Familiar/interactive raters are not always best: The influence of sampling schedules and class of behavior

Retrospective rating scales are widely used for formal assessment of typical performance. Raters who are the most familiar/interactive with ratees are routinely recommended to maximize the quality of ratings. This caveat to use the most familiar/interactive raters fails to distinguish sampling parameters of the observations on which ratings are based that may be important to assessing different classes of behavior. We hypothesized that systematic observational schedules would be of greater importance to ratings of public events than familiarity/interaction, per se, while the caveat would hold for ratings of private events. We used the Psychotic Inpatient Profile (PIP), which provides separate factor scores for ratings of public and private events, to examine these hypotheses in a quasi-experimental study with adult inpatients of mental hospitals. A large multiinstitutional data set provided retrospective PIP ratings by two types of raters. The most familiar/interactive local clinical staff for each client completed the PIP after observing on an ad lib schedule, along with ongoing job duties. Unfamiliar, noninteractive raters completed the PIP for each client after observing on a systematic time-sampling schedule for purposes of coding an entirely different instrument. Data were selected so that each of 189 clients received PIP scores from four raters, reflecting functioning during the same time period based on day-shift observations by one rater of each type and evening-shift observations by one rater of each type. Analyses of variance, consistency/discriminability of ratings, and prediction of social-action outcomes all supported the hypotheses. We discuss alternative strategies that are better for assessing typical performance in most circumstances. We also provide recommendations for improving the adequacy of observations for those circumstances in which the standardized retrospective rating scale could be a cost-effective assessment strategy.This study was the basis of a master's thesis at the University of Houston by the senior author under the direction of the junior authors. Richard M. Rozelle served on the examination committee. This study was partially supported by grants to Gordon L. Paul from the National Institute of Mental Health, Public Health Service (MH-15353; MH-25464); the Illinois Department of Mental Health and Developmental Disabilities; the Joyce Foundation; the MacArthur Foundation; the Owsley Foundation; the Cullen Foundation; and the Center for Public Policy of the University of Houston.     

Discomfort with space and motion: A possible marker of vestibular dysfunction assessed by the situational characteristics questionnaire

Space and motion discomfort (SMD) refers to the situational specificity of symptoms occurring in some patients with vestibular dysfunction, such as those with balance disorders and some with panic disorder. SMD occurs in situations characterized by inadequate visual or kinesthetic information for normal spatial orientation. We report the results of two studies of the construct validity of the Situational Characteristics Questionnaire (SitQ), which has two subscales, both of which measure SMD: the SMD-I and SMD-II. In Study 1, the SitQ was administered to members of a self-help group for balance disorders, a psychiatric sample consisting of patients with panic disorder, nonpanic anxiety disorders, depression, and a sample of normals. SMD levels were the highest in the self-help balance group, next to the highest in the panic groups, and lowest in the remaining groups. In Study 2, the SitQ was administered to otolaryngological patients with vestibular dysfunction and to patients with hearing loss. SMD levels were higher in the vestibular patients. Data on internal consistency, test-retest reliability, and convergent and discriminant validity are presented. The SitQ, particularly the SMD-II, is recommended for quantifying space and motion discomfort in patients with anxiety and/or balance disorders.Study 1 was funded by MH 40757. Study 2 was funded by a grant from the Upjohn Company and MH 19816.     

Applications of social cognitive theory to the career development of women of color

This article provides a review of the literature on the educational and career development of women of color within the context of social cognitive career theory (Lent, et al, 1994 and Lent, et al, 1996). Specifically, possible gender, ethnic, racial, and cultural influences on career self-efficacy and outcome expectations are explored to delinate the potential mechanisms whereby ethnicity, culture, and ethnic and racial identity development, in interaction with gender, affect career choice and adjustment. Suggestions for future research on social cognitive career theory and the career development of women of color are presented.     

The Reinvention of Behavioral Health Services in the VA System

The Veterans Health Administration under the direction of Kenneth Kizer, M.D., has faced the challenge of providing high-quality health care while controlling costs. Under Dr. Kizer's direction, VA hospitals are moving toward managed patient centered primary care. Hospital organization, funding, and clinical practices have been changed. Reorganization has meant a variety of possibilities for psychologists employed in the VA system.     

Clarification of Religious Issues in Treatment Through Peer Supervision

This paper will review The Orthodox Jewish community's attitude towards mental health treatment, factors that facilitated attitudinal changes in the past decades, and the efficacy of a peer supervision group for therapists treating this population. A clinical vignette is included.     

Preschool Children's Emotional Expressions with Peers: The Roles of Gender and Emotion Socialization

This study examined whether mothers and fathers reported using different emotion socialization strategies and whether these differences were related to preschoolers' gender and emotional expressiveness during peer play. Ninety percent of the children were Caucasian, 6% were Asian-American, and 4% were Mexican-American. The positive expressive behavior of 82 preschoolers participating in two conflict eliciting situations with two same gender peers were coded. The scores for the two sessions were averaged. All of the mothers and 63 of the fathers were administered three emotion socialization questionnaires. Results revealed that girls expressed more positive emotion than boys. In addition, mothers and fathers also reported using different emotion socialization practices and, in some cases, this was dependent upon their child's gender. The findings also showed that mothers' and fathers' reports of emotion socialization practices were differentially related to children's emotionally expressive behavior during peer play. In addition, fathers' emotion socialization practices accounted for unique variance in children's emotionally expressive behavior over and above that explained by the maternal emotion socialization variables. These findings highlight the importance of mothers' and fathers' emotion socialization practices for preschoolers' emotional competence in emotionally challenging situations with peers.     

CPQ validity: The relationship between Children's Personality Questionnaire scores and teacher ratings

Scores on the Children's Personality Questionnaire (CPQ) were correlated with scores from rating scale items selected by a panel of raters measuring the same behavior as a CPQ scale. Data were obtained on a normal sample of school children in grades three to six and on two referred groups, underachievers and chilren with behavior or social problems. The teachers of the children were asked to complete two rating scales on each child. Correlations between rating scale scores and CPQ scores suggest that, in general, the CPQ does not measure the traits it purports to measure.     

College-bound girls and science careers: Perceptions of barriers and facilitating factors

Student perceptions of barriers, facilitating factors, and information needs related to the consideration of careers in science and technology were investigated with a nationwide sample of talented high school senior women (N = 1017). Data were collected through a mailed questionnaire as part of a broader National Science Foundation project. Results of the study suggest that relatively few girls choose careers in science and technology because: They have doubts about combining family life with a science career; they lack information about steps in preparing for a science career; they believe influential adults; and they see few examples of the important role women can play in science. The data describing the students' perceptions of facilitating factors and information needs suggest that encouragement from family, access to role models, extra help and encouragement from science teachers, and information about careers in science, including the steps involved in preparation, might be influential in helping change perceptions of barriers to careers in science and technology.