Alliance Ratings as a Part of Trainee Evaluations Within Family Therapy Training

Client-reported therapeutic alliance scores were examined as a measure of improvement in therapeutic skills across master's-level marriage and family therapy (MFT) training. The results indicate significant correlations between alliance ratings and training variables, with the number of cumulative clinical hours identified as a significant predictor of alliance ratings according to a regression analysis. Trainees lacking the expected number of clinical contact hours in each level of training were found to be more likely to receive consistently marginal alliance ratings. Additionally, alliance ratings were especially useful in identifying trainees who were functioning at minimal levels of competency.     

Identifying Causes of Disagreement Between Self-Reports and Spouse Ratings of Personality

Self-reports and spouse ratings of personality traits typically show less-than-perfect agreement, but powerful moderators of agreement have not yet been identified. In Study 1, 47 married couples completed the Revised NEO Personality Inventory to describe themselves and their spouses. Extent of agreement was not consistently moderated by response sets; the age, intelligence, or education of the respondent; or the length or quality of the relationship. In Study 2 these couples were interviewed about reasons for substantial disagreements, and an audiotape was content-analyzed. Sixteen reasons were reliably coded, including idiosyncratic understanding of items, reference to different time frames or roles, and unavailability of covert experience to the spouse. Faking good, assumed similarity, and other variables prominent in the psychometric literature were relatively unimportant. Findings (1) suggest that attempts to improve the validity of self-reports and ratings may need to be refocused and (2) underscore the desirability of routinely obtaining multiple sources of information on personality.     

Polyamory: Experiences of Power from Without,from Within,and in Between

This article highlights the ways in which cultural, relational, and therapeutic power can affect polyamorous relationships and the therapeutic process. In therapy, focusing on the power narratives that polyamorous partners might experience can aid in challenging mononormativity while creating space for a variety of relational orientations. Power processes are presented as occurring on three levels: social discourse (without), relational meaning-making (within), and therapeutic practice (in between). A case study is used to evaluate these processes and implications are provided for clinicians working with polyamorous families.     

Vicissitudes of Student Group Psychotherapists

Abstract

This article describes the main processes and themes in consciousness-raising gender conflict groups for undergraduate students who study in parallel a course on gender and psychology. The main theme of the course is that gender is a classification system that influences individuals, interactions between individuals, and social institutions. The aim of the groups is to provide students with a safe environment to discuss their thoughts and feelings following the encounter of these ideas. Group leading is based on a combination of principles derived from consciousness-raising groups from the 1970s and a model for working with groups in conflict.     

Parent-Offspring and Sibling Adoption Analyses of Parental Ratings of Temperament in Infancy and Childhood

A first step toward understanding the etiology of personality is to investigate the relative impact of genetic and environmental factors using twin and adoption designs. Twin studies of infants and young children indicate substantial genetic influence for parental ratings of temperament in the preschool years. Adoption studies, however, have not previously been reported during the early years of life. We present parent-offspring comparisons for temperament (emotionality, activity, sociability, and impulsivity) for adopted and nonadopted children yearly from 1 to 7 years of age and their biological, adoptive, and nonadoptive parents. Also presented are correlations for adoptive and nonadoptive siblings when each child was 1, 2, 3, and 4 years of age. In contrast with twin results, little evidence is found for genetic influence. The average correlation between biological parents and their adopted-away children for data averaged over the 7 years is only .03. Similarly, the average parent-offspring correlation in nonadoptive families (.08) is no greater than in adoptive families (.12). Results for nonadoptive and adoptive siblings also indicate little genetic influence. The difference between the twin and adoption results may be due to environmental effects or to nonadditive genetic variance.     

Exploring the Relationship Between Interrater Correlations and Validity of Peer Ratings

A field study was conducted to investigate the relationship between interrater correlations and validity estimates of peer ratings. Validity coefficients and interrater correlations were calculated for 281 work units in a large law enforcement organization in Israel. The main result was a weak positive linear relationship between these two variables. Furthermore, in some of the analyses conducted, a nonlinear quadratic component in the relationship between these measures was evident. Validity was low only when interrater correlation was very low (r = .4 and less). Above this level, validity was stable and almost did not change as interrater correlation increased. This finding, together with other studies (Borman, 1975 Borman, W. C. 1975. Effects of instructions to avoid halo error on reliability and validity of performance evaluation ratings. Journal of Applied Psychology, 60: 556–560. [Crossref], [Web of Science ®] , [Google Scholar]; Buckner, 1959 Buckner, D. N. 1959. The predictability of ratings as a function of interrater agreement. Journal of Applied Psychology, 43: 60–64.  [Google Scholar]; Freeberg, 1969 Freeberg, N. E. 1969. Relevance of rater-ratee acquaintance in the validity and reliability of ratings. Journal of Applied Psychology, 53: 518–524.  [Google Scholar]; Weekley & Gier, 1989 Weekley, J. A. and Gier, J. A. 1989. Ceilings in the reliability and validity of performance ratings: The case of expert raters. Academy of Management Review, 32: 213–222.  [Google Scholar]), cast doubt on the assertion that interrater correlation in the field of performance rating is a proper measurement of reliability.     

Relationship Between Counselors' Clinical Hypotheses and Client Ratings of Counselor Effectiveness

The authors assessed the relationship of counseling students' hypothesis formation skill levels to counseling effectiveness. Hypothesis rating scales were selected to assess skill in using a comprehensive range of client data, integrating multiple client dimensions, and forming questions for hypothesis testing. Results indicated that higher ratings of hypothesis formation skill were associated with higher client ratings of counselor effectiveness. A combination of four hypothesis skill ratings predicted more than 60% of the variance in total Counselor Rating Form-Short version (CRF-S) scores, and one or more hypothesis formation skills were predictive of each CRF-S subscale score.     

A Meta-Analysis of the Relationship Between Rater Liking and Performance Ratings

This meta-analysis reviewed the magnitude and moderators of the relationship between rater liking and performance ratings. The results revealed substantial overlap between rater liking and performance ratings (ρ = .77). Although this relationship is often interpreted as indicative of bias, we review studies that indicate that to some extent the relationship between liking and performance ratings potentially reflects “true” differences in ratee performance. Moderator analyses indicated that the relationship between liking and performance ratings was weaker for ratings of organizational citizenship behaviors, ratings made by peer raters, ratings in nonsales jobs, and ratings made for development; however, the relationship was strong across moderator levels, underscoring the robustness of this relationship. Implications for the interpretation of performance ratings are discussed.     

Explaining the Weak Relationship Between Job Performance and Ratings of Job Performance

Ratings of job performance are widely viewed as poor measures of job performance. Three models of the performance–performance rating relationship offer very different explanations and solutions for this seemingly weak relationship. One-factor models suggest that measurement error is the main difference between performance and performance ratings and they offer a simple solution—that is, the correction for attenuation. Multifactor models suggest that the effects of job performance on performance ratings are often masked by a range of systematic nonperformance factors that also influence these ratings. These models suggest isolating and dampening the effects of these nonperformance factors. Mediated models suggest that intentional distortions are a key reason that ratings often fail to reflect ratee performance. These models suggest that raters must be given both the tools and the incentive to perform well as measurement instruments and that systematic efforts to remove the negative consequences of giving honest performance ratings are needed if we hope to use performance ratings as serious measures of job performance.     

Factor Structure and Criterion Validity of Secondary School Teacher Ratings of ADHD and ODD

Attention-Deficit Hyperactivity Disorder (ADHD) is currently viewed as a heterogeneous disorder with two factors: inattention and impulsivity–hyperactivity. This conceptualization of ADHD is based primarily on research with children or samples that mix children and adolescents. To examine if the 2-factor ADHD model is appropriate for adolescents and if the ADHD factors are distinct from Oppositional Defiant Disorder (ODD) in adolescents, teacher rating data were collected for 2 samples of adolescents. The results of a confirmatory factor analysis supported the convergent and divergent validity of a model with separate but correlated factors for inattention, impulsivity–hyperactivity, and defiant behavior. Further evidence of construct validity was found when factor scores were examined relative to the criterion variables of academic performance and rule-breaking behavior. The results support the utility of teacher ratings of ADHD and ODD in the assessment of adolescents, and the applicability of the DSM-IV conceptualization of these disorders to adolescents.     

Effects of Work Group Size and Task Size on Observers' Job Characteristics Ratings

The effects of number of workers (work-group size) and number of tasks (task size) on perceptions of job enrichment were investigated using a simulated assembly-line job. Forty subjects observed workers performing a job in four combinations of work-group size and task size, rating the respective jobs on dimensions taken from the Job Characteristics Model (Hackman & Oldham, 1975). The results indicated that jobs performed by smaller work groups were perceived as significantly more enriched on four of the five dimensions and had greater potential for worker motivation. Significant main effects were also found for task size on three of the five dimensions such that jobs with larger tasks were seen as more enriched and as having greater motivating potential for the workers. A significant interaction was noted for only one job dimension. An ecological perspective of the data (manning theory) supported these results and suggests theoretically useful interpretations of the data.     

Group Reward Contingencies and Cooperative Learning: Immediate and Delayed Effects on Academic Performance,Self-esteem,and Sociometric Ratings

While cooperative learning methods have been reported to have positive effects on a range of personal and social student outcomes, research into their academic benefits has produced mixed results. This study evaluated the effects of one cooperative learning method (cooperative reading and integrated composition, or CIRC) on the reading achievement, sociometric ratings, and self-esteem of 83 third-graders under three reward conditions (group rewards, individual rewards, and no rewards). Although students in the group rewards condition achieved significantly (p < 0.05) higher rate and accuracy scores on weekly reading quizzes than those in the individual and no rewards conditions, this effect was not reflected in overall pre–post reading test scores. There were also no significant effects for condition on the sociometric questionnaire. There was, however, a significant condition by sex interaction effect on total self-esteem scores, which indicated higher scores in the group rewards condition than in the other two conditions for girls. Results are interpreted in light of their practical implications for the application of the CIRC method in school settings, and their theoretical implications for research on the impact of group reward contingencies in cooperative learning methods. This revised version was published online in August 2006 with corrections to the Cover Date.     

Parent Ratings of Attention-Deficit/Hyperactivity Disorder Symptoms: Factor Structure and Normative Data

Changes in the diagnostic criteria for attention-deficit/hyperactivity disorder (ADHD) have necessitated the creation of new measures for clinical assessment. The factor structure of a parent rating scale containing the 18 symptoms of ADHD was examined in this study. Factor analyses and assessment of differences in ADHD ratings across sex, age, and ethnic group were conducted using a sample of 4666 participants ranging in age from 4 to 20 years old who attended kindergarten through 12th grade in 22 school districts across the United States. Two factors (Inattention and Hyperactivity–Impulsivity) were derived and normative data for a nationally representative sample are presented. A higher frequency of ADHD symptoms was found for boys, younger children, and African-American participants. Potential uses of this scale in clinical practice and research are discussed.     

Relations Between Adolescent Ratings of Rothbart's Temperament Questionnaire and the HEXACO Personality Inventory

Conventionally, individual differences have been assessed using temperament measures for infants and children, and personality measures for adults. We chose to explore both temperament and personality to see whether a convergence exists specifically during adolescence. A sample of 225 adolescents completed Rothbart's Early Adolescent Temperament Questionnaire–Revised (EATQ–R), a 4-factor temperament scale, and the HEXACO Personality Inventory–Revised (HEXACO PI–R), a 6-factor personality scale. As hypothesized, we found significant relations between the 2 measures. However, there were some important differences between the 2 measures regarding Honesty–Humility, Openness, and Frustration that highlight the unique contributions of both instruments to understanding and measuring adolescent individual differences. As there is a relatively scant history of measuring temperament or personality in adolescence, it is sometimes difficult for researchers to decide which instrument is most appropriate. The results reported here suggest that either the EATQ–R or the HEXACO PI–R could be appropriate, depending on the specific research questions being asked.     

A Multivariate Analysis of Selected Class Characteristic and Student Rating of Instruction

This study examined the relationship between selected class characteristics and student ratings of instructors. A large number of classes (N = 1247)and students (over 33,000) a t a large Midwestern University provided the data for this study. The results indicated that the class characteristics that had the strongest influence on the results of instructor ratings were the grades expected by students and the percentage of students in the class taking the course as an elective.     

Item Response Theory Analyses of the Parent and Teacher Ratings of the DSM-IV ADHD Rating Scale

The graded response model (GRM), which is based on item response theory (IRT), was used to evaluate the psychometric properties of the inattention and hyperactivity/impulsivity symptoms in an ADHD rating scale. To accomplish this, parents and teachers completed the DSM-IV ADHD Rating Scale (DARS; Gomez et al., Journal of Child Psychology and Psychiatry, 40, 265–274, 1999) for a group of 1,475 primary school-aged children. The results for the discrimination parameters showed that all symptoms for both groups of respondents were generally good for discriminating their respective latent traits. For virtually all symptoms, their threshold values showed moderate to large increases in the level of the latent trait at each subsequent response dichotomy, with the symptoms being especially good at representing the appropriate traits from mean to moderately high trait levels. The item information function values for most symptoms indicated reasonable reliability from, approximately, the mean trait levels to moderately high trait levels. These findings indicate good psychometric properties for the parent and teacher ratings of the DARS. The implications of the findings for the use of the DARS and other similar scales are discussed.     

Providing Choice Making Opportunities Within and Between Daily School Routines

The purpose of this study was to investigate the effects of providing choice making opportunities, embedded within and between daily school routine activities, on the frequency of protests and task initiations exhibited by a student with a severe intellectual disability. An ABABC single-subject design was used to evaluate the effects of choice making opportunities embedded within and between three daily routine activities. During phase A, the classroom staff directed the student's participation without providing choice making opportunities within the activities. In phase B, staff provided choice making opportunities embedded within steps of each activity. Phase C extended choice making opportunities by providing the participant with a choice between activities as well as within the steps of the activities after it was noted that the first step of beginning the activities occasioned more protests than the other steps. The results of this study replicate earlier research showing that embedded choice making opportunities within routines reduced protests and increased task initiations. The addition of choice making opportunities between activities during phase C further reduced the incidents of protests.     

A Comparative Investigation of Rotation Criteria Within Exploratory Factor Analysis

Exploratory factor analysis (EFA) is a commonly used statistical technique for examining the relationships between variables (e.g., items) and the factors (e.g., latent traits) they depict. There are several decisions that must be made when using EFA, with one of the more important being choice of the rotation criterion. This selection can be arduous given the numerous rotation criteria available and the lack of research/literature that compares their function and utility. Historically, researchers have chosen rotation criteria based on whether or not factors are correlated and have failed to consider other important aspects of their data. This study reviews several rotation criteria, demonstrates how they may perform with different factor pattern structures, and highlights for researchers subtle but important differences between each rotation criterion. The choice of rotation criterion is critical to ensure researchers make informed decisions as to when different rotation criteria may or may not be appropriate. The results suggest that depending on the rotation criterion selected and the complexity of the factor pattern matrix, the interpretation of the interfactor correlations and factor pattern loadings can vary substantially. Implications and future directions are discussed.