SINCE WHEN IS NO NEWS GOOD NEWS? THE RELATIONSHIP BETWEEN PERFORMANCE AND RESPONSE RATES IN MULTIRATER FEEDBACK

Despite the popularity of multirater feedback in practice and research, few studies have examined the issue of response rates in these efforts. This study explored the relationship between performance, vis-á-vis a measure of service quality, and feedback response rates in a large-scale developmental multirater feedback initiative using data from 538 senior service providers, 4,446 coworkers and supervisors, and 1,617 clients. The number of rater responses that the focal individual received was largely unrelated to his or her performance level as rated by his or her clients. More specifically, less than 2% of the variance in response rates was explained by the focal individual's performance. Data representativeness and feedback acceptance implications are discussed.     

How are high school studies related to performance in a psychology degree?

The relationship between performance in final high school studies, on which the university entrance system is based, and performance in a psychology major at university is examined. A total of 241 students were identified who completed first year psychology at a regional university, and had started university within two years of completing high school. Their marks in psychology subjects over the 3‐year major program, their University Admission Index (UAI) and Higher School Certificate subject profile were extracted from the university student records system and subjected to a series of analyses. Psychology marks were averaged to produce a score for each of the three year‐levels. UAI correlated with performance at all three levels (.42 – .49) and was the strongest predictor of performance. Having studied mathematics or a creative arts subject, but not a science subject, had a significant impact on performance in the psychology course over and above the influence of UAI score.     

THE ROLE OF COGNITIVE ABILITY IN THE SUBGROUP DIFFERENCES AND INCREMENTAL VALIDITY OF ASSESSMENT CENTER EXERCISES

This study investigates the degree to which subgroup (Black-White) mean differences on various assessment center exercises (e.g., in-basket, role play) may be a function of the type of exercise employed; and furthermore, begins to explore why these different types of exercises result in subgroup differences. The sample consisted of 633 participants who completed a managerial assessment center that evaluated them on 14 ability dimensions across 7 different types of assessment exercises. In addition, each participant completed a cognitive ability measure. The results suggest that subgroup differences varied by type of assessment exercise; and furthermore that the subgroup difference appeared to be a function of the cognitive component of the exercise. Lastly, preliminary support is found that the validity of some of the assessment center exercises in predicting supervisor ratings of job performance is based, in part, on their cognitive component; however, evidence of incremental validity does exist.     

INFLUENCE OF ASSESSMENT CENTER METHODS ON ASSESSORS'RATINGS

Recently a number of authors have argued persuasively that performance ratings are influenced to a large extent by the way the rater selects, organizes, stores, and recalls information. Although the influence of the rater's cognitive processes on the obtained ratings has been considered in the job-performance evaluation literature, this issue has not been considered in the assessment center literature. The purpose of the present study was to examine how assessment center methods affect the way assessors organize and process assessment center information and affect the ratings they make. Independent groups of assessors underwent one of two methods for evaluating candidates in an assessment center. Data indicated differences in the convergent and discriminant validities and differences in the factor structures of the ratings for the two methods. The pattern of results suggested that the two methods for evaluating assessment center candidates affected the way the assessors organized the assessment center information and affected the obtained ratings. Future research should consider assessment center methods and assessors as sources of variation in assessment center ratings.     

Childhood maltreatment and adult personality disorder symptoms in a non‐clinical sample

It can be argued that the well‐substantiated relationship between childhood maltreatment and adult personality disorder (PD) symptoms may be confounded by comorbid symptoms of depression, anxiety or dysfunctional childhood family environments. Therefore, the current study was designed to test the hypothesis that retrospective reports of childhood maltreatment would still be significantly related to reports of more PD symptoms when statistically controlling for these factors. One hundred and seventy‐eight non‐clinical participants were divided into groups reporting childhood maltreatment (n = 54) or not (n = 124) according to scores on the Childhood Trauma Questionnaire. Participants also completed questionnaires measuring current depression, anxiety, and PD symptoms as well as retrospective reports of their childhood environment. Results showed that individuals reporting childhood maltreatment reported more symptoms of PD than those not reporting childhood maltreatment, even when statistically controlling for depression, anxiety and retrospective reports of dysfunctional family environment. These findings underscore the relevance and independent contribution of childhood maltreatment to the development of PDs, with important implications for further research and clinical practice.     

FORCED DISTRIBUTION RATING SYSTEMS AND THE IMPROVEMENT OF WORKFORCE POTENTIAL: A BASELINE SIMULATION

Through simulation we investigate how characteristics of forced distribution rating systems (FDRS), which require firing a certain percentage of the workforce each year, might interact with ratings reliability, selection validity, selection ratio, and voluntary turnover to improve average workforce performance potential. Results suggest that a FDRS could lead to noticeable improvement in workforce potential, that most of the improvement should be expected to occur over the first several years, and that improvement is largely a function of the percentage of workers to be fired and the level of voluntary turnover. Greater improvement is associated with higher numbers being fired and lower levels of voluntary turnover. The effects of bundling FDRS with recruiting and retention initiatives are also investigated.     

Attachment avoidance and the cultural fit hypothesis: A cross-cultural investigation

This study examined the impact of attachment avoidance on relationship outcomes. A "cultural fit" hypothesis, which states that individual differences in personality should be associated with relationship problems if they encourage patterns of behavior that are incongruent with cultural norms, was investigated. It was hypothesized that attachment avoidance, a style of relationship in which emotional distance and independence are emphasized, would be more strongly associated with relationship problems in more collectivist societies (Hong Kong and Mexico) than in a more individualist one (the United States), given the greater emphasis placed on closeness and harmony in relationships in collectivist cultures. As predicted, associations between avoidant attachment and relationship problems were stronger in Hong Kong and Mexico than in the United States.     

Age‐related Changes in Creative Thinking

Age‐related differences in cognitive processes were used to understand age‐related declines in creativity. According to the Geneplore model (Finke, Ward, & Smith, 1992), there are two phases of creativity — generating an idea and exploring the implications of the idea — each with different underlying cognitive processes. These two phases are measured in the Creative Invention Task (CIT; Finke, 1990). Younger adults (n = 41) and older adults (n = 41) completed the CIT, the Torrance Tests of Creative Thinking (TTCT), and a measure of working memory capacity (Paper Folding test). In addition, the CIT was scored by both younger and older adults. There were age‐related declines on both phases of the CIT, but not on the TTCT. These declines were noted by both the younger and older raters. After adjusting for working memory capacity, however, age‐related differences on the CIT were nonsignificant.     

UNDERSTANDING RESPONSE BEHAVIOR TO AN ONLINE SPECIAL TOPICS ORGANIZATIONAL SATISFACTION SURVEY

In this study we sought to better understand response intentions and response behavior to an online special topics university satisfaction survey to not only advance theory but to better inform practice on the meaning and implications of nonresponse to their efforts. Using the Rogelberg, Luong, Sederburg, and Cristol (2000) response behavior model, data collected in this 2-wave field study (394 students, 50% men) supported most of the framework's major assertions, supported our proposed extensions, and resulted in a few unexpected findings. Overall, to understand response behavior to an online special topics organizational survey, one must take into consideration factors related to technology, attitudes toward surveys in general, satisfaction with the specific topic in question, and response intentions.