Accountability and need for cognition effects on contrast, halo, and accuracy in performance ratings

In the present study, the authors investigated the effects of accountability and need for cognition on contrast errors, halo, and accuracy of performance ratings examined in good and poor performance context conditions, as well as in a context-free control condition. The accountability manipulation reduced the contrast effect and also modified rater recall of good ratee behavior. Accountability reduced halo in ratings and increased rating accuracy in a poor performance context. Accountability also interacted with need for cognition in predicting individual rater halo.     

The influence of delaying judgments of learning on metacognitive accuracy: a meta-analytic review

Many studies have examined the accuracy of predictions of future memory performance solicited through judgments of learning (JOLs). Among the most robust findings in this literature is that delaying predictions serves to substantially increase the relative accuracy of JOLs compared with soliciting JOLs immediately after study, a finding termed the delayed JOL effect. The meta-analyses reported in the current study examined the predominant theoretical accounts as well as potential moderators of the delayed JOL effect. The first meta-analysis examined the relative accuracy of delayed compared with immediate JOLs across 4,554 participants (112 effect sizes) through gamma correlations between JOLs and memory accuracy. Those data showed that delaying JOLs leads to robust benefits to relative accuracy (g = 0.93). The second meta-analysis examined memory performance for delayed compared with immediate JOLs across 3,807 participants (98 effect sizes). Those data showed that delayed JOLs result in a modest but reliable benefit for memory performance relative to immediate JOLs (g = 0.08). Findings from these meta-analyses are well accommodated by theories suggesting that delayed JOL accuracy reflects access to more diagnostic information from long-term memory rather than being a by-product of a retrieval opportunity. However, these data also suggest that theories proposing that the delayed JOL effect results from a memorial benefit or the match between the cues available for JOLs and those available at test may also provide viable explanatory mechanisms necessary for a comprehensive account.     

Anchoring effects on performance judgments

Three studies were conducted investigating the effects of irrelevant anchors on performance judgments. Both a lab and field study demonstrated that an alternative anchoring manipulation that did not involve an explicit comparative question had effects on performance judgments similar to a traditional anchoring manipulation. The final study examined whether the anchoring effects were more likely when the anchor was highly applicable to the final judgment. The results indicated that both highly applicable and low applicable anchors produced an anchoring effect, but the highly applicable anchors had a larger effect on performance judgments. Evidence was also found for asymmetrical anchoring effects. In two of the three studies, high anchors increased performance judgments relative to the control group, whereas low anchors were not significantly different from the control group.     

Examining contrast effects in performance appraisals: using appropriate controls and assessing accuracy

In research on contrast effects in performance appraisals, control conditions or measures of accuracy have rarely been used. In the present study, the authors included appropriate controls and used expert ratings to develop "true scores" for assessing accuracy. The study is an examination of the influence of 3 variables on performance ratings: (a) the sequence of viewing and rating performance, (b) the delay between viewing and rating performance, and (c) whether the target of the performance rating was the same person as the anchor. Experimental conditions did not have the expected differential effects on target ratings, but target ratings in all the experimental conditions showed contrast effects when compared with ratings in relevant control conditions. The target ratings in experimental conditions were accurate, however, as assessed by comparisons with true scores, thus raising questions about the relationship between contrast effects and accuracy.     

The effects of angle-arm length on judgments of angle magnitude and orientation contrast

Acute angles frequently are overestimated, an effect that has been attributed to lateral inhibitory mechanisms. It can be derived from such theories that lengthening the arms of an angle should either reduce or not affect its judged subtense. However, in Experiments 1 and 2, it was found that angles with longer arms were judged larger. In Experiment 3, direct measures of anglearm orientation indicated that orientation contrast does not increase with angle-arm length, that it decreases with distance from the angle vertex, and that these effects are not averaged along the entire length of the arm. It follows that inhibitory mechanisms alone cannot explain why longer armed angles appear larger or why angle arms appear straight rather than bowed. It is suggested that a distinction is required between the orientation and the angular domains and that the latter judgments depend, at least partially, on the space or area within an angle. The fact that angles appear unbowed may reflect the fact that perceived orientation differences occur along an angle’s arm only when matches are made to small segments of the arm.     

Independence and interdependence of group judgments: Xenophobia and minority influence

A first experiment examined the effects of two methods of dividing resources between Swiss nationals and foreign residents in a study involving 118 subjects. Subjects gave judgments involving either interdependent allocation (resources allocated to the outgroup cannot be allocated to the ingroup) or independent allocation. The results indicated that the socio-cognitive functioning preferred by subjects varies as a function of their view of outsiders. Interdependence of judgments was more characteristic of the most xenophobic subjects, whereas the least xenophobic were more likely to reason in terms of independence. On the other hand, intermediate subjects (those who were clearly neither for nor against outsiders) were sensitive to these modalities of judgment: interdependence engendered an ingroup favoritism, while independence counteracted this bias. A second experiment further analysed the influence of a more or less imperative minority argument on the attitudes of 109 more xenophobic subjects. Independent as compared to interdependent judgment facilitated a latent influence by the source, especially when the source employed a more imperative rhetoric to urge a more favourable attitude to foreigners.     

Transactive memory in organizational groups: the effects of content, consensus, specialization, and accuracy on group performance

Previous research on transactive memory has found a positive relationship between transactive memory system development and group performance in single project laboratory and ad hoc groups. Closely related research on shared mental models and expertise recognition supports these findings. In this study, the author examined the relationship between transactive memory systems and performance in mature, continuing groups. A group's transactive memory system, measured as a combination of knowledge stock, knowledge specialization, transactive memory consensus, and transactive memory accuracy, is positively related to group goal performance, external group evaluations, and internal group evaluations. The positive relationship with group performance was found to hold for both task and external relationship transactive memory systems.     

The influence of instructions and terminology on the accuracy of remember–know judgments

The remember–know paradigm is one of the most widely used procedures to examine the subjective experience associated with memory retrieval. We examined how the terminology and instructions used to describe the experiences of remembering and knowing affected remember–know judgments. In Experiment 1 we found that using neutral terms, i.e., Type A memory and Type B memory, to describe the experiences of remembering and knowing reduced remember false alarms for younger and older adults as compared to using the terms Remember and Know, thereby increasing overall memory accuracy in the neutral terminology condition. In Experiment 2 we found that using what we call source-specific remember–know instructions, which were intended to constrain remember judgments to recollective experiences arising only from the study context, reduced remember hits and false alarms, and increased know hits and false alarms. Based on these data and other considerations, we conclude that researchers should use neutral terminology and source-specific instructions to collect the most accurate reports of the experiences of remembering and knowing arising from the study context.     

The effects of unidirectional versus bidirectional rating procedures on college students' judgments of response-outcome contingency

Studies of human contingency judgment often reveal substantial bias and inaccuracy in ratings of cause-effect relationship. This study examined the effects of different rating procedures on contingency judgment. In two experiments, college students responded to and rated a range of positive, negative, and zero contingencies presented in a free-operant format. Experiment 1 found that judgments made along a unidirectional 0 to 100 “control” scale were less sensitive to variations in contingency (especially negative ones) and were based on less sophisticated judgment strategies than judgments made along a bidirectional − 100 to + 100 “prevent-cause” scale. Experiment 2 found that informing subjects given the unidirectional scale that their responding may either cause or prevent the outcome eliminated the tendency to underestimate negative contingencies and improved the sophistication of strategy use but did not increase judgment sensitivity to the level of subjects given the bidirectional scale. Taken together, these results suggest that the bidirectional “prevent-cause” scale contributes to highly accurate and unbiased ratings of response-outcome contingency.     

On being sad and mistaken: mood effects on the accuracy of thin-slice judgments

A series of studies explored how sadness impacts the accuracy of social judgments. In Study 1, induced sadness led to reduced accuracy in judgments of teacher effectiveness from brief samples of nonverbal behavior (thin slices). In Study 2, sad participants showed reduced accuracy in judging relationship type from thin slices as well as diminished judgmental efficiency. Study 3 revealed that higher Beck Depression Inventory scores were associated with diminished accuracy on the Profile of Nonverbal Sensitivity. Finally, Study 4 tested the possibility that sadness impairs accuracy by promoting a more deliberative information-processing style. As expected, accuracy was higher among participants in a sad mood condition who completed the judgment task while simultaneously performing a distracting cognitive load task.     

Rating ability in performance judgments: The joint influence of implicit theories and intelligence

The purpose of this study was to approach the issue of rating ability by examining the influence of rater implicit theories and rater intelligence on rating outcomes. Using the inferential accuracy model (Jackson, 1972), raters were identified as either possessing a normative or idiosyncratic implicit theory of the occupation of college instructor. In a laboratory setting, 50 normative and 50 idiosyncratic raters judged the videotaped performance of either a good or poor lecturer. Results showed that (a) intelligence was positively related to rating accuracy and to possessing a normative implicit theory, (b) rater type moderated the relationship between intelligence and rating accuracy, and (c) controlling for intelligence, normative raters committed stronger halo effects than idiosyncratic raters. These results were discussed in relation to furthering the understanding of rating ability.     

The effects of noise on the performance of simultaneous interpreters: accuracy of performance

The effect of noisy listening conditions on the performance of simultaneous interpreters was studied by asking subjects to shadow and simultaneously interpret French prose into English at 3 signal-noise ratios. It was found that while noise had a significant effect on the proportions of texts correctly shadowed and interpreted, there were significantly more errors committed when interpreting than when shadowing at lower signal-noise ratios. This finding, together with analysis of subjects' self-corrections when interpreting, suggested that difficulty in perceiving source language passages reduced the ability of simultaneous interpreters to monitor their interpretations into the target language.