Managerial Experience and the Measurement Equivalence of Performance Ratings

ABSTRACT: Establishing the measurement equivalence of instruments is a prerequisite to making meaningful comparisons between individuals or within individuals over time. Whereas previous research has investigated the effects of rater characteristics on the measurement equivalence of performance ratings, the current study investigated a ratee characteristic—ratee job experience. Using confirmatory factor analysis and item response theory methods with replication, the measurement equivalence of supervisor ratings of 7,200 managers with differing levels of managerial experience was assessed. Overall, results indicated a high degree of measurement equivalence suggesting that meaningful comparison may be made across ratees with different levels of job experience.     

Core Self-Evaluations and Work Success

ABSTRACT— Core self-evaluations (CSE) is a broad, integrative trait indicated by self-esteem, locus of control, generalized self-efficacy, and (low) neuroticism (high emotional stability). While only a decade old, research on CSE suggests that it explains much of the overlap among these trait measures, while also predicting many work and other applied outcomes better than the individual traits. Individuals with high levels of CSE perform better on their jobs, are more successful in their careers, are more satisfied with their jobs and lives, report lower levels of stress and conflict, cope more effectively with setbacks, and better capitalize on advantages and opportunities. Though research on individual self-concept traits such as self-esteem and locus of control should continue, researchers interested in these traits should consider the advantages of CSE in its relation to success in work and in life.     

A Comparison of Adaptive Behavior Ratings: Revised Vineland and AAMD ABS-SE

Although the assessment of adaptive behavior is a mandated component of many school assessments, concerns have been raised about the measurement of the construct and related professional practices. Estimates of adaptive behavior have been shown sometimes to vary by instruments and raters and therefore may influence placement decisions in unknown ways. This study examined the agreement among teachers and parents on the revised Vineland and the AAMD Adaptive Behavior Scale-School Edition for a sample of developmentally handicapped children. A sample of learning disabled children was also included in order to explore the effects of a restricted range on the correlations. Also, the potential effects of estimates of adaptive behavior on placement decisions were analyzed. The results suggest that serious discrepancies could occur that would directly affect placement decisions.     

核心自我评价：人格倾向研究的新取向

国外学者整合了有关工作满意度的人格倾向研究,并在此基础上提出了核心自我评价的概念。核心自我评价包括四种核心特质：自尊、控制点、神经质和一般自我效能。四种特质构成了一个更为基本的结构。核心自我评价及四种核心特质与工作态度和工作行为存在较强的相关,且能够有效预测这些变量。文章最后指出了今后的研究方向,比如对于结构问题的探讨和跨文化研究的深入     

The Impact of Territory Difficulty and Self Versus Other Ratings on Managerial Evaluations of Sales Personnel

Previous research has yielded inconclusive evidence regarding whether territory difficulty information influences evaluations of salesperson performance. Two studies were conducted to assess whether a territory difficulty bias exists. In addition, the research tested for a divergence in performance ratings depending upon whether the evaluation was completed by a salesperson or a sales manager. The results show that, given the right conditions, territory difficulty bias can be overcome, and that previous failures to find territory difficulty effects in similar studies were likely caused by Type II errors. Also, the results indicate that self-ratings do tend to exhibit an upward bias over ratings by others.     

A Meta-Analytic Review of Paternalistic Leadership

Scholars have proposed that paternalistic leaders may demonstrate authoritarianism, benevolence, and morality in their actions. In this study, I conduct a meta-analysis of the relationships between paternalistic leadership and follower work outcomes. I found that authoritarian leadership is related negatively and benevolence and moral leadership are related positively to numerous follower outcomes. Results from relative weight analyses suggest unique contribution of paternalistic leadership over and above transformational leadership and leader member exchange (LMX) in the prediction of follower outcomes. Moreover, I found that LMX partially mediates the relationship between paternalistic leadership and follower outcomes. With respect to moderators, I found mixed evidence for publication status and power distance. Finally, studies that used Cheng et al.’s measurement showed weaker mean corrected correlations and employee samples from law enforcement organisations showed stronger mean corrected correlations for relationships between paternalistic leadership and follower work outcomes.     

The Role of Temporal Comparison, Social Comparison, and Direct Appraisal in the Elderly's Self-Evaluations of Health

Elderly persons (n= 91) were interviewed about self- perceptions of physical health and the contribution of social comparison, temporal comparison, and direct appraisal to these judgments. Consistent with previous studies, self-assessments tended to be mainly positive (67% reported their health as “good” or “excellent”), though tempered somewhat by the individual's objective physical condition (i.e., number of chronic diseases or disabilities). Independent of objective health, respondents' ratings were more negative if they mentioned thinking about past or anticipated health. Respondents were more concerned about their health if they thought about their past or anticipated health or mentioned comparing with a specific other person. Direct feedback had no effect on health ratings. Among those who reported social comparison, ratings were more positive when worse-off others were mentioned. Temporal comparisons may be associated with more negative ratings because the elderly's past health is likely to have been better and their future (anticipated) health can be expected to become worse. If using temporal and social comparison information is associated with more negative assessments then what accounts for the generally positive self-assessments? We propose that the elderly compare themselves with a cognitively constructed stereotypical standard of the frail elderly rather than with a specific other. Because few elderly actually “fit” this stereotype, most elderly feel they are doing well.     

A Comparison of Expert Ratings and Self-Assessments of Situation Awareness During a Combat Fatigue Course

The current study compared expert-observer ratings of situation awareness (SA) with subjective self-ratings of SA in Norwegian military academy cadets during a summer combat survival course. The cadets (N?=?30) completed an 8-day combat survival course characterized by sleep and food deprivation, continuous operations, and altered circadian entrainment cues. Results indicated that self-ratings of SA did not correlate consistently with expert-observer SA ratings, and self-ratings were consistently higher than expert-observer ratings. The results are congruent with expected effects of these extreme conditions on cognition and self-awareness, demonstrate a pronounced self-enhancement bias and suggest that subjective measures of SA are not likely to provide valid estimates of SA under extreme conditions.     

核心自我评价研究的反思与展望

核心自我评价是一种潜在的、宽泛的人格结构, 被定义为个体对自我能力和价值所持有的最基本的评价和估计。在过去十余年里, 核心自我评价的研究重点从早期关注结构的验证与测量、探讨核心自我评价在工作领域中的功能, 到近期开始转向探讨与心理健康、学业行为等变量的关系。另外, 核心自我评价的预测作用和调节作用可从动机、图式、能力、应对与获益和自我验证五种机制进行解释。核心自我评价的起源、过高核心自我评价是好是坏、核心自我评价还应包括或排除哪些因素、核心自我评价是否只有高低之分、“参照框架”对核心自我评价的预测力有何影响等涉及核心自我评价性质的问题目前仍没有得到解决。未来的研究可着眼于扩大研究领域、解决与核心自我评价性质有关的问题以及对核心自我评价进行本土化研究。     

Perceptions of Ingroup and Outgroup Variability: A Meta-Analytic Integration

This article reports the results of a meta-analytic integration of previous research on perceptions of ingroup and outgroup variability. The following patterns were observed: The tendency to perceive greater variability for the ingroup relative to the variability perceived for the outgroup (relative heterogeneity) was demonstrated to be a significant but small effect. The basic relative heterogeneity effect is the result of a small shift away from the midpoint of the scale toward homogeneity for the outgroup, coupled with a smaller, slight shift away from the midpoint of the scale toward heterogeneity for the ingroup, in addition, perceptions of group variability were demonstrated to vary in predictable and interesting ways. For example, relative heterogeneity decreases as the relative size of the ingroup decreases, producing a relative homogeneity effect on the part of small minorities. Relative heterogeneity is strongest when the ingroup and outgroup comprise real, enduring groups, and weakest when the ingroup and outgroup comprise artificial, laboratory-created groups. Discussion considers the implications of these results for the various proposed mediating mechanisms for perceptions of group variability, and for an understanding of the phenomenology of being in a group.     

Maternal Depression and Child Psychopathology: A Meta-Analytic Review

Although the association between maternal depression and adverse child outcomes is well established, the strength of the association, the breadth or specificity of the outcomes, and the role of moderators are not known. This information is essential to inform not only models of risk but also the design of preventive interventions by helping to identify subgroups at greater risk than others and to elucidate potential mechanisms as targets of interventions. A meta-analysis of 193 studies was conducted to examine the strength of the association between mothers’ depression and children’s behavioral problems or emotional functioning. Maternal depression was significantly related to higher levels of internalizing, externalizing, and general psychopathology and negative affect/behavior and to lower levels of positive affect/behavior, with all associations small in magnitude. These associations were significantly moderated by theoretically and methodologically relevant variables, with patterns of moderation found to vary somewhat with each child outcome. Results are interpreted in terms of implications for theoretical models that move beyond main effects models in order to more accurately identify which children of depressed mothers are more or less at risk for specific outcomes.     

单维测验合成信度元分析

元分析是根据现有研究对感兴趣的主题得出比较准确和有代表性结论的一种重要方法,在心理、教育、管理、医学等社会科学研究中得到广泛应用。信度是衡量测验质量的重要指标,用合成信度能比较准确的估计测验信度。未见有文献提供合成信度元分析方法。本研究在比较对参数进行元分析的三种模型优劣的基础上,在变化系数模型下推出合成信度元分析点估计及区间估计的方法;以区间覆盖率为衡量指标,模拟研究表明本研究提出的合成信度元分析区间估计的方法得当;举例说明如何对单维测验的合成信度进行元分析。     

Narcissistic Illusions in Self-Evaluations of Intelligence and Attractiveness

In this study we compared the ability of narcissism and self-esteem to predict positive illusions in self-evaluations of intelligence and physical attractiveness in a sample of 146 college students. Narcissism predicted both types of illusion for males and females; self-esteem predicted intelligence self-illusion for males. Both males and females overestimated their own intelligence, with males, but not females, also overestimating their attractiveness. Positive illusions for intelligence and attractiveness were correlated. Males showed greater positive illusions than females, with this effect at least partly attributable to observed gender differences in narcissism.     

Executive Function and the Frontal Lobes: A Meta-Analytic Review

Currently, there is debate among scholars regarding how to operationalize and measure executive functions. These functions generally are referred to as “supervisory” cognitive processes because they involve higher level organization and execution of complex thoughts and behavior. Although conceptualizations vary regarding what mental processes actually constitute the “executive function” construct, there has been a historical linkage of these “higher-level” processes with the frontal lobes. In fact, many investigators have used the term “frontal functions” synonymously with “executive functions” despite evidence that contradicts this synonymous usage. The current review provides a critical analysis of lesion and neuroimaging studies using three popular executive function measures (Wisconsin Card Sorting Test, Phonemic Verbal Fluency, and Stroop Color Word Interference Test) in order to examine the validity of the executive function construct in terms of its relation to activation and damage to the frontal lobes. Empirical lesion data are examined via meta-analysis procedures along with formula derivatives. Results reveal mixed evidence that does not support a one-to-one relationship between executive functions and frontal lobe activity. The paper concludes with a discussion of the implications of construing the validity of these neuropsychological tests in anatomical, rather than cognitive and behavioral, terms.     

A Developmental Analysis of Performance Ratings

In this study, we examined the performance appraisal process from a developmental perspective. Components of cognitive structure, measured in terms of differentiation and hierarchic integration, were obtained from 45 American students representing three different academic levels at three times during a 15-week semester. These students' performance evaluations (ratings) of their psychology instructors were collected during the first and final sessions. The results indicated that although both differentiation and hierarchic integration seemed to change systematically, even over a short period of time, there was no corresponding change in the halo inherent in the raters' ratings. We present possible explanations for the failure of developmental changes in cognitive structure to be reflected in the halo inherent in the performance ratings, as would be predicted by Schneier's (1977) cognitive compatibility hypothesis. Increased emphasis on developmental aspects of the performance appraisal process is recommended.     

Perceived Control and the Optimistic Bias: A Meta-Analytic Review

People consistently believe that negative events are less likely to happen to them than to others. Research suggests a relationship between this optimistic bias and perceived control such that the greater control people perceive over future events, the greater their optimistic bias. We conducted a meta-analysis of 27 independent samples to quantify the size of this relationship and examine what variables moderated the relationship. Greater perceived control was significantly related to greater optimistic bias, but this relationship was moderated by participant nationality, student status, risk status, and the type of optimistic bias measure used. We discuss the findings in the context of primary versus secondary control.     

A Meta-Analytic Review of the Common-Sense Model of Illness Representations

A meta-analysis of empirical studies ( N = 45) adopting Leventhal, Meyer and Nerenz's (1980) Common Sense Model (CSM) of illness representations is presented. The average corrected intercorrelation matrix for the sample of studies showed that the CSM illness cognition dimensions of consequences, control/cure, identity and timeline followed a logical pattern supporting their construct and discriminant validity across illness types. A content analysis classified coping strategies into seven distinctive categories and health outcomes into six categories. Examining the average corrected correlation coefficients across the studies revealed that perceptions of a strong illness identity were significantly and positively related to the use of coping strategies of avoidance and emotion expression. In addition, perceived controllability of the illness was significantly associated with cognitive reappraisal, expressing emotions and problem-focused coping strategies. Perceptions of the illness as highly symptomatic, having a chronic timeline and serious consequences was significantly correlated with avoidance and expressing emotions coping strategies. Further, perceptions that the illness was curable/controllable was significantly and positively related to the adaptive outcomes of psychological well-being, social functioning and vitality and negatively related to psychological distress and disease state. Conversely, illness consequences, timeline and identity exhibited significant, negative relationships with psychological well being, role and social functioning and vitality. The analyses provide evidence for theoretically predictable relations between illness cognitions, coping and outcomes across studies.     

Gender-Role Differences in Spatial Ability: A Meta-Analytic Review

Although gender-related differences in highly gender typed cognitive abilities are of considerable interest to educators and cognitive researchers alike, relatively little progress has been made in understanding the psychological processes that lead to them. Nash (1979) proposed a gender-role mediation hypothesis for such differences, with particular emphasis on spatial ability. However, changes in gender equality and gender stereotypes in the decades since merit a re-examination of whether a gender-role association still holds (Feingold 1988). A meta-analysis of 12 studies that examined gender-role identity and mental rotation performance was conducted. These included studies from the United Kingdom, Canada, Poland, Croatia, and the United States of America. The mean effect size for masculinity was r = .30 for men and r = .23 for women; no association was found between femininity and mental rotation. This effect size was slightly larger than that found previously by Signorella and Jamison (1986), and exceeds many other factors known to influence spatial ability. The implications of gender-role mediation of gender differences are discussed and future research directions are identified.     

Religion and Prejudice Toward Immigrants and Refugees: A Meta-Analytic Review

ABSTRACT

Religion is often a driving force in negative attitudes; however, in the specific case of migrant-based attitudes, research has produced conflicting findings. That is, religion can paradoxically facilitate either tolerance or intolerance toward this group. In light of these inconsistent findings, we conducted a meta-analytic review to estimate the effect size of this relationship with two major aims—first, to explore differences as a function of how religion was operationalised, and second, to explore differences in the target migrant-type (e.g., differences in religion-based attitudes toward immigrants and refugees/asylum seekers). Our search strategy was applied to PsycINFO, EBSCO Psychology and Behavioural Sciences Collection, Web of Science, PsycEXTRA, and ProQuest Central for peer-reviewed English language studies and made calls for unpublished data through relevant professional bodies. This search strategy yielded 37 records (including 43 studies; N = 472,688). Religion was quantified in two ways: either as categorical religious affiliations (k = 60) or as individual differences in self-reported religiosity (k = 30). The meta-analyses revealed that religion quantified as affiliation, but not religiosity, was related to negative migrant attitudes. Specifically, religiously affiliated samples report more negative attitudes than nonreligious affiliated samples, and this effect was often stronger when the target groups were refugees rather than immigrants. In addition, analyses revealed that Muslims have more negative attitudes toward migrants than Christians. Religiosity was unrelated to negative attitudes. These findings are discussed in light of rising antimigrant attitudes.