Rater Personality,Rating Format,and Social Context: Implications for Performance Appraisal Ratings

This study investigates the effects of rater personality (Conscientiousness and Agreeableness), rating format (graphic rating scale vs. behavioral checklist), and the rating social context (face‐to‐face feedback vs. no face‐to‐face feedback) on rating elevation of performance ratings. As predicted, raters high on Agreeableness showed more elevated ratings than those low on Agreeableness when they expected to have the face‐to‐face feedback meeting. Furthermore, rating format moderated the relationship between Agreeableness and rating elevation, such that raters high on Agreeableness provided less elevated ratings when using the behavioral checklist than the graphic rating scale, whereas raters low on Agreeableness showed little difference in elevation across different rating formats. Results also suggest that the interactive effects of rater personality, rating format, and social context may depend on the performance level of the ratee. The implications of these findings will be discussed.     

Cultural Values and Performance Appraisal: Assessing the Effects of Rater Self-Construal on Performance Ratings

Much of the prior research investigating the influence of cultural values on performance ratings has focused either on conducting cross-national comparisons among raters or using cultural level individualism/collectivism scales to measure the effects of cultural values on performance ratings. Recent research has shown that there is considerable within country variation in cultural values, i.e. people in one country can be more individualistic or collectivistic in nature. Taking the latter perspective, the present study used Markus and Kitayama's (1991) conceptualization of independent and interdependent self-construals as measures of individual variations in cultural values to investigate within culture variations in performance ratings. Results suggest that rater self-construal has a significant influence on overall performance evaluations; specifically, raters with a highly interdependent self-construal tend to show a preference for interdependent ratees, whereas raters high on independent self-construal do not show a preference for specific type of ratees when making overall performance evaluations. Although rater self-construal significantly influenced overall performance evaluations, no such effects were observed for specific dimension ratings. Implications of these results for performance appraisal research and practice are discussed.     

The Impact of Specific Psychotherapist Beliefs Regarding Managed Care on Prospective Psychotherapy Clients

The purpose of this study was to investigate the separate impact of each of thirteen therapist beliefs that, presented collectively, were previously found to have a significantly negative impact on prospective clients' attitudes toward managed care psychotherapy (Pomerantz, 2000). Participants in this study initially completed a brief questionnaire measuring their willingness to enter psychotherapy and their expectations regarding psychotherapy under managed care. Participants subsequently completed the same brief questionnaire again after being instructed to imagine seeing a hypothetical psychologist and being presented with the psychologist's supposed beliefs regarding managed care (which were actually derived from survey data by Murphy et al., 1998). Results suggest that almost every discrete therapist belief had a significantly negative impact on participants' attitudes toward managed care psychotherapy. Several specific therapist beliefs produced particularly salient negative effects. Implications regarding ethics and informed consent are discussed.     

Concept Redundancy and Rater Naivety in Organizational Research

The validity of five work commitment concepts is assessed via content analysis. The role of rater naivety (i.e., familiarity) with the concepts and measures used is also evaluated. Organizational commitment and Protestant work ethic were found to be least redundant. Naive raters demonstrated more redundancy than raters familiar with the concepts and measures. The implications of these findings for the study of work commitment and organizational research in general are discussed.     

The Effect of Information Format and Performance Pattern on Performance Appraisal Judgments in a Computerized Performance Monitoring Context1

This paper examines how the presentation of computer-monitored performance information affects performance judgments. Two factors were examined: the performance pattern and the information format. In a computer simulation, subjects were responsible for evaluating the performance of a computer-monitored typist. They were assigned to one of three format conditions: a periodic, delayed, or summarized format. The pattern of the typist's performance was also varied: It either improved, worsened, or remained about the same during the simulation. Results indicate that performance pattern affected subjects' ratings of overall performance, performance quality, and performance consistency. Both factors influenced ratings of future performance and recall of specific performance information. Implications of these results for performance appraisals and computerized performance monitoring systems are discussed.     

Persuasive Impact of Organizational Value Statements in a Recruitment Context1

Two experiments were conducted to examine the persuasive impact of different types of evidence supporting an organizational recruitment message. In the first experiment, information on organizational values, presented in a recruitment brochure, was supported using statistical, anecdotal, or no evidence. Graduating university students who were attending a job fair (N = 69) were most attracted to the company as an employer when statistical evidence was presented. In the second study, an employed sample (N= 172) received organizational value evidence in the context of either a recruitment brochure or a community newspaper article. Whereas we replicated the findings of the first study in the brochure condition, we found that anecdotal information was most persuasive in the newspaper condition. We conclude that predicting the persuasive impact of evidence for organizational values requires knowledge of both the type of evidence to be employed and the medium in which that evidence is conveyed.     

The Performance Appraisal Milieu: A Multilevel Analysis of Context Effects in Performance Ratings

Purpose

The purpose of this study was to take an inductive approach in examining the extent to which organizational contexts represent significant sources of variance in supervisor performance ratings, and to explore various factors that may explain contextual rating variability.

Design/Methodology/Approach

Using archival field performance rating data from a large state law enforcement organization, we used a multilevel modeling approach to partition the variance in ratings due to ratees, raters, as well as rating contexts.

Findings

Results suggest that much of what may often be interpreted as idiosyncratic rater variance, may actually reflect systematic rating variability across contexts. In addition, performance-related and non-performance factors including contextual rating tendencies accounted for significant rating variability.

Implications

Supervisor ratings represent the most common approach for measuring job performance, and understanding the nature and sources of rating variability is important for research and practice. Given the many uses of performance rating data, our findings suggest that continuing to identify contextual sources of variability is particularly important for addressing criterion problems, and improving ratings as a form of performance measurement.

Originality/Value

Numerous performance appraisal models suggest the importance of context; however, previous research had not partitioned the variance in supervisor ratings due to omnibus context effects in organizational settings. The use of a multilevel modeling approach allowed the examination of contextual influences, while controlling for ratee and rater characteristics.

     

Impact of Organizational Citizenship Behavior on Performance in Women's Sport Teams

The current study examined the relationship between organizational citizenship behavior and sport team performance and the moderating role of task interdependence in that relationship. Two types of collegiate teams—softball (N = 25) and tennis (N = 15)—were utilized to represent different levels of task interdependence with softball being considered more interdependent than tennis. Athletes (N = 448) answered survey questions concerning organizational citizenship behavior (helping, civic virtue, sportsmanship [due to the historic use of the term “sportmanship” in developing the measures used in this study, that term will be used instead of “sportpersonship”]), team cohesiveness, athlete satisfaction, and transformational leadership behaviors. Researchers collected performance statistics for athletes. Results indicated that helping behavior was the strongest organizational citizenship behavior predictor of performance, but the effect differed between tennis and softball teams.     

Lay Persons' and Police Officers' Beliefs Regarding Deceptive Behaviour

Research on the detection of deception, via non-verbal cues, has shown that people's ability to successfully discriminate between truth and deception is only slightly better than chance level. One of the reasons for these disappointing findings possibly lies in people's inappropriate beliefs regarding ‘lying behaviour’. A 64-item questionnaire originally used in Germany, which targets participants' beliefs regarding truthful and deceptive behaviour, was used. The present study differed from previous research in three ways: (i) instead of a student population, police officers and lay people were sampled, (ii) both people's beliefs regarding others' deceptive behaviour and their beliefs regarding their own deceptive behaviour were examined, and (iii) both non-verbal cues to, and content characteristics of, deceptive statements were examined. Results were consistent with previous studies, which found significant differences between people's beliefs regarding deceptive behaviour and experimental observations of actual deceptive behaviour. Further, police officers held as many false beliefs as did lay people and finally, participants were more accurate in their beliefs regarding their own deceptive behaviour than they were in their beliefs regarding others' behaviour.     

Adults' Efficacy and Control Beliefs Regarding Memory and Aging: Separating General from Personal Beliefs

This study examined beliefs about memory in 307 18-93 year-old community-dwelling adults. Two new questionnaires, the General Beliefs about Memory (GBMI) and the Personal Beliefs about Memory (PBMI) Instruments, were used to compare and contrast beliefs about memory in the general population of adults from beliefs about one's own memory. Both questionnaires used a graphic rating scale format to obtain more refined responses. The GBMI showed that, on average, all age groups perceived the average adult as experiencing curvilinear decline over the adult life span for multiple aspects of memory, with the greatest changes believed to occur after age 40. Beliefs about different specific types of memory were consistent with lay beliefs and with empirical results regarding aging and memory (e.g., memory for names was perceived to decline more rapidly than memory for faces). In contrast to earlier studies, small but significant age differences between young, middle-aged, and older respondents regarding beliefs about rates of memory aging were identified. Results for the PBMI indicated that personal beliefs were strongly related to, but distinct from, general beliefs. Older adults believed themselves to be lower in memory efficacy, to have declined more than younger adults, and to have less personal control over memory, as in earlier research.     

Impact of Family Efficacy Beliefs on Quality of Family Functioning and Satisfaction with Family Life

The present study tested with 142 families a structural model of the interplay of perceived dyadic and collective forms of efficacy within the interdependent family system, and how these different forms of efficacy are structurally related to quality of family functioning and satisfaction with family life. Dyadic parent–child efficacy, dyadic spousal efficacy, and filial efficacy were linked to family satisfaction through the mediating impact of collective family efficacy. A high sense of collective family efficacy was accompanied by open family communication and candid disclosure by adolescents of their activities outside the home. Collective family efficacy contributed to parents' and adolescents' satisfaction with their family life both directly and through its impact on quality of family functioning. An alternative structural model in which quality of family functioning affects the different forms of perceived family efficacy and family satisfaction provided a poorer fit to the data.     

Rater Personality and Performance Dimension Weighting in Making Overall Performance Judgments

Purpose  

The present study examined the effects of rater personality on the performance appraisal process. Specifically, we determined the relative weights that raters place on different performance dimensions when making overall performance evaluations, and examined whether rater personality influenced this weighting process. The literatures on social/political values and mate/friend selection were used as guiding frameworks in developing specific hypotheses.     

Context Effects in Performance Evaluation: The Impact of Ratee Sex and Performance Level on Performance Ratings and Behavioral Recall

We extend the research on context effects in performance evaluation by examining the impact of ratee sex and context performance level as moderators of context effects in performance ratings and in the recall of performance information. Subjects (N= 269) rated the performance of an average performer (male or female) alone or following a low or high performing context (male or female). We found significant differences in the magnitude of contrast effects for an average target ratee as a function of both target ratee sex and performance level. These differences were found for both performance ratings and the evaluative content of performance information recalled.     

Context and Message Content During Organizational Socialization

This study examined the socialization experiences of 85 newly hired managers over a 4‐month period. Results indicated partial support for a model proposing a mediating relationship among structured and unstructured socialization contexts, socialization message content, and newcomer adjustment. Performance proficiency message content mediated the impact of fixed and serial tactics on role ambiguity while sequential tactics and trial by fire experiences had a direct effect. Investiture tactics were negatively related to new manager role innovation.     

Impact of Common Rater Variance on Construct Validity of Assessment Center Dimension Judgments

In an assessment center (AC), assessors generally rate an applicant's performance on multiple dimensions in just 1 exercise. This rating procedure introduces common rater variance within exercises but not between exercises. This article hypothesizes that this phenomenon is partly responsible for the consistently reported result that the AC lacks construct validity. Therefore, in this article, the rater effect is standardized on discriminant and convergent validity via a multitrait-multimethod design in which each matrix cell is based on ratings of different assessors. Two independent studies (N = 200, N = 52) showed that, within exercises, correlations decrease when common rater variance is excluded both across exercises (by having assessors rate only 1 exercise) and within exercises (by having assessors rate only 1 dimension per exercise). Implications are discussed in the context of the recent discussion around the appropriateness of the within-exercise versus the within-dimension evaluation method.     

A Meta-Analysis of the Relationship Between Rater Liking and Performance Ratings

This meta-analysis reviewed the magnitude and moderators of the relationship between rater liking and performance ratings. The results revealed substantial overlap between rater liking and performance ratings (ρ = .77). Although this relationship is often interpreted as indicative of bias, we review studies that indicate that to some extent the relationship between liking and performance ratings potentially reflects “true” differences in ratee performance. Moderator analyses indicated that the relationship between liking and performance ratings was weaker for ratings of organizational citizenship behaviors, ratings made by peer raters, ratings in nonsales jobs, and ratings made for development; however, the relationship was strong across moderator levels, underscoring the robustness of this relationship. Implications for the interpretation of performance ratings are discussed.     

Context Sensitivity and Balancing in Indian Organizational Behaviour

This paper attempts to explain Indian organizational behaviour with the help of two interrelated concepts: context sensitivity and balancing. Context sensitivity pertains to beliefs about person (patra), time (kal), and ecological (desh) components of the environment. Balancing is a behavioural disposition to avoid extremes and to integrate or accommodate diverse considerations. Traditional systems such as Hindu religion, caste as a form of social stratification, and agricultural mode of production have interacted with foreign invasions and alien rules to give rise to several sociocultural characteristics: (1) group embeddedness and hierarchy while relating to people (patra), (2) uncertainty about future and the resultant short-term perspective while relating to time (kal), and (3) scarcity of resources, deficient infrastructural facilities, and poverty syndrome while relating to ecology (desh). Rapid industrialization and the transplant of Western technology and work forms in the last three decades have added individualistic values and Western management practices. While responding to the three components of the environment, people exhibit both a primary expresive mode that is traditional in nature and a secondary expressive mode that is acquired as a result of the transplantation of the Western management system onto a traditional core. Superior-subordinate relationships, work behaviour, and management practices reflect both the primary and secondary modes in varying degrees.     

创业精神的影响因素及其绩效评价

创业精神分为个体创业精神和企业创业精神。个性特质、认知模式、教育培训和创业经验影响个体创业精神,企业战略、组织结构、企业环境和组织支持影响企业创业精神。该文最后讨论了创业精神的绩效评价问题,指出准确的绩效测量是创业研究的关键。     

Effects of Performance Context on Processing Speed and Performance Ratings

The present study demonstrated that the presence of evaluatively polarized context performances not only produces contrast and halo effects on judgments of a target performance, but also causes judgments to be made much faster. Processing speed and positive halo were highly correlated, supporting the notion that halo in performance ratings results from raters' recall and use of a single, general impression. Furthermore, regression analyses demonstrated that processing speed mediates the relationship between context and halo. The relationship between these findings, halo, processing speed, and general impressions, as well as implications for performance appraisals, are discussed.