Ethnic group differences in measures of job performance: a new meta-analysis

The authors conducted a new meta-analysis of ethnic group differences in job performance. Given a substantially increased set of data as compared with earlier analyses, the authors were able to conduct analyses of Black-White differences within more homogeneous categories of job performance and to reexamine findings on objective versus subjective measurement. Contrary to one perspective sometimes adopted in the field, objective measures are associated with very similar, if not somewhat larger, standardized ethnic group differences (ds) than subjective measures across a variety of indicators. This trend was consistent across quality, quantity, and absenteeism measures. Further, work samples and job knowledge tests are associated with larger ds than performance ratings or measures of absenteeism. Analysis of Hispanic-White standardized differences shows that they are generally lower than Black-White differences in several categories.     

Exploring how constraints created by other people influence intraindividual variation in objective performance measures

Objective performance indicators have low test-retest reliability, particularly in complex jobs. Yet, little is actually known about the reasons why objective performance indicators lack temporal stability. The authors address this issue by using data from a sample of 106 professional football players to explore how the actions of other people influence intraindividual variation in performance. Results suggest that weekly measures of performance outcome exhibit substantial variability within individuals. A significant portion of this within-person variance is explained by environmental fluctuation created by the constraining actions of other people. Individuals with highly fluctuating past performance exhibit stronger relationships between the actions of competitors and subsequent performance outcomes. The intraindividual relationship between fluctuating constraints and performance outcomes is also stronger for individuals in more complex jobs.     

Cognitive ability,cognitive aptitudes,job knowledge,and job performance

This paper reviews the hundreds of studies showing that general cognitive ability predicts job performance in all jobs. The first section shows that general cognitive ability predicts supervisor ratings and training success. The second section shows that general cognitive ability predicts objective, rigorously content valid work sample performance with even higher validity. Path analysis shows that much of this predictive power stems from the fact that general cognitive ability predicts job knowledge (r = .80 for civilian jobs) and job knowledge predicts job performance (r = .80). However, cognitive ability predicts performance beyond this value (r = .75 versus r = [.80][.80] = .64) verifying job analyses showing that most major cognitive skills are used in everyday work. The third section of the paper briefly reviews evidence showing that it is general cognitive ability and not specific cognitive aptitudes that predict performance.     

The use of the position analysis questionnaire in selecting correlates of job performance among mentally retarded workers

The present study investigated the efficiency of various existing measures, mainly psychological tests, for predicting job performance of mentally retarded workers in a sheltered occupational shop. Twenty-two production-related jobs and one nonproduction-related job were analyzed with the Position Analysis Questionnaire resulting in two job attribute clusters. Correlations between 19 predictor variables and 5 criterion variables, which consisted of supervisor ratings of job performance, were then calculated separately for subjects performing preferred jobs in each attribute group. The results indicated that, contrary to past research, existing measures are predictive of performance on some but not all jobs in a sheltered workshop.     

The role of acceptance and job control in mental health, job satisfaction, and work performance

Acceptance, the willingness to experience thoughts, feelings, and physiological sensations without having to control them or let them determine one's actions, is a major individual determinant of mental health and behavioral effectiveness in a more recent theory of psychopathology. This 2-wave panel study examined the ability of acceptance also to explain mental health, job satisfaction, and performance in the work domain. The authors hypothesized that acceptance would predict these 3 outcomes 1 year later in a sample of customer service center workers in the United Kingdom (N = 412). Results indicated that acceptance predicted mental health and an objective measure of performance over and above job control, negative affectivity, and locus of control. These beneficial effects of having more job control were enhanced when people had higher levels of acceptance. The authors discuss the theoretical and practical relevance of this individual characteristic to occupational health and performance.     

The interactive effects of conscientiousness and agreeableness on job performance

The authors hypothesized that the relationship between conscientiousness and job performance would be stronger for persons high in agreeableness than for those low in agreeableness. Results of hierarchical moderated regression analyses for 7 independent samples of employees across diverse occupations provided support for the hypothesis in 5 of the samples. In samples supporting the hypothesis, among the highly conscientious workers, those low in agreeableness were found to receive lower ratings of job performance than workers high in agreeableness. One explanation for lack of an interaction between conscientiousness and agreeableness in the other 2 samples is that those jobs were not characterized by frequent, cooperative interactions with others. Overall, the results show that highly conscientious workers who lack interpersonal sensitivity may be ineffective, particularly in jobs requiring cooperative interchange with others.     

The role of job security in understanding the relationship between employees' perceptions of temporary workers and employees' performance

On the basis of psychological contract and social cognition theories, the authors explored the role of full-time employees' perceived job security in explaining their reactions to the use of temporary workers by using a sample of 149 full-time employees who worked with temporaries. As hypothesized, employees' perceived job security negatively related to their perceptions that temporaries pose a threat to their jobs, but it did not relate to their perceptions that temporaries are beneficial. Furthermore, employees' job security moderated the relationships between benefit and threat perceptions and supervisor ratings of job performance. For those with high job security, there was a positive relationship between benefit perceptions and performance. For those with low job security, there was a negative relationship between threat perceptions and performance.     

DYNAMIC CRITERIA REVISITED: A LONGITUDINAL STUDY OF PERFORMANCE STABILITY AND PREDICTIVE VALIDITY

The concept of dynamic criteria has been the subject of a recent debate regarding both the definition and prevalence of the phenomenon (Austin, Humphreys, & Hulin, 1989; Barrett & Alexander, 1989; Barrett, Caldwell, & Alexander, 1985). The present paper questions the adequacy of the conceptual framework underlying the debate and provides data supporting a refined concept of dynamic criteria. The incidence and possible causes of change in relative performance were investigated using weekly performance data from 509 sewing machine operators. Analyses were conducted to determine the degree of performance consistency, potential moderators of consistency, and the stability of predictor-criteria relationships using multiple predictors and criteria. Results revealed a steady decline in performance stability coefficients as the interval between measures increased. This decay was evident regardless of employees' prior job experience, cognitive ability, or psychomotor ability. Analyses of predictive validity coefficients revealed temporal changes in validity for both objective and subjective criteria, but not in the expected direction. The validity of cognitive ability increased, the validity of psychomotor ability was stable, and that of prior job experience decreased over time. Implications for theory and research are discussed.     

Translating self-efficacy in job performance over time: The role of job crafting

This investigation intends to uncover the mechanisms linking self-efficacy to job performance by analyzing the mediating role of job crafting. A two-wave study on 465 white-collar workers was conducted, matching participants’ self-report data (i.e., self-efficacy and job crafting) with supervisory performance ratings. The structural equation model showed a positive reciprocal relationship between self-efficacy and crafting behaviors. In turn, job crafting predicted performance positively over time. More importantly, results confirmed the mediating role of crafting actions, which may represent the behavioral process underlying the positive effect of self-efficacy on individual outcomes. Practical implications for organizations, such as encouraging bottom-up job design or designing job-crafting interventions, and future research directions are also offered.     

Relationships between job evaluation ratings and self-ratings of job characteristics

Self-ratings by 308 shop workers of their job variety, autonomy, task identity, and skill challenge correlate significantly with ratings by observers of the jobs' skill requirements. Self-ratings, however, are unrelated to observers' estimates of the physical demands of the jobs or to environmental conditions of the work. The self-ratings and observer measures provide complementary, not substitute, information. Self-ratings can signal person-job dysfunctions, and more objective job measures can identify possible sources of the dysfunctions. Modifications to job characteristics measures are discussed and suggestions are made to begin a new phase of programmatic job characteristics research.     

Revisiting the relationship between impression management and job performance

Although theoretical arguments suggest that impression management should be related to job performance, empirical results have been unsupportive of the association. We argue that this relationship, however, may be found for specific jobs (sales) using a specific objective criterion (sales revenue). We tested this hypothesis across two samples. The first sample utilized a concurrent design and found a significant association between impression management and objective job performance. Furthermore, impression management demonstrated incremental validity over conscientiousness. In the second sample, using a different impression management scale and a predictive design we found that impression management was related to sales revenue, and showed incremental validity over cognitive ability. Implications for research and practice are discussed.     

Reliability of personality disorder symptoms and personality traits in substance-dependent inpatients

The authors compared the internal consistency, 1-year temporal stability, and self-informant agreement of ratings of personality trait (NEO Five-Factor Inventory; NEO-FFI; P. T. Costa & R. R. McCrae, 1992) and personality disorder symptom severity (Structured Clinical Interview for DSM-III-R Personality Disorders Questionnaire; SCID-II-Q; R. L. Spitzer, J. B. W. Williams, M. Gibbon, & M. First, 1990) in 131 substance-dependent inpatients. Internal consistency coefficients were acceptable to very good for most NEO-FFI and SCID-II-Q scales, and temporal stability correlations were significant for all measures. Agreement between patient and informant ratings was more modest. Substance abuse and depression symptom severity moderated the temporal stability and self-informant agreement of several personality trait and disorder ratings. The authors did not find that the five factors were more reliable than the Axis II symptoms. Issues related to the reliability of personality assessment in multiply diagnosed patients are discussed.     

The moderating influence of job performance dimensions on convergence of supervisory and peer ratings of job performance: unconfounding construct-level convergence and rating difficulty

Meta-analysis was used to cumulate the correlations between supervisor and peer ratings for different dimensions of job performance. The general pattern in the data suggested that raters from the same organizational level disagree as much as raters from different levels. Methods were used to separate the effects of rating difficulty and lack of construct-level convergence on the correlation between supervisor and peer ratings. The authors found complete construct-level convergence for ratings of overall job performance, productivity, effort, job knowledge, quality, and leadership but not for ratings of administrative competence, interpersonal competence, and compliance or acceptance of authority. Higher rating difficulty was more strongly associated with lower mean observed peer-supervisor correlations than were construct-level disagreements between peers and supervisors. Implications for research and practice are discussed.     

The importance of job autonomy, cognitive ability, and job-related skill for predicting role breadth and job performance

Role theory suggests and empirical research has found that there is considerable variation in how broadly individuals define their jobs. We investigated the theoretically meaningful yet infrequently studied relationships between incumbent job autonomy, cognitive ability, job-related skill, role breadth, and job performance. Using multiple data sources and multiple measurement occasions in a field setting, we found that job autonomy, cognitive ability, and job-related skill were positively related to role breadth, accounting for 23% of the variance in role breadth. In addition, role breadth was positively related to job performance and was found to mediate the relationship between job autonomy, cognitive ability, job-related skill, and job performance. These results add to our understanding of the factors that predict role breadth, as well as having implications for how job aspects and individual characteristics are translated into performance outcomes and the treatment of variability in incumbent reports of job tasks.     

A comparison of job performance and disciplinary records of smokers and nonsmokers

The authors compared job performance and receipt of disciplinary action among smoking and nonsmoking hotel employees using organizational records and observation. Although smokers and nonsmokers did not differ on 3 measures of discipline, there were significant differences on a guest relations performance dimension and a summated overall job performance measure. Smokers received higher ratings than did nonsmokers. Implications of these findings for the management of smoking behavior in the workplace are discussed.     

The relative importance of task, citizenship, and counterproductive performance to global ratings of job performance: a policy-capturing approach

A review of research on job performance suggests 3 broad components: task, citizenship, and counterproductive performance. This study examined the relative importance of each component to ratings of overall performance by using an experimental policy-capturing design. Managers in 5 jobs read hypothetical profiles describing employees' task, citizenship, and counterproductive performance and provided global ratings of performance. Within-subjects regression analyses indicated that the weights given to the 3 performance components varied across raters. Hierarchical cluster analyses indicated that raters' policies could be grouped into 3 homogeneous clusters: (a) task performance weighted highest, (b) counterproductive performance weighted highest, and (c) equal and large weights given to task and counterproductive performance. Hierarchical linear modeling indicated that demographic variables were not related to raters' weights.     

Age,job complexity,satisfaction, and performance

Job complexity was measured for jobs in a Public Agency. Perceptions of job complexity were obtained from self-reports of 133 employees. Independent measures were obtained from interviews with the subjects. Career stages, based upon age groupings, were found to moderate the relationship between (1) job-satisfaction and perceived job complexity and (2) job-performance and independently rated job complexity. These results are discussed in light of the current literature.     

Job performance ratings: The relative importance of mental ability,conscientiousness, and career adaptability

According to career construction theory, continuous adaptation to the work environment is crucial to achieve work and career success. In this study, we examined the relative importance of career adaptability for job performance ratings using an experimental policy-capturing design. Employees (N = 135) from different vocational backgrounds rated the overall job performance of fictitious employees in 40 scenarios based on information about their career adaptability, mental ability, conscientiousness, and job complexity. We used multilevel modeling to investigate the relative importance of each factor. Consistent with expectations, career adaptability positively predicted job performance ratings, and this effect was relatively smaller than the effects of conscientiousness and mental ability. Job complexity did not moderate the effect of career adaptability on job performance ratings, suggesting that career adaptability predicts job performance ratings in high-, medium-, and low-complexity jobs. Consistent with previous research, the effect of mental ability on job performance ratings was stronger in high- compared to low-complexity jobs. Overall, our findings provide initial evidence for the predictive validity of employees' career adaptability with regard to other people's ratings of job performance.     

Reliability (Generalizability) of Job Performance Measurements: Navy Machinist Mates

The Armed Services have undertaken a Joint Services Project to develop prototype methods for measuring job performance and, if feasible, to link enlistment standards to on-the-job performance. As one step toward meeting the first purpose of the project, our study assessed the reliability of scores on four measures of job performance of machinist mates in the Navy: a hands-on performance test, a paper-and-pencil job knowledge test, job task perform- ance ratings, and global ratings. Generalizability theory was used to estimate the reliability of the measures and to improve the design of each. The generalizability analyses investigated the consistency of performance scores over observers, tasks (equipment operation, casualty control, preventative maintenance), and types of raters (supervisor, peer, and self). Recommenda- tions about the optimal designs of studies for decision making (e.g., pre- dicting hands-on performance scores from the other measures of job perform- ance) were based on the findings.