IDENTIFYING OPTIMAL PREDICTOR COMPOSITES AND TESTING FOR GENERALIZABILITY ACROSS JOBS AND PERFORMANCE FACTORS

The initial examination of validity generalization in the Army Selection and Classification Project used data from a concurrent validation sample of 4,039 job incumbents drawn from a representative sample of nine jobs. The available data consisted of 24 predictor scores and five job performance factor scores on each individual. The major objectives were to determine (a) the degree of validity generalization across the major components of performance, with the job held constant, and (b) the degree of validity generalization across jobs within each major performance factor. After reducing the predictor set by eliminating variables that added no information, a modified confirmatory analysis was used to test the hypotheses that one equation would fit the data from all performance components and that one equation would fit the data from all jobs, given a particular performance component. The major findings were that different predictor equations were needed for each of the five criterion factors. For generalization across jobs, within each criterion factor, one equation fit the data for four of the five performance components. Different prediction equations were required for the component that reflects proficiency on the technical tasks specific to each job.     

任职者任务绩效水平对其工作分析结果的影响

在控制了个体人口统计学变量和排除组织水平变量的影响下,探讨了电厂设计和编辑两个职位任职者的任务绩效水平对于他们Occupational Information Network (以下缩写为O*NET)工作分析问卷评价结果的影响。层次回归结果发现,控制了相关因素后,发电厂设计人员的任务绩效水平能显著影响其对技术性技能的水平评价,编辑的任务绩效水平能显著影响信息处理的重要性评价和水平评价,在一定程度上证实了“工作分析结果差异来源于真实差异”的理论     

The impact of job complexity and performance measurement on the temporal consistency, stability, and test-retest reliability of employee job performance ratings

Although research has shown that individual job performance changes over time, the extent of such changes is unknown. In this article, the authors define and distinguish between the concepts of temporal consistency, stability, and test-retest reliability when considering individual job performance ratings over time. Furthermore, the authors examine measurement type (i.e., subjective and objective measures) and job complexity in relation to temporal consistency, stability, and test-retest reliability. On the basis of meta-analytic results, the authors found that the test-retest reliability of these ratings ranged from .83 for subjective measures in low-complexity jobs to .50 for objective measures in high-complexity jobs. The stability of these ratings over a 1-year time lag ranged from .85 to .67. The analyses also reveal that correlations between performance measures decreased as the time interval between performance measurements increased, but the estimates approached values greater than zero.     

MODELING JOB PERFORMANCE IN A POPULATION OF JOBS

The Army Selection and Classification Project has produced a comprehensive examination of job performance in 19 entry-level Army jobs (Military Occupational Specialties) sampled from the existing population of entry-level positions. Multiple methods of job analysis and criterion measurement were utilized in a subsample of nine jobs to generate over 200 performance indicators, which were then used to assess performance in a combined sample of 9,430 job incumbents. An iterative procedure involving a series of content analyses and principal components analyses was used to develop a basic array of up to 32 criterion scores for each job. This basic set of scores formed the starting point of an attempt to model the latent structure of performance in this population of jobs. After alternative models were proposed for the latent structure, the models were submitted to a goodness-of-fit test via LIS-REL VI. After accounting for two components of method variance, a five-factor solution was judged as the best fit. The implications of the results and the modeling procedure for future personnel research are discussed.     

The Validity of Job Knowledge Measures

The validity of written job knowledge tests as predictors of job performance and training success was examined. Based on a sample of 363,528 persons and 502 coefficients, meta-analyses were performed to investigate the extent of validity generalization and the effects of two hypothesized moderator variables: content similarity and job complexity. Corrected mean validities were 0.45 for studies predicting job performance and 0.47 for studies of training success. Support was found for both moderators since validities were higher for high complexity jobs and when job-test content similarity was high. The implications of this study for personnel selection and research in the area of work performance are discussed.     

Meta‐Analysis of Clerical Performance Predictors: Still stable after all these years

Pearlman, Schmidt, and Hunter (1980) published a seminal paper on the validity of various measures for predicting performance in clerical jobs. They concluded that for both job and training performance criteria, 10 types of tests (e.g., perceptual speed, clerical aptitude, verbal ability) predicted performance across 5 clerical job families. This paper describes a psychometric meta‐analysis of validity studies using similar measures for clerical jobs conducted since 1980 to examine the stability of Pearlman and colleagues' validity estimates. This paper contributes to the literature by investigating the long‐term stability of validity generalization estimates over a period of several decades. Clerical jobs provide a compelling case study because these jobs have changed considerably due to the increased use of computers and technology in the office environment. Results showed that the mean population estimates in the present study were consistent with, or higher than, those obtained by Pearlman and colleagues, thus demonstrating the long‐term stability of meta‐analytic estimates of validity. The relative stability of the validity estimates also supports the robustness of g as a predictor, even as jobs change over time.     

印象管理测量与经理的工作绩效

理论界认为、在人际相互作用很重要的那些工作中,印象管理测量应该能预测管理者的工作绩效,但实证研究并没有支持这一假设。文章在综述已有的研究背景基础上,着重介绍了C．Viswesvarav．D．S．Ones等关于印象管理测量与经理的工作绩效之关系的系列实证研究．认为似乎没有证据表明“印象管理量表得分能够预测工作绩效(虽然在这些工作中人际相互作用很重要),并讨论了在今后的研究中需要进一步探讨的问题以及应该注意的问题。     

AN EMPIRICAL TEST OF A TRAIT-ORIENTED JOB ANALYSIS TECHNIQUE

A trait-oriented job analysis technique based on a checklist of 33 a priori carefully defined traits that encompass elements of the physical, mental, learned, motivational and social domains of the work world is described. The analysis identifies the relevant traits, their levels and weights, in relation to overall job performance. Results of discriminability tests were supportive of the job analysis technique and indicated that incumbents of jobs requiring a particular trait scored higher on measures (predictors) of that trait than incumbents of jobs not requiring that trait. Implications of the results for personnel selection and placement are discussed.     

PROJECT A VALIDITY RESULTS: THE RELATIONSHIP BETWEEN PREDICTOR AND CRITERION DOMAINS

A predictor battery of cognitive ability, perceptual-psychomotor ability, temperament/personality, interest, and job outcome preference measures was administered to enlisted soldiers in nine Army jobs. These measures were summarized in terms of 24 composite scores. The relationships between the predictor composite scores and five components of job performance were analyzed. Scores from the cognitive and perceptual-psychomotor ability tests provided the best prediction of job-specific and general task proficiency, while the temperament/personality composites were the best predictors of giving extra effort, supporting peers, and exhibiting personal discipline. Composite scores derived from the interest inventory were correlated more highly with task proficiency than with demonstrating effort and peer support. In particular, vocational interests were among the best predictors of task proficiency in combat jobs. The results suggest that the Army can improve the prediction of job performance by adding non-cognitive predictors to its present battery of predictor tests.     

Moderation of the effects of job enrichment by participation: A longitudinal field experiment

In a 2 × 2 field experimental test of L. R. Hackman and G. R. Oldham's (1980, Work redesign, Reading, MA: Addison-Wesley) task characteristic model, the moderating effects of a contextual variable, participation, on job redesign were examined. Seventy-six desk receptionists participated in the redesign of their jobs or did not, and/or their jobs were actually redesigned or not. The results found significant main effects of job redesign on several measures of satisfaction. Participation was more limited in its effects, only affecting one of the satisfaction measures. However, both factors significantly affected turnover. In addition, contrary to predictions from the model, employee participation did not enhance the effects of enriched work. The results are discussed in terms of revisions to the theory and the practice of job redesign.     

A field study of demographic characteristics and job attribute preferences of new part-time employees

This paper reports on a study of the demographic characteristics and job attribute preferences of 336 newly hired part-time employees in retail jobs. The results of the research challenge many of the traditional assumptions about the job preferences of part-time workers.     

Moderating effects of employee expectancies on the relationship between leadership consideration and job performance of engineers

Ninety-four engineers were asked to describe their supervisors' leadership style, to indicate their expectancies whether performing effectively in their jobs would lead to job rewards and the valence of these rewards. It was hypothesized that employees' expectancies and a considerative leadership style interact to influence the performance levels of these engineers. Results indicated that leader consideration and employee expectancies operate in joint fashions to effect job performance.     

The “feminine mystique” in male-dominated jobs: A comparison of attitudes and background factors of women in male-dominated versus female-dominated jobs

This paper examines various background factors plus success and work-related atttudes of 324 women as aggregated into one of three groups: those women working in male-dominated jobs, those in female-dominated jobs, and those in relatively sex-ratio balanced jobs. Overall results show that women holding male-dominated jobs are more likely to be older, better educated, have fathers with higher educational levels, and are more likely to be childless as compared to women in female-dominated jobs. Holding age and education constant, women in male-dominated jobs usually rated definitions of success as more important to their feelings of well-being than did women in female-dominated jobs. With these same constants, there were few differences in work attitudes among the three groups, but contrary to expectations, women in female-dominated jobs rated the importance of their work higher than did women in male-dominated jobs. The variables best predicting whether a woman held a male-dominated job were college attainment, problems related to sex discrimination, the age of the participant, her feelings toward achieving a very high salary, her feelings of the importance of her work, and her feelings about becoming an authority in her job.     

Measuring Airman Job Performance Using Occupational Survey Data

This research effort produced a task-based measure of job performance using data from existing Air Force occupational surveys. Previous performance measures col- lected in the field during the Air Force Job Performance Measurement (JPM) program were time consuming and expensive because they involved hands-on observation and measurement. The alternative, low-cost, readily available measure developed in this study accounted for the number and difficulty of job tasks performed by an airman and was validated against data from the JPM program using airman aptitude and experience as predictor variables. Results showed that the occupational task-based performance measure rank ordered airmen similarly to the JPM measure in terms of average performance, suggesting its value as a more cost-effective measure of work productivity.     

Validation of personality constructs for the selection of insurance industry employees

One hundred and nine employees working in clerical jobs in an insurance company participated in a concurrent criterion-related validity study. The employees were administered the Hogan Personality Inventory which consists of six basic scales and six occupational scales. Five criterion measures were collected: a within-department forced quintile distribution by the manager, and managerial ratings of the job factors of job knowledge, interpersonal skills, organization, and overall performance. The twelve test scores were correlated with each of the five criterion measures. The results revealed the Adjustment, Clerical Aptitude and Managerial Potential scales correlated significantly (p<.05) with each of the five criteria, while the Service Orientation scale correlated significantly with three of the five criteria. The results were discussed in the context of using personality scales to forecast job performance in the insurance industry.     

Selling Task Characteristics and the Job Satisfaction of Industrial Salespeople

Abstract

Hypotheses were tested concerning the relationship between selling task characteristics and industrial salesforce job satisfaction. The specific explanatory model included the five core task variables measured by the “Job Diagnostic Survey Instrument” designed by Hackman and Lawler. The hypotheses tested were that salespersons' job satisfaction will be greater to the extent that they perceive their selling jobs to be characterized by high skill variety requirements, task identity, task significance, autonomy, and performance feedback from the job. In addition, based upon previous research in non-selling occupations, the salesperson's higher order need strength was examined as a possible moderator variable for the task characteristic/job satisfaction relationship.     

Worker estimation of ability requirements of their jobs

A modified version of the Minnesota Job Requirements Questionnaire (MJRQ), representing the GATB aptitudes, was used by workers in 11 selected jobs to rate the ability requirements of their jobs. Worker MJRQ ratings were compared with supervisor MJRQ ratings. Modified Occupational Ability Patterns (OAPs) derived from worker ratings were compared with OAPs based on supervisor ratings, OAPs from expert ratings in the DOT, and OAPs from the empirical GATB approach. Reliability of worker MJRQ ratings was comparable to that of supervisor ratings. Comparisons of mean ratings and variability of ratings of workers in a job category with workers in other jobs, and with supervisors rating the same job, showed construct validity for worker MJRQ ratings, as did intercorrelations of the worker ratings. OAPs derived from worker MJRQ ratings compared favorably with OAPs derived from supervisor MJRQ ratings, from the DOT, and from the GATB. Differences among workers on variables such as satisfaction, age and tenure did not significantly affect their MJRQ ratings. Implications of the worker MJRQ ratings are discussed.     

Relationships between job evaluation ratings and self-ratings of job characteristics

Self-ratings by 308 shop workers of their job variety, autonomy, task identity, and skill challenge correlate significantly with ratings by observers of the jobs' skill requirements. Self-ratings, however, are unrelated to observers' estimates of the physical demands of the jobs or to environmental conditions of the work. The self-ratings and observer measures provide complementary, not substitute, information. Self-ratings can signal person-job dysfunctions, and more objective job measures can identify possible sources of the dysfunctions. Modifications to job characteristics measures are discussed and suggestions are made to begin a new phase of programmatic job characteristics research.     

The interaction of personality and job scope in predicting turnover

The interaction of employee personality characteristics and job scope in the prediction of turnover was studied. One hundred and nine individuals employed as machine operators (low-scope job) and scientific and technical personnel (high-scope job) within a large manufacturing organization were the sample. No direct relationships were found between personality characteristics and turnover for the combined sample of employees on high- and low-scope jobs. When correlational analyses were carried out within job scope samples it was evident that personality and job scope interacted in predicting turnover. For employees on high-scope jobs, turnover was negatively related to the need for achievement and positively related to the need for affiliation. Turnover was negatively related to the need for affiliation among employees on low-scope jobs. The implications of these findings for future research on turnover were discussed.