Worker estimation of ability requirements of their jobs

A modified version of the Minnesota Job Requirements Questionnaire (MJRQ), representing the GATB aptitudes, was used by workers in 11 selected jobs to rate the ability requirements of their jobs. Worker MJRQ ratings were compared with supervisor MJRQ ratings. Modified Occupational Ability Patterns (OAPs) derived from worker ratings were compared with OAPs based on supervisor ratings, OAPs from expert ratings in the DOT, and OAPs from the empirical GATB approach. Reliability of worker MJRQ ratings was comparable to that of supervisor ratings. Comparisons of mean ratings and variability of ratings of workers in a job category with workers in other jobs, and with supervisors rating the same job, showed construct validity for worker MJRQ ratings, as did intercorrelations of the worker ratings. OAPs derived from worker MJRQ ratings compared favorably with OAPs derived from supervisor MJRQ ratings, from the DOT, and from the GATB. Differences among workers on variables such as satisfaction, age and tenure did not significantly affect their MJRQ ratings. Implications of the worker MJRQ ratings are discussed.     

Influence of job characteristics on the acceptability of employee drug testing

Measures of the acceptability of employee drug testing were obtained from a sample of college students (N = 371) and a second sample of nontraditional, older college students (N = 112) and were correlated with job-analysis data from the Position Analysis Questionnaire (PAQ) and Dictionary of Occupational Titles (DOT) databases, and with measures of perceived danger from impaired performance in each job. Both PAQ and DOT data accounted for variance in ratings of acceptability. Perceptions of danger were the best single predictor of acceptability and appeared to mediate the relationships between job characteristics and the acceptability of employee drug testing.     

LINKING O*NET JOB ANALYSIS INFORMATION TO JOB REQUIREMENT PREDICTORS: AN O*NET APPLICATION

This is an exploratory study that examined the possible application of the job component validity (JCV) model to identify potential employee selection instruments and to determine job requirement levels from O*NET job analysis data, following a research paradigm established with the Position Analysis Questionnaire (PAQ). Job requirements were measured by mean aptitude test scores on the General Aptitude Test Battery (GATB), and the ratings on the O*NET Generalized Work Activities (GWAs) were selected as representative O*NET job analysis data. Multiple correlation coefficients ranging from .35 to .89 were found when predicting mean GATB test scores from GWAs. Similar to JCV research some 30 years ago, predictions were strongest for cognitive aptitudes and weakest for manual dexterity. The data were examined under both rational and cross-validated empirical models. The results have positive implications for the development of a database that would support JCV estimates derived from O*NET job analysis data and allow practitioners to use O*NET data to help identify useful employee selection instruments.     

A Review of the Nonreading Aptitude Test Battery

This article re-examines data from the Nonreading Aptitude Test Battery (NATB) and General Aptitude Test Battery (GATB) test manuals in light of some conventionally accepted psychometric considerations. The NATB standardization sample is adequate. However, the validity is open to question since the NATB demonstrates only a modest correlation with the GATB. It is recommended that caution be employed in relating NATB profiles to the Occupational Aptitude Patterns' norms. This is especially relevant since the NATB, lacking norms of its own, relies on GATB norms and its derived Occupational Aptitude Pattern (OAP).     

任职者任务绩效水平对其工作分析结果的影响

在控制了个体人口统计学变量和排除组织水平变量的影响下,探讨了电厂设计和编辑两个职位任职者的任务绩效水平对于他们Occupational Information Network (以下缩写为O*NET)工作分析问卷评价结果的影响。层次回归结果发现,控制了相关因素后,发电厂设计人员的任务绩效水平能显著影响其对技术性技能的水平评价,编辑的任务绩效水平能显著影响信息处理的重要性评价和水平评价,在一定程度上证实了“工作分析结果差异来源于真实差异”的理论     

A COMPARISON OF GLOBAL JUDGMENT VS. TASK ORIENTED APPROACHES TO JOB CLASSIFICATION

The purpose of this study was to determine the extent to which direct judgments of similarity by supervisors and incumbents could provide the same job classification results as a more elaborate job analysis procedure involving measures of task overlap among jobs. To accomplish this, 8 foreman jobs in a chemical processing plant were analyzed and compared on 237 task statements. In addition, 15 foremen incumbents and 17 supervisors evaluated the similarities among the same 8 foremen jobs in a paired comparisons rating task. The task-oriented job analysis required hundreds of man-hours to complete; the rating task took 15 minutes. Results using hierarchical cluster analysis and multidimensional scaling analysis revealed that the global judgments and the task-oriented data led to identical conclusions. Also, it was found that incumbent ratings produced the same results as ratings from supervisors. Uses, advantages, and disadvantages of the procedure are outlined.     

USING A META-ANALYTIC PERSPECTIVE TO ENHANCE JOB COMPONENT VALIDATION

This paper develops synthetic validity estimates based on a meta-analytic-weighted least squares (WLS) approach to job component validity (JCV), using position analysis questionnaire (PAQ) estimates of job characteristics, and the Data, People, & Things ratings from the  Dictionary of Occupational Titles  as indices of job complexity. For the general aptitude test battery database of 40,487 employees, nine validity coefficients were estimated for 192 positions. The predicted validities from the WLS approach had lower estimated variability than would be obtained from either the classic JCV approach or local criterion-related validity studies. Data, People, & Things summary ratings did not consistently moderate validity coefficients, whereas the PAQ data did moderate validity coefficients. In sum, these results suggest that synthetic validity procedures should incorporate a WLS regression approach. Moreover, researchers should consider a comprehensive set of job characteristics when considering job complexity rather than a single aggregated index.     

A validation of the Worker Trait Groups in the DOT

An empirical validation of the 114 Worker Trait Groups (WTG) of the Third Edition of the Dictionary of Occupational Titles (DOT) was performed by comparing the factor structure of the worker trait components of the 114 WTG's with the factor structure of a random sample of 800 of the 4000 jobs used as the basis for the DOT, Third Edition. Six factors were compared and cosines between .8997 and .9657 obtained on the matched factors, thus providing a measure of empirical validity for the 114 WTG's based on the worker trait components.     

A MULTIPLE LEVEL INVESTIGATION OF PERSONNEL RATINGS

A multiple levels of analysis approach was used to assess whether job performance and skill importance ratings were based on individual differences, incumbent/supervisor dyadic agreement, group membership, or functional department. Data were collected as part of a managerial training needs analysis conducted at a large gold and silver mining organization. Participants included 140 incumbent managers and their immediate supervisors, who were embedded in 140 incumbent/supervisor dyads, 39 managerial work groups, and eight departments of the organization. Results from Within and Between Analysis (WABA) suggested that (a) incumbent ratings of both performance and skill importance were characterized by individual differences, (b) supervisory ratings of both performance and skill importance were primarily characterized by between-groups (supervisors) differences, (c) matched incumbent-supervisory performance ratings displayed individual differences, and (d) matched incumbent-supervisory importance ratings displayed dyadic agreement (i.e., between-dyads differences). Practical implications of these results for interpreting these and other types of personnel-related data are discussed.     

Do Employees Know How Their Supervisors View Them? A Study Examining Metaperceptions of Job Performance

This study investigated employees’ views about how their supervisors would rate their job performance (i.e., employees’ metaperceptions). Two hundred forty employees from a high-tech firm provided self- and metaperception job performance ratings, and their supervisors also provided ratings of the employees’ performance. The study produced several notable findings, including that metaperceptions were more strongly related to supervisory ratings than were self-ratings, that meta-accuracy was stronger for task versus contextual performance, and that employees who engaged in more impression management behavior exhibited higher meta-accuracy. Discussion focuses on the theoretical and practical implications of these findings.     

The homogeneity assumption in differential prediction analysis: does it really matter?

In simulation studies, the F test for differences in regression slopes has tended to distort nominal Type I and II error rates when the 2 subgroup error variances exceeded a 1.50:1 ratio. This study examines the frequency and extent that this ratio is violated within data sets relevant to applied psychology. The General Aptitude Test Battery (GATB) validity study database contained ability data and overall job performance ratings. The Project A military database contained both ability and personality data, along with job performance factor scores and an overall job performance rating. Results suggest that subgroup (White-Black, male-female) error variances are often homogeneous enough to support F test results from past empirical work. Enough heterogeneity was found, however, to urge applied psychologists investigating differential prediction to explore their data and consider the possibility of alternative statistical tests.     

THE TRANSPORTABILITY OF JOB INFORMATION ACROSS COUNTRIES

Three Occupational Information Network (O*NET) instruments (Generalized Work Activities, Basic and Cross-Functional Skills, Work Styles) were administered to 1,007 job incumbents, from 369 organizations, performing 1 of 3 jobs (first-line supervisor, office clerk, computer programmer) in New Zealand, China, and Hong Kong. Data from these countries were compared with archival data collected from 370 incumbents holding similar jobs in the United States. Hypothesized country differences, derived from cross-cultural theory, received limited support. The magnitude of differences in mean item ratings between incumbents from the United States and the other 3 countries were generally small to moderate in size, and rank-orderings of the importance and level of work activities and job requirements were quite similar, suggesting that, for most applications, job information is likely to transport quite well across countries.     

USING WEB-BASED FRAME-OF-REFERENCE TRAINING TO DECREASE BIASES IN PERSONALITY-BASED JOB ANALYSIS: AN EXPERIMENTAL FIELD STUDY

We identify sources of biases in personality-based job analysis (PBJA) ratings and offer a Web-based frame-of-reference (FOR) training program to mitigate these biases. Given the use of job analysis data for the development of staffing, performance management, and many other human resource management systems, using biased PBJA ratings is likely to lead to a workforce that is increasingly homogenous in terms of personality but not necessarily a workforce with improved levels of performance. We conducted a field experiment (i.e., full random assignment) using 2 independent samples of employees in a city government and found evidence in support of the presence of biases as well as the effectiveness of the proposed solution. Specifically, FOR training was successful at decreasing the average correlation between job incumbents' self-reported personality and PBJA ratings from .27 to .07 (administrative support assistants) and from .30 to .09 (supervisors). Also, FOR training was successful at decreasing mean PBJA ratings by d = .44 (administrative support assistants) and by d = .68 (supervisors). We offer the entire set of Web-based FOR training materials for use in future research and applications.     

Shall we continue or stop disapproving of self-presentation? Evidence on impression management and faking in a selection context and their relation to job performance

The self-presentation tactics of candidates during job interviews and on personality inventories have been a focal topic in selection research. The current study investigated self-presentation across these two selection devices. Specifically, we examined whether candidates who use impression management (IM) tactics during an interview show more faking on a personality inventory and whether the relation to job performance is similar for both forms of self-presentation. Data were collected in a simulated selection process with an interview under applicant conditions and a personality inventory that was administered under applicant conditions and thereafter for research purposes. Because all participants were employed, we were also able to collect job performance ratings from their supervisors. Candidates who used IM in the interview also showed more faking in a personality inventory. Importantly, faking was positively related to supervisors’ job performance ratings, but IM was unrelated. Hence, this study gives rise to arguments for a more balanced view of self-presentation.     

Masculinity-femininity perceptions of job requirements and their relationship to job-sex stereotypes

Perceived sex appropriateness of the work situation is believed to constrain work opportunities, particularly for women. However, sex appropriateness may be defined either with respect to the entire job or with respect to the tasks which comprise the job. In this study sex appropriateness of job tasks was examined by obtaining subjective estimates of the masculinity-femininity of the job requirement dimensions defined by the Dictionary of Occupational Titles (DOT). Results indicate that interacting with things is perceived as masculine, interacting with people is perceived as feminine, and interacting with data is perceived as falling between the other two. There is less agreement on the masculinity-femininity of specific types of interactions with data, people, and things. Sex appropriateness of specific requirements was found to be only moderately associated with the DOT's assessment of the complexity of those requirements. Further, sex appropriateness of job requirements was not highly related to the job sextypes established by Shinar (Shinar, E. H. Journal of Vocational Behavior, 1975, 7, 99–110) and Krefting et al. (Krefting, L. A., Berger, P. K., and Wallace, M. J. Jr. Journal of Vocational Behavior, 1978, 13, 181–191). This suggests that sex appropriateness of a job and sex appropriateness of the tasks which comprise the job are distinct, separate concepts.     

OBTAINING VALID PREDICTORS BY MINIMIZING RATING ERRORS IN THE CRITERION1

The correlations between each of five predictors and supervisory ratings of job effectiveness were not significantly different from zero. On the basis of the job analysis that preceded the validation study, the author concluded that the low correlations between each of the five predictors and the criterion were not due to problems inherent in either the tests or the performance appraisal instrument. Rather, it was hypothesized that the low correlations were a result of rating errors made by supervisors. The results of an eight hour training program (Latham, Wexley, and Pursell, 1975) designed to minimize rating errors supported this hypothesis. Four of the five predictors correlated significantly with the performance ratings that were conducted after the supervisors had received the training.     

JOB ANALYSIS: THE COMPOSITION OF SME SAMPLES

It is common for job analysts to solicit information from incumbents and supervisors (Subject Matter Experts or SMEs) when conducting a job analysis. These SMEs are asked to provide ratings on salient dimensions (e.g., frequency and importance of tasks that comprise the job). In constructing samples of SMEs for this purpose, it is reasonable to consider any possible influences that might bias or systematically influence the task ratings. The present paper considers the possible influence of SME demographic characteristics on task ratings of frequency. The tasks comprising the job of patrol officer in a large city were rated for frequency by approximately 700 incumbents. These ratings were gathered in two different years, 1982 and 1984. The total data set was used to conduct a components analysis of the 444-item task inventory. The first eight principal components were considered the dependent variables and four demographic characteristics the independent variables in an analysis of the 1982 data set. Analysis of variance and follow-up tests indicated that incumbent experience had a substantial influence on task ratings. Educational level and race had minimal effects on ratings. The sex factor was confounded by the experience factor, making interpretation of the sex effect equivocal. Mechanisms that might account for the experience effect are discussed. It was concluded that incumbent experience is a salient issue in job analysis using SME groups.     

Supervisor Appraisal as the Link Between Family–Work Balance and Contextual Performance

We examined the relationship between subordinates’ family to work balance (conflict and enrichment) and two dimensions of contextual performance (interpersonal facilitation and job dedication) reported by supervisors. Beyond the direct effects, we hypothesized that supervisor’s appraisals of employee conflict and enrichment would influence the supervisor’s contextual performance ratings. Data collected from a matched sample of 156 private sector employees and their supervisors indicated that the supervisor’s performance ratings were impacted by the supervisor’s appraisal of enrichment. However, the supervisor’s appraisal of conflict only mattered for interpersonal facilitation. There was a direct effect of subordinate’s conflict on both dimensions of contextual performance.     

工作满意度、情感承诺和工作投入对工作技能评价结果的影响

通过对从事人力资源管理工作的公务员、软件工程师、网络编辑和报纸广告销售人员四个职业的272名任职者调查数据的层次回归分析,文章发现控制了职业和人口统计学变量的影响之后,工作满意度、情感承诺和工作投入三个工作态度变量对工作技能的重要性和水平评价有显著影响。进一步对比发现,工作满意度对于技能的重要性和水平评价的影响效应较大。该研究对多个职业的分析结果拓展了人们对工作分析结果影响因素的认识,并对未来工作分析研究和实践有重要的启示作用