Pre-employment honesty testing: Fakability,reactions of test takers,and company image

Two common employer concerns about pre-employment honesty testing were addressed: fakability and the test taker's reaction to such tests. Students, 84% with work experience in industries where honesty tests are common, took an honesty test under one of three instructional sets: respond honestly, fake good, and respond as if applying for a job. While subjects instructed to fake good could easily do so, the scores of subjects responding as job applicants more closely resembled those of subjects instructed to respond honestly. Strong negative reactions to honesty tests were not found; rather, most subjects felt that such tests were appropriate. The use of pre-employment honesty tests was not found to have a large impact on test taker perceptions of employers using such tests.     

Individual Achievement Testing of Children with Learning Problems: A Clinical Guide

This paper calls attention to the clinical value of standardized achievement tests in the individual evaluation of children with learning disabilities when these tests are interpreted within the framework of psychoanalytic ego-psychology. A number of aspects of test administration were considered: the choice from the wide variety of published tests, the sequence in which achievement tests are administered in the test battery, the selection of tests from within the achievement test battery, modifications in standard achievement test administration, supplementary exploration of idiosyncratic errors as well as the child's conception of the use of achievement skills. Methods of test analysis of derived scores, patterning of errors, and individual errors were illustrated. The diagnostic relevance of clinical behavior in the achievement testing situation was commented upon. The importance of integrating achievement test findings with the rest of the psychological test battery as well as with information from sources apart from testing was stressed. Finally, the heterogeneity of learning problems in children and the consequent importance of particularizing current status and etiology was emphasized.     

WEB‐BASED AND PAPER‐AND‐PENCIL TESTING OF APPLICANTS IN A PROCTORED SETTING: ARE PERSONALITY,BIODATA, AND SITUATIONAL JUDGMENT TESTS COMPARABLE?

This quasi-experimental study compares the equivalence of proctored Web-based tests to paper-and-pencil tests in a selection setting. The predictor battery was composed of measures of Conscientiousness, Agreeableness, Emotional Stability, a biodata form, and a situational judgment test. Three samples were administered the same test items, but differed with respect to context and test format: 425 incumbents completed a paper-and-pencil version, 2,544 applicants completed a paper-and-pencil version, and 2,356 applicants completed an identical Web-based version (although these individuals were not randomly assigned to test format, the job and organization were the same for all samples). The results found effects for both context and test format. Relative to the applicants completing the paper-and-pencil measures, the Web-based measures showed (a) better distributional properties, (b) lower means, (c) more variance, (d) higher internal consistency reliabilities, and (e) stronger intercorrelations. Although the applicant context resulted in higher mean responses than the incumbent context, this difference was about twice as large for the paper-and-pencil test than for the Web-based test. All such differences were greater for personality measures than for biodata and situational judgment tests. Overall, these results suggest that proctored Web-based testing has some positive benefits relative to paper-and-pencil measures, and we identify several implications of these findings for research and practice.     

Individual and group differences in intelligence and speed of information processing

A battery of eight different reaction time (RT) tests, measuring the speed with which individuals perform various elementary cognitive processes, and a group test of scholastic aptitude (the Armed Services Vocational Aptitude Battery, ASVAB) were given to 50 black and 56 white male vocational college students. The regression of the general factor scores of the ASVAB on the RT measures yielded a shrunken multiple correlation of 0.465. Although discriminant analyses, when applied separately to the ASVAB subtests and to the RT variables, showed highly comparable overall discrimination (over 70% correct classification) between the black and white groups, factor scores derived from the general factor (labeled ‘speed of information processing’) of the RT battery show only about one-third as large a mean black-white difference as the mean group difference on the general factor scores derived from the ASVAB. Comparisons were also made between the 106 vocational college students and 100 university students of higher average academic aptitude who had previously been tested on the same RT battery (Vernon, 1983a). These groups showed marked differences on the RT variables, the largest differences occuring on the tests that required more complex cognitive processing. The more complex RT tests also correlate most highly with the psychometric measures of ability within each group. The results are consistent with the hypothesis that individual differences and the mean differences between groups in psychometric abilities and scholastic achievement are related to differences in the speed of information processing as measured in elementary cognitive tasks.     

Validities of Unit-Weighted Composites of the ASVAB and the ECAT Battery

Currently, assignment to training in each entry-level enlisted job in the U.S. military is influenced by examinees’ scores on the classification composite for that job from the Armed Services Vocational Aptitude Battery (ASVAB). For a cross-service sample of the 18 occupations in the Enhanced Computer-Administered Test (ECAT) project, enhancements of their respective operational ASVAB composites (9 unique ones) are evaluated here. Analyses are reported on the gains in validity from adding 1 test with unit weight to each composite, the addition coming either from the other ASVAB tests or from the 9 tests of the ECAT battery. In more than half the schools, the best ASVAB additions were Coding Speed or Mechanical Comprehension. In the ECAT battery, 1 test of psychomotor ability (Two-Hand Tracking) and 2 tests of working memory (Mental Counters and Sequential Memory) were the most promising additions. The utility of the new composites for person–job matching is discussed.     

Stepwise Selection of ECATs for Maximum Mean Validity

The problem addressed in this article is how to select a common battery of predictor tests for all armed services schools. A technique was developed for selecting a subset of tests from a larger test pool in order to maximize the mean corrected validity across occupational samples. The method involved adding or deleting tests stepwise to build a battery having a specified number of tests. The method was applied to the combined battery consisting of the Armed Services Vocational Aptitude Battery (ASVAB) and the Enhanced Computer-Administered Test (ECAT) battery. The analyses showed that, if all ASVAB tests were forced in first, validity tended to level off after 3 ECAT tests were added, each test representing a different ECAT factor. The first 3 ECAT tests selected by the procedure were Two-Hand Tracking, Mental Counters, and Assembling Objects. These 3 ECAT tests produced 76% of the validity gain from the full 9-test ECAT battery for preferred (i.e., hands-on performance oriented) school criteria. Also, a combination of 3 ECAT battery tests and 5 ASVAB tests had greater mean validity than did the full ASVAB of 10 tests. A variety of alternative combinations of 3 ECAT tests had nearly the same validity as did the optimal tests, as long as the tests measured the 3 basic ECAT battery factors of Psychomotor Ability, Working Memory, and Spatial Ability.     

How Secure are Unproctored Pre-Employment Tests? Analysis of Inconsistent Test Scores

Employment tests have long been scrutinized for psychometric considerations such as validity and reliability, but the extent to which cheating may occur on pre-employment tests has generally been overlooked. With the rise of unproctored, on-demand, online testing, the need has never been greater to focus on design and process considerations that can help mitigate the potential for cheating on employment tests. This paper builds on the limited existing research on the detection of inconsistent test scores on unproctored Internet testing. Job candidates (n = 4,026) completed a computer adaptive cognitive ability test under two conditions: an unproctored screening test followed by a proctored confirmation test. Analyses focused on detecting instances of inconsistent test scores based on comparison of standard errors of measure for the unproctored and proctored test scores (Guo and Drasgow, Int J Sel Assess 18:351–364, 2010). Results revealed a relatively low number of inconsistent scores and are discussed in the context of future research, application, and theory building on the nature of cheating on pre-employment tests.     

Prediction of job satisfactoriness for workers with severe handicaps from aptitudes,personality, and training ratings

The predictive validity of General Aptitude Test Battery and Sixteen Personality Factor Questionnaire scores were compared to standard training ratings made by vocational instructors against the criterion of work performance measured by the Minnesota Satisfactoriness Scales for a sample of 106 employees with severe handicaps. The psychometric test variables were not correlated with the criterion; however, the training ratings were consistently predictive of the job satisfactoriness scores. These results suggest that the employment potential of job applicants with disabilities can be assessed more accurately using situational training ratings, as opposed to standardized psychometric test scores.     

The impact of “non-targeted traits” on personality test faking,hiring, and workplace deviance

Evidence suggests that job applicants often “fake” on pre-employment personality tests by attempting to portray an exceedingly desirable impression in order to improve the likelihood of being selected. In the current research we shed light on the personality characteristics of those individuals who seem most likely to engage in faking. We refer to these personality variables as non-targeted traits when they are not directly targeted by the organization’s pre-employment personality test. These traits, however, may have an influence on targeted scores used for employment decision making through their effect on faking. Findings suggest that individuals will be more likely to be hired if they are low on non-targeted traits including Honesty–Humility, Integrity, and Morality, and high on Risk Taking. Such individuals also reported higher levels of workplace deviance in their current jobs. Thus, it seems that individuals low on Honesty–Humility, Integrity, and Morality, and individuals high on Risk Taking, may be most likely to engage in personality test faking, be hired, and participate in workplace deviant behaviors if these traits are not directly targeted in selection.     

DOES PRE-EMPLOYMENT DRUG USE PREDICT ON-THE-JOB SUITABILITY?

Drug testing is increasingly used in the screening of applicants for employment. Despite the growth of drug testing, there is little research that examines the value of pre-employment drug-use information in the prediction of post-employment suitability. This research, which was based on a sample of 10,188 young adults, examined the criterion-related validity of pre-employment drug-use information. For all drugs examined, the greater the frequency of use and the earlier the age at which the drug was first used, the greater the probability of a person being classified as unsuitable after hire. However, the operational validity of each drug variable was influenced by the base rate of drug use. The low base rates for some drugs make their operational validity of limited value. The operational validity of the marijuana frequency-of-use measure (.07) was approximately equal to that of less frequently used drugs (e.g., stimulants and depressants). No strong moderators of the validity of a drug-composite measure were found.     

The impact of pre-employment integrity testing on employee turnover and inventory shrinkage losses

A major home improvement chain located primarily in the western United States initiated the use of thePersonnel Selection Inventory, a written integrity test, as part of its pre-employment hiring process. For two years only, those job applicants who passed this test and other pre-employment criteria were hired by the chain. Following the introduction of the inventory, there was: (1) a 50% reduction in the number of employee terminations for theft, illegal drug use, and violence over a five year period and (2) a savings in shrinkage losses that amounted to over two million dollars over a two year period.     

Taskomat: Evaluation of a Computerized Test Battery

A case study on a computerized test battery is presented based on more than a decade of use in military and civil settings. The study sheds light on the general issues associated with computerized testing. The accent is on the contrast between computerized and traditional paper-and-pencil testing. The computerized battery, called Taskomat, is founded on concepts arising from human performance theory. The tests of the battery are described, as well as issues related to the hardware (cost of purchasing, hardware reliability and industrial styling). Criteria used to evaluate the content of the tests were: reliability, robustness of effects, uniqueness or newness of abilities relative to paper-and-pencil testing, and validity of these abilities for predicting occupational success. A conclusion is that a theoretical foundation helps to increase the likelihood of assessing new abilities.     

Effects of Providing Pre‐Test Information and Preparation Materials on Applicant Reactions to Selection Procedures

This study examined the effects of providing applicants with pre‐test information and preparation (PTIP) materials on pass rates and reactions to the selection process. Applicants for chemical process operator positions that had (n=38) and had not (n=57) received PTIP materials before completing a test battery were surveyed after they had received notice of the outcome of the testing. Providing the PTIP materials did not influence overall pass rates or applicant reactions. However, results indicated that testing outcome (pass vs fail) had a strong influence on applicant reactions to the testing process. Among those that did not pass the testing hurdle, providing PTIP materials markedly improved perceptions of fairness and satisfaction with the testing process. These findings show that the use of PTIP materials reduces negative applicant reactions experienced by individuals that do not pass employment tests.     

PROJECT A: SPECIFICATION OF THE PREDICTOR DOMAIN AND DEVELOPMENT OF NEW SELECTION/ CLASSIFICATION TESTS

A major goal of the Army Selection and Classification Project was to develop an experimental predictor battery that would best supplement the Armed Forces Vocational Aptitude Battery for making selection and classification decisions for entry-level enlisted personnel. That is, what predictor measures would best serve the needs of all the jobs in an entire selection/classification system? This paper describes the characteristics of the new test battery and the procedures that were used to develop it. The major steps in the procedure were a structured literature search using a standard protocol, an extensive expert judgment study of expected true validities for a population of predictor variables against a population of performance components, fabrication of modularized software and a special response pedestal for computerized measurement of perceptual and psychomotor abilities, evaluations of experimental measures in three iterative pilot tests and one major field test, and a series of reviews by a panel of scientific advisers. The test battery that resulted from this 2 1/2-year development effort is described. The basic psychometric properties of each measure, as determined in a large concurrent validation sample, are also described.     

Introduction to the Special Issue on Selected New Developments in Military Enlistment Testing

This article provides a brief discussion of the historical context for the major recent advances in enlisted selection and classification that are the subject of this special issue. By providing a perspective on the difficulty personality assessment has had gaining traction as a screening measure, it supplies a basis for understanding the significance of recent advances in personality measurement. This article also summarizes the military research on interest measurement that will receive more extended treatment later in this issue. It relates the work in this issue on new information technology testing to the role of information testing in the current military operational selection and classification test battery, the Armed Services Vocational Aptitude Battery (ASVAB), and discusses the background for 2 additional cognitive measures, Coding Speed and Assembling Objects. Finally, it previews issues to be discussed in the commentary article at the end of this issue.     

Standardized Tests Used in Correctional Institutions

This study provides data from 11 adult correctional institutions on the percentage of residents who took standardized tests — educational, intelligence, vocational, and psychological tests — over a one-year period. The Gray-Votaw-Rogers and the General Educational Development tests were the most often administered educational tests. Many more residents were given educational or academic achievement tests than intelligence tests. The two measures of personality most common to all institutions in the study were the Minnesota Multiphasic Personality Inventory and the Rotter Incomplete Sentence Blank. Five of the 11 institutions gave no vocational tests other than the General Aptitude Test Battery. Many individual differences in institutions are noted.     

Health Care Providers Inventory: a method for evaluating nursing aides

The Health Care Providers Inventory (HCPI) is a 70-item questionnaire containing five primary scales and a validity scale. It is a pre-employment instrument designed to evaluate American nursing aides. In this study, I determined that the HCPI is a reliable, non-discriminatory test. Concurrent, construct, and predictive validity data are reported, which indicate that the HCPI measures significant personality characteristics, and is of value to administrators in their hiring of suitable applicants and in the reduction of employee turnover in nursing homes.     

Development of a Cyber/Information Technology Knowledge Test for Military Enlisted Technical Training Qualification

An Armed Services Vocational Aptitude Battery (ASVAB) Review Panel, with expertise in personnel selection, job classification, psychometrics, and cognitive psychology developed recommendations for changes to the military enlistment test battery. One recommendation was to develop and evaluate a test of cyber/information and communications technology literacy to supplement current ASVAB content. This article summarizes a multiphased Cyber Test development process: (a) a review of information/computer technology literacy definitions and measures, (b) development and pilot testing of a cyber knowledge measure, (c) validation of test scores against final school grades (FSGs) for selected technical training courses, (d) development of an operational reporting metric and subgroup norms, and (e) examination of construct validity. Results indicate the Cyber Test has predictive validity versus technical training school grades and incremental validity comparable to the ASVAB technical knowledge tests when used with the ASVAB Armed Forces Qualification Test (AFQT) verbal/math composite as a baseline.     

Correcting Differences in Answer Sheets for the 1980 Armed Services Vocational Aptitude Battery Reference Population

In the late 1970s, the Department of Defense (DoD) requested that the reference population for the Armed Services Vocational Aptitude Battery (ASVAB), at that time based on a 1944 sample, be changed and updated to reflect the current youth population. In 1980, the data for the new reference group were collected. Data analyses indicate that the new sample's speeded test scores are atypically low; therefore, the sample might be inappropriate as a reference. The problem was traced to the format of an answer sheet used in the 1980 youth population data collection. In our study, we tested the differences between performance on the 1980 youth study answer sheet and that used operationally for the ASVAB. An adjustment was developed to resolve those differences. Data for this study were scores on two ASVAB speeded tests of about 9,500 service applicants at Military Entrance Processing Stations (MEPS). Half of these applicants were tested on the operational ASVAB answer sheet; half were tested with the answer sheet used in the 1980 youth study. The speeded test scores derived from the 1980 youth study answer sheets were then equated to those derived from the operational ASVAB answer sheets. Adjustments based on these equatings resolved the speeded test anomalies observed in the 1980 youth study.     

The Effect of Selection Ratio on Perceptions of the Fairness of a Selection Test Battery

This research examined the effects of the selection ratio on applicants’ perceptions of the fairness of a battery of tests. These fairness perceptions were also examined to assess whether they moderated the validity of the tests. A laboratory study was undertaken to examine the effects of the selection ratio on applicants going through a selection process and to examine the effects of being hired or rejected. Results revealed that the selection ratio did not have an effect on perceptions, but that hired individuals perceived greater distributive fairness. Furthermore, attitudes towards the cognitive ability test moderated the validity of the cognitive ability test, but attitudes toward the personality test did not moderate the validity of the personality test.