Using Personality Constructs to Predict Performance: Narrow or Broad Bandwidth

One factor that can influence the magnitude of predictive validity of personality tests for selection is the bandwidth of the constructs measured (Ashton, Jackson, Paunonen, Helmes, & Rothstein, Journal of Research in Personality, 29, 432–442 (1995)). In addition, certain personality characteristics have been shown to be more prevalent in an occupational category (Barrick & Mount, Personnel Psychology, 44, 1–26 (1991)). The results of this study suggest the necessity to perform personality based job analysis within a specific occupational category to properly select a personality measure. Criterion validity coefficients of broad constructs were non significant. However, specific facets identified in a personality based job analysis demonstrated moderate significant correlations. In addition, applicants prefer a more narrowly defined selection test.     

Comparing applicants and incumbents: Effects of response distortion on mean scores and validity of personality measures

This study examined the negative effect of likely applicant distortion on mean scores and validity of personality measures. The personality test scores and performance ratings of applicants were directly compared to those of incumbents with the same occupation in four different samples. The results showed that applicant mean scores were higher and validity coefficients were lower than for incumbents.     

Personality and Situational Judgment Tests Across Applicant and Incumbent Settings: An Examination of Validity,Measurement, and Subgroup Differences

The effects of concurrent versus predictive designs were examined in 2 large samples of incumbents (N = 2,989) and applicants (N = 7,259) for 3 measures of personality and a situational judgment test (SJT). Results showed that applicants scored significantly higher than incumbents on the personality measures and significantly lower on the SJT. Regarding measurement equivalence, the results indicate that the same form of factor structure is found in both settings, with the factor structures themselves being generally invariant. Importantly, the criterion-related validities were equivalent across samples. Subgroup differences were small to moderate in both settings, though varying across race and gender. Limitations and directions for future research are offered.     

Do Applicants and Incumbents Respond to Personality Items Similarly? A Comparison of Dominance and Ideal Point Response Models

This study used an ideal point response model to examine the extent to which applicants and incumbents differ when responding to personality items. It was hypothesized that applicants' responses would exhibit less folding at high trait levels than incumbents' responses. We used sample data from applicants (N=1,509) and incumbents (N=1,568) who completed the 16 Personality Questionnaire Select. Differential item (DIF) and test functioning (DTF) analyses were conducted using the generalized graded unfolding model, which is based on ideal point model assumptions. Out of the 90 items, 50 showed DIF; however, only 11 were in the hypothesized direction. DTF was significant for 3 of the 12 scales; 2 were in the hypothesized direction.     

WEB‐BASED AND PAPER‐AND‐PENCIL TESTING OF APPLICANTS IN A PROCTORED SETTING: ARE PERSONALITY,BIODATA, AND SITUATIONAL JUDGMENT TESTS COMPARABLE?

This quasi-experimental study compares the equivalence of proctored Web-based tests to paper-and-pencil tests in a selection setting. The predictor battery was composed of measures of Conscientiousness, Agreeableness, Emotional Stability, a biodata form, and a situational judgment test. Three samples were administered the same test items, but differed with respect to context and test format: 425 incumbents completed a paper-and-pencil version, 2,544 applicants completed a paper-and-pencil version, and 2,356 applicants completed an identical Web-based version (although these individuals were not randomly assigned to test format, the job and organization were the same for all samples). The results found effects for both context and test format. Relative to the applicants completing the paper-and-pencil measures, the Web-based measures showed (a) better distributional properties, (b) lower means, (c) more variance, (d) higher internal consistency reliabilities, and (e) stronger intercorrelations. Although the applicant context resulted in higher mean responses than the incumbent context, this difference was about twice as large for the paper-and-pencil test than for the Web-based test. All such differences were greater for personality measures than for biodata and situational judgment tests. Overall, these results suggest that proctored Web-based testing has some positive benefits relative to paper-and-pencil measures, and we identify several implications of these findings for research and practice.     

Using Blatant Extreme Responding for Detecting Faking in High‐stakes Selection: Construct validity,relationship with general mental ability,and subgroup differences

Although there has been a steady growth in research and use of self‐report measures of personality in the last 20 years, faking in personality testing remains as a major concern. Blatant extreme responding (BER), which includes endorsing desirable extreme responses (i.e., 1 and 5 s), has recently been identified as a potential faking detection technique. In a large‐scale (N = 358,033), high‐stakes selection context, we investigate the construct validity of BER, the extent to which BER relates to general mental ability, and the extent to which BER differs across jobs, gender, and ethnic groups. We find that BER reflects applicant faking by showing that BER relates to a more established measure of faking, an unlikely virtue (UV) scale, and that applicants score higher than incumbents on BER. BER is (slightly) positively related to general mental ability whereas UV is negatively related to it. Applicants for managerial positions score slightly higher on BER than applicants for nonmanagerial positions. In addition, there was no gender or racial differences on BER. The implications of these findings for detecting faking in personnel selection are delineated.     

Applicant Reactions to Digital Selection Methods: A Signaling Perspective on Innovativeness and Procedural Justice

Research has shown that the use of digital technologies in the personnel selection process can have both positive and negative effects on applicants’ attraction to an organization. We explain this contradiction by specifying its underlying mechanisms. Drawing on signaling theory, we build a conceptual model that applies two different theoretical lenses (instrumental-symbolic framework and justice theory) to suggest that perceptions of innovativeness and procedural justice explain the relationship between an organization’s use of digital selection methods and employer attractiveness perceptions. We test our model by utilizing two studies, namely one experimental vignette study among potential applicants (N?=?475) and one retrospective field study among actual job applicants (N?=?335). With the exception of the assessment stage in Study 1, the positive indirect effects found in both studies indicated that applicants perceive digital selection methods to be more innovative. While Study 1 also revealed a negative indirect effect, with potential applicants further perceiving digital selection methods as less fair than less digitalized methods in the interview stage, this effect was not significant for actual job applicants in Study 2. We discuss theoretical implications for the applicant reactions literature and offer recommendations for human resource managers to make use of positive signaling effects while reducing potential negative signaling effects linked to the use of digital selection methods.

     

The Magnitude and Extent of Cheating and Response Distortion Effects on Unproctored Internet‐Based Tests of Cognitive Ability and Personality

The use of unproctored internet‐based testing (UIT) for employee selection is quite widespread. Although this mode of testing has advantages over onsite testing, researchers and practitioners continue to be concerned about potential malfeasance (e.g., cheating and response distortion) under high‐stakes conditions. Therefore, the primary objective of the present study was to investigate the magnitude and extent of high‐ and low‐stakes retest effects on the scores of a UIT speeded cognitive ability test and two UIT personality measures. These data permitted inferences about the magnitude and extent of malfeasant responding. The study objectives were accomplished by implementing two within‐subjects design studies ( Study 1 N=296; Study 2 N=318) in which test takers first completed the tests as job applicants (high‐stakes) or incumbents (low‐stakes) then as research participants (low‐stakes). For the speeded cognitive ability measure, the pattern of test score differences was more consonant with a psychometric practice effect than a malfeasance explanation. This result is likely due to the speeded nature of the test. And for the UIT personality measures, the pattern of higher high‐stakes scores compared with lower low‐stakes scores is similar to those reported for proctored tests in the extant literature. Thus, our results indicate that the use of a UIT administration does not uniquely threaten personality measures in terms of elevated scores under high‐stakes testing that are higher than those observed for proctored tests in the extant literature.     

Does Acquisitive Self‐Presentation in Personality Self‐Ratings Enhance Validity? Evidence from two experimental field studies

The aim of the present research was to demonstrate that acquisitive self‐presentation in personality scales is not a barrier to their criterion‐related validities in human resource contexts, but rather a means to improve them. A pilot study (Study 1) with 96 job incumbents provided preliminary positive evidence. In Study 2, in the experimental group (n=99), the instructions asked job incumbents to work on a Big‐Five personality inventory (BFI‐K) as if they took part in a personnel selection procedure for a personally very attractive position. In the control group (n=93) of Study 2, job incumbents were asked to answer the inventory items honestly. As expected, the correlation between the self‐ratings of the motive to get along (i.e., which comprises emotional stability, conscientiousness, and agreeableness) and contextual performance assessments was significantly higher in the experimental group than in the control group in Study 2. Additionally, the correlation between the self‐ratings of the motive to get ahead (i.e., which comprises extraversion and openness to experience) and task performance and leadership assessments was significantly higher in the experimental group than in the control group in Study 2. It is proposed that responding to a personality inventory in a human resource decision situation should be conceptualized as a workplace simulation.     

Substance and style in socially desirable responding

The purpose of the present series of studies was to evaluate whether Paulhus's (1991) Self-Deceptive Enhancement (SDE) and Communion Management (CM) socially desirable responding (SDR) scales should be interpreted as response set measures, response style measures, or measures of substantive individual differences in personality. In Study 1 (N=57) and Study 2 (N=62), army officer trainees were tested as applicants to their program and retested as incumbents 3 years later. Although participants generally responded to the situation by showing higher SDR scores in the applicant conditions, they also showed considerable rank-order stability across time. In Study 3 (N=70), self-reports on both SDR scales were corroborated by spouse reports, and, furthermore, SDE scores correlated with spouse reports of low Neuroticism and high Extraversion. Our data are interpreted as suggesting that both the CM and SDE scales are, in some varying amounts, measures of response set, response style, and substantive individual differences in personality. Implications of our findings for personality assessment and personnel selection are discussed.     

Applicant Perceptions of Selection Procedures: The Role of Selection Information,Belief in Tests,and Comparative Anxiety

This study addresses the effects of the provision of information on the reliability and validity of selection procedures and the effects of test–taker attitudes (i.e., belief in tests and comparative anxiety) on fairness perceptions. Prior to an actual selection process, applicants (N= 118) were given either information about the reliability and validity of various selection procedures or no information. Next, they evaluated the fairness of eight selection procedures. No significant effect of selection information was found. Belief in tests had significant effects, with applicants high on test belief giving higher fairness ratings than applicants low on test belief. In addition, an interaction effect between test belief and selection procedure was found. For example, test belief had larger effects on fairness for structured interviews, personality inventories, and cognitive ability tests. No significant effect of comparative anxiety on fairness was found.     

The Effect of Selection Ratio on Perceptions of the Fairness of a Selection Test Battery

This research examined the effects of the selection ratio on applicants’ perceptions of the fairness of a battery of tests. These fairness perceptions were also examined to assess whether they moderated the validity of the tests. A laboratory study was undertaken to examine the effects of the selection ratio on applicants going through a selection process and to examine the effects of being hired or rejected. Results revealed that the selection ratio did not have an effect on perceptions, but that hired individuals perceived greater distributive fairness. Furthermore, attitudes towards the cognitive ability test moderated the validity of the cognitive ability test, but attitudes toward the personality test did not moderate the validity of the personality test.     

The relationship between cognitive ability and personality scores in selection situations: A meta‐analysis

Several faking theories have identified applicants’ cognitive ability (CA) as a determinant of faking—the intentional distortion of answers by candidates—but the corresponding empirical findings in the area of personality tests are often ambiguous. Following the assumption that CA is important for faking, we expected applicants with high CA to show higher personality scores in selection situations, leading in this case to significant correlations between CA and personality scores, but not in nonselection situations. This meta‐analysis (66 studies, k = 115 individual samples, N = 46,265) showed this pattern of results as well as moderation effects for the study design (laboratory vs. field), the response format of the personality test, and the type of CA test.     

Using Recruiter Assessments of Applicants’ Resume Content to Predict Applicant Mental Ability and Big Five Personality Dimensions

Information provided on applicants’ resumes provides a convenient, cost–effective means for applicant screening. We sought to determine if recruiters’ assessments of the presence of certain types of information on job applicants’ resumes was related to applicants’ general mental ability and personality traits. Forty recruiters from 35 organizations assessed the extent to which specified items were present on the resumes of job applicants. Results indicated relationships between recruiters’ judgments regarding applicants’ resume information and applicants’ cognitive ability and Big Five personality characteristics. Implications for the use of resume information in the selection process are discussed.     

A Case for Homogeneity of Personality at the Occupational Level

The forces of attraction–selection–attrition have been hypothesized to create homogeneity of personality within organizations, and vocational choice theory predicts that these forces lead to a ‘modal personality’ within given occupations. This study compared the homogeneity of a set of personality characteristics for 6582 incumbents from eight organizations in eight occupations. The results indicated that (1) the homogeneity hypothesis was supported both within organizations as well as within occupations; and (2) the homogeneity within occupations was higher than that found in organizations.     

Do Applicants Fake Their Personality Questionnaire Responses and How Successful are Their Attempts? A Case of Military Pilot Cadet Selection

This paper presents the results of three interrelated studies investigating the occurrence of response distortion on personality questionnaires within selection and the success of applicants in faking situations. In Study 1, comparison of the Big Five personality scores obtained from applicants in a military pilot cadet selection procedure with participants responding honestly, faking good, and faking an ideal candidate revealed that applicants responded more desirable than participants responding honestly but less desirable than respondents under fake instructions. The occurrence of faking within the military pilot selection process was replicated in Study 2 using the Eysenck Personality Questionnaire and another comparison group. Finally, in Study 3, comparison of personality profiles obtained in selection and ‘fake job’ situations with experts' estimates indicated that participants were partially successful in faking the desirable profile.     

Personality traits and job characteristics as predictors of job experiences

This study investigates the relationships of personality traits and job characteristics (predictors) with job experiences (criteria) in a sample of job incumbents working in a broad variety of occupations. Subjects were 181 job applicants, who participated in a personnel selection procedure carried out by a Dutch staffing organization. As a part of this procedure, subjects completed a number of personality questionnaires. Personality scale scores were factor-analysed, and four orthogonal trait dimensions were identified: Emotional Stability, Extraversion, Sensation Seeking, and Achievement Motivation. Between l½ and 2 years after the selection, subjects rated their current jobs on four job characteristics dimensions, namely dynamicity, autonomy, external–internal, and structure. At the same time, they completed a questionnaire measuring job experiences, namely job satisfaction, job-induced tension, propensity to leave the job, and self-appraised performance. The results indicated that personality traits had several significant and hypothesized longitudinal effects on the job experience criteria. Personality contributed to the prediction of the criteria even when the effects of job characteristics were taken into account. No significant Personality X Job Characteristics interactions were found, although subgroup analysis revealed a number of interesting differences among the various categories of occupations. For example, Sensation Seeking predicted job strain and propensity to leave, especially in highly structured and not very autonomous jobs. It is concluded that work experiences are clearly determined by person and job characteristics, although in an additive rather than in an interactional way.     

Is the Political Skill Inventory Fit for Personnel Selection? An Experimental Field Study

The political skill inventory (PSI) assesses social effectiveness in organizations by self‐reports and has demonstrated strong evidence of validity. It was the purpose of this experimental field study to investigate construct and criterion‐related validity of the PSI when used under conditions of personnel selection. In the experimental group (n=102), the instructions asked job incumbents to work on the PSI, a social desirability scale, and a Big‐Five personality inventory as if they took part in a personnel selection procedure for a personally very attractive position. Additionally, they were asked to report yearly income. In the control group (n=110), job incumbents were asked to answer the items honestly. As expected, in both conditions, the PSI did not correlate with social desirability, but it correlated positively with extraversion, conscientiousness, and income, and negatively with neuroticism, thus demonstrating construct and incremental criterion‐related validity under both conditions. Implications and limitations are discussed.     

Personality measurement, faking, and employment selection

Real job applicants completed a 5-factor model personality measure as part of the job application process. They were rejected; 6 months later they (n = 5,266) reapplied for the same job and completed the same personality measure. Results indicated that 5.2% or fewer improved their scores on any scale on the 2nd occasion; moreover, scale scores were as likely to change in the negative direction as the positive. Only 3 applicants changed scores on all 5 scales beyond a 95% confidence threshold. Construct validity of the personality scales remained intact across the 2 administrations, and the same structural model provided an acceptable fit to the scale score matrix on both occasions. For the small number of applicants whose scores changed beyond the standard error of measurement, the authors found the changes were systematic and predictable using measures of social skill, social desirability, and integrity. Results suggest that faking on personality measures is not a significant problem in real-world selection settings.