On the validity of implicit association measures of personality traits

Participants (N = 200) completed self-report and implicit association (IAT) measures of Extraversion, Conscientiousness, and Emotional Stability. Peer trait ratings and supervisor ratings of job performance were also collected. Results suggested low convergence between IAT and self-report trait measures. Cognitive ability and self-positive bias both explained significant portions of the method variance expressed by IAT measures. Correlations between IAT trait measures and job performance were statistically non-significant, of similar magnitudes to their self-report counterparts, and of magnitudes consistent with past research on criterion validities of self-report trait measures. The results offer only very limited support for the use of IAT trait measures in applied assessment settings.     

Webcam testing: Validation of an innovative open-ended multimedia test

A modern test that takes advantage of the opportunities provided by advancements in computer technology is the multimedia test. The purpose of this study was to investigate the criterion-related validity of a specific open-ended multimedia test, namely a webcam test, by means of a concurrent validity study. In a webcam test a number of work-related situations are presented and participants have to respond as if these were real work situations. The responses are recorded with a webcam. The aim of the webcam test which we investigated is to measure the effectiveness of social work behaviour. This first field study on a webcam test was conducted in an employment agency in The Netherlands. The sample consisted of 188 consultants who participated in a certification process. For the webcam test, good interrater reliabilities and internal consistencies were found. The results showed the webcam test to be significantly correlated with job placement success. The webcam test scores were also found to be related to job knowledge. Hierarchical regression analysis demonstrated that the webcam test has incremental validity up to and beyond job knowledge in predicting job placement success. The webcam test, therefore, seems a promising type of instrument for personnel selection.     

The Overclaiming Questionnaire: A good way to measure faking?

We evaluated the validity of the Overclaiming Questionnaire (OCQ) as a measure of job applicants’ faking of personality tests. We assessed whether the OCQ (a) converged with an established measure of applicant faking, Residualized Individual Change Scores (RICSs); (b) predicted admission of faking and faking tendencies (Faking Frequency, Minimizing Weaknesses, Exaggerating Strengths, and Complete Misrepresentation); and, (c) predicted the aforementioned measures as strongly as RICSs did. First, 261 participants were instructed to respond honesty to an extraversion measure. Next, in a mock job application, they filled out the extraversion measure again, as well as the OCQ. The OCQ only weakly predicted RICSs (r = .17), Faking Admission (r = .18), and Faking Frequency (r = .15), and it failed to correlate significantly with Minimizing Weaknesses, Exaggerating Strengths, and Complete Misrepresentation. Moreover, the OCQ performed significantly worse than RICS in predicting Faking Admission, Faking Frequency, Minimizing Weaknesses, Exaggerating Strengths, and Complete Misrepresentation. We urge caution in using the current version of the OCQ to measure faking, but speculate that the innovative approach taken in the OCQ might be more effectively exploited if the OCQ content were tailored to the specific job that applicants are being tested for.