Applying theory to the black box: A model for empirically scoring biodata

Despite being an effective predictor of job performance, empirically keyed biodata assessments have been criticized as black box empiricism unlikely to generalize to new contexts. This paper introduces a model that challenges this perspective, explicating how biodata content, job demands, and criterion variables collectively influence the construct validity, and generalizability of empirically scored biodata. Across two field studies, expected changes in scale correlations with external measures were found that coincided with changes in the contextual similarity between calibration and holdout contexts, the criteria used, and the content validity of biodata items. Collectively, this paper offers a framework that helps understand and optimize empirical biodata keying in practice, furthering confidence for their use in applied settings.     

A Biodata Inventory Administered via Interactive Voice Response (IVR) Technology: Predictive Validity, Utility, and Subgroup Differences

Although organizations are increasingly using interactive voice response (IVR) systems to help screen and select job applicants, few if any published studies have investigated the effectiveness of such systems. The current study responded to this need by evaluating a biodata inventory administered via IVR technology. A predictive validity study revealed that both a 42-item biodata measure and a more parsimonious 6-item composite correlated with supervisor ratings of performance and did not result in adverse impact or differential prediction. In addition, a utility analysis indicated that both IVR biodata measures would likely result in considerable financial gains to the hiring organization. The implications of these results for selection research and practice are discussed.     

履历数据测评的效度分析

履历数据是人员测评的重要手段, 但其组织情景性限制使得国外同类工具不能适用于国内人事选拔, 国内也缺乏实证研究验证其信度、效度。本研究结合某通信企业的招募选拔工作, 开发履历数据分析工具, 选取250名应聘者的履历数据、一般认知能力、大五个性和面试结果数据, 通过效标关联效度、增量效度思想, 分析履历数据有效性。结果表明, 以面试结果为效标, 履历数据具有良好的效标关联效度, 与其他测评工具组合使用时有良好的增量效度。     

Diversity of Life Experiences: The Development and Validation of a Biographical Measure of Receptiveness to Dissimilar Others

In light of changing demographics one of the biggest future challenges for selection and promotion will be identifying individuals who are able to effectively work with dissimilar others and are receptive to differences in others. Since a reliable and valid measure of individuals’ receptiveness to dissimilar others does not currently exist, a biodata-based measure of this construct was developed using traditional scale development techniques. Evidence of the new measure’s reliability and validity are provided. Implications for theory-building and future research are presented, as well as potential applications for selection and assessment.     

Biodata: Meeting Clients’ Needs for a Better Way of Recruiting Entry-level Staff

Biodata as a selection technique is gaining greater acceptance in Australia and interest in the technique appears to be growing. There are a number of reasons for its rise in popularity, including particular advantages afforded by the technique such as enhanced validity and decreased adverse impact. This paper presents an overview of the development of a biodata instrument for large-scale recruitment and focuses specifically on how clients' needs were met by incorporating biodata in a revised recruitment system. The reader is also referred to another article in this issue by Karas and West that reports on this project, but covers technical aspects of the rational-empirical approach taken to instrument development. The biodata technique was chosen to meet specific requirements of a new selection system for entry level clerical and graduate staff of the Australian Public Service. Broadly, the system sought to assess a range of job-related skills encompassing both cognitive and noncognitive abilities and to maximize the validity and fairness of the recruitment process. The addition of a biodata questionnaire, as an integral part of the selection system, assisted in meeting these aims and providing clients with a more comprehensive process which offered greater flexibility and the reliable assessment of noncognitive attributes that are critical to success in today’s workplace.     

An Ideal Student Factor and the validity of noncognitive measures of student potential

The presence of a general factor has been found in previous research on the utilization of personality tests in selection contexts. Termed the Ideal Employee Factor (IEF), this factor is thought to represent an effort to present oneself as an ideal employee to some degree on all items in the test. Examining the responses to biodata and situational judgment items, we provide evidence for the existence of a factor similar to the IEF within the college admissions context, termed the Ideal Student Factor (ISF), but the magnitude of this factor relative to specific factors was small. Mixed support was found for the hypothesized differences in the factor loadings on the ISF for different constructs included in the model. The presence of the ISF was not found to substantially impact the validity of other predictors within this study. The overall conclusion is that this general factor would not impact the use of these biodata and situational judgment items in college admissions.     

Suitability Screening During Basic Military Training

Results are presented for suitability screening conducted by the United States Air Force during basic military training. The Lackland Behavioral Questionnaire has been used operationally since 2007, and its use has led to an increase in predictive validity. For the prediction of outcomes during the first 4 years of service, one can identify trainees with a 49% likelihood of being separated for unsuitability and a 56% likelihood of being diagnosed with a mental disorder. A formal suitability screening program allows referrals and recommendations to be made using a combination of empirical evidence and clinical judgment.     

Biodata Validity Decay and Score Inflation with Faking: Do Item Attributes Explain Variance Across Items?

Rating scales were developed to assess the biodata dimensions offered by Mael (1991). Biodata items assessing conscientiousness were administered under honest-responding and faking-good conditions. Item attributes were examined to determine their value in predicting item validity for honest respondents and item validity for faking respondents. Analyses were also conducted to determine whether the degree of item faking was related to item attributes. Item attributes associated with item validity for honest respondents are not the same as the item attributes indicative of item validity for the faking respondents. We suggest that this makes it very difficult to develop a biodata questionnaire which will be equally valid for both honest and faking respondents.     

The Validity of “Mini” Simulations for Mexican Retail Salespeople

The use of mini role play simulations was proposed as a means of collecting predictor data in a low-cost, time-efficient, and reliable manner. Mini role play simulations were developed for the purpose of measuring sales ability. In order to evaluate the efficacy of using the mini role play simulations, a concurrent validation study was conducted with 94 salespeople from a large, Mexican retail chain. Results indicated that the simulations significantly predicted performance and also added to the prediction of performance after controlling for a biodata instrument.