履历数据测评的效度分析

履历数据是人员测评的重要手段, 但其组织情景性限制使得国外同类工具不能适用于国内人事选拔, 国内也缺乏实证研究验证其信度、效度。本研究结合某通信企业的招募选拔工作, 开发履历数据分析工具, 选取250名应聘者的履历数据、一般认知能力、大五个性和面试结果数据, 通过效标关联效度、增量效度思想, 分析履历数据有效性。结果表明, 以面试结果为效标, 履历数据具有良好的效标关联效度, 与其他测评工具组合使用时有良好的增量效度。     

Incremental Validity of Interactive Multimedia Simulations in Two Organizations

Interactive multimedia simulations are conceptually distinct from other simulations commonly used as selection tools, such as assessment centers and situational judgment tests, and represent a potentially cost‐effective and job‐related candidate assessment tool. This study investigated the predictive validity of these simulations with a combined sample of call center employees from two organizations. Results indicate that customized interactive multimedia simulations demonstrate substantial criterion‐related validity and significant incremental validity over other noncognitive measures such as biodata and personality.     

Proctored Versus Unproctored Internet Tests: Are unproctored noncognitive tests as predictive of job performance?

As the usage of unproctored Internet testing (UIT) increases in selection settings, concerns about the validity of such practices must be addressed. While recent examinations of the issue have focused primarily on the practicality, ethics, and potential legal ramifications of UIT, this paper provides an examination of the criterion‐related validity of unproctored assessments. Using a database of validity evidence, we examine the predictive validity of several noncognitive assessments (i.e., personality and biodata) with respect to a number of subjective and objective job performance metrics. Results generally indicate that assessments administered in proctored and unproctored settings have similar validities. Limitations of this research and implications for practice are discussed.     

GENERALIZABLE BIOGRAPHICAL DATA VALIDITY CAN BE ACHIEVED WITHOUT MULTI-ORGANIZATIONAL DEVELOPMENT AND KEYING

This research showed that the validity of a biodata instrument developed and keyed within a single organization can generalize to other organizations. It also examines a criterion measure-rate of promotional progress-that has not been used extensively in biodata research, but has several characteristics that make its use attractive. The validity of the biodata component of the Manager Profile Record (MPR), developed and keyed within a single organization, as a predictor of rate of managerial progress was cross-validated on a sample of 7,334 managers and staff professionals in 24 organizations. Results indicate the MPR was a valid predictor of rate of promotional progress across all organizations and that validity did not vary greatly across organizations ( p = .53, SD_p= .05). The MPR was also a valid predictor for both sexes, as well as for managers of all age groups, lengths of company service, and education levels. These findings demonstrate that multiple-firm development and keying of a biodata instrument was not required for generalizable validity, and argue against the hypothesis of situational specificity. Suggestions for developing biodata instruments in single organizations that will generalize to other organizations include careful attention to the validity and reliability of criterion measures and developing validity at the item level.     

Construct-oriented Biodata: Capturing Change-related and Contextually Relevant Future Performance

This study highlights an approach to the development of performance and predictor constructs that has the potential to permit context and culture relevant selection. Task, contextual and adaptive measures of performance were used as criterion data in a selection study involving 325 staff in the hotel industry. Construct-oriented biodata were developed to predict adaptive and contextual performance and the validities were contrasted with measures of cognitive ability and personality. The results provided construct support for the separation of adaptive performance from task and contextual performance and for the predictive validity of change-related biodata after controlling for cognitive ability. The pattern of correlations among the personality measures, biodata scales and cognitive tests supported the construct validity of the biodata scales. Results are discussed in relation to the context in which the data were collected, and the general relevance of the procedure across countries or cultures.     

基于行为事件的履历资料评估

行为事件的履历资料评估能有效克服传统履历数据构思效度弱、情景限制多等问题。本研究结合某通信企业招聘工作,选取250名应聘者数据,结合关键事件法,通过对履历事件的行为锚定来评估应聘者的胜任特征。研究在多重比较行为履历资料、履历表数据、认知能力等多个指标组合对录用结果预测的回归模型基础上,检验新增指标的预测效度。结果表明,行为事件的履历资料评估具有效标关联效度,与其他工具组合使用时具有增量效度。     

Job context, selection decision outcome, and the perceived fairness of selection tests: biodata as an illustrative case

S. W. Gilliland (1993) has proposed a model of perceived selection system fairness to help understand applicants' prehire and posthire behavior. The present study aimed to verify and extend his framework by investigating the role of job context in the formation of fairness perceptions of biodata. A sample of 255 students (108 men, 147 women) completed an operational biodata instrument, believing that it would be used to hire persons for either international, local, or unspecified entry-level managerial positions. Participants were then presented with outcome information (selected or rejected for further consideration). Consistent support was found for the research hypotheses derived from the Gilliland model. Participants' perceptions of the fairness and job relatedness of biodata were affected by the selection context and decision outcome. The importance of considering selection context in assessments of perceived test fairness is discussed.     

Construction and Validation of a Biodata Selection Instrument

Abstract

Biodata instruments can be used in selection for several purposes (including screening, prediction, analysis of decision strategies). This article is concerned with the construction and validation of a biodata instrument for the selection of intermediaries by a profit-making employment agency in the Netherlands. The instrument was constructed according to the sample approach and measures work experiences with regard to relevant tasks and job dimensions. A field study gathered biodata scores from applicants (n £ 300) and present employees (n £ 70), interview ratings from the applicants, and ratings of job performance for the employees. The results obtained indicated that the instrument was a potentially useful selection device. The homogeneity of scale scores was sufficient and the scores show little overlap with other selection devices (interview ratings). In addition, particular scores correlate at a statistically significant level (P < 0.01) with ratings of job performance of present employees (r £ 0.30 to 0.40). Estimates of the utility (financial gains) of using the instrument in selection revealed that the instrument may yield considerable pay-offs. It is concluded that the construction and validation of the instrument yielded several positive results, and that the sample approach in constructing biodata selection instruments is an option worth considering.     

Military Enlistment Selection and Classification: Moving Forward

This article places the articles included in this special issue within the larger context of the objectives of a selection and classification system. It examines the full range of individual differences and how, until relatively recently, a focus on training success has led to an emphasis on the cognitive subset of these differences within the military. It describes how, consistent with a greater recognition of the importance of job performance, the research described in this issue has opened the door to expanded coverage of both cognitive and noncognitive attributes. It summarizes the methodological advances that have contributed to the efficacy of new noncognitive measures. It explores how popular approaches to the measurement of classification efficiency have led to unwarranted pessimism regarding the classification potential of multiattribute measures and discusses research indicating how much greater classification efficiency is possible with existing measures. Finally, it examines potentially fruitful areas of future research to better meet military objectives. These include development of an approach to performance measurement and validity transportation that makes future military classification research feasible; exploration of currently untapped individual-difference domains, particularly those that might differentially predict across job groupings; exploration of the interaction between cognitive and noncognitive attributes; and exploration of alternative measurement techniques.     

Variance in faking across noncognitive measures

There are discrepant findings in the literature regarding the effects of applicant faking on the validity of noncognitive measures. One explanation for these mixed results may be the failure of some studies to consider individual differences in faking. This study demonstrates that there is considerable variance across individuals in the extent of faking 3 types of noncognitive measures (i.e., personality test, biodata inventory, and integrity test). Participants completed measures honestly and with instructions to fake. Results indicated some measures were more difficult to fake than others. The authors found that integrity, conscientiousness, and neuroticism were related to faking. In addition, individuals faked fairly consistently across the measures. Implications of these results and a model of faking that includes factors that may influence faking behavior are provided.     

Examination of ethnic group differential responding on a biodata instrument

Biodata is a selection device that is often cited for high criterion validity and low adverse impact, yet little research examines the latter point. Further, little is known about whether differential biodata item responding by ethnic group occurs, and if so, whether this impacts ethnic group differences, predictive bias, adverse impact, and criterion validity. Data from 5,242 applicants for a government agency position indicated that elimination of biodata item response options with differential ethnic group selection rates from scoring consideration resulted in a large decrease in ethnic group differences, no predictive bias, less potential adverse impact, and a nonsignificant decrease in criterion validity. Results are compared to a general mental ability measure. Implications and future research directions are discussed.     

PERSONALITY MEASURES AND BIODATA: EVIDENCE REGARDING THEIR INCREMENTAL PREDICTIVE VALUE IN THE LIFE INSURANCE INDUSTRY

This study examines the extent to which a theoretically based set of personality measures can add incremental validity to an existing biodata instrument in terms of predicting both traditional (task) and expanded (contextual) dimensions of performance in the life insurance industry. Four of the Big Five measures of personality predicted contextual performance while just the Extraversion scale predicted task performance. This study demonstrates that personality measures can provide significant incremental prediction of contextual performance over biodata, and vice versa.     

Proactively balancing the validity and legal compliance of personal background measures in personnel management

Despite its proven utility and validity for the prediction of performance, the use of certain biodata questions for selection is being restricted because of fears of charges of discrimination, or of invasion of privacy, arising from increasingly stringent state and federal laws governing employment (Ash, 1989). The objective of this study was to develop alternative items that were valid and also perceived as nondiscriminatory and noninvasive for two biodata subscales in a well-researched biographical inventory. The newly developed subscales had acceptable KR-20 reliability coefficients. Sizeable and significant correlations between the corresponding original and newly developed subscales attested to the latter's construct validity. The performance criterion validity of the new subscales was demonstrated by significant correlations with both salary and with level of organizational functioning, which were regarded as measures of the individual's worth to the organization. The results of the present study encourage the expectation that biodata items can be constructed that are (1) valid, (2) in compliance, and (3) with a sufficiently low level of perceived invasiveness that will allow both the applicant and the test user to be comfortable with their use.     

A Biodata Inventory Administered via Interactive Voice Response (IVR) Technology: Predictive Validity, Utility, and Subgroup Differences

Although organizations are increasingly using interactive voice response (IVR) systems to help screen and select job applicants, few if any published studies have investigated the effectiveness of such systems. The current study responded to this need by evaluating a biodata inventory administered via IVR technology. A predictive validity study revealed that both a 42-item biodata measure and a more parsimonious 6-item composite correlated with supervisor ratings of performance and did not result in adverse impact or differential prediction. In addition, a utility analysis indicated that both IVR biodata measures would likely result in considerable financial gains to the hiring organization. The implications of these results for selection research and practice are discussed.     

Applying theory to the black box: A model for empirically scoring biodata

Despite being an effective predictor of job performance, empirically keyed biodata assessments have been criticized as black box empiricism unlikely to generalize to new contexts. This paper introduces a model that challenges this perspective, explicating how biodata content, job demands, and criterion variables collectively influence the construct validity, and generalizability of empirically scored biodata. Across two field studies, expected changes in scale correlations with external measures were found that coincided with changes in the contextual similarity between calibration and holdout contexts, the criteria used, and the content validity of biodata items. Collectively, this paper offers a framework that helps understand and optimize empirical biodata keying in practice, furthering confidence for their use in applied settings.     

THE EFFECTS OF REQUIRED ELABORATION OF ANSWERS TO BIODATA QUESTIONS

The impact of a request that examinees elaborate on their answers to a subset of items in a biodata instrument was evaluated. Four forms of a test in which different subsets of items are elaborated were randomly administered to 4 groups of examinees taking a pilot form of a selection instrument for a civil service position. Results indicated significantly lower scores on items for which elaborations were requested than the items for which no elaborations were requested. Lower scores were also observed for nonelaborated items when these items were embedded among those that were elaborated, and lower scores were found when the elaborated items were presented only in the first half of the test. Although the results suggest that requiring elaborated answers may reduce scores on biodata items, several practical and theoretical questions should be investigated to determine the utility of this approach as a method of reducing socially desirable responding.     

TELL ME SOME MORE: EXPLORING HOW VERBAL ABILITY AND ITEM VERIFIABILITY INFLUENCE RESPONSES TO BIODATA QUESTIONS IN A HIGH‐STAKES SELECTION CONTEXT

Although self‐rated or self‐scored selection measures are commonly used in selection contexts, they are potentially susceptible to applicant response distortion or faking. The response elaboration technique (RET), which requires job applicants to provide supporting information to justify their responses, has been identified as a potential way to minimize applicant response distortion. In a large‐scale, high‐stakes selection context (N= 16,304), we investigate the extent to which RET affects responding on a biodata test as well as the underlying reasons for any potential effect. We find that asking job applicants to elaborate their responses leads to overall lower scores on a biodata test. Item verifiability affects the extent to which RET decreases faking, which we suggest is due to increased accountability. In addition, verbal ability was more strongly related to biodata item scores when items require elaboration, although the effect of verbal ability was small. The implications of these findings for reducing faking in personnel selection are delineated.     

Faking on Personality Measures: Implications for selection involving multiple predictors

The potential for faking on noncognitive measures in high stakes testing situations remains a concern for many selection researchers and practitioners. However, the majority of previous research examining the practical effects of faking on noncognitive assessments has focused on these measures in isolation, rather than the more common situation in which they are used in combination with other predictors. The present simulation examined the effects of faking on a conscientiousness measure on criterion‐related validity, mean performance of those selected, and selection decision consistency when hiring decisions were based on this measure alone vs in combination with two other predictors across a range of likely selection scenarios. Overall, results indicated that including additional predictors substantially reduced – but did not eliminate – the negative effects of faking. Faking effects varied across outcomes and selection scenarios, with effects ranging from trivial to noteworthy even for multiple‐predictor selection. Implications for future research and practice are discussed.     

Predicting Voluntary Turnover from Job Applicant Biodata and Other Applicant Information

Research suggests that biodata (i.e., personal history information) is one of the best predictors of voluntary employee turnover. Given this fact, it is surprising that research on biodata has declined in recent years, and that biodata is not commonly used by employers for selecting employees. This article presents the results of a study that focused on the ability of biodata items and other information available on job applicants to predict voluntary turnover. With one exception, the hypotheses offered were confirmed. Specifically, applicant status (i.e., previously had applied for a job), submission of optional personal history information, employment status (i.e., job applicant was employed), and recruitment source (i.e., employee referral) all predicted voluntary turnover. The ability of applicant status, submission of a personal statement, and recruitment source to predict employee performance also was examined. Applicant status and recruitment source were found to predict subsequent performance ratings.     

Predictive validation of an insurance agent support person selection battery

This study investigated the predictive validity of a selection battery for insurance agent support persons. The selection battery included cognitive tests, personality scales, and biodata scales. Predictor data were collected as part of the agent support person selection process. Behavior summary scale ratings made by immediate supervisors of agent support persons were used as criteria in this study. Uncorrected correlations for six matched predictor composite-criterion dimension combinations identified in a previous concurrent validation study (Ashworth, Barge, Dunnette, & Carter, 1987) ranged from .17 (p<. 01) to .28 (p< .01) (M=.21, N=357).