Evidence of Predictive and Incremental Validity of Personality Factors,Vocal Attractiveness and the Situational Interview

This study evaluates the impact of the situational interview, personality measures, vocal attractiveness, and interactions between personality and vocal attractiveness on job performance. In a concurrent validity study with 154 customer service employees, a structured, situational interview was conducted and three of the Big Five personality factors (agreeableness, conscientiousness, and extraversion) are measured with two different frames‐of‐reference: at‐work and typical. Among the results are the validity of the situational interview and at‐work personality measures is established; vocal attractiveness correlates with both interview ratings and job performance; and finally, agreeableness and conscientiousness are found to vary in a pattern related to levels of vocal attractiveness such that both personality factors predict performance more strongly for people with more attractive voices.     

Incremental Validity of Situational Judgment Tests for Task and Contextual Job Performance

This paper has three goals. First, it responds to calls for additional research on subgroup differences in situational judgment tests. Second, it expands the cumulative knowledge on the incremental validity of situational judgment tests beyond cognitive ability and personality. Third, it examines the validity and incremental validity of various predictors for both task and contextual performance.     

Cognitive Ability Tests and the Situational Interview: A Test of Incremental Validity

This study investigated the validity and incremental validity of a situational interview beyond that of a composite measure of cognitive ability. Forty-seven factory service technicians underwent an interview and took four cognitive ability tests. Supervisors rated the performance of these subjects in a concurrent validation study. The interview was found to be a valid predictor of a supervisor rating of performance (r = 0.32, p < 0.05 uncorrected), however, was unable to show incremental validity over ability tests (Incremental R²= 0.05, n.s.). Limitations of the present study and directions for future research are discussed.     

Situational Tests in Student Selection: An Examination of Predictive Validity,Adverse Impact,and Construct Validity

The Flemish Admission Exam ‘Medical and Dental Studies’ is comprised of four cognitive ability tests and four situational tests, namely two work samples (i.e., a lecture and a medical text) and two video‐based situational judgement tests (i.e., a physician–patient interaction and a medical expert discussion). On the basis of the Admission Exam scores of 941 candidates (359 men, 582 women) this study shows that situational tests significantly can predict better than cognitive ability tests, with lecture and text emerging as significant predictors. When situational tests are combined with cognitive ability tests, there are no mean gender differences. Situational tests also enable us to measure a broader range of constructs. For example, in this study, the personality factor Openness is related to better situational test performance. Overall, this study demonstrates that situational tests may be a useful complement to traditional student selection procedures.     

情景判断测验效度的研究述评

文章在回顾近年来情景判断测验研究的基础上,总结了情景判断测验的效标关联效度、结构效度、增量效度和情景判断测验效度的影响因素.研究发现情景判断测验有较高的效标关联效度,是一种较好的人才选拔工具;情景判断测验是一种测量方法,可以用来测量指定的结构;情景判断测验对认知能力、人格、工作知识等变量具有增量效度;试题特性、测验开发模式、研究设计、评分方式等会影响情景判断测验的效度.     

面试预测效度和构想效度研究述评

面试是人才甄选中最常用的测量工具。大量研究证实,面试的预测效度比较理想,但不同类型面试的预测效度存在差异。虽然能够证实面试的预测效度较好,但对面试的测量构想却知之甚少。研究面试的构想效度,对于提高面试的递增效度有着重要的实践价值。相对人格成分而言,以往研究对面试能够测量到认知成分形成了更加一致地认识。     

The Role of Situational Interviews in Fostering Positive Reactions to Selection Decisions

We investigated the effect of interview format and employment equity program strength on perceptions of fairness. We used job seekers and vignettes to test the hypotheses. The participants reported lukewarm support for employment equity programs. The use of a situational interview in the selection process of an organisation that had adopted an employment equity program contributed to higher perceptions of fairness vis‐à‐vis the use of an unstructured interview. The results also showed that the inclusion of a situational interview in the selection process mitigated negative reactions to the selection decision when a strong employment equity program was in place as well as when a female visible minority was hired. Nous avons évalué l'impact sur la perception de justice du style d'entretien et de la rigueur d'une charte d'équité relative à l'emploi. On a fait appel à des demandeurs d'emploi et utilisé un test de jugement situationnel pour éprouver les hypothèses. Les répondants se sont montrés peu enthousiastes en ce qui concerne les chartes d'équité relatives à l'emploi. Le choix d'un entretien structuré dans le processus de sélection d'une organisation qui avait adopté une charte d'équité relative à l'emploi a amélioré la perception de justice portant sur un entretien ordinaire. Il apparaît aussi que la présence d'un entretien structuré dans le processus de sélection atténuait les réactions négatives consécutives au résultat de la sélection quand existait une sérieuse charte d'équité relative à l'emploi et quand était embauchée une minorité féminine non négligeable.     

Transparency in Structured Interviews: Consequences for Construct and Criterion-Related Validity

Although researchers agree on the use of structured interviews in personnel selection, past research has been undecided on whether these interviews need to be conducted nontransparently (i.e., without giving interviewees any indication of the evaluated criteria) or transparently (i.e., by revealing to interviewees the dimensions assessed in the interview). This article presents two independent studies examining the effects of interview transparency on interviewees' performance and on the interview's construct and criterion-related validity in the context of an application training program. Results from both Study 1 (N = 123) and Study 2 (N = 269) indicate an improvement in interviewees' performance under transparent interview conditions. Both studies further support the assumption that transparent interviews show satisfactory construct validity, whereas nontransparent interviews do not. Moreover, Study 2 showed no significant difference between the interview's criterion-related validity under transparent versus nontransparent conditions. Implications and directions for future research are discussed.     

The Incremental Validity of a Short Form of the Ideational Behavior Scale and Usefulness of Distractor,Contraindicative, and Lie Scales

This article describes an empirical refinement of the Runco Ideational Behavior Scale (RIBS). The RIBS seems to be associated with divergent thinking, and the potential for creative thinking, but it was possible that its validity could be improved. With this in mind, three new scales were developed and the unique benefit (or “incremental validity”) of each was assessed. The three validity scales contained (a) distractor items, (b) contraindicative items, or (c) items constituting a lie scale. Step‐wise analyses using the three validity scales indicated very little incremental validity: They were interpreted in the light of psychometric theory, which suggests that their contribution may have been on a behavioral rather than on a statistical level. One additional analysis explored the possibility that a short form could be constructed. The short form of the RIBS was highly correlated with the long form (r = .94). Thus, most decisions made by the short form will be entirely compatible with decisions that would have been reached using the long form. A second significant result was that the RIBS was highly correlated with a check list of creative activities, supporting its concurrent validity.     

Aural and Visual Sources of Validity in Structured Employment Interviews

This study tests effects of aural and visual cues on the validity of structured interviews. We recorded simulated job interviews with 40 managers from three utility companies on videotape. Supervisors provided performance ratings. Undergraduate research participants (N = 194) saw and heard the videotapes, heard them without the picture, or saw them without the sound and rated interviewees accordingly. Approximately 6 participants rated each interviewee in each condition of cue availability. Performance ratings and participants′ pooled ratings correlated .36 when they could hear and see the interviews, .33 when they could only hear the interviews, and .32 when they could only see the interviews. Interview ratings based on sight alone correlated .53 with interview ratings based on sound alone. One explanation is that aural cues, visual cues, and supervisory performance ratings all reflect true differences between interviewees in traits related to management effectiveness. Another is that interviewers and supervisors make the same mistakes when interpreting implications of aural cues and visual cues for management effectiveness.     

Predictive Validity of the Implicit Association Test in Studies of Brands,Consumer Attitudes,and Behavior

Three studies investigated implicit brand attitudes and their relation to explicit attitudes, product usage, and product differentiation. Implicit attitudes were measured using the Implicit Association Test (IAT; Greenwald, McGhee, & Schwartz, 1998). Study 1 showed expected differences in implicit attitudes between users of two leading yogurt brands, also revealing significant correlations between IAT‐measured implicit attitudes and explicit attitudes. In Study 2, users of two fast food restaurants (McDonald's and Milk Bar) showed implicit attitudi‐nal preference for their favorite restaurant. In Study 3, implicit attitudes of users of two soft drinks (Coca‐Cola and Pepsi) predicted brand preference, product usage, and brand recognition in a blind taste test. A meta‐analytic combination of the three studies showed that the use of IAT measures increased the prediction of behavior relative to explicit attitude measures alone.     

中层管理人员结构化面试测评效度的现场研究

通过对某上市公司随机抽取的43位中层管理人员素质测评的现场研究,探讨结构化面试的信度效度问题。研究设计基于岗位分析与关键事件分析,采用3人小组面试的方法,同时实施情景面试与行为描述面试,综合测评被试岗位胜任能力。分析结果表明,评委要素评价内部一致性和评委间内部一致性都比较高,并与面试半年后上级评定的任务绩效和总体绩效显著相关,结构化面试具有较高的信度与预测效度。进一步比较情景面试和行为描述面试发现,这两种结构化面试有类似的信度,但是行为描述面试具有更高的效度。     

The MBTI and Social Information Processing: An Incremental Validity Study

The ability of the Myers-Briggs Type Indicator (MBTI; Myers & McCaulley, 1985) to predict performance on social cognitive tasks tapping information processing effort was assessed. Judgment and intuition interacted to predict amount of attributional adjustment on a dispositional attribution task. The MBTI scales predicted processing above and beyond measures of the five factors, rational-experiential preferences, and causal uncertainty. The relevance of these results for interpretation of the MBTI indexes is discussed.     

情境判断测验的效度研究述评

情境判断测验是一种为作答者呈现工作相关的典型情境以及该情境下可能的行为反应, 要求根据指导语提示进行选择或评价的测验形式。随着其理论和实践的发展, 研究者越来越关注情境判断测验的效度研究, 包括对其构想效度、效标关联效度和递增效度的探讨, 以及指导语类型、情境保真度以及计分方式等因素对其效度的影响。基于这些研究进展, 未来情境判断测验实践领域可能的方向是：(1)开发针对特定构想的情境判断测验; (2)结合具体构想选用相应的指导语; (3)应用作假和培训对效度影响的研究结果指导实践。