Validity and Application of Computer-simulated Scenarios in Personnel Assessment

In Germany computer-simulated scenarios have been applied in personnel management for several years. Their goals are either to assess how potential managers cope with complex and connected problem states (job aptitude testing aspect) or to provide feedback on manager strengths and weaknesses in dealing with complexity, and how to modify these when necessary (training aspect). This paper presents and evaluates those scenarios that have been subjected to validity studies.     

Book Reviews

Schabracq, Marc J., Winnibst, Jacques A.M. and Cooper, Cary L., Handbook of Work and Health Psychology Bandura, Albert, Self-efficacy: the exercise of control Wiggins, Jerry S. The Five-Factor Model of Personality. Theoretical Perspectives Arredondo, Patricia, Successful diversity management initiatives: a blueprint for planning and implementation     

A Biodata Inventory Administered via Interactive Voice Response (IVR) Technology: Predictive Validity, Utility, and Subgroup Differences

Although organizations are increasingly using interactive voice response (IVR) systems to help screen and select job applicants, few if any published studies have investigated the effectiveness of such systems. The current study responded to this need by evaluating a biodata inventory administered via IVR technology. A predictive validity study revealed that both a 42-item biodata measure and a more parsimonious 6-item composite correlated with supervisor ratings of performance and did not result in adverse impact or differential prediction. In addition, a utility analysis indicated that both IVR biodata measures would likely result in considerable financial gains to the hiring organization. The implications of these results for selection research and practice are discussed.     

履历数据测评的效度分析

履历数据是人员测评的重要手段, 但其组织情景性限制使得国外同类工具不能适用于国内人事选拔, 国内也缺乏实证研究验证其信度、效度。本研究结合某通信企业的招募选拔工作, 开发履历数据分析工具, 选取250名应聘者的履历数据、一般认知能力、大五个性和面试结果数据, 通过效标关联效度、增量效度思想, 分析履历数据有效性。结果表明, 以面试结果为效标, 履历数据具有良好的效标关联效度, 与其他测评工具组合使用时有良好的增量效度。     

Multitasking as a Predictor of Pilot Performance: Validity Beyond Serial Single-Task Assessments

Although multitasking has been identified as an important competency for many jobs, standardized preemployment tests of multitasking are uncommon, and their validity beyond separate single-task assessments is unclear. To address this gap, this study compared the validity of a preemployment multitasking assessment (with math, memorization, and monitoring tasks presented concurrently) to an assessment in which the same constituent tasks were assessed separately. Among military pilot applicants, concurrent multitasking predicted both flying and academic performance, whereas serial single-task scores and their combination predicted only academic performance. Larger multitasking decrements (i.e., operationalized as the difference between single-task and multiple-task performance of the same constituent tasks) were associated with poorer flying performance. Results suggest the potential utility of multitasking assessments in selection for military jobs requiring competing, concurrent task demands.     

Inmate Subculture in a Nigerian Prison

This study of a prisoners' subculture in a Nigerian prison dealt with the prisoners' interactions among themselves and their adaptations to the subculture. It did not deal, except in passing, with the official or formal prison organization, which is unusually different from prisons in the United States and Great Britain. The focus was on the principal values and practices of the subculture and the vulnerability to them of different groups of prisoners. Striking similarities were found between the subculture and the world outside the prison. The prisoners' world, however, parodies the outside world rather than being a reflection of it.     

Incremental Validity of Cognitions in a Clinical Case Formulation: An Intraindividual Test in a Case Example

Incremental validity, the ability of a measure to predict or explain variance over and above other measures, is an important psychometric characteristic of standardized measures, but has received little attention idiographically. Idiographic assessment may be an important part of developing a clinical case formulation, guiding treatment by developing an individualized understanding of the variables that trigger and maintain distress. This study examined whether the idiosyncratic cognitive schema hypothesized by a clinician in a cognitive case formulation explained distress incrementally over that of situational triggers. Using daily ratings of situational triggers, idiosyncratic cognitions, and distress, the incremental validity of cognitions in predicting each of six distress measures was tested in a case example using dynamic time series regression. The incremental variance explained by cognitions varied across the distress measures, suggesting that, in this case example, targeting thoughts and beliefs for treatment may be important for only certain types of distress.

Longitudinal Predictive Validity of a Learning Potential Test

The aim of this article is to provide empirical psychometric evidence of the (longitudinal) predictive validity of a learning potential measure—the Learning Potential Computerised Adaptive Test (LPCAT)—in comparison with standard static tests with school aggregate results as the criterion measure. Participants were 79 boys (mean age 12.44, SD = 0.44) and 72 girls (mean age 11.18, SD = 0.42) attending two private schools. Correlation and regression analyses were used to evaluate the predictive validity of the learning potential and standard test scores for school aggregate academic results as criterion measure. Results indicate that learning potential scores were statistically significant predictors of aggregate academic results and provided results that were comparable to those of the standard test results—providing empirical support for the use of learning potential tests in mainstream educational settings.     

Validation of a Standardized Multiple‐Choice Multicultural Competence Test: Implications for Training,Assessment, and Practice

The Multicultural Counseling and Psychotherapy Test (MCPT), a measure of multicultural counseling competence (MCC), was validated in 2 phases. In Phase 1, the authors administered 451 test items derived from multicultural guidelines in counseling and psychology to 32 multicultural experts and 30 nonexperts. In Phase 2, the authors administered the top 50 discriminative items to licensed mental health professionals (N = 227) and compared MCPT scores to external indicators of MCC. Evidence was found for the construct validity and internal consistency reliability of the MCPT. El Test de Consejería Multicultural y Psicoterapia (MCPT, por sus siglas en inglés), una medida de la competencia en consejería multicultural (MCC, por sus siglas en inglés) fue validado en dos fases. En la Fase 1, los autores administraron 451 elementos del test derivados de las pautas multiculturales en consejería y psicología a 32 expertos multiculturales y 30 no expertos. En la Fase 2, los autores administraron los 50 elementos más discriminativos a profesionales licenciados de la salud mental (N = 227) y compararon los puntajes del MCPT con indicadores externos de MCC. Se hallaron evidencias de la validez del constructo y la fiabilidad de la consistencia interna del MCPT.     

西方诚信度测验研究述评

诚信度测验是指在招聘和选拔过程中用于评价应聘者的诚实、诚信、可依靠性,从而预测他们的偷盗、违反纪律、反工作行为以及今后工作业绩的以纸笔测验为主的测验工具。文章对西方诚信度测验的发展和应用现状做出了综述,指出诚信度测验具有较好的信度和效度。大五人格模型中的责任感、宜人性和情绪稳定性是诚信度测验潜在的测量内容,但诚信度测验与大五人格模型以外的其它人格维度也存在较高的相关性。诚信度测验对反工作行为和整体工作绩效具有良好的预测效度。文章在总结诚信度测验存在的一些争议和问题的基础上,提出了它在中国企业员工招聘和选拔中应用的若干建议     

Validity of Social Behavior Assessment in discriminating emotionally disabled from nonhandicapped students

Discriminant analyses and stepwise multiple regression techniques were applied to teacher ratings of 184 kindergarten through eighth-grade students using Stephen's Social Behavior Assessment (SBA) inventory and were used to predict group membership as emotionalyy disabled (ED) or non-ED. The results suggested that the SBA was highly effective in correctly discriminating ED from non-ED students. The linear discriminant function derived from the 30 SBA subcategories correctly classified 83% of the subjects, yielding a highly significant separation of groups of ED and non-ED children. While the results of the discriminant analyses have not yet been cross-validated, these findings support the discriminant validity of the SBA for ED versus non-ED classification and suggest that the SBA is potentially a useful instrument for school psychologists as one source of information in a multifactored assessment regarding the identification of children as ED.     

Validity of Two Questionnaires to Assess Social Fears: The Dutch Social Phobia and Anxiety Inventory and the Blushing, Trembling and Sweating Questionnaire

This report evaluates some psychometric properties of the Dutch Social Phobia and Anxiety Inventory (SPAI-N) as well as a newly developed instrument to assess fear of showing somatic symptoms among social phobic, the Blushing, Trembling and Sweating Questionnaire (BTS-Q). Results support the reliability and discriminative validity of the Dutch SPAI and the BTS-Q. Both questionnaires are able to discriminate social phobics from a community sample. Social phobics with fear of blushing, trembling, and sweating as the main complaint could be discriminated from social phobics without fear of blushing, trembling, and sweating as the main complaint using the BTS-Q. In contrast with expectations derived from cognitive models of social phobia, social phobics with fear of blushing, trembling, and sweating did not have stronger dysfunctional beliefs about (the social consequences of) blushing, trembling, and sweating than social phobics without such fears.     

Optimization of Social Structure in Business Networks by Grid-Technique and Polyhedral Analysis

This article deals with the definition and analysis of the social, communicative, and cognitive abilities of managers acting in network contexts. We can tackle the complex relationship of role demands and role adoption by applying grid-technique and polyhedral analysis. We can gather data on context-specific personal constructs with the help of the grid technique. Using these data, polyhedral analysis shows how defined persons are integrated into the relation structures within a network. Beyond this, we show if and how relevant criteria such as holes, connectivity, and eccentricity can be employed for analyzing problems stemming from personnel management. Based upon the applied methods, it is possible to provide information about the relevant structures within networks used in personnel selection and competency development. Decision makers have the task to select among the measures of personnel management. Within the relevant context, these measures should be suited to ensure the stability and efficiency of the network.     

Social Validity Assessment of Mindfulness Education and Practices Among High School Students

The authors describe social validity assessment of mindfulness education and practices among high school students (N = 84) participating in a 10-week instructional program. The participants rated their satisfaction with and acceptance of several program components, content areas, and outcomes, as well as their engagement in specific mindfulness practices. Nearly all of the participants rated the program favorably, reported many beneficial effects, and anticipated future use of mindfulness in their lives. They did not routinely perform voluntary formal guided meditations beyond the classroom but did engage in informal mindfulness practices preceding certain activities (e.g., preparing for a test, athletic competition, performance event) and going to sleep at night. The authors discuss these findings and the implications for designing school-based mindfulness education programs.     

The Social Phobia and Anxiety Inventory: Reliability and Validity in an Adolescent Spanish Population

The objective of this study is to examine the factor structure and psychometric properties of the SPAI in a sample of adolescent Spaniards. The results obtained support the use of the correlated two-factor SPAI subscales and indicate high coefficient alpha values for the SPAI subscales. The results provide support for the use of the SPAI in an adolescent population in a non-English-speaking country. Both exploratory and confirmatory factor analyses of the Social Phobia subscale showed a four-factor structure, instead of a five-factor dimension, as suggested by previous studies. Effects for gender and age and gender interaction were found. Limitations and suggestions for future research are discussed.     

A review of applicant faking in selection interviews

Interviews are commonly used for selection but research on interview faking only gained momentum relatively recently. We review both theoretical and empirical work on prevalence, antecedents, processes, and effects of interview faking. Most applicants fake at least to some degree. Personality (e.g., Conscientiousness, Honesty‐humility, the Dark Triad) and attitudes toward faking substantially correlate with faking behaviors. Research concerning applicants' ability, interview structure components, or contextual factors is limited. Furthermore, the impact of faking on interview ratings is mixed and effects on criterion‐related validity are not consistently negative. Finally, the detection of faking seems hardly possible and there are limited options available to reduce interview faking. Throughout our review, we describe important gaps and derive suggestions and propositions for future research.     

Temperament and Gender: Correlates of Toddler Social Competence

The relation between temperament, gender, and social competence was examined in a sample of 202 children ranging from 12 to 36 months of age. Gender and specific characteristics of temperament corresponded more with toddler social competence than did a more general style of temperament. Females were rated by mothers and group caregivers as more socially competent than males on all four measures used in the study and significantly more so on three of these measures. Characteristics of temperament most closely associated with toddler social competence were approach/withdrawal, adaptability to change, and general quality of mood.     

Assessment of Panic Frequency: Reliability and Validity of a Time-Line Follow-Back Method

The purpose of this study was to investigate the reliability and validity of a Panic Attack Frequency Calendar (PAFC), modeled after a time-line follow-back (TLFB) procedure (e.g., Sobell & Sobell, 1979). The latter has been used for years to reliably and validly assess daily alcohol use through self-report over extended periods of time. Seventy-four adult individuals (ages 18–57) who had experienced a panic attack within the past 2 weeks completed a battery of self-report questionnaires, including retrospective frequency measures, and were administered an 8-week PAFC initially and a 10-week PAFC 2 weeks later. Half the participants self-monitored their panic attacks in a diary. The PAFC showed high stability over 2 weeks across several panic behavior variables. The PAFC was also shown to be a valid instrument in assessing panic frequency when compared with panic data obtained from the diary and the retrospective frequency measure.     

Psychological hardiness predicts successful selection in a law enforcement special operations assessment and selection course

We studied the predictive effects of psychological hardiness on successful selection in a United States federal tactical law enforcement assessment and selection (A&S) program. Seventy‐one male experienced law enforcement personnel participated in a week‐long, physically and psychologically rigorous A&S course. Dispositional Resilience Scale (DRS‐15) Total Hardiness scores predicted selection in this select sample. Age and cognitive ability moderated the predictive effects of psychological hardiness such that hardiness predicted selection in younger candidates and candidates with higher cognitive ability. Similar findings were obtained for DRS Commitment. DRS‐15 Control facet also differentiated selection in this sample but the predictive effects did not hold when age and cognitive ability were controlled. Findings extend the application of the DRS‐15 to law enforcement personnel selection and highlight the importance of examining moderating effects of psychological hardiness.