Development and Validation of a Situational Judgment Test of Emotional Intelligence

The present study describes the development and validation of a situational judgment test (SJT) of emotional intelligence (EI). Initially, 80 situations and three response alternatives for each situation were created based on the available theoretical models. Principal component factor analysis with direct oblimin rotation of data (N = 213) yielded a three‐factor structure with 46 items. These factors were (1) utilizing own emotion, (2) sensing other's emotion, and (3) understanding emotional context. Additional studies showed that the measure had good internal consistency and test‐retest reliability. None of the three factors strongly correlated with the Big Five factors of personality (NEO Five‐Factor Inventory, thus establishing its identity as a construct distinct from personality. Findings of confirmatory factor analysis on secondary data reconfirm the three‐factor model for a 46‐item SJT of EI. The second study also found no correlation among these three factors, intelligence scores measured using Raven's Matrices, and trait EI score measured using the Trait Emotional Intelligence Questionnaire. The third study was conducted in order to determine the relationship of SJT of EI with academic achievement and life satisfaction. All three factors of SJT‐based EI measure were significantly associated with academic achievement and life satisfaction.     

Development and psychometric examination of a German video‐based situational judgment test for social competencies in medical school applicants

The present study describes the development and validation of a video‐based situational judgment test (SJT) assessing social competencies in applicants to medical school. Study 1 explored the psychometric properties of the SJT based on two applicant cohorts (N₁ = 769, N₂ = 787). Study 2 compared SJT data from applicants and 90 medical students. Tests for mean differences, correlation and factor analyses were used. In Study 1, the supposed two‐factor model for the SJT must be rejected. According to the minimum average partial test a single factor solution explaining 19–21% of the variance was suggested. The SJT showed satisfactory psychometric properties and stronger correlations to personality than to cognition as well as high acceptance. In study 2, applicants reached higher SJT scores than students.     

Validity evidence for the situational judgment test paradigm in emotional intelligence measurement

To date, various measurement approaches have been proposed to assess emotional intelligence (EI). Recently, two new EI tests have been developed based on the situational judgment test (SJT) paradigm: the Situational Test of Emotional Understanding (STEU) and the Situational Test of Emotion Management (STEM). Initial attempts have been made to examine the construct‐related validity of these new tests; we extend these findings by placing the tests in a broad nomological network. To this end, 850 undergraduate students completed a personality inventory, a cognitive ability test, a self‐report EI test, a performance‐based EI measure, the STEU, and the STEM. The SJT‐based EI tests were not strongly correlated with personality and fluid cognitive ability. Regarding their relation with existing EI measures, the tests did not capture the same construct as self‐report EI measures, but corresponded rather to performance‐based EI measures. Overall, these results lend support for the SJT paradigm for measuring EI as an ability.     

Effects of Organizationally Endorsed Coaching on Performance and Validity of Situational Judgment Tests

There is growing interest in organizationally provided or organizationally endorsed coaching. However, little is known about the effects of such coaching on test scores in operational settings. This study reports on an examination of such a program in the context of the use of a situational judgment test (SJT) for medical school admissions. We examine the effects of multiple types of coaching methods on SJT scores and on their construct‐related and predictive validities. Results suggest that (1) commercial coaching techniques may not be as effective as previously thought, whereas organizationally provided methods may be more effective, and that (2) the criterion‐related validity of the SJT scores is not degraded by the availability of coaching. Generally, this study illustrates that concerns about potential unfairness of coaching can be countered by making effective coaching available to all examinees, in the form of organizationally endorsed coaching.     

Counterproductive Work Behavior Among White‐Collar Employees: A study from Turkey

The current study was designed to evaluate the magnitude and types of counterproductive work behaviors (CWBs) among a group of white‐collar employees from different firms. A total of 766 employees voluntarily participated in our study. We focused especially on employees' perceptions of their work environment and on their affective responses to those perceptions. Data were dependent on self‐reporting and privacy, and anonymity measures were taken into account. The five different instruments used to evaluate job satisfaction were, organizational constraints, interpersonal conflict, quantitative workload and CWB. We found a high degree of job satisfaction, a minimal quantitative workload and a limited exhibition of CWBs among our sample. Organizational constraints were found to be the most strongly correlated to exhibited CWBs, followed by interpersonal conflict and quantitative workload. Job satisfaction had a diminishing effect on CWBs. Among the five dimensions of CWBs, abuse and withdrawal were found to be the most important. The most frequently reported CWB was ‘came to work late without permission.’ Except for income we found no statistically significant relationship between demographic characteristics and the exhibition of CWBs. We concluded that by abolishing pre‐existing organizational constraints there may be a reduction in CWBs.     

Association between just world beliefs and perceptions of counterproductive workplace behaviors

320 adults rated 48 counterproductive workplace behaviors (CWBs) on a 9-point scale, from petty to serious offense, and also completed the Just World Beliefs scale. Ratings of the seriousness of the CWBs indicated considerable variability in perceptions, with theft and physical violence rated most strongly. A factor analysis yielded five interpretable factors. Older participants were more likely to rate as more serious all counterproductive workplace behaviors.     

Power of the Circumplex: Incremental validity of intersection traits in predicting counterproductive work behaviors

This study examines the role of the circumplex model of personality in predicting counterproductive work behaviors (CWBs). Drawing on the fidelity‐bandwidth principle, we investigate the hypotheses that each of the three sets of circumplex traits representing the intersections of conscientiousness–agreeableness, conscientiousness–emotional stability, and agreeableness–emotional stability will account for significant incremental variance over five‐factor model (FFM) traits in predicting CWBs. Results indicated the circumplex traits contribute incremental variance over the FFM traits, are relatively more important than the FFM traits, and account for 1.5–2.0 times more variance in the total R² associated with CWBs. Collectively, these findings show that circumplex traits capture unique information not explained by FFM traits, and this information leads to a better understanding of the dispositional nature of CWBs.     

负性情绪在心理契约违背与反生产行为中的作用

为了探究反生产行为的产生机制,本研究采用问卷调查法,以“压力-情绪”模型为基础,使用相关分析以及线性回归分析等统计方法,考察了心理契约违背、负性情绪以及反生产行为之间的密切关系.结果发现,心理契约违背与负性情绪之间有显著的正相关,心理契约违背和负性情绪与反生产行为也具有显著的正相关关系,负性情绪在心理契约违背与反生产行为之间具有部分中介作用.     

Faking on a situational judgment test in a medical school selection setting: Effect of different scoring methods?

We examined the occurrence of faking on a rating situational judgment test (SJT) by comparing SJT scores and response styles of the same individuals across two naturally occurring situations. An SJT for medical school selection was administered twice to the same group of applicants (N = 317) under low‐stakes (T1) and high‐stakes (T2) circumstances. The SJT was scored using three different methods that were differentially affected by response tendencies. Applicants used significantly more extreme responding on T2 than T1. Faking (higher SJT score on T2) was only observed for scoring methods that controlled for response tendencies. Scoring methods that do not control for response tendencies introduce systematic error into the SJT score, which may lead to inaccurate conclusions about the existence of faking.     

Seeing the unseen: ostracism interventionary behaviour and its impact on employees

This article outlines the development and validation of the ostracism interventionary behaviour (OIB) scale. Based on in-depth interviews with employees, leaders, and content experts in addition to 603 survey respondents from Canada and the United States, 3 dimensions emerged to describe the ways in which leaders confront workplace ostracism-related cues and a measure was created to assess them. These refer to the ability for leaders to foster an inclusive workgroup dynamic and enact effective third-party interpersonal interventions through displays of (1) social awareness, (2) proactivity, and (3) harmony-seeking behaviour. In addition to possessing convergent and discriminant validity, the OIB scale demonstrated criterion-related validity through its relation with perceived workplace ostracism and well-being. Furthermore, evidence supported the scale’s test–retest reliability and predictive validity over and above leader–member exchange. Overall, the measure was found to be both reliable and valid, with important implications for the effective management of instances of ostracism at work.     

Video-based versus written situational judgment tests: a comparison in terms of predictive validity

In this study, the authors examined whether video-based situational judgment tests (SJTs) have higher predictive validity than written SJTs (keeping verbal content constant). The samples consisted of 1,159 students who completed a video-based version of an SJT and 1,750 students who completed the same SJT in a written format. The study was conducted in a high stakes testing context. The video-based version of an interpersonally oriented SJT had a lower correlation with cognitive ability than did the written version. It also had higher predictive and incremental validity for predicting interpersonally oriented criteria than did the written version. In this high stakes context, applicants also reacted relatively favorably to the SJTs, although there was no significant difference in face validity between the formats. These findings suggest that SJT format changes be made with caution and that validation evidence is needed when changes are proposed.     

The Relationship Between Financial History and Counterproductive Work Behavior

To reduce employee counterproductive work behaviors (CWBs), organizations may choose to utilize a financial history (FH) instrument during the selection process. To date, no published empirical research has attempted to determine the validity of such a practice. Consequently, the purpose of this study was to determine if employees with FH concerns, which were identified during the selection process and their 5‐year subsequent reinvestigation, were more likely to engage in CWBs, which were objectively measured through an examination of misconduct cases. Results from a random sample of 2519 employees indicated that those with FH concerns were significantly more likely to engage in CWBs than those without FH concerns. Implications to research and practice are discussed.     

Training teamwork in medicine: An active approach using role play and feedback

Recent reports in the field of medicine have recommended teamwork training as method of reducing human error. The current study evaluated a teamwork training protocol that used a lecture, several role plays, and guided discussion for feedback. Forty‐one medical residents participated in the training on 1 of 2 days (groups) and completed evaluation measures both prior to and immediately following the training program. Means for a situational judgment test (SJT) were higher for post‐training scores than pre‐training scores. However, mean comparisons with teamwork attitudes and learning goal orientation did not yield significant differences. An item analysis of the SJT responses indicated significant response shifts that corresponded to teamwork behaviors. Results suggested that teamwork training positively affected behavioral intentions for trauma room teamwork.     

A context-independent situational judgment test to measure prosocial implicit trait policy

Two studies developed and validated a context-independent situational judgment test (SJT) of prosocial implicit trait policy (ITP). The first study developed a SJT based on critical incidents about the prosocial behavior of physicians, lawyers, community service volunteers, and human factors engineers. In a sample of 396 undergraduates, scores obtained from this SJT were internally consistent and correlated significantly with other trait constructs related to prosocial ITP. In the second study with 134 undergraduates, the SJT was significantly correlated with relevant trait constructs and prosocial performance in role-plays simulating scenarios in which others needed help. These results show that a generic SJT developed from items that describe situations and actions specific to several occupations can predict behavior in situations unlike any that appear in its items.     

Breaking the rules,not the law: The potential risks of counterproductive work behaviors among overqualified employees

The extent to which overqualified employees may engage in counterproductive work behaviors (CWB) remains unclear. This study investigated the relationships between objectively measured overqualification (OOQ), perceived overqualification (POQ), and combinations of four lower‐order facets of CWB. The results found OOQ to be associated with POQ, which was in‐turn associated with minor‐CWB and organizational‐oriented CWB, but not with serious‐ or interpersonal‐oriented CWB. This is one of the first studies to examine CWB as a consequence of OOQ, and one of the few studies to differentially predict serious versus minor CWBs.     

The operational validity of a video-based situational judgment test for medical college admissions: illustrating the importance of matching predictor and criterion construct domains

This study is part of a trend of examining noncognitive predictors, for example, a situational judgment test (SJT), as supplements to cognitive predictors for making college admission decisions. The authors examined criterion data over multiple academic years and universities. The criterion domain was broadly conceptualized, including both cognitive and interpersonal domains. The sample consisted of 7,197 candidates of the Medical and Dental Studies Admission Exam in Belgium. Results confirmed the importance of cognitive predictors. A video-based SJT was differentially valid for predicting overall grade point average for different curricula. The SJT showed incremental validity over cognitively oriented measures for curricula that included interpersonal courses, but not for other curricula. The SJT became more valid through the years. This demonstrates the importance of carefully specifying predictor- criterion linkages and of differentiating both predictor and criterion constructs.     

Measuring Procedural Knowledge More Simply with a Single-Response Situational Judgment Test

Purpose  This paper describes the development of a situational judgment test (SJT) based on single-response options developed directly from critical incidents and reports a study that tested the SJT’s concurrent validity against ratings of job performance. Design/Methodology/Approach  Situational judgment test items were developed from critical incidents provided by administrators of volunteer agencies. Volunteers who worked at another agency completed the SJT and a self-report personality test. Supervisors rated their job performance on three dimensions. Findings  Situational judgment test scores representing procedural knowledge about work effort were significantly correlated with ratings of work effort performance (r = .28). Conscientiousness was correlated with work effort knowledge (r = .26), but not with work effort performance (r = −.02). Implications  These results provide some preliminary evidence that a single-response SJT format based upon critical incidents can produce valid measures of procedural knowledge and might be a useful alternative to the traditional multiple-response format. Originality/Value  This paper presents a novel way to construct SJTs using single-response options that are less laborious to develop than the multiple-response options in traditional SJT formats. Results of the validity study suggest that this new single-response format can predict job performance and encourage further research on the viability of this approach.     

Elaboration et validation de tests de jugement situationnel comme outil de sélection professionnelle : guide méthodologique

Current views in personnel selection recognize the necessity for situational judgements tests (SJT) which are closed to the real work context of companies. The SJTs have also become a popular selection tool across Europe. SJTs are attractive because they show good validity, positive applicants reactions and can be cost effective to test large group of applicants at once. The aim of this paper is to describe a structured methodology for the elaboration of such test. Each stage is illustrated by examples and psychometrics validation issues are discussed.