Measurement of ability emotional intelligence: Results for two new tests

Emotional intelligence (EI) has attracted considerable interest amongst both individual differences researchers and those in other areas of psychology who are interested in how EI relates to criteria such as well‐being and career success. Both trait (self‐report) and ability EI measures have been developed; the focus of this paper is on ability EI. The associations of two new ability EI tests with psychometric intelligence, emotion perception, and the Mayer–Salovey–Caruso EI test (MSCEIT) were examined. The new EI tests were the Situational Test of Emotion Management (STEM) and the Situational Test of Emotional Understanding (STEU). Only the STEU and the MSCEIT Understanding Emotions branch were significantly correlated with psychometric intelligence, suggesting that only understanding emotions can be regarded as a candidate new intelligence component. These understanding emotions tests were also positively correlated with emotion perception tests, and STEM and STEU scores were positively correlated with MSCEIT total score and most branch scores. Neither the STEM nor the STEU were significantly correlated with trait EI tests, confirming the distinctness of trait and ability EI. Taking the present results as a starting‐point, approaches to the development of new ability EI tests and models of EI are suggested.     

New paradigms for assessing emotional intelligence: theory and data

This article describes the development and validation of 2 measures of emotional intelligence (EI): the Situational Test of Emotional Understanding (STEU) and the Situational Test of Emotion Management (STEM). Study 1 (N=207 psychology students) examines multiple sources of validity evidence: relationships with EI, vocabulary, personality, and emotion-related criteria. Study 2 (N=149 white-collar volunteers) relates STEU and STEM scores to clinical symptoms, finding relationships to anxiety and stress for both tests, and to depression for the STEM. It is concluded that new performance-based approaches to test development, such as the present ones, might be useful in distinguishing between test and construct effects. Implications for expanding theory and for developing EI interventions are discussed.     

The dimensional structure of the emotional self‐efficacy scale (ESES)

This study aims to investigate the underlying dimensionality of the emotional self‐efficacy scale (ESES) and determine its relationship with measures of ability emotional intelligence (EI) (Mayer–Salovey–Caruso EI Test), trait EI (Trait EI Questionnaire), personality, and cognitive ability. Participants included 822 undergraduate students and 263 graduates already in the workplace. Analyses of the data suggested a multidimensional factor structure for the ESES. The measure was found to correlate with trait EI and showed expected correlations with personality. It did not correlate with ability EI or cognitive ability. These findings are discussed and are interpreted as offering support for the use of the ESES as a reliable measure of emotional self‐efficacy.     

The factor structures of the STEM and the STEU

The factor structures of two recently developed measures of emotional intelligence, the Situational Test of Emotional Understanding and Situational Test of Emotion Management (STEU, STEM; MacCann & Roberts, 2008) were examined. The results did not support a factor structure of either measure’s subscales indicated by the approach used in developing the test items, and examination of the factors obtained using parallel analysis to determine the number of factors to extract did not yield interpretable factors. These findings suggest that only total scale scores should be used for these tests, although the general factor extracted from the items was not strong for either test; further development work on these tests is indicated.     

Emotional Intelligence in Selection Contexts: Measurement method,criterion‐related validity,and vulnerability to response distortion

Two studies examined aspects of the validity of self‐report and performance‐based measures of emotional intelligence (EI) relevant to their use in personnel selection. In Study 1, structural equation modeling indicated that a two‐factor model with separate factors for the two types of EI measures fit better than a one‐factor solution. The performance‐based EI factor was more related to cognitive ability (R=.38) than personality (R=.26), whereas the self‐report EI factor was more related to personality (R=.85) than cognitive ability (R=.09). Although the performance‐based EI factor correlated more strongly with job performance (ρ=.24) than did that of the self‐report (ρ=.05), it provided little incremental validity beyond cognitive ability and conscientiousness. In Study 2, participants were asked to complete the measures as if applying for a job, and mean scores were then compared with those of Study 1. Results indicated that self‐report EI measures were more vulnerable to distortion than were the performance‐based measures. Implications for the assessment of EI in personnel selection contexts are discussed.     

Development and Validation of a Situational Judgment Test of Emotional Intelligence

The present study describes the development and validation of a situational judgment test (SJT) of emotional intelligence (EI). Initially, 80 situations and three response alternatives for each situation were created based on the available theoretical models. Principal component factor analysis with direct oblimin rotation of data (N = 213) yielded a three‐factor structure with 46 items. These factors were (1) utilizing own emotion, (2) sensing other's emotion, and (3) understanding emotional context. Additional studies showed that the measure had good internal consistency and test‐retest reliability. None of the three factors strongly correlated with the Big Five factors of personality (NEO Five‐Factor Inventory, thus establishing its identity as a construct distinct from personality. Findings of confirmatory factor analysis on secondary data reconfirm the three‐factor model for a 46‐item SJT of EI. The second study also found no correlation among these three factors, intelligence scores measured using Raven's Matrices, and trait EI score measured using the Trait Emotional Intelligence Questionnaire. The third study was conducted in order to determine the relationship of SJT of EI with academic achievement and life satisfaction. All three factors of SJT‐based EI measure were significantly associated with academic achievement and life satisfaction.     

Revisiting the predictive validity of emotional intelligence: self-report versus ability-based measures

In response to general press assertions that training emotionally intelligent children will lead to great rewards, this study examined the relationship between emotional intelligence (EI) and academic achievement in college students, using both self-report and ability-based measures of EI. Specifically, the Mayer, Salovey, Caruso Emotional Intelligence Test (MSCEIT, an ability-based measure) and the Bar-On Emotional Quotient Inventory (EQ-i, a self-report measure) were used to predict academic achievement. Achievement was operationalized as the respondents’ cumulative GPA. Results indicated that EI is not a strong predictor of academic achievement regardless of the type of instrument used to measure it. However, a construct validity examination revealed that the MSCEIT correlated highly with indices of cognitive ability but minimally with personality dimensions. In contrast, the EQ-i failed to correlate with indices of cognitive ability but correlated substantially with numerous personality dimensions.     

Emotional intelligence: A promise unfulfilled?

Emotional intelligence (EI) is a relatively new construct in differential psychology. Proponents of EI have made strong claims for its importance in basic and applied psychology. This article considers whether the promise of EI has been fulfilled. We examine various fundamental challenges to establishing EI as a major individual differences factor, including cross‐cultural issues. We then examine strategies for assessing EI as a personal quality distinct from general intelligence and personality, and evaluate leading tests and scales for EI. Various sources of validity evidence demonstrate the value of research on EI, but we also identify various weaknesses of existing instruments. It appears that there is no strong, over‐arching general factor of EI that shapes human emotional functioning across a range of diverse contexts. Instead, we advocate a “multipolar” conception of EI that discriminates temperament, information‐processing, emotion‐regulation and acquired skills. Focusing research on more narrowly defined but conceptually coherent research domains may be a more productive strategy than seeking to define an all‐embracing general EI.     

Personal factor effects on authentic leadership

This study explored the relationship between authentic leadership and personal factors of emotional intelligence (EI), personality, cognitive abilities and gender. The convenience sample of respondents included 341 employees, and prospective students in an advanced leadership education programme at a South African Business School. The respondents completed measures on authentic leadership, emotional intelligence, personality and cognitive ability. The data were analysed by applying regression analysis to predict self-perceived authentic leadership from EI, personality attributes, cognitive abilities and gender. Findings suggest that one EI dimension (Self-awareness) and four personality attributes, namely, Emotionally Controlled, Evaluative, Independent Minded, and Adaptable predicted authentic leadership. Authentic leadership is associated with individuals who are seen as credible and aware of how they think and behave. Therefore, such individuals have various self-reflective attributes and advanced emotional capabilities.     

FURTHER STUDIES OF SITUATIONAL TESTS

In the present paper, results are reported for two different situational judgment tests (SJT) used in validation studies with almost 4,000 employees in 7 different organizations. Across the 2 studies, it was shown that situational test scores were significantly related to performance (weighted average r = .19), cognitive ability (weighted average r = .45), and experience (weighted average r = .20). In one study, there was a slight tendency for experience and cognitive ability to interact in the prediction of situational judgment, such that cognitive ability became less predictive as experience increased. Situational judgment fully mediated the effects of cognitive ability in one study, but not in the other. Finally, SJT race effect sizes were consistent with past research and, while not trivial, smaller than those typically observed for cognitive ability tests. The studies yielded very similar results despite the use of different keying methods (empirical vs. subject matter expert opinion). The preponderance of the evidence indicates that situational judgment measures mediate avariety of job relevant skills. Limitations to these studies and directions for future research are reviewed.     

Emotional intelligence predicts components of subjective well-being beyond personality: A two-country study using self- and informant reports

This study aimed to examine the ability of overall emotional intelligence (EI) to predict cognitive and affective components of subjective well-being. University students in Germany and Turkey responded to self-report measures of EI, Big Five personality traits, life satisfaction, and positive and negative affect. Multiple informant ratings on subjective well-being measures were obtained to further support the validity of the findings. Results indicated a positive relationship between EI and affective as well as cognitive facets of well-being, with a closer association on part of the affective aspect. The incremental validity of EI was established in that EI predicted both affect balance and life satisfaction when controlling for the Big Five. Whereas participants in Germany reported better well-being than those in Turkey, personality traits and EI explained more variance in well-being measures in Germany than in Turkey. However, the relationship between EI and well-being did not appear to be culturally bound.     

An Evaluation of Construct Validity: What Is This Thing Called Emotional Intelligence?

This article presents a meta-analytic review of the Emotional Intellpigence (EI) construct. The first portion of the study examines the relation between EI measures based on two differing models of the construct (i.e., mixed and ability). This study then examines the relation of each of the models separately with cognitive ability and the Big Five personality factors. Results indicate that measures based on the mixed model of EI overlap extensively (i.e., correlate .71 among themselves; k = 12, N = 3,259), whereas mixed measures and ability measures are relatively distinct (.14; k = 13, N = 2,442). Mixed model measures of EI exhibited greater overlap with personality- than ability-based EI measures. Conversely, ability-based EI measures demonstrated a higher correlation with cognitive ability than mixed measures (.34 vs. .13). Implications and suggestions for the measurement of EI are provided.     

Speed of emotional information processing and emotional intelligence

The present study aimed to investigate the relationship between the speed of emotional information processing and emotional intelligence (EI). To evaluate individual differences in the speed of emotional information processing, a recognition memory task consisted of two subtests similar in design but differing in the emotionality of the stimuli. The first subtest required judgment about whether an emotional facial expression in the test face was identical to one of the four emotional expressions of the same individual previously presented. The second subtest required deciding whether the test face with a neutral emotional expression was identical to one of the four neutral faces of different individuals previously presented. Mean response latencies were calculated for “Yes” and “No” responses. All latencies were correlated with other measures of processing speed such as discrimination time and time of figure recognition. However, the emotional expression recognition subtest was hypothesized to require the processing of emotional information in addition to that of facial identity. Latencies in this subtest were longer than those in the face recognition subtest. To obtain a measure of the additional processing that was called for by the emotionality of the stimuli, a subtraction method and regression analysis were employed. In both cases, measures calculated for “No” responses were related to ability EI, as assessed via a self‐report questionnaire. According to structural equation modeling, there was a moderately negative association between latent EI and the latency of “No” responses in the subtest with emotional stimuli. These relationships were not observed for “Yes” responses in the same subtest or for responses in the subtest with neutral face stimuli. Although the differences between “Yes” and “No” responses in their associations with EI require further investigation, the results suggest that, in general, individuals with higher EI are also more efficient in the processing of emotional information.     

Emotional intelligence and health‐related quality of life in institutionalised Spanish older adults

This study explores the relationship between emotional intelligence (EI) and health‐related quality of life (HRQoL) in a sample of Spanish older adults who are institutionalised in long‐term care (LTC) facilities. One hundred fifteen institutionalised individuals (47.82% women; 88.3 ± 7.9 years) from southern Spain completed a set of questionnaires that included measures of EI, health and personality. Data were analysed via hierarchical regression. After controlling for personality and sociodemographic variables, the EI dimensions, emotional comprehension and emotional facilitation, accounted for part of the variance in several HRQoL facets. These dimensions could have an important role in the HRQoL of residents in LTC. Moreover, the use of a performance measure addresses the limitations of previous studies that have relied on self‐report measures. These aspects underscore the importance of the results of this study.     

The role of personality traits,core self‐evaluation,and emotional intelligence in career decision‐making difficulties

This study examines the role of personality traits, core self‐evaluation, and emotional intelligence (EI) in career decision‐making difficulties. Italian university students (N= 232) responded to questions on the Big Five Questionnaire, Core Self‐Evaluation Scale, Bar‐On Emotional Quotient Inventory, and Career Decision‐Making Difficulties Questionnaire. It was found that EI adds significant incremental variance compared with personality traits and core self‐evaluation in predicting career decision‐making difficulties. The results draw attention to the unique role of EI in career decision‐making difficulties, offering new research opportunities and intervention possibilities.     

Measuring Procedural Knowledge More Simply with a Single-Response Situational Judgment Test

Purpose  This paper describes the development of a situational judgment test (SJT) based on single-response options developed directly from critical incidents and reports a study that tested the SJT’s concurrent validity against ratings of job performance. Design/Methodology/Approach  Situational judgment test items were developed from critical incidents provided by administrators of volunteer agencies. Volunteers who worked at another agency completed the SJT and a self-report personality test. Supervisors rated their job performance on three dimensions. Findings  Situational judgment test scores representing procedural knowledge about work effort were significantly correlated with ratings of work effort performance (r = .28). Conscientiousness was correlated with work effort knowledge (r = .26), but not with work effort performance (r = −.02). Implications  These results provide some preliminary evidence that a single-response SJT format based upon critical incidents can produce valid measures of procedural knowledge and might be a useful alternative to the traditional multiple-response format. Originality/Value  This paper presents a novel way to construct SJTs using single-response options that are less laborious to develop than the multiple-response options in traditional SJT formats. Results of the validity study suggest that this new single-response format can predict job performance and encourage further research on the viability of this approach.     

Order Effects on Situational Judgment Test Items: A case of construct‐irrelevant difficulty

Situational judgment tests (SJTs) pose unique cognitive demands on test takers in that, when presented in written form, they require a great deal of reading and cognitive effort. Because of this cognitive demand, responses to test items toward the end of the test may be influenced by an order effect produced by responding to a large quantity of previous test items. This construct‐irrelevant order effect may increase measurement error and threaten the validity of SJT scores. To test this phenomenon, data were obtained from 1,089 applicants who had completed a lengthy SJT as part of a selection process for an hourly safety and surveillance job at a large international corporation. Results showed that local item dependence, item difficulty, and the rate of omitted responses all increased when items were placed toward the end. The order effect alone was not strong enough to influence subgroup mean score differences in the second half of the test. However, this effect did vary by race: African‐Americans were most strongly affected by the order effect, followed by Caucasians, in their number of omitted responses. Implications and future research of this effect for SJTs and similar types of assessments are discussed.