Emotional intelligence: A meta-analytic investigation of predictive validity and nomological net

This study used meta-analytic techniques to examine the relationship between emotional intelligence (EI) and performance outcomes. A total of 69 independent studies were located that reported correlations between EI and performance or other variables such as general mental ability (GMA) and the Big Five factors of personality. Results indicated that, across criteria, EI had an operational validity of .23 (k=59, N=9522). Various moderating influences such as the EI measure used, dimensions of EI, scoring method and criterion were evaluated. EI correlated .22 with general mental ability (k=19, N=4158) and .23 (Agreeableness and Openness to Experience; k=14, N=3306) to .34 (Extraversion; k=19, N=3718) with the Big Five factors of personality. Results of various subgroup analyses are presented and implications and future directions are provided.     

Revisiting the predictive validity of emotional intelligence: self-report versus ability-based measures

In response to general press assertions that training emotionally intelligent children will lead to great rewards, this study examined the relationship between emotional intelligence (EI) and academic achievement in college students, using both self-report and ability-based measures of EI. Specifically, the Mayer, Salovey, Caruso Emotional Intelligence Test (MSCEIT, an ability-based measure) and the Bar-On Emotional Quotient Inventory (EQ-i, a self-report measure) were used to predict academic achievement. Achievement was operationalized as the respondents’ cumulative GPA. Results indicated that EI is not a strong predictor of academic achievement regardless of the type of instrument used to measure it. However, a construct validity examination revealed that the MSCEIT correlated highly with indices of cognitive ability but minimally with personality dimensions. In contrast, the EQ-i failed to correlate with indices of cognitive ability but correlated substantially with numerous personality dimensions.     

Factor structure, measurement invariance and structural invariance of the MSCEIT V2.0

This study explored factor structure and measurement and structural invariance of the MSCEIT V2.0 across two age groups: 258 young (18-31 years) and 262 older adults (32-79 years). Results supported a three-factor solution reflecting the Experiential Emotional Intelligence area, and Understanding Emotions and Managing Emotions branches. There was evidence of measurement invariance of factor structure and factor loadings, and partial support for invariance of the intercepts. Comparisons of latent factor means suggested that older adults have significantly higher mean scores on two of the three factors: Understanding and Managing Emotions. Implications of the invariance tests and latent means analyses are discussed.     

Convergent, discriminant, and incremental validity of competing measures of emotional intelligence

This study investigated the convergent, discriminant, and incremental validity of one ability test of emotional intelligence (EI)--the Mayer-Salovey-Caruso-Emotional Intelligence Test (MSCEIT)--and two self-report measures of EI--the Emotional Quotient Inventory (EQ-i) and the self-report EI test (SREIT). The MSCEIT showed minimal relations to the EQ-i and SREIT, whereas the latter two measures were moderately interrelated. Among EI measures, the MSCEIT was discriminable from well-studied personality and well-being measures, whereas the EQ-i and SREIT shared considerable variance with these measures. After personality and verbal intelligence were held constant, the MSCEIT was predictive of social deviance, the EQ-i was predictive of alcohol use, and the SREIT was inversely related to academic achievement. In general, results showed that ability EI and self-report EI are weakly related and yield different measurements of the same person.     

An examination of the predictive criterion-related validity of professional certification tests

This study examines the predictive criterion-related validity of a series of professional certification tests for water and wastewater management operators. Certification test data were obtained on 164 operators holding one of three jobs in water or wastewater management facilities. The certification test scores were broken down into four component scores and a total score. Criterion data consisted of performance evaluations obtained from the operator's supervisor, a self-rating from the operator, or both. Test scores were correlated with the job performance evaluations. The results indicated that scores on the certification tests were not related to rated job performance by job type, job level, source of performance evaluation, or component of job performance. The findings are discussed in the context of establishing an appropriate criterion against which to validate certification tests, and the practical problems of doing so in an applied setting.     

Process assessment: An examination of reinforcer effectiveness and predictive validity

This research describes an assessment procedure based on measures of actual learning. First-grade children (N = 120) learned five sight vocabulary words under feedback only, and were then assigned to one of five conditions where they learned five additional words either under feedback, praise, candy, praise and candy, or reproof. In a sixth condition (reciprocal to the first treatment), students learned the first five works under praise and the second five under feedback only. Although results indicated no differences in learning rate under different reinforcement conditions, learning measures under feedback accounted for approximately 39% of the variance in achievement (r = .62), with combined reinforcement learning measures slightly improving prediction (r = .68). The order of treatments had no effect on learning rate. Implications for this process approach to assessment are discussed. Directions for future research are suggested.     

Further validation of the IDAS: evidence of convergent, discriminant, criterion, and incremental validity

The authors explicated the validity of the Inventory of Depression and Anxiety Symptoms (IDAS; D. Watson et al., 2007) in 2 samples (306 college students and 605 psychiatric patients). The IDAS scales showed strong convergent validity in relation to parallel interview-based scores on the Clinician Rating version of the IDAS; the mean convergent correlations were .51 and .62 in the student and patient samples, respectively. With the exception of the Well-Being Scale, the scales also consistently demonstrated significant discriminant validity. Furthermore, the scales displayed substantial criterion validity in relation to Diagnostic and Statistical Manual of Mental Disorders (4th ed.; DSM-IV; American Psychiatric Association, 1994) mood and anxiety disorder diagnoses in the patient sample. The authors identified particularly clear and strong associations between (a) major depression and the IDAS General Depression, Dysphoria and Well-Being scales, (b) panic disorder and IDAS Panic, (c) posttraumatic stress disorder and IDAS Traumatic Intrusions, and (d) social phobia and IDAS Social Anxiety. Finally, in logistic regression analyses, the IDAS scales showed significant incremental validity in predicting several DSM-IV diagnoses when compared against the Beck Depression Inventory-II (A. T. Beck, R. A. Steer, & G. K. Brown, 1996) and the Beck Anxiety Inventory (A. T. Beck & R. A. Steer, 1990).     

Concurrent and incremental validity of three trait emotional intelligence measures

This study explored concurrent and incremental validity of three trait emotional intelligence measures: the Schutte Emotional Intelligence Scale, Multidimensional Emotional Intelligence Assessment, and Trait Emotional Intelligence Questionnaire. A total of 307 participants were drawn predominantly from community and student populations. Concurrent criterion validity of the measures varied depending on whether emotional intelligence (EI) was assessed as a lower, middle or higher level construct, with validity coefficients being larger for the former. In all cases, the Trait Emotional Intelligence Questionnaire was the superior predictor of multiple psychological criteria. At the higher level of assessment, incremental validity beyond (a) age, gender and the Big Five, and (b) the remaining two EI measures, was also superior.     

Further examination of the convergent and discriminant validity of the student–teacher relationship scale

Two studies extended psychometric research on the Student–Teacher Relationship Scale (STRS) with kindergarten and preschool children (N₁ = 60–71; N₂ = 35) and their teachers. These studies used a multi‐method approach to replicate and extend previous findings concerning the convergent validity of the STRS Closeness, Conflict, and Dependency scale and to further examine the discriminant validity of the STRS. Study 1 investigated convergence between the STRS scales and child‐ and peer‐reports of the same constructs based on a multi‐trait multi‐method approach. Study 2 examined the pattern of associations between the STRS and indicators of teacher–child relationship quality rated by external observers. Support was found for the convergent validity and to a lesser extent the discriminant validity of the STRS Closeness and Conflict scale. For the STRS Dependency scale, additional research remains necessary. Copyright © 2009 John Wiley & Sons, Ltd.     

The Error-Oriented Motivation Scale: An examination of structural and convergent validity

The current paper describes an analysis of the factor structure and convergent validity of the Error-Oriented Motivation Scale (EOMS). The EOMS is an attempt to validate a context-general and brief measure of error orientations theoretically similar to the Error Orientation Questionnaire (EOQ) written by (Rybowiak, Garst, Frese, and Batinic (1999)). Motivation theory, particularly approach/avoidance motives and goal theory, was chosen as a foundational model for the new EOMS measure, arguing that errors take on properties of goals when they occur by creating a discrepancy, which generates arousal and direction toward a solution. In this article, the factor structure of the EOMS is examined, as well as expected correlations with subscales of the EOQ. The discussion focuses on the advantages of the EOMS measure and suggestions for its further validation and use in applied settings.     

Convergent,discriminant, and predictive validity of aggressive driving inventories: they drive as they live

The authors hypothesized that aggressive driving is indicative of a more general trait that leads individuals to behave aggressively in different situations. This hypothesis was tested by having 85 male and 237 female undergraduates complete the Aggression Questionnaire, three measures of aggressive driving (the Driver Anger Scale, Driver Vengeance Questionnaire, and Driving Behavior Inventory), and questions about violating traffic laws. High correlations among the aggressive driving inventories provided evidence for the convergent validity, but a confirmatory factor analyses raised questions about the discriminant validity of aggressive driving inventories. The inventories did not attain significance in hierarchical analyses of traffic violations that controlled for gender, driving experience, and measures of trait aggression. It is concluded that there is little unique about aggressive driving and that individuals drive as they live. Aggr. Behav. 32:89–98, 2006. © 2006 Wiley‐Liss, Inc.     

Assessing the predictive validity of cultural intelligence over time

The study examines four core components of cultural intelligence (CQ) - Behavioral, Motivational, Cognitive and Meta-cognitive - as predictors of cross-cultural adaptation problems in a longitudinal study of international students in New Zealand and tests the hypothesis that Motivational CQ predicts better psychological and sociocultural outcomes over time. One hundred and four students completed measures of CQ during a pre-term orientation program and assessments of adaptation problems approximately three months later. In line with the hypothesis, bi-variate correlations indicated that Motivational CQ was related to fewer psychological symptoms (r = −.30, p < .01) and sociocultural adaptation problems (r = −.27, p < .01). However, hierarchical regression analysis, controlling for age, gender, length of residence abroad and region of origin, revealed that while Motivational CQ was a significant (negative) predictor (ß = −.36, p < .01) of psychological symptoms, the overall amount of variance explained (14.6%) in the model was not significant. In contrast, region of origin (ß = .37, p < .01) was the only significant predictor of sociocultural adaptation problems with international students from Western countries reporting fewer difficulties than those from other regions. The results are discussed in relation to contemporary theories of motivation along with recommendations for future research.     

An examination of the factor structure and convergent and discriminant validity of the SCL-90R in an outpatient clinic population

This study investigated the factor structure of the SCL-90R using an outpatient psychology clinic population. Six relatively homogeneous and stable factors were identified: Depression, Somatization, Anger-Hostility, Paranoid-Psychoticism, Phobic Anxiety, and Obsessive-Compulsive. However, a principal component analysis revealed that the first factor accounted for a large percentage of the variance, suggesting that this instrument measures a general dimension of psychopathology. In addition, significant correlations between the SCL-90R symptom dimensions and both the BDI and several MMPI scales were found. The results of the study lead to questions regarding the utility of the SCL-90R.     

Intelligence and maturity: meta-analytic evidence for the incremental and discriminant validity of Loevinger's measure of ego development

This review examined whether Loevinger's measure of personality (ego) development is equivalent to the measurement of intelligence. The authors conducted a meta-analysis of 52 correlations between ego level scores and intelligence test scores (retrieved from 42 studies involving 5,648 participants). The weighted average correlation between ego level and intelligence ranged from.20 to.34, depending on the intellectual ability assessed (e.g., verbal intelligence). Adjusting for measurement unreliability increased these values only minimally. The authors also reviewed 16 studies that examined the association between ego level and various criterion variables (e.g., aggressive behavior) after statistically controlling for the effects of intelligence. Ninety-four percent of the tests revealed significant relations between ego level and criterion variables after controlling for intelligence, indicating that ego development and intelligence are not interchangeable constructs. These findings do not support recent speculations concerning the limited value of stage models of maturity, social development, and moral reasoning.     

The Trait Emotional Intelligence Questionnaire in Lebanon and the UK: A comparison of the psychometric properties in each country

The aim of this study was to validate the Trait Emotional Intelligence Questionnaire (TEIQue v. 1.5) in a Lebanese sample and compare its factorial structure to that of a UK sample. There were similar gender and age distributions in both samples as well as satisfactory structural reliabilities at the global, factor, and facet levels. Results from exploratory factor analysis showed a four-factor structure similar to that originally obtained by the author of the questionnaire. There were strong correlations between the factor scores derived from the two datasets (≥.90). Tucker congruence supported the similarity between the Lebanese and UK factors. Independent-samples t tests showed that Lebanese participants scored higher on the Sociability factor and the facets of self-esteem, social awareness and emotion perception, whereas UK participants scored higher on the facets of stress management, optimism and relationships. Gender differences are also reported, and recommendations for future research discussed.     

An investigation of the relationship between trait emotional intelligence and emotional task performance

This study examined the relationships between trait emotional intelligence (EI) and tasks involving the recognition of facial expressions of emotion. Two facial expression recognition tasks using the inspection time (IT) paradigm assessed speed of emotional information processing. An unspeeded emotion recognition task was also included, and a symbol IT task was used to assess speed of processing of non-emotional information. It was found that scores on all three emotion-related tasks were strongly intercorrelated, as were scores on the three IT tasks. The two emotional IT scores remained significantly correlated when symbol IT performance was partialled out. This finding, together with the associations between the speeded (IT) and unspeeded face tasks suggests that the association between the emotional IT tasks is not entirely accounted for by general processing speed, and that a general emotion-processing ability also contributes to performance on these tasks. An EI subscale assessing Appraisal of Emotions was significantly correlated with performance on the emotional IT tasks, suggesting that self-reports of emotional perception ability do relate to performance measures.     

Measurement invariance across gender and ethnicity on the Emotional Quotient Inventory 2.0

This study investigated the measurement invariance of the Emotional Quotient Inventory 2.0 across gender and ethnic groups in South Africa. The sample consisted of 1 144 working adults (female = 49.8%. black = 36.2%, white = 29.8%; other = 34%; age range = 18 to 74 years). Multiple group factor analysis was conducted to test for configural, metric, and scalar invariance. Results suggest that the assessment is largely invariant at configural and metric levels across gender and ethnic groups. At scalar level, full invariance was achieved for ten of the fifteen scales across gender and one scale across ethnicity. Partial scalar models were explored for all other scales. Overall, the evidence seems to suggest that the scores from the Emotional Quotient Inventory 2.0 scales had similar meanings for different gender and ethnic groups. However, for a few scales across gender, and more so for ethnicity, it seems that participant responses might also be influenced by factors other than the underlying latent constructs. Thus, while the scales of the assessment appears to be largely invariant at the configural and metric levels, a more nuanced picture emerged at scalar level with partially invariant models, especially across ethnic groups.     

One-year temporal stability and predictive and incremental validity of the Body,Eating, and Exercise Comparison Orientation Measure (BEECOM) among college women

This study examined the one-year temporal stability and the predictive and incremental validity of the Body, Eating, and Exercise Comparison Measure (BEECOM) in a sample of 237 college women who completed study measures at two time points about one year apart. One-year temporal stability was high for the BEECOM total and subscale (i.e., Body, Eating, and Exercise Comparison Orientation) scores. Additionally, the BEECOM exhibited predictive validity in that it accounted for variance in body dissatisfaction and eating disorder symptomatology one year later. These findings held even after controlling for body mass index and existing measures of social comparison orientation. However, results regarding the incremental validity of the BEECOM, or its ability to predict change in these constructs over time, were more mixed. Overall, this study demonstrated additional psychometric properties of the BEECOM among college women, further establishing the usefulness of this measure for more comprehensively assessing eating disorder-related social comparison.     

Examination of the structural, convergent, and incremental validity of the Reynolds Intellectual Assessment Scales (RIAS) with a clinical sample

Empirical examination of the Reynolds Intellectual Assessment Scales (RIAS; C. R. Reynolds & R. W. Kamphaus, 2003a) has produced mixed results regarding its internal structure and convergent validity. Various aspects of validity of RIAS scores with a sample (N = 521) of adolescents and adults seeking psychological evaluations at a university-based clinic were examined. Results from exploratory factor analysis indicated only 1 factor, and confirmatory factor analysis (CFA) indicated that the 1-factor model was a good fit and a better fit than the 2-factor model. Hierarchical factor analysis indicated the higher order, general intelligence factor accounted for the largest amount of variance. Correlations with other measures of verbal/crystallized and nonverbal/fluid intelligence were supportive of the convergent validity of the Verbal Intelligence Index but not the Nonverbal Intelligence Index. Joint CFA with these additional measures resulted in a superior fit of the 2-factor model compared with the 1-factor model, although the Odd-Item-Out subtest was found to be a poor measure of nonverbal/fluid intelligence. Incremental validity analyses indicated that the Composite Intelligence Index explained a medium to large portion of academic achievement variance; the NIX and VIX explained a small amount of remaining variance. Implications regarding interpretation of the RIAS when assessing similar individuals are discussed.     

Sense of humor, emotional intelligence, and social competence

Associations among sense of humor, emotional intelligence (EI), and social competence were examined in 111 undergraduate students using measures of humor styles, trait cheerfulness, social competence, and an ability test of EI. Emotional management ability was positively correlated with self-enhancing humor and trait cheerfulness, and negatively correlated with trait bad mood. Ability to accurately perceive emotions was negatively related to aggressive and self-defeating humor. Positive humor styles and trait cheerfulness were positively correlated with various domains of social competence, whereas negative humor styles and trait bad mood were negatively correlated with social competence. Finally, the emotional management facet of EI was positively correlated with several social competence domains.