A Multitrait–Multisource Confirmatory Factor Analytic Approach to the Construct Validity of ADHD and ODD Rating Scales with Malaysian Children

Confirmatory factor analysis (CFA) was used to model a multitrait by multisource matrix to determine the convergent and discriminant validity of measures of attention-deficit hyperactivity disorder (ADHD)-inattention (IN), ADHD-hyperactivity/impulsivity (HI), and oppositional defiant disorder (ODD) in 917 Malaysian elementary school children. The three trait factors were ADHD-IN, ADHD-HI, and ODD. The two source factors were parents and teachers. Similar to earlier studies with Australian and Brazilian children, the parent and teacher measures failed to show convergent and discriminant validity with Malaysian children. The study outlines the implications of such strong source effects in ADHD-IN, ADHD-HI, and ODD measures for the use of such parent and teacher scales to study the symptom dimensions.     

Construct Validity of ADHD/ODD Rating Scales: Recommendations for the Evaluation of Forthcoming DSM-V ADHD/ODD Scales

Exploratory structural equation modeling (SEM) was applied to a multiple indicator (26 individual symptom ratings) by multitrait (ADHD-IN, ADHD-HI and ODD factors) by multiple source (mothers, fathers and teachers) model to test the invariance, convergent and discriminant validity of the Child and Adolescent Disruptive Behavior Inventory with 872 Thai adolescents and the ADHD Rating Scale-IV and ODD scale of the Disruptive Behavior Inventory with 1,749 Spanish children. Most of the individual ADHD/ODD symptoms showed convergent and discriminant validity with the loadings and thresholds being invariant over mothers, fathers and teachers in both samples (the three latent factor means were higher for parents than teachers). The ADHD-IN, ADHD-HI and ODD latent factors demonstrated convergent and discriminant validity between mothers and fathers within the two samples. Convergent and discriminant validity between parents and teachers for the three factors was either absent (Thai sample) or only partial (Spanish sample). The application of exploratory SEM to a multiple indicator by multitrait by multisource model should prove useful for the evaluation of the construct validity of the forthcoming DSM-V ADHD/ODD rating scales.     

Test-Retest Measurement Invariance of Clinic Referred Children’s ADHD Symptoms

This study examined the test-retest measurement invariance of ratings of the ADHD symptoms. Mothers of a group of 217 clinic-referred children (boys?=?169, girls?=?49; age range?=?7 to 17 years) completed ratings of the ADHD symptoms presented in a modified version of the Strengths and Weaknesses of ADHD-Symptoms and Normal Behavior Scale (SWAN-M) twice, 12 months apart. Confirmatory factor analysis (CFA) of their ratings at both time points provided more support for the bifactor model of ADHD [orthogonal general and specific factors for inattention (IA) and hyperactivity/impulsivity (HI) symptoms] over the 2-factor oblique model (factors for inattention IA and HI symptoms). For the bifactor model, measurement invariance testing using multiple-group CFA indicated support for configural and full scalar test-retest invariance when the chi-square difference test was applied. For metric invariance, all but one symptom showed invariance. When the differences in approximate fit indices were applied, there was support for full measurement invariance (configural, metric and scalar). The findings indicate that observed scores (based on maternal ratings of the SWAM-M), twelve months apart, are comparable as they have the same measurement properties. Several practical, theoretical, research and clinical implications of the findings are discussed.     

Validity of the Sluggish Cognitive Tempo Symptom Dimension in Children: Sluggish Cognitive Tempo and ADHD-Inattention as Distinct Symptom Dimensions

This study examined the validity of the sluggish cognitive tempo (SCT) symptom dimension in children. Ten symptom domains were used to define SCT (i.e., (1) daydreams; (2) attention fluctuates; (3) absent-minded; (4) loses train of thought; (5) easily confused; (6) seems drowsy; (7) thinking is slow; (8) slow-moving; (9) low initiative; and (10) easily bored, needs stimulation). Teacher ratings of 366 children (ages 5 to 13 with 56 % girls) along with parent ratings of 703 children (ages 5 to 13 with 55 % girls) indicated that SCT symptom domains one to eight showed convergent validity (i.e., substantial loadings on the SCT factor) and discriminant validity with the ADHD-IN dimension (i.e., higher loadings on the SCT factor than the ADHD-IN factor). Higher scores on this eight-symptom measure of SCT predicted lower levels of academic and social competence even after controlling for ADHD-IN and ADHD-HI. In addition, higher SCT scores still predicted higher anxiety/depression scores after controlling for ADHD-IN and ADHD-HI. Higher SCT scores also predicted lower ADHD-HI scores after controlling for ADHD-IN and anxiety/depression while higher ADHD-IN and anxiety/depression scores predicted higher ADHD-HI scores after controlling for SCT and anxiety/depression or ADHD-IN. SCT also showed a unique negative relationship with ODD while ADHD-IN and anxiety/depression showed unique positive relationships with ODD. This new measure of the SCT dimension was meaningfully independent from the ADHD-IN and anxiety/depression dimensions and suggests that such an SCT dimension may signify a distinct presentation of ADHD or a different (if highly comorbid) disorder altogether.     

Internal and External Validity of Sluggish Cognitive Tempo and ADHD Inattention Dimensions with Teacher Ratings of Nepali Children

The objective was to evaluate the validity of sluggish cognitive tempo (SCT) and ADHD-inattention (IN) symptoms in children from Nepal. Teachers rated SCT, ADHD-IN, ADHD-hyperactivity/impulsivity (HI), oppositional defiant disorder (ODD), anxiety, depression, academic impairment, social impairment, and peer rejection dimensions in 366 children (50 % girls) in first through sixth grades (M _age?=?9.35, SD _age?=?1.96) on two separate occasions separated by 4-weeks. Seven of the eight SCT symptoms and all nine ADHD-IN symptoms showed convergent validity (substantial loadings on their respective factors) and discriminant validity (higher loadings on their respective factor than the alternative factor) at both time-points. Across all three separate analyses (assessment 1, assessment 2, and from assessment 1 to assessment 2), higher SCT scores were associated with lower ADHD-HI scores and higher depression, academic impairment, and social impairment scores after controlling for ADHD-IN while higher ADHD-IN scores were associated with higher ADHD-HI, ODD, academic impairment, and peer rejection scores after controlling for SCT. Also, as hypothesized, SCT scores were not related to ODD scores after controlling for ADHD-IN. The study provides the first evidence for the internal and external validity of the SCT dimension relative to the ADHD-IN dimension with teacher ratings of children from Nepal, thereby increasing the validity of the SCT construct beyond North America, Western Europe, South America, and South Korea.     

Affective Decision-Making and Externalizing Behaviors: The Role of Autonomic Activity

We tested a conceptual model involving the inter-relations among affective decision-making (indexed by a gambling task), autonomic nervous system (ANS) activity, and attention-deficit/hyperactivity disorder (ADHD) and oppositional defiant disorder (ODD) symptoms in a largely impoverished, inner city sample of first through third grade children (N=63, 54% male). The present study hypothesized that impaired affective decision-making and decreased sympathetic and parasympathetic activation would be associated with higher levels of ADHD and ODD symptoms, and that low sympathetic and parasympathetic activation during an emotion-inducing task would mediate the relation between affective decision-making and child externalizing symptoms. In support of our model, disadvantageous decision-making on a gambling task was associated with ADHD hyperactivity/impulsivity symptoms among boys, and attenuated sympathetic activation during an emotion-inducing task mediated this relation. Support for the model was not found among girls.     

Empirically based dimensions of externalizing symptoms in children and adolescents: a multitrait-multisource approach

The present study sought to refine knowledge about the structure underlying externalizing dimensions. From a “top-down” ICD/DSM-based perspective, externalizing symptoms can be categorized into attention-deficit/hyperactivity disorder (ADHD), oppositional defiant disorder (ODD), and conduct disorder (CD). From a “bottom-up” developmental theory-based perspective, disruptive behaviors can be meaningfully described as aggressive (AGG) and rule-breaking (RB) behaviors. We analyzed five large data sets comprising externalizing symptom ratings obtained with a screening instrument using different sources (parents, teachers, self-ratings) from different samples. Using confirmatory factor analyses, we evaluated several factor models (unidimensional; correlated factors; bifactor (S-1) models) derived from an ICD/DSM- and theory-based perspective. Our optimally fitting models were assessed for measurement invariance across all sources, sample settings, and sex. Following several model-based criteria (model fit indices; factor loadings; omega statistics; model parsimony), we discarded our models stepwise and concluded that both the ICD/DSM-based model with three correlated factors (ADHD, ODD, CD) and the developmental theory-based model with three correlated factors (ADHD, AGG, RB) displayed a statistically sound factor structure and allowed for straightforward interpretability. Furthermore, these two models demonstrated metric invariance across all five samples and across sample settings (community, clinical), as well as scalar invariance across sources and sex. While the dimensions AGG and RB may depict a more empirically coherent view than the categorical perspective of ODD and CD, at this point we cannot clearly determine whether one perspective really outperforms the other. Implications for model selection according to our model-based criteria and clinical research are discussed.

     

Measurement invariance across gender and ethnicity on the Emotional Quotient Inventory 2.0

This study investigated the measurement invariance of the Emotional Quotient Inventory 2.0 across gender and ethnic groups in South Africa. The sample consisted of 1 144 working adults (female = 49.8%. black = 36.2%, white = 29.8%; other = 34%; age range = 18 to 74 years). Multiple group factor analysis was conducted to test for configural, metric, and scalar invariance. Results suggest that the assessment is largely invariant at configural and metric levels across gender and ethnic groups. At scalar level, full invariance was achieved for ten of the fifteen scales across gender and one scale across ethnicity. Partial scalar models were explored for all other scales. Overall, the evidence seems to suggest that the scores from the Emotional Quotient Inventory 2.0 scales had similar meanings for different gender and ethnic groups. However, for a few scales across gender, and more so for ethnicity, it seems that participant responses might also be influenced by factors other than the underlying latent constructs. Thus, while the scales of the assessment appears to be largely invariant at the configural and metric levels, a more nuanced picture emerged at scalar level with partially invariant models, especially across ethnic groups.     

Evidence for the Trait-Impulsivity Etiological Model in a Clinical Sample: Bifactor Structure and Its Relation to Impairment and Environmental Risk

The trait-impulsivity etiological model assumes that a general factor (trait-impulsivity) underlies attention-deficit/hyperactivity disorder (ADHD), oppositional defiant disorder (ODD), and other externalizing disorders. We investigated the plausibility of this assumption by testing the factor structure of ADHD and ODD in a bifactor framework for a clinical sample of 1420 children between 6 and 18 years of age (M = 9.99, SD = 3.34; 85% male). Further, the trait-impulsivity etiological model assumes that ODD emerges only if environmental risk factors are present. Our results support the validity of the trait-impulsivity etiological model, as they confirm that ADHD and ODD share a strong general factor of disruptive behavior (DB) in this clinical sample. Furthermore, unlike the subdimensions of ADHD, we found that the specific ODD factor explained as much true score variance as the general DB factor. This suggests that a common scale of ADHD and ODD may prove to be as important as a separate ODD subscale to assess externalizing problems in school-age children. However, all other subscales of ADHD may not explain sufficient true score variance once the impact of the general DB factor has been taken into consideration. In accordance with the trait-impulsivity model, we also showed that all factors, but predominantly the general factor and specific inattention factor, predicted parent-rated impairment, and that predominantly ODD and impulsivity are predicted by environmental risk factors.     

Evidence for a Higher-Order ESEM Structure of ADHD in a Sample of Chinese Children

Exploratory structural equation modeling (ESEM) solutions have been proposed to represent the factor structures of attention-deficit/hyperactivity disorder (ADHD) in recent literature, yet no studies have assessed those structures in Chinese children. The primary aim of this study was to comprehensively examine the factor structures of the Chinese version of the ADHD Rating Scale-IV (ADHD RS-IV): Home Version. Data on 458 Chinese children aged 3–8 years (boys: 246; 54%) were used to test and compare eleven factor models: confirmatory factor analysis (CFA) models (one-factor, two-factor and three-factor), second-order CFA model, bifactor CFA models (two and three specific factors), ESEM models (two-factor and three-factor), second-order ESEM model, and bifactor ESEM models (two and three specific factors). The results showed that, overall, ESEM models displayed better fit than CFA models. Specifically, the second-order ESEM model with three first-order factors best represented of the ADHD factor structure in our sample. In addition, measurement invariance testing results showed that scalar invariance was established across gender, age and informant groups. Implications for future research are discussed.

     

Preschoolers at risk for attention-deficit hyperactivity disorder and oppositional defiant disorder: family,parenting, and behavioral correlates

This community study assigned 129 4-year-olds to groups at risk for attention deficit hyperactivity disorder (ADHD), oppositional defiant disorder (ODD), both ADHD and ODD, or no problems. Mothers of children at risk for ODD reported more family dysfunction, felt less competent as parents, suggested fewer solutions to child behavior problems, demonstrated a less assertive approach to child management, and reported more child internalizing problems than did mothers of children not elevated on ODD symptoms. Mothers of children at risk for ADHD reported higher personal depression scores than did those of the non-ADHD subgroup. Children at risk for ADHD evidenced the most difficulties in school where teachers reported more social behavior, classroom management, and internalizing problems relative to other children not at risk for ADHD. When solving child management problems, mothers of children in all groups suggested twice as many controlling/negative management strategies as positive/preventive strategies. In addition, faced with oppositional and conduct problems, mothers of children in all groups increased controlling/negative suggestions and decreased positive/preventive suggestions. Mothers of girls at risk for ADHD, ODD, and ADHD/ODD gave more rewards per positive behavior than did mothers of boys.     

The structure of childhood disruptive behaviors

Attention-deficit/hyperactivity disorder (ADHD) and oppositional defiant disorder (ODD) frequently co-occur. Comorbidity of these 2 childhood disruptive behavior domains has not been satisfactorily explained at either a structural or etiological level. The current study evaluated a bifactor model, which allows for a "g" factor in addition to distinct component factors, in relation to other models to improve understanding of the structural relationship between ADHD and ODD. Participants were 548 children (321 boys, 227 girls) between the ages of 6 years and 18 years who participated in a comprehensive diagnostic assessment incorporating parent and teacher ratings of symptoms. Of these 548 children, 153 children were diagnosed with ADHD (without ODD), 114 children were diagnosed with ADHD + ODD, 26 children were diagnosed with ODD (without ADHD), and 239 children were classified as non-ADHD/ODD comparison children (including subthreshold cases). ADHD symptoms were assessed via parent report on a diagnostic interview and via parent and teacher report on the ADHD Rating Scale. ODD symptoms were assessed via teacher report. A bifactor model of disruptive behavior, comprising a "g" factor and the specific factors of ADHD and ODD, exhibited best fit, compared to 1-factor, 2-factor, 3-factor, and 2nd-order factor models of disruptive behaviors. It is concluded that a bifactor model of childhood disruptive behaviors is superior to existing models and may help explain common patterns of comorbidity between ADHD and ODD.     

The Perceived Stress Scale: Evaluating Configural, Metric and Scalar Invariance across Mental Health Status and Gender

The Perceived Stress Scale (PSS; Cohen, Kamarck, & Mermelstein, Journal of Health and Social Behavior, 24: 385–396, 1983) and its derivatives are among the most commonly used self-report measures of subjective global stress. Several factorial models of the PSS have been proposed; however, which of these structures reliably measures individuals with mental illness remains unclear. Moreover, despite the detection of gender differences in perceived stress, factorial invariance between genders has not yet been tested with the PSS. Confirmatory factor analysis evaluating six prevailing factorial models of the PSS among a large sample of psychiatric patients and a matched community sample supported a two-factor model. Multiple group analysis established configural, metric and scalar invariance of this model across gender, but only configural invariance across samples differing by mental health status. Implications are that gender differences can be cautiously interpreted as true mean differences rather than artifacts of measurement bias; however, mean perceived stress factor scores should not be compared directly across psychiatric and non-psychiatric samples.     

Executive Functioning and Engagement in Physical and Relational Aggression among Children with ADHD

Although evidence suggests that executive functioning (EF) impairments are implicated in physically aggressive behavior (e.g., hitting) these cognitive impairments have rarely been examined with regard to relational aggression (e.g., gossip, systematic exclusion). Studies also have not examined if EF impairments underlie the expression of aggression in children with attention-deficit/hyperactivity disorder (ADHD) and if child gender moderates risk. Children with and without clinical elevations in ADHD symptoms (N = 124; ages 8–12 years; 48 % male) completed a battery of EF tests. Parent and teacher report of ADHD and oppositional defiant disorder (ODD) symptoms and teacher report of engagement in physical and relational aggression were collected. Models tested the unique association of EF abilities with physical and relational aggression and the indirect effect through the expression of ADHD or ODD behaviors; child gender was also tested as a moderator. EF impairment was uniquely associated with physical aggression, but better EF ability was associated with relational aggression. For boys, poor EF also was indirectly associated with greater physical aggression through the expression of ADHD behaviors. However, ADHD symptoms were unrelated to relational aggression. ODD symptoms also predicted physical aggression for boys but relational aggression for girls. Results suggest that there are multiple and distinct factors associated with engagement in physical and relational aggression and that better EF may actually promote relational aggression. Established models of physical aggression should not be assumed to map on to explanations of relational aggression.     

Cross‐cultural Measurement Invariance of the Employment Opportunity Index (EOI) in Mexican and Brazilian Professionals

Perceived employment alternatives have been shown to add incremental variance in understanding voluntary turnover as well as factors related to recruiting and staffing. The Employment Opportunity Index (EOI) is a multidimensional assessment of perceived employment alternatives that has exhibited predictive validity across multiple job types and populations. This study assessed the measurement invariance of the EOI in American, Mexican, and Brazilian professionals. We found support for configural and metric invariance in all five dimensions of the EOI with these populations, and support for scalar invariance three of the five EOI dimensions. The construct validity of the EOI appears to be relatively robust in Latin American populations, although cultural and macroeconomic factors may impose some response bias in these groups.     

A confirmatory factor analysis on the DSM-IV ADHD and ODD symptoms: what is the best model for the organization of these symptoms?

Confirmatory factor analysis (CFA) was used to evaluate five different models for the organization of the DSM-IV ADHD and oppositional defiant disorder (ODD) symptoms (Model 1: a single factor model; Model 2: an ADHD and ODD two factor model; Model 3a: an inattention (INA), hyperactivity/impulsivity (HYP/IMP), and ODD three factor model; Model 3b: an INA, HYP/IMP, and ODD three factor model where the three IMP symptoms cross-load on the ODD factor; Model 4: an INA, HYP, IMP, and ODD four factor model). To evaluate these models, maternal ratings of ADHD and ODD symptoms were obtained at outpatient pediatric clinics on 742 children not in treatment and 91 children in treatment for ADHD. Model 3a resulted in a good fit as well as a significantly better fit than Model 2. Model 3a was also equivalent across treatment status, gender, and age groupings for the most part. Though Models 3b and 4 provided a statistically better fit than Model 3a, the improvement in fit was small and other model selection criteria argued against these more complex models.     

Inhibition and working memory in young preschool children with symptoms of ADHD and/or oppositional-defiant disorder

Background: Early symptoms of attention deficit/hyperactivity disorder (ADHD) and oppositional-defiant disorder (ODD) are associated with deficits in cognitive self-regulatory processes or executive functions (EF)s. However, the hypothesis that neurocognitive deficits underlying the two disorders are already evident during early preschool years still has limited empirical support. The present study investigated associations between symptoms of ADHD and/or ODD and two core EFs, inhibition and working memory, in a large nonclinical sample of 3-year old children. Method: Participants were 1045 children (554 boys, age 37–47 months), recruited from the population based Norwegian Mother and Child Cohort Study (MoBa). Relations between behavioral symptoms and measures of inhibition and working memory were studied both categorically and dimensionally. Results: Children with co-occurring symptoms of ADHD and ODD performed at a significantly lower level than typically developing children in 4 out of 5 EF measures. Symptoms of ADHD, both alone and in combination with ODD, were associated with reduced performance on tests of inhibition in the group comparisons. Dimensional analyses showed that performance within both EF domains contributed to variance primarily in ADHD symptom load. The associations between test results and behavioral symptoms remained significant after gender and verbal skills had been controlled. Conclusion: Young preschoolers show the same pattern of relations between EF and behavioral symptoms of ADHD and/or ODD as previously described in older children diagnosed with ADHD and/or ODD. Effect sizes were generally small, indicating that measures of EF have limited clinical utility at this stage in development.     

Experiences of physical and relational victimization in children with ADHD: The role of social problems and aggression

The social risk factors for physical and relational peer victimization were examined within a mixed‐gender sample of children with and without attention‐deficit/hyperactivity disorder (ADHD). Participants were 124 children (ages 8–12 years; 48% boys), with 47% exhibiting sub‐clinical or clinical elevations in ADHD symptoms. ADHD and oppositional defiant disorder (ODD) symptom counts were assessed based on parent‐ and teacher‐reports; parents rated children's social problems and teachers rated children's use of physical and relational aggression and experiences of physical and relational victimization. A multiple mediator model was used to test whether there were indirect effects of ADHD or ODD symptoms on physical and relational victimization through social problems, physical aggression, or relational aggression. At the bivariate level, ADHD and ODD symptoms were both significantly associated with higher rates of physical and relational victimization. In the mediational model, there were significant indirect effects of ADHD symptoms on relational victimization via social problems, of ODD on relational victimization via relational aggression, and of ODD symptoms on physical victimization via physical aggression. Results suggest that there are distinct risk factors implicated in the physical and relational victimization of youth with ADHD and that the co‐occurrence of ODD symptoms is important to assess. Clinical implications for addressing victimization in children with ADHD are discussed.

     

A Common Genetic Factor Explains the Covariation Among ADHD ODD and CD Symptoms in 9–10 Year Old Boys and Girls

Previous studies examining the covariation among Attention Deficit Hyperactivity Disorder (ADHD), Oppositional Defiant Disorder (ODD) and Conduct Disorder (CD) have yielded inconsistent results. Some studies have concluded that the covariation among these symptoms is due to common genetic influences, whereas others have found a common environmental overlap. The present study investigated the genetic and environmental correlations among these three childhood disorders, based on a sample of 1,219 twins, age 9–10 years. A latent externalizing behavior factor was found to explain the covariance among ADHD, ODD and CD symptoms. Genetic influences explained more than half of the variance in this externalizing factor in both boys and girls. There were also unique genetic and environmental influences in each set of symptoms, suggesting some etiological independence of the three disorders. Our findings have implications for molecular genetic studies trying to identify susceptibility genes for these disorders. This study was funded by NIMH (R01 MH58354). Catherine Tuvblad was supported by post-doctoral stipends from the Swedish Council for Working Life and Social Research (Project 2006-1501) and the Sweden-America Foundation. Adrian Raine was supported by NIMH (Independent Scientist Award K02 MH01114-08). We thank the Southern California Twin Project staff for their assistance in collecting data, and the twins and their families for their participation.