Frequency of Scale Elevations and Factor Structure of the Behavior Rating Inventory of Executive Function (BRIEF) in Children and Adolescents With Intractable Epilepsy

The Behavior Rating Inventory of Executive Function (BRIEF) is a standardized rating scale that provides information about the nature and extent of executive function deficits displayed by children and adolescents in daily life. BRIEF protocols completed by parents of 80 children with intractable epilepsy were evaluated with respect to prevalence and severity of scale elevations in the sample, and also with respect to factor structure. Overall, the sample was rated as having significantly more executive function problems than healthy children in the BRIEF standardization sample; elevations on the Working Memory and Plan/Organize scales were most frequently seen. Fully 36% of the sample had four or more significantly elevated scales. However, 31% of the sample had no clinically elevated scales, indicating that executive difficulties, though frequent, are not necessarily characteristic of all children with severe epilepsy. As in the validation studies reported in the manual, a two-factor solution emerged from a principal factor analysis of BRIEF scales. However, the factor structure as given in the manual was not entirely replicated; specifically, the Monitor scale was found to load equivalently on both factors. The results of this study suggest that a substantial proportion of children with intractable epilepsy display significant executive function deficits in daily life. Research into the relationship of BRIEF scores to other measures of executive functioning in children with epilepsy is needed to further clarify its clinical utility.     

Frequency of scale elevations and factor structure of the Behavior Rating Inventory of Executive Function (BRIEF) in children and adolescents with intractable epilepsy.

The Behavior Rating Inventory of Executive Function (BRIEF) is a standardized rating scale that provides information about the nature and extent of executive function deficits displayed by children and adolescents in daily life. BRIEF protocols completed by parents of 80 children with intractable epilepsy were evaluated with respect to prevalence and severity of scale elevations in the sample, and also with respect to factor structure. Overall, the sample was rated as having significantly more executive function problems than healthy children in the BRIEF standardization sample; elevations on the Working Memory and Plan/Organize scales were most frequently seen. Fully 36% of the sample had four or more significantly elevated scales. However, 31% of the sample had no clinically elevated scales, indicating that executive difficulties, though frequent, are not necessarily characteristic of all children with severe epilepsy. As in the validation studies reported in the manual, a two-factor solution emerged from a principal factor analysis of BRIEF scales. However, the factor structure as given in the manual was not entirely replicated; specifically, the Monitor scale was found to load equivalently on both factors. The results of this study suggest that a substantial proportion of children with intractable epilepsy display significant executive function deficits in daily life. Research into the relationship of BRIEF scores to other measures of executive functioning in children with epilepsy is needed to further clarify its clinical utility.     

Construct Validity of Parent Ratings of Inhibitory Control

Recent literature has emphasized the need to examine executive functions (EF) in children using multiple sources, including both parent rating and performance-based measures. Computerized Go/No-Go tests, including commercially available continuous performance tests (CPTs), represent one of the most commonly used methods of assessing inhibitory control—a variable central to the executive function construct. We examined the relationship between parent ratings of inhibitory control and CPT performance in two mixed clinical samples. Experiment 1 examined 109 children ages 6–18 using the Behavior Rating Inventory of Executive Function (BRIEF; Gioia, Isquith, Guy, & Kenworthy, 2000) and the Conners' CPT-II (Conners, 2000). In this sample, ratings on the BRIEF Inhibit scale (mean T-score?=?62.3) were significantly higher than the CPT-II commissions score (mean T-score?=?50.7; p < .0001); and the BRIEF and CPT-II scores were not highly correlated (r?=???.12). Experiment 2 examined a sample of 131 children ages 7–18 using the BRIEF and the Tests of Variables of Attention (TOVA; Greenberg, 1996). In this sample, parent ratings on the BRIEF Inhibit scale (mean T-score?=?56.8) were similar to TOVA commissions scores (mean T-score?=?58.6; p?=?.33), although still poorly correlated (r?=??.02). Factor analyses exploring covariance between BRIEF scales CPT-II variables (Experiment 1) and between BRIEF and TOVA (Experiment 2) yielded similar findings. In both experiments, all eight BRIEF scales loaded on a single factor, with no overlap with either the CPT-II or the TOVA. In mixed outpatient clinical samples, the BRIEF appears to measure different elements of inhibitory control than those assessed by computerized continuous performance tests.     

Construct validity of parent ratings of inhibitory control.

Recent literature has emphasized the need to examine executive functions (EF) in children using multiple sources, including both parent rating and performance-based measures. Computerized Go/No-Go tests, including commercially available continuous performance tests (CPTs), represent one of the most commonly used methods of assessing inhibitory control - a variable central to the executive function construct. We examined the relationship between parent ratings of inhibitory control and CPT performance in two mixed clinical samples. Experiment 1 examined 109 children ages 6-18 using the Behavior Rating Inventory of Executive Function (BRIEF; Gioia, Isquith, Guy, & Kenworthy, 2000) and the Conners' CPT-II (Conners, 2000). In this sample, ratings on the BRIEF Inhibit scale (mean T-score = 62.3) were significantly higher than the CPT-II commissions score (mean T-score = 50.7; p < .0001); and the BRIEF and CPT-II scores were not highly correlated (r = - .12). Experiment 2 examined a sample of 131 children ages 7-18 using the BRIEF and the Tests of Variables of Attention (TOVA; Greenberg, 1996). In this sample, parent ratings on the BRIEF Inhibit scale (mean T-score = 56.8) were similar to TOVA commissions scores (mean T-score = 58.6; p = .33), although still poorly correlated (r = -.02). Factor analyses exploring covariance between BRIEF scales CPT-II variables (Experiment 1) and between BRIEF and TOVA (Experiment 2) yielded similar findings. In both experiments, all eight BRIEF scales loaded on a single factor, with no overlap with either the CPT-II or the TOVA. In mixed outpatient clinical samples, the BRIEF appears to measure different elements of inhibitory control than those assessed by computerized continuous performance tests.     

Multigroup confirmatory factor analysis and structural invariance with age of the Behavior Rating Inventory of Executive Function (BRIEF)—French version

The parent and teacher forms of the French version of the Behavioral Rating Inventory of Executive Function (BRIEF) were used to evaluate executive function in everyday life in a large sample of healthy children (N = 951) aged between 5 and 18.

Several psychometric methods were applied, with a view to providing clinicians with tools for score interpretation. The parent and teacher forms of the BRIEF were acceptably reliable. Demographic variables (such as age and gender) were found to influence the BRIEF scores. Confirmatory factor analysis was then used to test five competing models of the BRIEF's latent structure. Two of these models (a three-factor model and a two-factor model, both based on a nine-scale structure) had a good fit. However, structural invariance with age was only obtained with the two-factor model.

The French version of the BRIEF provides a useful measure of everyday executive function and can be recommended for use in clinical research and practice.     

Personality for free: Psychometric properties of a public domain Australian measure of the five‐factor model

Fifty items from Goldberg's International Personality Item Pool were compiled to form a public‐domain measure of personality, the Australian Personality Inventory (API). Data from a random community sample (N = 7615) and a university‐based sample (N = 271) were used to explore psychometric properties of this 50‐item measure of the five‐factor model of personality (FFM). In both samples, internal reliabilities were adequate. In the university‐based sample an appropriate pattern of convergent and divergent relationship was found between scale scores and domain scores from the NEO Five‐Factor Inventory. After adjusting for an apparent response set (mean response across items), exploratory factor analyses clearly retrieved the FFM in both samples. It is provisionally concluded that raw scale scores from the API provide reliable estimates of the FFM, but adjustment for mean response across the 50 items might clarify the five‐factor structure, especially in less educated samples.     

Factor structure and aetiological architecture of the BRIEF: A twin study

Executive function is a broad construct that encompasses various processes involved in goal‐directed behaviour in non‐routine situations (Banich, 2009). The present study uses a sample of 560 5‐ to 16‐year‐old twin pairs (M = 11.14, SD = 2.53): 219 monozygotic twin pairs (114 female; 105 male) and 341 dizygotic twin pairs (136 female, 107 male; 98 opposite sex) to extend prior literature by providing information about the factor structure and the genetic and environmental architecture of the Behavior Rating Inventory of Executive Function (BRIEF; Gioia et al., 2000, Child Neuropsychol., 6, 235; Gioia et al., 2000, Behavior rating inventory of executive function, Lutz, FL: Psychological Assessment Resources), a multifaceted rating scale of everyday executive functions. Phenotypic results revealed a 9‐scale, 3‐factor model best represents the BRIEF structure within the current sample. Results of the genetically sensitive analyses indicated the presence of rater bias/contrast effects for the Initiate, Working Memory, and Task‐Monitor scales. Additive genetic and non‐shared environmental influences were present for the Initiate, Plan/Organize, Organization of Materials, Shift, and Monitor and Self‐Monitor scales. Influences on Emotional Control were solely environmental. Interestingly, the aetiological architecture observed was similar to that of performance‐based measures of executive function. This observed similarity provided additional evidence for the usefulness of the BRIEF as a measure of ‘everyday’ executive function.     

Long-Term Executive Function Deficits in Children With Traumatic Brain Injuries: Assessment Using the Behavior Rating Inventory of Executive Function (BRIEF)

Long-term deficits in executive functions following childhood traumatic brain injuries (TBI) were examined using the Behavior Rating Inventory of Executive Function (BRIEF). Parents completed the BRIEF approximately 5 years postinjury as part of a prospective study of children injured between the ages of 6 and 12. The children were between 10 and 19 years of age at the time of the assessment, and included 33 with severe TBI, 31 with moderate TBI, and 34 with orthopedic injuries. Parents also rated children's adaptive functioning and completed several other measures of parent and family functioning. Children were administered a neuropsychological test battery that included several measures of executive functions. The groups displayed a significant linear trend in BRIEF scores, with the largest deficits in executive functions reported in children with severe TBI. BRIEF scores were related consistently across groups to a test of working memory, but not to other neuropsychological measures. BRIEF scores also predicted children's adaptive functioning and behavioral adjustment, as well as parent psychological distress, perceived family burden, and general family functioning. The findings indicate that TBI results in long-term deficits in executive functions that are related to children's psychosocial outcomes, as well as to parent and family functioning.     

Factorial validity of the Behavior Rating Inventory of Executive Function (BRIEF)-Teacher form

Deficits in executive function (self-regulatory mechanisms) have been linked with many childhood disorders including attention deficit/hyperactivity disorder (ADHD), autism spectrum disorder, and conduct disorder. Executive functioning is typically assessed by individually administering performance-based measures in a clinical setting. However, performance-based methods are inefficient for school psychologists. A more feasibly implemented measure for applied settings is the Behavior Rating Inventory of Executive Function (BRIEF), but researchers have raised questions about the internal validity and the proposed factors. In this study, we examined the factor structure of the teacher form of the BRIEF in a sample of 2,044 general education elementary students and 131 teachers in a multilevel design. Results revealed support for a model with three factors at Level 1 and one general factor at Level 2. The results of our study do not support the current two-factor model of the published BRIEF protocol.     

Using Score Equating and Measurement Invariance to Examine the Flynn Effect in the Wechsler Adult Intelligence Scale

The Flynn effect (FE; i.e., increase in mean IQ scores over time) is commonly viewed as reflecting population shifts in intelligence, despite the fact that most FE studies have not investigated the assumption of score comparability. Consequently, the extent to which these mean differences in IQ scores reflect population shifts in cognitive abilities versus changes in the instruments used to measure these abilities is unclear. In this study, we used modern psychometric tools to examine the FE. First, we equated raw scores for each common subtest to be on the same scale across instruments. This enabled the combination of scores from all three instruments into one of 13 age groups before converting raw scores into Z scores. Second, using age-based standardized scores for standardization samples, we examined measurement invariance across the second (revised), third, and fourth editions of the Wechsler Adult Intelligence Scale. Results indicate that while scores were equivalent across the third and fourth editions, they were not equivalent across the second and third editions. Results suggest that there is some evidence for an increase in intelligence, but also call into question many published FE findings as presuming the instruments' scores are invariant when this assumption is not warranted.     

Parent rating of executive function in fetal alcohol spectrum disorder: A review of the literature and new data on Aboriginal Canadian children

Aboriginal children in Canada are at high risk of fetal alcohol spectrum disorder (FASD) but there is little research on the cognitive impact of prenatal alcohol exposure (PAE) in this population. This paper reviews the literature on parent report of executive functioning in children with FASD that used the Behavior Rating Inventory of Executive Function (BRIEF). New data on the BRIEF is then reported in a sample of 52 Aboriginal Canadian children with FASD for whom a primary caregiver completed the BRIEF. The children also completed a battery of neuropsychological tests. The results reveal mean scores in the impaired range for all three BRIEF index scores and seven of the eight scales, with the greatest difficulties found on the Working Memory, Inhibit and Shift scales. The majority of the children were reported as impaired on the index scores and scales, with Working Memory being most commonly impaired scale. On the performance-based tests, Trails B and Letter Fluency are most often reported as impaired, though the prevalence of impairment is greater for parent ratings than test performance. No gender difference is noted for the parent report, but the boys had slightly slower intellectual functioning and were more perseverative than the girls on testing. The presence of psychiatric comorbidity is unrelated to either BRIEF or test scores. These findings are generally consistent with prior studies indicating that parents observe considerable executive dysfunction in children with FASD, and that children with FASD may have more difficulty with executive functions in everyday life than is detected by laboratory-based tests alone.     

Long-term executive function deficits in children with traumatic brain injuries: assessment using the Behavior Rating Inventory of Executive Function (BRIEF).

Long-term deficits in executive functions following childhood traumatic brain injuries (TBI) were examined using the Behavior Rating Inventory of Executive Function (BRIEF). Parents completed the BRIEF approximately 5 years postinjury as part of a prospective study of children injured between the ages of 6 and 12. The children were between 10 and 19 years of age at the time of the assessment, and included 33 with severe TBI, 31 with moderate TBI, and 34 with orthopedic injuries. Parents also rated children's adaptive functioning and completed several other measures of parent and family functioning. Children were administered a neuropsychological test battery that included several measures of executive functions. The groups displayed a significant linear trend in BRIEF scores, with the largest deficits in executive functions reported in children with severe TBI. BRIEF scores were related consistently across groups to a test of working memory, but not to other neuropsychological measures. BRIEF scores also predicted children's adaptive functioning and behavioral adjustment, as well as parent psychological distress, perceived family burden, and general family functioning. The findings indicate that TBI results in long-term deficits in executive functions that are related to children's psychosocial outcomes, as well as to parent and family functioning.     

Construct and criterion validity of the Behaviour Rating Inventory of Executive Function (BRIEF) in children referred for neuropsychological assessment after paediatric traumatic brain injury

The construct and criterion validities of the parent version of the Behaviour Rating Inventory of Executive Function (BRIEF) were evaluated in a sample of 100 6- to 16-year-old children with traumatic brain injury (TBI). Maximum-likelihood factor analysis identified two latent constructs that largely replicated the factor structure reported for the standardization sample, with the notable exception that the Inhibit scale covaried primarily with the metacognition factor and not with behavioural regulation factor. Only the former factor demonstrated evidence for sensitivity to the severity of TBI. Results on both factors were affected by a premorbid history of attention-deficit/hyperactivity disorder or other out-patient psychiatric treatment. It is concluded that the BRIEF has construct and criterion validity in the evaluation of children with TBI but that findings on this instrument can only be interpreted within the context of review of the child's premorbid history.     

Measurement invariance of the Utrecht Work Engagement Scale for Students: A study across secondary school pupils and university students

School engagement is a multidimensional construct characterized by vigour, dedication, and absorption towards academic work that is related to school achievement. This study aimed to examine the measurement invariance of a school engagement measure – the Utrecht Work Engagement Scale-Students (UWES-S) – across secondary school pupils and university students. Two samples of secondary school pupils (n = 251) and university students (n = 229) were used. The results supported the original three-factor structure (vigour, dedication and absorption) of the UWES-S instead of a two- or a one-factor structure in both samples. Evidence for the metric and scalar invariance of the measure across secondary school pupils and university students was also found. The university sample had higher scores in vigour and absorption but not in dedication. These findings demonstrate that the UWES-S can be used for developmental studies where school engagement and its relation with other variables needs to be compared across distinct educational levels.     

Parental ratings of daily behavior and child cognitive test performance after pediatric mild traumatic brain injury

This study aimed to evaluate the degree to which the Behavior Rating Inventory of Executive Function (BRIEF) and Child Behavior Checklist (CBCL) measure overlapping vs. distinct constructs in pediatric patients with mild traumatic brain injury (TBI), and to examine the demographic and injury correlates of such constructs as well as those of cognitive test performance. A total of 100 parents completed the BRIEF and the CBCL within 1 to 12 months after the injury of their child. Groups were contrasted based on the presence vs. absence of impairment on, respectively, the BRIEF and the CBCL. Exploratory maximum likelihood factor analysis was used to evaluate latent constructs. Correlates of the various factor scores were evaluated through regression analysis and contrasted with those of a test of verbal learning and memory.The results revealed that the BRIEF and the CBCL disagree about the presence vs. absence of impairment in about one quarter of cases. A prior history of attention deficit/hyperactivity disorder (ADHD) was associated with an increased likelihood of impairment on both the BRIEF and the CBCL, whereas prior outpatient psychiatric treatment was associated with the increased likelihood of selective impairment on the CBCL. Latent constructs manifested themselves along cognitive regulation, emotional adjustment and behavioral regulation factors. Whereas premorbid characteristics were the exclusive correlates of these factors, performance on a test of verbal learning and memory was negatively affected by intracranial lesions on neuroimaging.It is concluded that the BRIEF and the CBCL offer complementary and non-redundant information about daily functioning after pediatric mild TBI. The correlates of cognitive test performance and parental behavior ratings after such injuries are different and reflect a divergence between premorbid and injury-related influences.     

The association between the behavior rating inventory of executive functioning and cognitive testing in children diagnosed with a brain tumor

Pediatric brain tumor survivors (PBTS) suffer from cognitive late effects, such as deteriorating executive functioning (EF). We explored the suitability of the Behavior Rating Inventory of Executive Function (BRIEF) to screen for these late effects. We assessed the relationship between the BRIEF and EF tasks, and between the BRIEF-Parent and BRIEF-Teacher, and we explored the clinical utility. Eighty-two PBTS (8–18 years) were assessed with EF tasks measuring attention, cognitive flexibility, inhibition, visual-, and working memory (WM), and with the BRIEF-Parent and BRIEF-Teacher. Pearson’s correlations between the BRIEF and EF tasks, and between the BRIEF-Parent and BRIEF-Teacher were calculated. The BRIEF-Parent related poorly to EF tasks (rs < .26, ps > .01), but of the BRIEF-Teacher the WM-scale, Monitor-scale, Behavioral-Regulation-Index, and Meta-cognition-Index, and Total-score (rs > .31, ps < .01) related significantly to some EF tasks. When controlling for age, only the WM scale and Total score related significantly to the attention task (ps < .01). The inhibit scales of the BRIEF-Parent and BRIEF-Teacher correlated significantly (r = .33, p < .01). Children with clinically elevated scores on BRIEF scales that correlated with EF tasks performed worse on all EF tasks (ds 0.56–1.23, ps < .05). The BRIEF-Teacher Total and Index scores might better screen general EF in PBTS than the BRIEF-Parent. However, the BRIEF-Teacher is also not specific enough to capture separate EFs. Solely relying on the BRIEF as a screening measure of EFs in BPTS is insufficient. Questionnaires and tasks give distinctive, valuable information.     

Executive function performance on the children's kitchen task assessment with children with sickle cell disease and matched controls

Objective: The aim of this study was to compare executive function abilities of 8- to 12-year-old children with sickle cell disease (SCD) with a matched control sample. The measures included the parent and teacher Behavior Rating Inventory of Executive Function (BRIEF); the Delis-Kaplan Executive Function System (D-KEFS), Free Sorting Test and Color Word Interference Test; and the Children's Kitchen Task Assessment (CKTA), a new performance measure. Methods: Twenty-two children with SCD were recruited from one hematology clinic and 22 community children, matched on characteristics of age, gender, and race, were selected from a larger sample of controls for comparison. Parents and teachers completed rating scales. Results:As hypothesized, children with SCD scored significantly lower than matched controls on Digit Span Forward; on 5 of the 9 D-KFES Color Word Interference and Sorting tasks; on CKTA organization, initiation, and task completion; and on the BRIEF's parent and teacher Metacognitive Index (MI) and Global Executive Composite (GEC) scores. Conclusion:Cognitive and performance evaluations indicate lower executive function among children with SCD. Results substantiate the need for evaluative triangulation for children with SCD: Neurocognitive testing supported by performance testing, and adult reflection of a child's daily performance compared to other children. These elements will provide rich data to create educational support for children with SCD who have frequent hospitalizations, school absences, and the potential presence of cerebral vascular accident symptomology.     

Psychometric properties of the Portuguese version of the Alabama Parenting Questionnaire parent form

ABSTRACT

The Alabama Parenting Questionnaire parent form (APQ-P) is one of the most commonly used measures to assess parenting practices. The current study evaluated the psychometric properties of the APQ-P using a community sample of 499 Portuguese mothers of children and adolescents aged 10 to 17 years. Confirmatory factor analysis revealed adequate psychometric properties of a three-factor model (positive parenting, ineffective parenting, and poor monitoring) in a solution of 20-items. After comparing the three-factor model across children’s age groups (≤13 vs. ≥14), partial metric and partial scalar invariance were found. Items loadings were similar between groups for ineffective parenting and poor monitoring, and factor scores were similar between groups for positive parenting. The 20-item version can be an appropriate measure of parenting, relevant for research and intervention purposes. Future studies should validate the current findings in independent samples, and devote particular attention to different parenting practices across different children’s age groups.     

Brief report: Relationship between performance testing and parent report of attention and executive functioning profiles in children following perinatal arterial ischemic stroke

Children with perinatal arterial ischemic stroke (PAIS) have increased rates of attention and executive functioning (EF) weaknesses. Research in other pediatric disorders has documented poor consistency between parent report of these skills and performance-based measures. We compared these data sources in children with PAIS. Forty full-term (≥37 weeks) children ages 3–16 (median = 7.2 years; 58% male) with PAIS completed neuropsychological testing and composite scores were created for seven attention and EF domains (Processing Speed; Attention; Working Memory; Verbal Retrieval; Inhibitory Control; Flexibility/Shifting; Planning). Parents completed “real-world” functioning questionnaires (ADHD Rating Scale-IV, BRIEF). Correlational analysis were used to compare parent and performance measures. Correlations between ADHD Rating Scale-IV scores and the performance-based Attention and Inhibition composite scores were nonsignificant. Significant negative correlations were found between the BRIEF GEC and performance-based Verbal Retrieval and Processing Speed composites, but remaining GEC/composite comparisons were nonsignificant. Analyses between parent report BRIEF index scores and the corresponding performance-based domain identified one significant negative correlation between the BRIEF Working Memory Index and the Working Memory composite score. While children with PAIS demonstrate difficulties in attention and EF on both parent report and performance measures, little significance was found in comparisons of these two types of measures. There may be several explanations for this dissociation: measures assessing different aspects of the same underlying construct; performance-based measures lacking ecological validity; and parents underestimating/underreporting their child’s deficits. Thus, multiple sources of informant and performance data are necessary to make more accurate conclusions about functioning in these domains.     

Constructing a short form of the Smoking Consequences Questionnaire with adolescents and young adults

The goal of the present studies was to construct and validate a short form of the 50-item Smoking Consequences Questionnaire (SCQ; T.H. Brandon & T. B. Baker, 1991), a measure of smoking outcome expectancies. In Study 1, a 21-item short form (S-SCQ) was derived from a sample of 107 young adults previously treated for substance abuse. In Study 2, the measure was cross-validated on 125 adolescents in treatment for substance abuse. Confirmatory factor analyses revealed good model fit and factorial invariance for the 4 S-SCQ subscales across both samples. Validation analyses on each sample found that subscale scores generally correlated significantly with smoking-related variables. The present studies provide initial evidence for the utility of the S-SCQ when used with young adults and adolescents.