Executive function in early childhood: longitudinal measurement invariance and developmental change

This study tested the longitudinal measurement invariance and developmental changes of a newly developed battery of executive function (EF) tasks for use in early childhood. The battery was administered in the Family Life Project-a prospective longitudinal study (N = 1,292) of families who were oversampled from low-income and African American families at the birth of a new child-at assessments conducted when the child was 3, 4, and 5 years old. All 6 individual EF tasks exhibited strong measurement invariance over time. The EF battery, which was derived from the 6 individual tasks, exhibited partial strong invariance over time. Second-order latent growth curve models revealed individual differences in the levels but not rates of change in latent EF ability. The functional form of change was nonlinear; 60% of the total change in EF ability that was observed between the 3- and 5-year assessments occurred between the Year 3 and Year 4 assessments. Results are discussed with respect to the importance of establishing scalable measures of EF ability prior to investigating experiences that predict or are predicted by changes in EF during early childhood.     

Investigating the links between the subcomponents of executive function and academic achievement: a cross-cultural analysis of Chinese and American preschoolers

Little is known about how components of executive function (EF) jointly and uniquely predict different aspects of academic achievement and how this may vary across cultural contexts. In the current study, 119 Chinese and 139 American preschoolers were tested on a battery of EF tasks (i.e., inhibition, working memory, and attentional control) as well as academic achievement tasks (i.e., reading and mathematics). Results demonstrate that although working memory performance in both cultures was comparable, Chinese children outperformed American children on inhibition and attentional control tasks. In addition, the relation between components of EF and achievement was similar in the two countries. Working memory uniquely predicted academic achievement, with some intriguing patterns in regard to tasks requiring complex processing. Inhibition uniquely predicted counting but did not uniquely predict calculation. Attentional control predicted most aspects of achievement uniformly and was the most robust predictor for reading in both countries. In sum, the data provide insight into both cultural variability and consistency in the development of EF during early childhood.     

Interactions between Callous Unemotional Behaviors and Executive Function in Early Childhood Predict later Aggression and Lower Peer-liking in Late-childhood

Callous unemotional (CU) behaviors are linked to aggression, behavior problems, and difficulties in peer relationships in children and adolescents. However, few studies have examined whether early childhood CU behaviors predict aggression or peer-rejection during late-childhood or potential moderation of this relationship by executive function. The current study examined whether the interaction of CU behaviors and executive function in early childhood predicted different forms of aggression in late-childhood, including proactive, reactive, and relational aggression, as well as how much children were liked by their peers. Data from cross-informant reports and multiple observational tasks were collected from a high-risk sample (N = 240; female = 118) at ages 3 and 10 years old. Parent reports of CU behaviors at age 3 predicted teacher reports of reactive, proactive, and relational aggression, as well as lower peer-liking at age 10. Moderation analysis showed that specifically at high levels of CU behaviors and low levels of observed executive function, children were reported by teachers as showing greater reactive and proactive aggression, and were less-liked by peers. Findings demonstrate that early childhood CU behaviors and executive function have unique main and interactive effects on both later aggression and lower peer-liking even when taking into account stability in behavior problems over time. By elucidating how CU behaviors and deficits in executive function potentiate each other during early childhood, we can better characterize the emergence of severe and persistent behavior and interpersonal difficulties across development.     

The measurement of executive function at age 5: psychometric properties and relationship to academic achievement

This study examined the psychometric properties and criterion validity of a newly developed battery of executive function (EF) tasks for use in early childhood. The battery was included in the Family Life Project (FLP), a prospective longitudinal study of families who were oversampled from low-income and African American families at the birth of a new child (N = 1,292). Ninety-nine percent (N = 1,036) of children who participated in the age 5 home visit completed 1 or more (M = 5.8, Mdn = 6) of the 6 EF tasks. Results indicated that tasks worked equally well for children residing in low-income and not low-income homes, that task scores were most informative about the ability level of children in the low-average range, that performance on EF tasks was best characterized by a single factor, and that individual differences on the EF battery were strongly related to a latent variable measuring overall academic achievement, as well as to individual standardized tests that measured phonological awareness, letter-word identification, and early math skills.     

Factor analytic approaches to personality item-level data

Factor analysis models have played a central role in formulating conceptual models in personality and personality assessment, as well as in empirical examinations of personality measurement instruments. Yet, the use of item-level data presents special problems for factor analysis, applications. In this article, we review recent developments in factor analysis that are appropriate for the type of item-level data often collected in personality. Included in this review are discussions of how these developments have been addressed in the context of two different (but formally related) statistical models item response theory (IRT: Hambleton, Swaminathan, & Rogers, 1991) and structural, equation modeling (Bollen 1989) for item-level data. We also discuss the relevance of item scaling in the context of these models. Using the restandardization data for the Minnesota Multiphasic Personality Inventory-2 Scale (cf. Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989), we show brief examples of the utility of these approaches to address basic questions about responses to personality scale items regarding: (a) scale, dimensionality and general item properties, (b) the "appropriateness" of the observed responses, and (c) differential item functioning across subsamples. implications for analyses of personality item-level data in the IRT and factor analytic traditions are discussed.     

Measuring executive function skills in young children in Kenya

Interest in measuring executive function skills in young children in low- and middle-income country contexts has been stymied by the lack of assessments that are both easy to deploy and scalable. This study reports on an initial effort to develop a tablet-based battery of executive function tasks, which were designed and extensively studied in the United States, for use in Kenya. Participants were 193 children, aged 3–6 years old, who attended early childhood development and education centers. The rates of individual task completion were high (65–100%), and 85% of children completed three or more tasks. Assessors indicated that 90% of all task administrations were of acceptable quality. An executive function composite score was approximately normally distributed, despite higher-than-expected floor and ceiling effects on inhibitory control tasks. Children’s simple reaction time (β = –0.20, p = .004), attention-related behaviors during testing (β = 0.24, p = .0005), and age (β = –0.24, p = .0009) were all uniquely related to performance on the executive function composite. Results are discussed as they inform efforts to develop valid and reliable measures of executive function skills among young children in developing country contexts.     

The test–retest reliability of the latent construct of executive function depends on whether tasks are represented as formative or reflective indicators

This study investigates the test–retest reliability of a battery of executive function (EF) tasks with a specific interest in testing whether the method that is used to create a battery-wide score would result in differences in the apparent test–retest reliability of children’s performance. A total of 188 4-year-olds completed a battery of computerized EF tasks twice across a period of approximately two weeks. Two different approaches were used to create a score that indexed children’s overall performance on the battery—i.e., (1) the mean score of all completed tasks and (2) a factor score estimate which used confirmatory factor analysis (CFA). Pearson and intra-class correlations were used to investigate the test–retest reliability of individual EF tasks, as well as an overall battery score. Consistent with previous studies, the test–retest reliability of individual tasks was modest (rs ≈ .60). The test–retest reliability of the overall battery scores differed depending on the scoring approach (r_mean = .72; r_{factor_score} = .99). It is concluded that the children’s performance on individual EF tasks exhibit modest levels of test–retest reliability. This underscores the importance of administering multiple tasks and aggregating performance across these tasks in order to improve precision of measurement. However, the specific strategy that is used has a large impact on the apparent test–retest reliability of the overall score. These results replicate our earlier findings and provide additional cautionary evidence against the routine use of factor analytic approaches for representing individual performance across a battery of EF tasks.     

Linking Executive Function and Peer Problems from Early Childhood Through Middle Adolescence

Peer interactions and executive function play central roles in the development of healthy children, as peer problems have been indicative of lower cognitive competencies such as self-regulatory behavior and poor executive function has been indicative of problem behaviors and social dysfunction. However, few studies have focused on the relation between peer interactions and executive function and the underlying mechanisms that may create this link. Using a national sample (n?=?1164, 48.6 % female) from the Study of Early Child Care and Youth Development (SECCYD), we analyzed executive function and peer problems (including victimization and rejection) across three waves within each domain (executive function or peer problems), beginning in early childhood and ending in middle adolescence. Executive function was measured as a multi-method, multi-informant composite including reports from parents on the Children’s Behavior Questionnaire and Child Behavior Checklist and child’s performance on behavioral tasks including the Continuous Performance Task, Woodcock-Johnson, Tower of Hanoi, Operation Span Task, Stroop, and Tower of London. Peer problems were measured as a multi-informant composite including self, teacher, and afterschool caregiver reports on multiple peer-relationship scales. Using a cross-lagged design, our Structural Equation Modeling findings suggested that experiencing peer problems contributed to lower executive function later in childhood and better executive function reduced the likelihood of experiencing peer problems later in childhood and middle adolescence, although these relations weakened as a child moves into adolescence. The results highlight that peer relationships are involved in the development of strengths and deficits in executive function and vice versa.     

Computerized games to study the development of attention in childhood

Children enjoy playing games. We can take advantage of this in the designs of computerized tasks that will engage their interest. These designs also serve to advance the study of chronometric measures, such as manual and saccadic reaction times and event related potentials, with young children. The goals of our method development are (1) to allow for comparable tasks across a wide variety of ages, (2) to make possible comparisons of child performance with data gathered in adult cognitive studies, and (3) to help to support inferences about the development of underlying mechanisms. We have designed a battery of computerized tasks in order to study the development of attention functions of alertness, orienting, and executive control during childhood. Our purpose is to describe each of these tasks in detail and present the results that have been obtained so far. The battery was tested using a sample of 5-year-old children as subjects.     

Item response theory analyses of the Delis-Kaplan Executive Function System card sorting subtest

In the current study, we examined the dimensionality of the 16-item Card Sorting subtest of the Delis-Kaplan Executive Functioning System assessment in a sample of 264 native English-speaking children between the ages of 9 and 15 years. We also tested for measurement invariance for these items across age and gender groups using item response theory (IRT). Results of the exploratory factor analysis indicated that a two-factor model that distinguished between verbal and perceptual items provided the best fit to the data. Although the items demonstrated measurement invariance across age groups, measurement invariance was violated for gender groups, with two items demonstrating differential item functioning for males and females. Multigroup analysis using all 16 items indicated that the items were more effective for individuals whose IRT scale scores were relatively high. A single-group explanatory IRT model using 14 non-differential item functioning items showed that for perceptual ability, females scored higher than males and that scores increased with age for both males and females; for verbal ability, the observed increase in scores across age differed for males and females. The implications of these findings are discussed.     

Measurement of alcohol-related consequences among high school and college students: application of item response models to the Rutgers Alcohol Problem Index

The Rutgers Alcohol Problem Index (RAPI; H. R. White & E. W. Labouvie, 1989) is a frequently used measure of alcohol-related consequences in adolescents and college students, but psychometric evaluations of the RAPI are limited and it has not been validated with college students. This study used item response theory (IRT) to examine the RAPI on students (N = 895; 65% female, 35% male) assessed in both high school and college. A series of 2-parameter IRT models were computed, examining differential item functioning across gender and time points. A reduced 18-item measure demonstrating strong clinical utility is proposed, with scores of 8 or greater implying greater need for treatment.     

Specifying Links Between Executive Functioning and Theory of Mind during Middle Childhood: Cognitive Flexibility Predicts Social Understanding

The purpose of this study was to specify the development of and links between executive functioning and theory of mind during middle childhood. One hundred four 7- to 12-year-old children completed a battery of age-appropriate tasks measuring working memory, inhibition, flexibility, theory of mind, and vocabulary. As expected, spatial working memory and flexibility increased significantly with age, especially after 7 years. Moreover, flexibility predicted social understanding over and above the effects of age, vocabulary, working memory, and inhibition. Together, these findings highlight improvements in and tight relations between complex aspects of executive functioning and theory of mind during middle childhood and suggest that executive functioning and theory of mind are linked beyond their emergence in early childhood.     

Preschool Executive Control and Internalizing Symptoms in Elementary School

Depression and anxiety are prevalent and impairing forms of psychopathology in children and adolescents. Deficits in early executive control (EC) may contribute to the development of these problems, but longitudinal studies with rigorous measurement across key developmental periods are limited. The current study examines EC in preschool as a predictor of subsequent depression and anxiety symptoms in elementary school in a community sample (N?=?280). Child participants completed a battery of nine developmentally-appropriate tasks designed to measure major aspects of EC at age 5 years, 3 months. Children later participated in an elementary school follow-up phase, during which they completed validated norm-referenced self-report questionnaires of depression and anxiety symptoms in fourth grade. Results indicate that poorer preschool EC was significantly associated with both greater depression and anxiety symptoms in elementary school, controlling for baseline depression and anxiety symptoms in preschool and other relevant variables. These findings suggest that poor EC may be an important risk factor for the development of internalizing psychopathology in childhood. Given emerging evidence for the modifiability of EC, particularly in preschool, EC promotion interventions may hold promise as a potential target in psychopathology prevention.     

Language and executive function in self-reported impulsive aggression

The present study employed a battery of verbal tests that included a broad range of executive demands to demonstrate the differential contributions of language and executive function to the performance decrement observed in individuals who display impulsive aggressive (IA) outbursts. A profile analysis revealed that despite not differing on tasks requiring limited verbal output, the IAs deviated further from nonaggressive controls as the tasks required increasing spontaneous organization. Results suggest that language ability per se is not impaired in IAs; rather inefficient executive functioning is responsible for their significantly poorer performance on complex verbal tasks.     

Relations between key executive functions and aggression in childhood

The present study examined relationships between three key executive functions (working memory, inhibition, and mental set-shifting) and multiple types of aggression in a general population sample of 9-year-old children. One hundred and forty-eight children completed a battery of executive function tasks and were rated on aggression by their primary teachers. All executive function (EF) composites were related to a composite measure of aggression. Working memory (WM) was most consistently related to the different types of aggression (overt, relational, reactive, and proactive), whereas inhibition and mental set-shifting only were related to relational and reactive aggression, respectively. Specificity in relations (studied as independent contributions) was generally low with the exception of the relation between WM and relational aggression. Taken together, our results highlight the roles of WM and relational aggression in EF-aggression relations in middle childhood.     

Prosocial behavior is related to later executive function during early childhood: A longitudinal study

ABSTRACT

Previous research has shown that executive function is correlated with prosocial behavior during early childhood. Whether early prosocial behaviors were associated with later executive function during preschool years or vice versa was thus examined in a longitudinal design. The prosocial behaviors and executive function of children (N = 64) aged 42 to 65 months were evaluated twice (Times 1 and 2), based on teachers’ reports and children’s performance on hot and cool executive function tasks. Results revealed that prosocial behaviors at Time 1 were associated with later hot executive function at Time 2, but executive function at Time 1 was not related to prosocial behaviors at Time 2. These findings suggest that prosocial behaviors may enhance children’s hot executive function.     

Specifying Ability Growth Models Using a Multidimensional Item Response Model for Repeated Measures Categorical Ordinal Item Response Data

When categorical ordinal item response data are collected over multiple timepoints from a repeated measures design, an item response theory (IRT) modeling approach whose unit of analysis is an item response is suitable. This study proposes a few longitudinal IRT models and illustrates how a popular compensatory multidimensional IRT model can be utilized to formulate such longitudinal IRT models, which permits an investigation of ability growth at both individual and population levels. The equivalence of an existing multidimensional IRT model and those longitudinal IRT models is also elaborated so that one can make use of an existing multidimensional IRT model to implement the longitudinal IRT models.     

An Introduction to Item Response Theory Using the Need for Cognition Scale

This paper provides an introduction to two commonly used item response theory (IRT) models (the two-parameter logistic model and the graded response model). Throughout the paper, the Need for Cognition Scale (NCS) is used to help illustrate different features of the IRT model. After introducing the IRT models, I explore the assumptions these models make as well as ways to assess the extent to which those assumptions are plausible. Next, I describe how adopting an IRT approach to measurement can change how one thinks about scoring, score precision, and scale construction. I briefly introduce the advanced topics of differential item functioning and computerized adaptive testing before concluding with a summary of what was learned about IRT generally, and the NCS specifically.     

Executive functions after age 5: Changes and correlates

Research and theorizing on executive function (EF) in childhood has been disproportionately focused on preschool age children. This review paper outlines the importance of examining EF throughout childhood, and even across the lifespan. First, examining EF in older children can address the question of whether EF is a unitary construct. The relations among the EF components, particularly as they are recruited for complex tasks, appear to change over the course of development. Second, much of the development of EF, especially working memory, shifting, and planning, occurs after age 5. Third, important applications of EF research concern the role of school-age children’s EF in various aspects of school performance, as well as social functioning and emotional control. Future research needs to examine a more complete developmental span, from early childhood through late adulthood, in order to address developmental issues adequately.