AULA virtual reality test as an attention measure: Convergent validity with Conners’ Continuous Performance Test

The majority of neuropsychological tests used to evaluate attention processes in children lack ecological validity. The AULA Nesplora (AULA) is a continuous performance test, developed in a virtual setting, very similar to a school classroom. The aim of the present study is to analyze the convergent validity between the AULA and the Continuous Performance Test (CPT) of Conners. The AULA and CPT were administered correlatively to 57 children, aged 6–16 years (26.3% female) with average cognitive ability (IQ mean = 100.56, SD = 10.38) who had a diagnosis of attention deficit/hyperactivity disorder (ADHD) according to DSM-IV-TR criteria. Spearman correlations analyses were conducted among the different variables. Significant correlations were observed between both tests in all the analyzed variables (omissions, commissions, reaction time, and variability of reaction time), including for those measures of the AULA based on different sensorial modalities, presentation of distractors, and task paradigms. Hence, convergent validity between both tests was confirmed. Moreover, the AULA showed differences by gender and correlation to Perceptual Reasoning and Working Memory indexes of the WISC-IV, supporting the relevance of IQ measures in the understanding of cognitive performance in ADHD. In addition, the AULA (but not Conners’ CPT) was able to differentiate between ADHD children with and without pharmacological treatment for a wide range of measures related to inattention, impulsivity, processing speed, motor activity, and quality of attention focus. Additional measures and advantages of the AULA versus Conners’ CPT are discussed.     

Attentional Performance in Children and Adolescents with Tic Disorder and Co-Occurring Attention-Deficit/Hyperactivity Disorder: New Insights from a 2 × 2 Factorial Design Study

The aim of the present study was to investigate the effect of both tic disorder (TD) and attention-deficit/hyperactivity disorder (ADHD) on attentional functions. N = 96 children and adolescents participated in the study, including n = 21 subjects with TD, n = 23 subjects with ADHD, n = 25 subjects with TD+ADHD, and n = 27 controls. Attentional performance was tested based on four computerized attention tasks (sustained attention, divided attention, go/nogo and set shifting). The effect of TD as well as ADHD on attentional performance was tested using a 2 × 2 factorial approach. A diagnosis of TD had no negative impact on attentional functions but was associated with improved performance in the set shifting task. By contrast, regardless of a diagnosis of TD, subjects with ADHD were found to perform worse in the sustained attention, divided attention and go/nogo task. No interaction effect between the factors TD and ADHD was revealed for any of the attention measures. Our results add to findings from other areas of research, showing that in subjects with TD and ADHD, ADHD psychopathology is often the main source of impairment, whereas a diagnosis of TD has little or no impact on neuropsychological performance in most cases and even seems to be associated with adaptive mechanisms.     

A controlled clinical comparison of attention performance in children with ADHD in a virtual reality classroom compared to standard neuropsychological methods.

In this initial pilot study, a controlled clinical comparison was made of attention perforance in children with attention deficit-hyperactivity disorder (ADHD) in a virtual reality (VR) classroom. Ten boys diagnosed with ADHD and ten normal control boys participated in the study. Groups did not significantly differ in mean age, grade level, ethnicity, or handedness. No participants reported simulator sickness following VR exposure. Children with ADHD exhibited more omission errors, commission errors, and overall body movement than normal control children in the VR classroom. Children with ADHD were more impacted by distraction in the VR classroom. VR classroom measures were correlated with traditional ADHD assessment tools and the flatscreen CPT. Of note, the small sample size incorporated in each group and higher WISC-III scores of normal controls might have some bearing on the overall interpretation of results. These data suggested that the Virtual Classroom had good potential for controlled performance assessment within an ecologically valid environment and appeared to parse out significant effects due to the presence of distraction stimuli.     

Utility of a CPT in Diagnosing ADHD among a Representative Sample of High-Risk Children: A Cautionary Study

Continuous performance tests (CPTs) are widely used in the assessment and study of attention deficit hyperactivity disorder (ADHD). Although CPTs have reliably found differences between children with ADHD and normal controls, discriminating between children with ADHD and children with subclinical levels of behavioral or cognitive problems is a more clinically relevant and difficult endeavor. Additionally, most studies use convenience samples from clinical care settings that may not represent the ADHD population as a whole. The current study assessed the utility of a clinically used CPT, the Test of Variables of Attention (TOVA), in distinguishing between children with ADHD and children with subclinical levels of attention/behavior problems. Participants constituted a representative sample of elementary school students at high risk for ADHD, including 116 children with ADHD and 51 subclinical controls. Results found no significant differences between the ADHD and subclinical group on CPT variables, and CPT performance did not reliably predict group membership. Implications of the findings are discussed.     

Utility of a CPT in diagnosing ADHD among a representative sample of high-risk children: a cautionary study.

Continuous performance tests (CPTs) are widely used in the assessment and study of attention deficit hyperactivity disorder (ADHD). Although CPTs have reliably found differences between children with ADHD and normal controls, discriminating between children with ADHD and children with subclinical levels of behavioral or cognitive problems is a more clinically relevant and difficult endeavor. Additionally, most studies use convenience samples from clinical care settings that may not represent the ADHD population as a whole. The current study assessed the utility of a clinically used CPT, the Test of Variables of Attention (TOVA), in distinguishing between children with ADHD and children with subclinical levels of attention/behavior problems. Participants constituted a representative sample of elementary school students at high risk for ADHD, including 116 children with ADHD and 51 subclinical controls. Results found no significant differences between the ADHD and subclinical group on CPT variables, and CPT performance did not reliably predict group membership. Implications of the findings are discussed.     

Relations Between Continuous Performance Test Performance Measures and ADHD Behaviors

The Conners' Continuous Performance Test (CPT) is a neuropsychological task that has repeatedly been shown to differentiate ADHD from normal groups. Several variables may be derived from the Conners' CPT including errors of omission and commission, mean hit reaction time(RT), mean hit RT standard error, d', and . What each CPT parameter actually assesses has largely been based upon clinical assumptions and the face validity of each measure (e.g., omission errors measure inattention, commission errors measure impulsivity). This study attempts to examine relations between various CPT variables and phenotypic behaviors so as to better understand the various CPT variables. An epidemiological sample of 817 children was administered the Conners' CPT. Diagnostic interviews were conducted with parents to determine ADHD symptom profiles for all children. Children diagnosed with ADHD had more variable RTs, made more errors of commission and omission, and demonstrated poorer perceptual sensitivity than nondiagnosed children. Regarding specific symptoms, generalized estimating equations (GEE) and ANCOVAs were conducted to determine specific relationships between the 18 DSM-IV ADHD symptoms and 6 CPT parameters. CPT performance measures demonstrated significant relationships to ADHD symptoms but did not demonstrate symptom domain specificity according to a priori assumptions. Overall performance on the two signal detection measures, d' and , was highly related to all ADHD symptoms across symptom domains. Further, increased variability in RTs over time was related to most ADHD symptoms. Finally, it appears that at least 1 CPT variable, mean hit RT, is minimally related to ADHD symptoms as a whole, but does demonstrate some specificity in its link with symptoms of hyperactivity.     

Comparison between two continuous performance tests for identifying ADHD: Traditional vs. virtual realityEjecución continua para la detección del TDAH: pruebas tradicionales frente a la realidad virtual

Background/Objective: Continuous Performance Tests (CPTs) have demonstrated validity when differentiating children with ADHD from healthy controls. However, these CPTs have limitations such as low ecological validity. New CPTs based on the use of Virtual Reality (VR) have appeared as supposedly improved methods for assessing ADHD. This study aims to compare the discriminant value of attentional variables produced by a VR CPT (Aula Nesplora) with that of variables from a traditional CPT (Test of Variables of Attention; TOVA) for identifying ADHD. Method: A total of 338 children aged between 6 and 16 years old (M = 10.84, SD = 3.01) participated in the study: 31.95% correspond to the inattentive presentation, 15.38% to the impulsive-hyperactive presentation, 22.78% to the combined presentation, and the remaining 29.88% correspond to children without ADHD. Results: Results indicated that Aula Nesplora predicts ADHD presentations better than TOVA. It also differentiates better between ADHD and non-ADHD students. Conclusions: These findings show the potential advantages of using virtual reality in ADHD assessment, as it facilitates the diagnosis of ADHD and the differentiation of its presentations in a realistic environment.     

Does the Conners' Continuous Performance Test Aid in ADHD Diagnosis?

The performance of clinic-referred children aged 6–11 (N = 100) was examined using the Conners' Continuous Performance Test (CPT) and measures of auditory attention (Auditory Continuous Performance Test; ACPT), phonological awareness, visual processing speed, and visual-motor competence. The Conners' CPT overall index was unrelated to measures of visual processing speed or visual-motor competence. Although the Conners' CPT converged with the ACPT, the latter demonstrated age and order effects. Significant variance in Conners' CPT parameters was predicted by phonological awareness measures, suggesting that Reading Disordered (RD) children could be false positives on the Conners' CPT. The Conners' CPT overall index, phonological awareness, and visual-motor measures were submitted to a 2×2 MANCOVA (ADHD vs. RD, covarying for age and socieoeconomic status): a main effect for RD status was found. Children with ADHD did not have higher Conners' CPT scores than did clinical controls; however, children with Reading Disorders did. Phonological measures distinguished RD children from ADHD children and other clinical controls. ADHD children who failed the Conners' CPT were rated by teachers as more hyperactive. Despite the strengths of the Conners' CPT, its utility for differential diagnosis of ADHD is questioned.     

A trial-by-trial analysis reveals more intense physical activity is associated with better cognitive control performance in attention-deficit/hyperactivity disorder

Hyperactivity is a key symptom and the most observable manifestation of attention-deficit/hyperactivity disorder (ADHD). The over-activity associated with ADHD can cause specific challenges in academic settings, extracurricular activities and social relationships. Cognitive control challenges are also well established in ADHD. The current study included 44 children between the ages of 10 and 17 diagnosed with ADHD or who were typically developing (TD), all of whom had no psychiatric co-morbidity or significant learning disorders. Participants wore an actometer on their ankle while performing a flanker paradigm in order to objectively measure their rates of activity in association with cognitive control. Analyses assessed the relationship between frequency and intensity of activity to task accuracy on a trial-by-trial basis. A significant interaction effect between group and performance revealed that more intense movement was associated with better performance in the ADHD group but not in the TD group. The ADHD group demonstrated more intense activity than the TD group during correct (but not error) trials. Within-group, children with ADHD generated higher intensity movements in their correct trials compared to their error trials, whereas the TD group did not demonstrate any within-group differences. These findings suggest that excessive motoric activity associated with clinically significant ADHD symptoms may reflect compensatory efforts to modulate attention and alertness. Future research should systematically explore the relationship between motion in ADHD and how it might be used to improve cognitive performance.     

Virtual reality technology in neuropsychological testing: A systematic review

Neuropsychological testing aims to measure individuals' cognitive abilities (e.g. memory, attention), analysing their performance on specific behavioural tasks. Most neuropsychological tests are administered in the so-called ‘paper-and-pencil’ modality or via computerised protocols. The adequacy of these procedures has been recently questioned, with more specific concerns about their ecological validity, i.e. the relation between test scores observed in the laboratory setting and the actual everyday cognitive functioning. In developing more ecological tasks, researchers started to implement virtual reality (VR) technology as an administration technique focused on exposing individuals to simulated but realistic stimuli and environments, maintaining at the same time a controlled laboratory setting and collecting advanced measures of cognitive functioning. This systematic review aims to present how VR procedures for neuropsychological testing have been implemented in the last years. We initially explain the rationale for supporting VR as an advanced assessment tool, but we also discuss the challenges and risks that can limit the widespread implementation of this technology. Then, we systematised the large body of studies adopting VR for neuropsychological testing, describing the VR tools' distribution amongst different cognitive functions through a PRISMA-guided systematic review. The systematic review highlighted that only very few instruments are ready for clinical use, reporting psychometric proprieties (e.g. validity) and providing normative data. Most of the tools still need to be standardised on large cohorts of participants, having published only limited data on small samples up to now. Finally, we discussed the possible future directions of the VR neuropsychological test development linked to technological advances.     

The adrenergic receptor α-2A gene (ADRA2A) and neuropsychological executive functions as putative endophenotypes for childhood ADHD

There is resurgent interest in the psychiatric literature in endophenotypes, variables thought to more strongly reflect the effects of candidate genes than do manifest disorders. In a sample of 176 children with attention deficit hyperactivity disorder (ADHD) and 52 of their siblings, we examined the validity of several putative endophenotypes for ADHD that represent commonly used clinical measures of multiple cognitive/neuropsychological domains of executive functions (EFs). We review their distributional normality, their relations to ADHD symptoms in probands and unaffected siblings relative to nonADHD controls, and their correlation in siblings. We also tested the EF measures’ associations with the ADRA2A gene and whether they mediated or moderated the associations between ADHD and ADRA2A. Several EF measures showed association with ADRA2A, as well as moderation, but not mediation, of its association with ADHD. Implications of the results for evaluating the validity and utility of putative endophenotype measures and for finding candidate gene effects on ADHD are discussed.     

An investigation of intra-individual variability in children with fetal alcohol spectrum disorder (FASD)

Intra-individual variability (IIV) is defined as systematic within-person variation in performance either across test sessions (e.g., test/retest performance on the same task) or in one session (e.g., variations in performance on multiple trials of a single task). Higher levels of IIV have been noted as a characteristic of neurodevelopmental disorders such as attention deficit/hyperactivity disorder? (ADHD), but IIV is yet to be investigated in fetal alcohol spectrum disorder (FASD). FASD is a term used to describe a range of conditions resulting from prenatal exposure to alcohol. As part of a comprehensive neuropsychological battery, four study groups (1. fetal alcohol syndrome/partial fetal alcohol syndrome; 2. static encephalopathy/alcohol exposed; 3. neurobehavioral disorder/alcohol exposed as diagnosed using the University of Washington FASD 4-Digit Code; 4. typically-developing (TD) age-matched children with no prenatal alcohol exposure) were administered measures of motor response and inhibitory control, attention, and adaptive behavior. The results indicate increased levels of IIV in those with FASD compared to the TD controls. It was found that IIV uniquely contributes to predicting adaptive behavior above and beyond attention, while attention partially mediates the relationship between IIV and adaptive behavior. This is the first study to the authors’ knowledge to show the presence of increased IIV in children with FASD. It additionally provides evidence that IIV measures some inherent variability in performance independent of poor attention in children with FASD.     

Assessment of executive function in ADHD adolescents: contribution of performance tests and rating scales

This study aimed to analyze performance on measures of neuropsychological and behavioral executive functions (EF) in adolescents with attention deficit hyperactivity disorder (ADHD), and to evaluate the utility of performance-based tests for predicting scores on behavioral EF ratings. One hundred eighteen adolescents (75 ADHD and 43 controls) aged 12–16 years performed neuropsychological tests and completed a behavior rating scale of EF. The ADHD group presented significantly lower scores than controls on Full Scale IQ (FSIQ) and all indexes of the WISC-IV, except the verbal comprehension index (VCI). The ADHD group had significantly lower scores on performance-based tests of working memory, planning and inhibition, and on EF rating scales. Scores on the cognitive EF working memory, planning and flexibility modestly predicted performance on behavioral EF. The results suggest that the combined use of performance-based tests and rating scales provides valuable complementary information that can improve the assessment of executive domains in ADHD.     

Time-based prospective memory difficulties in children with ADHD and the role of time perception and working memory

Time-based prospective memory (PM) is the ability to remember to perform an intended action at a given time in the future. It is a competence that is crucial for effective performance in everyday life and may be one of the main causes of problems for individuals who have difficulty in planning and organizing their life, such as children with attention deficit/hyperactivity disorder (ADHD). This study systematically examines different aspects of time-based PM performance in a task that involves taking an action at a given future time in a group of 23 children with ADHD who were compared with a matched group of typically-developing (TD) children. The children were asked to watch a cartoon and then answer a questionnaire about its content (ongoing task). They were also asked to press a key every 2 minutes while watching the cartoon (PM task). The relationships of time perception and verbal working memory with PM performance were examined by administering appropriate tasks. The results showed that the children with ADHD were less accurate than the TD children in the PM task and exhibited less strategic time-monitoring behavior. Time perception was found to predict PM accuracy, whereas working memory was mainly involved in time-monitoring behavior, but this applied more to the TD group than to the ADHD group, suggesting that children with ADHD are less able to use their cognitive resources when meeting a PM request.     

Inattentive and noninattentive ADHD children: Do they constitute a unitary group?

Teacher-rated ADHD and normal control children were administered a continuous performance test (CPT), and were then further subdivided based upon the presence or absence of objectively assessed attentional deficits. In addition, children were assessed using several measures of cognitive and behavioral functioning. Attentional deficits were signficantly more prevalent among the ADHD group, but about half of the ADHD children showed no evidence of objectively assessed attentional dysfunction. Further group analyses indicated that ADHD children with objectively assessed attentional dysfunction appeared cognitively impaired, while ADHD children without objective evidence of attentional dysfunction had more conduct problems. CPT inattention was not related to the presence of cognitive impairments or conduct problems in the control group. These data must be considered preliminary because teacher ratings were the only source of diagnosis and a single measure of inattention was used. However, they suggest that two subtypes of ADHD children can be identified, one characterized by inattention and learning problems, and the other by conduct problems.The authors gratefully acknowledge the assistance of Sister Hildegard Kogler and the St. Francis DeSales School, and the parents and children who participated in this study.     

Relating children's attentional capabilities to intelligence, memory, and academic achievement: a test of construct specificity in children with asthma.

The relationship between attention, intelligence, memory, achievement, and behavior in a large population (N = 939) of children without neuropsychologic problems was investigated in children with mild and moderate asthma. It was hypothesized that different levels of children's attentional capabilities would be associated with different levels of intellectual, memory, and academic abilities. Children ages 6-12 at the eight clinical centers of the Childhood Asthma Management Program (CAMP) were enrolled in this study. Standardized measures of child neuropsychological and behavioral performance were administered to all participants, with analyses examining both the developmental trajectory of child attentional capabilities and the associations between Continuous Performance Test (CPT) scores and intellectual functioning, and measures of memory, academic achievement, and behavioral functioning. Findings demonstrated that correct responses on the CPT increase significantly with age, while commission errors decrease significantly with age. Performance levels on the CPT were associated with differences in child intellectual function, memory, and academic achievement. Overall these findings reveal how impairments in child attention skills were associated with normal levels of performance on measures of children's intelligence, memory, academic achievement, and behavioral functioning, suggesting that CPT performance is a salient marker of brain function.     

Brief report: Relationship between performance testing and parent report of attention and executive functioning profiles in children following perinatal arterial ischemic stroke

Children with perinatal arterial ischemic stroke (PAIS) have increased rates of attention and executive functioning (EF) weaknesses. Research in other pediatric disorders has documented poor consistency between parent report of these skills and performance-based measures. We compared these data sources in children with PAIS. Forty full-term (≥37 weeks) children ages 3–16 (median = 7.2 years; 58% male) with PAIS completed neuropsychological testing and composite scores were created for seven attention and EF domains (Processing Speed; Attention; Working Memory; Verbal Retrieval; Inhibitory Control; Flexibility/Shifting; Planning). Parents completed “real-world” functioning questionnaires (ADHD Rating Scale-IV, BRIEF). Correlational analysis were used to compare parent and performance measures. Correlations between ADHD Rating Scale-IV scores and the performance-based Attention and Inhibition composite scores were nonsignificant. Significant negative correlations were found between the BRIEF GEC and performance-based Verbal Retrieval and Processing Speed composites, but remaining GEC/composite comparisons were nonsignificant. Analyses between parent report BRIEF index scores and the corresponding performance-based domain identified one significant negative correlation between the BRIEF Working Memory Index and the Working Memory composite score. While children with PAIS demonstrate difficulties in attention and EF on both parent report and performance measures, little significance was found in comparisons of these two types of measures. There may be several explanations for this dissociation: measures assessing different aspects of the same underlying construct; performance-based measures lacking ecological validity; and parents underestimating/underreporting their child’s deficits. Thus, multiple sources of informant and performance data are necessary to make more accurate conclusions about functioning in these domains.     

Cognitive Load Differentially Impacts Response Control in Girls and Boys with ADHD

Children with attention-deficit hyperactivity disorder (ADHD) consistently show impaired response control, including deficits in response inhibition and increased intrasubject variability (ISV) compared to typically-developing (TD) children. However, significantly less research has examined factors that may influence response control in individuals with ADHD, such as task or participant characteristics. The current study extends the literature by examining the impact of increasing cognitive demands on response control in a large sample of 81children with ADHD (40 girls) and 100 TD children (47 girls), ages 8–12 years. Participants completed a simple Go/No-Go (GNG) task with minimal cognitive demands, and a complex GNG task with increased cognitive load. Results showed that increasing cognitive load differentially impacted response control (commission error rate and tau, an ex-Gaussian measure of ISV) for girls, but not boys, with ADHD compared to same-sex TD children. Specifically, a sexually dimorphic pattern emerged such that boys with ADHD demonstrated higher commission error rate and tau on both the simple and complex GNG tasks as compared to TD boys, whereas girls with ADHD did not differ from TD girls on the simple GNG task, but showed higher commission error rate and tau on the complex GNG task. These findings suggest that task complexity influences response control in children with ADHD in a sexually dimorphic manner. The findings have substantive implications for the pathophysiology of ADHD in boys versus girls with ADHD.     

A rating measure of ADHD-related neuropsychological impairment in children and adolescents: Data from the Cognition and Motivation in Everyday Life (CAMEL) Scale from population and clinical samples

A new parent-completed questionnaire, the Cognition and Motivation in Everyday Life (CAMEL) scale, was developed to provide a comprehensive assessment of neuropsychological impairment in children related to attention-deficit/hyperactivity disorder (ADHD) across diverse cognitive, motivational and energetic domains. Its psychometric properties were investigated. A total of 60 items were generated to cover a wide range of putative ADHD-related neuropsychological processes. A clinical (n = 142) and community (n = 810) sample of parents with children between 6 and 16 years of age completed the questionnaire. Data on ADHD symptoms were also collected with a commonly-used, validated parent rating scale to explore the associations between CAMEL scores and dimensional measures of child ADHD and conduct problems. Factor analysis identified six factors which we labeled (i) Cognition, (ii) Self-Direction and Organization, (iii) Effort Engagement, (iv) Arousal Regulation, (v) Motivational Responsiveness, and (vi) Cautiousness. Self-Direction and Organization and Arousal Regulation were the strongest predictors for ADHD symptomatology. Self-Direction and Organization was strongly associated with inattention and Arousal Regulation with hyperactivity-impulsivity symptoms. Parents distinguished between broad neuropsychological domains in reliable and plausible ways, making distinctions between key aspects of functioning. However, the boundaries between these domains did not map directly onto the distinctions drawn within traditional models of ADHD deficits. Further research is required to examine the predictive validity and cost-effectiveness of the CAMEL scale compared to direct objective testing using laboratory measures in predicting prognosis and treatment outcome.     

Mentalizing skills of non-native,early signers: A longitudinal perspective

Using a population-based sample consisting of 401 6- to 12-year-olds, this study examined normative age and sex distributions on motor activity as measured in an actigraphic-based motion tracking system (MTS) and on attention-related functions derived from a Continuous Performance Test (CPT). Specific objectives were to present new knowledge on age-related change in motor activity and to study age effects on changes in motor activity and CPT performance as a function of time on task. Further, continuous relations between the two ADHD symptom domains and CPT performance and motor activity, and importantly, age effects in these relations were examined. CPT performance improved, and level of motor activity decreased with age. Linear associations between the two ADHD symptom domains and several of the CPT and MTS parameters support available research describing the nature of ADHD as a continuous dimension with variable expression throughout the general population. Further, our study is one of the first to provide developmental data using a time on task design, particularly with regard to motor activity. Imperative for ADHD future research are our results showing that age matters in the relation between ADHD behaviours and neuropsychological function.