Processing of audiovisually congruent and incongruent speech in school‐age children with a history of specific language impairment: a behavioral and event‐related potentials study

Previous studies indicate that at least some aspects of audiovisual speech perception are impaired in children with specific language impairment (SLI). However, whether audiovisual processing difficulties are also present in older children with a history of this disorder is unknown. By combining electrophysiological and behavioral measures, we examined perception of both audiovisually congruent and audiovisually incongruent speech in school‐age children with a history of SLI (H‐SLI), their typically developing (TD) peers, and adults. In the first experiment, all participants watched videos of a talker articulating syllables ‘ba’, ‘da’, and ‘ga’ under three conditions – audiovisual (AV), auditory only (A), and visual only (V). The amplitude of the N1 (but not of the P2) event‐related component elicited in the AV condition was significantly reduced compared to the N1 amplitude measured from the sum of the A and V conditions in all groups of participants. Because N1 attenuation to AV speech is thought to index the degree to which facial movements predict the onset of the auditory signal, our findings suggest that this aspect of audiovisual speech perception is mature by mid‐childhood and is normal in the H‐SLI children. In the second experiment, participants watched videos of audivisually incongruent syllables created to elicit the so‐called McGurk illusion (with an auditory ‘pa’ dubbed onto a visual articulation of ‘ka’, and the expectant perception being that of ‘ta’ if audiovisual integration took place). As a group, H‐SLI children were significantly more likely than either TD children or adults to hear the McGurk syllable as ‘pa’ (in agreement with its auditory component) than as ‘ka’ (in agreement with its visual component), suggesting that susceptibility to the McGurk illusion is reduced in at least some children with a history of SLI. Taken together, the results of the two experiments argue against global audiovisual integration impairment in children with a history of SLI and suggest that, when present, audiovisual integration difficulties in this population likely stem from a later (non‐sensory) stage of processing.     

Links between social and linguistic processing of speech in preschool children with autism: behavioral and electrophysiological measures

Data on typically developing children suggest a link between social interaction and language learning, a finding of interest both to theories of language and theories of autism. In this study, we examined social and linguistic processing of speech in preschool children with autism spectrum disorder (ASD) and typically developing chronologically matched (TDCA) and mental age matched (TDMA) children. The social measure was an auditory preference test that pitted 'motherese' speech samples against non-speech analogs of the same signals. The linguistic measure was phonetic discrimination assessed with mismatch negativity (MMN), an event-related potential (ERP). As a group, children with ASD differed from controls by: (a) demonstrating a preference for the non-speech analog signals, and (b) failing to show a significant MMN in response to a syllable change. When ASD children were divided into subgroups based on auditory preference, and the ERP data reanalyzed, ASD children who preferred non-speech still failed to show an MMN, whereas ASD children who preferred motherese did not differ from the controls. The data support the hypothesis of an association between social and linguistic processing in children with ASD.     

The relationship between emotional-state language and emotion understanding: A study with school-age children

We carried out an investigation with primary-school children on the relationship between both use and comprehension of emotional-state language and emotion understanding. Participants were 100 students between 7 and 10 years old (mean age=8 years and 10 months; SD=15.3 months), equally divided by gender. They completed four tests evaluating their language ability, use of emotional-state language, comprehension of emotional-state language and emotion understanding (EU) respectively. Significant correlations were found between both use and comprehension of emotional-state talk and children's EU. In addition, regression analyses showed that comprehension of emotional-state language, rather than its use, plays a significant role in explaining children's emotion understanding.     

Enhanced development of auditory change detection in musically trained school‐aged children: a longitudinal event‐related potential study

Adult musicians show superior auditory discrimination skills when compared to non‐musicians. The enhanced auditory skills of musicians are reflected in the augmented amplitudes of their auditory event‐related potential (ERP) responses. In the current study, we investigated longitudinally the development of auditory discrimination skills in musically trained and nontrained individuals. To this end, we recorded the mismatch negativity (MMN) and P3a responses from children who play a musical instrument and age‐matched children with no musical training at ages 7, 9, 11, and 13. Basic auditory processing was investigated by recording ERPs in the Multi‐Feature Paradigm that included frequency, duration, intensity, location, and gap deviants. The detection of musically more relevant sound changes was examined in an oddball paradigm with major chords as standards and minor chords as deviants. The musically trained children showed larger increase in MMN and P3a amplitudes with age for the chord deviants than the control children. There was also a strong trend (p = .054) for larger increase in MMN amplitude in the musically trained children for the location deviant. As no group differences in response amplitudes were evident at the early stages of the training, our results suggest that the superior neural auditory discrimination in adult musicians is due to training and not pre‐existing differences between musicians and non‐musicians.     

Temporal processing deficits in high‐functioning children with autism

It is well known that complex functions (e.g. perception, attention, memory, emotions, social interactions and language) are usually disturbed in autism. As these functions are characterized by specific temporal patterns, the present study examined whether children with autism show typical temporal processing in the time domain of a few seconds. Using a temporal‐reproduction paradigm, we found that they were unable to link their responses to stimulus duration. Independently of stimulus duration, they reproduced auditory or visual stimuli with the same response duration of, on average, 3 s. These results demonstrate important deficits in duration judgment in individuals with autism. As other experiments provide evidence for a temporal processing platform of ? 2 — 3 s in normal individuals, this platform may be preserved in a residual form in autism.     

Generalization between receptive and expressive language in young children with autism

Generalization between expressive and receptive language was studied in six boys with autism (chronological age 47–76 months, language age 13–42 months). Each participant received training on three or four word pairs (e.g. hot/cold). Half the pairs were taught expressively and then receptively; the other half were taught in the reverse order. Data were obtained on generalization from the trained to untrained modality, generalization errors, and between‐ and within‐subject differences. Across participants, the ‘expressive first’ condition led to cross‐modal generalization more often than the ‘receptive first’ condition. However, one child displayed the opposite pattern, and three other children's patterns varied across training stimuli. Error analyses indicated that, when children failed to demonstrate receptive‐to‐expressive generalization, they did generalize in another manner: responding based on physical resemblance between cues used in the study and those used in previous training. The results suggest ways to individualize instruction and better understand cross‐modal generalization. Copyright © 2003 John Wiley & Sons, Ltd.     

Positive emotion modulates cognitive control: An event‐related potentials study

There is substantial evidence to indicate that negative emotion can modulate cognitive control processing. However, only a few studies have investigated this effect with positive emotion. Therefore, the present study explored the electrophysiological correlates of the impact of positive emotional stimuli on cognitive control, using event‐related potentials (ERPs). Sixteen healthy young adults completed a modified Simon task (Simon, 1969). Behavioral data indicated that reaction times were faster for positive emotional stimuli than for neutral emotional stimuli in the incongruent condition, but not in the congruent condition, which suggested that positive emotion expedited conflict resolution. The ERP data showed that two negative ERP components (N300–400 and N450–550) were associated with the positive emotional stimuli in the incongruent minus congruent condition. It is suggested that these components may respectively be related to the conflict monitoring (N300–400) and response selection (N450–550) stages of cognitive control processing. Overall, our results indicated that positive emotion could facilitate cognitive control processing. These results are in line with the neuropsychological theory, according to which, positive emotion could modulate cognitive control mediated by increased dopamine levels in frontal brain areas.     

The use of averaged electroencephalic response techniques in the study of auditory processing related to speech and language

This paper reviews a number of studies done by the authors and others, who have utilized various averaged electroencephalic response (AER) techniques to study speech and language processing. Pertinent studies are described in detail. A relatively new AER technique, auditory brainstem responses (ABR), is described and its usefulness in studying auditory processing activity related to speech and language is outlined. In addition, a series of ABR studies, that have demonstrated significant male—female differences in ABR auditory processing abilities, is presented and the relevance of these data to already established differences in male—female language, hearing, and cognitive abilities is discussed.     

The use of event‐related potentials in the study of early cognitive development

The article by Guillaume Thierry is a welcome one, alerting the field to the exciting ways in which event‐related potentials (ERPs) can be used to study cognitive development. It is also timely: there is great interest in the brain sciences, and in how neuroscience can be applied to cognitive development and indeed to education. In my view, however, the article is perhaps too cautious. It does not seem necessary to delay the use of ERPs in cognitive work until all in the field have agreed on the sound characterization of ERP components. It should be possible for further characterization to proceed hand‐in‐hand with data gathering on applied questions. In fact, as partly noted by Thierry, in the auditory domain well‐characterized ERP components are already available, even for infants (e.g. Cheour et al., 1997; Leppänen and Lyytinen, 1997). Furthermore, it is of developmental interest to study older children as well as infants. If ERPs are seen as a tool to complement existing behavioural investigations, rather than as a stand‐alone method to be used independently, then auditory ERPs can certainly be used in current cognitive‐developmental work. Copyright © 2005 John Wiley & Sons, Ltd.     

Relations between infants’ emerging reach‐grasp competence and event‐related desynchronization in EEG

Recent reports of similar patterns of brain electrical activity (electroencephalogram: EEG) during action execution and observation, recorded from scalp locations over motor‐related regions in infants and adults, have raised the possibility that two foundational abilities – controlling one's own intentional actions and perceiving others’ actions – may be integrally related during ontogeny. However, to our knowledge, there are no published reports of the relations between developments in motor skill (i.e. recording actual motor skill performance) and EEG during both action execution and action observation. In the present study we collected EEG from 21 9‐month‐olds who were given opportunities to reach for toys and who also observed an experimenter reach for toys. Event‐related desynchronization (ERD) was computed from the EEG during the reaching events. We assessed infants’ reaching‐grasping competence, including reach latency, errors, preshaping of the hand, and bimanual reaches, and found that desynchronization recorded in scalp electrodes over motor‐related regions during action observation was associated with action competence during execution. Infants who were more competent reachers, compared to less competent reachers, exhibited greater ERD while observing reaching‐grasping. These results provide initial evidence for an early emerging neural system integrating one's own actions with the perception of others’ actions.     

Relationships between event‐related potentials and behavioral and scholastic measures of reading ability: A large‐scale,cross‐sectional study

In the cognitive, computational, neuropsychological, and educational literatures, it is established that children approach text in unique ways, and that even adult readers can differ in the strategies they bring to reading. In the developmental event‐related potential (ERP) literature, however, children with differing degrees of reading ability are, the majority of the time, placed in monolithic groups such as ‘normal’ and ‘dyslexic’ (e.g. Araújo et al., 2012) and analyzed only at the group level. This is likely done due to methodological concerns – such as low sample size or a lack of statistical power – that can make it difficult to perform analysis at the individual level. Here, we collected ERPs and behavior from > 100 children in grades pre‐K–7, as they read unconnected text silently to themselves. This large sample, combined with the statistical power of the Linear Mixed Effects Regression (LMER) technique, enables us to address individual differences in ERP component effects due to reading ability at an unprecedented level of detail. Results indicate that it is possible to predict reading‐related report card scores from ERP component amplitudes – especially that of the N250, a component pertaining to sublexical processing (including phonological decoding). Results also reveal relationships between behavioral measures of reading ability and ERP component effects that have previously been elusive, such as the relationship between vocabulary and N400 mean amplitude (cf. Henderson et al., 2011). We conclude that it is possible to meaningfully examine reading‐related ERP effects at the single subject level in developing readers, and that this type of analysis can provide novel insights into both behavior and scholastic achievement.     

Effects of school‐based mindfulness training on emotion processing and well‐being in adolescents: evidence from event‐related potentials

In a non‐randomized controlled study, we investigated the efficacy of a school‐based mindfulness curriculum delivered by schoolteachers to older secondary school students (16–18 years). We measured changes in emotion processing indexed by P3b event‐related potential (ERP) modulations in an affective oddball task using static human faces. ERPs were recorded to happy and sad face oddballs presented in a stimulus stream of frequent faces with neutral expression, before and after 8 weeks of mindfulness training. Whilst the mean amplitude of the P3b, an ERP component typically elicited by infrequent oddballs, decreased between testing sessions in the control group, it remained unchanged in the training group. Significant increases in self‐reported well‐being and fewer doctor visits for mental health support were also reported in the training group as compared to controls. The observed habituation to emotional stimuli in controls thus contrasted with maintained sensitivity in mindfulness‐trained students. These results suggest that in‐school mindfulness training for adolescents has scope for increasing awareness of socially relevant emotional stimuli, irrespective of valence, and thus may decrease vulnerability to depression.     

Teaching conversational speech to children with autism spectrum disorder using text‐message prompting

The present study was designed to teach conversational speech using text‐message prompts to children with autism spectrum disorder (ASD) in home play settings with siblings and peers. A multiple baseline design across children was used. Children learned conversational speech through the text‐message prompts, and the behavior generalized across peers and settings. Maintenance of treatment gains was seen at 1‐month follow‐up probes. Social validity measures indicated that parents of typically developing children viewed the participants' conversational speech as much improved after the intervention. Results are discussed in terms of the efficacy of text‐message prompts as a promising way to improve conversational speech for children with ASD.     

The cortical organization of lexical knowledge: a dual lexicon model of spoken language processing

Current accounts of spoken language assume the existence of a lexicon where wordforms are stored and interact during spoken language perception, understanding and production. Despite the theoretical importance of the wordform lexicon, the exact localization and function of the lexicon in the broader context of language use is not well understood. This review draws on evidence from aphasia, functional imaging, neuroanatomy, laboratory phonology and behavioral results to argue for the existence of parallel lexica that facilitate different processes in the dorsal and ventral speech pathways. The dorsal lexicon, localized in the inferior parietal region including the supramarginal gyrus, serves as an interface between phonetic and articulatory representations. The ventral lexicon, localized in the posterior superior temporal sulcus and middle temporal gyrus, serves as an interface between phonetic and semantic representations. In addition to their interface roles, the two lexica contribute to the robustness of speech processing.     

A study of timing in a manual and a spoken language: American sign language and English

A comparative analysis of the time variables in the production of speech and sign reveals that signers modify their global physical rate primarily by altering the time they spend articulating, whereas speakers do so by changing the time they spend pausing. When signers increase or decrease their pause time, however little they do so, they alter the number and the length of the pauses equally, whereas speakers primarily alter the number of pauses and leave their pause durations relatively constant. An analysis of the durations of signs reveals that signs are longer at the end of sentences than within sentences and that the first occurrence of a sign is longer than the second when syntactic location is controlled (both these findings have already been reported for spoken language). The inherent duration of a sign can be accounted for almost totally by the movement characteristic; handshape, location, and number of hands in a sign are of little importance. Finally, signers retain their regular quiet-breathing respiratory pattern across signing rates and inhale at locations independent of syntactic importance. In this they are quite unlike speakers, who breathe at syntactic breaks.This research was supported in part by Grant R03 MH 28133, Department of Health, Education, and Welfare.     

The relationship between phonological processing and arithmetic in children with learning disabilities

Phonological processing skills have not only been shown to be important for reading skills, but also for arithmetic skills. Specifically, previous research in typically developing children has suggested that phonological processing skills may be more closely related to arithmetic problems that are solved through fact retrieval (e.g., remembering the solution from memory) than procedural computation (e.g., counting). However, the relationship between phonological processing and arithmetic in children with learning disabilities (LDs) has not been investigated. Yet, understanding these relationships in children with LDs is especially important because it can help elucidate the cognitive underpinnings of math difficulties, explain why reading and math disabilities frequently co-occur, and provide information on which cognitive skills to target for interventions. In 63 children with LDs, we examined the relationship between different phonological processing skills (phonemic awareness, phonological memory, and rapid serial naming) and arithmetic. We distinguished between arithmetic problems that tend to be solved with fact retrieval versus procedural computation to determine whether phonological processing skills are differentially related to these two arithmetic processes. We found that phonemic awareness, but not phonological memory or rapid serial naming, was related to arithmetic fact retrieval. We also found no association between any phonological processing skills and procedural computation. These results converge with prior research in typically developing children and suggest that phonemic awareness is also related to arithmetic fact retrieval in children with LD. These results raise the possibility that phonemic awareness training might improve both reading and arithmetic fact retrieval skills.

Research Highlights

• Relationships between phonological processing and various arithmetic skills were investigated in children with learning disabilities (LDs) for the first time.
• We found phonemic awareness was related to arithmetic involving fact retrieval, but not to arithmetic involving procedural computation in LDs.
• The results suggest that phonemic awareness is not only important to skilled reading, but also to some aspects of arithmetic.
• These results raise the question of whether intervention in phonemic awareness might improve arithmetic fact retrieval skills.

     

Counterfactual comparison modulates fairness consideration in the mini‐ultimatum game: An event‐related potentials study

Existing literature on the mini‐ultimatum game indicates that counterfactual comparison between chosen and unchosen alternatives is of great importance for individual's fairness consideration. However, it is still unclear how counterfactual comparison influences the electrophysiological responses to unfair chosen offers. In conjunction with event‐related potentials’ (ERPs) technique, the current study aimed to explore the issue by employing a modified version of the mini‐ultimatum game where a fixed set of two alternatives (unfair offer vs. fair alternative, unfair vs. hyperfair alternative, unfair offer vs. hyperunfair alternative) was presented before the chosen offer. The behavioral results showed that participants were more likely to accept unfair chosen offers when the unchosen alternative was hyperunfair than when the unchosen alternative was fair or hyperfair. The ERPs results showed that the feedback‐related negativity (FRN) elicited by unfair chosen offers was insensitive to the type of unchosen alternative when correcting for possible overlap with other components. In contrast, unfair chosen offers elicited larger P300 amplitudes when the unchosen alternative was hyperunfair than when the unchosen alternative was fair or hyperfair. These findings suggest that counterfactual comparison may take effect at later stages of fairness consideration as reflected by the P300.     

Patterns of language and discourse comprehension skills in school‐aged children with autism spectrum disorders

Åsberg, J. (2010). Patterns of language and discourse comprehension skills in school‐aged children with autism spectrum disorders. Scandinavian Journal of Psychology 51, 534–539. The present study examined patterns of language and discourse comprehension skills in Swedish school‐aged children with autism spectrum disorders (ASD) (n = 16) as compared to a slightly younger group of typically developing children (n = 16) matched for non‐verbal cognitive ability. Results suggested significantly lower abilities in narrative discourse comprehension for the ASD group, but not in oral receptive vocabulary or reception of grammar. This difficulty with discourse‐level comprehension appeared to be of a general nature, as no evidence was found for the hypothesis that participants with ASD would find comprehension of inferential discourse information disproportionally more difficult than stated information, or for the hypothesis that discourse processing in ASD would be characterized by an elevated processing of explicitly stated narrative details. The study has clinical and educational implications, as the findings suggest that children with ASD would benefit from being offered specific support for discourse‐level comprehension.