Effects of grammatical categories on children's visual language processing: Evidence from event-related brain potentials

This study examined how school-aged children process different grammatical categories. Event-related brain potentials elicited by words in visually presented sentences were analyzed according to seven grammatical categories with naturally varying characteristics of linguistic functions, semantic features, and quantitative attributes of length and frequency. The categories included nouns, adjectives, verbs, pronouns, conjunctions, prepositions, and articles. The findings indicate that by the age of 9-10 years, children exhibit robust neural indicators differentiating grammatical categories; however, it is also evident that development of language processing is not yet adult-like at this age. The current findings are consistent with the hypothesis that for beginning readers a variety of cues and characteristics interact to affect processing of different grammatical categories and indicate the need to take into account linguistic functions, prosodic salience, and grammatical complexity as they relate to the development of language abilities.     

Analysis of information processing stages using event-related potentials.

The event-related potential (ERP) was recorded to identify the time epochs during which different independent variables have their effects on stages in a memory search task. Stimulus intensity, memory set size and response type were varied. For the most part, the order and timing of effects (evaluated by Principal Components Analysis of within-subjects ERP differences) were consistent with the presumed underlying stages, except for early effects of response type prior to memory set effects (suggesting precategorical target recognition). The usefulness of this type of analysis for the investigation of information processing stages is discussed.     

Attention effects on auditory scene analysis: insights from event-related brain potentials

Sounds emitted by different sources arrive at our ears as a mixture that must be disentangled before meaningful information can be retrieved. It is still a matter of debate whether this decomposition happens automatically or requires the listener’s attention. These opposite positions partly stem from different methodological approaches to the problem. We propose an integrative approach that combines the logic of previous measurements targeting either auditory stream segregation (interpreting a mixture as coming from two separate sources) or integration (interpreting a mixture as originating from only one source). By means of combined behavioral and event-related potential (ERP) measures, our paradigm has the potential to measure stream segregation and integration at the same time, providing the opportunity to obtain positive evidence of either one. This reduces the reliance on zero findings (i.e., the occurrence of stream integration in a given condition can be demonstrated directly, rather than indirectly based on the absence of empirical evidence for stream segregation, and vice versa). With this two-way approach, we systematically manipulate attention devoted to the auditory stimuli (by varying their task relevance) and to their underlying structure (by delivering perceptual tasks that require segregated or integrated percepts). ERP results based on the mismatch negativity (MMN) show no evidence for a modulation of stream integration by attention, while stream segregation results were less clear due to overlapping attention-related components in the MMN latency range. We suggest future studies combining the proposed two-way approach with some improvements in the ERP measurement of sequential stream segregation.     

Age-differential effects on updating cue information: Evidence from event-related potentials

Recent models on cognitive aging consider the ability to maintain and update context information to be a key source of age-related impairments in various cognitive tasks (Braver & Barch in Neuroscience & Biobehavioral Reviews, 26: 809–817, 2002). Context updating has been investigated with a modified AX-continuous-performance task by comparing performance and brain activity between context-dependent trials (i.e., correct responses require updating of the preceding cue information) and context-independent trials (i.e., correct responses are independent of cue information). We used an event-related potential (ERP) approach to identify sources of age differences in context processing in the early and late processing of cue information. Our behavioral data showed longer latencies and higher error rates on context-dependent than on context-independent trials for older than for younger adults, suggesting age-related impairments in context updating. The ERP data revealed larger P3b amplitudes for context-dependent than for context-independent trials only in younger adults. In contrast, in older adults, P3b amplitudes were more evenly distributed across the scalp and did not differ between context conditions. Interestingly, older but not younger adults were sensitive to changes of cue identity, as indicated by larger P3b amplitudes on cue-change than on cue-repeat trials, irrespective of the actual context condition. We also found a larger CNV on context-dependent than on context-independent trials, reflecting active maintenance of context information and response preparation. The age-differential effects in the P3b suggest that both younger and older adults were engaged in updating task-relevant information, but relied on different information: Whereas younger participants indeed relied on context cues to update and reconfigure the task settings, older adults relied on changes in cue identity, irrespective of context information.     

Bottom-up and top-down influences on auditory scene analysis: evidence from event-related brain potentials

The physiological processes underlying the segregation of concurrent sounds were investigated through the use of event-related brain potentials. The stimuli were complex sounds containing multiple harmonics, one of which could be mistuned so that it was no longer an integer multiple of the fundamental. Perception of concurrent auditory objects increased with degree of mistuning and was accompanied by negative and positive waves that peaked at 180 and 400 ms poststimulus, respectively. The negative wave, referred to as object-related negativity, was present during passive listening, but the positive wave was not. These findings indicate bottom-up and top-down influences during auditory scene analysis. Brain electrical source analyses showed that distinguishing simultaneous auditory objects involved a widely distributed neural network that included auditory cortices, the medial temporal lobe, and posterior association cortices.     

Semantic processing without conscious identification: evidence from event-related potentials

Three event-related potential (ERP) experiments examined whether semantic content can be accessed from visually presented words that cannot be consciously identified. Category labels were shown to participants, followed by masked, briefly exposed words that were either exemplars of the category or not exemplars. The task was to verify the category, by guessing if necessary, and to identify the word, naming it if possible. Exposure durations were selected to allow identification in approximately half the trials. For identified words, there was a marked difference in the ERP response between in-category and out-of-category words because of an N400 component. For unidentified words, there was a similar although smaller difference. Conscious identification was defined using a variety of approaches: verbal report, 6-alternative forced choice, and binary categorization (in the context of the regression method; A. G. Greenwald, M. R. Klinger, & E. S. Schuh, 1995). By any definition, ERPs for unidentified words showed evidence of semantic processing. In addition, there were differences in the neuronal populations recruited to process above-threshold versus below-threshold words, suggesting qualitative differences.     

Priming prepositional phrase attachment: Evidence from eye-tracking and event-related potentials

Three syntactic-priming experiments investigated the effect of structurally similar or dissimilar prime sentences on the processing of target sentences, using eye tracking (Experiment 1) and event-related potentials (ERPs) (Experiments 2 and 3) All three experiments tested readers' response to sentences containing a temporary syntactic ambiguity. The ambiguity occurred because a prepositional phrase modifier (PP-modifier) could attach either to a preceding verb or to a preceding noun. Previous experiments have established that (a) noun-modifying expressions are harder to process than verb-modifying expressions (when test sentences are presented in isolation); and (b) for other kinds of sentences, processing a structurally similar prime sentence can facilitate processing a target sentence. The experiments reported here were designed to determine whether a structurally similar prime could facilitate processing of noun-attached modifiers and whether such facilitation reflected syntactic-structure-building or semantic processes. These findings have implications for accounts of structural priming during online comprehension and for accounts of syntactic representation and processing in comprehension.     

Lexical contribution to nonword-repetition effects: Evidence from event-related potentials

Two experiments investigated the modulation of event-related potentials (ERPs) by the repetition of orthographically legal and illegal nonwords. In Experiment 1, subjects silently counted occasional words against a background of nonwords, a proportion of which were repetitions of an immediately preceding legal or illegal item. ERPs to repeated legal items showed a sustained, topographically diffuse, positive-going shift. In contrast, repeated illegal nonwords gave rise to ERPs showing a smaller and temporally more restricted positive-going modulation. In an attempt to equalize depth of processing across legal and illegal nonwords, subjects in Experiment 2 were required to count items containing a nonalphabetic character against the same background of nonword items. ERPs to repeated legal items showed a modulation similar to, although smaller than, that found in Experiment I, but no effects of repetition were observed in the ERPs to the illegal nonwords. It was concluded that the effects of repeating nonwords, at least as manifested in concurrently recorded ERPs, differ as a consequence of whether items can access lexical memory, and that this is inconsistent with the attribution of such effects solely to the operation of episodic memory processes.     

The role of animacy in the real time comprehension of Mandarin Chinese: Evidence from auditory event-related brain potentials

Two auditory ERP studies examined the role of animacy in sentence comprehension in Mandarin Chinese by comparing active and passive sentences in simple verb-final (Experiment 1) and relative clause constructions (Experiment 2). In addition to the voice manipulation (which modulated the assignment of actor and undergoer roles to the arguments), both arguments were either animate or inanimate. This allowed us to examine the interplay of animacy with thematic interpretation. In Experiment 1, we observed no effect of animacy at NP1, but N400 effects for inanimate actor arguments in second position. This result mirrors previous findings in German, thus suggesting that an initial undergoer universally leads to the prediction of an ideal (animate) actor. We also observed an N400 effect for passive sentences with an inanimate initial (undergoer) argument. We attribute this effect to a language-specific property of the passive construction in Chinese, namely that the first argument is negatively affected by the event described (i.e. bears an experiencer role). Experiment 2 showed that both of these effects can also be observed in sentence constructions of another type, in which the critical information sources become available in a different order. These findings provide the first demonstration that the N400 is not only sensitive to general (universal) aspects of thematic processing (i.e. "who is acting on whom") but also to the interaction between thematic interpretation and language-specific pragmatic principles.     

工作记忆负荷对反馈加工过程的影响:来自脑电研究的证据

个体对行为后反馈结果的加工在学习和环境适应方面有重要意义,工作记忆负荷(working memory load,WM load)如何影响反馈加工过程尚不清楚。采用双任务范式,设置基线、低WM load、高WM load三种条件,结合ERP技术对这一问题进行探究。发现RewP (reward positivity,奖赏正波)对效价敏感,而不受WM load条件影响;Theta震荡的正、负反馈差异波在高WMload条件下比在低WM load条件下小。结果支持等级强化学习-前扣带回理论(HRL-ACC, hierarchical reinforcement learning theory of anterior cingulate cortex)对于RewP和theta震荡的观点:RewP反映了反馈效价评估功能, theta震荡反映了认知控制功能,并且WM load选择性影响了ACC的认知控制功能而不是反馈效价评估功能。     

Goal-driven attentional capture by invisible colors: Evidence from event-related potentials

We combined event-related brain potentials (ERPs) and behavioral measures to test whether subliminal visual stimuli can capture attention in a goal-dependent manner. Participants searched for visual targets defined by a specific color. Search displays served as metacontrast masks for preceding cue displays that contained one cue in the target color. Although this target-color cue was spatially uninformative, it produced behavioral spatial cuing effects and triggered an ERP correlate of attentional selection (i.e., the N2pc component). These results demonstrate that target-color cues captured attention, in spite of the fact that cue localization performance assessed in separate blocks was at chance level. We conclude that task-set contingent attentional capture is not restricted to supraliminal stimuli, but is also elicited by visual events that are not consciously perceived.     

Adapting to changing memory retrieval demands: Evidence from event-related potentials

This study investigated preparatory processes involved in adapting to changing episodic memory retrieval demands. Event-related potentials (ERPs) were recorded while participants performed a general old/new recognition task and a specific task that also required retrieval of perceptual details. The relevant task remained either constant or changed (predictably or randomly) across trials. Responses were slowed when participants switched from the specific to the general task but not vice versa. Hence, asymmetrical switch costs were observed, suggesting that retrieval preparation is dependent not only on the current retrieval goal but also influenced by recent retrieval attempts. Consistently, over posterior scalp regions ERPs associated with advance preparation were modulated by the preceding task, reflecting increased attentional selection requirements for the general task, and by the foreknowledge about the task sequence. When retrieval demands remained constant, frontal slow-waves elicited by retrieval-cues were more positive going for the specific task, indicating full implementation of a retrieval orientation that allows more efficient retrieval of perceptual details.     

Cross-modal attention capture by affective stimuli: Evidence from event-related potentials

The P3 component of the event-related potential (ERP) to an acoustic startle probe is modulated during picture viewing, with reduced P3 amplitude when participants view either pleasant or unpleasant, as opposed to neutral, pictures. We have interpreted this as reflecting capture of attentional resources by affective pictures, with fewer resources available for processing the secondary startle probe. In the present study, we tested this resource allocation hypothesis by presenting either pictures or sounds as foreground stimuli, with the prediction that P3 amplitude in response to secondary startle probes would be reduced for affectively engaging foregrounds regardless of modality. Using dense-array electroencephalography and a source estimation procedure, we observed that P3 amplitude was indeed smaller when startle probes were presented during emotional, as opposed to neutral, stimuli for both sound and picture foregrounds. Source modeling indicated a common frontocentral maximum of P3 modulation by affect. The data support the notion that emotionally arousing stimuli transmodally attract resources, leading to optimized processing of the affective stimuli at the cost of the processing of concurrent stimuli.     

An attentional-adaptation account of spatial negative priming: Evidence from event-related potentials

Negative priming (NP) refers to a slower response to a target stimulus if it has been previously ignored. To examine theoretical accounts of spatial NP, we recorded behavioral measures and event-related potentials (ERPs) in a target localization task. A target and distractor briefly appeared, and the participant pressed a key corresponding to the target’s location. The probability of the distractor appearing in each of four locations varied, whereas the target appeared with equal probabilities in all locations. We found that response times (RTs) were fastest when the prime distractor appeared in its most probable (frequent) location and when the prime target appeared in the location that never contained a distractor. Moreover, NP effects varied as a function of location: They were smallest when targets followed distractors in the frequent distractor location—a finding not predicted by episodic-retrieval or suppression accounts of NP. The ERP results showed that the P2, an ERP component associated with attentional orientation, was smaller in prime displays when the distractor appeared in its frequent location. Moreover, no differences were apparent between negative-prime and control trials in the N2, which is associated with suppression processes, nor in the P3, which is associated with episodic retrieval processes. These results indicate that the spatial NP effect is caused by both short- and long-term adaptation in preferences based on the history of inspecting unsuccessful locations. This article is dedicated to the memory of Edward E. Smith, and we indicate how this study was inspired by his research career.     

Central auditory processing : II. Effects of anterior temporal lobectomy

Ear dominance for the pitch of dichotically presented tonal stimuli was measured in nine patients before and after a unilateral anterior temporal lobectomy. Four subjects had a left and five had a right lobectomy. Every patient exhibited a change of ear dominance consistent with the hypothesis that a unilateral lobectomy decreases the perceptual salience of the tone presented to the ear contralateral to the lesion. Depending on the direction and magnitude of the subject's preoperative ear dominance and the side of the lobectomy, the postoperative results either increased or decreased the strength of ear dominance in a predictable fashion. The results support the idea that within each temporal lobe lie physiological mechanisms which can enhance the perceptual salience of the acoustic signal emitted by one sound source when other, concurrent, spatially separated sound sources are present. It is also argued that the same mechanism operates on speech, melodic, and tonal signals.     

Emotional modulation of attention affects time perception: Evidence from event-related potentials

Emotional effects on human time perception are generally attributed to arousal speeding up or slowing down the internal clock. The aim of the present study is to investigate the less frequently considered role of attention as an alternative mediator of these effects with the help of event-related potentials (ERPs). Participants produced short intervals (0.9, 1.5, 2.7, and 3.3 s) while viewing high arousal images with pleasant and unpleasant contents in comparison to neutral images. Behavioral results revealed that durations were overproduced for the 0.9 s interval whereas, for 2.7 and 3.3 s intervals, underproduction was observed. The effect of affective valence was present for the shorter durations and decreased as the target intervals became longer. More specifically, the durations for unpleasant images were less overproduced in the 0.9 s intervals, and for the 1.5 s trials, durations for unpleasant images were slightly underproduced, compared to pleasant images, which were overproduced. The analysis of different ERP components suggests possible attention processes related to the timing of affective images in addition to changes in pacemaker speed. Early Posterior Negativity (EPN) was larger for positive than for negative images, indicating valence-specific differences in activation of early attention mechanisms. Within the early P1 and the Late Positive Potential (LPP) components, both pleasant and unpleasant stimuli exhibited equal affective modulation. Contingent Negative Variation (CNV) remained independent of both timing performance and affective modulation. This pattern suggests that both pleasant and unpleasant stimuli enhanced arousal and captured attention, but the latter effect was more pronounced for pleasant stimuli. The valence-specificity of affective attention revealed by ERPs combined with behavioral timing results suggests that attention processes indeed contribute to emotion-induced temporal distortions, especially for longer target intervals.     

情绪面孔的意识神经相关物及其无意识自动加工：来自事件相关电位的证据

意识的神经相关物尚有争议, 且个体能否无意识自动检测视觉环境变化尚不清楚。本研究采用非注意视盲范式操控视觉意识, 并引入具有社会信息的情绪面孔, 探讨意识的神经相关物以及视觉意识与自动检测变化机制的关系。在A阶段, 部分被试对任务无关的情绪面孔处于无意识水平; 在B阶段, 所有被试对任务无关的情绪面孔处于意识水平; 在C阶段, 所有被试对任务相关的情绪面孔处于意识水平。结果显示, 任务无关的情绪面孔的意识过程诱发视觉意识负波(visual awareness negativity, VAN)、晚期正成分(late positivity, LP)和晚期枕区正成分(late occipital positivity, LOP)。此外, 无意识的情绪面孔能诱发视觉失匹配负波(visual mismatch negativity, vMMN), 且其幅值不受意识影响, 但是受任务相关性调制。这些结果提示对情绪面孔的视觉意识在不同的时间进程上有不同的ERP指标——VAN反映早期知觉经验, 而LP和LOP反映晚期意识过程, 而且面孔情绪信息的自动加工独立于视觉意识, 但是受视觉注意调制。     

Object substitution masking interferes with semantic processing: evidence from event-related potentials

Object substitution masking (OSM) refers to impaired target identification caused by common onset, but delayed offset, of a surrounding dot mask. This effect has been hypothesized to reflect reentrant processes that result in the mask replacing the target representation. However, little is known about the depth of processing associated with masked targets in this paradigm. We investigated this issue by examining the effect of OSM on the N400 component of the event-related potential, which reflects the degree of semantic mismatch between a target and its context. Participants read a context word followed by a semantically related or unrelated target word surrounded by dots. As expected, delayed dot offset significantly reduced accuracy in identifying the target. The N400 amplitude was also diminished by OSM. These findings offer the first evidence that substitution interferes with target processing prior to semantic analysis, demonstrating an important difference between OSM and other visual phenomena, such as the attentional blink, in which semantic processing is independent of awareness.     

Gender differences in memory processing: evidence from event-related potentials to faces

This study investigated gender differences on memory processing using event-related potentials (ERPs). Behavioral data and ERPs were recorded in 16 males and 10 females during a recognition memory task for faces. The behavioral data results showed that females performed better than males. Gender differences on ERPs were evidenced over anterior locations and involve the modulation of two spatially and temporally distinct components. These results are in general accordance with the view that males and females differ in the cognitive strategies they use to process information. Specifically, they could differ in their abilities to maintain information over interference and in the processing of the intrinsic contextual attributes of items, respectively, associated with the modulation of two anterior components. These interpretations lend support to the view that processing in females entails more detailed elaboration of information content than in males. Processing in males is more likely driven by schemas or overall information theme.