Referential coding contributes to the horizontal SMARC effect

The present study tested whether coding of tone pitch relative to a referent contributes to the correspondence effect between the pitch height of an auditory stimulus and the location of a lateralized response. When left-right responses are mapped to high or low pitch tones, performance is better with the high-right/low-left mapping than with the opposite mapping, a phenomenon called the horizontal SMARC effect. However, when pitch height is task irrelevant, the horizontal SMARC effect occurs only for musicians. In Experiment 1, nonmusicians performed a pitch discrimination task, and the SMARC effect was evident regardless of whether a referent tone was presented. However, in Experiment 2, for a timbre-judgment task, nonmusicians showed a SMARC effect only when a referent tone was presented, whereas musicians showed a SMARC effect that did not interact with presence/absence of the referent. Dependence of the SMARC effect for nonmusicians on a reference tone was replicated in Experiment 3, in which judgments of the color of a visual stimulus were made in the presence of a concurrent high- or low-pitched pure tone. These results suggest that referential coding of pitch height is a key determinant for the horizontal SMARC effect when pitch height is irrelevant to the task.     

The speed and accuracy of perceptual decisions in a random-tone pitch task

Research in perceptual decision making is dominated by paradigms that tap the visual system, such as the random-dot motion (RDM) paradigm. In this study, we investigated whether the behavioral signature of perceptual decisions in the auditory domain is similar to those observed in the visual domain. We developed an auditory version of the RDM task, in which tones correspond to dots and pitch corresponds to motion (the random-tone pitch task, RTP). In this task, participants have to decide quickly whether the pitch of a “sound cloud” of tones is moving up or down. Stimulus strength and speed–accuracy trade-off were manipulated. To describe the relationship between stimulus strength and performance, we fitted the proportional-rate diffusion model to the data. The results showed a close coupling between stimulus strength and the speed and accuracy of perceptual decisions in both tasks. Additionally, we fitted the full drift diffusion model (DDM) to the data and showed that three of the four participants had similar speed–accuracy trade-offs in both tasks. However, for the RTP task, drift rates were larger and nondecision times slower, suggesting that some DDM parameters might be dependent on stimulus modality (drift rate and nondecision time), whereas others might not be (decision bound). The results illustrate that the RTP task is suitable for investigating the dynamics of auditory perceptual choices. Future studies using the task might help to investigate modality-specific effects on decision making at both the behavioral and neuronal levels.     

Binding “what” and “where” in auditory working memory: An asymmetrical association between sound identity and sound location

Contrasting results in visual and auditory working memory studies suggest that the mechanisms of association between location and identity of stimuli depend on the sensory modality of the input. In this auditory study, we tested whether the association of two features both encoded in the “what” stream is different from the association between a “what” and a “where” feature. In an old–new recognition task, blindfolded participants were presented with sequences of sounds varying in timbre, pitch and location. They were required to judge if either the timbre, pitch or location of a single-probe stimulus was identical or different to the timbre, pitch or location of one of the sounds of the previous sequence. Only variations in one of the three features were relevant for the task, whereas the other two features could vary, with task-irrelevant changes. Results showed that task-irrelevant variations in the “what” features (either timbre or pitch) caused an impaired recognition of sound location and in the other task-relevant “what” feature, whereas changes in sound location did not affect the recognition of either one of the “what” features. We conclude that the identity of sounds is incidentally processed even when not required by the task, whereas sound location is not maintained when task irrelevant.     

‘What’s in a name?’ ‘No more than when it's mine own’. Evidence from auditory oddball distraction

Research of the distractor value of hearing the own name has shown that this self-referring stimulus captures attention in an involuntary fashion and create distraction. The behavioral studies are few and the outcomes are not always clear cut. In this study the distraction by own name compared to a control name was investigated by using a cross-modal oddball task in two experiments. In the first experiment, thirty-nine participants were conducting a computerized categorization task while exposed to, to-be ignored own and matched control names (controlling for familiarity, gender and number of syllables) as unexpected auditory deviant stimulus (12.5% trials for each name category) and a sine wave tone as a standard stimulus (75% of the trials). In the second experiment, another group of thirty-nine participants completed the same task but with the additional deviant stimulus of an irrelevant word added (10% trials for each deviant type and 70% trials with the standard stimulus). Results showed deviant distraction by exposure to both the irrelevant word, own and the control name compared to the standard tone but no differences were found showing that the own name captured attention and distracted the participants more than an irrelevant word or a control name. The results elucidate the role of the own name as a potent auditory distractor and possible limitations with its theoretical significance for general theories of attention are discussed.     

Musical space synesthesia: Automatic,explicit and conceptual connections between musical stimuli and space

In musical–space synesthesia, musical pitches are perceived as having a spatially defined array. Previous studies showed that symbolic inducers (e.g., numbers, months) can modulate response according to the inducer’s relative position on the synesthetic spatial form. In the current study we tested two musical–space synesthetes and a group of matched controls on three different tasks: musical–space mapping, spatial cue detection and a spatial Stroop-like task. In the free mapping task, both synesthetes exhibited a diagonal organization of musical pitch tones rising from bottom left to the top right. This organization was found to be consistent over time. In the subsequent tasks, synesthetes were asked to ignore an auditory or visually presented musical pitch (irrelevant information) and respond to a visual target (i.e., an asterisk) on the screen (relevant information). Compatibility between musical pitch and the target’s spatial location was manipulated to be compatible or incompatible with the synesthetes’ spatial representations. In the spatial cue detection task participants had to press the space key immediately upon detecting the target. In the Stroop-like task, they had to reach the target by using a mouse cursor. In both tasks, synesthetes’ performance was modulated by the compatibility between irrelevant and relevant spatial information. Specifically, the target’s spatial location conflicted with the spatial information triggered by the irrelevant musical stimulus. These results reveal that for musical–space synesthetes, musical information automatically orients attention according to their specific spatial musical-forms. The present study demonstrates the genuineness of musical–space synesthesia by revealing its two hallmarks—automaticity and consistency. In addition, our results challenge previous findings regarding an implicit vertical representation for pitch tones in non-synesthete musicians.     

Bottom-up influences on working memory: behavioral and electrophysiological distraction varies with distractor strength

The present study investigates bottom-up effects serving the optimal balance between focusing attention on relevant information and distractibility by potentially significant events outside the focus of attention. We tested whether distraction, indicated by behavioral and event-related brain potential (ERP) measures, varies with the strength of task-irrelevant deviances. Twenty subjects performed a tone-duration discrimination task (200 or 400 ms sinusoidal tones presented equiprobably). The stimuli were presented with frequent standard (p = 0.84; 1000 Hz) or infrequent deviant (p = 0.16) pitch. These task-irrelevant pitch changes consisted in a frequency increase/decrease of 1%, 3%, 5%, or 10%. Each of them resulted in prolonged reaction times (RT) in the duration discrimination task and elicited the MMN, P3a, and RON components of the ERP. Importantly, these measures did increase as a function of pitch deviance. Separating the individual trials on the 1% deviation level into trials with and without RT prolongation, i.e., behavioral distraction effect, revealed that both subgroups had similar MMN, but P3a and RON were confined to the trials with RT prolongation. Results are interpreted within a model relating preattentive deviance detection, distraction, and working memory.     

Relative power of harmonics in human frequency-following responses associated with voice pitch in American and Chinese adults

When the fundamental frequency (f0) is removed from a complex stimulus, the pitch of the f0 is still perceived by the listener. Through the use of the scalp-recorded frequency-following response, this study examined the relative contributions of thef0 and its harmonics in pitch processing by systematically manipulating the speech stimulus to remove component frequencies. 12 American and 12 Chinese adults were recruited. There were statistically significant effects of pitch strength and frequency error for the experimental-condition factor. There were significantly larger responses to the harmonics-only conditions than those obtained in the f0-only and control conditions. No statistically significant difference was observed between the two groups of participants. These findings indicate that neural responses associated with individual harmonics dominate the pitch processing in the human brainstem, irrespective of whether the listener's native language is nontonal or tonal.     

Priming effects on the N400 in the affective priming paradigm with facial expressions of emotion

We studied the effect of facial expression primes on the evaluation of target words through a variant of the affective priming paradigm. In order to make the affective valence of the faces irrelevant to the task, the participants were assigned a double prime–target task in which they were unpredictably asked either to identify the gender of the face or to evaluate whether the word was pleasant or unpleasant. Behavioral and electrophysiological (event-related potential, or ERP) indices of affective priming were analyzed. Temporal and spatial versions of principal components analyses were used to detect and quantify those ERP components associated with affective priming. Although no significant behavioral priming was observed, electrophysiological indices showed a reverse priming effect, in the sense that the amplitude of the N400 was higher in response to congruent than to incongruent negative words. Moreover, a late positive potential (LPP), peaking around 700 ms, was sensitive to affective valence but not to prime–target congruency. This pattern of results is consistent with previous accounts of ERP effects in the affective priming paradigm that have linked the LPP with evaluative priming and the N400 with semantic priming. Our proposed explanation of the N400 priming effects obtained in the present study is based on two assumptions: a double check of affective stimuli in terms of valence and specific emotion content, and the differential specificities of facial expressions of positive and negative emotions.     

Electrophysiological correlates of exemplar-specific processes in implicit and explicit memory

The present ERP study investigated the retrieval of task-irrelevant exemplar-specific information under implicit and explicit memory conditions. Subjects completed either an indirect memory test (a natural/artificial judgment) or a direct recognition memory test. Both test groups were presented with new items, identical repetitions, and perceptually different but conceptually similar exemplars of previously seen study objects. Implicit and explicit memory retrieval elicited clearly dissociable ERP components that were differentially affected by exemplar changes from study to test. In the indirect test, identical repetitions, but not different exemplars, elicited a significant ERP repetition priming effect. In contrast, both types of repeated objects gave rise to a reliable old/new effect in the direct test. The results corroborate that implicit and explicit memory fall back on distinct cognitive representation and, more importantly, indicate that these representations differ in the type of stimulus information stored. Implicit retrieval entailed obligatory access to exemplar-specific perceptual information, despite its being task irrelevant. In contrast, explicit retrieval proved to be more flexible with conceptual and perceptual information accessed according to task demands.     

Attentional bias in anxiety: a behavioral and ERP study

Accumulating evidence suggests the existence of a processing bias in favor of threat-related stimulation in anxious individuals. Using behavioral and ERP measures, the present study investigated the deployment of attention to face stimuli with different emotion expressions in high-anxious and low-anxious participants. An attention-shifting paradigm was used in which faces with neutral, angry, fearful, sad, or happy expressions were presented singly at fixation. Participants had to fixate on the face cue and then discriminate a target shape that appeared randomly above, below, to the left, or right of the fixated face. The behavioral data show that high-anxious participants were slower to respond to targets regardless of the emotion expressed by the face cue. In contrast, the ERP data indicate that threat-related faces elicited faster latencies and greater amplitudes of early ERP components in high-anxious than in low-anxious individuals. The between-group pattern in ERP waveforms suggests that the slower reaction times in high-anxious participants might reflect increased attentional dwelling on the face cues, rather than a general slowing of response enacting.     

Featural and configural face processing in adults and infants: a behavioral and electrophysiological investigation

We sought to elucidate the behavioral and electrophysiological correlates of face processing, in adults and infants, by manipulating either the featural or configural information within the face. Two different experiments are reported. In these experiments, event-related potentials (ERPs) were recorded from the scalp while adult, 8-month-old, and 4-month-old participants completed configural-change and featural-change face tasks. The infants also completed a behavioral visual paired-comparison task with featural and configural face changes. ERP results reveal hemispheric differences in processing featural but not configural changes for the N170 in adults. Furthermore, featural and configural changes are processed differently within the right and left hemispheres. The right hemisphere N170 is significantly greater for configural compared to featural changes. The left hemisphere N170, however, exhibits the opposite effect. Infant data suggest that similar to adults, 8-month-old, but not 4-month-old participants, exhibit similar hemispheric differences between featural and configural changes for the P400 component. Behavioral results suggest increased sensitivity to both featural and configural face changes in 8-month-olds compared to 4-month-olds.     

The cognitive locus of distraction by acoustic novelty in the cross-modal oddball task

Unexpected stimuli are often able to distract us away from a task at hand. The present study seeks to explore some of the mechanisms underpinning this phenomenon. Studies of involuntary attention capture using the oddball task have repeatedly shown that infrequent auditory changes in a series of otherwise repeating sounds trigger an automatic response to the novel or deviant stimulus. This attention capture has been shown to disrupt participants' behavioral performance in a primary task, even when distractors and targets are asynchronous and presented in distinct sensory modalities. This distraction effect is generally considered as a by-product of the capture of attention by the novel or deviant stimulus, but the exact cognitive locus of this effect and the interplay between attention capture and target processing has remained relatively ignored. The present study reports three behavioral experiments using a cross-modal oddball task to examine whether the distraction triggered by auditory novelty affects the processing of the target stimuli. Our results showed that variations in the demands placed on the visual analysis (Experiment 1) or categorical processing of the target (Experiment 2) did not impact on distraction. Instead, the cancellation of distraction by the presentation of an irrelevant visual stimulus presented immediately before the visual target (Experiment 3) suggested that distraction originated in the shifts of attention occurring between attention capture and the onset of the target processing. Possible accounts of these shifts are discussed.     

Attentional capture is contingent on the interaction between task demand and stimulus salience

The aim of this research was to investigate the potential impacts of task demand and stimulus salience on the stimulus-driven attentional capture effect. The participants performed an inefficient visual search task while an irrelevant luminance singleton was present. In Experiment 1, the task demand was manipulated while the stimulus salience of the irrelevant singleton was fixed. With the same salient singleton, the attentional capture effect was observed in the low-difficulty condition but disappeared in the high-difficulty condition. In Experiment 2, the stimulus salience was manipulated while the task demand was fixed. With the same task, the highly salient singleton captured attention, whereas the relatively lowly salient singleton could not. In Experiment 3, both task demand and stimulus salience were manipulated simultaneously. The stimulus-driven attentional capture effect by the irrelevant singleton increased not only as the task demand decreased but also as the stimulus salience increased. The present study might provide a way to reconcile conflicting findings in the attentional capture literature; the underlying neural mechanism is discussed. 2009 The Psychonomic Society, Inc.     

汉语普通话声调感知的老年化效应：来自ERP的证据

研究考察汉语普通话老年人前注意阶段声调感知状况, 探究是否存在领域特殊的老年化。运用事件相关电位技术, 采用被动oddball范式诱发MMN回应, 控制领域一般性因素的影响。结果显示涉及范畴变化的声调和非语音音调诱发MMN强度衰减, 不涉及范畴变化的声调诱发MMN强度未衰退。研究结果表明在前注意阶段, 在特定汉语普通话声调范畴知识加工能力上存在领域特殊的衰退, 而不涉及母语音位知识的声调的感知存在领域特殊的一定程度的保留, 这一保留与时间维度上补偿机制的调用有关。受补偿机制调节, 语言加工呈现出衰退或保留等不同的老年化进程。     

An ERP study of inhibition of non-target languages in trilingual word production

The present study examined the locus where inhibition of non-target languages is exerted during trilingual word production by analyzing the cue-locked and stimulus-locked ERPs respectively in the n-2 language repetition paradigm. During the experiment, Uighur–Chinese–English trilinguals overtly named Arabic digits in one of their three languages according to a visually presented cue while their behavioral and electrophysiological responses were recorded. The behavioral data revealed insignificant n-2 repetition costs. Cue-locked ERPs revealed also only tiny or marginally significant n-2 repetition effects over some midline electrodes. The stimulus-locked ERP data showed a more negative ERP component elicited by the n-2 repetition trials than the n-2 non-repetition trials around 250 ms after stimulus onset, but no significant difference in this ERP effect between different languages was found. The results indicate that inhibition of non-target languages occurs at the lemma selection phase rather than the language task schemas phase during trilingual language production.     

Age differences in response selection for pure and mixed stimulus-response mappings and tasks

Two experiments examined effects of mixed stimulus-response mappings and tasks for older and younger adults. In Experiment 1, participants performed two-choice spatial reaction tasks with blocks of pure and mixed compatible and incompatible mappings. In Experiment 2, a compatible or incompatible mapping was mixed with a Simon task for which the mapping of stimulus color to location was relevant and stimulus location was irrelevant. In both experiments, older adults showed larger mixing costs than younger adults and larger compatibility effects, with the differences particularly pronounced in Experiment 1 when location mappings were mixed. In mixed conditions, when stimulus location was relevant, older adults benefited more than younger adults from complete repetition of the task and stimulus from the preceding trial. When stimulus location was irrelevant, the benefit of complete repetition did not differ reliably between age groups. The results suggest that the age-related deficit associated with mixing mappings and tasks is primarily due to older adults having more difficulty separating task sets that activate conflicting response codes.     

Processing linguistic and perceptual dimensions of speech: interactions in speeded classification.

Performance on selective-attention and divided-attention tasks shows strong and consistent interactions when participants rapidly classify auditory stimuli whose linguistic and perceptual dimensions (the words low vs. high, low and high pitch, low and high position in space) share common labels. Compared with baseline performance, response times were greater when one or two irrelevant dimensions varied (Garner interference) and when combinations of attributes were incongruent rather than congruent (congruence effects). Performance depended only on the congruence relationships between the relevant dimension and each of the irrelevant dimensions and not on the congruence relationships between the irrelevant dimensions themselves. In selective attention, an additive multidimensional model accounts well for the patterns of both Garner interference and congruence effects.     

Emotional face prediction in rejection sensitive individuals: Evidence from event-related potentials

Human beings live in an uncertain world, but they continuously generate top-down predictions about emotional face information of other people around them. Although the prediction processing has repeatedly been investigated in the literature of prediction, little is known about the impact of rejection sensitive (RS) on individuals’ emotional face prediction. To this end, high and low RS participants were asked to perform an identification task of emotional faces in which target faces were shown in either an angry or happy expression while their brain responses were recorded using an event-related potential (ERP) technique. The behavioral results suggested an effect of emotional face prediction. For the P100 component, low RS participants showed longer P100 peak latencies in the left than right hemisphere when they viewed predictable emotional faces. In addition, low RS participants showed larger N170 mean amplitudes for angry compared to happy faces when they perceived unpredictable faces, but not when these faces were predictable. This presumably reflected a sensibility to angry faces in the unpredictable trails. Interestingly, high RS participants did not demonstrate such a N170 difference, suggesting that high RS participants showed a reduced sensitivity to unpredictable angry faces. Furthermore, angry faces triggered increased LPP mean amplitudes compared to happy faces, which was consistent with the results of other ERP studies examining the processing of emotional faces. Finally, we observed significant negative correlations between behavioral and ERP prediction effect, indicating one consistency between the behavioral and electrophysiological data.     

Effects of visual attentional load on low-level auditory scene analysis

The sharing of processing resources between the senses was investigated by examining the effects of visual task load on auditory event-related brain potentials (ERPs). In Experiment 1, participants completed both a zero-back and a one-back visual task while a tone pattern or a harmonic series was presented. N1 and P2 waves were modulated by visual task difficulty, but neither mismatch negativity (MMN) elicited by deviant stimuli from the tone pattern nor object-related negativity (ORN) elicited by mistuning from the harmonic series was affected. In Experiment 2, participants responded to identity (what) or location (where) in vision, while ignoring sounds alternating in either pitch (what) or location (where). Auditory ERP modulations were consistent with task difficulty, rather than with task specificity. In Experiment 3, we investigated auditory ERP generation under conditions of no visual task. The results are discussed with respect to a distinction between process-general (N1 and P2) and processspecific (MMN and ORN) auditory ERPs.     

Automatic influence of arousal information on evaluative processing: Valence–arousal interactions in an affective Simon task

Previous research showed that evaluation speed is faster for negative stimuli that are high in arousal and for positive stimuli that are low in arousal. The present study investigated whether arousal and valence analogously interact in automatic stimulus evaluations, i.e., if stimulus valence is irrelevant for the task. One sample of participants switched randomly between an evaluation task and an affective Simon task that assessed stimulus evaluations indirectly. Another sample completed a pure Simon task. In all conditions, the influence of affective stimuli on task performance was enhanced when valence and arousal were congruent (i.e., high-arousing negative and low-arousing positive stimuli) than when both stimulus dimensions were incongruent (i.e., low-arousing negative and high-arousing positive stimuli). These findings suggest that evaluative implications of stimulus arousal and valence are automatically inferred even when stimulus evaluation is irrelevant for the task at hand.