Intentional attention switching in dichotic listening: Exploring the efficiency of nonspatial and spatial selection

Using an auditory variant of task switching, we examined the ability to intentionally switch attention in a dichotic-listening task. In our study, participants responded selectively to one of two simultaneously presented auditory number words (spoken by a female and a male, one for each ear) by categorizing its numerical magnitude. The mapping of gender (female vs. male) and ear (left vs. right) was unpredictable. The to-be-attended feature for gender or ear, respectively, was indicated by a visual selection cue prior to auditory stimulus onset. In Experiment 1, explicitly cued switches of the relevant feature dimension (e.g., from gender to ear) and switches of the relevant feature within a dimension (e.g., from male to female) occurred in an unpredictable manner. We found large performance costs when the relevant feature switched, but switches of the relevant feature dimension incurred only small additional costs. The feature-switch costs were larger in ear-relevant than in gender-relevant trials. In Experiment 2, we replicated these findings using a simplified design (i.e., only within-dimension switches with blocked dimensions). In Experiment 3, we examined preparation effects by manipulating the cueing interval and found a preparation benefit only when ear was cued. Together, our data suggest that the large part of attentional switch costs arises from reconfiguration at the level of relevant auditory features (e.g., left vs. right) rather than feature dimensions (ear vs. gender). Additionally, our findings suggest that ear-based target selection benefits more from preparation time (i.e., time to direct attention to one ear) than gender-based target selection.     

Attentional orienting across the sensory modalities

This event-related potential study investigated (i) to what extent incongruence between attention-directing cue and cued target modality affects attentional control processes that bias the system in advance to favor a particular stimulus modality and (ii) to what extent top-down attentional control mechanisms are generalized for the type of information that is to be attended. To this end, both visual and auditory word cues were used to instruct participants to direct attention to a specific visual (color) or auditory (pitch) stimulus feature of a forthcoming multisensory target stimulus. Effects of cue congruency were observed within 200 ms post-cue over frontal scalp regions and related to processes involved in shifting attention from the cue modality to the modality of the task-relevant target feature. Both directing visual attention and directing auditory attention were associated with dorsal posterior positivity, followed by sustained fronto-central negativity. However, this fronto-central negativity appeared to have an earlier onset and was more pronounced when the visual modality was cued. Together the present results suggest that the mechanisms involved in deploying attention are to some extent determined by the modality (visual, auditory) in which attention operates, and in addition, that some of these mechanisms can also be affected by cue congruency.     

The role of crossmodal competition and dimensional overlap in crossmodal attention switching

Crossmodal selective attention was investigated in a cued task switching paradigm using bimodal visual and auditory stimulation. A cue indicated the imperative modality. Three levels of spatial S–R associations were established following perceptual (location), structural (numerical), and conceptual (verbal) set-level compatibility. In Experiment 1, participants switched attention between the auditory and visual modality either with a spatial-location or spatial-numerical stimulus set. In the spatial-location set, participants performed a localization judgment on left vs. right presented stimuli, whereas the spatial-numerical set required a magnitude judgment about a visually or auditorily presented number word. Single-modality blocks with unimodal stimuli were included as a control condition. In Experiment 2, the spatial-numerical stimulus set was replaced by a spatial-verbal stimulus set using direction words (e.g., “left”). RT data showed modality switch costs, which were asymmetric across modalities in the spatial-numerical and spatial-verbal stimulus set (i.e., larger for auditory than for visual stimuli), and congruency effects, which were asymmetric primarily in the spatial-location stimulus set (i.e., larger for auditory than for visual stimuli). This pattern of effects suggests task-dependent visual dominance.     

Cueing task goals and earning money: Relatively high monetary rewards reduce failures to act on goals in a Stroop task

We examined the role of monetary rewards in failures to act on goals in a Stroop task. Based on recent developments in theorizing on the interplay between rewards and cognitive control, we hypothesized that relatively high monetary rewards enhance the focus and stability of a cued task goal compared to low monetary rewards, and hence cause a reduction in failures to act on current task goals under circumstances that warrant top–down goal implementation. To test this, participants received a modified version of the Stroop task, in which they were either briefly cued with the goal of naming the color or meaning of targets on a trial-by-trial basis. After goal cuing, but before presenting the target, either a low or high reward cue was presented. Results showed that higher rewards produced a general speed-up. More importantly, Stroop interference on error rates was lower in the high reward condition compared to the low reward condition, revealing that the rewards enhanced focus and stability of the cued goal. These results provide support for theorizing that reward processing modulates utility assessment of current goals by affecting attention to facilitate goal-directed behavior.     

Sequential effects in rudimentary auditory and visual tasks

Three experiments examined sequential effects in choice reaction time tasks. On each trial, a right/left positional judgment was made to a either a pure tone or a luminance increment in a visual array of box elements. In the first two experiments, a preparatory signal was presented prior to each imperative signal to indicate the relevant stimulus modality. At a short stimulus onset asynchrony (SOA) between the preparatory and the imperative signal (i.e., 60 msec), subjects were quicker to repeat the same response than to change their response when presented with successive tones, although no such repetition effect occurred on the visual target trials. Subjects were impaired if the stimulus modality changed across successive trials regardless of the modality of the target. At a longer SOA (i.e., 500 msec), these sequential effects were abolished; subjects were assumed to be able to prepare for the relevant modality because of the presentation of the preparatory signal. When the preparatory signals were omitted, in a final experiment, the modality-switching costs were still evident, but now inhibition of return occurred on both the auditory and the visual target trials-subjects were now impaired in responding when the target reappeared at its immediately previous location. It seems, therefore, that the repetition effect and modality-switching effects do dissociate. The data revealed clear differences between orienting attention to a particular spatial locale and focusing attention to a particular sensory modality.     

On measuring selective attention to an expected sensory modality

Perceptual judgments can be affected by expectancies regarding the likely target modality. This has been taken as evidence for selective attention to particular modalities, but alternative accounts remain possible in terms of response priming, criterion shifts, stimulus repetition, and spatial confounds. We examined whether attention to a sensory modality would still be apparent when these alternatives were ruled out. Subjects made a speeded detection response (Experiment 1), an intensity or color discrimination (Experiment 2), or a spatial discrimination response (Experiments 3 and 4) for auditory and visual targets presented in a random sequence. On each trial, a symbolic visual cue predicted the likely target modality. Responses were always more rapid and accurate for targets presented in the expected versus unexpected modality, implying that people can indeed selectively attend to the auditory or visual modalities. When subjects were cued to both the probable modality of a target and its likely spatial location (Experiment 4), separable modality-cuing and spatial-cuing effects were observed. These studies introduce appropriate methods for distinguishing attention to a modality from the confounding factors that have plagued previous normal and clinical research.     

Selective attention to the chemosensory modality

Previous studies have shown that behavioral responses to auditory, visual, and tactile stimuli are modulated by expectancies regarding the likely modality of an upcoming stimulus (see Spence & Driver, 1997). In the present study, we investigated whether people can also selectively attend to the chemosensory modality (involving responses to olfactory, chemical, and painful stimuli). Participants made speeded spatial discrimination responses (left vs. right) to an unpredictable sequence of odor and tactile targets. Odor stimuli were presented to either the left or the right nostril, embedded in a birhinally applied constant airstream. Tactile stimuli were presented to the left or the right hand. On each trial, a symbolic visual cue predicted the likely modality for the upcoming target (the cue was a valid predictor of the target modality on the majority of trials). Response latencies were faster when targets were presented in the expected modality than when they were presented in the unexpected modality, showing for the first time that behavioral responses to chemosensory stimuli can be modulated by selective attention.     

Attention to auditory and peripheral visual stimuli: effects of arousal and predictability

Changes in the distribution of attention among auditory and peripheral visual stimuli were examined in a choice reaction time paradigm. Two variables were manipulated: predictability of stimulus locations and arousal state of subjects. The arousal level of some subjects was raised by occasionally exposing them to brief, mild electric shocks. On most trials either a tone or a light was presented alone (single-stimulus trials). However, on 20% of the trials both a tone and light were presented simultaneously (dual trials). Two dependent variables were used to assess dominance of attention: reaction time (on all trials) and percentage of time each modality was chosen on dual trials. Neither modality was dominant when subjects were in a nonaroused state and stimulus locations were unpredictable. However, peripheral vision dominated when stimulus locations were predictable or when the subjects' level of arousal was raised. The results are discussed with reference to previous research on sensory dominance and on the facilitating or inhibiting effects of auditory stimuli on reaction time.     

Reward speeds up and increases consistency of visual selective attention: a lifespan comparison

Children and older adults often show less favorable reward-based learning and decision making, relative to younger adults. It is unknown, however, whether reward-based processes that influence relatively early perceptual and attentional processes show similar lifespan differences. In this study, we investigated whether stimulus–reward associations affect selective visual attention differently across the human lifespan. Children, adolescents, younger adults, and older adults performed a visual search task in which the target colors were associated with either high or low monetary rewards. We discovered that high reward value speeded up response times across all four age groups, indicating that reward modulates attentional selection across the lifespan. This speed-up in response time was largest in younger adults, relative to the other three age groups. Furthermore, only younger adults benefited from high reward value in increasing response consistency (i.e., reduction of trial-by-trial reaction time variability). Our findings suggest that reward-based modulations of relatively early and implicit perceptual and attentional processes are operative across the lifespan, and the effects appear to be greater in adulthood. The age-specific effect of reward on reducing intraindividual response variability in younger adults likely reflects mechanisms underlying the development and aging of reward processing, such as lifespan age differences in the efficacy of dopaminergic modulation. Overall, the present results indicate that reward shapes visual perception across different age groups by biasing attention to motivationally salient events.     

Evidence for the automatic processing of prelexical codes in an orthographic but not a phonological task

The automatic activation of phonological and orthographic information in auditory and visual word processing was examined using a task-set procedure. Participants engaged in a phonological task (i.e., determining whether the letter “a” in a word sounded like /e/ or /æ/) or an orthographic task (i.e., determining whether the sound /s/ in a word was spelled with an “s” or a “c”). Participants were cued regarding which task to perform simultaneously with, or 750 ms before, a clear or degraded target. The stimulus clarity effect (i.e., clear words responded to faster than degraded words) was absorbed into the time that it took participants to identify the task on the basis of the cue in a simultaneous cue–target as compared to a delayed cue–target condition, but only for the orthographic task. These data are consistent with the claim that prelexical processing occurs in a capacity-free manner upon stimulus presentation when participants are trying to extract orthographic codes from words presented in the visual and auditory modalities. Such affirmative data were not obtained when participants attempted to extract phonological codes from words, since here the effects of stimulus clarity and cue delay were additive.     

The interaction between emotion and executive control: Comparison between visual,auditory, and tactile modalities

The reciprocal connections between emotion and attention are vital for adaptive behaviour. Previous results demonstrated that the behavioural effects of emotional stimuli on performance are attenuated when executive control is recruited. The current research studied whether this attenuation is modality dependent. In two experiments, negative and neutral pictures were presented shortly before a visual, tactile, or auditory target in a Simon task. All three modalities demonstrated a Simon effect, a conflict adaptation effect, and an emotional interference effect. However, the interaction between picture valence and Simon congruency was found only in the visual task. Specifically, when the Simon target was visual, emotional interference was reduced during incongruent compared to congruent trials. These findings suggest that although the control-related effects observed in the Simon tasks are not modality dependent, the link between emotion and executive control is modality dependent. Presumably, this link occurs only when the emotional stimulus and the target are presented in the same modality.     

双通道分配性注意对视听觉返回抑制的影响

本研究基于线索-靶子范式, 操纵目标刺激类型(视觉、听觉、视听觉)与线索有效性(有效线索、中性条件、无效线索)两个自变量, 通过3个实验来考察双通道分配性注意对视听觉返回抑制(inhibition of return, IOR)的影响。实验1 (听觉刺激呈现在左/右侧)结果发现, 在双通道分配性注意条件下, 视觉目标产生显著IOR效应, 而视听觉目标没有产生IOR效应; 实验2 (听觉刺激呈现在左/右侧)与实验3 (听觉刺激呈现在中央)结果发现, 在视觉通道选择性注意条件下, 视觉与视听觉目标均产生显著IOR效应但二者无显著差异。结果表明：双通道分配性注意减弱视听觉IOR效应。     

Local and global effects of motivation on cognitive control

Motivation has been found to enhance cognitive control, but the mechanisms by which this occurs are still poorly understood. Cued motivational incentives (e.g., monetary rewards) can modulate cognitive processing locally??that is, on a trial-by-trial basis (incentive cue effect). Recently, motivational incentives have also been found to produce more global and tonic changes in performance, as evidenced by performance benefits on nonincentive trials occurring within incentive blocks (incentive context effect). In two experiments involving incentivized cued task switching, we provide systematic evidence that the two effects are dissociable. Through behavioral, diffusion-modeling, and individual-differences analyses, we found dissociations between local and global motivational effects that were linked to specific properties of the incentive signals (i.e., timing), while also ruling out alternative interpretations (e.g., practice and speed??accuracy trade-off effects). These results provide important clues regarding the neural mechanisms by which motivation exerts both global and local influences on cognitive control.     

Head-centred meridian effect on auditory spatial attention orienting

Six experiments examined the issue of whether one single system or separate systems underlie visual and auditory orienting of spatial attention. When auditory targets were used, reaction times were slower on trials in which cued and target locations were at opposite sides of the vertical head-centred meridian than on trials in which cued and target locations were at opposite sides of the vertical visual meridian or were not separated by any meridian. The head-centred meridian effect for auditory stimuli was apparent when targets were cued by either visual (Experiments 2, 3, and 6) or auditory cues (Experiment 5). Also, the head-centred meridian effect was found when targets were delivered either through headphones (Experiments 2, 3, and 5) or external loudspeakers (Experiment 6). Conversely, participants showed a visual meridian effect when they were required to respond to visual targets (Experiment 4). These results strongly suggest that auditory and visual spatial attention systems are indeed separate, as far as endogenous orienting is concerned.     

Crossmodal attention switching: Auditory dominance in temporal discrimination tasks

Visual stimuli are often processed more efficiently than accompanying stimuli in another modality. In line with this “visual dominance”, earlier studies on attentional switching showed a clear benefit for visual stimuli in a bimodal visual–auditory modality-switch paradigm that required spatial stimulus localization in the relevant modality. The present study aimed to examine the generality of this visual dominance effect. The modality appropriateness hypothesis proposes that stimuli in different modalities are differentially effectively processed depending on the task dimension, so that processing of visual stimuli is favored in the dimension of space, whereas processing auditory stimuli is favored in the dimension of time. In the present study, we examined this proposition by using a temporal duration judgment in a bimodal visual–auditory switching paradigm. Two experiments demonstrated that crossmodal interference (i.e., temporal stimulus congruence) was larger for visual stimuli than for auditory stimuli, suggesting auditory dominance when performing temporal judgment tasks. However, attention switch costs were larger for the auditory modality than for visual modality, indicating a dissociation of the mechanisms underlying crossmodal competition in stimulus processing and modality-specific biasing of attentional set.     

试次历史对跨通道非空间返回抑制的影响

个体对刺激的反应不仅受刺激本身的影响, 还会受到先前刺激的影响, 表现为对当前试次中刺激的反应会受到前一试次的影响, 即试次历史。本研究采用“线索-中性线索-靶子”范式探讨前一试次有效性对跨通道的非空间返回抑制的影响。实验1通过连续两个试次间的线索有效性考察在跨通道非空间返回抑制中试次历史的影响。为了在跨通道非空间返回抑制中减小试次历史的影响, 实验2通过延长试次间时间间隔考察跨通道非空间返回抑制中试次历史的作用是否减小。结果发现, 前一试次线索无效时, 当前试次中的返回抑制效应量显著小于前一试次有效时, 这种影响会根据试次中线索和靶子通道的不同而不同。并且当延长试次间的时间间隔可以有效地减少前一试次对当前试次的影响。因此本研究表明, 试次历史能够对跨通道非空间返回抑制产生影响, 并且这种影响可以通过增大试次间时间间隔来减小。     

Utilization of reward-prospect enhances preparatory attention and reduces stimulus conflict

The prospect of gaining money is an incentive widely at play in the real world. Such monetary motivation might have particularly strong influence when the cognitive system is challenged, such as when needing to process conflicting stimulus inputs. Here, we employed manipulations of reward-prospect and attentional-preparation levels in a cued-Stroop stimulus conflict task, along with the high temporal resolution of electrical brain recordings, to provide insight into the mechanisms by which reward-prospect and attention interact and modulate cognitive task performance. In this task, the cue indicated whether or not the participant needed to prepare for an upcoming Stroop stimulus and, if so, whether there was the potential for monetary reward (dependent on performance on that trial). Both cued attention and cued reward-prospect enhanced preparatory neural activity, as reflected by increases in the hallmark attention-related negative-polarity ERP slow wave (contingent negative variation [CNV]) and reductions in oscillatory Alpha activity, which was followed by enhanced processing of the subsequent Stroop stimulus. In addition, similar modulations of preparatory neural activity (larger CNVs and reduced Alpha) predicted shorter versus longer response times (RTs) to the subsequent target stimulus, consistent with such modulations reflecting trial-to-trial variations in attention. Particularly striking were the individual differences in the utilization of reward-prospect information. In particular, the size of the reward effects on the preparatory neural activity correlated across participants with the degree to which reward-prospect both facilitated overall task performance (shorter RTs) and reduced conflict-related behavioral interference. Thus, the prospect of reward appears to recruit attentional preparation circuits to enhance processing of task-relevant target information.     

Preference for unpredictable food rewards occurs with high proportion of reinforced trials or alcohol if rewards are not delayed

Organisms typically prefer situations where reward and nonreward are predictable rather than unpredictable. Although many theories can account for this result (e.g., information theory and delay-reduction theory), a recently developed mathematical model (DMOD) also predicts that subjects prefer the unpredictable reward situation under conditions that substantially decrease aversiveness of unpredictable nonreward (Daly & Daly, 1982). Because a high proportion of reinforced trials (lenient schedule) and alcohol injections decrease aversive conditioning, these variables were tested with rats in five E-maze experiments. A choice to one side of the maze resulted in a stimulus uncorrelated with reward outcome (unpredictable situation). A choice to the other side resulted in stimuli correlated with reward and nonreward (predictable situation). The stimuli were not visible until after the choice was made. A lenient reinforcement schedule resulted in preference for the unpredictable reward situation if rewards were not delayed. Alcohol resulted in preference for the unpredictable reward situation if a medium five-pellet reward was given. A lenient reinforcement schedule combined with an alcohol injection resulted in faster acquisition of the preference for the unpredictable reward situation than did a lenient schedule combined with a saline control injection. These results pose a major challenge to most theories, yet were predicted by DMOD.     

When cross-modal spatial attention fails

There is now convincing evidence that an involuntary shift of spatial attention to a stimulus in one modality can affect the processing of stimuli in other modalities, but inconsistent findings across different paradigms have led to controversy. Such inconsistencies have important implications for theories of cross-modal attention. The authors investigated why orienting attention to a visual event sometimes influences responses to subsequent sounds and why it sometimes fails to do so. They examined visual-cue-on-auditory-target effects in two paradigms--implicit spatial discrimination (ISD) and orthogonal cuing (OC)--that have yielded conflicting findings in the past. Consistent with previous research, visual cues facilitated responses to same-side auditory targets in the ISD paradigm but not in the OC paradigm. Furthermore, in the ISD paradigm, visual cues facilitated responses to auditory targets only when the targets were presented directly at the cued location, not when they appeared above or below the cued location. This pattern of results confirms recent claims that visual cues fail to influence responses to auditory targets in the OC paradigm because the targets fall outside the focus of attention. (PsycINFO Database Record (c) 2008 APA, all rights reserved).     

Audition dominates vision in duration perception irrespective of salience,attention, and temporal discriminability

Whereas the visual modality tends to dominate over the auditory modality in bimodal spatial perception, the auditory modality tends to dominate over the visual modality in bimodal temporal perception. Recent results suggest that the visual modality dominates bimodal spatial perception because spatial discriminability is typically greater for the visual than for the auditory modality; accordingly, visual dominance is eliminated or reversed when visual-spatial discriminability is reduced by degrading visual stimuli to be equivalent or inferior to auditory spatial discriminability. Thus, for spatial perception, the modality that provides greater discriminability dominates. Here, we ask whether auditory dominance in duration perception is similarly explained by factors that influence the relative quality of auditory and visual signals. In contrast to the spatial results, the auditory modality dominated over the visual modality in bimodal duration perception even when the auditory signal was clearly weaker, when the auditory signal was ignored (i.e., the visual signal was selectively attended), and when the temporal discriminability was equivalent for the auditory and visual signals. Thus, unlike spatial perception, where the modality carrying more discriminable signals dominates, duration perception seems to be mandatorily linked to auditory processing under most circumstances.