Interference in visual perception by verbal and spatial cognitive activity

In two experiments we tested the hypothesis that cognitive processing based on spatial imagery produces more deterioration of visual perception than cognitive processing based on verbal codes. So, we studied the effect on visual perception of two cognitive tasks, one of spatial imagery and the other a verbal task. In the first one, with 30 participants, we analyzed the mental load and ocular behaviors in both cognitive tasks. In the second experiment, with 29 participants, we studied the effect of both tasks on a visual search task, using a dual-task experimental paradigm. The verbal task presented higher mental load than the imagery task when both tasks were carried out with visual search task, and there was more deterioration in stimulus detection with the verbal task. We can conclude that: (1) cognitive tasks produce important deterioration in the capacities of visual search and identification of stimuli; (2) this deterioration has two components: (a) an inefficient search, associated with alterations of the gaze patterns while performing cognitive tasks, and (b) a general interference, nonspecific to spatial codes, in the process of identification of looked-at stimuli; (3) this cognitive interference is related to the mental load or effort required by the cognitive task.     

Assessing the automaticity of the exogenous orienting of tactile attention

We examined whether or not abrupt tactile onsets are capable of exogenously capturing tactile spatial attention when visual spatial attention is focused elsewhere. In experiment 1, we compared performance under dual-task conditions (where participants performed a tactile exogenous cuing task and a rapid serial visual presentation--RSVP--task at the same time) with their performance under single-task conditions (where the participants had to perform only the cuing task, although the RSVP stream was still presented in the background) and to a no-stream condition (where only the cuing task was presented). Tactile cuing was completely suppressed in both the dual-task and single-task conditions, showing that exogenous tactile spatial orienting is modulated by visual-spatial attention, which hence appears to be far from truly automatic. In experiment 2, we demonstrated that the abolishment of exogenous tactile orienting was not caused by the transient presentation of abrupt onset stimuli (letters). These results therefore show that exogenous spatial attentional orienting toward abrupt peripheral tactile stimuli is possible as long as perceptual resources are not depleted by a perceptually demanding (RSVP) task.     

Speech shadowing while driving: on the difficulty of splitting attention between eye and ear

Abstract - We investigated the role of cross-modal links in spatial attention in modulating the efficiency of dual-task performance. The difficulty of combining speech shadowing with a simulated driving task was modulated by the spatial location from which the speech was presented. In both single- and dual-task conditions, participants found it significantly easier to shadow one of two auditory streams when the relevant speech was presented from directly in front of them, rather than from the side. This frontal speech advantage was more pronounced when participants performed the demanding simulated driving task at the same time as shadowing than when they performed the shadowing task alone. These results demonstrate that people process auditory information more efficiently (with a lower overall dual-task decrement) when relevant auditory and visual stimuli are presented from the same, rather than different, spatial locations. These results are related to recent findings showing that there are extensive cross-modal links in spatial attention, and have clear implications for the design of better user interfaces.     

习得性空间联结的迁移依赖于语义工作记忆

采用练习迁移范式与双任务范式相结合的设计来探讨练习所习得的空间联结在工作记忆中如何表征。被试先进行不一致空间的刺激—反应映射练习任务, 五分钟后, 随机迁移到单任务(Simon任务)或者双任务(Simon任务+语义工作记忆负荷任务或空间工作记忆负荷任务)。结果发现：不一致的练习能使单任务出现反转的Simon效应, 但语义工作记忆负荷会使反转的Simon效应消失, 而空间工作记忆负荷却对反转的Simon效应没有影响。实验结果表明练习产生的空间联结依赖于语义工作记忆。     

Covert shifts of attention can account for the functional role of “eye movements to nothing”

When trying to remember verbal information from memory, people look at spatial locations that have been associated with visual stimuli during encoding, even when the visual stimuli are no longer present. It has been shown that such “eye movements to nothing” can influence retrieval performance for verbal information, but the mechanism underlying this functional relationship is unclear. More precisely, covert in comparison to overt shifts of attention could be sufficient to elicit the observed differences in retrieval performance. To test if covert shifts of attention explain the functional role of the looking-at-nothing phenomenon, we asked participants to remember verbal information that had been associated with a spatial location during an encoding phase. Additionally, during the retrieval phase, all participants solved an unrelated visual tracking task that appeared in either an associated (congruent) or an incongruent spatial location. Half the participants were instructed to look at the tracking task, half to shift their attention covertly (while keeping the eyes fixed). In two experiments, we found that memory retrieval depended on the location to which participants shifted their attention covertly. Thus, covert shifts of attention seem to be sufficient to cause differences in retrieval performance. The results extend the literature on the relationship between visuospatial attention, eye movements, and verbal memory retrieval and provide deep insights into the nature of the looking-at-nothing phenomenon.     

Task-set inertia and memory-consolidation bottleneck in dual tasks

Three dual-task experiments examined the influence of processing a briefly presented visual object for deferred verbal report on performance in an unrelated auditory-manual reaction time (RT) task. RT was increased at short stimulus-onset asynchronies (SOAs) relative to long SOAs, showing that memory consolidation processes can produce a functional processing bottleneck in dual-task performance. In addition, the experiments manipulated the spatial compatibility of the orientation of the visual object and the side of the speeded manual response. This cross-task compatibility produced relative RT benefits only when the instruction for the visual task emphasized overlap at the level of response codes across the task sets (Experiment 1). However, once the effective task set was in place, it continued to produce cross-task compatibility effects even in single-task situations (“ignore” trials in Experiment 2) and when instructions for the visual task did not explicitly require spatial coding of object orientation (Experiment 3). Taken together, the data suggest a considerable degree of task-set inertia in dual-task performance, which is also reinforced by finding costs of switching task sequences (e.g., AC → BC vs. BC → BC) in Experiment 3.     

Orthogonal cross-task compatibility: Abstract spatial coding in dual tasks

Spatially orthogonal stimulus and response sets can produce compatibility effects. To explore whether such effects cross the border of logically independent tasks, we combined a nonspeeded visual task requiring verbal report of a stimulus movement (up vs. down) with an auditory reaction time task that required a unimanual movement to the left or right. Two experiments demonstrated that up stimuli facilitate rightward responses and down stimuli facilitate leftward responses, relative to the opposite combinations, thus producing an orthogonal cross-task compatibility effect. This effect presumably arises from abstract coding with respect to the salient referents of a spatial dimension (i.e., up and right), so that coactivation of structurally similar codes leads to mutual priming even when the codes refer to different tasks. The present evidence for abstract spatial coding extends previously proposed coding principles from single-task settings to dual-task settings.     

Concurrent performance of two memory tasks: evidence for domain-specific working memory systems

Previous studies of dual-task coordination in working memory have shown a lack of dual-task interference when a verbal memory task is combined with concurrent perceptuomotor tracking. Two experiments are reported in which participants were required to perform pairwise combinations of (1) a verbal memory task, a visual memory task, and perceptuomotor tracking (Experiment 1), and (2) pairwise combinations of the two memory tasks and articulatory suppression (Experiment 2). Tracking resulted in no disruption of the verbal memory preload over and above the impact of a delay in recall and showed only minimal disruption of the retention of the visual memory load. Performing an ongoing verbal memory task had virtually no impact on retention of a visual memory preload or vice versa, indicating that performing two demanding memory tasks results in little mutual interference. Experiment 2 also showed minimal disruption when the two memory tasks were combined, although verbal memory (but not visual memory) was clearly disrupted by articulatory suppression interpolated between presentation and recall. These data suggest that a multiple-component working memory model provides a better account for performance in concurrent immediate memory tasks than do theories that assume a single processing and storage system or a limited-capacity attentional system coupled with activated memory traces.     

Response preparation and code overlap in dual tasks

In a dual-task paradigm, a visual-encoding task with a deferred verbal report of a moving target was combined with a speeded task, in which participants prepared a precued leftward or rightward key-press response that was withheld until an auditory go signal. We manipulated the interval between the response cue and the target for the visual-encoding task, the interval between this target and the go signal, and spatial cross-task compatibility between the direction of the target movement in the visual task and the speeded manual response. The results of two experiments suggest that visual encoding interferes with response preparation and with the initiation of the prepared manual response at a short target-go interval. Also, responses were faster in compatible than in incompatible trials, indicating a cross-task compatibility effect. Experiment 2 reversed this compatibility effect by instruction, suggesting that the compatibility effect is based on response-response overlap. In both experiments, response preparation impaired accuracy in the visual task. Taken together, these results suggest that response processes and visual encoding share common codes and processes.     

The Role of Memory in the Tower of London Task

The Tower of London (TOL) task is widely used as a neuropsychological test of planning. Relatively little is known of the cognitive components of the task, and in particular the role of memory in performance. The current studies on normal adults looked at the role of verbal and spatial working memory in the TOL. The effects of verbal and visuospatial dual-task manipulations on TOL performance were examined in an experiment with 36 participants. Both verbal and visuospatial executive secondary tasks caused poorer performance on the TOL; however, concurrent articulatory suppression enhanced performance. The results suggest that executive and spatial components are important in the task, and raise questions about the role of preplanning in the TOL.     

The role of memory in the Tower of London task

The Tower of London (TOL) task is widely used as a neuropsychological test of planning. Relatively little is known of the cognitive components of the task, and in particular the role of memory in performance. The current studies on normal adults looked at the role of verbal and spatial working memory in the TOL. The effects of verbal and visuospatial dual-task manipulations on TOL performance were examined in an experiment with 36 participants. Both verbal and visuospatial executive secondary tasks caused poorer performance on the TOL; however, concurrent articulatory suppression enhanced performance. The results suggest that executive and spatial components are important in the task, and raise questions about the role of preplanning in the TOL.     

ERP evidence of early cross-modal links between auditory selective attention and visuo-spatial memory

Previous dual-task research pairing complex visual tasks involving non-spatial cognitive processes during dichotic listening have shown effects on the late component (Ndl) of the negative difference selective attention waveform but no effects on the early (Nde) response suggesting that the Ndl, but not the Nde, is affected by non-spatial processing in a dual-task. Thus to further explore the nature of this dissociation and whether the Nd waveform is affected by spatial processing; fourteen adult participants performed auditory dichotic listening in conjunction with visuo-spatial memory in a cross-modal dual-task paradigm. The results showed that the visuo-spatial memory task decreased both the Nde and Ndl waveforms, and also attenuated P300 and increased its latency. This pattern of results suggests that: (1) the Nde reflects a memory trace that is shared with vision when the information is spatial in nature, and (2) P300 latency appears to be influenced by the discriminability of stimuli underlying the Nde and Ndl memory trace.     

Dividing attention within and between hemispheres: testing a multiple resources approach to limited-capacity information processing

Two experiments tested the limiting case of a multiple resources approach to resource allocation in information processing. In this framework, the left and right hemispheres are assumed to have separate, limited-capacity pools of undifferentiated resources that are not mutually accessible, so that tasks can overlap in their demand for these resources either completely, partially, or not at all. We tested all three degrees of overlap in demand for left hemisphere supplies, using dual-task methodology in which subjects were induced to pay different amounts of attention to each task. Experiment 1 compared complete and partial overlap by combining a verbal memory load with a task in which subjects named nonsense syllables briefly presented to either the left or right visual field (LVF and RVF, respectively). Experiment 2 compared complete versus no overlap by using the same verbal memory load combined with a laterally presented same-different judgment task that did not require a spoken response. Decrements from single-task performance were always more severe when the visual field task stimulus was presented to the RVF. Further, subjects in Experiment 1 were able to trade performance between tasks on both LVF and RVF trials because there was always at least some overlap in left hemisphere demand. In Experiment 2, performance trade-offs were observed on RVF (complete overlap) trials, but not on LVF trials, where no overlap in demand existed. These results contradict a single-capacity model, but they support the idea that the hemispheres' resource supplies are independent and have implications for both cerebral specialization and divided attention issues.     

Susceptibility of spatial and verbal working memory to demands of the central executive

We used a dual-task paradigm to examine the degree to which domain-specific spatial and verbal subsystems depend on the domain-general central executive. Forty participants were asked to retain spatial or verbal information while performing a concurrent secondary task related to simple arithmetic. The secondary tasks consisted of three cognitive processes: single-digit addition, a digit-carrying operation, and digit reading. The single-digit addition and carry operation include central executive functioning, while digit reading relies solely on the phonological loop. The single-digit addition caused a performance decrement on the spatial working memory task, while the digit reading impaired performance on the verbal working memory task. The carry operation interfered with recall accuracy on both working memory tasks. The spatial working memory task was significantly correlated with the verbal working memory task only when the secondary task was more demanding on the central executive. Our results suggest that spatial working memory rather than verbal working memory is susceptible to failure of central executive functioning and that the central executive plays an important role in regulating the cognitive demands of different domains.     

The role of working memory in the association between number magnitude and space

In two experiments, participants performed a magnitude comparison task in single and dual-task conditions. In the dual conditions, the comparison task was accomplished while phonological or visuospatial information had to be maintained for a later recall test. The results showed that the requirement of maintaining visuospatial information produced the lack of spatial-numerical association of response codes (SNARC) effect. The SNARC effect was not found even when the performance in the comparison task did not decline, as indicated by a similar distance effect in all conditions. These results show a special role for the visuospatial component of working memory in the processing of spatial representation of numbers and an interesting dissociation between SNARC and distance effects.     

Remarks of the In-Coming Editor

A digit memory task and a delayed visual aiming task were used in a test of resource capacity theories. These tasks were run either singly, with short- or long-retention intervals, or in pairs. In the dual-task conditions, the short version of one was inserted into the longer version of the other. Delay by itself had no effect on retention, but the dual-task combinations showed asymmetrical interference: Inserting verbal memory into the visual-motor delay had little effect on either task, but inserting the motor task into the verbal retention interval disrupted both. These results thus support neither single nor multiple resource models, but can be explained with reference to component processes in working memory.     

Selective working memory disables inhibition of visual features

Recent research suggests that information held in working memory can facilitate subsequent attentional processing. Here, we explore the negative corollary of this conception: Under which circumstances does information in working memory disrupt subsequent processing? Seventy participants performed visual discriminations in a dual-task paradigm. They were asked to judge colors or shapes in an online attention task under three different working-memory conditions: Same, Switch, or Unknown. In the Same condition, participants selectively maintained one visual feature in working memory, from the same dimension as in the online attention task. In the Switch condition, participants selectively maintained one visual feature in working memory, but had to focus on another visual dimension in the online attention task. In the Unknown condition, participants could not predict which visual feature would be relevant for the working-memory task. We found that irrelevant features in the online attention task were particularly difficult to ignore in the Switch condition, that is, when the irrelevant features belong to a visual dimension that is simultaneously prioritized in selective working memory. The findings are consistent with accounts in terms of neural overlap between working-memory and attention circuits, and suggest that mechanisms of selection, rather than resource limitations, critically determine the extent of visual interference.     

The role of crosstalk in dual-task performance: evidence from manipulating response-code overlap

The present study examined the role of crosstalk in dual-task interference using a combination of a nonspeeded visual task and an auditory-manual reaction time (RT) task. The potential for dual-task crosstalk was introduced by presenting in the visual task objects (e.g., a cup with a handle), which “afford” associated responses that were either spatially compatible or incompatible with the response in the RT task. Crucially, the degree of crosstalk was varied by instructing participants either to attend to the left–right orientation of the objects, creating explicit cross-task response-code overlap (“strong crosstalk”), or to attend to object identity (no direct overlap; “weak crosstalk”). The data indicated a relative benefit for cross-task compatible trials, which was much greater with strong crosstalk than with weak crosstalk. Crucially, however, even on compatible trials dual-task performance was substantially worse with strong crosstalk than with weak crosstalk. This overall cost of crosstalk suggests interference of response codes even on compatible dual-task trials. This work was presented in August 2007 at the XVth Conference of the European Society for Cognitive Psychology (ESCoP) in Marseille, France. The author would like to thank Peter A. Frensch and two anonymous reviewers for helpful comments, Julia Klotz and Marion Marksteiner for testing the participants, and Lynn Huestegge for helpful discussions.     

Relationships between dual-task related changes in stride velocity and stride time variability in healthy older adults

Dual-task related gait changes have been previously reported for healthy older adults, suggesting that gait control requires attention. Compared to balance control, the involvement of attention in the control of the rhythmic stepping mechanism, as reflected by stride time variability, is not well known. In particular, under dual-task, the relative contributions of a second, attention-demanding task and changes in walking speed remain unclear. Thus, the aims of this study were (1) to assess whether walking with a slow-selected speed or walking while performing an attention-demanding task affected stride time variability in a sample of healthy older participants, and (2) to establish whether stride time variability under dual-task conditions is related either to the decrease of walking speed or the simultaneous attention-demanding task, or to both. Forty-five healthy older participants performed four experimental conditions: (1) walking at a normal self-selected speed, (2) walking at a slow self-selected speed, (3) performing a verbal fluency task when sitting on a chair, and (4) performing the verbal fluency task while walking at self-selected walking speed. Gait parameters were recorded across 15 meters, using Physilog. Results showed a significant dual-task related decrease in mean values of stride velocity, as well as a significant increase in mean values and coefficients of variation of stride time. These dual-task related changes in stride time were explained by the simultaneous performance of the verbal fluency task, the decrease of gait speed and the variability between participants. Although a relationship exists between decreased walking speed and increased stride time variability, the dual-task related increase of stride time variability was also significantly associated with the attention-demanding task, suggesting some attentional control for the rhythmic stepping mechanism of walking in healthy older adults.     

Multiple response codes play specific roles in response selection and inhibition under task switching

Several task-switch studies show that response category repetition is favorable on task repetition trials, but disadvantageous on task switch trials. In the present study we investigated how this interaction depends on the type and number of involved response categories. In a dual-task number-categorization experiment, subjects had to respond to tasks T(1) and T(2) with one of the two fingers of their left and right hand, respectively. For one group of participants, the use of spatial response categories, and for another group the use of finger-type categories was induced. It turned out that the interaction between task switching and response category repetition was clearly related to the induced response categories, but at the same time, the spatial categories nevertheless also affected response selection in the finger-type group. However, these two effects were additive. This shows that multiple response codes can simultaneously be involved in response selection, but that they affect performance differentially.