Effects of spatial and selective attention on basic multisensory integration

When participants respond to auditory and visual stimuli, responses to audiovisual stimuli are substantially faster than to unimodal stimuli (redundant signals effect, RSE). In such tasks, the RSE is usually higher than probability summation predicts, suggestive of specific integration mechanisms underlying the RSE. We investigated the role of spatial and selective attention on the RSE in audiovisual redundant signals tasks. In Experiment 1, stimuli were presented either centrally (narrow attentional focus) or at 1 of 3 unpredictable locations (wide focus). The RSE was accurately described by a coactivation model assuming linear superposition of modality-specific activation. Effects of spatial attention were explained by a shift of the evidence criterion. In Experiment 2, stimuli were presented at 3 locations; participants had to respond either to all signals regardless of location (simple response task) or to central stimuli only (selective attention task). The RSE was consistent with task-specific coactivation models; accumulation of evidence, however, differed between the 2 tasks.     

Effects of auditory stimulus intensity on response force in simple, go/no-go, and choice RT tasks

In four experiments, increasing the intensities of both relevant and irrelevant auditory stimuli was found to increase response force (RF) in simple, go/no-go, and choice reaction time (RT) tasks. These results raise problems for models that localize the effects of auditory intensity on purely perceptual processes, indicating instead that intensity also affects motor output processes under many circumstances. In Experiment 1, simple RT, go/no-go, and choice RT tasks were compared, using the same stimuli for all tasks. Auditory stimulus intensity affected both RT and RF, and these effects were not modulated by task. In Experiments 2-4, an irrelevant auditory accessory stimulus accompanied a relevant visual stimulus, and the go/no-go and choice tasks were used. The intensity of the irrelevant auditory accessory stimulus was found to affect RT and RF, although the sizes of these effects depended somewhat on the temporal predictability of the accessory stimulus.     

Divided attention: Evidence for coactivation with redundant signals

Many models of divided attention assume that signals presented on different channels produce separate activations, any one of which can initiate a response. According to these models, detection responses are especially fast when signals are presented on two channels at the same time because the system can detect a signal in either of two ways. Such models predict a testable relation among reaction time distributions for conditions in which a single signal is presented as compared with a condition in which two signals are presented, and this prediction is tested in two tasks. A bimodal detection task required a simple speeded response to either a visual or an auditory signal. A letter search task required a choice response depending on whether or not a two-letter display included the signal letter “A.” Data from both tasks are inconsistent with the prediction. When two signals are presented, responses are faster than separate-activation models can explain. The results favor “coactivation” models, in which signals presented on different channels contribute to a common pool of activation that initiates a response.     

The race that precedes coactivation: development of multisensory facilitation in children

Rationale: The facilitating effect of multisensory integration on motor responses in adults is much larger than predicted by race‐models and is in accordance with the idea of coactivation. However, the development of multisensory facilitation of endogenously driven motor processes and its relationship to the development of complex cognitive skills in school‐age children is largely unexplored. Method: Twenty adults and 95 children where allocated into six age groups: 6, 7, 8, 9, 10–11 and adults. Participants’ motor reaction times (MRTs) and accuracy in response to the detection of auditory, visual and audiovisual stimuli were recorded. Children's reading accuracy and nonverbal IQ were also assessed. Results: In general, MRTs of children were significantly slower with greater variability than those of adults. Although the average level of multisensory facilitation was similar for all age groups, mean cumulative density functions (CDFs) showed that multisensory facilitation in 6 and 10–11‐year‐olds is within the predictive limits of race‐models. Where coactivation was seen in the CDF of individual children it was not as strong or as consistent as that in adults. The degree of multisensory facilitation did not correlate with age, reading accuracy or IQ. Conclusion: The average level of multisensory facilitation to endogenously driven motor responses does not change gradually with age nor is it related to intelligence or reading accuracy. In general, multisensory integration remains immature until 10–11 years of age and lies within the predicted confines of race‐models.     

A model of the go/no-go task

In this article, the first explicit, theory-based comparison of 2-choice and go/no-go variants of 3 experimental tasks is presented. Prior research has questioned whether the underlying core-information processing is different for the 2 variants of a task or whether they differ mostly in response demands. The authors examined 4 different diffusion models for the go/no-go variant of each task along with a standard diffusion model for the 2-choice variant (R. Ratcliff, 1978). The 2-choice and the go/no-go models were fit to data from 4 lexical decision experiments, 1 numerosity discrimination experiment, and 1 recognition memory experiment, each with 2-choice and go/no-go variants. The models that assumed an implicit decision criterion for no-go responses produced better fits than models that did not. The best model was one in which only response criteria and the nondecisional components of processing changed between the 2 variants, supporting the view that the core information on which decisions are based is not different between them.     

The N2 in go/no-go tasks reflects conflict monitoring not response inhibition

The functional significance of the N2 in go/no-go tasks was investigated by comparing electrophysiological data obtained from two tasks: a go/no-go task involving both response inhibition as well as response conflict monitoring, and a go/GO task associated with conflict monitoring only. No response was required to no-go stimuli, and a response with maximal force to GO stimuli. The relative frequency of the go stimuli (80% vs. 50%) was varied. The N2 peaked on both no-go and GO trials, with larger amplitudes for both signals when presented in a context of frequent (80%) go signals. These results support the idea that the N2 reflects conflict monitoring not response inhibition.     

Backward crosstalk effects in psychological refractory period paradigms: effects of second-task response types on first-task response latencies

Three experiments using psychological refractory period (PRP) tasks documented backward crosstalk effects in which the nature of the second-task response influenced the first-task response latencies. Such effects are difficult to explain within currently popular bottleneck models, according to which second-task response selection does not begin until first-task response selection has finished. In Experiments 1 and 2, the first of the PRP tasks required a choice reaction time (RT) response, whereas the second task required a go/no-go decision. Task 1 responses were faster when the second task required a go response than when it required a no-go response. Experiment 3 showed that Task 1 RTs were also influenced by the complexity of second-task responses. These backward crosstalk effects indicate that significant second-task processing is carried out in time to influence first-task responses and thus challenge strictly serial bottleneck models.     

On the ups and downs of emotion: testing between conceptual-metaphor and polarity accounts of emotional valence–spatial location interactions

In the past decade, many studies have focused on the relationship between emotional valence and vertical spatial positions from a processing perspective. Lakoff and Johnson’s (1980) work on conceptual metaphor has traditionally motivated these investigations, but recent work (Lakens in J Exp Psychol: Learn, Mem Cogn, 38: 726–736, 2012) has suggested that polarity-based perspectives offer an alternative account of response time patterns. We contrasted the predictions of these two theories using a new facial emotion recognition task, in which participants made speeded responses to happy or sad faces on a display, with the spatial location of those faces being manipulated. In three experiments (two-alternative forced choice tasks and a go/no-go task), we found a pattern of responses consistent with a polarity-based account, but inconsistent with key predictions of the conceptual-metaphor account. Overall, congruency effects were observed for positively valenced items, but not for negatively valenced items. These findings demonstrate that polarity effects extend to nonlinguistic stimuli and beyond two-alternative forced choice tasks. We discuss the results in terms of common-coding approaches to task–response mappings.     

Electrophysiological correlates of anterior cingulate function in a go/no-go task: Effects of response conflict and trial type frequency

Neuroimaging and computational modeling studies have led to the suggestion that response conflict monitoring by the anterior cingulate cortex plays a key role in cognitive control. For example, response conflict is high when a response must be withheld (no-go) in contexts in which there is a prepotent tendency to make an overt (go) response. An event-related brain potential (ERP) component, the N2, is more pronounced on no-go than on go trials and was previously thought to reflect the need to inhibit the go response. However, the N2 may instead reflect the high degree of response conflict on no-go trials. If so, an N2 should also be apparent when subjects make a go response in conditions in which nogo events are more common. To test this hypothesis, we collected high-density ERP data from subjects performing a go/no-go task, in which the relative frequency of go versus no-go stimuli was varied. Consistent with our hypothesis, an N2 was apparent on both go and no-go trials and showed the properties expected of an ERP measure of conflict detection on correct trials: (1) It was enhanced for low-frequency stimuli, irrespective of whether these stimuli were associated with generating or suppressing a response, and (2) it was localized to the anterior cingulate cortex. This suggests that previous conceptions of the no-go N2 as indexing response inhibition may be in need of revision. Instead, the results are consistent with the view that the N2 in go/no-go tasks reflects conflict arising from competition between the execution and the inhibition of a single response.     

Redundancy phenomena are affected by response requirements

Results are reported for two go/no-go reaction time (RT) experiments, in which the redundant targets advantage was investigated. These experiments were replications of two earlier choice reaction time (CRT) experiments, in which letter stimuli were used. Important differences between the go/no-go RT experiments and the CRT experiments were obtained. Equal and significant redundancy advantages were obtained whether redundant targets were compared with a single target presented with a noise letter or without noise. In the CRT experiments, the advantage was not obtained in the comparison with a single target presented alone. Noise letters did not slow the RTs to single targets with which they were presented as was the case with CRT. Since the differing results of the two procedures depend on the response requirements, explanation of differing CRT data in terms of perceptual or attentional concepts is probably inappropriate. The presence and absence of response competition in the two situations may be the best interpretation. The results tend to support a conclusion of the parallel processing of two letter stimuli separated spatially by as much as 3 degrees.     

Somatic responses in behavioral inhibition

In the present study, skin conductance responses (SCRs) were measured postdecision and prefeedback in a go/no-go (GNG) task in which participants used response feedback to learn when to respond or not to respond to numeric stimuli. Like somatic markers in gambling tasks and somatic reactions to error monitoring in choice reaction time tasks, SCR patterns distinguished between correct and incorrect trials over time. These somatic reactions were disrupted by a reversal of GNG contingencies, and they were facilitated by pretraining of the stimulus—response mappings. In all cases, however, the somatic reactions appeared to be a product of competent decision making rather than a contributor to performance. Differential somatic responses to good and bad choices appear to be a robust and fairly general phenomenon, but researchers should be cautious in assuming that the somatic responses contribute to performance.     

Conditions under which children experience inhibitory difficulty with a "button-press" go/no-go task

Go/no-go tasks seem to provide a simple marker of inhibitory development in young children. Children are told to respond to one stimulus on go trials but to make no response to another stimulus on no-go trials; responding on no-go trials is assumed to reflect a failure to inhibit the go response. However, there is evidence to suggest that a type of go/no-go task, which we call the "button-press" task, does not require inhibition. We investigated the conditions under which young children (M=3 years 6 months, N=120) experience inhibitory difficulty with this type of task. The data suggest that the speed of stimulus presentation is crucial and that other studies using this type of task have presented the stimuli too briefly. The importance of establishing the inhibitory credentials of a task before it is used as a marker of inhibitory control is emphasized.     

Task dependent modulation of exogenous attention: Effects of target duration and intervening events

Inhibition of return (IOR) consists of slower reaction times in response to stimuli appearing at previously attended or inspected locations. The exact mechanisms underlying the effect have not yet been determined. In the present work, we manipulated two variables, target duration and intervening event (fixation cue between cue and target), through which we modulated the IOR effect as a function of task. When the target was presented until response, the presence of an intervening event made the cueing effect more negative in all tasks, although facilitation in the absence of an intervening event was only observed in discrimination and go–no-go tasks. When the target duration was 50 ms, the effect of the intervening event on cueing was also only observed for the discrimination and go–no-go tasks. Target duration had no effect at all in the discrimination task. Possible mechanisms for these modulations (detection cost and spatial selection benefit, both of which are based on cue–target integration processes) are discussed.     

Increased spatial salience in the social Simon task: A response-coding account of spatial compatibility effects

A spatial compatibility effect (SCE) is typically observed in forced two-choice tasks in which a spatially defined response (e.g., pressing a left vs. a right key) has to be executed to a nonspatial feature of a stimulus (e.g., discriminating red from green) that is additionally connoted by a spatial feature (e.g., the stimulus points to the left or the right). Responses are faster and more accurate when the response side and the spatial stimulus feature are compatible than when they are incompatible. Previous research has demonstrated that SCEs are diminished when stimuli from only one response category are responded to in individual go/no-go tasks, whereas SCEs reemerge when two participants work jointly on two complementary, individual go/no-go tasks in a joint go/no-go task setting. This social Simon effect has been considered evidence for shared task representations. We show that SCEs emerge in individual go/no-go tasks when the spatial dimension is made more salient, whereas SCEs are eliminated in joint go/no-go tasks when the spatial dimension is made less salient. These findings are consistent with an account of social Simon effects in terms of spatial response coding, whereas they are inconsistent with an account of shared task representations. The relevance of social factors for spatial response coding is discussed.     

多感觉整合范式中潜在的跨通道转换效应

大脑可以对来自不同感觉通道的信息进行处理与整合。与单一感觉通道相比, 个体对同时呈现在不同感觉通道的目标信号的响应会更快。对于这种现象的一种主要理论解释是共同激活模型, 该模型认为来自不同通道的刺激在特定的脑区汇聚整合, 比如顶叶内沟、颞上沟和前额叶皮层区域。整合后的信号强度更大, 可以更快地触发反应, 但是信号的整合发生在认知加工的哪一阶段目前尚未有明确结论。当个体对出现在不同感觉通道之间的任务转换进行加工时, 产生与感觉通道相关的任务转换的损失小于跨感觉通道转换损失与任务转换损失的总和, 这为与感觉通道相关的转换代价来源于任务设置的惯性和干扰提供了证据。而在单通道和多通道之间发生转换时, 跨通道转换代价会减小甚至消失, 这是由于同时发生的多感觉整合抵消了一部分损失, 这种现象支持了共同激活模型理论。然而, 多感觉信号整合对任务转换的神经加工过程产生怎样的影响并不清楚, 在未来的研究中可以把多感觉整合范式同经典的任务转换范式结合改进, 进而确定跨通道转换的加工机制和多感觉信号整合的发生阶段。     

Bimanual response grouping in dual-task paradigms

In three experiments we measured response time (RT) and peak force (PF) to investigate the grouping of left- and right-hand key press responses in a dual-task paradigm involving two independent go/no-go tasks. Within each task, a go stimulus within one of two modalities (i.e., visual versus auditory) required a response by one hand. In Experiment 1 with simultaneous go stimuli in the two tasks, responses appeared to be grouped in approximately 75–80% of trials, compared with nearly 100% grouping in a single-task condition requiring bimanual responses to the onset of any stimulus in either modality. In Experiment 2 with stimulus onset asynchronies (SOAs) of 0–400 ms between the two go stimuli, response grouping clearly declined as SOA increased, although some grouping was still evident even at the longest SOA. The same pattern was observed in Experiment 3 with the same range of SOAs but unpredictable stimulus order, suggesting that grouping is not strongly dependent on prior knowledge of the likely response order. These results emphasize the pervasiveness of response grouping in bimanual dual-task RT paradigms and provide useful clues as to its nature.     

Age-related differences in the processing of redundant visual dimensions

Age differences in the redundant-signals effect and coactivation of visual dimensions were investigated in 2 experiments. In Experiment 1 the task required the conjoining of dimensions, whereas in Experiment 2 the spatial separation of dimensions was manipulated. Although coactivation was evident for both age groups when the redundant dimensions occurred at the same location, older adults showed more evidence for coactivation, perhaps because of compensation for declines in perceptual processing. When the redundant dimensions were separated, neither age group showed evidence for coactivation. These findings indicate that the coactive processing of redundant visual dimensions is spared in healthy older adults and that for both groups, attention must be focused on both dimensions for coactivation to occur.     

Evidence for a role of the responding agent in the joint compatibility effect

The present study explored the role of the responding agent in a social context. To do so, we developed a compatibility task with socially relevant but task-irrelevant stimuli (own face, neutral face, and a friend's face). Participants were required to perform naming responses to coloured diamonds, while the faces were presented as irrelevant stimuli. We observed faster responses in face–name compatible than in incompatible conditions. When the task was distributed among two friends, we observed a compatibility effect in a joint go/no-go condition, in which both participants performed their go/no-go tasks together. In contrast, no compatibility effect was obtained in an individual go/no-go condition. Further, the experiment showed that this joint compatibility effect was based on the compatibility between the irrelevant face and the responding agent. This result demonstrates that features of the responding agent play a crucial role in the joint compatibility effect.     

Bimanual response grouping in dual-task paradigms

In three experiments we measured response time (RT) and peak force (PF) to investigate the grouping of left- and right-hand key press responses in a dual-task paradigm involving two independent go/no-go tasks. Within each task, a go stimulus within one of two modalities (i.e., visual versus auditory) required a response by one hand. In Experiment 1 with simultaneous go stimuli in the two tasks, responses appeared to be grouped in approximately 75-80% of trials, compared with nearly 100% grouping in a single-task condition requiring bimanual responses to the onset of any stimulus in either modality. In Experiment 2 with stimulus onset asynchronies (SOAs) of 0-400 ms between the two go stimuli, response grouping clearly declined as SOA increased, although some grouping was still evident even at the longest SOA. The same pattern was observed in Experiment 3 with the same range of SOAs but unpredictable stimulus order, suggesting that grouping is not strongly dependent on prior knowledge of the likely response order. These results emphasize the pervasiveness of response grouping in bimanual dual-task RT paradigms and provide useful clues as to its nature.     

Age-related differences in interhemispheric visuomotor integration measured by the redundant target effect

Presentation of bilateral redundant visual stimuli produces faster reaction times (RT) than presentation of a single unilateral stimulus; an effect known as the redundant target effect (RTE; Miller, 1982), and is a means of testing interhemispheric visuomotor integration (Ouimet, 2009). RTEs that exceed expectations, based on Miller's race model of inequality (RMI), are referred to as "enhanced RTEs" and imply neural coactivation. Paradoxically, enhanced RTEs are observed in cases of corpus callosum disruption. The Hemispheric Coactivation Hypothesis accounts for this paradox by positing that bihemispheric processing occurs to both unilateral and bilateral stimuli in the normal brain, but occurs only with bilateral stimuli in the disconnected brain. Neuroimaging has revealed decreases in the microstructural integrity of the corpus callosum with age (Ota et al., 2006), but research investigating the bilateral RTE in healthy older individuals is lacking. The present study investigated the bilateral RTE in healthy younger and healthy older adults using simple RT and choice RT tasks. Our prediction that older individuals would show significantly larger RTEs than younger individuals was found to be true for both tasks. Tests of the RMI produced little evidence for coactivation. The crossed-uncrossed difference, generally used as a means of testing visuomotor interhemispheric transfer, was also investigated, but no age effects were found. The observation of greater RTE in age is congruent with the Hemispheric Coactivation hypothesis (Miller, 2004) in which callosal disconnection is associated with increased RTE.