视听刺激突显性对视觉主导效应的影响

本研究使用空间任务-转换范式,控制视、听刺激的突显性,探讨自下而上注意对视觉主导效应的影响。结果表明视、听刺激突显性显著地影响视觉主导效应,实验一中当听觉刺激为高突显性时,视觉主导效应显著减弱。实验二中当听觉刺激为高突显性并且视觉刺激为低突显性时,视觉主导效应进一步减弱但依然存在。结果支持偏向竞争理论,在跨通道视听交互过程中视觉刺激更具突显性,在多感觉整合过程中更具加工优势。     

Mechanisms of Priming by Masked Stimuli: Inferences From Event-Related Brain Potentials

A metacontrast procedure was combined with the recording of event-related potentials (ERPs) to examine the mechanisms underlying the priming effect exerted by masked visual stimuli (primes) on target processing. Participants performed spatially arranged choice responses to stimulus locations. The relationship between prime and target locations (congruity) and the mapping between target and response locations (compatibility) were factorially manipulated. Although participants were unaware of prime locations, choice responses were faster for congruent than incongruent conditions irrespective of the mapping. Visual ERP components and the onset of the lateralized readiness potential (LRP), an index of specific motor activation, revealed that neither perceptual nor preselection processes contributed to the congruity effect. However, the LRP waveform indicated that primes activated responses that fit the stimulus-response mapping. These results support the view that sensorimotor processing of masked stimuli is functionally distinct from their conscious perception.     

The neural correlates of orienting to walking direction in 6‐month‐old infants: An ERP study

The ability to detect social signals represents a first step to enter our social world. Behavioral evidence has demonstrated that 6‐month‐old infants are able to orient their attention toward the position indicated by walking direction, showing faster orienting responses toward stimuli cued by the direction of motion than toward uncued stimuli. The present study investigated the neural mechanisms underpinning this attentional priming effect by using a spatial cueing paradigm and recording EEG (Geodesic System 128 channels) from 6‐month‐old infants. Infants were presented with a central point‐light walker followed by a single peripheral target. The target appeared randomly at a position either congruent or incongruent with the walking direction of the cue. We examined infants' target‐locked event‐related potential (ERP) responses and we used cortical source analysis to explore which brain regions gave rise to the ERP responses. The P1 component and saccade latencies toward the peripheral target were modulated by the congruency between the walking direction of the cue and the position of the target. Infants' saccade latencies were faster in response to targets appearing at congruent spatial locations. The P1 component was larger in response to congruent than to incongruent targets and a similar congruency effect was found with cortical source analysis in the parahippocampal gyrus and the anterior fusiform gyrus. Overall, these findings suggest that a type of biological motion like the one of a vertebrate walking on the legs can trigger covert orienting of attention in 6‐month‐old infants, enabling enhancement of neural activity related to visual processing of potentially relevant information as well as a facilitation of oculomotor responses to stimuli appearing at the attended location.     

The redundant target effect is affected by modality switch costs

When participants have to respond to stimuli of two modalities, faster reaction times are observed for simultaneous, bimodal events than for unimodal events (the redundant target effect [RTE]). This finding has been interpreted as reflecting processing gains for bimodal relative to unimodal stimuli, possibly due to multisensory interactions. In random stimulus sequences, reaction times are slower when the stimulus is preceded by a stimulus of a different modality (modality switch effect [MSE]). Simple reaction time redundant target experiments with auditory-visual, visual-tactile, and auditory-tactile stimulus combinations were run to determine whether the RTE may be partly explained by MSEs because bimodal stimuli do not require a modality switch. In all three modality pairings, significant MSEs and RTEs were observed. However, the RTE was still significant after reaction times were corrected for the MSE, supporting the hypothesis that coactivation occurs independently of modality switch costs.     

Preattentive processing of audio-visual emotional signals

Previous research has shown that redundant information in faces and voices leads to faster emotional categorization compared to incongruent emotional information even when attending to only one modality. The aim of the present study was to test whether these crossmodal effects are predominantly due to a response conflict rather than interference at earlier, e.g. perceptual processing stages. In Experiment 1, participants had to categorize the valence and rate the intensity of happy, sad, angry and neutral unimodal or bimodal face–voice stimuli. They were asked to rate either the facial or vocal expression and ignore the emotion expressed in the other modality. Participants responded faster and more precisely to emotionally congruent compared to incongruent face–voice pairs in both the Attend Face and in the Attend Voice condition. Moreover, when attending to faces, emotionally congruent bimodal stimuli were more efficiently processed than unimodal visual stimuli. To study the role of a possible response conflict, Experiment 2 used a modified paradigm in which emotional and response conflicts were disentangled. Incongruency effects were significant even in the absence of response conflicts. The results suggest that emotional signals available through different sensory channels are automatically combined prior to response selection.     

The influence of spatial representation on valence judgements: An event-related potential study

The present study used event-related potentials (ERPs) to explore the nature of space-valence congruency effects. We presented participants with up or down arrows at the centre of the screen and then asked participants to identify whether the following target words had the emotional valence. The target words included positive emotional words (e.g., “happy” and “delight”), negative emotional words (e.g., “sad” and “depressive”) and neutral words (e.g., “history” and “country”). Behavioural data showed that the positive targets were identified faster when they are primed by up arrows than when primed by down arrows, whereas the negative targets were identified faster when they are primed by down arrows than when primed by up arrows. The ERP analysis showed larger P2 amplitudes were found in the congruent condition (i.e., the positive targets following up arrows or the negative targets following down arrows) than in the incongruent condition (i.e., the positive targets following down arrows or the negative targets following up arrows). Furthermore, larger N400 amplitudes were found in the incongruent condition compared with the congruent condition. Moreover, larger LPC amplitudes were found in the congruent condition compared with the incongruent condition. Therefore, in addition to replicating the space-valence congruency effects in a neutral/emotional judgement task, our study also extended previous studies by showing that spatial information modulates the processing of the emotional words at multiple stages.     

Should I fetch one or the other? A study on dogs on the object choice in the bimodal contrasting paradigm

The present study assessed how dogs weigh gestural versus verbal information communicated to them by humans in transitive actions. The dogs were trained by their owners to fetch an object under three conditions: a bimodal congruent condition characterized by using gestures and voices simultaneously; a unimodal gestural condition characterized by using only gestures; and a unimodal verbal condition characterized by using only voices. An additional condition, defined as a bimodal incongruent condition, was later added, in which the gesture contrasted with the verbal command, that is, the owner indicated an object while pronouncing the name of the other object visible to dogs. In the incongruent condition, seven out of nine dogs choose to follow the gestural indication and performed above chance, two were at chance, whereas none of the dogs followed the verbal cues above chance. The dogs, as a group, performed above chance the gestural command in 73.6% of cases. The analysis of latencies in the above-mentioned four conditions exhibited significant differences. The unimodal verbal and the gestural conditions recorded a slower performance than both the bimodal incongruent and congruent conditions. No statistical differences were observed between the unimodal and bimodal conditions. Our results demonstrate that dogs, trained to respond equally well to gestural and verbal commands, choose to follow the indication provided by the gestural command than the verbal one to a significant extent in transitive actions. Furthermore, the responses to bimodal conditions were found to be quicker than the unimodal ones.     

Depth of facial expression processing depends on stimulus visibility: Behavioral and electrophysiological evidence of priming effects

Participants performed a priming task during which emotional faces served as prime stimuli and emotional words served as targets. Prime-target pairs were congruent or incongruent, and two levels of prime visibility were obtained by varying the duration of the masked primes. To probe a neural signature of the impact of the masked primes, lateralized readiness potentials (LRPs) were recorded over motor cortex. In the high-visibility condition, responses to word targets were faster when the prime-target pairs were congruent than when they were incongruent, providing evidence of priming effects. In line with the behavioral results, the electrophysiological data showed that high-visibility face primes resulted in LRP differences between congruent and incongruent trials, suggesting that prime stimuli initiated motor preparation. Contrary to the above pattern, no evidence for reaction time or LRP differences was observed in the low-visibility condition, revealing that the depth of facial expression processing is dependent on stimulus visibility.     

Covert orienting of attention in 3-month-old infants: The case of biological motion

Humans attend to different positions in the space either by moving their eyes or by moving covertly their attention. The development of covert attention occurs during the first year of life. According to Colombo’s model of attention (2001), within the first years there is a significant change in infants’ visuo-spatial orienting mechanisms, from a predominantly overt form to a covert orienting starting from 4 to 5 months of life. The use of non-invasive brain imaging techniques can shed light on the origin of such mechanisms. In particular, EEG and ERP studies can directly investigate the neural correlates of covert attention in young infants. The present study investigated the neural correlates of covert attention employing a visuo-spatial cueing paradigm in 3-month-old infants. Infants were presented with a central point-light walker (PLD) followed by a single peripheral target. The target appeared randomly at a position either congruent or incongruent with the walking direction of the cue. We examined infants’ target-locked P1 component and the saccade latencies toward the peripheral target. Results showed that the P1 component was larger in response to congruent than to incongruent targets and saccade latencies were faster for congruent rather than incongruent trials. Moreover, the facilitation in processing sensory information (priming effects) presented at the cued spatial location occurs even before the onset of the oculomotor response, suggesting that covert attention is present before 4 months of age. Overall, this study highlights how ERPs method could help researchers at investigating the neural basis of attentional mechanisms in infants.     

Age-related differences in automatic stimulus-response associations: Insights from young and older adults’ parity judgments

Young and older adults completed a parity judgment task (i.e., judging whether a target digit was odd or even) in which target numbers were preceded by masked prime numbers presented for 43 msec. Targets were either congruent (i.e., they had the same parity status as their primes) or incongruent (i.e., odd primes were paired with even targets, and even primes were paired with odd targets). Response times, percent errors, and event-related potentials (ERPs) were recorded for all items to compare automatic stimulus—response association (ASRA) and congruence effects (i.e., better performance on congruent than on incongruent trials) across age groups. Two important original sets of findings were obtained in this sample of participants. First, both age groups showed ASRA effects in behavioral measures. Second, age-related differences were observed in amplitude, timing, and scalp distributions for each congruent and incongruent ERP. These findings have implications for furthering the understanding of ASRA effects and of general characteristics of cognitive processes affected (or not affected) by aging.     

Electrophysiological correlates of crossmodal visual distractor congruency effects: Evidence for response conflict

To investigate the basis of crossmodal visual distractor congruency effects, we recorded event-related brain potentials (ERP) while participants performed a tactile location-discrimination task. Participants made speeded tactile location-discrimination responses to tactile targets presented to the index fingers or thumbs while ignoring simultaneously presented task-irrelevant visual distractor stimuli at either the same (congruent) or a different (incongruent) location. Behavioural results were in line with previous studies, showing slowed response times and increased error rates on incongruent compared with congruent visual distractor trials. To clarify the effect of visual distractors on tactile processing, concurrently recorded ERPs were analyzed for poststimulus, preresponse, and postresponse modulations. An enhanced negativity was found in the time range of the N2 component on incongruent compared with congruent visual distractor trials prior to correct responses. In addition, postresponse ERPs showed the presence of error-related negativity components on incorrect-response trials and enhanced negativity for congruent-incorrect compared with incongruent-incorrect trials. This pattern of ERP results has previously been related to response conflict (Yeung, Botvinick, & Cohen, 2004). Importantly, no modulation of early somatosensory ERPs was present prior to the N2 time range, which may have suggested the contribution of other perceptual or postperceptual processes to crossmodal congruency effects. Taken together, our results suggest that crossmodal visual distractor effects are largely due to response conflict.     

Cross-modal integration of simple auditory and visual events

Responses are typically faster and more accurate when both auditory and visual modalities are stimulated than when only one is. This bimodal advantage is generally attributed to a speeding of responding on bimodal trials, relative to unimodal trials. It remains possible that this effect might be due to a performance decrement on unimodal ones. To investigate this, two levels of auditory and visual signal intensities were combined in a double-factorial paradigm. Responses to the onset of the imperative signal were measured under go/no-go conditions. Mean reaction times to the four types of bimodal stimuli exhibited a superadditive interaction. This is evidence for the parallel self-terminating processing of the two signal components. Violations of the race model inequality also occurred, and measures of processing capacity showed that efficiency was greater on the bimodal than on the unimodal trials. These data are discussed in terms of a possible underlying neural substrate.     

Colavita dominance effect revisited: the effect of semantic congruity

To investigate the effect of semantic congruity on audiovisual target responses, participants detected a semantic concept that was embedded in a series of rapidly presented stimuli. The target concept appeared as a picture, an environmental sound, or both; and in bimodal trials, the audiovisual events were either consistent or inconsistent in their representation of a semantic concept. The results showed faster detection latencies to bimodal than to unimodal targets and a higher rate of missed targets when visual distractors were presented together with auditory targets, in comparison to auditory targets presented alone. The findings of Experiment 2 showed a cross-modal asymmetry, such that visual distractors were found to interfere with the accuracy of auditory target detection, but auditory distractors had no effect on either the speed or the accuracy of visual target detection. The biased-competition theory of attention (Desimone & Duncan Annual Review of Neuroscience 18: 1995; Duncan, Humphreys, & Ward Current Opinion in Neurobiology 7: 255–261 1997) was used to explain the findings because, when the saliency of the visual stimuli was reduced by the addition of a noise filter in Experiment 4, visual interference on auditory target detection was diminished. Additionally, the results showed faster and more accurate target detection when semantic concepts were represented in a visual rather than an auditory format.     

Multisensory integration of vision and touch in nonspatial feature discrimination tasks

Multisensory integration of nonspatial features between vision and touch was investigated by examining the effects of redundant signals of visual and tactile inputs. In the present experiments, visual letter stimuli and/or tactile letter stimuli were presented, which participants were asked to identify as quickly as possible. The results of Experiment 1 demonstrated faster reaction times for bimodal stimuli than for unimodal stimuli (the redundant signals effect (RSE)). The RSE was due to coactivation of figural representations from the visual and tactile modalities. This coactivation did not occur for a simple stimulus detection task (Experiment 2) or for bimodal stimuli with the same semantic information but different physical stimulus features (Experiment 3). The findings suggest that the integration process might occur at a relatively early stage of object-identification prior to the decision level.     

Action for perception: a motor-visual attentional effect

Five experiments investigated whether preparation of a grasping movement affects detection and discrimination of visual stimuli. Normal human participants were required to prepare to grasp a bar and then to grasp it as fast as possible on presentation of a visual stimulus. On the basis of the degree of sharing of their intrinsic properties with those of the to-be-grasped bar, visual stimuli were categorized as "congruent" or "incongruent." Results showed that grasping reaction times to congruent visual stimuli were faster than reaction times to incongruent ones. These data indicate that preparation to act on an object produces faster processing of stimuli congruent with that object. The same facilitation was present also when, after the preparation of hand grasping, participants were suddenly instructed to inhibit the prepared grasping movement and to respond with a different motor effector. The authors suggest that these findings could represent an extension of the premotor theory of attention, from orienting of attention to spatial locations to orienting of attention to graspable objects.     

Crossmodal temporal discrimination: assessing the predictions of a general pacemaker-counter model

In this study, an extended pacemaker-counter model was applied to crossmodal temporal discrimination. In three experiments, subjects discriminated between the durations of a constant standard stimulus and a variable comparison stimulus. In congruent trials, both stimuli were presented in the same sensory modality (i.e., both visual or both auditory), whereas in incongruent trials, each stimulus was presented in a different modality. The model accounts for the finding that temporal discrimination depends on the presentation order of the sensory modalities. Nevertheless, the model fails to explain why temporal discrimination was much better with congruent than with incongruent trials. The discussion considers possibilities to accommodate the model to this and other shortcomings.     

Multimodal signal detection: Independent decisions vs. integration

The pooling of information from simultaneous, spatially congruent auditory and visual stimuli is examined in a signal detection task. The paradigm used permits discrimination among a number of models of the decision mechanisms involved in processing multiple component stimuli. Parameter-free predictions are presented for the weighted integration model and for three versions of the independent decisions model. The data support an independent decisions model of the bimodal detection process in which attention is shared equally between modalities.     

双通道分配性注意对视听觉返回抑制的影响

本研究基于线索-靶子范式, 操纵目标刺激类型(视觉、听觉、视听觉)与线索有效性(有效线索、中性条件、无效线索)两个自变量, 通过3个实验来考察双通道分配性注意对视听觉返回抑制(inhibition of return, IOR)的影响。实验1 (听觉刺激呈现在左/右侧)结果发现, 在双通道分配性注意条件下, 视觉目标产生显著IOR效应, 而视听觉目标没有产生IOR效应; 实验2 (听觉刺激呈现在左/右侧)与实验3 (听觉刺激呈现在中央)结果发现, 在视觉通道选择性注意条件下, 视觉与视听觉目标均产生显著IOR效应但二者无显著差异。结果表明：双通道分配性注意减弱视听觉IOR效应。     

Perception of emergent configurations in humans (Homo sapiens) and chimpanzees (Pan troglodytes)

We examined the perceptions of emergent configurations in humans and chimpanzees using a target-localization task. The stimulus display consisted of a target placed among multiple identical distractors. The target and distractors were presented either solely, within congruent contexts in which salient configurations emerge, or within incongruent contexts in which salient configurations do not emerge. We found that congruent contexts had similar facilitative effects on target localization by humans and chimpanzees, whereas similar disruptive effects emerged when the stimuli were presented within incongruent contexts. When display size was manipulated, targets under the congruent-context condition were localized in a parallel manner, but those under the no-context and incongruent-context conditions were localized in a serial manner by both species. These results suggest that both humans and chimpanzees perceive emergent configurations when targets and distractors are presented within certain congruent contexts and that they process such emergent configurations preattentively.     

Observing repetitive finger movements modulates response times of auditorily cued finger movements

Our motor and perceptual representations of actions seem to be intimately linked and the human mirror neuron system (MNS) has been proposed as the mediator. In two experiments, we presented biological or non-biological movement stimuli that were either congruent or incongruent to a required response prompted by a tone. When the tone occurred with the onset of the last movement in a series, i.e., it was perceived during the movement presentation, congruent biological stimuli resulted in faster reaction times than congruent non-biological stimuli. The opposite was observed for incongruent stimuli. When the tone was presented after visual movement stimulation, however, no such interaction was present. This implies that biological movement stimuli only affect motor behaviour during visual processing but not thereafter. These data suggest that the MNS is an "online" system; longstanding repetitive visual stimulation (Experiment 1) has no benefit in comparison to only one or two repetitions (Experiment 2).