Principles of cross-modal competition: Evidence from deficits of attention

How does the attentional system coordinate the processing of stimuli presented simultaneously to different sensory modalities? We investigated this question with individuals with neurological damage who suffered from deficits of attention. In these individuals, we examined how the processing of tactile stimuli is affected by the simultaneous presentation of visual or auditory stimuli. The investigation demonstrated that two stimuli from different modalities are in competition when attention is directed to the perceptual attributes of both, but not when attention is directed to the perceptual attributes of one and the semantic attributes of the other. These findings reveal a differentiated attentional system in which competition is modulated by the level of stimulus representation to which attention is directed.     

Tactile "capture" of audition

Previous research has demonstrated that the localization of auditory or tactile stimuli can be biased by the simultaneous presentation of a visual stimulus from a different spatial position. We investigated whether auditory localization judgments could also be affected by the presentation of spatially displaced tactile stimuli, using a procedure designed to reveal perceptual interactions across modalities. Participants made left-right discrimination responses regarding the perceived location of sounds, which were presented either in isolation or together with tactile stimulation to the fingertips. The results demonstrate that the apparent location of a sound can be biased toward tactile stimulation when it is synchronous, but not when it is asynchronous, with the auditory event. Directing attention to the tactile modality did not increase the bias of sound localization toward synchronous tactile stimulation. These results provide the first demonstration of the tactile capture of audition.     

视-听跨通道汉语词汇信息加工中的抑制机制

采用选择性再认的方法考察在汉语词汇加工过程中 ,视 -听跨通道信息与视觉单通道信息加工过程中的抑制机制。结果表明 :对于视觉词汇的总体再认“否”反应 ,单通道干扰条件下的成绩优于跨通道干扰条件下的成绩。在视觉词汇加工过程中 ,对外在干扰材料的抑制效率不受输入干扰刺激的通道的影响。抑制效率受干扰材料语义关系性的影响 ,与目标材料属于同一语义范畴的比异范畴的干扰材料更难以被抑制。     

Tactile “capture” of audition

Previous research has demonstrated that the localization of auditory or tactile stimuli can be biased by the simultaneous presentation of a visual stimulus from a different spatial position. We investigated whether auditory localization judgments could also be affected by the presentation of spatially displaced tactile stimuli, using a procedure designed to reveal perceptual interactions across modalities. Participants made left—right discrimination responses regarding the perceived location of sounds, which were presented either in isolation or together with tactile stimulation to the fingertips. The results demonstrate that the apparent location of a sound can be biased toward tactile stimulation when it is synchronous, but not when it is asynchronous, with the auditory event. Directing attention to the tactile modality did not increase the bias of sound localization toward synchronous tactile stimulation. These results provide the first demonstration of the tactilecapture of audition.     

Defective stimulus set attention in generalized epilepsy

This study examined auditory selective attention in primary generalized and complex-partial (temporal lobe) epileptics using binaural and dichotic versions of the Continuous Performance Test. The patient groups did not differ from normal controls when only one channel was presented or when divided attention (simultaneously monitoring two channels) was required. However, generalized epileptics had significantly depressed hit rates when directed attention (responding to critical stimuli in only one channel) was required. These results suggest a contribution of brain stem “arousal” mechanisms to stimulus set attention. In addition, right ear perceptual advantages were found on these dichotic monitoring tasks, lending support to the contention that short-term auditory memory and verbal report are not required for the dichotic ear effect.     

Isolating cognitive modules with the dual-task paradigm: Are speech perception and production separate processes?

A dual-task paradigm is used to investigate whether the auditory input logogen is distinct from the articulatory output logogen. In the first two experiments it is shown that the task of detecting an unspecified name in an auditory input stream can be combined with reading aloud visually presented words with relatively little single- to dual-task decrement. The stimuli for both tasks are independent streams of random words presented at rapid rates. A series of control experiments suggest that the first task places a considerable information processing load on the auditory input logogen, the second a considerable load on the phonological output logogen, and that subjects do not switch between the two tasks. The fact that the two tasks can be combined with ease is therefore interpreted as supporting the view that the systems underlying reading aloud and listening are separate. The ease of performance when the input streams are in different modalities, compared to the difficulties when they are in the same, has implications for general models of attention.     

听觉警报失聪的认知因素

无意失聪是指当人们集中精神做事时,会忽略非预期的听觉刺激。这种现象在现实生活中普遍存在,它对航空和交通安全构成巨大威胁。研究者们发现高知觉和高认知负荷条件下因认知资源有限导致无意失聪。且随着负荷增加,被忽略的听觉刺激诱发的早期（N100）和晚期（P300）神经活动有所减弱。这表明非预期听觉刺激可以进入晚期加工阶段,但其能否被感知可能取决于与工作记忆相关的额顶网络的抑制控制程度。而工作记忆容量及其负荷与无意失聪关系的现有研究结果之间还存在不一致性。未来研究可以将其范式和理论拓展到其他安全生产领域,并运用认知训练等方式规避无意失聪,从而减少人因失误。     

Nonconcurrently presented auditory tones reduce distraction

Recent research has demonstrated that task-irrelevant stimuli presented simultaneously with a target-distractor stimulus reduce distraction and improve selective attention. In studies examining this reduced interference effect, visual selective attention tasks and concurrently presented task-irrelevant stimuli are used. We report first evidence for a similar effect in the auditory domain and with nonconcurrent stimuli (i.e., the task-irrelevant stimuli are presented before the target). The effect of nonconcurrently presented auditory tones on an auditory Stroop task developed by Leboe and Mondor (Psychological Research, 71, 568--575, 2007) was investigated. Stroop interference was reduced when task-irrelevant tones were presented before the Stroop stimulus. We conclude that task-irrelevant stimuli can improve selective attention not only when presented concurrently, but also when presented before the selective attention task. Our results are consistent with the hypothesis that interference reduction is due to perceptual dilution caused by task-irrelevant stimuli.     

The role of preparation and cue-modality in crossmodal task switching

The present study examined the effects of cue-based preparation and cue-target modality mapping in crossmodal task switching. In two experiments, we randomly presented lateralized visual and auditory stimuli simultaneously. Subjects were asked to make a left/right judgment for a stimulus in only one of the modalities. Prior to each trial, the relevant stimulus modality was indicated by a visual or auditory cue. The cueing interval was manipulated to examine preparation. In Experiment 1, we used a corresponding mapping of cue-modality and stimulus modality, whereas in Experiment 2 the mapping of cue and stimulus modalities was reversed. We found reduced modality-switch costs with a long cueing interval, showing that attention shifts to stimulus modalities can be prepared, irrespective of cue-target modality mapping. We conclude that perceptual processing in crossmodal switching can be biased in a preparatory way towards task-relevant stimulus modalities.     

To what extent do Gestalt grouping principles influence tactile perception?

Since their formulation by the Gestalt movement more than a century ago, the principles of perceptual grouping have primarily been investigated in the visual modality and, to a lesser extent, in the auditory modality. The present review addresses the question of whether the same grouping principles also affect the perception of tactile stimuli. Although, to date, only a few studies have explicitly investigated the existence of Gestalt grouping principles in the tactile modality, we argue that many more studies have indirectly provided evidence relevant to this topic. Reviewing this body of research, we argue that similar principles to those reported previously in visual and auditory studies also govern the perceptual grouping of tactile stimuli. In particular, we highlight evidence showing that the principles of proximity, similarity, common fate, good continuation, and closure affect tactile perception in both unimodal and crossmodal settings. We also highlight that the grouping of tactile stimuli is often affected by visual and auditory information that happen to be presented simultaneously. Finally, we discuss the theoretical and applied benefits that might pertain to the further study of Gestalt principles operating in both unisensory and multisensory tactile perception.     

Temporal order and processing acuity of visual,auditory, and tactile perception in developmentally dyslexic young adults

We studied the temporal acuity of 16 developmentally dyslexic young adults in three perceptual modalities. The control group consisted of 16 age- and IQ-matched normal readers. Two methods were used. In the temporal order judgment (TOJ) method, the stimuli were spatially separate fingertip indentations in the tactile system, tone bursts of different pitches in audition, and light flashes in vision. Participants indicated which one of two stimuli appeared first. To test temporal processing acuity (TPA), the same 8-msec nonspeech stimuli were presented as two parallel sequences of three stimulus pulses. Participants indicated, without order judgments, whether the pulses of the two sequences were simultaneous or nonsimultaneous. The dyslexic readers were somewhat inferior to the normal readers in all six temporal acuity tasks on average. Thus, our results agreed with the existence of a pansensory temporal processing deficit associated with dyslexia in a language with shallow orthography (Finnish) and in well-educated adults. The dyslexic and normal readers' temporal acuities overlapped so much, however, that acuity deficits alone would not allow dyslexia diagnoses. It was irrelevant whether or not the acuity task required order judgments. The groups did not differ in the nontemporal aspects of our experiments. Correlations between temporal acuity and reading-related tasks suggested that temporal acuity is associated with phonological awareness.     

Duration discrimination of filled and empty auditory intervals: cognitive and perceptual factors.

Adult subjects were presented with two auditory stimuli per trial, and their task was to decide which of the two was longer in duration. An adaptive psychophysical procedure was used. In Experiments 1, 2, and 4, the base duration was 50 msec, whereas in Experiment 3, the base duration was 1 sec. In Experiments 1, 2, and 4, it was found that filled intervals (continuous tones) were discriminated more accurately than empty intervals (with onset and offset marked by clicks). It was concluded that this difference was perceptual rather than cognitive in nature, since performance on filled and empty intervals was not affected by increasing cognitive load in a dual-task procedure (Experiment 2) but was affected by backward masking (Experiment 4). In contrast, the results of Experiment 3 showed that duration discrimination of filled auditory intervals of longer duration was cognitively influenced, since performance was impaired by increasing cognitive load. Implications for notions of perceptual processing and timing mechanism underlying differences in duration discrimination with filled and empty intervals are discussed.     

Duration discrimination of filled and empty auditory intervals: Cognitive and perceptual factors

Adult subjects were presented with two auditory stimuli per trial, and their task was to decide which of the two was longer in duration. An adaptive psychophysical procedure was used. In Experiments 1, 2, and 4, the base duration was 50 msec, whereas in Experiment 3, the base duration was 1 sec. In Experiments 1, 2, and 4, it was found that filled intervals (continuous tones) were discriminated more accurately than empty intervals (with onset and offset marked by clicks). It was concluded that this difference was perceptual rather than cognitive in nature, since performance on filled and empty intervals was not affected by increasing cognitive load in a dual-task procedure (Experiment 2) but was affected by backward masking (Experiment 4). In contrast, the results of Experiment 3 showed that duration discrimination of filled auditory intervals of longer duration was cognitively influenced, since performance was impaired by increasing cognitive load. Implications for notions of perceptual processing and timing mechanisms tanderlying differences in duration discrimination with filled and empty intervals are discussed.     

IMPLICIT MEMORY IN THE TACTILE MODALITY:

Abstract— Research on perceptual priming has previously focused exclusively on priming in the visual and auditory modalities. The present study explored whether perceptual priming also extends to the tactile modality. Tactile priming for Braille words was examined in a group of blind participants, using a Braille analogue of the stem-completion task. The results for tactile priming paralleled previous stem-completion results in other modalities. Manipulating the encoding task at study (semantic vs nonsemantic) dissociated implicit and explicit Braille stem-completion performance, and priming was unaffected by the number of study presentations (one vs three). Finally, Braille stem-completion priming was found in a cross-modal paradigm to have both a specifically tactile component and a cross-modal component. These results demonstrate for the first time that verbal priming can occur in the tactile domain and that tactile priming has basic functional similarities with stem-completion priming in the visual and auditory domains.     

Transfer across modality in perceptual implicit memory

We examined whether words studied in one modality (visual or auditory) would prime performance in the opposite modality in five different perceptual implicit memory tests: auditory perceptual identification, auditory stem completion, visual perceptual identification, visual stem completion, and visual fragment completion. Significant transfer across modality was observed in all five tasks. However, a large proportion of the subjects reported using explicit retrieval strategies during the implicit tests. Those subjects who claimed not to have used explicit retrieval processes during the test phase demonstrated transfer across modalities in the stem completion tests and the perceptual identification tests, but not in the fragment completion test. The results indicate that implicit visual word-fragment completion is unique, in the sense that it relies exclusively on perceptual memory processes, whereas the other tasks rely, in part, on nonperceptual memory processes.     

It's about time: revisiting temporal processing deficits in dyslexia

Temporal processing in French children with dyslexia was evaluated in three tasks: a word identification task requiring implicit temporal processing, and two explicit temporal bisection tasks, one in the auditory and one in the visual modality. Normally developing children matched on chronological age and reading level served as a control group. Children with dyslexia exhibited robust deficits in temporal tasks whether they were explicit or implicit and whether they involved the auditory or the visual modality. First, they presented larger perceptual variability when performing temporal tasks, whereas they showed no such difficulties when performing the same task on a non‐temporal dimension (intensity). This dissociation suggests that their difficulties were specific to temporal processing and could not be attributed to lapses of attention, reduced alertness, faulty anchoring, or overall noisy processing. In the framework of cognitive models of time perception, these data point to a dysfunction of the ‘internal clock’ of dyslexic children. These results are broadly compatible with the recent temporal sampling theory of dyslexia.     

视听刺激突显性对视觉主导效应的影响

本研究使用空间任务-转换范式,控制视、听刺激的突显性,探讨自下而上注意对视觉主导效应的影响。结果表明视、听刺激突显性显著地影响视觉主导效应,实验一中当听觉刺激为高突显性时,视觉主导效应显著减弱。实验二中当听觉刺激为高突显性并且视觉刺激为低突显性时,视觉主导效应进一步减弱但依然存在。结果支持偏向竞争理论,在跨通道视听交互过程中视觉刺激更具突显性,在多感觉整合过程中更具加工优势。     

Working memory resources are shared across sensory modalities

A common assumption in the working memory literature is that the visual and auditory modalities have separate and independent memory stores. Recent evidence on visual working memory has suggested that resources are shared between representations, and that the precision of representations sets the limit for memory performance. We tested whether memory resources are also shared across sensory modalities. Memory precision for two visual (spatial frequency and orientation) and two auditory (pitch and tone duration) features was measured separately for each feature and for all possible feature combinations. Thus, only the memory load was varied, from one to four features, while keeping the stimuli similar. In Experiment 1, two gratings and two tones—both containing two varying features—were presented simultaneously. In Experiment 2, two gratings and two tones—each containing only one varying feature—were presented sequentially. The memory precision (delayed discrimination threshold) for a single feature was close to the perceptual threshold. However, as the number of features to be remembered was increased, the discrimination thresholds increased more than twofold. Importantly, the decrease in memory precision did not depend on the modality of the other feature(s), or on whether the features were in the same or in separate objects. Hence, simultaneously storing one visual and one auditory feature had an effect on memory precision equal to those of simultaneously storing two visual or two auditory features. The results show that working memory is limited by the precision of the stored representations, and that working memory can be described as a resource pool that is shared across modalities.     

Visual motion interferes with tactile motion perception

Previous studies have demonstrated that visual apparent motion can alter the judgment of auditory apparent motion. We investigated the effect of visual apparent motion on judgments of the direction of tactile apparent motion. When visual motion was presented at the same time as, but in a direction opposite to, tactile motion, accuracy in judging the direction of tactile apparent motion was substantially reduced. This reduction in performance is referred to as 'the congruency effect'. Similar effects were observed when the visual display was placed either near to the tactile display or at some distance from the tactile display (experiment 1). In experiment 2, the relative alignment between the visual and tactile directions of motion was varied. The size of the congruency effect was similar at 0 degrees and 45 degrees alignments but much reduced at a 90 degrees alignment. In experiment 3, subjects made confidence ratings of their judgments of the direction of the tactile motion. The results indicated that the congruency effect was not due to subjects being unsure of the direction of motion and being forced to guess. In experiment 4, static visual stimuli were shown to have no effect on the judgments of direction of the tactile stimuli. The extent to which the congruency effect reflects capture effects and is the result of perceptual versus post-perceptual processes is discussed.     

Rhythms and responses

Rhythms are fundamental to behavior, but the control mechanism for timed responses is not known. Many theorists have assumed that there is a central clock coordinating behavior in all sensory modalities and response modes. We tested this hypothesis using a rhythmic tapping task in which university undergraduates first attempted to synchronize responses with brief auditory, tactile, or visual stimuli and then continued to tap at the same rate on their own. Performance was most variable with visual stimuli and least variable with auditory stimuli. The detailed results suggest that performances are not based on a common clock, but, rather, different strategies are employed when the task is presented in different modalities. We reject the hypothesis of a single timing mechanism as controlling behavior and, in doing so, question the validity of information processing models that are formulated without regard to temporal relations among their conjectured processes.