A partial matching theory of the mirror effect in immediate probed recognition

A set of experiments on immediate probed recognition of digit triples is reported in which the variables were list length (five, six, seven, or eight triples), the probability that a probe was old (.33, .5, or .67), and whether the digit triples were presented with an auditory component or articulatory suppression. Previous work had suggested that the false alarm (FA) rate in this paradigm was lower when auditory information was available than when it was not; this observation had led to the development of thepartial matching theory of immediate probed recognition, according to which FAs could arise not only as a result of unlucky guesses but also when new probes shared a first digit in common with a partially retained target triple. It was argued that partial memory representations were less likely following auditory presentation than following articulatory suppression. Partial matching theory is contrasted with therational response theory, according to which all FAs are unlucky guesses; partial matching theory gave a better account of the present experimental data than did rational response theory. However, a logical relationship between the two theories was suggested, a consequence of which was that rational response theory could be modified to include partial matching in such a way as to account for mirror effects, not only in unusually difficult immediate probed recognition tasks, but also in the more commonly studied mixed test list paradigm involving words of high or low frequency.     

Priming T2 in a visual and auditory attentional blink task

Participants performed an attentional blink (AB) task including digits as targets and letters as distractors within the visual and auditory domains. Prior to the rapid serial visual presentation, a visual or auditory prime was presented in the form of a digit that was identical to the second target (T2) on 50% of the trials. In addition to the "classic" AB effect, an overall drop in performance on T2 was observed for the trials on which the stream was preceded by an identical prime from the same modality. No cross-modal priming was evident, suggesting that the observed inhibitory priming effects are modality specific. We argue that the present findings represent a special type of negative priming operating at a low feature level.     

Auditory and audiovisual inhibition of return

Two experiments examined any inhibition-of-return (IOR) effects from auditory cues and from preceding auditory targets upon reaction times (RTs) for detecting subsequent auditory targets. Auditory RT was delayed if the preceding auditory cue was on the same side as the target, but was unaffected by the location of the auditorytarget from the preceding trial, suggesting that response inhibition for the cue may have produced its effects. By contrast, visual detection RT was inhibited by the ipsilateral presentation of a visual target on the preceding trial. In a third experiment, targets could be unpredictably auditory or visual, and no peripheral cues intervened. Both auditory and visual detection RTs were now delayed following an ipsilateral versus contralateral target in either modality on the preceding trial, even when eye position was monitored to ensure central fixation throughout. These data suggest that auditory target—target IOR arises only when target modality is unpredictable. They also provide the first unequivocal evidence for cross-modal IOR, since, unlike other recent studies (e.g., Reuter-Lorenz, Jha, & Rosenquist, 1996; Tassinari & Berlucchi, 1995; Tassinari & Campara, 1996), the present cross-modal effects cannot be explained in terms of response inhibition for the cue. The results are discussed in relation to neurophysiological studies and audiovisual links in saccade programming.     

The modality effect and articulation

The two experiments reported in this paper investigate the influences of irrelevant articulation on the modality effect in serial recall. Subjects performed a post-list distractor task, which involved generating a well-learned alphabetic sequence for five seconds. The modality effect was impaired when subjects vocalized the letters aloud, but was unaffected by whether the sequence was silently mouthed or silently written. These results show that the modality effect does not arise from the contribution of an articulatory code to recall of the most recent auditory items. They also question the functional equivalence of recency effects for auditory, mouthed and lipread stimuli. On the basis of these and other findings, a multi-component approach to recency effects is proposed.     

Immediate serial recall of mixed-modality lists

Seven experiments are reported in which subjects were tested for immediate serial recall of mixed-modality lists. On mixed auditory-visual lists, there was an advantage for auditory items at all serial positions. This was due to both a facilitation of auditory items and an inhibition of visual items on mixed lists, as compared with single-modality lists. When presented on a list containing items read silently, recall of items that were silently mouthed by the subject demonstrated patterns similar to those found with auditory items. When presented on a list containing items read aloud, recall of mouthed items showed patterns similar to those found with silently read items. The auditory advantage on mixed lists was found even when the list items were acoustically similar or identical and was not reduced by midlist auditory suffixes. The results suggest that modality differences in recall of mixed-modality lists are based on information different from that responsible for modality differences in recall of single-modality lists.     

Modality effect in false recognition: evidence from Chinese characters

Using the Deese/Roediger‐McDermott (DRM) false memory method, Smith and Hunt ( 1998 ) first reported the modality effect on false memory and showed that false recall from DRM lists was lower following visual study than following auditory study, which led to numerous studies on the mechanism of modality effect on false memory and provided many competing explanations. In the present experiment, the authors tested the modality effect in false recognition by using a blocked presentation condition and a random presentation condition. The present experiment found a modality effect different from the results of the previous research; namely, false recognition was shown to be greater following visual study than following auditory study, especially in the blocked presentation condition rather than in the random presentation condition. The authors argued that this reversed modality effect may be due to different encoding and processing characteristics between Chinese characters and English words. Compared with English words, visual graphemes of critical lures in Chinese lists are likely to be activated and encoded in participants' minds, thus it is more difficult for participants to discriminate later inner graphemes from those items presented in visual modality. Hence visual presentation could lead to more false recognition than auditory presentation in Chinese lists. The results in the present experiment demonstrated that semantic activation occurring during the encoding and retrieve phases played an important role in modality effect in false recognition, and our findings might be explained by the activation‐monitoring account.     

The stimulus suffix effect as a memory coding phenomenon

Two short-term memory experiments examined the nature of the stimulus suffix effect on auditory linguistic and nonlinguistic stimulus lists. In Experiment 1, where subjects recalled eight-item digit lists, it was found that a silently articulated digit suffix had the same effect on recall for the last list item as a spoken digit suffix. In Experiment 2, subjects recalled lists of sounds made by inanimate objects either by listing the names of the objects or by ordering a set of drawings of the objects. Auditory suffixes, either another object sound or the spoken name of an object, produced a suffix effect under both recall conditions, but a visually presented picture also produced a suffix effect when subjects recalled using pictures. The results were most adequately explained by a levels-of-processing memory coding hypothesis.     

Paradoxical effects of presentation modality on false memory.

Two experiments are reported in which the effects of presentation modality on false memory in recall and recognition are studied. False recall and recognition of critical targets are lower for non-presented items related to a study list when that study list is presented visually than when presented auditorily. This pattern of low levels of false memory for critical targets holds even when participants read the visually presented study items aloud. These results suggest that recollection of visual detail plays a role in the prevention of false memory. However, both the hit rates (true memory) and the false-alarm rates to weakly related distractors (non-critical targets) were higher for visual presentation than for auditory presentation, suggesting that more than one mechanism may underlie false recognition.     

Object file continuity and the auditory attentional blink

Three experiments were designed to investigate the causes of the auditory attentional blink (AB). Experiments 1A and 1B revealed that there was a larger auditory AB when the target and the distractors were different in two attributes than when they were different in only one attribute. Experiments 2A and 2B showed that for pure-tone distractor sequences, there were small auditory AB deficits when both the target and the probe were different from the distractors in two attributes or in one attribute; however, for pulse distractor sequences, there was a large auditory AB when both the target and the probe were different from the distractors in one attribute, but not when they were different in two attributes. Experiments 3A and 3B revealed that regardless of the relationship of the target to the subsequent distractors, a large AB was generated if it was the first sound in a sequence. Moreover, only a very small AB was apparent when the distractors following the probe were replaced by silence. These results indicated that the auditory AB is affected by both the requirement of creating and consolidating a new object file for the target and the overwriting of the probe by the distractors following it.     

跨视听通道的相继错误记忆效应

本研究以12名大学生为被试采用DRM范式,考察了视觉与听觉通道在编码阶段的错误记忆ERP效应,以从更深层面认识错误记忆的内在加工机制。研究结果表明,在编码阶段,在300-500ms及500-700ms的时间窗视觉通道均存在相继错误记忆效应（DIM）,比听觉通道表现出较强的DIM效应,这不仅说明视觉通道与听觉通道在编码阶段具有不同的脑机制,而且表明DIM效应与学习项目的语义加工有着密切的关系。     

Sound enhances visual perception: cross-modal effects of auditory organization on vision

Six experiments demonstrated cross-modal influences from the auditory modality on the visual modality at an early level of perceptual organization. Participants had to detect a visual target in a rapidly changing sequence of visual distractors. A high tone embedded in a sequence of low tones improved detection of a synchronously presented visual target (Experiment 1), but the effect disappeared when the high tone was presented before the target (Experiment 2). Rhythmically based or order-based anticipation was unlikely to account for the effect because the improvement was unaffected by whether there was jitter (Experiment 3) or a random number of distractors between successive targets (Experiment 4). The facilitatory effect was greatly reduced when the tone was less abrupt and part of a melody (Experiments 5 and 6). These results show that perceptual organization in the auditory modality can have an effect on perceptibility in the visual modality.     

Attentional limitations in processing sequentially presented vibrotactile targets

In seven experiments, participants experienced rapid, serially presented streams of vibrations and responded to specific targets in the streams. In visual (and sometimes auditory) streams presented in this manner, it is typical to find a deficit in reporting the second of two targets when both must be reported and the second appears within a short temporal interval of the first, but not when identical displays are presented but only the second target must be reported (e.g., the attentional blink, or AB). This conventional AB pattern was found in the last experiment, in which judgments were about target location. However in the first six experiments reported here, in which judgments were about frequency, intensity, duration, or location of targets, accuracy was dependent on target separation regardless of whether or not the first target was reported. This unconventional pattern could represent an AB if the first target was attended even when it was not reported. The evidence for this claim and an alternative possibility that location judgments are especially sensitive to attention manipulations are discussed.     

双通道分配性注意对视听觉返回抑制的影响

本研究基于线索-靶子范式, 操纵目标刺激类型(视觉、听觉、视听觉)与线索有效性(有效线索、中性条件、无效线索)两个自变量, 通过3个实验来考察双通道分配性注意对视听觉返回抑制(inhibition of return, IOR)的影响。实验1 (听觉刺激呈现在左/右侧)结果发现, 在双通道分配性注意条件下, 视觉目标产生显著IOR效应, 而视听觉目标没有产生IOR效应; 实验2 (听觉刺激呈现在左/右侧)与实验3 (听觉刺激呈现在中央)结果发现, 在视觉通道选择性注意条件下, 视觉与视听觉目标均产生显著IOR效应但二者无显著差异。结果表明：双通道分配性注意减弱视听觉IOR效应。     

视听刺激突显性对视觉主导效应的影响

本研究使用空间任务-转换范式,控制视、听刺激的突显性,探讨自下而上注意对视觉主导效应的影响。结果表明视、听刺激突显性显著地影响视觉主导效应,实验一中当听觉刺激为高突显性时,视觉主导效应显著减弱。实验二中当听觉刺激为高突显性并且视觉刺激为低突显性时,视觉主导效应进一步减弱但依然存在。结果支持偏向竞争理论,在跨通道视听交互过程中视觉刺激更具突显性,在多感觉整合过程中更具加工优势。     

视-听跨通道汉语词汇信息加工中的抑制机制

采用选择性再认的方法考察在汉语词汇加工过程中 ,视 -听跨通道信息与视觉单通道信息加工过程中的抑制机制。结果表明 :对于视觉词汇的总体再认“否”反应 ,单通道干扰条件下的成绩优于跨通道干扰条件下的成绩。在视觉词汇加工过程中 ,对外在干扰材料的抑制效率不受输入干扰刺激的通道的影响。抑制效率受干扰材料语义关系性的影响 ,与目标材料属于同一语义范畴的比异范畴的干扰材料更难以被抑制。     

启动刺激含有多个靶子条件下的负启动效应

采用数字命名任务,在通常的负启动范式基础上增加启动刺激靶子数目．进行了两个实验。实验一发现,当启动刺激靶子个数为1个和2个时。出现负启动效应;当启动刺激靶子个数为3个和4个时。则不出现负启动效应。这提示靶子所获注意资源数量的作用。实验二发现．当启动刺激有2个和3个靶子时．如果未被选择来反应的靶子成为探测刺激的靶子,其反应时与控制组无显著差异。即不出现负启动。这表明在启动刺激中未被选择来反应的靶子与干扰项所受到的加工是有差别的。     

The modality shift effect and the effectiveness of warning signals in different modalities

Which is better, a visual or an auditory warning signal? Initial findings suggested that an auditory signal was more effective, speeding reaction to a target more than a visual warning signal, particularly at brief foreperiods [Bertelson, P., & Tisseyre, F. (1969). The time-course of preparation: confirmatory results with visual and auditory warning signals. Acta Psychologica, 30. In W.G. Koster (Ed.), Attention and Performance II (pp. 145-154); Davis, R., & Green, F. A. (1969). Intersensory differences in the effect of warning signals on reaction time. Acta Psychologica, 30. In W.G. Koster (Ed.), Attention and Performance II (pp. 155-167)]. This led to the hypothesis that an auditory signal is more alerting than a visual warning signal [Sanders, A. F. (1975). The foreperiod effect revisited. Quarterly Journal of Experimental Psychology, 27, 591-598; Posner, M. I., Nissen, M. J., & Klein, R. M. (1976). Visual dominance: an information-processing account of its origins and significance. Psychological Review, 83, 157-171]. Recently [Turatto, M., Benso, F., Galfano, G., & Umilta, C. (2002). Nonspatial attentional shifts between audition and vision. Journal of Experimental Psychology: Human Perception and Performance, 28, 628-639] found no evidence for an auditory warning signal advantage and showed that at brief foreperiods a signal in the same modality as the target facilitated responding more than a signal in a different modality. They accounted for this result in terms of the modality shift effect, with the signal exogenously recruiting attention to its modality, and thereby facilitating responding to targets arriving in the modality to which attention had been recruited. The present study conducted six experiments to understand the cause of these conflicting findings. The results suggest that an auditory warning signal is not more effective than a visual warning signal. Previous reports of an auditory superiority appear to have been caused by using different locations for the visual warning signal and visual target, resulting in the target arriving at an unattended location when the foreperiod was brief. Turatto et al.'s results were replicated with a modality shift effect at brief foreperiods. However, it is also suggested that previous measures of the modality shift effect may still have been confounded by a location cuing effect.     

The category effect in visual search depends on physical rather than conceptual differences

Is a target letter (digit) more readily detected in a digit (letter) background because of conceptual-level differences between letters and digits or because of physical-level differences? When letters and digits were matched on physical features, both for the target set and the background set, no letter vs. digit category effect was found. With physical differences eliminated, search was faster and more accurate for letter than for digit targets and distractors, presumably because of the greater familiarity of letters. Presenting the same characters in normal and mirrorreversed orientation, which also minimized featural differences between categories, produced only a small normal vs. reversed category effect. In a normal background, a reversed target lost much more from its unfamiliarity than it gained from mismatching the background. The present results indicate that the category effect vanishes when only conceptual level differences are present.     

Visual dominance and attention: the Colavita effect revisited

Under many conditions, humans display a robust tendency to rely more on visual information than on other forms of sensory information. Colavita (1974) illustrated this visual dominance effect by showing that naive observers typically fail to respond to clearly suprathreshold tones if these are presented simultaneously with a visual target flash. In the present study, we demonstrate that visual dominance influences performance under more complex stimulation conditions and address the role played by attention in mediating this effect. In Experiment 1, we show the Colavita effect in the simple speeded detection of line drawings and naturalistic sounds, whereas in Experiment 2 we demonstrate visual dominance when the task targets (auditory, visual, or bimodal combinations) are embedded among continuous streams of irrelevant distractors. In Experiments 3-5, we address the consequences of varying the probability of occurrence of targets in each sensory modality. In Experiment 6, we further investigate the role played by attention on visual dominance by manipulating perceptual load in either the visual or the auditory modality. Our results demonstrate that selective attention to a particular sensory modality can modulate--although not completely reverse--visual dominance as illustrated by the Colavita effect.     

选择性注意和分配性注意对多感觉整合的不同影响*

以简单图形为视觉刺激,以短纯音作为听觉刺激,通过指导被试注意不同通道（注意视觉、注意听觉、注意视听）以形成不同注意状态（选择性注意和分配性注意）,考察了注意对多感觉整合的影响,发现只有在分配性注意时被试对双通道目标的反应最快最准确。通过竞争模型分析发现,这种对双通道目标的加工优势源自于视听双通道刺激的整合。上述结果表明,只有在分配性注意状态下才会产生多感觉整合。