Schema-based processing in auditory scene analysis

What is the involvement of what we know in what we perceive? In this article, the contribution of melodic schema-based processes to the perceptual organization of tone sequences is examined. Two unfamiliar six-tone melodies, one of which was interleaved with distractor tones, were presented successively to listeners who were required to decide whether the melodies were identical or different. In one condition, the comparison melody was presented after the mixed sequence: a target melody interleaved with distractor tones. In another condition, it was presented beforehand, so that the listeners had precise knowledge about the melody to be extracted from the mixture. In the latter condition, recognition performance was better and a bias toward same responses was reduced, as compared with the former condition. A third condition, in which the comparison melody presented beforehand was transposed up in frequency, revealed that whereas the performance improvement was explained in part by absolute pitch or frequency priming, relative pitch representation (interval and/or contour structure) may also have played a role. Differences in performance as a function of mean frequency separation between target and distractor sequences, when listeners did or did not have prior knowledge about the target melody, argue for a functional distinction between primitive and schema-based processes in auditory scene analysis.     

The perception of interleaved melodies

If the notes of two melodies whose pitch ranges do not overlap are interleaved in time so that successive tones come from the different melodies, the resulting sequence of tones is perceptually divided into groups that correspond to the two melodies. Such “melodic fission” demonstrates perceptual grouping based on pitch alone, and has been used extensively in music.Experiment I showed that the identification of interleaved pairs of familiar melodies is possible if their pitch ranges do not overlap, but difficult otherwise. A short-term recognition-memory paradigm (Expt II) showed that interleaving a “background” melody with an unfamiliar melody interferes with same-different judgments regardless of the separation of their pitch ranges, but that range separation attenuates the interference effect. When pitch ranges overlap, listeners can overcome the interference effect and recognize a familiar target melody if the target is prespecified, thereby permitting them to search actively for it (Expt III). But familiarity or prespecification of the interleaved background melody appears not to reduce its interfering effects on same-different judgments concerning unfamiliar target melodies (Expt IV).     

On the nature of phase attraction in sensorimotor synchronization with interleaved auditory sequences

In a task that requires in-phase synchronization of finger taps with an isochronous sequence of target tones that is interleaved with a sequence of distractor tones at various fixed phase relationships, the taps tend to be attracted to the distractor tones, especially when the distractor tones closely precede the target tones [Repp, B. H. (2003a). Phase attraction in sensorimotor synchronization with auditory sequences: Effects of single and periodic distractors on synchronization accuracy. Journal of Experimental Psychology: Human Perception and Performance, 29, 290-309]. The present research addressed two related questions about this distractor effect: (1) Is it a function of the absolute temporal separation or of the relative phase of the two stimulus sequences? (2) Is it the result of perceptual grouping (integration) of target and distractor tones or of simultaneous attraction to two independent sequences? In three experiments, distractor effects were compared across two different sequence rates. The results suggest that absolute temporal separation, not relative phase, is the critical variable. Experiment 3 also included an anti-phase tapping task that addressed the second question directly. The results suggest that the attraction of taps to distractor tones is caused mainly by temporal integration of target and distractor tones within a fixed window of 100-150 ms duration, with the earlier-occurring tone being weighted more strongly than the later-occurring one.     

Auditory stream segregation in Japanese monkeys.

Japanese monkeys were examined to determine whether they perceptually segregate tone sequences. Monkeys were required to discriminate two sequences of tones (target sequences) differing in frequency contours. Distractor sequences were presented simultaneously with the target sequences. Monkeys could discriminate the sequences when the frequency ranges of the target and distractor sequences did not overlap, but they could not when the ranges overlapped. Subsequent probe tests confirmed that the discrimination depended on cues other than the local pitch of the component tones regardless of the presence of the distractor sequence. The results suggest that monkeys segregate tone sequences based on frequency proximity, and they perceive global characters of the segregated streams.     

The horserace between distractors and targets: Retrieval-based probe responding depends on distractor–target asynchrony

According to models assuming binding of stimulus and response features, any features can be integrated into a compound (consisting of stimulus and response features) and stored in episodic memory, even features irrelevant to the task. Reencountering any part of such an episode can retrieve the entire episode (or “event file”), including the response. That is, even the repeated presentation of a distractor can retrieve a response given to a target stimulus accompanied by this very distractor. We analysed how distractor-induced retrieval of an event-file competes with the response generation process triggered by the target by varying the stimulus onset asynchrony of targets and distractors. In particular, we used a selection task with prime–probe sequences and asynchronous onset of distractors and targets on the probe. Distractor-induced retrieval was only observed if the probe distractor appeared before or simultaneously with the probe target but not if the probe distractor appeared after probe target onset.     

Negative priming without probe selection

Responses to an object may be slower or less accurate if that object shares attributes with a recently ignored object(negative priming). Some studies have found negative priming only if the probe trial required selection against a distractor stimulus. In the present experiment, subjects responded to the location of a target (O), ignoring a distractor (X) if it appeared in another location. Reaction time was slower to probe targets that appeared in the same location as the prime distractor, regardless of whether or not the probe target was accompanied by a distractor.     

Semantic interference from visual object recognition on visual imagery

A new technique for examining the interaction between visual object recognition and visual imagery is reported. The "image-picture interference" paradigm requires participants to generate and make a response to a mental image of a previously memorized object, while ignoring a simultaneously presented picture distractor. Responses in 2 imagery tasks (making left-right higher spatial judgments and making taller-wider judgments) were longer when the simultaneous picture distractor was categorically related to the target distractor relative to unrelated and neutral target-distractor combinations. In contrast, performance was not influenced in this way when the distractor was a related word, when a semantic categorization decision was made to the target, or when distractor and target were visually but not categorically related to one another. The authors discuss these findings in terms of the semantic representations shared by visual object recognition and visual imagery that mediate performance.     

Retrieval of event files can be conceptually mediated

Distractor-based retrieval of event files was assessed with a sequential priming experiment using a four-choice identification task. Pictures or sounds of four different animals (frog, chicken, lamb, singing bird) had to be categorized by pressing one of four keys. On each trial, a target and a distractor stimulus were presented simultaneously in different modalities. The relevant modality switched randomly between trials. Distractor repetition effects were modulated by the response relation between the prime and probe: Repeating the prime distractor in the probe produced facilitation if the response repeated, but not if a different response had to be given in the prime and probe. Repeating the prime distractor in the probe led to an automatic retrieval of the prime response. Importantly, this distractor-based response retrieval effect also emerged for those sequences in which the modality of the repeated distractor was switched between the prime and probe. This cross-modal priming effect indicates that distractors were integrated into event files on a conceptual level and that response retrieval processes were mediated by conceptual codes of the distractor stimuli.     

Effect of distractor sounds on the auditory attentional blink

Four experiments were conducted to determine whether or not the presence and placement of distractors in a rapid serial auditory stream has any influence on the emergence of the auditory attentional blink (AB). Experiment 1 revealed that the presence of distractors is necessary to produce the auditory AB. In Experiments 2 and 3, the auditory AB was reduced when the distractor immediately following the probe was replaced by silence but not when the distractor following the target was replaced by silence. Finally, in Experiment 4, only a very small auditory AB was found to remain when all distractors following the probe were replaced by silence. These results suggest that the auditory AB is affected both by the overwriting of the probe by the distractors following it and by a reduction in discriminability generated by all of the distractors presented in the sequence.     

Spatial and identity negative priming in audition: Evidence of feature binding in auditory spatial memory

Two experiments are reported with identical auditory stimulation in three-dimensional space but with different instructions. Participants localized a cued sound (Experiment 1) or identified a sound at a cued location (Experiment 2). A distractor sound at another location had to be ignored. The prime distractor and the probe target sound were manipulated with respect to sound identity (repeated vs. changed) and location (repeated vs. changed). The localization task revealed a symmetric pattern of partial repetition costs: Participants were impaired on trials with identity-location mismatches between the prime distractor and probe target-that is, when either the sound was repeated but not the location or vice versa. The identification task revealed an asymmetric pattern of partial repetition costs: Responding was slowed down when the prime distractor sound was repeated as the probe target, but at another location; identity changes at the same location were not impaired. Additionally, there was evidence of retrieval of incompatible prime responses in the identification task. It is concluded that feature binding of auditory prime distractor information takes place regardless of whether the task is to identify or locate a sound. Instructions determine the kind of identity-location mismatch that is detected. Identity information predominates over location information in auditory memory.     

The role of probe trial distractors in the production/removal of the spatial negative priming effect

When a current (probe trial) target arises at a location formerly occupied by a distractor event (prime trial; ignored-repetition trial), its reaction time is slower than when it occurs at a previously empty location (control trial), revealing a spatial negative priming (SNP) effect. Here, we examined the influence of prime- and probe trial distractor identity similarity on the retrieval of the stored representations of prime trial processing (i.e., indexed by SNP production), in a context where the prevention of the SNP phenomenon had been motivated (via low probability of probe distractor presence—.25). Two results were important. One, the SNP effect was evident when the prime–probe distractor identities fully matched, but not when they partially or totally mismatched, showing a retrieval role for the probe distractor. Two, target-repeat trial latency facilitation showed the same pattern, indicating that representations of prime target and distractor processing are retrieved together, indicative of an episodic storage format. Since target identity remained fixed, the role of a matching probe distractor identity in SNP production was to presumably complete the triggering requirement (i.e., full event identity matching) for accessing the episodically stored representations.     

目标探测对记忆提取的影响

采用经典的"学习–再认"范式,在测验阶段设置了目标探测的干扰任务,通过比较目标探测和分心拒绝是否会对记忆提取产生不同的影响,以进一步探讨提取干扰与再认记忆之间的关系。结果发现,无论对目标进行显性(实验1)还是隐性(实验2)的探测反应,目标探测下旧词的再认反应均要比分心拒绝下更优,表明外显记忆的提取也会受到注意资源的调节。但更为重要的是,在辨别力指数(d′)及判断标准(C)上的差异分析发现,目标探测并没有提高被试的再认水平,而是降低了被试的判断标准,使得被试在目标探测条件下更容易对词做出"旧"反应。这种反应倾向与目标探测的动作反应方式无关,也不受词汇的编码加工水平深浅的调节。由此可见,外显记忆提取并非完全的"自动化加工",仍会受到注意资源的调节。     

The depth of distractor processing in search with clutter

Some search tasks involve looking for a category target in clutter. This is the task faced, for example, by a baggage screener looking for weapons in a suitcase. Such tasks presumably involve the segmentation and recognition of the target object, but it is unknown whether they also involve the segmentation and recognition of the distractor objects. To examine the depth of distractor processing in this task, we had observers search through cluttered displays composed of normal and chimerical distractors. The normal distractors were photographs of recognizable objects, while the chimerical distractors were created by interchanging parts between the normal objects. The obsever's task was to identify the display quadrant that contained an animal or a vehicle target. We varied the difficulty of the search task by varying target and distractor discriminability, target uncertainty, and target occlusion. Only when the target was partially occluded did we find an effect of distractor type. In this case, observers may have found the target through a process of mentally eliminating whole distractor objects. When the target was unoccluded, we found no evidence that observers selected and rejected whole distractors during search. This second result supports our previous claim that often the items for search in clutter are not whole objects.     

Dissociations between identity and location negative priming

Negative priming refers to the phenomenon of a slowed response time to a previously ignored distractor. Identity negative priming can be observed when the identity of a previous distractor is repeated as the target identity, and location negative priming can be observed when the spatial location of a previous distractor is repeated as the target location. This article reviewed and integrated previous findings and provided empirical evidence to show the dissociations between location and identity negative priming: (a) the removal of probe distractor impeded identity negative priming but not location negative priming; (b) identity negative priming was modulated by the distance between the target and distractor, while location negative priming was not; and (c) perceptual grouping of the target and distractor affected identity negative priming but not location negative priming.     

注意促进效应的ERP研究

近期发现,采用目标探测任务作为二级任务时,目标探测条件不仅不会削弱,甚至会提高记忆成绩,产生注意促进效应（ABE）。为进一步探究目标探测的作用机制,研究采用事件相关电位（ERP）技术,对比目标与分心条件在编码和提取过程中所诱发的ERP差异。结果表明,两类条件在再认过程中所诱发的ERP差异不仅表现在早期与知觉加工相关的ERP成份上,并且一直持续到了后期与细节提取相关的ERP成分上。由此推测,ABE不仅体现在编码早期的知觉加工阶段,更会延续到后期的复述与精加工。     

Object file continuity and the auditory attentional blink

Three experiments were designed to investigate the causes of the auditory attentional blink (AB). Experiments 1A and 1B revealed that there was a larger auditory AB when the target and the distractors were different in two attributes than when they were different in only one attribute. Experiments 2A and 2B showed that for pure-tone distractor sequences, there were small auditory AB deficits when both the target and the probe were different from the distractors in two attributes or in one attribute; however, for pulse distractor sequences, there was a large auditory AB when both the target and the probe were different from the distractors in one attribute, but not when they were different in two attributes. Experiments 3A and 3B revealed that regardless of the relationship of the target to the subsequent distractors, a large AB was generated if it was the first sound in a sequence. Moreover, only a very small AB was apparent when the distractors following the probe were replaced by silence. These results indicated that the auditory AB is affected by both the requirement of creating and consolidating a new object file for the target and the overwriting of the probe by the distractors following it.     

Task difficulty and visual similarity increase a distractor's effects on random shapes

Recognition of random shapes followed by a visual distractor is altered by the type of distractor and whether the distractor needs to be attended. Three experiments tested which characteristics modify a visual distractor's effect on random target shapes presented for 75 to 150 msec. Exp. 1 showed that increasing the number of digits to be remembered (1, 3, or 8) increased the effectiveness of digits as distractors. Exeir effect as visual distractors for random target shapes. Random shapes were highly effective as distractors, while pictures of faces or comples colored pictures had a relatively small effect. In Exp. 3 decreasing the presentation time for novel visual distractors decreased recognition of the distractors but not of random target shapes. However, adding a three-digit distractor after the novel visual distractor did decrease recognition of target shapes. Exps. 2 and 3 showed that the order of the recognition tests of the target and distracting stimuli altered target recognition if and only if subjects did know which was to be reported first. These experiments indicate that the effect of a visual distractor depends on both the extent to which it is allotted attention and its visual similarity to the target stimulus.     

Online recognition of music is influenced by relative and absolute pitch information

Three experiments explored online recognition in a nonspeech domain, using a novel experimental paradigm. Adults learned to associate abstract shapes with particular melodies, and at test they identified a played melody's associated shape. To implicitly measure recognition, visual fixations to the associated shape versus a distractor shape were measured as the melody played. Degree of similarity between associated melodies was varied to assess what types of pitch information adults use in recognition. Fixation and error data suggest that adults naturally recognize music, like language, incrementally, computing matches to representations before melody offset, despite the fact that music, unlike language, provides no pressure to execute recognition rapidly. Further, adults use both absolute and relative pitch information in recognition. The implicit nature of the dependent measure should permit use with a range of populations to evaluate postulated developmental and evolutionary changes in pitch encoding.     

Top-down and bottom-up attentional control: On the nature of interference from a salient distractor

In two experiments using spatial probes, we measured the temporal and spatial interactions between top-down control of attention and bottom-up interference from a salient distractor in visual search. The subjects searched for a square among circles, ignoring color. Probe response times showed that a color singleton distractor could draw attention to its location in the early stage of visual processing (before a 100-msec stimulus onset asynchrony [SOA]), but only when the color singleton distractor was located far from the target. Apparently the bottom-up activation of the singleton distractor’s location is affected early on by local interactions with nearby stimulus locations. Moreover, probe results showed that a singleton distractor did not receive attention after extended practice. These results suggest that top-down control of attention is possible at an early stage of visual processing. In the long-SOA condition (150-msec SOA), spatial attention selected the target location over distractor locations, and this tendency occurred with or without extended practice.     

A transient processing deficit following selection of an auditory target

Two experiments were conducted to examine the possibility that a transient processing deficit might result following selection of an auditory target. In both experiments, listeners were presented with a sequence of tones and required to make separate detection judgments, one regarding a target and the second regarding a subsequent probe. The target was presented following a variable number of tones, and the probe was presented in one of the seven or eight possible temporal positions following the target. The experiments differed only in that in Experiment 1 the first post-target item could be either a distractor tone or a probe, whereas in Experiment 2 the first post-target item was replaced by a silent period. In both experiments, a deficit in processing of the probe was apparent when it was presented in one of the first few positions following the target.