The crossmodal facilitation of visual object representations by sound: evidence from the backward masking paradigm

We report a series of experiments designed to demonstrate that the presentation of a sound can facilitate the identification of a concomitantly presented visual target letter in the backward masking paradigm. Two visual letters, serving as the target and its mask, were presented successively at various interstimulus intervals (ISIs). The results demonstrate that the crossmodal facilitation of participants' visual identification performance elicited by the presentation of a simultaneous sound occurs over a very narrow range of ISIs. This critical time-window lies just beyond the interval needed for participants to differentiate the target and mask as constituting two distinct perceptual events (Experiment 1) and can be dissociated from any facilitation elicited by making the visual target physically brighter (Experiment 2). When the sound is presented at the same time as the mask, a facilitatory, rather than an inhibitory effect on visual target identification performance is still observed (Experiment 3). We further demonstrate that the crossmodal facilitation of the visual target by the sound depends on the establishment of a reliable temporally coincident relationship between the two stimuli (Experiment 4); however, by contrast, spatial coincidence is not necessary (Experiment 5). We suggest that when visual and auditory stimuli are always presented synchronously, a better-consolidated object representation is likely to be constructed (than that resulting from unimodal visual stimulation).     

Manipulability and living/non-living category effects on object identification

Object naming studies have generally observed that both normal and brain damaged individuals are faster and more accurate at identifying non-living objects than living objects (). However, a potential confounding variable, manipulability, has been present in past studies that may mediate this effect. Previous studies that have observed a non-living advantage have often used manipulable and non-manipulable exemplars to represent the non-living and living groups, respectively. Under conditions which controlled for object manipulability and familiarity, results demonstrated advantages for the identification of non-manipulable and for living objects.     

Infants' object category formation and use: Real-world context effects on category use in object processing

Three experiments investigated category formation based on real-world encounters with objects and how that category knowledge functioned as a top-down influence on infants' scene processing. 5-month-old infants received various experiences with exemplars of an object category and then were shown a display containing 2 adjacent novel objects, 1 of which was a novel exemplar of the category. If infants recognized this novel exemplar, they could use category information to determine the boundary between the 2 objects. Only infants who experienced object exemplars in situations that closely mimicked everyday infant experiences with objects successfully parsed the display. Results suggest that regularities in the contexts where infants experience similar objects help infants link their experiences and form object categories that can be used to segregate novel scenes. These results shed light on the real-world process of infant knowledge base formation and on how infants use their knowledge base to segment real-world scenes.     

The role of sensory-motor information in object recognition: evidence from category-specific visual agnosia

The role of sensory-motor representations in object recognition was investigated in experiments involving AD, a patient with mild visual agnosia who was impaired in the recognition of visually presented living as compared to non-living entities. AD named visually presented items for which sensory-motor information was available significantly more reliably than items for which such information was not available; this was true when all items were non-living. Naming of objects from their associated sound was normal. These data suggest that both information about object form computed in the ventral visual system as well as sensory-motor information specifying the manner of manipulation contribute to object recognition.     

3-d interpolation in object perception: evidence from an objective performance paradigm

Object perception requires interpolation processes that connect visible regions despite spatial gaps. Some research has suggested that interpolation may be a 3-D process, but objective performance data and evidence about the conditions leading to interpolation are needed. The authors developed an objective performance paradigm for testing 3-D interpolation and tested a new theory of 3-D contour interpolation, termed 3-D relatability. The theory indicates for a given edge which orientations and positions of other edges in space may be connected to it by interpolation. Results of 5 experiments showed that processing of orientation relations in 3-D relatable displays was superior to processing in 3-D nonrelatable displays and that these effects depended on object formation. 3-D interpolation and 3-D relatabilty are discussed in terms of their implications for computational and neural models of object perception, which have typically been based on 2-D-orientation-sensitive units.     

Age of acquisition, not word frequency affects object recognition: evidence from the effects of visual degradation

Four experiments examined how age of acquisition (AoA) and word frequency (WF) interact with manipulations of image quality in a picture-naming task. Experiments 1 and 2 examined the effect of overlaying the to-be-named picture with irrelevant contours. The magnitude of the AoA effect increased when the contours were added (Experiment 1), but the effect of WF remained constant (Experiment 2). Experiments 3 and 4 examined the effects of reducing the contrast of the contours defining the to-be-named picture. Both the effects of AoA (Experiment 3) and WF (Experiment 4) remained constant in the face of contrast reduction. These results provide an empirical dissociation of the effects of AoA and WF. The results are consistent with the idea that both AoA and the addition of irrelevant contours affect the efficiency of object recognition, but WF affects later processes involved in retrieval of object names. The theoretical implications of these findings in relation to accounts of AoA and frequency and their functional localisation in the lexical system are discussed.     

Perceptual differentiation as a source of category effects in object processing: Evidence from naming and object decision

The locus of category effects in picture recognition and naming was examined in two experiments with normal subjects. Subjects carried out object decision (deciding whether the stimulus is a “real” object or not) and naming tasks with pictures of clothing, furniture, fruit, and vegetables. These categories are distinguished by containing either relatively many exemplars with similar perceptual structures (fruit and vegetables;structurally similar categories), or relatively few exemplars with similar perceptual structures (clothing and furniture;structurally dissimilar categories). In Experiment 1, responses to the stimuli from the structurally similar categories were slower than responses to stimuli from the structurally dissimilar categories, and this effect was larger in the naming than in the object decision task. Further, prior object decisions to stimuli from structurally similar categories facilitated their subsequent naming. In Experiment 2, we orthogonally manipulated object decision and naming as prime and target tasks, again with stimuli from the four categories. Category effects, with responses slower to objects from structurally similar categories, were again larger in naming than in object decision, and these category effects in naming were reduced by priming with both naming and object decision. We interpret the data to indicate that category effects in object naming can reflect visually based competition which is reduced by the preactivation of stored structural knowledge for objects.     

多目标觉知范式检验视觉意识容量

采用一种新的多目标觉知范式检验视觉意识容量。实验中首先迅速呈现包含8个刺激的圆形阵列（刺激位置随机分布）,然后所有刺激被灰色的圆覆盖,并随机选取阵列中的一个刺激作为目标,要求被试用尽可能少的点击次数找到目标。结果发现,即使被试不能一次击中目标,其也可能拥有对目标不精确的视觉信息。这些不精确的视觉信息能够帮助被试用更少的点击次数和更短的点击距离找到目标,且被试对这些不精确的视觉信息是有意识的。研究结果表明视觉意识能够以概率性的表征存在,并支持视觉整体统计假说,也能够进一步解释视觉意识容量的主观测量和客观测量之间存在的冲突。     

Phonological effects in handwriting production: evidence from the implicit priming paradigm

In the present article, we report 3 experiments using the odd-man-out variant of the implicit priming paradigm, aimed at determining the role played by phonological information during the handwriting process. Participants were asked to write a small set of words learned in response to prompts. Within each block, response words could share initial segments (constant homogeneous) or not (heterogeneous). Also, 2 variable homogeneous blocks were created by including a response word that did not share orthographic onset with the other response (odd-man-out). This odd-man-out could be phonologically related to the targets or not. Experiment 1 showed a preparation effect in the constant homogeneous condition, which disappeared (spoil effect) in the variable condition not phonologically related. However, no spoil effect was found when the odd-man-out shared the phonological initial segment with the targets. In Experiment 2, we obtained a spoil effect in the variable phonologically related condition, but it was significantly smaller than in the variable not phonologically related condition. The effects observed in Experiment 2 vanished in Experiment 3 under articulatory suppression, suggesting that they originated at a sublexical level. These findings suggest that phonological sublexical information is used during handwriting and provide evidence that the implicit priming paradigm (and the odd-man-out version of this) is a suitable tool for handwriting production research.     

Age of acquisition affects object recognition: evidence from visual duration thresholds

The impact of age of acquisition (AoA) on object recognition was explored in three experiments measuring visual duration threshold (VDT) for the identification of pictures labelled with early and late acquired names. Participants viewed briefly displayed images preceded and followed by a pattern mask. The minimum display duration required for correct identification was shorter for pictures labelled with early names than for those labelled with late names. In Experiments 2 and 3 we explored the effects of two forms of visual degradation on VDT for pictures with early and late acquired names. Both degradation by superimposed visual elements, and degradation by contrast reduction extended VDT, but only the former interacted with AoA. We conclude that both AoA and degradation by superimposed visual elements affect the efficiency of visual object recognition, but only degradation by contrast and not AoA affects the efficiency of earlier pre-recognition processes.     

Semantic category effects in visual word search

The initial question was whether subjects could categorize a word semantically before they precisely identified the word itself. This failed to occur. When searching a visual display for a single target word, subjects searched at the same rate whether the distractors were in the same or in a different semantic category. However, when the size of the target set was increased to three, then six, items, subjects increasingly used category information to speed their search rate when targets and distractors belonged to different categories. Subjects appeared to perform the task by comparing the category of each display word to the category of the target set.     

The locus of redundant-targets and nontargets effects: evidence from the psychological refractory period paradigm

In target detection tasks, responses are faster when displays have 2 targets (redundant-targets effect; RTE) and slower when they have no targets (nontargets effect; NTE) relative to displays with a single target. The psychological refractory period paradigm was used to localize these effects. In Experiment 1, participants classified tones as high or low and then classified letters as targets or nontargets after a short or long stimulus onset asynchrony (SOA). The magnitudes of the RTE and NTE did not depend on SOA. In Experiment 2, the order of the tasks was reversed, and at short SOAs the RTE and NTE had similar magnitudes for both tone discrimination and target detection responses. These findings suggest that the RTE and NTE arise during response selection. Interactive effects of tone pitch with the number and type of target features were also observed, and these were tentatively interpreted as synesthetic effects.     

Studying visual attention using the multiple object tracking paradigm: A tutorial review

Human observers are capable of tracking multiple objects among identical distractors based only on their spatiotemporal information. Since the first report of this ability in the seminal work of Pylyshyn and Storm (1988, Spatial Vision, 3, 179–197), multiple object tracking has attracted many researchers. A reason for this is that it is commonly argued that the attentional processes studied with the multiple object paradigm apparently match the attentional processing during real-world tasks such as driving or team sports. We argue that multiple object tracking provides a good mean to study the broader topic of continuous and dynamic visual attention. Indeed, several (partially contradicting) theories of attentive tracking have been proposed within the almost 30 years since its first report, and a large body of research has been conducted to test these theories. With regard to the richness and diversity of this literature, the aim of this tutorial review is to provide researchers who are new in the field of multiple object tracking with an overview over the multiple object tracking paradigm, its basic manipulations, as well as links to other paradigms investigating visual attention and working memory. Further, we aim at reviewing current theories of tracking as well as their empirical evidence. Finally, we review the state of the art in the most prominent research fields of multiple object tracking and how this research has helped to understand visual attention in dynamic settings.     

The effects of concurrent task interference on category learning: evidence for multiple category learning systems

Participants learned simple and complex category structures under typical single-task conditions and when performing a simultaneous numerical Stroop task. In the simple categorization tasks, each set of contrasting categories was separated by a unidimensional explicit rule, whereas the complex tasks required integrating information from three stimulus dimensions and resulted in implicit rules that were difficult to verbalize. The concurrent Stroop task dramatically impaired learning of the simple explicit rules, but did not significantly delay learning of the complex implicit rules. These results support the hypothesis that category learning is mediated by multiple learning systems.     

Lexical- and perceptual-based object effects in the two-rectangle cueing paradigm

Previous studies demonstrate that attentional selection can be object-based, in which the object is defined in terms of Gestalt principles or lexical organizations. Here we investigate how attentional selection functions when the two types of objects are manipulated jointly. Experiment 1 replicated Li and Logan (2008) by showing that attentional shift between two Chinese characters is more efficient when they form a compound word than when they form a nonword. Experiment 2A presented characters either alone or within rectangles (Egly, Driver, & Rafal, 1994) and the characters in a rectangle formed either a word or a nonword. Experiment 2B differed from Experiment 2A in that the two characters forming a word were in different rectangles. Experiment 3A presented the two characters of a word either within a rectangle or in different rectangles. Experiment 3B used the same design as Experiment 3A but presented stimuli of different types in random orders, rather than in blocks as in Experiments 2A, 2B and 3A. In blocked presentation, detection responses to the target color on a character were faster when this character and the cue character formed a word than when they did not, and the size of this lexical-based object effect did not vary according to whether the two characters were presented alone or within or between rectangles. In random presentation, however, the lexical-based object effect was diminished when the two characters of a word were presented in different rectangles. Overall, these findings suggest that the processes that constrain attention deployment over conjoined objects can be strategically adjusted.     

Age differences in implicit memory: fragmented object identification and category exemplar generation.

In a cross-sectional study of 164 participants aged 21 to 91, the authors examined age differences on two implicit tests, fragmented object identification (FOI) and category exemplar generation (CEG), and on tests of explicit memory, attention, and verbal fluency. FOI results revealed impaired perceptual skill learning in those over 60 and a decrease in perceptual priming across young, middle-aged, and older groups. CEG priming was impaired in those over 80. Regression analysis revealed explicit contamination of priming on both the FOI and CEG tests. Across the three implicit measures, age accounted for 4 to 13% of the variance when explicit memory was controlled. Semantic fluency predicted CEG priming, suggesting possible frontal lobe involvement on the test. Altogether, results indicate that age has a small but reliable influence on implicit memory.     

The visual system supports online translation invariance for object identification

The ability to recognize the same image projected to different retinal locations is critical for visual object recognition in natural contexts. According to many theories, the translation invariance for objects extends only to trained retinal locations, so that a familiar object projected to a nontrained location should not be identified. In another approach, invariance is achieved “online,” such that learning to identify an object in one location immediately affords generalization to other locations. We trained participants to name novel objects at one retinal location using eyetracking technology and then tested their ability to name the same images presented at novel retinal locations. Across three experiments, we found robust generalization. These findings provide a strong constraint for theories of vision.     

Attentional requirements is visual detection and identification: evidence from the attentional blink

Perception of the 2nd of 2 targets (T1 and T2) is impaired if the lag between them is short (0-500 ms). The authors used this attentional blink (AB) to index attentional requirements in detection and identification tasks, with or without backward masking of T2, in 2 stimulus domains (line orientation, coherent motion). With masking, the AB occurred because T2 was masked during the attentional dwell time created by T1 processing (Experiments 1, 2, and 3). Without masking, an AB occurred only in identification because during the attentional dwell time, T2 decayed to a level that could support simple detection but not complex identification. However, an AB occurred also in detection if T2 was sufficiently degraded (Experiment 4). The authors drew 2 major conclusions: (a) Attention is required in both identification and detection, and (b) 2 factors contribute to the AB, masking of T2 while attention is focused on T1 and decay of the T2 trace while unattended.