The visual system supports online translation invariance for object identification

The ability to recognize the same image projected to different retinal locations is critical for visual object recognition in natural contexts. According to many theories, the translation invariance for objects extends only to trained retinal locations, so that a familiar object projected to a nontrained location should not be identified. In another approach, invariance is achieved “online,” such that learning to identify an object in one location immediately affords generalization to other locations. We trained participants to name novel objects at one retinal location using eyetracking technology and then tested their ability to name the same images presented at novel retinal locations. Across three experiments, we found robust generalization. These findings provide a strong constraint for theories of vision.     

Newborns' recognition of changing and unchanging aspects of schematic faces

The present study investigated newborns' ability to discriminate, recognize, and learn visual information embedded in the schematic face-like patterns preferred at birth. Four experiments were carried out using the visual-paired comparison paradigm. Results indicated that newborns discriminated face-like stimuli relying on their internal features (Experiments 1 and 4) and recognized a perceptual invariance between face-like configurations in conditions of low (Experiment 2) and high-perceptual variability (Experiment 3) of their inner elements. Altogether, data show that the presence of the preferred structure that schematically defines a face, displaying a triplet of elements in the correct locations for eyes and mouth, does not constitute a limit that constrains newborns' face learning processes.     

An attention account of neural priming

Repetition priming of familiar stimuli (e.g., objects) produces a decrease in visual cortical activity for repeated versus novel items, which has been attributed to more fluent processing for repeated items. By contrast, priming of unfamiliar stimuli (e.g., abstract shapes) produces an increase in visual cortical activity. The mechanism for priming-related increases in activity for repeated unfamiliar stimuli is unknown. We hypothesised that such increases in activity may reflect attentional allocation to these items. We tested this hypothesis using a priming-spatial attention paradigm. During Phase 1 of Experiment 1, participants viewed unfamiliar abstract shapes and familiar objects. During Phase 2, participants identified target letters (S or H). Each target letter was preceded by a non-informative shape or object cue that was repeated (from Phase 1) or novel in the same (valid) or opposite (invalid) hemifield. In Experiment 2, we manipulated shape familiarity by presenting shapes once or six times during Phase 1. For both experiments, at valid locations, target identification accuracy was higher following repeated versus novel unfamiliar item cues and lower following repeated versus novel familiar item cues. These findings support our hypothesis that priming-related increases in visual cortical activity for repeated unfamiliar items may, in part, reflect attentional allocation.     

Orientation Invariance and Geometric Primitives in Shape Recognition

Although it is generally assumed that vision is orientation invariant, that is, that shapes can be recognized regardless of viewing angle, there is little evidence that speaks directly to this issue, and what evidence there is fails to support orientation invariance. We propose an explanation for the previous results in terms of the kinds of shape primitives used by the visual system in achieving orientation invariance: Whereas contours are used at stages of vision that ore not orientation invariant, surfaces and/or volumes are used at stages of vision that are orientation invariant. The stimuli in previously reported studies were wire forms, which can represented only in terms of contour. In four experiments, testing both short-term and long-term memory for shape, we replicated the previous failures of orientation invariance using wire forms, but found relatively good or perfect orientation invariance with equivalently shaped surfaces.     

Visual mental rotation of possible and impossible objects

Participants were tested on two visual mental rotation tasks using three-dimensional "possible" and "impossible" shapes. Both types of stimuli can be easily encoded by their parts and how they are spatially organized. However, while possible shapes can also be easily encoded as a global image, it is more difficult to encode impossible shapes in such a way. Participants visually rotated both types of stimuli at comparable rates, reflecting that local representations were used in the process of visual mental rotation.     

Limited translation invariance of human visual pattern recognition

Visual object recognition is considered to be largely translation invariant. An earlier study (Foster & Kahn, 1985), however, has indicated that recognition of complex novel stimuli is partially specific to location in the visual field: It is significantly easier to determine the identity of two briefly displayed random patterns if both stimuli are presented at the same, rather than at different, locations. In a series ofsame/different discrimination tasks, we characterize the processes underlying this “displacement effect”: Horizontal and vertical translations are equally effective in reducing performance. Making the task more difficult by increasing pattern similarity leads to even higher positional specificity. The displacement effect disappears after rotation or contrast reversal of the patterns, indicating that positional specificity depends on relatively low levels of processing. Control experiments rule out explanations that are independent of visual pattern memory, such as spatial attention, eye movements, or retinal afterimages. Positional specificity of recognition is found only forsame trials. Our results demonstrate that position invariance, a widely acknowledged property of the human visual system, is limited to specific experimental conditions. Normalization models involving mental shifts of an early visual representation or of a window of attention cannot easily account for these findings.     

Visual and haptic discrimination of symmetry in unfamiliar displays extended in the z-axis

We investigated, in two experiments, the discrimination of bilateral symmetry in vision and touch using four sets of unfamiliar displays. They varied in complexity from 3 to 30 turns. Two sets were 2-D flat forms (raised-line shapes and raised surfaces) while the other two were 3-D objects constructed by extending the 2-D shapes in height (short and tall objects). Experiment 1 showed that visual accuracy was excellent but latencies increased for raised-line shapes compared with 3-D objects. Experiment 2 showed that unimanual exploration was more accurate for asymmetric than for symmetric judgments, but only for 2-D shapes and short objects. Bimanual exploration at the body midline facilitated the discrimination of symmetric shapes without changing performance with asymmetric ones. Accuracy for haptically explored symmetric stimuli improved as the stimuli were extended in the third dimension, while no such a trend appeared for asymmetric stimuli. Unlike vision, haptic response latency decreased for 2-D shapes compared with 3-D objects. The present results are relevant to the understanding of symmetry discrimination in vision and touch.     

Perceptual interference and hemispheric specialization

Two experiments evaluated the effect of stimuli presented at fixation on the recognition of faces or random shapes presented to the left or right visual half-field (VF). Increasing the processing demands of the center stimulus produced a large, linear decrease in recognition from both VFs for both faces and shapes. Recognition of random shapes was decreased more in the right visual field by center digits and in the left VF by center faces and shapes. In addition, interference was found between the VF faces and the center digits to the left of fixation. It was concluded that differences in the processing capacity of the two hemispheres are a function of the verbal-nonverbal nature of the stimuli at a later stage in processing but that the two hemispheres may also differ along other perceptual dimensions at an earlier stage of visual recognition.     

Serial position effects in the identification of letters, digits, symbols, and shapes in peripheral vision

Three experiments measured serial position functions for character-in-string identification in peripheral vision. In Experiment 1, random strings of five letters (e.g., P F H T M) or five symbols (e.g., λ Б Þ Ψ ¥) were briefly presented to the left or to the right of fixation, and identification accuracy was measured at each position in the string using a post-cued two-alternative forced-choice task (e.g., was there a T or a B at the 4th position). In Experiment 2 the performance to letter stimuli was compared with familiar two-dimensional shapes (e.g., square, triangle, circle), and in Experiment 3 we compared digit strings (e.g., 6 3 7 9 2) with a set of keyboard symbols (e.g., % 4 @ < ?). Eye-movements were monitored to ensure central fixation. The results revealed a triple interaction between the nature of the stimulus (letters/digits vs. symbols/shapes), eccentricity, and visual field. In all experiments this interaction reflected a selective left visual field advantage for letter or digit stimuli compared with symbol or shape stimuli for targets presented at the greatest eccentricity. The results are in line with the predictions of the modified receptive field hypothesis proposed by Tydgat and Grainger (2009), and the predictions of the SERIOL2 model of letter string encoding.     

Shape constancy: The effects of changing shape orientation and the effects of changing the position of focal features

Five experiments examined the time taken to judge that two consecutive elongated geometrical shapes had the same structure, irrespective of their orientation. Shape transformations either changed the orientation of the principal axis while maintaining the relative locations of focal features or maintained the orientation of the principal axis while changing the relative locations of focal features, or they changed both. Experiment 1 demonstrated that changes in the orientation of the principal axis were more detrimental to matching than were changes in the locations of the shape’s focal features. Indeed, the time taken to match same-orientation shapes was the same as that taken to match shapes that maintained the same position in the visual field. Further experiments showed that this result was not due to differential apparent motion in the transformation conditions, that it was not due to response bias, and that it generalized across shapes. However, the result was different when subjects could predict the location of the to-be-matched stimulus. In this case, performance was principally affected by the position of the focal feature of the shape and not by the shape’s orientation. It is suggested that the results reflect the efficiency with which subjects can construct matching representations for the stimuli When subjects cannot predict stimulus locations, they generate representations by describing shape structure relative to the shape’s principal axis. When the axis of the to-be-matched shapes is constant, subjects can use the same procedure in generating this representation for both shapes, facilitating matching relative to the case in which the orientation of the axis changes. When subjects can predict the stimulus location, they selectively attend to the focal features of shapes, minimizing the effects of shape orientation.     

Head-centred meridian effect on auditory spatial attention orienting

Six experiments examined the issue of whether one single system or separate systems underlie visual and auditory orienting of spatial attention. When auditory targets were used, reaction times were slower on trials in which cued and target locations were at opposite sides of the vertical head-centred meridian than on trials in which cued and target locations were at opposite sides of the vertical visual meridian or were not separated by any meridian. The head-centred meridian effect for auditory stimuli was apparent when targets were cued by either visual (Experiments 2, 3, and 6) or auditory cues (Experiment 5). Also, the head-centred meridian effect was found when targets were delivered either through headphones (Experiments 2, 3, and 5) or external loudspeakers (Experiment 6). Conversely, participants showed a visual meridian effect when they were required to respond to visual targets (Experiment 4). These results strongly suggest that auditory and visual spatial attention systems are indeed separate, as far as endogenous orienting is concerned.     

Textures shape the attentional focus: Evidence from exogenous and endogenous cueing

The spatial cueing paradigm (Posner Quarterly Journal of Experimental Psychology 32:3–25, 1980) has often been used to investigate the time course of the deployment of visual attention in space. In a series of eight experiments we investigated whether spatial cues would not only enhance processing of stimuli presented at cued locations, but also enhance processing of the entire texture in which the stimuli were presented. Results showed highest accuracy for responses to stimuli presented at cued locations, a replication of the traditional cueing effect (Posner 1980). Additionally, stimuli presented at uncued locations were responded to with higher accuracy when they were presented inside the same texture as the cued location, as compared with stimuli presented outside the texture with the cued location. To investigate this texture advantage for both automatic and voluntary attention deployment, exogenous and endogenous cues were used. The texture advantage was observed for short interstimulus intervals (ISIs) of 50 and 100 ms for exogenous cues and for a longer ISI of 200 ms for endogenous cues. These findings indicate that the arrangement of task-irrelevant visual stimuli also can have a large impact on the cueing effect. This suggests that visual spatial attention spreads texture-wise across the visual field. Control experiments revealed that the homogeneity within texture elements contributes most to the effect but that the texture advantage is a function of both orientation contrast at the texture border and homogeneity within texture elements.     

Role of Attention and Perceptual Grouping in Visual Statistical Learning

Statistical learning has been widely proposed as a mechanism by which observers learn to decompose complex sensory scenes. To determine how robust statistical learning is, we investigated the impact of attention and perceptual grouping on statistical learning of visual shapes. Observers were presented with stimuli containing two shapes that were either connected by a bar or unconnected. When observers were required to attend to both locations at which shapes were presented, the degree of statistical learning was unaffected by whether the shapes were connected or not. However, when observers were required to attend to just one of the shapes' locations, statistical learning was observed only when the shapes were connected. These results demonstrate that visual statistical learning is not just a passive process. It can be modulated by both attention and connectedness, and in natural scenes these factors may constrain the role of stimulus statistics in learning.     

Does the use of natural stimuli facilitate amodal completion in pigeons?

Three experiments were carried out to investigate whether amodal completion in pigeons can be facilitated by the use of colour photographs instead of highly artificial stimuli such as geometrical shapes. Ten pigeons were trained in a go/no-go procedure to discriminate between photographs of complete and of incomplete pigeon figures. In the subsequent test, the birds classified pictures of partly occluded pigeons as though they were complete (experiment 1). However, we found evidence that classification was based on spurious stimulus features that paralleled the intended class rule of figural completeness versus incompleteness. In particular, classification was shown to be guided by white background gaps that separated the parts of the fragmented pigeon figures (experiment 2), as well as by cues related to overall Gestalt (experiment 3). In summary, the present results indicate that the use of more natural stimuli such as photographs instead of geometrical shapes is insufficient for providing amodal completion in pigeons. It is suggested that a combination of various cues, including, eg, 3-D information and common motion in addition to surface and contour properties, may be required to induce a perceptual bias favouring visual completion of occluded portions.     

视觉表象产生的大脑半球专门化效应

采用Kosslyn单侧视野速示技术, 以英文字母图片为学习材料, 通过三个实验考察了视觉表象产生的大脑半球专门化效应。实验一提出在两种类型的视觉表象产生任务中, 有两种截然不同的加工起作用, 但却不能直接证实这两种不同加工机制的存在。实验二和实验三则进一步证实了两种表象产生任务具有不同的认知加工机制, 并表现出不同的大脑半球专门化效应。上述研究表明: 大脑两半球均参与产生视觉心理表象, 但分工不同, 并表现出不同的单侧化效应: 大脑左半球通过运用类别空间关系产生表象更有效, 大脑右半球运用数量空间关系产生表象更有效。结果进一步拓展了Kosslyn关于视觉空间关系加工的大脑半球专门化观点。     

On the role of eye movements and saccade preparation in generating auditory inhibition of return.

In three experiments, listeners were required to either localize or identify the second of two successive sounds. The first sound (the cue) and the second sound (the target) could originate from either the same or different locations, and the interval between the onsets of the two sounds (Stimulus Onset Asynchrony, SOA) was varied. Sounds were presented out of visual range at 135 azimuth left or right. In Experiment 1, localization responses were made more quickly at 100 ms SOA when the target sounded from the same location as the cue (i.e., a facilitative effect), and at 700 ms SOA when the target and cue sounded from different locations (i.e., an inhibitory effect). In Experiments 2 and 3, listeners were required to monitor visual information presented directly in front of them at the same time as the auditory cue and target were presented behind them. These two experiments differed in that in order to perform the visual task accurately in Experiment 3, eye movements to visual stimuli were required. In both experiments, a transition from facilitation at a brief SOA to inhibition at a longer SOA was observed for the auditory task. Taken together these results suggest that location-based auditory IOR is not dependent on either eye movements or saccade programming to sound locations.     

Stroop interference is affected in inhibition of return

In previous research, we have shown that the processing of targets that are presented to locations subject to inhibition of return (IOR) is affected by an inhibitory tagging mechanism. This mechanism acts by disconnecting activated representations of stimuli at inhibited locations from their associated responses. In two experiments, we assessed whether this inhibitory tagging mechanism of visual attention is also applied to task-irrelevant but prepotent dimensions of target stimuli, such as words in the Stroop task. To test this hypothesis, we examined the Stroop effect in an IOR procedure. The results showed that (1) IOR can be found in a color discrimination task, (2) the Stroop interference was reduced (Experiment 1) or eliminated (Experiment 2) when stimuli appeared at cued locations, as compared with cases in which they were presented at uncued locations, and (3) the effect of inhibitory tagging was limited to the shortest stimulus onset asynchrony value, replicating previous findings. These results agree with the idea that inhibitory tagging, occurring in IOR, affects the efficiency with which color words compete for responses in Stroop-like situations.     

When do spatial and visual working memory interact?

This study examined how spatial working memory and visual (object) working memory interact, focusing on two related questions: First, can these systems function independently from one another? Second, under what conditions do they operate together? In a dual-task paradigm, participants attempted to remember locations in a spatial working memory task and colored objects in a visual working memory task. Memory for the locations and objects was subject to independent working memory storage limits, which indicates that spatial and visual working memory can function independently from one another. However, additional experiments revealed that spatial working memory and visual working memory interact in three memory contexts: when retaining (1) shapes, (2) integrated color-shape objects, and (3) colored objects at specific locations. These results suggest that spatial working memory is needed to bind colors and shapes into integrated object representations in visual working memory. Further, this study reveals a set of conditions in which spatial and visual working memory can be isolated from one another.     

Visual evoked potentials elicited by subjective contour figures

In order to investigate the relationship between the appearance of illusory figures and the wave form of visual evoked potentials (VEPs), 8 different visual pattern stimuli were presented to 8 normal subjects. Four of the stimuli (experimental stimuli) produced subjective figures and contours (squares and discs). The 4 other stimuli (reference stimuli), although equal to the experimental stimuli in the amount of physical energy, did not produce the illusion of squares or discs. Electrodes were placed on the scalp at central and occipital locations. Three prominent peaks in the occipital record were observed in all subjects. An amplitude difference of VEP N180 (N2) between the subjective figures and the reference stimuli was found in the values for each subject. Enhancement of the VEP of the illusory figure stimuli was observed for a specific component (N2), whereas the amplitude values at the central components and the occipital P120 (P2) and P280 (P3) were almost the same as the reference values. The VEP (N2 component) amplitude enhancement at the occipital area for subjective figure stimuli suggests that illusory contour formation takes place at higher levels in the visual system. This was known from experiments using dichoptic presentation.