Principles of feature integration in visual perception

Several recent theories of visual information processing have postulated that errors in recognition may result not only from a failure in feature extraction, but also from a failure to correctly join features after they have been correctly extracted. Errors that result from incorrectly integrating features are called conjunction errors. The present study uses conjunction errors to investigate the principles used by the visual system to integrate features. The research tests whether the visual system is more likely to integrate features located close together in visual space (the location principle) or whether the visual system is more likely to integrate features from stimulus items that come from the same perceptual group or object (the perceptual group principle). In four target-detection experiments, stimuli were created so that feature integration by the location principle and feature integration by the perceptual group principle made different predictions for performance. In all of the experiments, the perceptual group principle predicted feature integration even though the distance between stimulus items and retinal eccentricity were strictly controlled.     

Position uncertainty and the perception of apparent movement

Two experiments compared the perception of apparent movement when the second of two successive stimuli always appeared in the same position and when it varied randomly between two spatial positions. The results of both experiments showed that foreknowledge of the position of the second stimulus does not facilitate the perception of apparent movement. Experiment 2 also clearly showed that the space-time relationships of Korte’s third law of apparent movement does not depend on foreknowledge of the position of the second stimulus. These findings imply that apparent movement in real time occurs after the second stimulus has been registered by the visual system. It suggests that apparent movement involves a delayed decision mechanism that stores the first stimulus, the interstimulus temporal interval, and the second stimulus, and then impletes a motion compatible with the stimulus information.     

Audiovisual identity perception from naturally-varying stimuli is driven by visual information

Identity perception often takes place in multimodal settings, where perceivers have access to both visual (face) and auditory (voice) information. Despite this, identity perception is usually studied in unimodal contexts, where face and voice identity perception are modelled independently from one another. In this study, we asked whether and how much auditory and visual information contribute to audiovisual identity perception from naturally-varying stimuli. In a between-subjects design, participants completed an identity sorting task with either dynamic video-only, audio-only or dynamic audiovisual stimuli. In this task, participants were asked to sort multiple, naturally-varying stimuli from three different people by perceived identity. We found that identity perception was more accurate for video-only and audiovisual stimuli compared with audio-only stimuli. Interestingly, there was no difference in accuracy between video-only and audiovisual stimuli. Auditory information nonetheless played a role alongside visual information as audiovisual identity judgements per stimulus could be predicted from both auditory and visual identity judgements, respectively. While the relationship was stronger for visual information and audiovisual information, auditory information still uniquely explained a significant portion of the variance in audiovisual identity judgements. Our findings thus align with previous theoretical and empirical work that proposes that, compared with faces, voices are an important but relatively less salient and a weaker cue to identity perception. We expand on this work to show that, at least in the context of this study, having access to voices in addition to faces does not result in better identity perception accuracy.     

Perceptual acceleration of objects in stream: evidence from flash-lag displays

An object in continuous motion is perceived ahead of the briefly flashed object, although the two images are physically aligned (Nijhawan, 1994), the phenomenon called flash-lag effect. Flash-lag effects have been found also with other continuously changing features such as color, pattern entropy, and brightness (Sheth, Nijhawan, & Shimojo, 2000) as well as with streamed pre- and post-target input without any change of the feature values of streaming items in feature space (Bachmann & P?der, 2001a. 2001b). We interpret all instances of the flash-lag as a consequence of a more fundamental property of conscious perception in general: acceleration of the speed with which samples of perceptual information become represented in explicit format immediately after the stimulation onset. Decreased visual latency of the samples of stimulus information from the streamed input leads to the relative perceptual lag for the separately flashed stimulus because it is not preceded by adjacent sensory input that would have accelerated its perception. Experimental support for the notion of perceptual acceleration is reviewed.     

The aftermath of memory retrieval for recycling visual working memory representations

We examined the aftermath of accessing and retrieving a subset of information stored in visual working memory (VWM)—namely, whether detection of a mismatch between memory and perception can impair the original memory of an item while triggering recognition-induced forgetting for the remaining, untested items. For this purpose, we devised a consecutive-change detection task wherein two successive testing probes were displayed after a single set of memory items. Across two experiments utilizing different memory-testing methods (whole vs. single probe), we observed a reliable pattern of poor performance in change detection for the second test when the first test had exhibited a color change. The impairment after a color change was evident even when the same memory item was repeatedly probed; this suggests that an attention-driven, salient visual change made it difficult to reinstate the previously remembered item. The second change detection, for memory items untested during the first change detection, was also found to be inaccurate, indicating that recognition-induced forgetting had occurred for the unprobed items in VWM. In a third experiment, we conducted a task that involved change detection plus continuous recall, wherein a memory recall task was presented after the change detection task. The analyses of the distributions of recall errors with a probabilistic mixture model revealed that the memory impairments from both visual changes and recognition-induced forgetting are explained better by the stochastic loss of memory items than by their degraded resolution. These results indicate that attention-driven visual change and recognition-induced forgetting jointly influence the “recycling” of VWM representations.     

Illusory causal crescents: misperceived spatial relations due to perceived causality

When an object A moves toward an object B until they are adjacent, at which point A stops and B starts moving, we often see a collision--ie we see A as the cause of B's motion. The spatiotemporal parameters which mediate the perception of causality have been explored in many studies, but this work is seldom related to other aspects of perception. Here we report a novel illusion, wherein the perception of causality affects the perceived spatial relations among two objects involved in a collision event: observers systematically underestimate the amount of overlap between two items in an event which is seen as a causal collision. This occurs even when the causal nature of the event is induced by a surrounding context, such that estimates of the amount of overlap in the very same event are much improved when the event is displayed in isolation, without a 'causal' interpretation. This illusion implies that the perception of causality does not proceed completely independently of other visual processes, but can affect the perception of other spatial properties.     

A Simon effect induced by induced motion and location: Evidence for a direct linkage of cognitive and motor maps

It has been argued that two distinct maps of visual space are formed: a cognitive map that is susceptible to illusions, and a motor map that represents the physical world veridically. In the present study, subjects responded to a nonspatial attribute of a visual target stimulus by pressing a left or right key, while an illusory horizontal displacement of the target was induced. A Simon-type effect was obtained to the induced target motion or position shift—that is, responses were faster when the illusory target motion or location corresponded to the response position. Further experiments indicated that the observed effects cannot be accounted for by attentional shifts. These results suggest that the content of the cognitive map does not only influence perceptual judgments but is also responsible for the automatic activation of response codes. In other words, perception and action seem to be fed by a common, cognitively penetrable, spatial representation.     

A Simon effect induced by induced moton and location: evidence for a direct linkage of cognitive and motor maps

It has been argued that two distinct maps of visual space are formed: a cognitive map that is susceptible to illusions, and a motor map that represents the physical world veridically. In the present study, subjects responded to a nonspatial attribute of a visual target stimulus by pressing a left or right key, while an illusory horizontal displacement of the target was induced. A Simon-type effect was obtained to the induced target motion or position shift-that is, responses were faster when the illusory target motion or location corresponded to the response position. Further experiments indicated that the observed effects cannot be accounted for by attentional shifts. These results suggest that the content of the cognitive map does not only influence perceptual judgments but is also responsible for the automatic activation of response codes. In other words, perception and action seem to be fed by a common, cognitively penetrable, spatial representation.     

Differential use of partial information by good and poor readers

Two interpretations of the poor readers' deficit are examined. According to one interpretation, poor readers are primarily deficient in use of phonetic information, and, thus, their deficit is specific to reading or at least to use of language. A second interpretation is that good and poor readers differ in their ability or tendency to use stimulus attributes—that is, partial information for stimulus identity—and, thus, their deficit is not specific to reading. Three experiments provide evidence favoring the second interpretation. Good and poor readers perform differently in tests of memory—whether or not the stimulus items are coded phonetically—when information about stimulus identity is incomplete due to memory loss and the response measure is sensitive to partial-information use in guessing. Likewise, the two groups perform differently in a perceptual task when information for stimulus identity is partial, but they perform at similar levels when information is complete.     

Visual and haptic matching of perceived orientations of lines

In this study we investigated the perception and production of line orientations in a vertical plane. Previous studies have shown that systematic errors are made when participants have to match oblique orientations visually and haptically. Differences in the setup for visual and haptic matching did not allow for a quantitative comparison of the errors. To investigate whether matching errors are the same for different modalities, we asked participants to match a visually presented orientation visually, haptically with visual feedback, and haptically without visual feedback. The matching errors were the same in all three matching conditions. Horizontal and vertical orientations were matched correctly, but systematic errors were made for the oblique orientations. The errors depended on the viewing position from which the stimuli were seen, and on the distance of the stimulus from the observer.     

Hemispheric differences in the perception of words and faces in deaf and hearing children

The purpose of this study was to investigate hemispheric functional asymmetry in 18 normal hearing children and 18 congenitally deaf children aged 13-14 years. The task was identification of a visual stimulus (3-letter word or photograph of a face) presented in either the left or right visual field. The children responded by pointing to the target stimulus on a response card which contained four different words or three different faces. The percentage of errors for presentations to the two visual fields were analysed to determine hemispheric dominance. The pattern of hemispheric differences for the hearing children was consistent with that from previous investigations. The results for the deaf children differed from those of the normals. In word perception we observed a right hemisphere advantage and in the face recognition a lack of hemispheric differences. These results point to a lack of auditory experiences which is affecting the functional organization of the two hemispheres. It is suggested that the necessity to make use of visuo-spatial information in the process of communication causes right hemisphere dominance in verbal tasks. This may influence the perception of other visuo-spatial stimuli which may yield a lack of hemispheric asymmetry in face recognition.     

Absence of a cross-modal “suffix effect” in short-term memory

Three experiments are reported involving the presentation of lists of either letters or digits for immediate serial recall. The main variable was the presence or absence of a suffix-prefix, an item (tick or cross) occurring at the end of the list which had to be copied before recall of the stimulus list. With auditory stimuli and an auditory suffix-prefix there was a large and selective increase in the number of errors on the last few serial positions—the typical “suffix effect”. The suffix effect was not found with auditory stimuli and a visual suffix-prefix nor with a visual stimulus and an auditory suffix-prefix. These results are interpreted as supporting a model for short-term memory proposed by Crowder and Morton (1969) in which it is suggested that with serial recall information concerning the final items following auditory presentation has a different, precategorical, origin from that concerning other items.     

A further examination of attentional effects in the phonemic restoration illusion

Models of how listeners understand speech must specify the types of representations that are computed, the nature of the flow of information, and the control structures that modify performance. Three experiments are reported that focus on the control processes in speech perception. Subjects in the experiments tried to discriminate stimuli in which a phoneme had been replaced with white noise from stimuli in which white noise was merely superimposed on a phoneme. In the first two experiments, subjects practiced the discrimination for thousands of trials but did not improve, suggesting that they have poor access to low-level representations of the speech signal. In the third experiment, each (auditory) stimulus was preceded by a visual cue that could potentially be used to focus attention in order to enhance performance. Only subjects who received information about both the identity of the impending word and the identity of the critical phoneme showed enhanced discrimination. Other cues, including syllabic plus phonemic information, were ineffective. The results indicate that attentional control of processing is difficult but possible, and that lexical representations play a central role in the allocation of attention.     

Kanizsa-type subjective contours do not guide attentional deployment in visual search but line termination contours do

We used visual search to explore whether attention could be guided by Kanizsa-type subjective contours and by subjective contours induced by line ends. Unlike in previous experiments, we compared search performance with subjective contours against performance with real, luminance contours, and we had observers search for orientations or shapes produced by subjective contours, rather than searching for the presence of the contours themselves. Visual search for one orientation or shape among distractors of another orientation or shape was efficient when the items were defined by luminance contours. Search was much less efficient among items defined by Kanizsa-type subjective contours. Search remained efficient when the items were defined by subjective contours induced by line ends. The difference between Kanizsa-type subjective contour and subjective contours induced by line ends is consistent with physiological evidence suggesting that the brain mechanisms underlying the perception of these two kinds of subjective contours may be different.     

Task-irrelevant distractors in the delay period interfere selectively with visual short-term memory for spatial locations

Visual short-term memory (VSTM) enables the representation of information in a readily accessible state. VSTM is typically conceptualized as a form of “active” storage that is resistant to interference or disruption, yet several recent studies have shown that under some circumstances task-irrelevant distractors may indeed disrupt performance. Here, we investigated how task-irrelevant visual distractors affected VSTM by asking whether distractors induce a general loss of remembered information or selectively interfere with memory representations. In a VSTM task, participants recalled the spatial location of a target visual stimulus after a delay in which distractors were presented on 75% of trials. Notably, the distractor’s eccentricity always matched the eccentricity of the target, while in the critical conditions the distractor’s angular position was shifted either clockwise or counterclockwise relative to the target. We then computed estimates of recall error for both eccentricity and polar angle. A general interference model would predict an effect of distractors on both polar angle and eccentricity errors, while a selective interference model would predict effects of distractors on angle but not on eccentricity errors. Results showed that for stimulus angle there was an increase in the magnitude and variability of recall errors. However, distractors had no effect on estimates of stimulus eccentricity. Our results suggest that distractors selectively interfere with VSTM for spatial locations.     

Induced motion and oculomotor capture

Three experiments investigating the basis of induced motion are reported. The proposition that induced motion is based on the visual capture of eye-position information and is therefore a subject-relative, rather than object-relative, motion was explored in the first experiment. Observers made saccades to an invisible auditory stimulus following fixation on a stationary stimulus in which motion was induced. In the remaining two experiments, the question of whether perceived induced motion produces a straight ahead shift was explored. The critical eye movement was directed to apparent straight ahead. Because these saccades partially compensated for the apparent displacement of the induction stimulus, and saccades to the auditory stimulus did not, we conclude that induced motion is not based on oculomotor visual capture. Rather, it is accompanied by a shift in the judged direction of straight ahead, an instance of the straight ahead shift. The results support an object-relative theory of induced motion.     

Concurrent processing of spatial relations and objects in two cerebral hemispheres

This study examined hemispheric asymmetry for concurrent processing of object and spatial information. Participants viewed two successive stimuli, each of which consisted of two digits and two pictures that were randomly located and judged them as identical or different. A sample stimulus was presented in a central visual field, followed by a matching stimulus presented briefly in a left or right visual field. The matching stimuli were different from the sample stimuli with respect to the object (digit or picture) or spatial (locations or distances of items) aspect. No visual field asymmetry was found in the detection of object change. However, a left visual field advantage was found in the detection of spatial change. This result can be explained by the double filtering by frequency theory of Ivry and Robertson, who asserted that the left hemisphere has a bias for processing information contained in relatively high spatial frequencies whereas the right hemisphere has a bias for processing information contained in relatively low spatial frequencies. Based upon this evidence, the importance of interhemispheric integration for visual scene perception is discussed.     

A DEVELOPMENTAL DEFICIT IN LOCALIZING OBJECTS FROM VISION

Abstract— We describe a college student, A. H., with a developmental deficit in determining the location of objects from vision. The deficit is selective in that (a) localization from auditory or tactile information is intact, (b) A H reports the identity of mislocalized objects accurately, (c) visual localization errors preserve certain parameters of the target location, and (d) visual localization is severely impaired under certain stimulus conditions, but nearly intact under other conditions. These results bear on the representation and processing of location information in the visual system, and also have implications for understanding developmental dyslexia.     

Working memory, perceptual priming, and the perception of hierarchical forms: Opposite effects of priming and working memory without memory refreshing

Previous research has shown that stimuli held in working memory (WM) can influence spatial attention. Using Navon stimuli, we explored whether and how items in WM affect the perception of visual targets at local and global levels in compound letters. Participants looked for a target letter presented at a local or global level while holding a regular block letter as a memory item. An effect of holding the target’s identity in WM was found. When memory items and targets were the same, performance was better than in a neutral condition when the memory item did not appear in the hierarchical letter (a benefit from valid cuing). When the memory item matched the distractor in the hierarchical stimulus, performance was worse than in the neutral baseline (a cost on invalid trials). These effects were greatest when the WM cue matched the global level of the hierarchical stimulus, suggesting that WM biases attention to the global level of form. Interestingly, in a no-memory priming condition, target perception was faster in the invalid condition than in the neutral baseline, reversing the effect in the WM condition. A further control experiment ruled out the effects of WM being due to participants’ refreshing their memory from the hierarchical stimulus display. The data show that information in WM biases the selection of hierarchical forms, whereas priming does not. Priming alters the perceptual processing of repeated stimuli without biasing attention.     

Baseball batters support an ecological efference mediation theory of natural event perception

People with healthy motor systems often expose themselves to natural conditions that induce errors in registered eye or limb position. Visual illusions accompany such errors in the oculomotor system. In the present study, natural conditions induced illusions that disturbed the ability of batters to hit a pitched baseball. Theoretical implications include the conclusion that a better understanding of perception and action relationships will emerge from studies of the interaction between motor information and rich visual information. Practical implications concern performance of athletes and aircraft pilots.