Perceptual depth synthesis in the visual system as revealed by selective adaptation

Selective adaptations was used to determine the degree of interactions between channels processing relative depth from stereopsis, motion parallax, and texture. Monocular adaptations with motion parallax or binocular stationary adaptation caused test surfaces, viewed either stationary binocularly or monocularly with motion parallax, to appear to slant in the opposite direction compared with the slant initially adapted to. Monocular adaptations on frontoparallel surfaces covered with a pattern of texture gradients caused a subsequently viewed test surface, viewed either monocularly with motion parallax or stationary binocularly, to appear to slant in the opposite direction as the slant indicated by the texture in the adaptation condition. No aftereffect emerged in the monocular stationary test condition. A mechanism of independent channels for relative depth perception is dismissed in favor of a view of an asymmetrical interactive processing of different information sources. The results suggest asymmetrical inhibitory interactions among habituating slant detector units receiving inputs from static disparity, dynamic disparity, and texture gradients.     

'Coarse-to-fine' cyclopean processing

Previously (Popple et al, 1998 Vision Research 38 319-326) we found, using random-dot stereograms, that initial vergence increases with the size of a cyclopean disc. A corresponding improvement in stereoacuity within the disc was predicted, because disparities in the disc would be brought closer to the plane of current fixation. In the present experiment, we looked at the effect of the spatial extent of a briefly presented (< or = 500 ms) cyclopean depth pedestal on stereoacuity thresholds. Observers were required to judge the depth of a small, 1.7 deg, central disc relative to a larger surrounding disc in a random-pattern stereogram. The larger disc was set, initially, at a pedestal disparity of +/- 24 min of arc against a fixation-plane surround. The size of the larger disc was varied from 2.6 to 8.0 deg. As predicted, stereoacuity thresholds fell significantly with increasing pedestal disc size. Next, the disparity of the pedestal disc was varied. When pedestal disparity was reduced to +/- 2.4 min of arc, a disparity too small to demand vergence, the size effect disappeared except when the pedestal boundary was within 30 min of arc of the test disc boundary. We argue from this result that the effect was largely due to vergence and not cyclopean integration alone. However, the effect of pedestal size was found to persist with stimuli too brief to permit vergence (< or = 100 ms) suggesting that factors other than vergence may also play a role.     

The spatial spread of attentional modulation of the motion aftereffect

The spatial spread of attentional modulation of selective adaptation was investigated in four experiments in which the duration of the movement aftereffect (MAE) was measured with and without processing of intermittently changing digits at the fixation point. In the first experiment, the effects of diverting attention on MAE duration were found to reduce as the distance between the fixation digits and the inner edge of the surrounding adapt/test grating was increased. A second experiment suggested that eye movements were unlikely to underlie the attentional effects. In experiment 3, the attentional effect stayed constant as the outer diameter of the adapt/test gratings was increased. In experiment 4 (as in experiment 1) the modulatory effects of attention were larger the closer the adapt/test gratings were to the locus of attention, when the area of the grating was held constant but its eccentricity varied. In experiments 1 and 4, an intermittently changing fixation digit was found to reduce MAE durations more than an unchanging digit, even when subjects were not required to process it, suggesting that exogenous as well as endogenous attentional processes modulate early motion processing.     

Effects of attentional modulation of a stationary surround in adaptation to motion

The effect of varying the spatial relationships between an adapt/test grating and a stationary surrounding reference grating, and their interaction with diversion of attention during adaptation, were investigated in two experiments on the movement aftereffect (MAE). In experiment 1, MAEs were found to increase as the separation between the surrounding grating and the adapt/test grating decreased, but not with the area of the adapt/test grating. Although diversion during adaptation (repeating changing digits at the fixation point) reduced MAE durations, its effects did not interact with any of the stimulus variables. In experiment 2, MAE durations increased as the outer dimensions of the reference grating were increased, and this effect did interact with diversion, so that the effects of diversion were smaller when the surround grating was larger. This suggests that diversion may be affecting the inputs to an opponent process in motion adaptation, with a smaller effect on the surrounds than on the centres of antagonistic motion-contrast detectors with large receptive fields. A third experiment showed that, although repeating the word 'zero' during adaptation reduced MAEs, this reduction was smaller than that from naming a changing sequence of digits (and not significantly different from that from simply observing the changing digits), suggesting that MAE reductions are not produced only, if at all, by putative movements of the head and eyes caused by speaking.     

Stereospatial masking and aftereffect with normal and transformed random-dot patterns

Masking and aftereffect in the perception of binocular depth were studied using random-dot sterograms as adaptation and target stimuli. Detection of the target was impaired by prior adaptation only when the two stimuli differed in disparity by less than 2 minarc. The masking function was unaffected by uniocular enlargement and blurring within the adaptation stimulus, but masking was no longer selective to disparity when the elements seen by the two eyes were reversed in brightness. The stereoscopic depth aftereffect was also insensitive to uniocular enlargement and blurring, and could not be generated when there was brightness complementation within the adaptation stimulus. Both the masking and aftereffect data are interpreted as evidence that stereospatial detectors in human vision are insensitive to transforms that maintain luminance-spatial correlations in binocular input.     

The influence of depth segmentation on colour constancy

In real scenes, surfaces in different depth planes often differ in the luminance and chromatic content of their illumination. Scene segmentation is therefore an important issue when considering the compensation of illumination changes in our visual perception (lightness and colour constancy). Chromatic adaptation is an important sensory component of colour constancy and has been shown to be linked to the two-dimensional spatial structure of a scene (Werner, 2003 Vision Research 43 1611 - 1623). Here, the question is posed whether this cooperation also extends to the organisation of a scene in depth. The influence of depth on colour constancy was tested by introducing stereo disparity, whereby the test patch and background were perceived in either the same or one of five different depth planes (1.9-57 min of arc). There were no additional cues to depth such as shadows or specular highlights. For consistent illumination changes, colour constancy was reduced when the test patch and background were separated in depth, indicating a reduction of contextual influences. An interaction was found between the influences of stereo depth and spatial frequency on colour constancy. In the case of an inconsistent illumination change, colour constancy was reduced if the test patch and background were in the same depth plane (2-D condition), but not if they were separated in depth (3-D condition). Furthermore, colour constancy was slightly better in the 3-D inconsistent condition than in the 2-D inconsistent condition. It is concluded that depth segmentation supports colour constancy in scenes with inconsistent illumination changes. Processes of depth segmentation are implemented at an early sensory stage of colour constancy, and they define visual regions within which the effects of illuminant changes are discounted for separately. The results support recent models that posit such implementation of scene segmentation in colour constancy.     

The surface and deep structure of the waterfall illusion

The surface structure of the waterfall illusion or motion aftereffect (MAE) is its phenomenal visibility. Its deep structure will be examined in the context of a model of space and motion perception. The MAE can be observed following protracted observation of a pattern that is translating, rotating, or expanding/contracting, a static pattern appears to move in the opposite direction. The phenomenon has long been known, and it continues to present novel properties. One of the novel features of MAEs is that they can provide an ideal visual assay for distinguishing local from global processes. Motion during adaptation can be induced in a static central grating by moving surround gratings; the MAE is observed in the static central grating but not in static surrounds. The adaptation phase is local and the test phase is global. That is, localised adaptation can be expressed in different ways depending on the structure of the test display. These aspects of MAEs can be exploited to determine a variety of local/global interactions. Six experiments on MAEs are reported. The results indicated that relational motion is required to induce an MAE; the region adapted extends beyond that stimulated; storage can be complete when the MAE is not seen during the storage period; interocular transfer (IOT) is around 30% of monocular MAEs with phase alternation; large field spiral patterns yield MAEs with characteristic monocular and binocular interactions.     

Rapid adaptation to auditory-visual spatial disparity

The so-called ventriloquism aftereffect is a remarkable example of rapid adaptative changes in spatial localization caused by visual stimuli. After exposure to a consistent spatial disparity of auditory and visual stimuli, localization of sound sources is systematically shifted to correct for the deviation of the sound from visual positions during the previous adaptation period. In the present study, this aftereffect was induced by presenting, within 17 min, 1800 repetitive noise or pure-tone bursts in combination with synchronized, and 20° disparate flashing light spots, in total darkness. Post-adaptive sound localization, measured by a method of manual pointing, was significantly shifted 2.4° (noise), 3.1° (1 kHz tones), or 5.8° (4 kHz tones) compared with the pre-adaptation condition. There was no transfer across frequencies; that is, shifts in localization were insignificant when the frequencies used for adaptation and the post-adaptation localization test were different. It is hypothesized that these aftereffects may rely on shifts in neural representations of auditory space with respect to those of visual space, induced by intersensory spatial disparity, and may thus reflect a phenomenon of neural short-term plasticity.     

The magnitude of binocular disparity modulates search time for targets defined by a conjunction of depth and colour

Nakayama and Silverman (1986) proposed that, when searching for a target defined by a conjunction of color and stereoscopic depth, observers partition 3D space into separate depth planes and then rapidly search each such plane in turn, thereby turning a conjunctive search into a "feature" search. In their study, they found, consistent with their hypothesis, shallow search slopes when searching depth planes separated by large binocular disparities. Here, the authors investigated whether the search slope depends upon the extent of the stereoscopically induced separation between the planes to be searched (i.e., upon the magnitude of the binocular disparity. The obtained slope shows that (1) a rapid search only occurs with disparities greater than 6 min of arc, a value that vastly exceeds the stereo threshold, and that (2) the steepness of this slope increases in a major way at lower disparities. The ability to implement the search mode envisaged by Nakayama and Silverman is thus clearly limited to large disparities; less efficient search strategies are mandated by lower disparity values, as under such conditions items from one depth plane may be more likely to "intrude" upon the other. (PsycINFO Database Record (c) 2008 APA, all rights reserved).     

Absence of binocular interaction between spatial and color attributes of visual stimuli

The hypothesis that induction of the McCollough effect (spatially selective color aftereffects) entails adaptation of monocularly driven detectors tuned to both spatial and color attributes of the visual stimulus was examined in four experiments. The McCollough effect could not be generated by displaying contour information to one eye and color information to the other eye during inspection, even in the absence of binocular rivalry. Nor was it possible to induce depth-specific color aftereffects following an inspection period during which random-dot stereograms were viewed, with crossed and uncrossed disparity seen in different colored light. Masking and aftereffect in the perception of stereoscopic depth were also nonselective to color; in both cases, perceptual distortion was controlled by stereospatial variables but not by the color relationship between the inspection and test stimuli. The results suggest that binocularly driven spatial detectors in human vision are insensitive to wavelength.     

Depth from dichoptic edges depends on vergence tuning

Small but reproducible fixation disparities occur in normal subjects when they view certain types of dichoptic stimuli. During dichoptic as well as stereoptic stimulation the motor fusion process determines first the average vergence state of the eyes. The subsequent fine tuning of vergence is shown to depend on the spatial distribution of contrast edges both of the same contrast sign ('stereoptic edges') and of opposite contrast sign ('dichoptic edges'). Stereoptic edges tend to induce superposition attempts of the vergence control system and dichoptic edges tend to antagonise this process. If a single low-contrast dichoptic edge is presented with zero disparity and within a stereoptic reference frame, a fixation disparity of several minutes of arc results. This influences depth vision since dichoptic edges are perceived (as monocular edges) at the actual rather than at the intended fixation distance. The findings explain previous paradoxical results of eg Kaufman and Pitblado who reported seeing depth in opposite-contrast stereograms. Their results seemed to contradict the well-established 'same-sign rule' (SSR) which states that the stereoptic system only detects disparities of edges with the same contrast sign. It is concluded that (i) the SSR holds; (ii) dichoptic (and monocular) edges are seen at the horopter; (iii) the vergence fine tuning prevents superposition of dichoptic edges even if this causes a fixation disparity.     

Attention affects the stereoscopic depth aftereffect

'Preattentive' vision is typically considered to include several low-level processes, including the perception of depth from binocular disparity and motion parallax. However, doubt was cast on this model when it was shown that a secondary attentional task can modulate the motion aftereffect (Chaudhuri, 1990 Nature 344 60-62). Here we investigate whether attention can also affect the depth aftereffect (Blakemore and Julesz, 1971 Science 171 286-288). Subjects adapted to stationary or moving random-dot patterns segmented into depth planes while attention was manipulated with a secondary task (character processing at parametrically varied rates). We found that the duration of the depth aftereffect can be affected by attentional manipulations, and both its duration and that of the motion aftereffect varied with the difficulty of the secondary task. The results are discussed in the context of dynamic feedback models of vision, and support the penetrability of low-level sensory processes by attentional mechanisms.     

三维空间中不同视野深度位置上的返回抑制

通过虚拟现实构建虚拟三维场景,将二维平面视觉空间返回抑制范式应用到三维空间,通过两个实验操纵了目标深度、线索有效性以及视野位置三个变量,考察注意在三维空间不同视野深度位置上进行定向/重定向产生的返回抑制效应。结果发现,(1)二次线索化位于固定的中央视野时,不论目标出现在近处空间还是出现在远处空间,外周视野条件下的返回抑制大于中央视野条件下的返回抑制;(2)二次线索化位于非固定的中央视野时,近处空间和远处空间的返回抑制存在分离,表现为当目标出现在远处空间时,外周视野条件下的返回抑制效应减小。研究表明,三维空间中外周视野深度位置上的返回抑制与中央视野深度位置上的返回抑制存在差异。     

The perception of verticality and the frame of reference of the visual tilt aftereffect

Previous research has suggested that the visual tilt aftereffect operates according to a gravitational frame of reference. Three experiments were conducted to test this conclusion further. In each experiment, observers (with head upright) adjusted an illuminated bar to apparent vertical following various adaptation conditions. In Experiment 1, observers were given clear visual cues for objective vertical while adjusting the bar. In Experiment 2, they were not given visual cues for vertical. The adaptation conditions in Experiments 1 and 2 consisted of various combinations of head and stimulus tilt. Experiment 3 investigated the effects of head tilt alone. The results indicated that the tilt aftereffect follows a retinal frame of reference under some conditions (Experiment 1) and appears to follow a gravitational frame under others (Experiment 2). These results can be predicted by a simple model involving two factors, a purely visual aftereffect that follows a retinal frame and an extravisual aftereffect that appears to follow a gravitational frame.     

Psychophysical evidence for an extrastriate contribution to a pattern-selective motion aftereffect

A stationary vertical test grating appears to drift to the left after adaptation to an inducing grating drifting to the right, this being known as the motion aftereffect (MAE). Pattern-specific motion aftereffects (PSMAEs) induced by superimposed pairs of gratings in which the component gratings drift up and down but the observer sees a single coherent plaid drifting to the right have been investigated. Two experiments are reported in which it is demonstrated that the PSMAE is tuned more to the motion of the pattern than to the orientation and direction of motion of the component gratings. However, when subjects adapt to the component gratings in alternation, aftereffect magnitude is dependent upon the individual grating orientations and motion directions. These results can be interpreted in terms of extrastriate contributions to the PSMAE, possibly arising from the middle temporal area, where some cells, unlike those in striate cortex (V1), are tuned to pattern motion rather than to component motion.     

The effects of adaptation to square-wave gratings as a function of grating orientation

An adaptation technique was used to measure the selectivity or tuning for grating orientation in the visual system for different orientations of the inspection stimulus. Duration thresholds for grating patterns of constant luminance were determined for 13 test gratings oriented from ±5 to 90 deg away from each of five adaptation gratings: 0, 22, 45, 67, and 90 deg. Threshold data obtained for test gratings without prior adaptation indicated higher sensitivity for gratings oriented along the horizontal and vertical axis than along the oblique axis. After adaptation, thresholds increased (sensitivity was reduced) for gratings having similar orientations as the test gratings. However, the functions relating sensitivity reduction to degree of angular disparity between test and adaptation grating did not vary across the five inpsection orientations, i.e., selectivity or tuning for grating orientation appeared to be independent of the orientation of the adapting stimulus.     

The site of binocular rivalry suppression.

Two experiments were performed to localize the site of binocular rivalry suppression in relation to the locus of grating adaptation. In one experiment it was found that phenomenal suppression of a high-contrast adaptation grating presented to one eye had no influence on the strength of the threshold-elevation aftereffect measured interocularly. Evidently information about the adaptation grating arrives at the site of the aftereffect (presumably binocular neurons) even during suppression. In a second experiment 60 s of grating adaptation was found to produce a short-term reduction in the predominance of the adapted eye during binocular rivalry. These findings provide converging lines of evidence that suppression occurs at a site in the human visual system after the locus of grating adaptation and, hence, after the striate cortex.     

Predominance of ground over ceiling surfaces in binocular rivalry

The superiority of ground surfaces over ceiling surfaces in determining the representation of the visual world, demonstrated in several studies of visual perception and visual search, has been attributed to a preference for top-away projections resulting from ecological constraints. Recent research on binocular rivalry indicates that ecological constraints affect predominance relations. The present study considered whether there is a difference in predominance between ground and ceiling surfaces. In Experiment 1, we examined whether a ground surface would dominate a ceiling surface when one surface was presented to each eye. In Experiment 2, we used an eye-swapping paradigm to determine whether a ground surface would come to dominance faster than a ceiling surface when presented to the suppressed eye. The eye-swapping paradigm was used again in Experiment 3, but the ground and ceiling planes were replaced with frontal planes with similar variations in texture density. The results of these experiments indicate that ground surfaces are predominant over ceiling surfaces, with this predominance affecting both the dominance and suppression phases of binocular rivalry. This superiority of ground planes is independent of image properties such as the increase or decrease in texture density from the lower half to the upper half of the images.     

Asymmetries and errors in perception of depth from disparity suggest a multicomponent model of disparity processing

In three experiments, asymmetries between the processing of crossed and uncrossed disparities were investigated. The target was a luminance-defined circle concentric to a fixation mark, viewed stereoscopically on a computer monitor for 105 msec. Fifteen disparities were presented according to the method of constant stimuli. Observers indicated the apparent direction of target depth relative to fixation. All experiments measured both the accuracy and latency of this response. Experiment 1 showed fewer errors and shorter reaction times for identifying crossed disparities. Experiments 2 and 3 replicated Experiment 1 and also showed that observers may often perceive a target in the direction opposite that prescribed by the disparity information. We propose that the asymmetries and reversals result from differences in computation of sign, not of magnitude. This notion is consistent with a scheme of continuous disparity tuning and accounts for such asymmetries and errors without positing disparity pooling mechanisms.     

Brightness selectivity in the motion aftereffect

Eighteen Ss were required to track the apparent motion of a stationary grating viewed after prolonged inspection of a moving grating. Measures were obtained with the inspection and test gratings identical in contrast but different in space-average luminance, or with luminance held constant and contrast varied. The aftereffect was reduced as the gratings differed in space-average luminance, but contrast exerted less uniform influence as a variable. Brightness-selectivity in the motion aftereffect is interpreted within the selective adaptation model of aftereffects as evidence that some detectors in human vision are conjointly tuned to space-average luminance and image motion.