Perceptual, oculomotor, and neural responses to moving color plaids

Moving plaids constructed from two achromatic gratings of identical luminance contrast are known to yield a percept of coherent pattern motion, as are plaids constructed from two identical chromatic (e.g. isoluminant red/green) gratings. To examine the interactive influences of chromatic and luminance contrast on the integration of visual motion signals, we constructed plaids with gratings that possessed both forms of contrast. We used plaids of two basic types, which differed with respect to the phase relationship between chromatic and luminance modulations (after Kooi et al, 1992 Perception 21 583-598). One plaid type ('symmetric') was made from component gratings that had identical chromatic/luminance phase relationships (e.g. both components were red-bright/green-dark modulation). The second plaid type ('asymmetric') was made from components that had complimentary phase relationships (i.e. one red-bright/green-dark grating and one green-bright/red-dark grating). Human subjects reported that the motion of symmetric plaids was perceptually coherent, while the components of asymmetric plaids failed to cohere. We also recorded eye movements elicited by both types of plaids to determine if they are similarly affected by these image cues for motion coherence. Results demonstrate that, under many conditions, eye movements elicited by perceptually coherent vs noncoherent plaids are distinguishable from one another. To reveal the neural bases of these perceptual and oculomotor phenomena, we also recorded the responses of neurons in the middle temporal visual area (area MT) of macaque visual cortex. Here we found that individual neurons exhibited differential tuning to symmetric vs asymmetric plaids. These neurophysiological results demonstrate that the neural mechanism for motion coherence is sensitive to the phase relationship between chromatic and luminance contrast, a finding which has implications for interactions between 'color' and 'motion' processing streams in the primate visual system.     

The use of chromatic information for motion segmentation: differences between psychophysical and eye-movement measures

Previous psychophysical studies have shown that chromatic (red/green) information can be used as a segmentation cue for motion integration. We investigated the mechanisms mediating this phenomenon by comparing chromatic effects (and, for comparison, luminance effects) on motion integration between two measures: (i) directional eye movements with the notion that these responses are mediated mainly by low-level motion mechanisms, and (ii) psychophysical reports, with the notion that subjects' reports should employ higher-level (attention-based) mechanisms if available. To quantify chromatic (and luminance) effects on motion integration, coherent motion thresholds were obtained for two conditions, one in which the signal and noise dots were the same 'red' or 'green' chromaticity (or the same 'bright' or 'dark' luminance), referred to as homogeneous, and the other in which the signal and noise dots were of different chromaticities (or luminances), referred to as heterogeneous. 'Benefit ratios' (theta(HOM)/theta(HET)) were then computed, with values significantly greater than 1.0 indicating that chromatic (or luminance) information serves as a segmentation cue for motion integration. The results revealed a high and significant chromatic benefit ratio when the measure was based on psychophysical report, but not when it was based on an eye-movement measure. By contrast, luminance benefit ratios were roughly the same (and significant) for both measures. For comparison to adults, eye-movement data were also obtained from 3-month-old infants. Infants showed marginally significant benefit ratios in the luminance, but not in the chromatic, condition. In total, these results suggest that the use of chromatic information as a segmentation cue for motion integration relies on higher-level mechanisms, whereas luminance information works mainly through low-level motion mechanisms.     

Retention and disruption of motion information in visual short-term memory.

Velocity discrimination thresholds for drifting luminance gratings were measured as a function of the time interval between test and reference gratings, using a two-interval, forced-choice procedure. Discrimination thresholds, expressed as Weber fractions (delta V/V), were independent of interstimulus intervals (ISIs) ranging from 1-30 s, demonstrating perfect short-term retention of velocity information. When a third grating was briefly presented halfway through a 10-s ISI, memory masking was observed. Discrimination thresholds in memory masking were unaffected by maskers of the same velocity but increased by 100% when test and masker velocity differed by a factor of 2. The results are interpreted with reference to a model where the short-term memory for simple stimulus attributes is assumed to be organized in terms of arrays of memory stores linked in a lateral inhibitory network.     

The effects of adaptation to square-wave gratings as a function of grating orientation

An adaptation technique was used to measure the selectivity or tuning for grating orientation in the visual system for different orientations of the inspection stimulus. Duration thresholds for grating patterns of constant luminance were determined for 13 test gratings oriented from ±5 to 90 deg away from each of five adaptation gratings: 0, 22, 45, 67, and 90 deg. Threshold data obtained for test gratings without prior adaptation indicated higher sensitivity for gratings oriented along the horizontal and vertical axis than along the oblique axis. After adaptation, thresholds increased (sensitivity was reduced) for gratings having similar orientations as the test gratings. However, the functions relating sensitivity reduction to degree of angular disparity between test and adaptation grating did not vary across the five inpsection orientations, i.e., selectivity or tuning for grating orientation appeared to be independent of the orientation of the adapting stimulus.     

An oblique effect of chromatic gratings measured by color-mixture thresholds

Contrast sensitivity is lower for obliquely oriented achromatic gratings than for vertical or horizontal gratings at high spatial and low temporal frequencies. Although this response is suggestive of mediation by P-pathway cortical correlates, no clear sensory (i.e. class 1) oblique effect has been demonstrated with isoluminant chromatic stimuli. In the present experiment, a two-alternative forced-choice detection task was used to measure observers' sensitivity to spatiotemporal sinusoids varying in orientation and color contrast. A maximum-likelihood method fit ellipses to the thresholds, with the length of each ellipse taken as a measure of chromatic contrast sensitivity at isoluminance, and the width as luminance contrast threshold. A chromatic oblique effect was observed at about 3 cycles deg-1 suggesting an orientation bias within the cortical stream conveying P-cell activity.     

Perception of chromatic motion requires luminance interaction

There is an ongoing debate related to whether chromatic motion perception arises as a consequence of a chromatic signal only (eg Wandell et al 1999 Neuron 24 901-909) or a signal that is essentially based on luminance processes (luminance artifacts) (Mullen et al 2003 Vision Research 43 1235-1247). These two views conform to the idea that colour and luminance processes are physiologically independent (Livingstone and Hubel 1988 Science 240 740-749), but according to other reports many primary cortical 'V1' cells respond to both colour and luminance contrast (eg Vidyasagar et al 2002 European Journal of Neuroscience 16 945-956). A psychophysical task was designed to test whether possible interaction between luminance and chromatic contrast could account for perception of chromatic motion. It is shown that subjects respond in a manner that reflects involvement of both processes.     

Effective luminance contrast as a parameter in contingent aftereffects

Variation in the magnitude of contingent aftereffects was explored as a function of the luminance contrast ratio profile of inspection stimuli. Positive contrast stimuli (chromatic bars interspersed with achromatically brighter bars) produced substantially attenuated aftereffects compared with negative contrast stimuli (chromatic and dark bars). This attenuation was hypothesized to result from retinal image deterioration of positive contrast gratings due to retinal reflection/scatter. In a second experiment, subjects selected for their light retinal pigmentation manifested substantial enhancement of the asymmetry between the aftereffects generated by positive and negative contrast gratings. Those with dark fundus pigmentation showed symmetrical aftereffects.     

Visual attention to color: parvocellular guidance of attentional resources?

Although transient changes in luminance have been well documented to automatically attract attention to their location, experiments looking at abrupt changes in color have failed to find similar attentional capture. These results are consistent with current theories of the role of the magnocellular (M) and parvocellular (P) streams that postulate that the M stream, which is "color-blind," plays the dominant role in guiding attention and eye movements. The experiment reported here used stimuli that contained only information defined by color, and masked residual luminance information with dynamic noise, to assess the capacity of purely chromatic cues to automatically guide spatial attention. Such stimuli were as effective as those containing large luminance signals in guiding attention. To the extent that these purely chromatic signals isolated the P stream, these results suggest that this stream is also capable of automatic attentional capture. Hence, color vision not only aids target identification but also is a strong aid for target detection and localization.     

Colour changes as a function of luminance contrast.

When spectral light increases in luminance, the hues change. Normally, long-wavelength light becomes increasingly yellow, and short-wavelength light turns blue or blue-green. This is known as the Bezold-Brücke hue shift. Less notice has been paid to the change in relative chromatic content (saturation or chromatic strength) that accompanies these shifts in hue. As luminance contrast increases from zero, chromatic strength increases to reach a maximum at a luminance that is wavelength dependent. Short-wavelength blueish light reaches this maximum at low relative luminances, whereas midspectral yellowish stimuli need several log units higher luminance. Red and green are somewhere in between. For luminances above this maximum, the chromatic content usually diminishes, and most light becomes more whitish in appearance. In this study it is demonstrated how the combined chromatic appearance of hue and chromatic strength change with intensity. Both phenomena find a common physiological interpretation in the nonlinear and nonmonotonic responses of colour-opponent P cells in the retina and lateral geniculate nucleus of the primate. A model that combines the outputs of six P-cell types accounts for observers' estimates of hue and chromatic strength.     

Brightness selectivity in the motion aftereffect

Eighteen Ss were required to track the apparent motion of a stationary grating viewed after prolonged inspection of a moving grating. Measures were obtained with the inspection and test gratings identical in contrast but different in space-average luminance, or with luminance held constant and contrast varied. The aftereffect was reduced as the gratings differed in space-average luminance, but contrast exerted less uniform influence as a variable. Brightness-selectivity in the motion aftereffect is interpreted within the selective adaptation model of aftereffects as evidence that some detectors in human vision are conjointly tuned to space-average luminance and image motion.     

Luminance as a factor in the ability of achromatic gratings to interfere with MeCollough effects

McCollough effects were reduced in assessed strength by having observers view achromatic gratings that varied in space-average luminance. Whether the gratings were presented before or after induction of McCollough effects, high luminance gratings interfered with the effects more than did low luminance gratings. If considered within the context of a conditioning model, this finding may be interpreted as inconsistent with other characteristics of McCollough effects.     

Colour inputs to random-dot stereopsis.

Recently it has been claimed by Livingstone and Hubel that, of three anatomically and functionally distinct visual channels (the magnocellular, parvocellular interblob, and blob channels), only the magnocellular channel is involved in the processing of stereoscopic depth. Since the magnocellular system shows little overt colour opponency, the reported loss of the ability to resolve random-dot stereograms defined only by colour contrast seems consistent with this view. However, Julesz observed that reversed-contrast stereograms could be fused if correlated colour information was added. In the present study, 'noise' (non-corresponding) pixels were injected into random-dot stereograms in order to increase fusion time. All six subjects tested were able to achieve stereopsis in less than three minutes when there was only correspondence in colour and not in luminance, and three when luminance contrast was completely reversed. This ability depends on information about the direction of colour contrast, not just the presence of chromatic borders. When luminance and chromatic contrast are defined in terms of signal-to-noise ratios at the photoreceptor mosaic, chromatic information plays at least as important a role in stereopsis as does luminance information, suggesting that the magnocellular channel is not uniquely involved.     

Assessing stereomotion thresholds with a high-resolution computer monitor

We investigated the feasibility of a computer-graphics-based method of assessing stereomotion thresholds (Silicon Graphics Stereoview stereoscopic system). Stereomotion thresholds for a rectangle oscillating in depth were determined with the use of a dual randomly interleaved staircase design. In a group of 31 naive observers, the average thresholds of 5.97′ of arc forcrossed stereomotion and 6.00′ of arc foruncrossed stereomotion were comparable to those assessed in earlier work done with optics-based techniques. By assessing the thresholds for a rectangle that was defined either by lateral motion or by changing size, in a group of experienced observers, we were able to show that any potential residual translational motion present in the display would not have influenced the stereomotion thresholds. Our findings suggest that this computer-graphics-based technique may be a reasonable alternative to optics-based methods of assessing stereomotion thresholds.     

Experimental measures and theoretical account of hue scaling as a function of luminance

Functions relating the magnitude of chromatic response to stimulus luminance were determined at the unique green and yellow wavelengths. These measured functions were used to account for the shift from a preponderance of green at low stimulus luminances to a preponderance of yellow at higher luminances, for a stimulus wavelength of 550 nm. The two hue magnitude functions were found to have the same power-law exponents, and the hue shift was due to the difference in thresholds between the two opponent-color systems.     

Orientation-specific aftereffects and illusions in the perception of brightness

Orientation-specific brightness aftereffects were found when vertical and horizontal gratings of the same space-average luminance were viewed following alternate exposure to vertical and horizontal gratings that differed in space-average luminance. The vertical test grating appeared bright following exposure to a dim vertical grating, and dim after a bright vertical grating had been viewed. This aftereffect did not occur when the adaptation gratings had been seen by one eye and the test gratings by the other eye. An orientation-specific illusion in the perception of brightness was also found, with the white sectors of a vertical grating appearing brighter against a background of horizontal lines than they did against a background of vertical lines. Both distortions imply that there are detectors in the human visual system that are conjointly tuned to luminance and contour orientation.     

Chromatic information processing

The investigation of visual processing mediated solely by chromatic information requires conditions preventing a subject's use of the luminance differences normally accompanying a chromatic change. In Experiment 1, which involved a discriminative reaction time (RT) task, chromatic and white stimuli of the same luminance were presented on a dimmer achromatic background. Subjects were instructed to respond only to the chromatic stimuli. RT was slowest at 570 nm and somewhat faster to short wavelengths than to long wavelengths. In Experiment 2, which compared two discriminative RT tasks, RT was faster when subjects responded to color than when they responded to white. Experiments 3 and 4 demonstrated that a brighter white surround decreased the perceived brightness of chromatic stimuli as well as their perceptual similarity to white, but did not affect RT. The results are discussed in terms of the response strength of the chromatic processing channel.     

Motion adaptation from surrounding stimuli.

When a narrow uniform gap was surrounded by a moving grating, the gap appeared as a grating in the opposite phase to that of the surround, moving in the same direction with the same speed. Contrast thresholds for moving test-gratings placed in the region of the uniform gap were found to be elevated after prolonged viewing of this pattern, thus demonstrating the existence of motion adaptation in a retinal region surrounded by, but not covered by, a moving pattern. The amplitude of the moving induced-grating was measured by nulling with a real grating moving in the same direction and with the same speed as the surround. When the speed of the inducing grating was varied, the amplitude of the induced effect did not correlate with the magnitude of the threshold elevation. Therefore, it is unlikely that motion adaptation in the uniform gap was due to induced gratings. In some conditions, the adaptation effect of surrounding gratings was no less than the adaptation effect of gratings covering the test region. This result rules out an explantation involving scattered light, and indicates that motion adaptation occurs at a later stage than that consisting of simple motion mechanisms which confound the contrast and velocity of a moving stimulus.     

Coherence and transparency of moving plaids composed of Fourier and non-Fourier gratings

We examined the perceptual coherence of two-component moving plaids. The gratings that constituted the plaids were either standard Fourier gratings (F), in which luminance was determined by a drifting sinusoid, or non-Fourier gratings (NF), in which the contrast of a random background was modulated by a drifting sinusoid. These NF gratings are examples of stimuli that generate a compelling percept of motion, even though they fail to elicit a motion signal from motion analyzers based on standard cross-correlation (Chubb & Sperling, 1988). Naive observers viewed three types of stimuli consisting of superpositions of these two components: (1) two standard drifting gratings (F/F), (2) two non-Fourier drifting gratings (NF/NF), and (3) one standard and one non-Fourier drifting grating (F/NF). As expected, the F/F stimulus yielded a compelling percept of coherent motion. The dominant percept of all the observers for the NF/NF stimulus was one of coherent motion, provided that both gratings were visible and of approximately equal contrast. None of the observers reported a dominant percept of coherent motion for the F/NF condition, over a wide range of contrasts for the two grating components and across two varieties of NF gratings. In view of the results of Albright (1992) and Albright and Chaudhuri (1989), that show that single cells in macaque V1 and MT respond to both F and NF motion, one cannot interpret our findings as evidence that F and NF motion are processed independently. Alternative, “higher level” interpretations based on the intrinsically ambiguous nature of the stimuli and physical laws governing the appearance of transparent objects are discussed.     

Perfect visual short-term memory for periodic patterns

Abstract

The short-term memory for spatial frequency information was assessed by measuring the spatial frequency discrimination thresholds for briefly flashed luminance gratings as a function of the time interval between the test and reference gratings, using a computer-controlled two-interval forced-choice procedure. Discrimination thresholds were stable for interstimulus intervals in the range 1–30 sec under all conditions tested. At low contrasts, short exposure times and low spatial frequencies discrimination thresholds increased, but no interactions between stimulus parameters affecting thresholds and interstimulus interval were observed. It is concluded that factors limiting spatial discrimination are associated with the sensory coding stage. Spatial discrimination and visual memory may be based on a common representation, which is perfectly retained in short-term memory. Visual half-field tests revealed no hemispheric differences in the processing and retention of spatial frequency information.     

Wavelength effects on simple reaction time

Simple reaction time was measured to spectral lights matched photometrically in luminance. When these lights were presented on a dimmer achromatic background, reaction time did not vary as a function of wavelength. Moreover, reaction times to white and chromatic lights were the same. When the luminance of the background was the same as that of the chromatic lights, reaction time increased and showed a strong effect of wavelength. Reaction time in this condition appeared to follow a saturation function. The results are described in terms of the operation of achromatic and chromatic processing channels.