Perception of chromatic motion requires luminance interaction

There is an ongoing debate related to whether chromatic motion perception arises as a consequence of a chromatic signal only (eg Wandell et al 1999 Neuron 24 901-909) or a signal that is essentially based on luminance processes (luminance artifacts) (Mullen et al 2003 Vision Research 43 1235-1247). These two views conform to the idea that colour and luminance processes are physiologically independent (Livingstone and Hubel 1988 Science 240 740-749), but according to other reports many primary cortical 'V1' cells respond to both colour and luminance contrast (eg Vidyasagar et al 2002 European Journal of Neuroscience 16 945-956). A psychophysical task was designed to test whether possible interaction between luminance and chromatic contrast could account for perception of chromatic motion. It is shown that subjects respond in a manner that reflects involvement of both processes.     

The fluttering-heart illusion: a new hypothesis

The fluttering-heart illusion is a perceived lagging behind of a colour target on a background of a different colour when the two are oscillated together. It has been proposed that the illusion is caused by a differential in the perceptual latencies of different colours (Helmholtz 1867/1962), a differential in rod-cone latencies (von Kries 1896) and rod-cone interactions (von Grünau 1975, 1976 Vision Research 15 431-436, 437-440; 16 397-401; see list of references there). The purpose of this experiment was to assess the hypothesis that the fluttering-heart illusion is caused by a differential in the perceived velocities of chromatic and achromatic motion. To evaluate this hypothesis, we tested observers possessing normal colour vision and deuteranopes. The perceived delay of a chromatic target relative to an achromatic target was measured as a function of background cone contrast and target colour. For observers with normal colour vision, the perceived delay of the chromatic target is greater in the L-S than the L-M testing conditions. The reverse is observed in deuteranope observers. We suggest that this is caused by the absence of an L-M opponent mechanism contributing to chromatic motion in deuteranopes. Greater background cone contrasts tended to yield smaller perceived delays in both normal and deuteranope observers, indicating that greater chromatic modulation decreases the perceived delay of the colour target. These results support the hypothesis that the fluttering-heart illusion can be explained by a differential in the perceived velocities of chromatic and achromatic motion.     

The influence of depth segmentation on colour constancy

In real scenes, surfaces in different depth planes often differ in the luminance and chromatic content of their illumination. Scene segmentation is therefore an important issue when considering the compensation of illumination changes in our visual perception (lightness and colour constancy). Chromatic adaptation is an important sensory component of colour constancy and has been shown to be linked to the two-dimensional spatial structure of a scene (Werner, 2003 Vision Research 43 1611 - 1623). Here, the question is posed whether this cooperation also extends to the organisation of a scene in depth. The influence of depth on colour constancy was tested by introducing stereo disparity, whereby the test patch and background were perceived in either the same or one of five different depth planes (1.9-57 min of arc). There were no additional cues to depth such as shadows or specular highlights. For consistent illumination changes, colour constancy was reduced when the test patch and background were separated in depth, indicating a reduction of contextual influences. An interaction was found between the influences of stereo depth and spatial frequency on colour constancy. In the case of an inconsistent illumination change, colour constancy was reduced if the test patch and background were in the same depth plane (2-D condition), but not if they were separated in depth (3-D condition). Furthermore, colour constancy was slightly better in the 3-D inconsistent condition than in the 2-D inconsistent condition. It is concluded that depth segmentation supports colour constancy in scenes with inconsistent illumination changes. Processes of depth segmentation are implemented at an early sensory stage of colour constancy, and they define visual regions within which the effects of illuminant changes are discounted for separately. The results support recent models that posit such implementation of scene segmentation in colour constancy.     

The binocular combination of chromatic contrast

How is chromatic contrast combined binocularly? One index of binocularity is the binocular contrast summation ratio (BCSR), which is the improvement in contrast sensitivity with binocular rather than monocular presentation. Simmons and Kingdom (1998, Vision Research 38 1063-1071) noted that BCSRs with some red-green isoluminant stimuli were suggestive of full linear summation. This suggestion was investigated further in four subjects by measuring binocular and monocular contrast thresholds for the detection of 0.5 cycle deg(1) isoluminant (red-green) and isochromatic (yellow-black) Gabor patches. These Gabor patches had either vertically or horizontally oriented carrier gratings and were either dichoptically in phase (same coloured bars in binocular correspondence) or in dichoptic anti-phase (opposite coloured bars in binocular correspondence). Full linear summation would be indicated by BCSRs of 2 for the in-phase and close to 0 for the anti-phase conditions. Mean BCSRs at isoluminance were 1.93 and 0.90, respectively, for the in-phase and anti-phase stimuli with horizontal carriers, the former being consistent with full linear summation, but the latter not. Despite these results, BCSRs obtained with isoluminant and isochromatic stimuli under similar conditions were not statistically distinguishable from each other, although there was a tendency for summation at isoluminance with in-phase stimuli to be higher and anti-phase stimuli to be lower. These data fall short of demonstrating full linear summation of chromatic contrast between the eyes under all presentation conditions, but they do indicate that there are strong binocular interactions at red-green isoluminance, which are similar to, and possibly even stronger than, those obtained with luminance stimuli.     

Development of chromatic induction in infancy

The perception of colour in an embedded field is affected by the surround colour. This phenomenon is known as chromatic induction. In the present study we investigated whether the colour perception by infants aged 5–7 months could be affected by the surround colour. In Experiments 1 and 2 each stimulus was composed of an array of six squares in tandem. The colour appearance of the array in the familiarization stimulus was established by chromatic induction. In Experiment 1 we used familiarization stimuli that were perceived as two‐colour array with a two‐colour surround. In Experiment 2 we used a familiarization stimulus that was perceived as a uniform‐colour array with a two‐colour surround. In the test phase, the uniform‐colour array and the two‐colour array were presented on a white uniform‐colour surround in both experiments. The results showed that in Experiment 1 the 5‐ and 7‐month‐old infants had novelty preference for the uniform‐colour test array. This suggested that the infants' colour perception could be affected by surround colour. The results of Experiment 2 showed that the 7‐month‐olds showed a novelty preference for the two‐colour test array, but the 5‐month‐olds showed no novelty preference. This suggested that 7‐month‐olds' colour perception could be affected by surround colour, but that of 5‐month‐olds could not. We discuss the contradiction of the results between Experiments 1 and 2. Copyright © 2007 John Wiley & Sons, Ltd.     

Reduced chromatic discrimination in children with autism spectrum disorders

Atypical perception in Autism Spectrum Disorders (ASD) is well documented ( Dakin & Frith, 2005 ). However, relatively little is known about colour perception in ASD. Less accurate performance on certain colour tasks has led some to argue that chromatic discrimination is reduced in ASD relative to typical development ( Franklin, Sowden, Burley, Notman & Alder, 2008 ). The current investigation assessed chromatic discrimination in children with high-functioning autism (HFA) and typically developing (TD) children matched on age and non-verbal cognitive ability, using the Farnsworth-Munsell 100 hue test (Experiment 1) and a threshold discrimination task (Experiment 2). In Experiment 1, more errors on the chromatic discrimination task were made by the HFA than the TD group. Comparison with test norms revealed that performance for the HFA group was at a similar level to typically developing children around 3 years younger. In Experiment 2, chromatic thresholds were elevated for the HFA group relative to the TD group. For both experiments, reduced chromatic discrimination in ASD was due to a general reduction in chromatic sensitivity rather than a specific difficulty with either red–green or blue–yellow subsystems of colour vision. The absence of group differences on control tasks ruled out an explanation in terms of general task ability rather than chromatic sensitivity. Theories to account for the reduction in chromatic discrimination in HFA are discussed, and findings are related to cortical models of perceptual processing in ASD.     

Children reorient using the left/right sense of coloured landmarks at 18-24 months

In previous studies, children disoriented in small enclosures used room shape, but not wall colours, to find hidden objects. Their reorientation was said to depend solely on a "geometric module" informationally encapsulated with respect to colour. We argue that previous studies did not fully evaluate children's use of colour owing to a bias in the enclosures' design. In this study, disoriented 18-24 month olds searched for toys in small square enclosures with two blue and two white walls. Children successfully reoriented using wall colour. This shows that they can make location judgments based on the left/right sense of the colours of adjoining landmarks. Performance was no different when symmetric colourful shapes were added to walls, but improved with asymmetric shapes which could be used without left/right judgments. The relatively poor use of colour in previous studies may be explained partly by a bias in their design, and partly by children's limited ability to discriminate the left/right sense of nongeometric features.     

Colour vision is aligned with natural scene statistics at 4 months of age

Visual perception in adult humans is thought to be tuned to represent the statistical regularities of natural scenes. For example, in adults, visual sensitivity to different hues shows an asymmetry which coincides with the statistical regularities of colour in the natural world. Infants are sensitive to statistical regularities in social and linguistic stimuli, but whether or not infants’ visual systems are tuned to natural scene statistics is currently unclear. We measured colour discrimination in infants to investigate whether or not the visual system can represent chromatic scene statistics in very early life. Our results reveal the earliest association between vision and natural scene statistics that has yet been found: even as young as 4 months of age, colour vision is aligned with the distributions of colours in natural scenes.

Research Highlights

1. We find infants’ colour sensitivity is aligned with the distribution of colours in the natural world, as it is in adults.
2. At just 4 months, infants’ visual systems are tailored to extract and represent the statistical regularities of the natural world.
3. This points to a drive for the human brain to represent statistical regularities even at a young age.

     

“Filling-in” colour in natural scenes

Our subjective experience of the world as being in full colour across the entire visual field is at odds with the highly fovea-biased distribution of cones in the retina. It is unclear how this percept of “pan-field colour” comes about. We use novel stimuli—“colour chimeras”—to demonstrate a related visual phenomenon in which observers perceive rich colour throughout images with large achromatic regions. This percept appears to critically depend on natural scene statistics. By separately manipulating chromatic and structural content in such images, we demonstrate that both the spatial distribution of colour and the presence of recognizable scene structure contribute to the experience of pan-field colour in these stimuli. Our results suggest that this percept is unlikely to be due to a low-level colour spreading process. Instead, we suggest that mechanisms dependent on natural scenes’ chromatic and luminance statistics provide the basis for the phenomenon.     

Motion, flash, and flicker: a unified spatiotemporal model of perceived edge sharpening

Blurred edges appear sharper in motion than when they are stationary. We proposed a model of this motion sharpening that invokes a local, nonlinear contrast transducer function (Hammett et al, 1998 Vision Research 38 2099-2108). Response saturation in the transducer compresses or 'clips' the input spatial waveform, rendering the edges as sharper. To explain the increasing distortion of drifting edges at higher speeds, the degree of nonlinearity must increase with speed or temporal frequency. A dynamic contrast gain control before the transducer can account for both the speed dependence and approximate contrast invariance of motion sharpening (Hammett et al, 2003 Vision Research, in press). We show here that this model also predicts perceived sharpening of briefly flashed and flickering edges, and we show that the model can account fairly well for experimental data from all three modes of presentation (motion, flash, and flicker). At moderate durations and lower temporal frequencies the gain control attenuates the input signal, thus protecting it from later compression by the transducer. The gain control is somewhat sluggish, and so it suffers both a slow onset, and loss of power at high temporal frequencies. Consequently, brief presentations and high temporal frequencies of drift and flicker are less protected from distortion, and show greater perceptual sharpening.     

Chromatic masking revealed by the standing wave of invisibility illusion

We have used the standing wave of invisibility illusion (Macknik and Livingstone, 1998 Nature Neuroscience 1 144-149) to examine the masking effects produced by a range of stimuli of varying chromatic and luminance contrast content. The pattern of masking was highly selective. Maximum effects were always obtained when the target and mask were identical in terms of their chromatic and/or luminance contrast composition, but were reduced as the angular separation in colour space between them was increased. Masking was of a monopolar nature, indicating the operation of rectified mechanisms selective for different combinations of colour and luminance contrast.     

Effect of scene complexity on colour constancy with real three-dimensional scenes and objects

The effect of scene complexity on colour constancy was tested with a novel technique in which a virtual image of a real 3-D test object was projected into a real 3-D scene. Observers made discriminations between illuminant and material changes in simple and complex scenes. The extent of colour constancy achieved varied little with either scene structure or test-object colour, suggesting a dominant role of local cues in determining surface-colour judgments.     

The role of part structure in the perceptual localization of a shape

The process of object localization may be accomplished with respect to a particular reference location, such as the center of gravity, COG (eg Vishwanath and Kowler, 2003 Vision Research 43 1637-1653). Here, we investigated how part structure affects an object's reference location. The reference location was evaluated with a measure of the illusory displacement of an internal target element embedded within a larger object (Morgan et al, 1990 Vision Research 30 1793-1810). To examine whether the reference location is different for shapes with part structure, two shapes were tested: circle (small and large; no part structure) and bell (shape with two parts, one larger than the other). Results were examined with respect to two predictions: either the location of an object is based on its shape as a whole, disregarding part structure (ie a single, overall COG), or the parts are processed separately (different COGs). With the circles, the results showed a systematic illusory displacement of the internal target toward the COG. With the bell, the illusion was significantly weaker than with both circles--even though the main part of the bell had the same size as the small circle, and its horizontal axis had the same extent as the large circle. Moreover, the distance judgments for the bell were consistent with a (weaker) reference point being located at the COG of the larger part, rather than at the COG of the entire bell. These results show that the part structure of a shape plays a role in the representation of its location, and that for complex shapes the perceived location of an embedded element depends more on the parts within which it is embedded, rather than on the whole shape.     

Opponent chromatic response functions for an average observer

Average opponent chromatic response functions are presented for use in quantitative models of color perception. Theoretical transformations of photopigment input are related to opponent channel activity. Opponent chromatic activity is, in turn, used to describe a theoretical huenaming curve for an average observer.     

Anomalous induction of brightness and surface qualities: a new illusion due to radial lines and chromatic rings

When a chromatic (eg light-blue) annulus surrounds the central gap of an Ehrenstein figure so as to connect the inner ends of the radial lines, a striking new lightness effect emerges: the central white disk has both a self-luminous quality (brighter than in the regular Ehrenstein figure) and a surface quality (dense, paste-like). Self-luminous and surface qualities do not ordinarily appear co-extensively: hence, the brightness induction is called anomalous. In experiment 1, subjects separately scaled self-luminous and surface properties, and in experiment 2, brightness was nulled by physically darkening the central gap. Experiments 3 and 4 were designed to evaluate the importance of chromatic versus achromatic properties of the annulus; other aspects of the annulus (width or the inclusion of a thin black ring inside or outside the chromatic annulus) were tested in experiments 5-7. In experiments 8-12, subjects rated the brightness of modified Ehrenstein figures varying the radial lines (number, length, width, contrast, arrangement). Variation of these parameters generally affected brightness enhancement in the Ehrenstein figure and anomalous brightness induction in a similar manner, but was stronger for the latter effect. On the basis of these results, anomalous brightness induction is attributed to a surface induction process triggered by an interaction between illusory brightness enhancement (due to the radial lines) and border ownership (due to the blue annulus).     

Second-order statistics of colour codes modulate transformations that effectuate varying degrees of scene invariance and illumination invariance

We argue, from an ethology-inspired perspective, that the internal concepts 'surface colours' and 'illumination colours' are part of the data format of two different representational primitives. Thus, the internal concept of 'colour' is not a unitary one but rather refers to two different types of 'data structure', each with its own proprietary types of parameters and relations. The relation of these representational structures is modulated by a class of parameterised transformations whose effects are mirrored in the idealised computational achievements of illumination invariance of colour codes, on the one hand, and scene invariance, on the other hand. Because the same characteristics of a light array reaching the eye can be physically produced in many different ways, the visual system, then, has to make an 'inference' whether a chromatic deviation of the space-averaged colour codes from the neutral point is due to a 'non-normal', ie chromatic, illumination or due to an imbalanced spectral reflectance composition. We provide evidence that the visual system uses second-order statistics of chromatic codes of a single view of a scene in order to modulate corresponding transformations. In our experiments we used centre surround configurations with inhomogeneous surrounds given by a random structure of overlapping circles, referred to as Seurat configurations. Each family of surrounds has a fixed space-average of colour codes, but differs with respect to the covariance matrix of colour codes of pixels that defines the chromatic variance along some chromatic axis and the covariance between luminance and chromatic channels. We found that dominant wavelengths of red-green equilibrium settings of the infield exhibited a stable and strong dependence on the chromatic variance of the surround. High variances resulted in a tendency towards 'scene invariance', low variances in a tendency towards 'illumination invariance' of the infield.     

'Squaring' is better at predicting plaid motion than the vector average or intersection of constraints

How do humans combine the velocity information from two moving gratings (plaids) to detect pattern motion direction?-We are still unable to answer this question. The 'intersection of constraints' rule (IOC-Adelson and Movshon, 1982 Nature 300 523-525), and the 'vector average' rule (VA-Wilson et al, 1992 Visual Neuroscience 9 79-97) have both been supported by results in the plaid literature, but could these results be predicted by a 'squaring' nonlinearity that now forms part of several influential spatiotemporal energy models (Wilson et al 1992, loco cit.; Lu and Sperling, 1995 Vision Research 35 2697-2722; Simoncelli and Heeger, 1998 Vision Research 38 743-761)? Spatiotemporal energy in these models predicts directions other than those predicted by standard spatiotemporal energy models and may underlie the results that support the combination rules. The two combination rules and predictions from 'squaring' were tested under identical conditions. In the first three experiments a plaid was randomly presented in one of 45 different orientations, and observers were asked to remember the direction. The stimulus was then replaced by an oriented line indicating the direction predicted by one of the hypotheses. The observer was unaware which hypothesis had generated the line and was asked to make a same/different judgment. Results showed that the 'squaring' hypothesis was better at predicting perceived direction than either the IOC or VA.     

Saturation estimates and chromatic adaptation

Category estimates of spectral saturation were obtained from three observers under neutral adaptation and under three conditions of chromatic adaptation. The data so obtained show that chromatic adaptation causes a shift in the location of minimal spectral saturation toward the spectral locus of the adapting light. The existence of secondary minima and enhancement effects in spectral saturation are also noted.     

A biologically inspired algorithm for the recovery of shading and reflectance images

We present an algorithm for separating the shading and reflectance images of photographed natural scenes. The algorithm exploits the constraint that in natural scenes chromatic and luminance variations that are co-aligned mainly arise from changes in surface reflectance, whereas near-pure luminance variations mainly arise from shading and shadows. The novel aspect of the algorithm is the initial separation of the image into luminance and chromatic image planes that correspond to the luminance, red-green, and blue-yellow channels of the primate visual system. The red-green and blue-yellow image planes are analysed to provide a map of the changes in surface reflectance, which is then used to separate the reflectance from shading changes in both the luminance and chromatic image planes. The final reflectance image is obtained by reconstructing the chromatic and luminance-reflectance-change maps, while the shading image is obtained by subtracting the reconstructed luminance-reflectance image from the original luminance image. A number of image examples are included to illustrate the successes and limitations of the algorithm.     

Distinguishing choice and subjective probability estimation processes: Implications for theories of judgment and for cross-cultural comparisons

Research on subjective probability (SP) often focuses on the difference between the fraction of correct binary choices and the SP that they are correct or on the deviation of the calibration curve from the diagonal. On the assumption that choice and SP judgments reflect different, albeit closely related, processes, it is important to analyze the two sources of data separately. This article uses data collected by Yates, Lee, Shinotsuka, Patalano, and Sieck (1998) from Chinese, Japanese, and Americans to demonstrate the advantages of doing so and to yield new conclusions regarding cross-cultural comparisons of judgment. One new result is that a discrete threshold model with an error term best described the choice data of all groups. From their analyses, Yates et al. (1998) had concluded that the Chinese were more overconfident than the American or Japanese. According to the present results, the Chinese appeared either more overconfident or more underconfident, depending on how the data are analyzed. The dual outcome is a consequence of the greater variability both in their SP judgments and in their binary choices. Additionally, the Chinese participants’ choices and SPs were more responsive to the base rate than were those of the other groups.