Colour vision brings clarity to shadows

We have revealed a new role for colour vision in visual scene analysis: colour vision facilitates shadow identification. Shadows are important features of the visual scene, providing information about the shape, depth, and movement of objects. To be useful for perception, however, shadows must be distinguished from other types of luminance variation, principally the variation in object reflectance. A potential cue for distinguishing shadows from reflectance variations is colour, since chromatic changes typically occur at object but not shadow boundaries. We tested whether colour cues were exploited by the visual system for shadow identification, by comparing the ability of human test subjects to identify simulated shadows on chromatically variegated versus achromatically variegated backgrounds with identical luminance compositions. Performance was superior with the chromatically variegated backgrounds. Furthermore, introducing random colour contrast across the shadow boundaries degraded their identification. These findings demonstrate that the visual system exploits inbuilt assumptions about the relationships between colour and luminance in the natural visual world.     

My shadow,myself: Cast-body shadows are embodied

Objects that serve as extensions of the body can produce a sensation of embodiment, feeling as if they are a part of us. We investigated the characteristics that drive an object’s embodiment, examining whether cast-body shadows, a purely visual stimulus, are embodied. Tools are represented as an extension of the body when they enable observers to interact with distant targets, perceptually distorting space. We examined whether perceptual distortion would also result from exposure to cast-body shadows in two separate distance estimation perceptual matching tasks. If observers represent cast-body shadows as extensions of their bodies, then when these shadows extend toward a target, it should appear closer than when no shadow is present (Experiment 1). This effect should not occur when a non-cast-body shadow is cast toward a target (Experiment 2). We found perceptual distortions in both cast-body shadow and tool-use conditions, but not in our non-cast-body shadow condition. These results suggest that, although cast-body shadows do not enable interaction with objects or provide direct tactile feedback, observers nonetheless represent their shadows as if they were a part of them.     

Rapid processing of cast and attached shadows

We used a visual-search method to investigate the role of shadows in the rapid discrimination of scene properties. Targets and distractors were light or dark 2-D crescents of identical shape and size, on a mid-grey background. From the dark stimuli, illusory 3-D shapes can be created by blurring one arc of the crescent. If the inner arc is blurred, the stimulus is perceived as a curved surface with attached shadow. If the outer arc is blurred, the stimulus is perceived as a flat surface casting a shadow. In a series of five experiments, we used this simple stimulus to map out the shadow properties that the human visual system can rapidly detect and discriminate. To subtract out 2-D image factors, we compared search performance for dark-shadow stimuli with performance for light-shadow stimuli which generally do not elicit strong 3-D percepts. We found that the human visual system is capable of rapid discrimination based upon a number of different shadow properties, including the type of the shadow (cast or attached), the direction of the shadow, and the displacement of the shadow. While it is clear that shadows are not simply discounted in rapid search, it is unclear at this stage whether rapid discrimination is acting upon shadows per se or upon representations of 3-D object shape and position elicited by perceived shadows.     

Impossible shadows and the shadow correspondence problem

Shadows cast by objects contain potentially useful information about the location of these objects in the scene as well as their surface reflectance. However, before the visual system can use this information, it has to solve the shadow correspondence problem, that is to match the objects with their respective shadows. In the first experiment, it is shown that the estimate of the light source position is affected by a gradual luminance ramp added to the image. In the second experiment, it is shown that observers process impossible shadow images as if they ignored the local features of the objects. All together, the results suggest that the visual system solves the shadow correspondence problem by relying on a coarse representation of the scene.     

Differential effects of cast shadows on perception and action

In two experiments we investigated the effects of cast shadows on different real-life tasks. In experiment 1, participants were required to make a speeded verbal identification of the target object (perceptual task), whereas in experiment 2 participants were required to reach for and grasp the target object (motor task). In both experiments real three-dimensional (3-D) objects were presented, one at a time, either with their own natural cast shadow (congruent condition) or with the cast shadow of a different object (incongruent condition). Shadows were cast either to the left or to the right of the object. We asked whether the features of the shadow (ie whether it is congruent or incongruent with the object, and whether it is cast to the left or to the right of the object) could influence perception and action differently. Results showed that cast shadows did not influence identification of real 3-D objects (experiment 1), but they affected movement kinematics, producing distractor-like interference, particularly on movement trajectory (experiment 2). These findings suggest a task-dependent influence of cast shadows on human performance. In the case of object-oriented actions, cast shadows may represent further affordances of the object, and as such compete for the control of the action.     

Perception of scene layout from optical contact, shadows, and motion

Kersten et al (1997 Perception 26 171-192) found that the perceived motion of an object in a 3-D scene was determined by the motion of a shadow. In the present study, we compared the effect of a shadow to that of a second object on the ground in determining the perceived position in depth of a floating object in both dynamic and stationary scenes. Changing the second (lower) object from textured to dark increased the influence of the second object on the judged position of the first object. Giving the second object zero thickness had this effect only if it was also dark. Variations in the height of the floating object were important with a second object but not with a shadow, in motion scenes. With alternative shadows present, the position of the floating object was determined primarily by matching speeds, with matching sizes as a secondary factor. These results show some similarities but important differences between the effect of a second object and that of a shadow.     

Shape from shadows

The colors, textures, and shapes of shadows are physically constrained in several ways in natural scenes. The visual system appears to ignore these constraints, however, and to accept many patterns as shadows even though they could not occur naturally. In the stimuli that we have studied, the only requirements for the perception of depth due to shadows were that shadow regions be darker than the surrounding, nonshadow regions and that there be consistent contrast polarity along the shadow border. Three-dimensional shape due to shadows was perceived when shadow areas were filled with colors or textures that could not occur in natural scenes, when shadow and nonshadow regions had textures that moved in different directions, or when they were presented on different depth planes. The results suggest that the interpretation of shadows begins with the identification of acceptable shadow borders by a cooperative process that requires consistent contrast polarity across a range of scales at each point along the border. Finally, we discuss how the identification of a shadow region can help the visual system to patch together areas that are separated by shadow boundaries, to identify directions of surface curvature, and to select a preferred three-dimensional interpretation while rejecting others.     

The perception of cast shadows

When an object casts its shadow on a background surface, the shadow can be informative about the shape of the object, the shape of the background surface and the spatial arrangement of the object relative to the background. Among all these roles, we found that cast shadows were perceptually most relevant for the recovery of spatial arrangement, especially when the shadow is in motion. This finding is intriguing when one considers the ambiguities in the possible ways that shadow motion can be interpreted. We reasoned that the visual system must use a priori constraints to disambiguate the cast shadow motion. One of these constraints is that the light source is stationary. Though simple, the stationary-light-source constraint supports rich, reliable inferences about the qualitative motions of objects in three dimensions.     

From body shadows to bodily attention: Automatic orienting of tactile attention driven by cast shadows

Body shadows orient attention to the body-part casting the shadow. We have investigated the automaticity of this phenomenon, by addressing its time-course and its resistance to contextual manipulations. When targets were tactile stimuli at the hands (Exp.1) or visual stimuli near the body-shadow (Exp.2), cueing effects emerged regardless of the delay between shadow and target onset (100, 600, 1200, 2400 ms). This suggests a fast and sustained attention orienting to body-shadows, that involves both the space occupied by shadows (extra-personal space) and the space the shadow refers to (own body). When target type became unpredictable (tactile or visual), shadow-cueing effects remained robust only for tactile targets, as visual stimuli showed no overall reliable effects, regardless of whether they occurred near the shadow (Exp.3) or near the body (Exp.4). We conclude that mandatory attention shifts triggered by body-shadows are limited to tactile targets and, instead, are less automatic for visual stimuli.     

Why cast shadows are expendable: insensitivity of human observers and the inherent ambiguity of cast shadows in pictorial art

The kinds of visual cues artists choose to use or not use in their work can offer insight into perceptual processes. On the basis of the observed paucity of the use of cast shadow in pictorial art, we hypothesized that cast shadows might be relatively expendable as pictorial cues. In this study, we investigated two potential reasons for this expendability: first, viewers might be insensitive to much of the information that cast shadows provide; and, second, ambiguities about what is shadow and what is pigment can often be resolved only through motion-something that static media are ill-equipped to deal with. In experiment 1, we used a visual-search paradigm in which viewers had to determine if there were odd cast shadows in sets of 4, 8, 16, and 32 objects. In experiment 2, viewers had to discriminate between shadow/pigment ambiguities in both still and moving images. Our results demonstrate that viewers are neither particularly sensitive to static cast-shadow incongruities, nor are they able to disambiguate cast shadow from pigment without continuous motion information. Taken together, these results may help explain why cast shadows are relatively rare in static pictorial work.     

Stereokinetic shapes and their shadows

The visual space of phenomenal appearances has a complex geometry which cannot be reduced strictly to Euclidean or projective geometry. The distinctive nature of this space and its objects is evidenced paradigmatically by stereokinetic phenomena, which are perceptual objects in actual three-dimensional coming into being. Stereokinetic phenomena produce the appearance not only of corporeality but also, in certain circumstances, of shadows. By altering certain components of his experiments on the three-dimensional appearance of a truncated cone, in fact, Musatti discovered that on its white base floats some sort of shadow obscuring stretches of the white lines. These shadows are connected to phenomena of amodal presentations successively analysed by Kanizsa. The continuity of the unfolding in visual space of stereokinetic transformations produces a diversified series of percepts coming into being, shadows included, and highlights the role of configurational movement as a factor of formal unification, thereby proposing once again the hypothesis of assimilative factors as responsible for the field organisation of past experience.     

Cast shadows in wide perspective

We investigated the apparent spatial layout of cast shadows up to very wide fields of view. We presented up to 130 degrees wide images in which two 'flat poles' were standing on a green lawn under a cloudless blue sky on a sunny day. The poles threw sharp cast shadows on the green, of which one was fixed. The observer's task was to adjust the azimuth of the shadow of the other pole such that it fitted the scene. The source elevation was kept constant. The two cast shadows are, of course, parallel in physical space, but generically not in the picture plane because of the wide perspective. We found that observers made huge systematic errors, indicating that, generically, they fail to account for these perspective effects. The systematic deviations could be well described by a weighted linear combination of the directions in the picture plane and in the physical space, with weights that depended on the positions of, and distance between, the poles.     

The influence of cast shadows on visual search

We show that cast shadows can have a significant influence on the speed of visual search. In particular, we find that search based on the shape of a region is affected when the region is darker than the background and corresponds to a shadow formed by lighting from above. Results support the proposal that an early-level system rapidly identifies regions as shadows and then discounts them, making their shapes more difficult to access. Several constraints used by this system are mapped out, including constraints on the luminance and texture of the shadow region, and on the nature of the item casting the shadow. Among other things, this system is found to distinguish between line elements (items containing only edges) and surface elements (items containing visible surfaces), with only the latter deemed capable of casting a shadow.     

The perception and recognition of natural object shape from deforming and static shadows

In this study of the informativeness of shadows for the perception of object shape, observers viewed shadows cast by a set of natural solid objects and were required to discriminate between them. In some conditions the objects underwent rotation in depth while in other conditions they remained stationary, thus producing both deforming and static shadows. The orientation of the light source casting the shadows was also varied, leading to further alterations in the shape of the shadows. When deformations in the shadow boundary were present, the observers were able to reliably recognize and discriminate between the objects, invariant over the shadow distortions produced by movements of the light source. The recognition performance for the static shadows depended critically upon the content of the specific views that were shown. These results support the idea that there are invariant features of shadow boundaries that permit the recognition of shape (cf Koenderink, 1984 Perception 13 321-330).     

Size From Shadow: Some Informational Paths Less Traveled

This article deals with informational structure in cast shadows. Most research on cast shadows has focused on retrieving various geometric properties of the scene from shadow patterns, the shape of objects and distances between objects being the foremost features. Size appears to be a rather neglected aspect. However, shadows contain a wealth of information about size. I explore first a simple heuristic (approximate equivalence of size of shadow and size of object) and some complicating factors: elongated shadows, shadows from pinholes, and penumbra. Finally, I discuss the case of relative size of objects in multiobject scenes with shadows.     

Use of interreflection and shadow for surface contact

The interaction of light with surfaces results in a number of lighting effects that may serve as valuable visual cues. Previous research on shadows has shown them to be effective in determining the three-dimensional (3-D) layout of a scene, but interreflections have been ignored as cues for spatial layout. Interreflections as well as shadows may help to disambiguate the 3-D layout of objects by providing information about an object's contact with a surface. We generated computer images of a box on an extended textured ground plane that was either in contact with the ground or was slightly above the ground. Images were rendered for four conditions: (1) no shadow + no interreflection, (2) shadow only, (3) interreflection only, and (4) shadow + interreflection. A photometrically incorrect condition was also included. The participants rated the degree of contact for each image on a scale, which was used to generate receiver operating characteristic (ROC) curves and a measure of sensitivity. In the images with no shadows or interreflections, the participants performed at chance levels. Interreflections, shadows, and a combination of interreflections and shadows all resulted in high sensitivity for judging object contact. More important, information from shadows and interreflections can be combined, resulting in near-perfect judgment of surface contact. Interreflections and shadows can be effective cues for object contact.     

Perception of the motion trajectory of objects from moving cast shadows in infant Japanese macaques (Macaca fuscata)

The shadows cast by moving objects enable human adults and infants to infer the motion trajectories of objects. Nonhuman animals must also be able to discriminate between objects and their shadows and infer the spatial layout of objects from cast shadows. However, the evolutionary and comparative developmental origins of sensitivity to cast shadows have not been investigated. In this study, we used a familiarity/novelty preferential looking procedure to assess the ability of infant macaques, aged 7–24 weeks, to discriminate between a ‘depth’ display containing a ball and cast shadow moving diagonally and an ‘up’ display containing a ball with a diagonal trajectory and a shadow with a horizontal trajectory. The infant macaques could discriminate the trajectories of the balls based on the moving shadows. These findings suggest that the ability to perceive the motion trajectory of an object from the moving shadow is common to both humans and macaques.     

Invariant recognition of natural objects in the presence of shadows

Shadows are frequently present when we recognize natural objects, but it is unclear whether they help or hinder recognition. Shadows could improve recognition by providing information about illumination and 3-D surface shape, or impair recognition by introducing spurious contours that are confused with object boundaries. In three experiments, we explored the effect of shadows on recognition of natural objects. The stimuli were digitized photographs of fruits and vegetables displayed with or without shadows. In experiment 1, we evaluated the effects of shadows, color, and image resolution on naming latency and accuracy. Performance was not affected by the presence of shadows, even for gray-scale, blurry images, where shadows are difficult to identify. In experiment 2, we explored recognition of two-tone images of the same objects. In these images, shadow edges are difficult to distinguish from object and surface edges because all edges are defined by a luminance boundary. Shadows impaired performance, but only in the early trials. In experiment 3, we examined whether shadows have a stronger impact when exposure time is limited, allowing little time for processing shadows; no effect of shadows was found. These studies show that recognition of natural objects is highly invariant to the complex luminance patterns caused by shadows.     

The perception of 3-D shape from shadows cast onto curved surfaces

In a natural environment, cast shadows abound. Objects cast shadows both upon themselves and upon background surfaces. Previous research on the perception of 3-D shape from cast shadows has only examined the informativeness of shadows cast upon flat background surfaces. In outdoor environments, however, background surfaces often possess significant curvature (large rocks, trees, hills, etc.), and this background curvature distorts the shape of cast shadows. The purpose of this study was to determine the extent to which observers can “discount” the distorting effects of curved background surfaces. In our experiments, observers viewed deforming or static shadows of naturally shaped objects, which were cast upon flat and curved background surfaces. The results showed that the discrimination of 3-D object shape from cast shadows was generally invariant over the distortions produced by hemispherical background surfaces. The observers often had difficulty, however, in identifying the shadows cast onto saddle-shaped background surfaces. The variations in curvature which occur in different directions on saddle-shaped background surfaces cause shadow distortions that lead to difficulties in object recognition and discrimination.     

Infants' perception of depth from cast shadows

Five- and 7-month-old infants viewed displays in which cast shadows provided information that two objects were at different distances. The 7-month-olds reached preferentially for the apparently nearer object under monocular-viewing conditions but exhibited no reaching preference under binocular-viewing conditions. These results indicate that 7-month-old infants perceive depth on the basis of cast shadows. The 5-month-olds did not reach preferentially for the apparently nearer object and, therefore, exhibited no evidence of sensitivity to cast shadows as depth information. In a second experiment, 5-month-olds reached preferentially for the nearer of two objects that were similar to those used in the first experiment but were positioned at different distances from the infant. This result indicated that 5-month-olds have the motor skills and motivation necessary to exhibit a reaching preference under the conditions of this study. The results are consistent with the hypothesis that depth perception based on cast shadows first appears between 5 and 7 months of age.