Impossible shadows and the shadow correspondence problem

Shadows cast by objects contain potentially useful information about the location of these objects in the scene as well as their surface reflectance. However, before the visual system can use this information, it has to solve the shadow correspondence problem, that is to match the objects with their respective shadows. In the first experiment, it is shown that the estimate of the light source position is affected by a gradual luminance ramp added to the image. In the second experiment, it is shown that observers process impossible shadow images as if they ignored the local features of the objects. All together, the results suggest that the visual system solves the shadow correspondence problem by relying on a coarse representation of the scene.     

My shadow,myself: Cast-body shadows are embodied

Objects that serve as extensions of the body can produce a sensation of embodiment, feeling as if they are a part of us. We investigated the characteristics that drive an object’s embodiment, examining whether cast-body shadows, a purely visual stimulus, are embodied. Tools are represented as an extension of the body when they enable observers to interact with distant targets, perceptually distorting space. We examined whether perceptual distortion would also result from exposure to cast-body shadows in two separate distance estimation perceptual matching tasks. If observers represent cast-body shadows as extensions of their bodies, then when these shadows extend toward a target, it should appear closer than when no shadow is present (Experiment 1). This effect should not occur when a non-cast-body shadow is cast toward a target (Experiment 2). We found perceptual distortions in both cast-body shadow and tool-use conditions, but not in our non-cast-body shadow condition. These results suggest that, although cast-body shadows do not enable interaction with objects or provide direct tactile feedback, observers nonetheless represent their shadows as if they were a part of them.     

Why cast shadows are expendable: insensitivity of human observers and the inherent ambiguity of cast shadows in pictorial art

The kinds of visual cues artists choose to use or not use in their work can offer insight into perceptual processes. On the basis of the observed paucity of the use of cast shadow in pictorial art, we hypothesized that cast shadows might be relatively expendable as pictorial cues. In this study, we investigated two potential reasons for this expendability: first, viewers might be insensitive to much of the information that cast shadows provide; and, second, ambiguities about what is shadow and what is pigment can often be resolved only through motion-something that static media are ill-equipped to deal with. In experiment 1, we used a visual-search paradigm in which viewers had to determine if there were odd cast shadows in sets of 4, 8, 16, and 32 objects. In experiment 2, viewers had to discriminate between shadow/pigment ambiguities in both still and moving images. Our results demonstrate that viewers are neither particularly sensitive to static cast-shadow incongruities, nor are they able to disambiguate cast shadow from pigment without continuous motion information. Taken together, these results may help explain why cast shadows are relatively rare in static pictorial work.     

Some varieties of shadow illusions: split shadows, occluded shadows, stolen shadows, and shadows of shadows

Shadows are visual objects and as such are subject to preference rules for segmenting the visual scene (such as Gestalt laws). These rules govern shadows along two dimensions: their general unity and individuation (eg they describe a certain area as a unitary shadow as opposed to a set of two distinct shadows), and their being the shadow of a given object, as opposed to being the shadow of any other object in the scene (the shadow correspondence problem Mamassian, 2004 Perception 33 1279-1290). I describe a few phenomena that indicate the interplay of preferences in determining the final visual aspect of scenes in which shadows are present.     

Is Complex Visual Information Implicated During Language Comprehension? The Case of Cast Shadows

Previous research showed that sensorimotor information affects the perception of properties associated with implied perceptual context during language comprehension. Three experiments addressed a novel question of whether perceptual context may contribute to a simulation of information about such out-of-sight objects as cast shadows. In Experiment 1, participants read a sentence that implied a particular shadow cast on a target (blinds vs. an open window) and then verified the picture of the object onto which a shadow was cast. Responses were faster when the shadow of blinds cast on the object matched that implied by the sentence. However, the data did not show the same matching effect for pictures with cast shadows from an open window. In Experiments 2 and 3, we found that verification times for pictures with no cast shadows were faster when preceded by an “open window” sentence, thus suggesting that reading the sentence does not elicit a visual simulation of any specific shadow. Experiment 3 showed that the objects superimposed with a cast shadow of the blinds and blinds themselves were verified faster after reading a “blinds” sentence. However, the results of an order analysis showed the temporal stability of the “blinds shadows” effect, but the disappearance of the “blinds” effect in the second half of the data. We conclude that the results are compatible, to a lesser or greater extent, with multiple accounts, and discuss our findings in the context of a mental imagery view, a mental simulation view, and an amodal representation view.     

Stereokinetic shapes and their shadows

The visual space of phenomenal appearances has a complex geometry which cannot be reduced strictly to Euclidean or projective geometry. The distinctive nature of this space and its objects is evidenced paradigmatically by stereokinetic phenomena, which are perceptual objects in actual three-dimensional coming into being. Stereokinetic phenomena produce the appearance not only of corporeality but also, in certain circumstances, of shadows. By altering certain components of his experiments on the three-dimensional appearance of a truncated cone, in fact, Musatti discovered that on its white base floats some sort of shadow obscuring stretches of the white lines. These shadows are connected to phenomena of amodal presentations successively analysed by Kanizsa. The continuity of the unfolding in visual space of stereokinetic transformations produces a diversified series of percepts coming into being, shadows included, and highlights the role of configurational movement as a factor of formal unification, thereby proposing once again the hypothesis of assimilative factors as responsible for the field organisation of past experience.     

Size From Shadow: Some Informational Paths Less Traveled

This article deals with informational structure in cast shadows. Most research on cast shadows has focused on retrieving various geometric properties of the scene from shadow patterns, the shape of objects and distances between objects being the foremost features. Size appears to be a rather neglected aspect. However, shadows contain a wealth of information about size. I explore first a simple heuristic (approximate equivalence of size of shadow and size of object) and some complicating factors: elongated shadows, shadows from pinholes, and penumbra. Finally, I discuss the case of relative size of objects in multiobject scenes with shadows.     

The perception and recognition of natural object shape from deforming and static shadows

In this study of the informativeness of shadows for the perception of object shape, observers viewed shadows cast by a set of natural solid objects and were required to discriminate between them. In some conditions the objects underwent rotation in depth while in other conditions they remained stationary, thus producing both deforming and static shadows. The orientation of the light source casting the shadows was also varied, leading to further alterations in the shape of the shadows. When deformations in the shadow boundary were present, the observers were able to reliably recognize and discriminate between the objects, invariant over the shadow distortions produced by movements of the light source. The recognition performance for the static shadows depended critically upon the content of the specific views that were shown. These results support the idea that there are invariant features of shadow boundaries that permit the recognition of shape (cf Koenderink, 1984 Perception 13 321-330).     

Differential effects of cast shadows on perception and action

In two experiments we investigated the effects of cast shadows on different real-life tasks. In experiment 1, participants were required to make a speeded verbal identification of the target object (perceptual task), whereas in experiment 2 participants were required to reach for and grasp the target object (motor task). In both experiments real three-dimensional (3-D) objects were presented, one at a time, either with their own natural cast shadow (congruent condition) or with the cast shadow of a different object (incongruent condition). Shadows were cast either to the left or to the right of the object. We asked whether the features of the shadow (ie whether it is congruent or incongruent with the object, and whether it is cast to the left or to the right of the object) could influence perception and action differently. Results showed that cast shadows did not influence identification of real 3-D objects (experiment 1), but they affected movement kinematics, producing distractor-like interference, particularly on movement trajectory (experiment 2). These findings suggest a task-dependent influence of cast shadows on human performance. In the case of object-oriented actions, cast shadows may represent further affordances of the object, and as such compete for the control of the action.     

Use of interreflection and shadow for surface contact

The interaction of light with surfaces results in a number of lighting effects that may serve as valuable visual cues. Previous research on shadows has shown them to be effective in determining the three-dimensional (3-D) layout of a scene, but interreflections have been ignored as cues for spatial layout. Interreflections as well as shadows may help to disambiguate the 3-D layout of objects by providing information about an object's contact with a surface. We generated computer images of a box on an extended textured ground plane that was either in contact with the ground or was slightly above the ground. Images were rendered for four conditions: (1) no shadow + no interreflection, (2) shadow only, (3) interreflection only, and (4) shadow + interreflection. A photometrically incorrect condition was also included. The participants rated the degree of contact for each image on a scale, which was used to generate receiver operating characteristic (ROC) curves and a measure of sensitivity. In the images with no shadows or interreflections, the participants performed at chance levels. Interreflections, shadows, and a combination of interreflections and shadows all resulted in high sensitivity for judging object contact. More important, information from shadows and interreflections can be combined, resulting in near-perfect judgment of surface contact. Interreflections and shadows can be effective cues for object contact.     

Effects of perceptual and conceptual similarities on consumers' evaluations of copycat brand names

Copycats often choose brand names that mimic perceptual, conceptual, or both elements of leading brand names. Yet little is known about how perceptual and conceptual similarities of a copycat interact to affect consumers' evaluations, especially in logographic language systems (e.g., Chinese). Three laboratory experiments demonstrate that perceptual similarity alone leads to negative evaluations of copycat brand names; this negative effect, however, can be mitigated when conceptual similarity is added. The underlying mechanism for this effect can be traced to consumers' persuasion knowledge. Perceptual (vs. conceptual) similarity activates consumers' persuasion knowledge about the insincere motives of the copycat brand, which in turn shapes their brand evaluations. However, this effect can become less prominent when conceptual similarity is added because it alleviates use of persuasion knowledge, or when a consumer is in a happy mood because it neutralizes persuasion knowledge. These findings shed light on how different types of copycat strategies interact to affect copycat brand name evaluations and offer important implications for marketing practice. Copyright © 2015 John Wiley & Sons, Ltd.     

Perception of the motion trajectory of objects from moving cast shadows in infant Japanese macaques (Macaca fuscata)

The shadows cast by moving objects enable human adults and infants to infer the motion trajectories of objects. Nonhuman animals must also be able to discriminate between objects and their shadows and infer the spatial layout of objects from cast shadows. However, the evolutionary and comparative developmental origins of sensitivity to cast shadows have not been investigated. In this study, we used a familiarity/novelty preferential looking procedure to assess the ability of infant macaques, aged 7–24 weeks, to discriminate between a ‘depth’ display containing a ball and cast shadow moving diagonally and an ‘up’ display containing a ball with a diagonal trajectory and a shadow with a horizontal trajectory. The infant macaques could discriminate the trajectories of the balls based on the moving shadows. These findings suggest that the ability to perceive the motion trajectory of an object from the moving shadow is common to both humans and macaques.     

Spinning Shadows

If a spinning sphere casts a shadow, does the shadow also spin? This riddle is the point of departure for an investigation into the nature of shadow movement. A general theory of motion will encompass all moving things, not just physical objects. Ultimately, I argue that round shadows do indeed spin. Shadows are followers of the objects that cast them. Parts of the shadow correspond to parts of the leader, so motion of the caster's parts accounts for motions of the shadow's parts. I conclude with a discussion of how the dynamic aspects of shadows impose subtle constraints on other puzzles about shadows.     

The perception of cast shadows

When an object casts its shadow on a background surface, the shadow can be informative about the shape of the object, the shape of the background surface and the spatial arrangement of the object relative to the background. Among all these roles, we found that cast shadows were perceptually most relevant for the recovery of spatial arrangement, especially when the shadow is in motion. This finding is intriguing when one considers the ambiguities in the possible ways that shadow motion can be interpreted. We reasoned that the visual system must use a priori constraints to disambiguate the cast shadow motion. One of these constraints is that the light source is stationary. Though simple, the stationary-light-source constraint supports rich, reliable inferences about the qualitative motions of objects in three dimensions.     

Colour vision brings clarity to shadows

We have revealed a new role for colour vision in visual scene analysis: colour vision facilitates shadow identification. Shadows are important features of the visual scene, providing information about the shape, depth, and movement of objects. To be useful for perception, however, shadows must be distinguished from other types of luminance variation, principally the variation in object reflectance. A potential cue for distinguishing shadows from reflectance variations is colour, since chromatic changes typically occur at object but not shadow boundaries. We tested whether colour cues were exploited by the visual system for shadow identification, by comparing the ability of human test subjects to identify simulated shadows on chromatically variegated versus achromatically variegated backgrounds with identical luminance compositions. Performance was superior with the chromatically variegated backgrounds. Furthermore, introducing random colour contrast across the shadow boundaries degraded their identification. These findings demonstrate that the visual system exploits inbuilt assumptions about the relationships between colour and luminance in the natural visual world.     

Intuitive optics: what great apes infer from mirrors and shadows

There is ongoing debate about the extent to which nonhuman animals, like humans, can go beyond first-order perceptual information to abstract structural information from their environment. To provide more empirical evidence regarding this question, we examined what type of information great apes (chimpanzees, bonobos, and orangutans) gain from optical effects such as shadows and mirror images. In an initial experiment, we investigated whether apes would use mirror images and shadows to locate hidden food. We found that all examined ape species used these cues to find the food. Follow-up experiments showed that apes neither confused these optical effects with the food rewards nor did they merely associate cues with food. First, naïve chimpanzees used the shadow of the hidden food to locate it but they did not learn within the same number of trials to use a perceptually similar rubber patch as indicator of the hidden food reward. Second, apes made use of the mirror images to estimate the distance of the hidden food from their own body. Depending on the distance, apes either pointed into the direction of the food or tried to access the hidden food directly. Third, apes showed some sensitivity to the geometrical relation between mirror orientation and mirrored objects when searching hidden food. Fourth, apes tended to interpret mirror images and pictures of these mirror images differently depending on their prior knowledge. Together, these findings suggest that apes are sensitive to the optical relation between mirror images and shadows and their physical referents.     

Invariant recognition of natural objects in the presence of shadows

Shadows are frequently present when we recognize natural objects, but it is unclear whether they help or hinder recognition. Shadows could improve recognition by providing information about illumination and 3-D surface shape, or impair recognition by introducing spurious contours that are confused with object boundaries. In three experiments, we explored the effect of shadows on recognition of natural objects. The stimuli were digitized photographs of fruits and vegetables displayed with or without shadows. In experiment 1, we evaluated the effects of shadows, color, and image resolution on naming latency and accuracy. Performance was not affected by the presence of shadows, even for gray-scale, blurry images, where shadows are difficult to identify. In experiment 2, we explored recognition of two-tone images of the same objects. In these images, shadow edges are difficult to distinguish from object and surface edges because all edges are defined by a luminance boundary. Shadows impaired performance, but only in the early trials. In experiment 3, we examined whether shadows have a stronger impact when exposure time is limited, allowing little time for processing shadows; no effect of shadows was found. These studies show that recognition of natural objects is highly invariant to the complex luminance patterns caused by shadows.     

Shadow recognition in human infants

Seventy-five children of five different age groups (ranging from 13–18 to 37–42 months of age) were tested using various nonverbal indices for (a) their ability to respond to shadowed information about objects other than themselves, (b) their ability to manipulate their own shadow, and (c) their ability to recognize their own shadow as evidenced by the explicit use of shadowed information about themselves to respond to themselves. The results show that although infants are aware of shadows and show signs of having mastered the concept of shadow permanence at a fairly early age, compelling evidence of shadow self-recognition is developmentally delayed relative to what has been reported for the onset of mirror self-recognition, with most infants failing to show positive evidence prior to 3 years of age. The results are discussed in light of psychological differences that may exist between shadows and mirrors. Prior involvement and/or tutoring by parents about shadows had no effect on the emergence of shadow recognition.     

Shape from shadows

The colors, textures, and shapes of shadows are physically constrained in several ways in natural scenes. The visual system appears to ignore these constraints, however, and to accept many patterns as shadows even though they could not occur naturally. In the stimuli that we have studied, the only requirements for the perception of depth due to shadows were that shadow regions be darker than the surrounding, nonshadow regions and that there be consistent contrast polarity along the shadow border. Three-dimensional shape due to shadows was perceived when shadow areas were filled with colors or textures that could not occur in natural scenes, when shadow and nonshadow regions had textures that moved in different directions, or when they were presented on different depth planes. The results suggest that the interpretation of shadows begins with the identification of acceptable shadow borders by a cooperative process that requires consistent contrast polarity across a range of scales at each point along the border. Finally, we discuss how the identification of a shadow region can help the visual system to patch together areas that are separated by shadow boundaries, to identify directions of surface curvature, and to select a preferred three-dimensional interpretation while rejecting others.     

Rapid processing of cast and attached shadows

We used a visual-search method to investigate the role of shadows in the rapid discrimination of scene properties. Targets and distractors were light or dark 2-D crescents of identical shape and size, on a mid-grey background. From the dark stimuli, illusory 3-D shapes can be created by blurring one arc of the crescent. If the inner arc is blurred, the stimulus is perceived as a curved surface with attached shadow. If the outer arc is blurred, the stimulus is perceived as a flat surface casting a shadow. In a series of five experiments, we used this simple stimulus to map out the shadow properties that the human visual system can rapidly detect and discriminate. To subtract out 2-D image factors, we compared search performance for dark-shadow stimuli with performance for light-shadow stimuli which generally do not elicit strong 3-D percepts. We found that the human visual system is capable of rapid discrimination based upon a number of different shadow properties, including the type of the shadow (cast or attached), the direction of the shadow, and the displacement of the shadow. While it is clear that shadows are not simply discounted in rapid search, it is unclear at this stage whether rapid discrimination is acting upon shadows per se or upon representations of 3-D object shape and position elicited by perceived shadows.