Lightness constancy in the presence of specular highlights

Abstract— Visible surfaces in a natural environment often have multiple components of reflectance, including a diffuse component, by which light is scattered isotropically in all possible directions, and a specular component, by which light is reflected anisotropically within a limited range of directions. The research described in the present article was designed to investigate how these different components of reflectance influence the perception of lightness. Human observers were presented with shaded images of smoothly curved surfaces and asked to compare the relative lightness of different surface regions whose diffuse and specular components of luminance were independently manipulated. The results revealed that observers are able to discount the presence of specular highlights so that the relative lightness among different regions is determined almost entirely by the diffuse component of surface reflectance.     

The perception of surface orientation from multiple sources of optical information

An orientation matching task was used to evaluate observers’ sensitivity to local surface orientation at designated probe points on randomly shaped 3-D objects that were optically defined by texture, lambertian shading, or specular highlights. These surfaces could be stationary or in motion, and they could be viewed either monocularly or stereoscopically, in all possible combinations. It was found that the deformations of shading and/or highlights (either over time or between the two eyes’ views) produced levels of performance similar to those obtained for the optical deformations of textured surfaces. These findings suggest that the human visual system utilizes a much richer array of optical information to support its perception of shape than is typically appreciated.     

Aging and visual 3-D shape recognition from motion

Two experiments were conducted to evaluate the ability of younger and older adults to recognize 3-D object shape from patterns of optical motion. In Experiment 1, participants were required to identify dotted surfaces that rotated in depth (i.e., surface structure portrayed using the kinetic depth effect). The task difficulty was manipulated by limiting the surface point lifetimes within the stimulus apparent motion sequences. In Experiment 2, the participants identified solid, naturally shaped objects (replicas of bell peppers, Capsicum annuum) that were defined by occlusion boundary contours, patterns of specular highlights, or combined optical patterns containing both boundary contours and specular highlights. Significant and adverse effects of increased age were found in both experiments. Despite the fact that previous research has found that increases in age do not reduce solid shape discrimination, our current results indicated that the same conclusion does not hold for shape identification. We demonstrated that aging results in a reduction in the ability to visually recognize 3-D shape independent of how the 3-D structure is defined (motions of isolated points, deformations of smooth optical fields containing specular highlights, etc.).     

The visual perception of 3D shape

A fundamental problem for the visual perception of 3D shape is that patterns of optical stimulation are inherently ambiguous. Recent mathematical analyses have shown, however, that these ambiguities can be highly constrained, so that many aspects of 3D structure are uniquely specified even though others might be underdetermined. Empirical results with human observers reveal a similar pattern of performance. Judgments about 3D shape are often systematically distorted relative to the actual structure of an observed scene, but these distortions are typically constrained to a limited class of transformations. These findings suggest that the perceptual representation of 3D shape involves a relatively abstract data structure that is based primarily on qualitative properties that can be reliably determined from visual information.     

Shape from shading from images rendered with various surface types and light fields

Shape constancy is referred to as the tendency for the perceived shape of an object to remain unchanged even under changed viewing and illumination conditions. We investigated, in two experiments, whether shape constancy would hold for images of 3-D solid objects defined by shading only, whose renderings differed in terms of surface material type (bi-directional reflectance distribution functions), light field, light direction, shape, and specularity. Observers were presented with the image of a sphere or an ellipsoid and required to set perceived orientation and cross-section profile on designated points of the image. Results showed that shape judgments varied with all the aforementioned variables except specularity. Shape estimates were more precise with specular than asperity scattering surfaces, collimated than hemispherical diffuse lighting conditions, lower than higher elevations, spherical than ellipsoidal shapes, but not different between surfaces having differing specularity. These results suggest that shape judgments are made largely on the basis of the overall intensity distribution of shading, and that the portions of intensity distribution that are due to nonstructural variables such as surface material type or light field are not excluded in the process of shape estimation, as if being due to structural components. It is concluded that little constancy is expected in the perception of shape from shading.     

Young children reorient by computing layout geometry, not by matching images of the environment

Disoriented animals from ants to humans reorient in accord with the shape of the surrounding surface layout: a behavioral pattern long taken as evidence for sensitivity to layout geometry. Recent computational models suggest, however, that the reorientation process may not depend on geometrical analyses but instead on the matching of brightness contours in 2D images of the environment. Here we test this suggestion by investigating young children's reorientation in enclosed environments. Children reoriented by extremely subtle geometric properties of the 3D layout: bumps and ridges that protruded only slightly off the floor, producing edges with low contrast. Moreover, children failed to reorient by prominent brightness contours in continuous layouts with no distinctive 3D structure. The findings provide evidence that geometric layout representations support children's reorientation.     

Aging and the perception of local surface orientation from optical patterns of shading and specular highlights

Younger and older observers' ability to perceive local surface orientation from optical patterns of shading and specular highlights was investigated in two experiments. On each trial, the observers viewed a randomly generated, smoothly curved 3-D object and manipulated an adjustable gauge figure until its orientation matched that of a specific local region on the object's surface (cf. Koenderink, van Doom, & Kappers, 1992). The performance of both age groups was facilitated by the presence of binocular disparity (Experiment 1) and object rotation in depth (Experiment 2). Observers in both age groups were able to judge the surface tilt component of orientation more precisely than the slant component. Significant, but modest, effects of age were found in Experiment 1, but not in Experiment 2. The ability to perceive local surface orientation appears to be relatively well preserved with increasing age, at least through the age of 80.     

Core Knowledge and the Emergence of Symbols: The Case of Maps

Map reading is unique to humans but is present in people of diverse cultures, at ages as young as 4 years old. Here, we explore the nature and sources of this ability and ask both what geometric information young children use in maps and what nonsymbolic systems are associated with their map-reading performance. Four-year-old children were given two tests of map-based navigation (placing an object within a small three-dimensional [3D] surface layout at a position indicated on a two-dimensional [2D] map), one focused on distance relations and the other on angle relations. Children also were given two nonsymbolic tasks, testing their use of geometry for navigation (a reorientation task) and for visual form analysis (a deviant-detection task). Although children successfully performed both map tasks, their performance on the two map tasks was uncorrelated, providing evidence for distinct abilities to represent distance and angle on 2D maps of 3D surface layouts. In contrast, performance on each map task was associated with performance on one of the two nonsymbolic tasks: Map-based navigation by distance correlated with sensitivity to the shape of the environment in the reorientation task, whereas map-based navigation by angle correlated with sensitivity to the shapes of 2D forms and patterns in the deviant-detection task. These findings suggest links between one uniquely human, emerging symbolic ability, geometric map use, and two core systems of geometry.     

Specularity,brightness, achromatic color—and orthogonality

For objects under the same illumination, the more specular object appeared brighter. This occurred irrespective of an object’s apparent achromatic color, the distance at which it was viewed, the level of illumination, the method used for collecting observations, and other conditions. Also, when identical specular objects were differently illuminated, the one under the higher illumination, with the higher maximal luminances, appeared brighter. In the five experiments, which involved 340 subjects subdivided into 17 groups, large fields of view and real spaces were used. The results supported the conclusion that apparent brightness and achromatic color are orthogonal phenomena, and that in four of these experiments increased apparent brightness was correlated to, if not determined by, maximal specular luminances without regard to achromatic colors and diffuse luminances. This conclusion was necessarily modified by a fifth experiment, which showed that if placed under sufficiently high levels of illumination, less specular surfaces appeared brighter than more specular surfaces. This was taken to mean that a total account of the apparent brightness of surfaces would depend on an undiscovered algorithm involving maximal specular and diffuseluminances and their areal extents. With regard to the validity of the studies, the subjects were shown to have phenomenally discriminated brightness from glossiness and glare. Finally, phenomenal gloss and glare were found to be correlated to a surface’s level of specularity.     

Navigation as a source of geometric knowledge: young children's use of length, angle, distance, and direction in a reorientation task

Geometry is one of the highest achievements of our species, but its foundations are obscure. Consistent with longstanding suggestions that geometrical knowledge is rooted in processes guiding navigation, the present study examines potential sources of geometrical knowledge in the navigation processes by which young children establish their sense of orientation. Past research reveals that children reorient both by the shape of the surface layout and the shapes of distinctive landmarks, but it fails to clarify what shape properties children use. The present study explores 2-year-old children's sensitivity to angle, length, distance and direction by testing disoriented children's search in a variety of fragmented rhombic and rectangular environments. Children reoriented themselves in accord with surface distances and directions, but they failed to use surface lengths or corner angles either for directional reorientation or as local landmarks. Thus, navigating children navigate by some but not all of the abstract properties captured by formal Euclidean geometry. While navigation systems may contribute to children's developing geometric understanding, they likely are not the sole source of abstract geometric intuitions.     

Kinetic depth effect and identification of shape

We introduce an objective shape-identification task for measuring the kinetic depth effect (KDE). A rigidly rotating surface consisting of hills and valleys on an otherwise flat ground was defined by 300 randomly positioned dots. On each trial, 1 of 53 shapes was presented; the observer's task was to identify the shape and its overall direction of rotation. Identification accuracy was an objective measure, with a low guessing base rate of the observer's perceptual ability to extract 3D structure from 2D motion via KDE. (1) Objective accuracy data were consistent with previously obtained subjective rating judgments of depth and coherence. (2) Along with motion cues, rotating real 3D dot-defined shapes inevitably produced a cue of changing dot density. By shortening dot lifetimes to control dot density, we showed that changing density was neither necessary nor sufficient to account for accuracy; motion alone sufficed. (3) Our shape task was solvable with motion cues from the 6 most relevant locations. We extracted the dots from these locations and used them in a simplified 2D direction-labeling motion task with 6 perceptually flat flow fields. Subjects' performance in the 2D and 3D tasks was equivalent, indicating that the information processing capacity of KDE is not unique. (4) Our proposed structure-from-motion algorithm for the shape task first finds relative minima and maxima of local velocity and then assigns 3D depths proportional to velocity.     

The structure of three-dimensional object representations in human vision: evidence from whole-part matching

This article examines how the human visual system represents the shapes of 3-dimensional (3D) objects. One long-standing hypothesis is that object shapes are represented in terms of volumetric component parts and their spatial configuration. This hypothesis is examined in 3 experiments using a whole-part matching paradigm in which participants match object parts to whole novel 3D object shapes. Experiments 1 and 2, consistent with volumetric image segmentation, show that whole-part matching is faster for volumetric component parts than for either open or closed nonvolumetric regions of edge contour. However, the results of Experiment 3 show that an equivalent advantage is found for bounded regions of edge contour that correspond to object surfaces. The results are interpreted in terms of a surface-based model of 3D shape representation, which proposes edge-bounded 2-dimensional polygons as basic primitives of surface shape.     

Choice, matching, and human behavior: A review of the literature

This review concerns human performance on concurrent schedules of reinforcement. Studies indicate that humans match relative behavior to relative rate of reinforcement. Herrnstein's proportional matching equation describes human performance but most studies do not evaluate the equation at the individual level. Baum's generalized matching equation has received strong support with humans as subjects. This equation permits the investigation of sources of deviation from ideal matching and a few studies have suggested variables which control such deviations in humans. While problems with instructional control are raised, the overall findings support the matching law as a principle of human choice.     

Perceiving the shape and material properties of 3D surfaces

Our visual experience of the world relies on the interaction of light with the different substances, surfaces, and objects in our environment. These optical interactions generate images that contain a conflated mixture of different scene variables, which our visual system must somehow disentangle to extract information about the shape and material properties of the world. Such problems have historically been considered to be ill-posed, but recent work suggests that there are complex patterns of covariation in light that co-specify the 3D shape and material properties of surfaces. This work provides new insights into how the visual system acquired the ability to solve problems that have historically been considered intractable.     

The perception of doubly curved surfaces from anisotropic textures

Abstract— Most existing computational models of the visual perception of three-dimensional shape from texture are based on assumed constraints about how texture is distributed on visible surfaces. The research described in the present article was designed to investigate how violations of these assumptions influence human perception. Observers were presented with images of smoothly curved surfaces depicted with different types of texture, whose distribution of surface markings could be both anisotropic and inhomogeneous. Observers judged the pattern of ordinal depth on each object by marking local maxima and minima along designated scan lines. They also judged the apparent magnitudes of relative depth between designated probe points on the surface. The results revealed a high degree of accuracy and reliability in all conditions, except for a systematic underestimation of the overall magnitude of surface relief. These findings suggest that human perception of three-dimensional shape from texture is much more robust than would be reasonable to expect based on current computational models of this phenomenon.     

The apparent shape of afterimages in the Ames room.

When observers project afterimages of circular patterns onto a surface slanting away from them the images are reported as being oval in shape. In this paper it is reported that this does not occur when similar afterimages are projected onto the slanting rear wall of an Ames room. Instead of appearing as ovals, the afterimages remain circular. It appears as though the actually-slanted rear wall of the room not only looks as if it is normal to the line of vision, but also that it functions as if it was in such an orientation as far as a projection surface for afterimages is concerned. While these results are consistent with Emmert's law and with traditional accounts of shape and size constancy, they raise once again the age-old issue of whether the 'image on the retina' constitutes an object of perception that can be described in terms of its shape or size.     

Discrimination of 3-D shape and 3-D curvature from motion in active vision

We examined the ability of human observers to discriminate between different 3-D quadratic surfaces defined by motion, and with head position fed back to the stimulus to provide an up-to-date dynamical perspective view. We tested whether 3-D shape or 3-D curvature would affect discrimination performance. It appeared that discrimination of 3-D quadratic shape clearly depended on shape but not on the amount of curvature. Even when the amount of curvature was randomized, subjects’ performance was not altered. On the other hand, the discrimination of 3-D curvature clearly depended linearly on curvature with Weber fractions of 20% on the average and, to a small degree, on 3-D shape. The experiment shows that observers can easily separate 3-D shape and 3-D curvature, and that Koenderink’s shape index and curvedness provide a convenient way to specify shape. These results warn us against using just any arbitrary 3-D shape in 3-D shape perception tasks and indicate, for example, that emphasizing 3-D shape in computer displays by exaggerating curvature does not have any effect.     

Culture, context, and behavior

In this article I propose a model that posits three major sources of influence on behavior-basic human nature (via universal psychological processes), culture (via social roles), and personality (via individual role identities) and argue that individual behaviors are the products of the interaction between the three. I discuss how culture emerges from the interaction of basic human nature and the ecological contexts in which groups exist, and how social roles are determined by culture-specific psychological meanings attributed to situational contexts. The model further suggests that situational context moderates the relative contributions of the three sources in influencing behavior. I provide examples of apparent contradictory findings in the study of emotion that can be explained by the model proposed.     

Shape-from-shading for matte and glossy objects

We wanted to find out whether the presence of specular highlights on the otherwise matte objects would make a difference to the perceived surface relief. Six different, globally convex objects were displayed on a computer screen. The depicted objects were either matte or glossy and were illuminated from one of the two different directions. Shape-from-shading was evaluated with two different paradigms. In Experiment 1 observers were asked to set a number of local surface attitude probes such that the probes looked as if they were tangent to the objects' surfaces. In Experiment 2, observers were instructed to make traces of the contours of the depicted objects in the horizontal and vertical planes. Although the two tasks target different aspects of the perceived surface, they give essentially similar results here. In both tasks we found differences that were induced by changing the illumination direction. Surprisingly, no systematic difference was found between the results for matte and glossy objects. We must, therefore, conclude that there is no evidence from the current study that glossiness influences shape perception although to the observer matte and glossy objects look quite different.