A biodynamic basis for perceived categories of action: a study of sitting and stair climbing

Actors must determine whether the properties of the surface layout are sufficient to meet their specific requirements for performing an action. Warren's (1984) study of bipedal stair climbing has demonstrated the significance of intrinsic, body-scaled measures of environmental properties for defining perceptual categories relevant to action. Whereas the absolute measure of the perceptual boundary between "climbable" and "not climbable" varied according to the actor's size and mass, the perceived boundary was a constant proportion of each actor's leg length. Our current study examined the perceived maximum seat height (SHmax) for the act of sitting. Experiment 1 delineated the range of surface heights that were perceived to afford sitting on. When expressed as a function of each person's leg length (L), SHmax was remarkably stable across individuals. Unexpectedly, it was quite close to the maximum riser height determined by Warren. Experiment 2 examined whether this similarity reflected a common biodynamic requirement, since climbing and sitting require actors to lift their center of gravity above the surface of support. Perceived critical heights were obtained for both acts using the same methods and apparatus. The perceived maximum heights for each act were virtually identical. These findings are consistent with the possibility that the information used in determining critical action boundaries is already scaled with reference to some physical dimension of the actor.     

A Biodynamic Basis for Perceived Categories of Action

Actors must determine whether the properties of the surface layout are sufficient to meet their specific requirements for performing an action. Warren’s (1984) study of bipedal stair climbing has demonstrated the significance of intrinsic, body-scaled measures of environmental properties for defining perceptual categories relevant to action. Whereas the absolute measure of the perceptual boundary between “climbable” and “not climbable” varied according to the actor’s size and mass, the perceived boundary was a constant proportion of each actor’s leg length. Our current study examined the perceived maximum seat height (SHmax) for the act of sitting. Experiment 1 delineated the range of surface heights that were perceived to afford sitting on. When expressed as a function of each person’s leg length (L), SHmax was remarkably stable across individuals. Unexpectedly, it was quite close to the maximum riser height determined by Warren. Experiment 2 examined whether this similarity reflected a common biodynamic requirement, since climbing and sitting require actors to lift their center of gravity above the surface of support. Perceived critical heights were obtained for both acts using the same methods and apparatus. The perceived maximum heights for each act were virtually identical. These findings are consistent with the possibility that the information used in determining critical action boundaries is already scaled with reference to some physical dimension of the actor.     

A Rich Landscape of Affordances

Mark (1987) reported that observers, whose sitting capabilities had been altered by having them wear 10-cm blocks, were able to discover their own maximum height of a surface that afforded sitting on (SHmax), in the absence of an opportunity to practice sitting while wearing blocks. The current investigation attempted to identify conditions under which returning of an observer's SHmax, occurred. Returning of SH@, judgments readily occurred when observers were able to locomote between trials (Experiment 1), and rotate their heads, lean forward and to the side while making their judgments (Experiments I-2). However, they were unable to retune their SHmax, when the viewing conditions restricted all but the most basic actions (Experiments 3-5). Observers' actions during and between trials also were critical to the accuracy of their judgments when they did not wear the blocks. Overall, these findings strongly implicate observers' own activities as crucial for revealing information about their own S@ under both conditions when they are and are not familiar with their own sitting capabilities. Experiment 6 bolstered this conclusion by showing that prior practice with the act of sitting was not sufficient to enable observers to retune their own SHmax, (block condition) or to perceive their own SHmax under familiar circumstances (no block).     

Ontological issues in distance perception: cue use under full cue conditions cannot be inferred from use under controlled conditions

Phosphorescent square tiles (arranged to yield a single image size) were viewed in the dark by 56 monocular observers who utilized a chinrest. The targets were placed at one of three horizontal distances and at one of three eye heights, allowing us to study the relative effect of height in the visual field (HVF) and sagittal distance on observers' verbal reports of the horizontal distance at which the object lay (near, middle, or far). In Experiment 1, we found that reports covaried primarily with HVF and, as predicted, they exhibited a weak paradoxical inverse relation with horizontal distance. In a second and third experiment, a visible surface was placed under the targets at the three eye heights in both dark and fully lighted conditions. In this situation, the inverse distance relation disappeared, and HVF no longer influenced the judgments of most observers. The results show that information projected from relevant support surfaces is essential for veridical information about object distance. These results raise fundamental issues for perceptual researchers regarding how to decide when a cue has been properly delineated, given the assumption that the relation between a cue and what it specifies is probabilistic.     

Affordance Judgments and Nonlocomotor Body Movement

In 2 experiments, participants made judgments of their own maximum sitting height. During judgments, participants stood normally or on 10 cm blocks attached to their feet. The blocks increased participants' actual maximum sitting height. For many participants, judgments changed over trials, becoming more accurate, despite the absence of practice at sitting, or feedback about judgment accuracy. Learning was observed not only when participants wore the blocks but also when they stood normally. In Experiment 2, we measured motion of the head and torso. We identified changes in body motion that corresponded to engagement in the judgment task: Across trials, sway variability was stable during judgments but increased during the intervals between judgments. Other changes in sway were limited to participants whose judgments improved over trials; that is, sway was specifically associated with learning about maximum sitting height. We discuss the results in the context of perception–action and the learning of affordances.     

Perceiving affordances for another person's actions

The perception of affordances for the actions of other people (actors) was examined. Observers judged the maximum and preferred sitting heights of tall and short actors. Judgments were scaled in centimeters, as a proportion of the observer's leg length, and as a proportion of each actor's leg length. In Experiment 1 observers viewed live actors standing next to a chair. When judgments were scaled by actor leg length, they reflected the actual ordinal relation between the capabilities of the actors. The perception of affordances from kinematic displays was then evaluated. Observers differentiated tall and short actors, but only when the displays contained direct information about relations between the actors and the chair. It is concluded that observers can perceive affordances for the actions of actors and that kinematic displays can be enough to support such percepts if they preserve actor-environment relations that define affordances.     

Visual guidance of walking through apertures: body-scaled information for affordances

A necessary condition for visually guided action is that an organism perceive what actions are afforded by a given environmental situation. Warren (1984) proposed that an affordance such as the climbability of a stairway is determined by the fit between properties of the environment and the organism and can be characterized by optimal points, where action is most comfortable or efficient, and critical points, where a phase transition to a new action occurs. Perceiving an affordance, then, implies perceiving the relation between the environment and the observer's own action system. The present study is an extension of this analysis to the visual guidance of walking through apertures. We videotaped large and small subjects walking through apertures of different widths to determine empirically the critical aperture-to-shoulder-width ratio (A/S) marking the transition from frontal walking to body rotation. These results were compared with perceptual judgments of "passability" under static and moving viewing conditions. Finally, we tested the hypothesis that such judgments are based on intrinsic or body-scaled information specifying aperture width as a ratio of the observer's eyeheight. We conclude (a) that the critical point in free walking occurs at A/S = 1.30, (b) that static monocular information is sufficient for judging passability, and (c) that the perception of passability under such conditions is based on body-scaled eyeheight information.     

The ground dominance effect in the perception of 3-D layout

The relative effectiveness of the ground surface and other environmental surfaces (the ceiling and sidewalls) in determining perceived layout was investigated in five experiments and a real-world demonstration. In the first three experiments, two vertical or horizontal posts were positioned between two surfaces (ground and ceiling in all three experiments, left wall and right wall in Experiment 1), and optical contact was manipulated so that the two surfaces provided contradictory information about the relative distances of the posts. Observers judged which of the two posts appeared to be closer. In Experiment 4, to control the height on the posts at which the distance judgments were made, a blue dot was attached to both vertical posts at varying heights and observers judged which dot appeared closer. In Experiment 5, the posts were replaced by two gray ellipses to eliminate the effects of the regular shape and texture. Our findings were that (1) among all four surfaces tested, observers showed a preference to respond according to the optical contact information provided by the ground surface--a ground dominance effect, (2) this effect did not depend on the height of the posts in the image, (3) as the scene was tilted away from a ground/ceiling orientation, the ground dominance effect decreased, and (4) this effect was not due to the location of the judgment.     

The interaction of oculomotor cues and stimulus size in stereoscopic death constancy.

In the natural world, observers perceive an object to have a relatively fixed size and depth over a wide range of distances. Retinal image size and binocular disparity are to some extent scaled with distance to give observers a measure of size constancy. The angle of convergence of the two eyes and their accommodative states are one source of scaling information, but even at close range this must be supplemented by other cues. We have investigated how angular size and oculomotor state interact in the perception of size and depth at different distances. Computer-generated images of planar and stereoscopically simulated 3-D surfaces covered with an irregular blobby texture were viewed on a computer monitor. The monitor rested on a movable sled running on rails within a darkened tunnel. An observer looking into the tunnel could see nothing but the simulated surface so that oculomotor signals provided the major potential cues to the distance of the image. Observers estimated the height of the surface, their distance from it, or the stereoscopically simulated depth within it over viewing distances which ranged from 45 cm to 130 cm. The angular width of the images lay between 2 deg and 10 deg. Estimates of the magnitude of a constant simulated depth dropped with increasing viewing distance when surfaces were of constant angular size. But with surfaces of constant physical size, estimates were more nearly independent of viewing distance. At any one distance, depths appeared to be greater, the smaller the angular size of the image. With most observers, the influence of angular size on perceived depth grew with increasing viewing distance. These findings suggest that there are two components to scaling. One is independent of angular size and related to viewing distance. The second component is related to angular size, and the weighting accorded to it grows with viewing distance. Control experiments indicate that in the tunnel, oculomotor state provides the principal cue to viewing distance. Thus, the contribution of oculomotor signals to depth scaling is gradually supplanted by other cues as viewing distance grows. Binocular estimates of the heights and distances of planar surfaces of different sizes revealed that angular size and viewing distance interact in a similar way to determine perceived size and perceived distance.     

Standing distance in climbability of stairs.

The purpose of this experiment was to make a preliminary examination of the distance one needs to stand from a stair to successfully climb up without using arms for support. Using an adjustable stair structure to create different heights of risers, a group of 10 tall and of 10 short participants made perceptual judgments and physical attempts at heights that represented 83% and 93% of each group's mean leg length. Choice of maximum and minimum distance from the stair was measured for each participant. Analysis showed that perceptual judgments and physical capabilities were highly correlated (tall: Pearson r = .92); short: Pearson r = .93). Moreover, the ability to climb the two heights depended on the standing distance from the stair. The findings suggest that standing distance may be a consideration in stair climbing and that stair height alone may not be sufficient to specify climbability.     

Inaccurate representation of the ground surface beyond a texture boundary

The sequential-surface-integration-process (SSIP) hypothesis was proposed to elucidate how the visual system constructs the ground-surface representation in the intermediate distance range (He et al, 2004 Perception 33 789-806). According to the hypothesis, the SSIP constructs an accurate representation of the near ground surface by using reliable near depth cues. The near ground representation then serves as a template for integrating the adjacent surface patch by using the texture gradient information as the predominant depth cue. By sequentially integrating the surface patches from near to far, the visual system obtains the global ground representation. A critical prediction of the SSIP hypothesis is that, when an abrupt texture-gradient change exists between the near and far ground surfaces, the SSIP can no longer accurately represent the far surface. Consequently, the representation of the far surface will be slanted upward toward the frontoparallel plane (owing to the intrinsic bias of the visual system), and the egocentric distance of a target on the far surface will be underestimated. Our previous findings in the real 3-D environment have shown that observers underestimated the target distance across a texture boundary. Here, we used the virtual-reality system to first test distance judgments with a distance-matching task. We created the texture boundary by having virtual grass- and cobblestone-textured patterns abutting on a flat (horizontal) ground surface in experiment 1, and by placing a brick wall to interrupt the continuous texture gradient of a flat grass surface in experiment 2. In both instances, observers underestimated the target distance across the texture boundary, compared to the homogeneous-texture ground surface (control). Second, we tested the proposal that the far surface beyond the texture boundary is perceived as slanted upward. For this, we used a virtual checkerboard-textured ground surface that was interrupted by a texture boundary. We found that not only was the target distance beyond the texture boundary underestimated relative to the homogeneous-texture condition, but the far surface beyond the texture boundary was also perceived as relatively slanted upward (experiment 3). Altogether, our results confirm the predictions of the SSIP hypothesis.     

An information-based approach to action understanding

It has been proposed that the ability to make sense of other agents' behavior relies on the activation of internal mechanisms that map action perception onto action execution. In this study we explored the constraints on this ability introduced by eyeheight-scaled information in the optic array. Short and tall participants provided maximum overhead reaching judgments for themselves and another participant. Perceptual information was manipulated by changing the participants' optically specified eyeheight. Observers were modestly accurate in perceiving maximum overhead reach for themselves and for another actor whose action capabilities differed. Perceived maximum overhead reach increased for both self- and other-judgments when the perceiver's eyeheight was increased. The results suggest an important role of perceptual information that has gone unrecognized in existing accounts of action understanding and prediction.     

Resolving ambiguous behavioral intentions by means of involuntary prioritization of gaze processing

Anticipation of others' actions is of paramount importance in social interactions. Cues such as gaze direction and facial expressions can be informative, but can also produce ambiguity with respect to others' intentions. We investigated the combined effect of an actor's gaze and expression on judgments made by observers about the end-point of the actor's head rotation toward the observer. Expressions of approach gave rise to an unambiguous intention to move toward the observer, while expressions of avoidance gave rise to an ambiguous behavioral intention (as the expression and motion cues were in conflict). In the ambiguous condition, observers overestimated how far the actor's head had rotated when the actor's gaze was directed ahead of head rotation (compared to congruent or lagging behind). In the unambiguous condition the estimations were not influenced by the gaze manipulation. These results show that social cue integration does not follow simple additive rules, and suggests that the involuntary allocation of attention to another's gaze depends on the perceived ambiguity of the agent's behavioral intentions.     

The effects of binocular and motion-generated information on the perception of depth and height

The perception of distance and size in the presence of optical gradient information was investigated under four viewing conditions—binocular view with and without head motion, and monocular view with and without head motion. Subjects (60 adults) matched distance intervals (from 15 to 127 cm) and heights of a target triangle (from 5 to 15 cm) by adjusting the length of a metal tape. Both linear and power functions were fitted to each individual’s distance judgments, and the competing perceptual models were compared. For both models, it was found that binocular information was sufficient to specify relative, but not absolute, distance, that monocular information was sufficient to specify an orderly relation between target distance and judgment but not absolute distance, that average error was less in the binocular conditions, and that perceived distance was not affected in either condition by the addition of head motion. The analysis of size judgments revealed that monocular and binocular judgments did not differ, that matches made with and without head motion did not differ, and that, in all conditions, matches exceeded target heights by an average 30% to 40%. Judged size was also analyzed as a function of target distance. In all conditions but monocular view with head motion, the effect of distance was to increase size judgments. The distance judgments support the hypothesis (Purdy, 1958) that the binocular stimulus carries information that the monocular stimulus does not; they fail to support the hypothesis (Gibson, 1966) that observer motion adds information to the static stimulus. The size judgments support neither hypothesis but suggest an independence of perceived size from perceived distance.     

The visual perception of length along intrinsically curved surfaces

The ability of observers to perceive three-dimensional (3-D) distances or lengths along intrinsically curved surfaces was investigated in three experiments. Three physically curved surfaces were used: convex and/or concave hemispheres (Experiments 1 and 3) and a hyperbolic paraboloid (Experiment 2). The first two experiments employed a visual length-matching task, but in the final experiment the observers estimated the surface lengths motorically by varying the separation between their two index fingers. In general, the observers' judgments of surface length in both tasks (perceptual vs. motoric matching) were very precise but were not necessarily accurate. Large individual differences (overestimation, underestimation, etc.) in the perception of length occurred. There were also significant effects of viewing distance, type of surface, and orientation of the spatial intervals on the observers' judgments of surface length. The individual differences and failures of perceptual constancy that were obtained indicate that there is no single relationship between physical and perceived distances on 3-D surfaces that is consistent across observers.     

Second-order beliefs about intention and children's attributions of sociomoral judgment

Predicting how another person will evaluate the intention underlying an action involves consideration of second-order mental states. Children (ages 5-10 years) and college students (N=105) predicted an observer's belief about an actor's intention and evaluated the actor from both their own perspectives and the perspective of the observer. Younger children were more likely than older children and adults to attribute a belief to the observer that mismatched the actor's prior intention. Attributed beliefs about intention were more likely to match negative prior intentions than to match positive prior intentions and were also more likely to match prior intentions when the observer knew the actor's prior intention than when the observer did not know the actor's prior intention. The judgments attributed to the observer were based on the beliefs about intention attributed to the observer, showing use of second-order mental states to infer another's sociomoral judgments.     

The impact of visual exploration of judgments of whether a gap is crossable

When observers look down into a gap in the ground plane, their judgments of the widest gap they can step across (gapmax) decrease as gap depth increases (Y. Jiang & L. S. Mark, 1994). This study investigated the possibility that Jiang and Mark's viewing conditions did not afford observers a sufficient opportunity to perform exploratory movements needed to detect information about gap width. Experiment 1 showed that the gap depth by gaze interaction disappeared only when restrictions were not imposed on observers' exploratory activities (eye, head, and body movements). Experiment 2 showed that observers tended to see the vertical surface as slanted away from them, which made the bottom of the surface appear farther away from them than the top. Only when observers were able to view the gap binocularly under conditions that did not restrict exploratory activity did their slant perception improve and their gapmax judgments no longer covary with gap depth. The data indicate that the exploratory movements of prospective actors are essential for the pickup of information about their action capabilities.     

The visual perception of smoothly curved surfaces from minimal apparent motion sequences

A series of four experiments was designed to investigate the minimal amounts of information required to perceive the structure of a smoothly curved surface from its pattern of projected motion. In Experiments 1 and 2, observers estimated the amplitudes of sinusoidally corrugated surfaces relative to their periods. Observers’ judgments varied linearly with the depicted surface amplitudes, but the amount of perceived relative depth was systematically overestimated by approximately 30%. The observers’ amplitude judgments were also influenced to a lesser extent by the amount of rotary displacement of a surface at each frame transition, and by increasing the length of the apparent motion sequences from two to eight frames. The latter effect of sequence length was quite small, however, accounting for less than 3% of the variance in the observers’ judgments. Experiments 3 and 4 examined observers’ discrimination thresholds for sinusoidally corrugated surfaces of variable amplitude and for ellipsoid surfaces of variable eccentricity. The results revealed that observers could reliably detect differences of surface structure as small as 5%. The length of the apparent motion sequences had no detectable effect on these tasks, although there were significant effects of angular displacement and surface orientation. These results are considered with respect to the analysis of affine structure from motion proposed by Todd and Bressan (1990).     

More than just perception–action recalibration: Walking through a virtual environment causes rescaling of perceived space

Egocentric distances in virtual environments are commonly underperceived by up to 50 % of the intended distance. However, a brief period of interaction in which participants walk through the virtual environment while receiving visual feedback can dramatically improve distance judgments. Two experiments were designed to explore whether the increase in postinteraction distance judgments is due to perception–action recalibration or the rescaling of perceived space. Perception–action recalibration as a result of walking interaction should only affect action-specific distance judgments, whereas rescaling of perceived space should affect all distance judgments based on the rescaled percept. Participants made blind-walking distance judgments and verbal size judgments in response to objects in a virtual environment before and after interacting with the environment through either walking (Experiment 1) or reaching (Experiment 2). Size judgments were used to infer perceived distance under the assumption of size–distance invariance, and these served as an implicit measure of perceived distance. Preinteraction walking and size-based distance judgments indicated an underperception of egocentric distance, whereas postinteraction walking and size-based distance judgments both increased as a result of the walking interaction, indicating that walking through the virtual environment with continuous visual feedback caused rescaling of the perceived space. However, interaction with the virtual environment through reaching had no effect on either type of distance judgment, indicating that physical translation through the virtual environment may be necessary for a rescaling of perceived space. Furthermore, the size-based distance and walking distance judgments were highly correlated, even across changes in perceived distance, providing support for the size–distance invariance hypothesis.     

Duck! Scaling the height of a horizontal barrier to body height

Recent research shows that the body is used to scale environmental extents. We question whether the body is used to scale heights as measured by real actions (Experiments 1 and 2) or by judgments about action and extent made from a single viewpoint (Experiments 3 and 4). First, participants walked under barriers naturally, when wearing shoes, or when wearing a helmet. Participants required a larger margin of safety (they ducked at shorter heights) when they were made taller. In follow-up experiments, participants visually matched barrier heights and judged whether they could walk under them when wearing shoes or a helmet. Only the helmet decreased visually matched estimates; action judgments were no different when participants’ eye height increased. The final experiment suggested that the change in matched estimates may have been due to lack of experience wearing the helmet. Overall, the results suggest that perceived height is scaled to the body and that when body height is altered, experience may moderate the rescaling of height.