Learning to perceive differences in solid shape through vision and touch

A single experiment was designed to investigate perceptual learning and the discrimination of 3-D object shape. Ninety-six observers were presented with naturally shaped solid objects either visually, haptically, or across the modalities of vision and touch. The observers' task was to judge whether the two sequentially presented objects on any given trial possessed the same or different 3-D shapes. The results of the experiment revealed that significant perceptual learning occurred in all modality conditions, both unimodal and cross-modal. The amount of the observers' perceptual learning, as indexed by increases in hit rate and d', was similar for all of the modality conditions. The observers' hit rates were highest for the unimodal conditions and lowest in the cross-modal conditions. Lengthening the inter-stimulus interval from 3 to 15 s led to increases in hit rates and decreases in response bias. The results also revealed the existence of an asymmetry between two otherwise equivalent cross-modal conditions: in particular, the observers' perceptual sensitivity was higher for the vision-haptic condition and lower for the haptic-vision condition. In general, the results indicate that effective cross-modal shape comparisons can be made between the modalities of vision and active touch, but that complete information transfer does not occur.     

Aging and the perception of depth and 3-D shape from motion parallax

The ability of younger and older observers to perceive 3-D shape and depth from motion parallax was investigated. In Experiment 1, the observers discriminated among differently curved 3-dimensional (3-D) surfaces in the presence of noise. In Experiment 2, the surfaces' shape was held constant and the amount of front-to-back depth was varied; the observers estimated the amount of depth they perceived. The effects of age were strongly task dependent. The younger observers' performance in Experiment 1 was almost 60% higher than that of the older observers. In contrast, no age effect was obtained in Experiment 2. Older observers can effectively perceive variations in depth from patterns of motion parallax, but their ability to discriminate 3-D shape is significantly compromised.     

Aging preserves the ability to perceive 3D object shape from static but not deforming boundary contours

A single experiment investigated how younger (aged 18-32 years) and older (aged 62-82 years) observers perceive 3D object shape from deforming and static boundary contours. On any given trial, observers were shown two smoothly-curved objects, similar to water-smoothed granite rocks, and were required to judge whether they possessed the "same" or "different" shape. The objects presented during the "different" trials produced differently-shaped boundary contours. The objects presented during the "same" trials also produced different boundary contours, because one of the objects was always rotated in depth relative to the other by 5, 25, or 45 degrees. Each observer participated in 12 experimental conditions formed by the combination of 2 motion types (deforming vs. static boundary contours), 2 surface types (objects depicted as silhouettes or with texture and Lambertian shading), and 3 angular offsets (5, 25, and 45 degrees). When there was no motion (static silhouettes or stationary objects presented with shading and texture), the older observers performed as well as the younger observers. In the moving object conditions with shading and texture, the older observers' performance was facilitated by the motion, but the amount of this facilitation was reduced relative to that exhibited by the younger observers. In contrast, the older observers obtained no benefit in performance at all from the deforming (i.e., moving) silhouettes. The reduced ability of older observers to perceive 3D shape from motion is probably due to a low-level deterioration in the ability to detect and discriminate motion itself.     

Visual and haptic discrimination of symmetry in unfamiliar displays extended in the z-axis

We investigated, in two experiments, the discrimination of bilateral symmetry in vision and touch using four sets of unfamiliar displays. They varied in complexity from 3 to 30 turns. Two sets were 2-D flat forms (raised-line shapes and raised surfaces) while the other two were 3-D objects constructed by extending the 2-D shapes in height (short and tall objects). Experiment 1 showed that visual accuracy was excellent but latencies increased for raised-line shapes compared with 3-D objects. Experiment 2 showed that unimanual exploration was more accurate for asymmetric than for symmetric judgments, but only for 2-D shapes and short objects. Bimanual exploration at the body midline facilitated the discrimination of symmetric shapes without changing performance with asymmetric ones. Accuracy for haptically explored symmetric stimuli improved as the stimuli were extended in the third dimension, while no such a trend appeared for asymmetric stimuli. Unlike vision, haptic response latency decreased for 2-D shapes compared with 3-D objects. The present results are relevant to the understanding of symmetry discrimination in vision and touch.     

Effective 3-D shape discrimination survives retinal blur

A single experiment evaluated observers’ ability to visually discriminate 3-D object shape, where the 3-D structure was defined by motion, texture, Lambertian shading, and occluding contours. The observers’ vision was degraded to varying degrees by blurring the experimental stimuli, using 2.0-, 2.5-, and 3.0-diopter convex lenses. The lenses reduced the observers’ acuity from ?0.091 LogMAR (in the no-blur conditions) to 0.924 LogMAR (in the conditions with the most blur; 3.0-diopter lenses). This visual degradation, although producing severe reductions in visual acuity, had only small (but significant) effects on the observers’ ability to discriminate 3-D shape. The observers’ shape discrimination performance was facilitated by the objects’ rotation in depth, regardless of the presence or absence of blur. Our results indicate that accurate global shape discrimination survives a considerable amount of retinal blur.     

Visual and tactile memory for 2-D patterns: Effects of changes in size and left-right orientation

Visual identification of 3-D objects depends on representations that are invariant across changes in size and left-right orientation. We examined whether this finding reflects the unique demands of processing 3-D objects, or whether it generalizes to 2-D patterns and to the tactile modality. Our findings suggest that object representation for identification is influenced greatly by the processing demands of stimulus materials (e.g., 2-D vs. 3-D objects) and stimulus modality (touch vs. vision). Identification of 2-D patterns in vision is adversely affected by left-right orientation changes, but not size changes. Identification of the same patterns in touch is adversely affected by both changes. Together, the results suggest that the unique processing demands of stimulus materials and modality shape the representation of objects in memory.     

The visual perception of length along intrinsically curved surfaces

The ability of observers to perceive three-dimensional (3-D) distances or lengths along intrinsically curved surfaces was investigated in three experiments. Three physically curved surfaces were used: convex and/or concave hemispheres (Experiments 1 and 3) and a hyperbolic paraboloid (Experiment 2). The first two experiments employed a visual length-matching task, but in the final experiment the observers estimated the surface lengths motorically by varying the separation between their two index fingers. In general, the observers' judgments of surface length in both tasks (perceptual vs. motoric matching) were very precise but were not necessarily accurate. Large individual differences (overestimation, underestimation, etc.) in the perception of length occurred. There were also significant effects of viewing distance, type of surface, and orientation of the spatial intervals on the observers' judgments of surface length. The individual differences and failures of perceptual constancy that were obtained indicate that there is no single relationship between physical and perceived distances on 3-D surfaces that is consistent across observers.     

The role of sequence order in determining view canonicality for novel wire-frame objects

Objects are best recognized from so-called “canonical” views. The characteristics of canonical views of arbitrary objects have been qualitatively described using a variety of different criteria, but little is known regarding how these views might be acquired during object learning. We address this issue, in part, by examining the role of object motion in the selection of preferred views of novel objects. Specifically, we adopt a modeling approach to investigate whether or not the sequence of views seen during initial exposure to an object contributes to observers’ preferences for particular images in the sequence. In two experiments, we exposed observers to short sequences depicting rigidly rotating novel objects and subsequently collected subjective ratings of view canonicality (Experiment 1) and recall rates for individual views (Experiment 2). Given these two operational definitions of view canonicality, we attempted to fit both sets of behavioral data with a computational model incorporating 3-D shape information (object foreshortening), as well as information relevant to the temporal order of views presented during training (the rate of change for object foreshortening). Both sets of ratings were reasonably well predicted using only 3-D shape; the inclusion of terms that capture sequence order improved model performance significantly.     

Mental models change rapidly with implicitly acquired information about the local environment: a two-tone image study

The projection of 3-D objects to 2-D images necessitates a loss of information, thus the shape of volumetric objects depicted in images is inherently ambiguous. The results of 3 experiments suggest observers use mental models of the local visual environment to constrain image interpretation. These models change quickly and dramatically to accommodate implicitly acquired information. Observers viewed very high-contrast (2-tone) images of novel volumetric objects. Before priming, novel 2-tone images appeared 2-D. After incidental exposure to similar objects in grayscale or familiar objects in 2-tone, the test images appeared volumetric. Incidental leaming appears to alter observers' mental models, thus causing an alteration in image interpretation in the absence of any image change. Highlights were interpreted more accurately than shadows, suggesting shadows play a secondary role in shape recovery.     

Evidence for patchwork approximation of shape primitives

Investigators have proposed that qualitative shapes are the primitive information of spatial vision: They preserve an approximately one-to-one mapping between surfaces, images, and perception. Given their importance, we examined how the visual system recovers these primitives from sparse disparity fields that do not provide sufficient information for their recovery. We hypothesized that the visual system interpolates sparse disparities with planes, resulting in a patchwork approximation of the implicitly defined shapes. We presented observers with stereo displays simulating planar or smooth curved surfaces having different curvatures. The observers' task was to detect whether dots deviated from these surfaces or to discriminate planar from curved or planar from scrambled surfaces. Consistent with our hypothesis, increasing curvature had detrimental effects on observers' performance (Experiments 1-3). Importantly, this patchwork approximation leads to the recovery of the proposed shape primitives, since observers were more accurate at discriminating planar-from-curved than planar-from-scrambled surfaces with matched disparity range (Experiment 4).     

The perception and discrimination of local 3-D surface structure from deforming and disparate boundary contours

In a series of four experiments, we evaluated observers' abilities to perceive and discriminate ordinal depth relationships between separated local surface regions for objects depicted by static, deforming, and disparate boundary contours or silhouettes. Comparisons were also made between judgments made for silhouettes and for objects defined by surface texture, which permits judgment based on conventional static texture gradients, conventional stereopsis, and conventional structure-from-motion. In all the experiments, the observers were able to detect, with relatively high precision, ordinal depth relationships, an aspect of local three-dimensional (3-D) structure, from boundary contours or silhouettes. The results of the experiments clearly demonstrate that the static, disparate, and deforming boundary contours of solid objects are perceptually important optical sources of information about 3-D shape. Other factors that were found to affect performance were the amount of separation between the local surface regions, the proximity or closeness of the regions to the boundary contour itself, and for the conditions with deforming contours, the overall magnitude of the boundary deformation.     

Angular velocity discrimination

Three experiments were designed to investigate naive observers' abilities at discriminating the rotational velocities of two simultaneously viewed objects. In Experiment 1, rotations could occur about parallel or orthogonal axes, with initial orientations in phase or out of phase, and (for parallel rotational axes) in the same or opposite direction. Differential thresholds were approximately 10%. In Experiment 2, stimulus objects differed in the number of faces revealed in rotation (three vs. four). Observers' response curves had no greater spread, but their PSEs (points of subjective equality) were shifted such that there was a partial compensation for faces revealed per unit time. In both Experiment 1 and Experiment 2, performance was consistent across rotational axis and directional conditions. In Experiment 3, the effect of object size was examined, in order to determine the extent to which angular velocity judgments are influenced by the tangential velocity of the faces. When the comparison cube's edges were half the length of the standard's, PSEs were elevated 18.5%. Taken together, these data suggest that observers are able to discriminate angular velocities with a competence near that for linear velocities. However, perceived angular rate is influenced by structural aspects of the stimuli.     

Aging and the visual, haptic, and cross-modal perception of natural object shape

One hundred observers participated in two experiments designed to investigate aging and the perception of natural object shape. In the experiments, younger and older observers performed either a same/different shape discrimination task (experiment 1) or a cross-modal matching task (experiment 2). Quantitative effects of age were found in both experiments. The effect of age in experiment 1 was limited to cross-modal shape discrimination: there was no effect of age upon unimodal (ie within a single perceptual modality) shape discrimination. The effect of age in experiment 2 was eliminated when the older observers were either given an unlimited amount of time to perform the task or when the number of response alternatives was decreased. Overall, the results of the experiments reveal that older observers can effectively perceive 3-D shape from both vision and haptics.     

Texture perception in sighted and blind observers

The purpose of the present study was to evaluate the utility of visual imagery for texture perception. In Experiment 1, sighted, early-blind, and late-blind observers made relative smoothness judgments of abrasive surfaces using active or passive tough. In Experiment 2, subjects compared vision and touch in the accuracy of smoothness detection, using a broad range of textures, including very fine surfaces. No differences appeared between the sighted and the blind, and it did not matter if touch were active or passive. Vision and touch showed similar performance with relatively coarse textures, but touch was superior to vision for much finer surface textures. The results were consistent with the notion that visual coding of tactual stimuli is not advantageous (or necessary) for texture perception, since touch may hold advantages for the detection of the smoothness of surfaces.     

Haptic discrimination of bilateral symmetry in 2-dimensional and 3-dimensional unfamiliar displays

In five experiments, we tested the accuracy and sensitivity of the haptic system in detecting bilateral symmetry of raised-line shapes (Experiments 1 and 2) and unfamiliar 3-D objects (Experiments 3–5) under different time constraints and different modes of exploration. Touch was moderately accurate for detecting this property in raised displays. Experiment 1 showed that asymmetric judgments were systematically more accurate than were symmetric judgments with scanning by one finger. Experiment 2 confirmed the results of Experiment 1 but also showed that bimanual exploration facilitated processing of symmetric shapes without improving asymmetric detections. Bimanual exploration of 3-D objects was very accurate and significantly facilitated processing of symmetric objects under different time constraints (Experiment 3). Unimanual exploration did not differ from bimanual exploration (Experiment 4), but restricting hand movements to one enclosure reduced performance significantly (Experiment 5). Spatial reference information, signal detection measures, and hand movements in processing bilateral symmetry by touch are discussed.     

Segregation by color and stereoscopic depth in three-dimensional visual space

Two experiments were conducted to investigate how color and stereoscopic depth information are used to segregate objects for visual search in three-dimensional (3-D) visual space. Eight observers were asked to indicate the alphanumeric category (letter or digit) of the target which had its unique color and unique depth plane. In Experiment 1, distractors sharing a common depth plane or a common color appeared in spatial contiguity in thexy plane. The results suggest that visual search for the target involves examination of kernels formed by homogeneous items sharing the same color and depth. In Experiment 2, thexy contiguity of distractors sharing a common color or a common depth plane was varied. The results showed that when target-distractor distinction becomes more difficult on one dimension, the other dimension becomes more important in performing visual search, as indicated by a larger effect on search time. This suggests that observers can make optimal use of the information available. Finally, color had a larger effect on search time than did stereoscopic depth. Overall, the results support models of visual processing which maintain that perceptual segregation and selective attention are determined by similarity among objects in 3-D visual space on both spatial and nonspatial stimulus dimensions.     

Recognizing familiar objects by hand and foot: Haptic shape perception generalizes to inputs from unusual locations and untrained body parts

The limits of generalization of our 3-D shape recognition system to identifying objects by touch was investigated by testing exploration at unusual locations and using untrained effectors. In Experiments 1 and 2, people found identification by hand of real objects, plastic 3-D models of objects, and raised line drawings placed in front of themselves no easier than when exploration was behind their back. Experiment 3 compared one-handed, two-handed, one-footed, and two-footed haptic object recognition of familiar objects. Recognition by foot was slower (7 vs. 13 s) and much less accurate (9 % vs. 47 % errors) than recognition by either one or both hands. Nevertheless, item difficulty was similar across hand and foot exploration, and there was a strong correlation between an individual’s hand and foot performance. Furthermore, foot recognition was better with the largest 20 of the 80 items (32 % errors), suggesting that physical limitations hampered exploration by foot. Thus, object recognition by hand generalized efficiently across the spatial location of stimuli, while object recognition by foot seemed surprisingly good given that no prior training was provided. Active touch (haptics) thus efficiently extracts 3-D shape information and accesses stored representations of familiar objects from novel modes of input.     

The perception of distances and spatial relationships in natural outdoor environments

The ability of observers to perceive distances and spatial relationships in outdoor environments was investigated in two experiments. In experiment 1, the observers adjusted triangular configurations to appear equilateral, while in experiment 2, they adjusted the depth of triangles to match their base width. The results of both experiments revealed that there are large individual differences in how observers perceive distances in outdoor settings. The observers' judgments were greatly affected by the particular task they were asked to perform. The observers who had shown no evidence of perceptual distortions in experiment 1 (with binocular vision) demonstrated large perceptual distortions in experiment 2 when the task was changed to match distances in depth to frontal distances perpendicular to the observers' line of sight. Considered as a whole, the results indicate that there is no single relationship between physical and perceived space that is consistent with observers' judgments of distances in ordinary outdoor contexts.