Perceptual orientational asymmetries: A comparison of visual and haptic space

Stimulus orientation discrimination was investigated in visual and haptic modalities under conditions of simultaneous matching and memory. Discrimination of vertical and horizontal was significantly more accurate than discrimination of oblique stimulus orientations (45°, 135°, 225°, and 315°) for both modalities; haptic errors, however, were significantly greater at each orientation. While subjects were reliably more accurate in visually matching oblique stimulus orientations to a standard than producing them from memory, for the haptic modality, differences between memory and matching conditions were less consistent across the orientations sampled.     

Catching oriented objects

We have investigated how participants match the orientation of a line, which moves on a vertical screen towards the subject. On its path to the participant, the line could disappear at several positions. Participants were instructed to put a bar on a predefined interception point on the screen, such that the bar touched the screen with the same orientation as the moving line at the very moment when the line passed through the interception point or (in case of line disappearance) when the hidden line would pass through the interception point (like in catching). Participants made significant errors for oblique orientations, but not for vertical and horizontal orientations of the moving line. These errors were small or absent when the moving line was visible all the way along its path on the screen. However, these errors became larger when the line disappeared farther away from the interception point. In the second experiment we tested whether these errors could be related to errors in visual perception of line orientation. The results demonstrate that errors in matching of the bar do not correspond to the last perceived orientation of the line, but rather to the perceived orientation of the moving line near the beginning of the movement path. This corresponds to earlier observations that participants shortly track a moving target and then make a saccadic eye movement to the interception point.     

The structure of frontoparallel haptic space is task dependent

In three experiments, we investigated the structure of frontoparallel haptic space. In the first experiment, we asked blindfolded participants to rotate a matching bar so that it felt parallel to the reference bar, the bars could be at various positions in the frontoparallel plane. Large systematic errors were observed, in which orientations that were perceived to be parallel were not physically parallel. In two subsequent experiments, we investigated the origin of these errors. In Experiment 2, we asked participants to verbally report the orientation of haptically presented bars. In this task, participants made errors that were considerably smaller than those made in Experiment 1. In Experiment 3, we asked participants to set bars in a verbally instructed orientation, and they also made errors significantly smaller than those observed in Experiment 1. The data suggest that the errors in the matching task originate from the transfer of the reference orientation to the matching-bar position.     

Visuo-haptic integration in object identification using novel objects

Although some studies have shown that haptic and visual identification seem to rely on similar processes, few studies have directly compared the two. We investigated haptic and visual object identification by asking participants to learn to recognize (Experiments 1, and 3), or to match (Experiment 2) novel objects that varied only in shape. Participants explored objects haptically, visually, or bimodally, and were then asked to identify objects haptically and/or visually. We demonstrated that patterns of identification errors were similar across identification modality, independently of learning and testing condition, suggesting that the haptic and visual representations in memory were similar. We also demonstrated that identification performance depended on both learning and testing conditions: visual identification surpassed haptic identification only when participants explored the objects visually or bimodally. When participants explored the objects haptically, haptic and visual identification were equivalent. Interestingly, when participants were simultaneously presented with two objects (one was presented haptically, and one was presented visually), object similarity only influenced performance when participants were asked to indicate whether the two objects were the same, or when participants had learned about the objects visually—without any haptic input. The results suggest that haptic and visual object representations rely on similar processes, that they may be shared, and that visual processing may not always lead to the best performance.     

The perception and representation of orientations: A study in the haptic modality

This research examines the haptic perception of orientations in the frontal plane in order to identify the nature of their representation. Blindfolded participants inserted the tip of the index finger into a thimble mounted on the extremity of a haptic interface and manually explored the orientation of a "virtual rod". After a short delay, participants had to reproduce the scanned orientation with the same hand without the guidance of the virtual rod. The analysis of the systematic errors showed that the recalled orientations were markedly biased toward the nearest diagonal in each quadrant with the exception of the orientations nearest to the vertical, which were biased toward the vertical. The variable error was greater for the oblique orientations than for the horizontal or vertical orientation. These results are interpreted with the Category-Adjustment model, which posits that orientations are categorically represented. We show that it is necessary to assume the existence of vertical and horizontal categories in addition to the previously postulated oblique categories to predict the error patterns observed in the present and former studies. The similarity of the error patterns in the visual and haptic modalities suggests that a common mechanism is at play in perceiving and reproducing orientations in both sensory modalities.     

Repetition priming and the haptic recognition of familiar and unfamiliar objects

In four experiments, we examined the haptic recognition of 3-D objects. In Experiment 1, blindfolded participants named everyday objects presented haptically in two blocks. There was significant priming of naming, but no cost of an object changing orientation between blocks. However, typical orientations of objects were recognized more quickly than nonstandard orientations. In Experiment 2, participants accurately performed an unannounced test of memory for orientation. The lack of orientation-specific priming in Experiment 1, therefore, was not because participants could not remember the orientation at which they had first felt an object. In Experiment 3, we examined haptic naming of objects that were primed either haptically or visually. Haptic priming was greater than visual priming, although significant cross-modal priming was also observed. In Experiment 4, we tested recognition memory for familiar and unfamiliar objects using an old-new recognition task. Objects were recognized best when they were presented in the same orientation in both blocks, suggesting that haptic object recognition is orientation sensitive. Photographs of the unfamiliar objects may be downloaded from www.psychonomic.org/archive.     

The role of contextual cues in the haptic perception of orientations and the oblique effect

Blindfolded right-handed participants were asked to position, with the right hand, a frontoparallel rod to one of three orientations: vertical (0°) and left 45° and right 45° obliques. Simultaneously, three different backgrounds were explored with the left hand: smooth, congruent stripes (parallel to the orientation to be produced), or incongruent stripes (tilted relative to the orientation to be produced). The analysis of variable errors showed that the oblique effect (higher precision for the vertical orientation than for the oblique orientations) was weakened in the presence of contextual cues, because of an improvement in oblique precision. Moreover, the analysis of constant errors revealed that the perception of orientations erred in the direction of the stripes, similar to the effect that has been found with vision, where visual contextual cues (tilted frame or lines) divert the perception of the vertical. These results are discussed in relation to a patterncentric frame of reference hypothesis or as a congruency effect.     

Egocentric reference frame bias in the palmar haptic perception of surface orientation

The effect of egocentric reference frames on palmar haptic perception of orientation was investigated in vertically separated locations in a sagittal plane. Reference stimuli to be haptically matched were presented either haptically (to the contralateral hand) or visually. As in prior investigations of haptic orientation perception, a strong egocentric bias was found, such that haptic orientation matches made in the lower part of personal space were much lower (i.e., were perceived as being higher) than those made at eye level. The same haptic bias was observed both when the reference surface to be matched was observed visually and when bimanual matching was used. These findings support the conclusion that, despite the presence of an unambiguous allocentric (gravitational) reference frame in vertical planes, haptic orientation perception in the sagittal plane reflects an egocentric bias.     

The visual perception coordinate system uses axes defined by the earth, trunk, and vision

Eight young adults adjusted a line located on one side of a computer display parallel to internally specified Earth-fixed vertical (display in frontal plane), to the horizontal trunk-fixed anterior-posterior axis (display in horizontal plane), and to an oblique line (display in horizontal and vertical planes). All tasks were completed in a dark room with the head and trunk in both a standard erect posture and varied postures. Errors were lowest when setting the line to internally specified vertical in the frontal plane and to an oblique line in the horizontal plane when head and trunk orientations were varied. Constant errors for setting one line parallel to a second line were in opposite directions when the second line was located on the left versus right side of the display, but did not differ in direction when setting the line parallel to internally specified axes. Also, the oblique effect was preserved when the head and trunk were tilted to various orientations, suggesting that it results from integration of an internally specified gravitational reference with visual input. We conclude that the visual perceptual coordinate system uses internally specified vertical and, when available, a visually specified horizontal reference axis to define object orientation.     

Effect of modality-specific experience on visual and haptic judgment of orientation

Although the 'oblique effect' (poorer performance on oblique orientations as compared to performance on vertical and horizontal orientations) is generally understood as a strictly visual phenomenon, a haptic oblique effect occurs for blindfolded subjects required to set a stimulus rod by hand. Because oblique effects are often attributed to the observer's experience with a predominantly horizontal and vertical environment, we assessed the effect of visual and haptic experience by providing subjects with modality-specific inspection periods to familiarize them with the more poorly judged obliques. Oblique error was significantly reduced in magnitude for judgments made by the modality of experience, and for judgments made across modalities. Rate of improvement, consistency of transfer, and the subjective reports of subjects indicate that this haptic oblique effect is more strongly influenced by visual experience and imagery than by haptic experience. It need not be interpreted as an effect based on factors intrinsic to the haptic modality.     

Developmental change in young children's use of haptic information in a visual task: the role of hand movements

Preschoolers who explore objects haptically often fail to recognize those objects in subsequent visual tests. This suggests that children may represent qualitatively different information in vision and haptics and/or that children’s haptic perception may be poor. In this study, 72 children (2½-5 years of age) and 20 adults explored unfamiliar objects either haptically or visually and then chose a visual match from among three test objects, each matching the exemplar on one perceptual dimension. All age groups chose shape-based matches after visual exploration. Both 5-year-olds and adults also chose shape-based matches after haptic exploration, but younger children did not match consistently in this condition. Certain hand movements performed by children during haptic exploration reliably predicted shape-based matches but occurred at very low frequencies. Thus, younger children’s difficulties with haptic-to-visual information transfer appeared to stem from their failure to use their hands to obtain reliable haptic information about objects.     

The haptic oblique effect in the perception of rod orientation by blind adults

The haptic perception of vertical, horizontal, +45° oblique, and +135° oblique orientations was studied in completely blind adults. The purpose was to determine whether the variations of the gravitational cues provided by the arm-hand system during scanning would affect the manifestation of the oblique effect (lower performance in oblique orientations than in vertical-horizontal ones) as they did in blindfolded sighted people (Gentaz & Hatwell, 1996). In blindfolded sighted adults, the oblique effect was reduced or absent when the magnitude of gravitational cues was decreased. If visual experience participated in the haptic oblique effect, we should observe no oblique effect in early blind subjects in the conditions of manual exploration where late blind and blindfolded sighted manifest this effect. The magnitude of gravitational cues was therefore varied by changing gravity constraints, whereas the variability of these cues was varied by changing the plane in which the task was performed: horizontal (low variability) and frontal (high variability). Early and late blind adults were asked to explore haptically a rod and then to reproduce its orientation ipsilateraUy in one of two exploratory conditions in each plane. In the horizontal plane, the oblique effect was absent, whatever the gravity constraints, in both groups (early and late blind subjects). In the frontal plane, the oblique effect was present, whatever the gravity constraints, in both groups. Taken together, these results showed that, in blind people, the variability of gravitational cues played a role in the haptic oblique effect; no effect of previous visual experience was observed.     

Haptic parallelity perception on the frontoparallel plane: the involvement of reference frames

It has been established that spatial representation in the haptic modality is subject to systematic distortions. In this study, the haptic perception of parallelity on the frontoparallel plane was investigated in a bimanual matching paradigm. Eight reference orientations and 23 combinations of stimulus locations were used. The current hypothesis from studies conducted on the horizontal and midsagittal planes presupposes that what is haptically perceived as parallel is a product of weighted contributions from both egocentric and allocentric reference frames. In our study, we assessed a correlation between deviations from the veridical and hand/arm postures and found support for the role of an intermediate frame of reference in modulating haptic parallelity on the frontoparallel plane as well. Moreover, a subject-dependent biasing influence of the egocentric reference frame determines both the reversal of the oblique effect and a scaling effect in deviations as a function of bar position.     

The eyes grasp,the hands see: Metric category knowledge transfers between vision and touch

Categorization of seen objects is often determined by the shapes of objects. However, shape is not exclusive to the visual modality: The haptic system also is expert at identifying shapes. Hence, an important question for understanding shape processing is whether humans store separate modality-dependent shape representations, or whether information is integrated into one multisensory representation. To answer this question, we created a metric space of computer-generated novel objects varying in shape. These objects were then printed using a 3-D printer, to generate tangible stimuli. In a categorization experiment, participants first explored the objects visually and haptically. We found that both modalities led to highly similar categorization behavior. Next, participants were trained either visually or haptically on shape categories within the metric space. As expected, visual training increased visual performance, and haptic training increased haptic performance. Importantly, however, we found that visual training also improved haptic performance, and vice versa. Two additional experiments showed that the location of the categorical boundary in the metric space also transferred across modalities, as did heightened discriminability of objects adjacent to the boundary. This observed transfer of metric category knowledge across modalities indicates that visual and haptic forms of shape information are integrated into a shared multisensory representation.     

The reproduction of vertical and oblique orientations in the visual, haptic, and somatovestibular systems

This study investigates whether the vertical orientation may be predominantly used as an amodal reference norm by the visual, haptic, and somato-vestibular perceptual systems to define oblique orientations. We examined this question by asking the same sighted adult subjects to reproduce, in the frontal (roll) plane, the vertical (0°) and six oblique orientations in three tasks involving different perceptual systems. In the visual task, the subjects adjusted a moveable rod so that it reproduced the orientation of a visual rod seen previously in a dark room. In the haptic task, the blindfolded sighted subjects scanned an oriented rod with one hand and reproduced its orientation, with the same hand, on a moveable response rod. In the somato-vestibular task, the blindfolded sighted subjects, sitting in a rotating chair, adjusted this chair in order to reproduce the tested orientation of their own body. The results showed that similar oblique effects (unsigned angular error difference between six oblique orientations and vertical orientation) were observed across the three tasks. However, there were no positive correlations between the visual, haptic,     

Body tilt effect on the reproduction of orientations: studies on the visual oblique effect and subjective orientations

Body tilt effects on the visual reproduction of orientations and the Class 2 oblique effect (E. A. Essock, 1980) were examined. Body tilts indicate whether the oblique effect (i.e., lower performance in oblique orientations than in vertical-horizontal orientations) is defined in an egocentric or a gravitational reference frame. Results showed that the oblique effect observed in upright posture disappeared in tilted conditions, mainly due to a decrease in the precision of the vertical and horizontal settings. In tilted conditions, the subjective visual vertical proved to be the orientation reproduced the most precisely. Thus, the oblique effect seemed to be not purely gravitationally or egocentrically defined but, rather, to depend on a subjective gravitational reference frame tilted in the same direction as body tilts.     

Eliminating the haptic oblique effect: influence of scanning incongruity and prior knowledge of the standards

Although the oblique effect has been conceptualized as a purely visual phenomenon, recent studies report its occurrence in a haptic matching task and present the hypothesis that differences in haptic orientational sensitivity might be responsible for the results. The possibility that procedural variables could be responsible was investigated. Specifically, the effect of prior knowledge of the stimulus orientation standards and of use of bilateral haptic exploration of standard and comparison orientations was examined. The results indicate that the reported oblique effect is reduced either when subjects are not informed which orientations will be tested, or when a unilateral matching procedure instead of a bilateral one is used. When both conditions are combined, the haptic oblique effect is eliminated. It is concluded that this particular manifestation of the oblique effect is not related to haptic sensitivity, but stems from the use of well-established imagery as referent for a match (imagery for oblique stimulus orientations is inferior) and the inherently different scanning patterns required in bilateral exploration of obliques (percepts of standard and comparison obliques will be necessarily different).     

Catching and matching bars with different orientations

The hypothesis that perception enslaves action is examined by assessing whether systematic distortions in perceptual judgments are reflected by inaccuracies in catching. In the first experiment, participants had to align manually the orientation of a reference bar placed at different distances in the frontoparallel plane. In the second experiment participants had to catch differently orientated moving bars, which became invisible at different distances from the interception point. In the matching experiment, systematic errors in the alignment of orientation were found in particular for oblique orientations, the magnitude of which increased with increasing distance of the reference bar. The inaccuracies in the final hand orientation during the catching task, however, did not mirror this pattern of deviations. The findings are interpreted to be more consistent with recent views that vision for perception (i.e., matching) and vision for action (i.e., catching) are dissociated than with the view that perception enslaves action.     

Viewpoint and orientation influence picture recognition in the blind

In the first three experiments, subjects felt solid geometrical forms and matched raised-line pictures to the objects. Performance was best in experiment 1 for top views, with shorter response latencies than for side views, front views, or 3-D views with foreshortening. In a second experiment with blind participants, matching accuracy was not significantly affected by prior visual experience, but speed advantages were found for top views, with 3-D views also yielding better matching accuracy than side views. There were no performance advantages for pictures of objects with a constant cross section in the vertical axis. The early-blind participants had lower performance for side and frontal views. The objects were rotated to oblique orientations in experiment 3. Early-blind subjects performed worse than the other subjects given object rotation. Visual experience with pictures of objects at many angles could facilitate identification at oblique orientations. In experiment 5 with blindfolded sighted subjects, tangible pictures were used as targets and as choices. The results yielded superior overall performance for 3-D views (mean, M = 74% correct) and much lower matching accuracy for top views as targets (M = 58% correct). Performance was highest when the target and matching viewpoint were identical, but 3-D views (M = 96% correct) were still far better than top views. The accuracy advantage of the top views also disappeared when more complex objects were tested in experiment 6. Alternative theoretical implications of the results are discussed.     

Illusory contours and spatial judgment

We investigated whether, in the human visual system, the mechanisms responsible for relative location judgments are the same when those judgments are made in the context of illusory contours and in the context of mentally joining two points. We asked subjects to align a dot with the oblique contour of an illusory surface or to align a dot with two markers at an oblique orientation. The systematic errors differed in direction for these two conditions. All the systematic errors were orientation dependent. The errors in aligning a dot with an illusory contour seem to be related to the asymmetrical shape of the single objects, which are able to induce an illusory contour, as well as figure-ground segregation.