The effect of orientation on tactual braille recognition: Optimal touching positions

Subjects in five experiments matched tangible braille against a visible matching code. In Experiment 1, braille recognition suffered when entire lines of braille characters were tilted in varying amounts from the upright. Experiment 2 showed that tilt lowered performance for tangible, large embossed letters, as well as for braille. However, recognition was better for print letters than it was for braille. In Experiment 3, subjects attempted to match the upright array against embossed braille that was left/right reversed, inverted up/down, or rotated +180°. Performance was close to that for normal braille in the left/right reversal condition, and very low for the +180° rotation group. These results on braille tilt in the “picture plane” may reflect difficulty in manipulating the tangible “image.” Braille recognition performance was not lowered whenthe visible matching array was tilted ?45° or ?90° from the upright but the tangible stimuli were upright. In Experiment 4, recognition of left/right reversed braille that was physically horizontal (on the bottom of a shelf) was compared with that of braille left/right reversed due to its location on the back of a panel, in the vertical plane. Braille recognition accuracy was higher with braille located vertically. An additional experiment showed the beneficial effect of locating braille in the vertical, frontoparallel plane, obtained with +90° degree rotated braille. It is proposed that optimal tactual performance with tangible arrays might depend on touching position, and on the physical position of stimuli in space. Just as there are good and poor viewing positions, there may be optimal touching positions. The effects of tilt on braille identification were diminished for blind subjects, suggesting the importance of tactile experience and skill.     

The effect of orientation on visual and tactual braille recognition

Five experiments are reported in which subjects matched tangible or visible braille characters against either visual or tangible arrays. In both modalities recognition was impaired when the characters were tilted, but visual performance was superior to that for touch. Touch may be more sensitive than vision to tilt, since very small deviations from the upright decreased recognition accuracy. Orientation influenced pattern recognition with and without prior information about orientation. Tilting patterns slowed down recognition for tactual-visual matching, but only when orientation was studied with repeated measures. The results are consistent with the hypothesis that it is difficult to code braille patterns tactually as global outline shapes.     

Tactile memory in sighted and blind observers: the influence of orientation and rate of presentation

Sighted, early blind, and late blind subjects attempted to identify numerals or number sequences printed on their palms. The numerals were either upright, or inverted, or rotated perpendicular to the arm axis. Stimulus rotation degraded recognition in the early blind subjects, suggesting the influence of experience with visual frames of reference. Slower rates of presentation with upright number sequences improved recall in both sighted and blind observers. An experiment on tactual-visual braille recognition in the sighted observers showed that tilt degraded pattern identification, but visual guidance of the fingertip and ballpoint minimized this loss. A further experiment was performed to distinguish between visual imagery and visual frame of reference explanations of the visual guidance effect on recognition of rotated braille. Subjects explored upright or tilted braille characters while viewing only a light emitting diode on the exploratory fingertip. Sight of scanning movements did not aid pattern recognition with tilt. The results indicate that the benefits of visual guidance on recognition of tilted patterns were probably due to frame of reference information. It is concluded that spatial reference information may aid tactile memory in the sighted and late blind, since the early blind performed at a lower level in the retention task. It is proposed that visual imagery may only explain the superiority of the sighted and late blind when familiar stimuli are studied.     

Mental rotation under head tilt: Factors influencing the location of the subjective reference frame

We report five experiments on the effect of head tilt on the mental rotation of patterns to the “upright.” In Experiment 1, subjects rotated alphanumeric characters, displayed within a circular surround. Experiment 2 was similar except that the character was an unfamiliar letter-like symbol. In Experiment 3, subjects again rotated alphanumeric characters, but they were displayed within a rectangular frame tilted 60° to the right. Experiment 4 was similar, except that the subjects were instructed to rotate the characters to the “upright” defined by the tilted frame. In all four experiments, the subjects performed the task with their heads either upright or tilted 60°. In Experiment 5, subjects had their heads and bodies tilted 90°, and rotated alphanumeric characters displayed within a circular surround. In all except Experiment 4, analysis of response latencies revealed that the subjective vertical lay closer to the gravitational than to the retinal vertical, although it was somewhat displaced in the direction of the head tilt—more so in Experiments 2 and 3 than in Experiment 1, and more so still in Experiment 5. In Experiment 4, instructions to adopt the axes of the frame land thus of the retina) succeeded in bringing the subjective vertical closer to the retinal than to the gravitational vertical, although the subjective vertical was still some 20° on average from the gravitational vertical. The results show that the subjective reference frame is distinct from both gravitational and the retinal frames, and that the gravitational frame exerts the stronger influence. They also argue against the primacy of a “retinal factor” in the perception of orientation.     

Is visual image segmentation a bottom-up or an interactive process?

Visualimage segmentation is the process by which the visual system groups features that are part of a single shape. Is image segmentation a bottom-up or an interactive process? In Experiments 1 and 2, we presented subjects with two overlapping shapes and asked them to determine whether two probed locations were on the same shape or on different shapes. The availability of top-down support was manipulated by presenting either upright or rotated letters. Subjects were fastest to respond when the shapes corresponded to familiar shapes—the upright letters. In Experiment 3, we used a variant of this segmentation task to rule out the possibility that subjects performed same/different judgments after segmentation and recognition of both letters. Finally, in Experiment 4,we ruled out the possibility that the advantage for upright letters was merely due to faster recognition of upright letters relative to rotated letters. The results suggested that the previous effects were not due to faster recognition of upright letters; stimulus familiarity influenced segmentation per se. The results are discussed in terms of an interactive model of visual image segmentation.     

Tactual perception of embossed Morse code and braille: the alliance of vision and touch

In three experiments observers made visual matches to tangible embossed patterns. Stained glass was used to blur vision and thus allow the effect of visual guidance of tactual exploration on the accuracy of symbol recognition to be evaluated. Stained glass rendered the embossed code invisible, but allowed sight of the hand. In the first experiment subjects identified patterns made up of dots and dashes drawn from Morse code; in the second and third experiments they studied braille. The results show that subjects are more accurate in 'reading' tangible codes when provided with visual guidance. Performance was higher for braille than for Morse code. Vision aided touch through the provision of a frame of reference and through sight of scanning movements. Naive sighted observers were able to identify invisible braille dots by watching other individuals touch the symbols, suggesting the importance of vision of kinesthetic patterns.     

Mental rotation of mirrored letters: evidence from event-related brain potentials

Event-related brain potentials (ERPs) were recorded while participants (n=13) were presented with mirrored and normal letters at different orientations and were asked to make mirror-normal letter discriminations. As it has been suggested that a mental rotation out of the plane might be necessary to decide on mirrored letters, we wanted to determine whether this rotation occurs after the plane rotation in mirror rotated letters. The results showed that mirrored letters in the upright position elicited a negative-going waveform over the right hemisphere in the 400-500 ms window. A similar negativity was also present in mirrored letters at 30 degrees, 60 degrees, and 90 degrees, but in these cases it was delayed. Moreover, the well-known orientation effect on the amplitude of the rotation-related negativity was also found, although it was more evident for normal than for mirrored letters. These results indicate that the processing of mirrored letters differs from that of normal letters, and suggest that a rotation out of the plane after the plane rotation may be involved in the processing of mirror rotated letters.     

Influence of visual guidance on braille recognition: Low lighting also helps touch

This study was an attempt to clarify the mechanisms responsible for the benefits of visual guidance in tactual braille recognition. Subjects touched +90° tilted braille under normal room lighting, or with low lighting, with or without visual guidance. Both visual information about finger angle and spatial reference information were manipulated with stained glass and light-emitting diodes. The provision of visual information about finger angle alone was no help to braille recognition, and performance was low. Adding visual spatial reference information to vision of finger angle raised performance. However, recognition accuracy was also substantially improved by low lighting. The benefits of darkness for haptics did not generalize to the reading of upright, two-letter braille words. It was proposed that extraneous visual information may distract sighted subjects in haptic tasks that require mental rotation of visual images.     

Haptic dominance in form perception: vision versus proprioception.

An experiment placed vision and touch in conflict by the use of a mirror placed perpendicular to a letter display. The mirror induced a discrepancy in direction and form. Subjects touched the embossed tangible letters p, q, b, d, W, and M, while looking at them in a mirror, and were asked to identify the letters. The upright mirror produced a vertical inversion of the letters, and visual inversion of the direction of finger movement. Thus, subjects touched the letter p, but saw themselves touching the letter b in the mirror. There were large individual differences in reliance on the senses. The majority of the subjects depended on touch, and only one showed visual dominance. Others showed a compromise between the senses. The results were consistent with an attentional explanation of intersensory dominance.     

Visual field asymmetries and allocation of attention in visual scenes

Single items such as objects, letters or words are often presented in the right or left visual field to examine hemispheric differences in cognitive processing. However, in everyday life, such items appear within a visual context or scene that affects how they are represented and selected for attention. Here we examine processing asymmetries for a visual target within a frame of other elements (scene). We are especially interested in whether the allocation of visual attention affects the asymmetries, and in whether attention-related asymmetries occur in scenes oriented out of alignment with the viewer. In Experiment 1, visual field asymmetries were affected by the validity of a spatial precue in an upright frame. In Experiment 2, the same pattern of asymmetries occurred within frames rotated 90 degrees on the screen. In Experiment 3, additional sources of the spatial asymmetries were explored. We conclude that several left/right processing asymmetries, including some associated with the deployment of spatial attention, can be organized within scenes, in the absence of differential direct access to the two hemispheres.     

Decisions about the axes of disoriented shapes

Subjects were timed as they made decisions about the location of an asterisk placed to the left, right, top, or bottom of disoriented shapes, and their reaction times were plotted as a function of the angular departure of the shapes from the upright. In Experiment 1, the shapes were letters, and the functions suggested that the subjects generally mentally rotated some internal representation of each letter to the upright in order to decide whether the asterisk was to the left or the right, regardless of whether the letters were vertically symmetrical (A, T, U, V), horizontally symmetrical (B, C, D, E), or asymmetrical (F, G, R, L). For decisions about top and bottom, mental rotation rarely occurred, although there was some evidence for it in the case of horizontally symmetrical letters. Experiment 2 showed that mental rotation was not involved when subjects made one response if the asterisk was to the left or right, and another if it was at the top or bottom. In Experiment 3, the shapes were relatively unfamiliar architectural symbols, and in this case mental rotation was most strongly induced by those decisions requiring mirror-image discrimination, that is, left-right decisions for vertically symmetrical shapes and top-bottom decisions for horizontally symmetrical ones. Taken overall, the results suggest that there are two task ingredients that may induce mental rotation: One is the labeling of the left and right sides of a disoriented shape, and the other is the discrimination of mirror images.     

On the tangibility of letters and braille

Braille characters and letters were presented to the senses of touch and vision of sighted observers. The optical stimuli were subjected to low-pass spatial filtering to the degree that visual spatial resolution closely matched tactile spatial resolution(re the size of characters presented). In one experiment, three sets of braille characters and five sets of Roman letters, varying in typography, were presented as stimuli. The variations in tangibility and legibility across the eight character sets were highly correlated (r =.98). In a second experiment, braille characters and letters were varied in size. The psychometric functions relating tangibility and legibility to character size were similar in both shape and position along the abscissa. The congruence of tangibility and legibility for these conditions, in which the senses were matched in spatial resolution, supports the idea that braille characters are more tangible by virtue of their greater distinctiveness after the low-pass spatial filtering of cutaneous processing.     

Asymmetrical transfer of braille acquisition between hands

Two experiments are presented which demonstrate asymmetrical transfer for tactual recognition of individual braille letters in sighted subjects, a task usually associated with right hemisphere specialization. Right-handers were studied in Experiment 1, left- and right-handers in Experiment 2. Poor transfer of training from the right hand to the left hand was observed for right-handed subjects in both experiments. The same was true for one group of left-handers (who wrote with the "inverted" position). For another group (who wrote with the "noninverted" position), no disadvantage was associated with opposite-hand training for either hand. The role of hemispheric specialization of function in determining the direction of greater transfer is discussed, and it is argued that handwriting posture may be an index of the degree of functional "connectedness" of the two hemispheres in left-handers.     

Tachistoscopic perception under head tilt

Subjects attempted to identify singly presented letters, flashed briefly at six different locations equidistant from fixation. The locations were at 1, 3, 5, 7, 9, and 11 o’clock on an imaginary circle. The subjects performed both with their heads upright or tilted 60° (i.e., through 2 and 8 o’clock or through 10 and 4 o’clock). In Experiment 1, the letters were projected in a gravitationally fixed rectangular surround, and accuracy of report depended largely on the locations of the letters in gravitational coordinates, although there was clear evidence of a retinal influence as well. In Experiment 2, the surround was circular and accuracy depended principally on retinal location, although there was also a gravitational influence. Analysis of individual data suggested that, when their heads were tilted, subjects generally adopted a reference frame which lay between the retinal and gravitational frames, closer to one than the other but typically coinciding with neither. We conclude that the subjective reference frame does not depend on a poststimulus correction, but rather that stimulus information is incorporated directly into the subjective frame. The data also suggested that lateral asymmetries depend on a perceptual rather than a retinal interpretation of left and right visual fields.     

Perception of self-tilt in a true and illusory vertical plane

A tilted furnished room can induce strong visual reorientation illusions in stationary subjects. Supine subjects may perceive themselves upright when the room is tilted 90 degrees so that the visual polarity axis is kept aligned with the subject. This 'upright illusion' was used to induce roll tilt in a truly horizontal, but perceptually vertical, plane. A semistatic tilt profile was applied, in which the tilt angle gradually changed from 0 degrees to 90 degrees, and vice versa. This method produced larger illusory self-tilt than usually found with static tilt of a visual scene. Ten subjects indicated self-tilt by setting a tactile rod to perceived vertical. Six of them experienced the upright illusion and indicated illusory self-tilt with an average gain of about 0.5. This value is smaller than with true self-tilt (0.8), but comparable to the gain of visually induced self-tilt in erect subjects. Apparently, the contribution of nonvisual cues to gravity was independent of the subject's orientation to gravity itself. It therefore seems that the gain of visually induced self-tilt is smaller because of lacking, rather than conflicting, nonvisual cues. A vector analysis is used to discuss the results in terms of relative sensory weightings.     

Visual orientation during and after lateral head,body, and trunk tilt

Visual judgments of orientation were investigated during (effect) and after (aftereffect) different body postures. In Experiment 1 four trained Ss made apparent verticality (AV) judgments before and after 2 min in each of seven orientations: head tilt left and right, body tilt left and right, trunk tilt left and right and a control condition with head ’and body upright. The aftereffect was significant for all postures excepting trunk tilt left and the control. The aftereffect from head tilt was greater than that from the same degree of body tilt, and that in the trunk tilt condition was in the same direction as’ predicted from neck stimulation. In Experiment 2, 30 Ss made AV judgments during tilt in the same seven postures. The E-phenomenon resulted from both head and body tilts, and an effect was found for trunk tilt in the direction predicted from neck stimulation. The results are discussed in terms of the otolith, neck, and trunk receptor systems.     

What’s up in mental rotation?

We report two experiments on the influence of head tilt on mental rotation. In Experiment I, subjects decided whether dot patterns were or were not repeated about a line. Their reaction times (RTs) were consistent with the interpretation that they mentally rotated the patterns so that the line was subjectively vertical before making their decisions. When the subjects tilted their heads, the RT functions shifted in the direction of the tilt, indicating that the subjective vertical lay closer to the retinal than to the gravitational vertical. In Experiment II, subjects decided whether singly presented alphanumeric characters in various orientations were standard or backward (mirror-reversed). Again, analysis of their RTs suggested mental rotation to the standard upright, but the function was unaffected by head tilt; in this case, the subjects operated in subjective gravitational rather than retinal coordinates. The choice of retinal or gravitational coordinates may depend on whether the stimuli are interpreted egocentrically or as part of the external world.     

Must egocentric and environmental frames of reference be aligned to produce spatial S-R compatibility effects?

Four experiments were conducted to determine the effects of misaligning egocentric and environmental frames of reference on spatial S-R compatibility effects. In Experiments 1 and 3, subjects looked at two lights that were aligned horizontally, one each on either side of the body midline. They held their head upright or tilted 90 degrees to the left or right. In the upright condition the hands were uncrossed and rested opposite the lights (frames of reference aligned), whereas in the head tilt condition the hands were either crossed or uncrossed but positioned perpendicular to the lights (frames of reference not aligned). Manual choice reaction times to the lights produced spatial S-R compatibility effects that were as large when the frames of reference were aligned as when they were not. In Experiments 2 and 4, which also used upright and tilted conditions, we found generally similar results when the lights were displayed vertically and the hands disposed horizontally. The results indicate that under conditions of head rotation and with stimulus and response arrays perpendicular to each other, spatial S-R compatibility effects still occur. By taking into account both frames of reference, the subject classifies the stimuli as left or right whether they are horizontally or vertically disposed and maps them onto the responding hand, thereby producing the observed compatibility effects.     

Orientation unbound: Dissociation of identity and orientation under rapid serial visual presentation

Participants were shown rapid sequences of three letters, flanked by digits, each rotated 0 degree, 90 degrees, 180 degrees, or 270 degrees clockwise from upright. In Experiment 1, the participants tried to report the letter that matched the orientation of an arrow, presented either before (before task) or after (after task) the sequence. A third task (total task) required them to report all of the letters. Accuracy for individual letters was significantly better in the total task than in the before task, and better in the before task than in the after task, suggesting particular difficulty in binding orientation to identity. In Experiment 2, the participants were given letter probes and were asked to indicate the orientation of the probed letter. Although report was above chance, there were frequent illusory conjunctions. Since perception of orientation must depend on prior establishment of identity, our results suggest that orientation and identity may become unbound during processing and are held in parallel storage systems.