Cerebral Asymmetry and Decision Strategies in Mental Rotation: A Psychophysical Analysis

The accuracy with which observers judged the parity of pairs of rotated images in the two visual fields was determined from receiver operating characteristic (ROC) analysis of confidence ratings. In one experiment, observers judged whether pairs of letters were of the same parity (that is, both normal or both backwards) or of different parities (one normal and one backwards). A small right visual field advantage in the observers' accuracy was found in this mental rotation task. In a second experiment, observers judged whether pairs of pictures were of the same parity or of different parities. Unlike the first experiment, no evidence of a consistent visual field advantage was found in this mental rotation task. The decision strategy adopted by the observers in making same-different judgements about rotated stimuli was examined. The symmetrical shape of the ROCs obtained was consistent with the adoption of the likelihood-ratio decision strategy, a result which supplemented previous evidence that this decision strategy is adopted when same-different judgements are made about multidimensional stimuli.     

The perception of verticality and the frame of reference of the visual tilt aftereffect

Previous research has suggested that the visual tilt aftereffect operates according to a gravitational frame of reference. Three experiments were conducted to test this conclusion further. In each experiment, observers (with head upright) adjusted an illuminated bar to apparent vertical following various adaptation conditions. In Experiment 1, observers were given clear visual cues for objective vertical while adjusting the bar. In Experiment 2, they were not given visual cues for vertical. The adaptation conditions in Experiments 1 and 2 consisted of various combinations of head and stimulus tilt. Experiment 3 investigated the effects of head tilt alone. The results indicated that the tilt aftereffect follows a retinal frame of reference under some conditions (Experiment 1) and appears to follow a gravitational frame under others (Experiment 2). These results can be predicted by a simple model involving two factors, a purely visual aftereffect that follows a retinal frame and an extravisual aftereffect that appears to follow a gravitational frame.     

Reference frames for orientation anisotropies in face recognition and biological-motion perception

Both face recognition and biological-motion perception are strongly orientation-dependent. Recognition performance decreases if the stimuli are rotated with respect to their normal upright orientation. Here, the question whether this effect operates in egocentric coordinates or in environmental coordinates is examined. In addition to the use of rotated stimuli the observers were also rotated and tested both with a same-different face-recognition task and with a biological-motion detection task. A strong orientation effect was found that depended only on the stimulus orientation relative to the observer. This result clearly indicates that orientation effects in both stimulus domains operate in an egocentric frame of reference. This finding is discussed in terms of the particular requirement of extracting sophisticated information for social recognition and communication from faces and biological motion.     

The importance of being upright: Use of environmental and viewer-centered reference frames in shape discriminations of novel three-dimensional objects

We investigated the frame of reference that people use to make shape discriminations when their heads are either upright or tilted. Observers madesame-different judgments of pairs of novel threedimensional objects that were aligned along their length within the frontal-parallel plane and rotated in depth around an axis parallel to their own axes of elongation. The aligned objects were displayed vertically, tilted 45°, or horizontally with respect to the environmental upright, but the distance of each pair from the upright was irrelevant to resolving the angular disparity between the stimuli for thesame-different judgment. Nevertheless, when observers’ heads were upright, the time to encode the stimuli was a linear function of the distance of the stimuli from the environmental upright, whereas when observers’ heads were tilted 45°, encoding times for tilted and vertical stimuli did not differ and were faster than the times to encode horizontal stimuli. We interpreted these data to mean that observers either rotate or reference the top of an object to the environmental upright, and they can use either a gravitational or retinal reference frame to do so when either they or the objects are not upright.     

Learning to search for visual targets defined by edges or by shading: Evidence for non-equivalence of line drawings and surface representations

A visual search task was used to test the idea that shaded images and their line-drawn analogues are treated identically from an early stage onwards in human vision. Reaction times and error rates were measured to locate the presence or absence of a target in an array of a variable number of distractors. The target was a cube in one orientation and the distractors cubes in a different orientation. The stimuli were defined by lines alone, shading alone, or lines plus shading. Both the slopes and the intercepts of the search functions (graphs of search time against number of displayed items) were higher for the line drawings than for the stimuli defined by shading. Over six experimental sessions, both the slopes and the intercepts fell for all stimuli, but the relative differences between them were maintained. The data suggest that, at an equivalent stage of practice, line-drawn stimuli are processed more slowly than shaded stimuli in early vision.     

Perception of illuminance flow in the case of anisotropic rough surfaces

Human observers estimate the illumination direction of rough surfaces rather precisely. When surfaces are rough, the illumination generates visible "texture" from differential shading at the level of the roughness, whereas differential illumination at the level of significant global surface curvature leads to the more familiar "shading". The shading is used in conventional shape-from-shading (SFS) algorithms, which ignore the illumination texture cue. Because of this simplification, SFS algorithms are typically formulated as global problems (partial differential equations, etc.). Human observers are likely to apply different methods than do these conventional SFS algorithms, however. When the roughness is not isotropic, one expects systematic errors in the visual detection of illumination direction, conceivably giving rise to erroneous shape estimates. Here we addressed this issue through systematic psychophysics on illumination direction detection as a function of the roughness anisotropy. Our expectations were fully borne out, in that the observers committed the predicted systematic errors. These results are precise enough to allow the inference that illumination direction detection is based on second-order statistics--that is, of edge detector (rather than line detector) activity.     

Effective 3-D shape discrimination survives retinal blur

A single experiment evaluated observers’ ability to visually discriminate 3-D object shape, where the 3-D structure was defined by motion, texture, Lambertian shading, and occluding contours. The observers’ vision was degraded to varying degrees by blurring the experimental stimuli, using 2.0-, 2.5-, and 3.0-diopter convex lenses. The lenses reduced the observers’ acuity from ?0.091 LogMAR (in the no-blur conditions) to 0.924 LogMAR (in the conditions with the most blur; 3.0-diopter lenses). This visual degradation, although producing severe reductions in visual acuity, had only small (but significant) effects on the observers’ ability to discriminate 3-D shape. The observers’ shape discrimination performance was facilitated by the objects’ rotation in depth, regardless of the presence or absence of blur. Our results indicate that accurate global shape discrimination survives a considerable amount of retinal blur.     

Separate influences of orientation and lighting in the inverted-face effect

Studies of the inverted-face effect typically use photos as stimuli. Inverting photos not only misorients the face but also reverses important shading and shadow cues. We decoupled the influence of spatial orientation and the direction of lighting in three experiments and found that the relation between these factors varied with the task given to observers. When the task required identification of faces (Experiments 1 and 3), the factors were additive, consistent with a strategy of mental rotation of the face prior to an interpretion of the shading cues. When faces were assigned to coarse categories (Experiments 2 and 3), these factors interacted, consistent with a more piecemeal approach to face processing. We propose that the identification of a specific individual depends on configurational information, which is preserved if the image of an inverted face is mentally rotated before the identification process is begun.     

Body tilt effect on the reproduction of orientations: studies on the visual oblique effect and subjective orientations

Body tilt effects on the visual reproduction of orientations and the Class 2 oblique effect (E. A. Essock, 1980) were examined. Body tilts indicate whether the oblique effect (i.e., lower performance in oblique orientations than in vertical-horizontal orientations) is defined in an egocentric or a gravitational reference frame. Results showed that the oblique effect observed in upright posture disappeared in tilted conditions, mainly due to a decrease in the precision of the vertical and horizontal settings. In tilted conditions, the subjective visual vertical proved to be the orientation reproduced the most precisely. Thus, the oblique effect seemed to be not purely gravitationally or egocentrically defined but, rather, to depend on a subjective gravitational reference frame tilted in the same direction as body tilts.     

The perception of surface orientation from multiple sources of optical information

An orientation matching task was used to evaluate observers’ sensitivity to local surface orientation at designated probe points on randomly shaped 3-D objects that were optically defined by texture, lambertian shading, or specular highlights. These surfaces could be stationary or in motion, and they could be viewed either monocularly or stereoscopically, in all possible combinations. It was found that the deformations of shading and/or highlights (either over time or between the two eyes’ views) produced levels of performance similar to those obtained for the optical deformations of textured surfaces. These findings suggest that the human visual system utilizes a much richer array of optical information to support its perception of shape than is typically appreciated.     

Mental rotation under head tilt: Factors influencing the location of the subjective reference frame

We report five experiments on the effect of head tilt on the mental rotation of patterns to the “upright.” In Experiment 1, subjects rotated alphanumeric characters, displayed within a circular surround. Experiment 2 was similar except that the character was an unfamiliar letter-like symbol. In Experiment 3, subjects again rotated alphanumeric characters, but they were displayed within a rectangular frame tilted 60° to the right. Experiment 4 was similar, except that the subjects were instructed to rotate the characters to the “upright” defined by the tilted frame. In all four experiments, the subjects performed the task with their heads either upright or tilted 60°. In Experiment 5, subjects had their heads and bodies tilted 90°, and rotated alphanumeric characters displayed within a circular surround. In all except Experiment 4, analysis of response latencies revealed that the subjective vertical lay closer to the gravitational than to the retinal vertical, although it was somewhat displaced in the direction of the head tilt—more so in Experiments 2 and 3 than in Experiment 1, and more so still in Experiment 5. In Experiment 4, instructions to adopt the axes of the frame land thus of the retina) succeeded in bringing the subjective vertical closer to the retinal than to the gravitational vertical, although the subjective vertical was still some 20° on average from the gravitational vertical. The results show that the subjective reference frame is distinct from both gravitational and the retinal frames, and that the gravitational frame exerts the stronger influence. They also argue against the primacy of a “retinal factor” in the perception of orientation.     

Projective invariance and visual shape constancy

As one moves about a table, the projection of its shape on the retina varies enormously, yet the table's shape appears constant. The various retinal images of a single object are nearly congruent in projective geometry. To explain apparent constancy, standard theories of vision assume that the visual system has access to this projective congruence. We present four experiments that undermine this assumption (i.e., the projective thesis). The basic result is that observers' estimates of shape in a simple production task represent gross departures from correct projection, even when observers are given aids to fixation. We manipulate both observer sample and experimental procedure in an attempt to find a source of these persistent errors. Our present hypothesis is that observers lack the sensitivity or implicit knowledge of projective geometry that has been attributed to them.     

Social categorization,visual cues,and social judgements

Recent research on social cognition suggests that lifelike visual and vocal information about a person may strongly mediate the impact of prior social categorical knowledge on social judgements. Other research, however, on the contribution of visual cues to impression formation, suggests that they have relatively little impact. This study sought to resolve these conflicting findings by examining the effect of visual cues on social judgements when subjects possess prior social categorical knowledge varying in salience to the experimental task. Videotaped target interviews were monitored by observers in either sound and vision or sound only, and measures were taken of the targets' perceived personality, their ‘actual’ and ‘predicted’ social performance, and social acceptance by observers. Whilst salience of categorization strongly influenced the quality of judgements, visual cues had little if any effect. However, visual cues strongly influenced subjects' confidence in all three sets of judgements, sound and vision subjects being consistently more confident than their sound only counterparts. The findings are discussed in relation to previous research in both social cognition and visual cues.     

Two reference frames for visual perception in two gravity conditions

The processing and storage of visual information concerning the orientation of objects in space is carried out in anisotropic reference frames in which all orientations are not treated equally. The perceptual anisotropies, and the implicit reference frames that they define, are evidenced by the observation of 'oblique effects' in which performance on a given perceptual task is better for horizontally and vertically oriented stimuli. The question remains how the preferred horizontal and vertical reference frames are defined. In these experiments cosmonaut subjects reproduced the remembered orientation of a visual stimulus in 1g (on the ground) and in 0g, both attached to a chair and while free-floating within the International Space Station. Results show that while the remembered orientation of a visual stimulus may be stored in a multimodal reference frame that includes gravity, an egocentric reference is sufficient to elicit the oblique effect when all gravitational and haptic cues are absent.     

A study of the effect of structural information and familiarity in form perception

Two experiments were carried out to investigate the influence of structural information and familiarity on the processing of visual forms. Pairs of “well” structured and nameable and “poorly” structured and non-nameable fragmented forms were employed as stimuli. The effects of structure and familiarity were assessed by manipulating the visual hemifield of presentation and the task. In Experiment 1 stimuli were judged as being either in the same orientation or mirror-reversed, a task that does not require high-level semantic information to be processed. Experiment 2 required physically identical forms to be matched, which may use either physical or name information. In Experiment 1 “same” judgements were equivalent for both types of stimuli, and “different' judgements were longer for the “poorly” structured (non-nameable) forms. In Experiment 2 there was little overall difference between “well” and “poorly” structured forms, though response times to “well” structured (nameable) forms were slowed for right-visual-field presentations. It is suggested that familiarity may not be sufficient to provide a perceptual advantage for nameable forms, as the advantage for nameable stimuli was confined to “same” judgements in Experiment 1 and response times were shorter for non-nameable stimuli in Experiment 2. Rather, performance depends upon factors such as the computation of global shape (due to structural properties of collinearity and closure) and on the use of different kinds or representations (physical versus name) in matching.     

The relationship between allocentric and egocentric frames of reference and categorical and coordinate spatial information processing

We report two experiments on the relationship between allocentric/egocentric frames of reference and categorical/coordinate spatial relations. Jager and Postma (2003) suggest two theoretical possibilities about their relationship: categorical judgements are better when combined with an allocentric reference frame and coordinate judgements with an egocentric reference frame (interaction hypothesis); allocentric/egocentric and categorical/coordinate form independent dimensions (independence hypothesis). Participants saw stimuli comprising two vertical bars (targets), one above and the other below a horizontal bar. They had to judge whether the targets appeared on the same side (categorical) or at the same distance (coordinate) with respect either to their body-midline (egocentric) or to the centre of the horizontal bar (allocentric). The results from Experiment 1 showed a facilitation in the allocentric and categorical conditions. In line with the independence hypothesis, no interaction effect emerged. To see whether the results were affected by the visual salience of the stimuli, in Experiment 2 the luminance of the horizontal bar was reduced. As a consequence, a significant interaction effect emerged indicating that categorical judgements were more accurate than coordinate ones, and especially so in the allocentric condition. Furthermore, egocentric judgements were as accurate as allocentric ones with a specific improvement when combined with coordinate spatial relations. The data from Experiment 2 showed that the visual salience of stimuli affected the relationship between allocentric/egocentric and categorical/coordinate dimensions. This suggests that the emergence of a selective interaction between the two dimensions may be modulated by the characteristics of the task.     

The Thatcher illusion: rotating the viewer instead of the picture

Faces are difficult to recognise when presented upside down. This effect of face inversion was effectively demonstrated with the 'Thatcher illusion' by Thompson (1980 Perception 9 483-484). It has been tacitly assumed that this effect is due to inversion relative to retinal coordinates. Here we tested whether it is due to egocentric (i.e. retinal) inversion or whether the orientation of the body with respect to gravity also influences the face-inversion effect. A 3-D human turntable was used to test subjects in 5 different body-tilt (roll) orientations: 0 degree, 45 degrees, 90 degrees, 135 degrees, and 180 degrees. The stimuli consisted of 4 'normal' and 4 'thatcherised' faces and were presented in 8 different orientations in the picture plane. The subjects had to decide in a yes-no task whether the faces were 'normal' or 'thatcherised'. Analysis of the d' values revealed a significant effect of stimulus orientation and body tilt. The significant effect of body tilt was due to a drop in d' values in the 135 degrees orientation. This result is compared to findings of studies on the subjective visual vertical, where larger errors occurred in body-tilt orientations between 90 degrees and 180 degrees. The present findings suggest that the face-inversion effect relies mainly on retinal coordinates, but that in head-down body-tilt orientations around 135 degrees the gravitational reference frame has a major influence on the perception of faces.     

On the perception of shape from shading

The extraction of three-dimensional shape from shading is one of the most perceptually compelling, yet poorly understood, aspects of visual perception. In this paper, we report several new experiments on the manner in which the perception of shape from shading interacts with other visual processes such as perceptual grouping, preattentive search (“pop-out”), and motion perception. Our specific findings are as follows: (1) The extraction of shape from shading information incorporates at least two “assumptions” or constraints—first,that there is a single light source illuminating the whole scene, and second, that the light is shining from “above” in relation to retinal coordinates. (2) Tokens defined by shading can serve as a basis for perceptual grouping and segregation. (3) Reaction time for detecting a single convex shape does not increase with the number of items in the display. This “pop-out” effect must be based on shading rather than on differences in luminance polarity, since neither left-right differences nor step changes in luminance resulted in pop-out. (4) When the subjects were experienced, there were no search asymmetries for convex as opposed to concave tokens, but when the subjects were naive, cavities were much easier to detect than convex shapes. (5) The extraction of shape from shading can also provide an input to motion perception. And finally, (6) the assumption of “overhead illumination” that leads to perceptual grouping depends primarily on retinal rather than on “phenomenal” or gravitational coordinates. Taken collectively, these findings imply that the extraction of shape from shading is an “early” visual process that occurs prior to perceptual grouping, motion perception, and vestibular (as well as “cognitive”) correction for head tilt. Hence, there may be neural elements very early in visual processing that are specialized for the extraction of shape from shading.     

On the perception of shape from shading.

The extraction of three-dimensional shape from shading is one of the most perceptually compelling, yet poorly understood, aspects of visual perception. In this paper, we report several new experiments on the manner in which the perception of shape from shading interacts with other visual processes such as perceptual grouping, preattentive search ("pop-out"), and motion perception. Our specific findings are as follows: (1) The extraction of shape from shading information incorporates at least two "assumptions" or constraints--first, that there is a single light source illuminating the whole scene, and second, that the light is shining from "above" in relation to retinal coordinates. (2) Tokens defined by shading can serve as a basis for perceptual grouping and segregation. (3) Reaction time for detecting a single convex shape does not increase with the number of items in the display. This "pop-out" effect must be based on shading rather than on differences in luminance polarity, since neither left-right differences nor step changes in luminance resulted in pop-out. (4) When the subjects were experienced, there were no search asymmetries for convex as opposed to concave tokens, but when the subjects were naive, cavities were much easier to detect than convex shapes. (5) The extraction of shape from shading can also provide an input to motion perception. And finally, (6) the assumption of "overhead illumination" that leads to perceptual grouping depends primarily on retinal rather than on "phenomenal" or gravitational coordinates. Taken collectively, these findings imply that the extraction of shape from shading is an "early" visual process that occurs prior to perceptual grouping, motion perception, and vestibular (as well as "cognitive") correction for head tilt. Hence, there may be neural elements very early in visual processing that are specialized for the extraction of shape from shading.     

The age deficit on photopic counterphase flicker: contrast, spatial frequency, and luminance effects.

This study evaluated the contribution of reduced contrast sensitivity and retinal illuminance to the age-related deficit on the temporal resolution of suprathreshold spatial stimuli. The discrimination of counterphase flicker was measured in optimally refracted young and elderly observers for sinusoidal gratings of three spatial frequencies (1, 4, and 8 cycles per degree) at three contrast levels (0.11, 0.33, and 0.66). Age deficits in flicker discrimination at the two higher contrast levels and at the two lower spatial frequencies were unrelated to observer contrast sensitivity. Flicker discrimination of young observers who carried out the task through .5 ND filters to simulate a two-thirds reduction of retinal illuminance in the older eye, was similar to that of the elderly observers. An age-related reduction in retinal luminance appears to be a major determinant of the age-related spatiotemporal deficit at suprathreshold contrast levels, although neural factors may also be involved.