Mental imagery and the third dimension

What sort of medium underlies imagery for three-dimensional scenes? In the present investigation, the time subjects took to scan between objects in a mental image was used to infer the sorts of geometric information that images preserve. Subjects studied an open box in which five objects were suspended, and learned to imagine this display with their eyes closed. In the first experiment, subjects scanned by tracking an imaginary point moving in a straight line between the imagined objects. Scanning times increased linearly with increasing distance between objects in three dimensions. Therefore metric 3-D information must be preserved in images, and images cannot simply be 2-D "snapshots." In a second experiment, subjects scanned across the image by "sighting" objects through an imaginary rifle sight. Here scanning times were found to increase linearly with the two-dimensional separations between objects as they appeared from the original viewing angle. Therefore metric 2-D distance information in the original perspective view must be preserved in images, and images cannot simply be 3-D "scale-models" that are assessed from any and all directions at once. In a third experiment, subjects mentally rotated the display 90 degrees and scanned between objects as they appeared in this new perspective view by tracking an imaginary rifle signt, as before. Scanning times increased linearly with the two-dimensional separations between objects as they would appear from the new relative viewing perspective. Therefore images can display metric 2-D distance information in a perspective view never actually experiences, so mental images cannot simply be "snapshot plus scale model" pairs. These results can be explained by a model in which the three-dimensional structure of objects is encoded in long-term memory in 3-D object-centered coordinate systems. When these objects are imagined, this information is then mapped onto a single 2-D "surface display" in which the perspective properties specific to a given viewing angle can be depicted. In a set of perceptual control experiments, subjects scanned a visible display by (a) simply moving their eyes from one object to another, (b) sweeping an imaginary rifle sight over the display, or (c) tracking an imaginary point moving from one object to another. Eye-movement times varied linearly with 2-D interobject distance, as did time to scan with an imaginary rifle sight; time to tract a point varied independently with the 3-D and 2-D interobject distances. These results are compared with the analogous image scanning results to argue that imagery and perception share some representational structures but that mental image scanning is a process distinct from eye movements or eye-movement commands.     

Distance estimation from cognitive maps

Four experiments investigated map clutter as a source of distortion in subjects' estimates of distance. In Experiments 1 (incidental learning) and 2 (intentional learning), subjects estimated distances between pairs of points on a memorized map. In both experiments, estimates increased as a linear function of the number of intervening points along the route. In Experiment 3, subjects estimated distances while viewing the map. The effect of clutter was reduced but not eliminated. In Experiment 4, the clutter effect was demonstrated using subjects' preexperimental knowledge of United States geography. Psychophysical power functions relating true to estimated distance provided a good fit to both memory and perception data. These results suggest an analogy between perceptual and memorial processes of distance estimation. A model proposed to account for the data assumes that subjects perceptually scan a route (or image of a route) from start to destination and use scan duration to determine path distance.     

Interobject spacing explains the attentional bias toward interacting objects

Spatio-temporal interactions between simple geometrical shapes typically elicit strong impressions of intentionality. Recent research has started to explore the link between attentional processes and the detection of interacting objects. Here, we asked whether visual attention is biased toward such interactions. We investigated probe discrimination performance in algorithmically generated animations that involved two chasing objects and two randomly moving objects. In Experiment 1, we observed a pronounced attention capture effect for chasing objects. Because reduced interobject spacing is an inherent feature of interacting objects, in Experiment 2 we designed randomly moving objects that were matched to the chasing objects with respect to interobject spacing at probe onset. In this experiment, the capture effect attenuated completely. Therefore, we argue that reduced interobject spacing reflects an efficient cue to guide visual attention toward objects that interact intentionally.     

The importance of a visual horizon for distance judgments under severely degraded vision

In two experiments we examined the role of visual horizon information on absolute egocentric distance judgments to on-ground targets. Sedgwick [1983, in Human and Machine Vision (New York: Academic Press) pp 425-458] suggested that the visual system may utilize the angle of declination from a horizontal line of sight to the target location (horizon distance relation) to determine absolute distances on infinite ground surfaces. While studies have supported this hypothesis, less is known about the specific cues (vestibular, visual) used to determine horizontal line of sight. We investigated this question by requiring observers to judge distances under degraded vision given an unaltered or raised visual horizon. The results suggest that visual horizon information does influence perception of absolute distances as evident through two different action-based measures: walking or throwing without vision to previously viewed targets. Distances were judged as shorter in the presence of a raised visual horizon. The results are discussed with respect to how the visual system accurately determines absolute distance to objects on a finite ground plane and for their implications for understanding space perception in low-vision individuals.     

Infants’ sensitivity to familiar size: The effect of memory on spatial perception

Two experiments investigated infants’ sensitivity to familiar size as information for the distances of objects with which they had had only brief experience. Each experiment had two phases: a familiarization phase and a test phase. During the familiarization phase, the infant played with a pair of different-sized objects for 10 min. During the test phase, a pair of objects, identical to those seen in the familiarization phase but now equal in size, were presented to the infant at a fixed distance under monocular or binocular viewing conditions. In the test phase of Experiment 1, 7-month-old infants viewing the objects monocularly showed a significant preference to reach for the object that resembled the smaller object in the familiarization phase. Seven-month-old infants in the binocular viewing condition reached equally to the two test phase objects. These results indicate that, in the monocular condition, the 7-month-olds used knowledge about the objects’ sizes, acquired during the familiarization phase, to perceive distance from the test objects’ visual angles, and that they reached preferentially for the apparently nearer object. The lack of a reaching preference in the binocular condition rules out interpretations of the results not based on the objects’ perceived distances. The results, therefore, indicate that 7-month-old infants can use memory to mediate spatial perception. The implications of this finding for the debate between direct and indirect theories of visual perception are discussed. In the test phase of Experiment 2,5-month-old infants viewing the objects monocularly showed no reaching preference. These infants, therefore, showed no evidence of sensitivity to familiar size as distance information.     

Magnification rate of objects in a perspective image to fit to our perception

Abstract: A landscape photograph may give a different impression from that formed at the real scene, with respect to the size and distance of objects. Researchers have reported that the perceived sizes and distances of objects in a photograph are not identical to those in a real space. In order to develop a method to create a graphic image that is close to our visual impression as seen in the real space, two experiments were conducted. In Experiment 1, we examined how the magnification rate of the perceived size to the object size on the retina varied with the viewing distance (range was from 1 m to 10 m). In Experiment 2, we examined whether transformation based on the magnification rate is effective for creating an image that matches the perceived size of the object at the scene. Our results indicate that the magnification rate is useful for transforming the perspective image to match our perception of the objects regardless of the viewing distance.     

Perception of two-body center of mass

Participants estimated the perceptual center of mass between two horizontally oriented black dots varying in size and distance. Experiment 1 showed that estimates, measured as distance from the larger dot's center, decreased with an increase in size ratio between the dots and a decrease in the distance between them, as predicted by the physical center-of-mass equation. The results were replicated and extended in further experiments with different ratios and distances. In all experiments, the true center was consistently overestimated, either because the stimuli were perceived in a low dimensionality or because of a hesitancy to place estimates near the larger dot's edge. In Experiment 4, the center was deliberately placed near this edge for one- and two-dimensional solutions. Participants still overestimated, indicating an "edge effect" as responsible.     

The visual perception of lines on the road

The present work demonstrates that observers grossly underestimate the length of lines parallel to their line of sight. In Experiment 1, observers, working from memory, estimated the length of a dashed line on the road to be 0.61 m. This result is consistent with observers' using an average visual angle converted to the physical length of visible lines on the road to estimate their length. In Experiment 2, observers gave verbal and matching estimates that significantly underestimated the length of a 3.05-m line on the ground that was parallel to their line of sight. In Experiment 3, observers significantly underestimated the length of dashed lines on the road while in a moving car. The results of Experiments 1 and 3 are described well by Euclidean geometry, whereas the tangle model that utilizes an increasing function of the visual angle to describe perceived extent best describes the results of Experiment 2.     

True three-dimensional displays that allow viewers to dynamically shift accommodation, bringing objects displayed at different viewing distances into and out of focus.

Under natural viewing conditions, viewers do not just passively perceive. Instead, they dynamically scan the visual scene by shifting their eye fixation and focus between objects at different viewing distances. In doing so, the oculomotor processes of accommodation (eye focus) and vergence (angle between lines of sight of two eyes) must be shifted synchronously to place new objects in sharp focus in the center of each retina. Accordingly, nature has reflexively linked accommodation and vergence, such that a change in one process automatically drives a matching change in the other. Conventional stereoscopic displays force viewers to try to decouple these processes, because while they must dynamically vary vergence angle to view objects at different stereoscopic distances, they must keep accommodation at a fixed distance--or else the entire display will slip out of focus. This decoupling generates eye fatigue and compromises image quality when viewing such displays. In an effort to solve this accommodation/vergence mismatch problem, we have built various prototype displays that can vary the focus of objects at different distances in a displayed scene to match vergence and stereoscopic retinal disparity demands and better simulate natural viewing conditions. By adjusting the focus of individual objects in a scene to match their stereoscopic retinal disparity, the cues to ocular accommodation and vergence are brought into agreement. As in natural vision, the viewer brings different objects into focus by shifting accommodation. As the mismatch between accommodation and vergence is decreased, natural viewing conditions are better simulated and eye fatigue should decrease.     

Journal of experimental psychology: human perception and performance

We examined the nonveridicality of visual direction produced by monocular viewing. In Experiment 1, 19 subjects pointed to a small light and moved a small light to their subjective median plane. The extent of constant error under monocular and binocular viewing conditions differed in both tasks (p less than .001). The monocular-binocular difference was larger when the viewing distance was 25 cm than when it was 50 cm (p less than .01). Also, correlations between phoria and monocular-binocular differences ranged from .58 to .77, depending on viewing distances and tasks. The effects of phoria within the context of Hering's .001). The monocular-binocular difference was larger when the viewing distance was 25 cm than when it was 50 cm (p less than .01). Also, correlations between phoria and monocular-binocular differences ranged from .58 to .77, depending on viewing distances and tasks. The effects of phoria within the context of Hering's .001). The monocular-binocular difference was larger when the viewing distance was 25 cm than when it was 50 cm (p less than .01). Also, correlations between phoria and monocular-binocular differences ranged from .58 to .77, depending on viewing distances and tasks. The effects of phoria within the context of Hering's principle of visual direction can account for these results. In Experiment 2, the same subjects adapted to phoria-induced error by placing a finger over a monocularly viewed target. The difference in their pointing responses before and after the task were reliable (p less than .005), and the correlations between phoria and the pre- to posttest differences were .45 and .77, depending on the number of adaptation trials. We argue that all monocular experiments dealing with visual direction should control for these effects.     

Mental imagery of visual motion modifies the perception of roll-vection stimulation

When viewing a wide-angle visual display, which rotates in the frontoparallel plane around the line of sight, observers experience an illusory shift of the direction of gravity; this shift leads to an apparent tilt of the body and displaces allocentric space coordinates. In this study, subjects adjusted an indicator to the apparent horizontal while viewing a rotating display. To determine whether top down processes could affect the illusion, the subjects were asked to visualize a rotating configuration of dots onto a blank central portion of the moving visual field. Visualizing dots and actually viewing the dots deflected the spatial judgment in very similar ways. These results demonstrate that top down processing can affect allocentric space coordinates.     

VIEWPOINT DEPENDENCE IN SCENE RECOGNITION

Abstract— Two experiments investigated the viewpoint dependence of spatial memories. In Experiment 1, participants learned the locations of objects on a desktop from a single perspective and then took part in a recognition test, test scenes included familiar and novel views of the layout. Recognition latency was a linear function of the angular distance between a test view and the study view. In Experiment 2, participants studied a layout from a single view and then learned to recognize the layout from three additional training views. A final recognition test showed that the study view and the training views were represented in memory, and that latency was a linear function of the angular distance to the nearest study or training view. These results indicate that interobject spatial relations are encoded in a viewpoint-dependent manner, and that recognition of novel views requires normalization to the most similar representation in memory. These findings parallel recent results in visual object recognition     

Perception of visual inclination in a real and simulated urban environment

The perceived inclination of slopes is generally overestimated. We claim that overestimation depends on the use of impoverished stimuli and on the distance between the observer and an inclined surface. In experiment 1, participants reported the perceived inclination of a set of urban roads from two different viewing distances. Observers did not overestimate the perceived inclination of slopes when they saw roads from the shorter viewing distances, whereas they slightly overestimated the perceived inclination of slopes from the farther distance. In experiment 2, participants reported the perceived inclination of a set of stereoscopic slides representing the same urban roads as in experiment 1. Here, observers did not overestimate the perceived inclination of slopes when the projected stereoscopic image contained horizontal disparity and simulated the shorter viewing distance; while they revealed a slight overestimation from the farther distance. We found always overestimation when the binocular image did not contain horizontal disparity, independently from the viewing distance. In conclusion, slopes are overestimated when (a) horizontal disparity is absent, and (b) the viewing distance is increased.     

视觉表象扫描中的视角大小效应

采用视觉表象的几何距离扫描任务,通过两个实验首次揭示了视觉表象扫描中的视角大小效应。实验一采用3 (视角：2.7°,5.5°和8.2°) × 3 (扫描距离：0.0cm、0.4cm和0.8cm) 组内实验设计,探讨了视角大小这种表象前加工因素是否影响心理扫描的问题;实验二采用8 (视角：2.7°,4.1°,5.5°,6.9°,8.2°,9.6°,12.3°和17.1°) × 2 (扫描距离：0.4cm和0.8cm) 组内实验设计,探讨了视角大小如何影响心理扫描加工过程的问题。结果表明：（1）在视觉表象扫描中,扫描时间会受到表象对应刺激的视角大小影响,即使扫描的几何距离相等,不同视角大小条件下的扫描时间仍存在显著差异;（2）在4°到10°这个视角范围内心理扫描的时间显著短于这个范围之外的扫描时间,6.5°左右是视觉表象扫描的最佳视角。视角大小效应有别于心理扫描的大小效应和距离效应,为Kosslyn的表象计算理论增加了新的内容,具有重要的理论意义。同时它对仪表、图形设计以及棋牌游戏等工作和生活实践具有一定的应用价值     

Two kinds of visual perspective taking

Visual perspective taking can be used to determine where objects are located relative toanother agent, or whether the agent can see a particular object. Four experiments indicated that different processes provide these different kinds of information. When participants were asked to report whether an object was to the left or to the right of another agent, response times (RTs) increased with increasing angular distance between the participant and the agent, suggesting that participants mentally transformed their perspective to align it with that of the agent. For visibility judgments, RTs were independent of the angle between the participant and the agent but increased with the distance between the agent and the object, suggesting that participants traced the agent's line of sight. Together, these data suggest that perspective taking encompasses at least two qualitatively different computational processes: one that updates the viewer's imagined perspective, and one that traces a line of sight.     

局部注意干扰效应中的眼动特征

采用眼动追踪范式,本研究通过两个实验探讨局部注意干扰效应（LAI）的注意分配特点和机制。实验一采用搜索时间有限的范式,目标呈现70毫秒后消失,在行为和眼动指标上均发现LAI效应：当两个目标距离较近时,反应时增加,正确率降低,总注视时长增长、注视点增加和眼跳速度加快。实验二增加目标呈现时间至1500毫秒以鼓励搜索,产生了比实验一更强烈的LAI效应,且眼跳速度的模式也有不同,说明增加搜索时间并不利于减轻LAI,从而推断LAI的竞争发生在判断阶段,而非搜索和识别目标阶段。     

Depth perception as a function of motion parallax and absolute-distance information

The results of three experiments demonstrated that the visual system calibrates motion parallax according to absolute-distance information in processing depth. The parallax was created by yoking the relative movement of random dots displayed on a cathode-ray tube to the movements of the head. In Experiment 1, at viewing distances of 40 cm and 80 cm, observers reported the apparent depth produced by motion parallax equivalent to a binocular disparity of 0.47 degree. The mean apparent depth at 80 cm was 2.6 times larger than at 40 cm. In Experiment 2, again at viewing distances of 40 cm and 80 cm, observers adjusted the extent of parallax so that the apparent depth was 7.0 cm. The mean extent of parallax at 80 cm was 31% of that at 40 cm. In Experiment 3, distances ranged from 40 cm to 320 cm, and a wide range of parallax was used. As distance and parallax increased, the perception of a rigid three-dimensional surface was accompanied by rocking motion; perception of depth was replaced by perception of motion in some trials at 320 cm. Moreover, the mean apparent depths were proportional to the viewing distance at 40 cm and 80 cm but not at 160 cm and 320 cm.     

Apparent distance in a horizontal plane with tactile-kinesthetic stimuli

In the study of active tactile-kinesthetic space perception apparent distance has been found to vary as a function of the direction of the line segment in a horizontal plane. The present data indicate that the error is not consistently related to the same frame of reference as the visual illusion. Rather, with movement of the extended arm to determine the relative distances between pairs of points, radial distances are overestimated in relation to tangential ones, whether parallel or perpendicular to the medial plane. Interpretations are in terms of kinesthetic stimulus patterns and the structure of perceptual representation.