Music-reading expertise alters visual spatial resolution for musical notation

Crowding occurs when the perception of a suprathreshold target is impaired by nearby distractors, reflecting a fundamental limitation on visual spatial resolution. It is likely that crowding limits music reading, as each musical note is crowded by adjacent notes and by the five-line staff, similar to word reading, in which letter recognition is reduced by crowding from adjacent letters. Here, we tested the hypothesis that, with extensive experience, music-reading experts have acquired visual skills such that they experience a smaller crowding effect, resulting in higher music-reading fluency. Experts experienced a smaller crowding effect than did novices, but only for musical stimuli, not for control stimuli (Landolt Cs). The magnitude of the crowding effect for musical stimuli could be predicted by individual fluency in music reading. Our results highlight the role of experience in crowding: Visual spatial resolution can be improved specifically for objects associated with perceptual expertise. Music-reading rates are likely limited by crowding, and our results are consistent with the idea that experience alleviates these limitations.     

Computers in spatial vision research

The original impulse for using computers in a laboratory dedicated to spatial vision research and the current role of computers in experiments are detailed. Although computers are used widely for modeling spatial vision, there is some doubt about whether conventional serial computers are the most appropriate tools for this task.     

How visual spatial attention alters perception

Visual attention is essential for visual perception. Spatial attention allows us to grant priority in processing and selectively process information at a given location. In this paper, I explain how two kinds of spatial attention: covert (allocated to the target location, without accompanying eye movements) and presaccadic (allocated to the location of the upcoming saccade’s target) affect performance and alter appearance. First, I highlight some behavioral and neuroimaging research on covert attention, which alters performance and appearance in many basic visual tasks. Second, I review studies showing that presaccadic attention improves performance and alters appearance at the saccade target location. Further, these modulations change the processing of feature information automatically, even when it is detrimental to the task at hand. We propose that saccade preparation may support transsaccadic integration. Systematically investigating the common and differential characteristics of covert attention and presaccadic attention will continue to further our understanding of the pervasive selective processing of information, which enables us to make sense of our complex visual world.     

Perception of spatial order in extrafoveal vision

Perception of spatial order in central and extrafoveal vision was investigated by means of a task in which observers judged the relative position of a target line segment in a briefly flashed array of six line segments. The line arrays were size-scaled in extrafoveal vision according to the cortical magnification factor derived from the cone and ganglion cell distributions across the human retina, i.e. the stimulus representations in the striate cortex were of equal size in central and eccentric vision. In central vision, observers could judge the relative position of the target with high accuracy but in extrafoveal vision the task was more difficult, especially with short interline distances. However, performance was well above chance level also in extrafoveal vision.     

Attention alters the appearance of spatial frequency and gap size

Transient attention is the automatic and short-lasting preferential processing of an area in visual space initiated by sudden stimulation in the same vicinity. Transient attention enhances early visual processing in a variety of dimensions, increasing contrast sensitivity, spatial resolution, and acuity. A recent study established that the increase in contrast sensitivity is accompanied by an increase in apparent contrast. In the present study, we investigated whether the effects of transient attention on spatial resolution and acuity are accompanied by corresponding phenomenological changes in these dimensions. The data indicate that transient attention increases the apparent spatial frequency of Gabor stimuli (Experiment 1) and increases apparent gap size in a Landolt-square acuity task (Experiment 2). Transient attention not only affects basic visual processing-it changes what one experiences.     

Transient spatial attention degrades temporal resolution

To better understand the interplay between the temporal and spatial components of visual perception, we studied the effects of transient spatial attention on temporal resolution. Given that spatial attention sharpens spatial resolution, can it also affect temporal resolution? To assess temporal resolution, we measured the two-flash fusion threshold When two flashes of light are presented successively to the same location, the two-flash fusion threshold is the minimal interval between the flashes at which they are still perceived as two flashes, rather than a single flash. This assessment of temporal resolution was combined with peripheral precuing--a direct manipulation of transient spatial attention. This allowed us to demonstrate, for the first time, that spatial attention can indeed affect temporal resolution. However, in contrast to its effect on spatial resolution, spatial attention degrades temporal resolution. Two attentional mechanisms that could account for both attentional effects--enhanced spatial resolution and reduced temporal resolution--are discussed.     

Intact spatial updating with severely degraded vision

Critical to low-vision navigation are the abilities to recover scale and update a 3-D representation of space. In order to investigate whether these abilities are present under low-vision conditions, we employed the triangulation task of eyes-closed indirect walking to previously viewed targets on the ground. This task requires that the observer continually update the location of the target without any further visual feedback of his/her movement or the target’s location. Normally sighted participants were tested monocularly in a degraded vision condition and a normal vision condition on both indirect and direct walking to previously viewed targets. Surprisingly, we found no difference in walked distances between the degraded and normal vision conditions. Our results provide evidence for intact spatial updating even under severely degraded vision conditions, indicating that participants can recover scale and update a 3-D representation of space under simulated low vision.     

The spatial resolution of visual attention.

Two tasks were used to evaluate the grain of visual attention, the minimum spacing at which attention can select individual items. First, observers performed a tracking task at many viewing distances. When the display subtended less than 1 degrees in size, tracking was no longer possible even though observers could resolve the items and their motions: The items were visible but could not be individuated one from the other. The limiting size for selection was roughly the same whether tracking one or three targets, suggesting that the resolution limit acts independently of the capacity limit of attention. Second, the closest spacing that still allowed individuation of single items in dense, static displays was examined. This critical spacing was about 50% coarser in the radial direction compared to the tangential direction and was coarser in the upper as opposed to the lower visual field. The results suggest that no more than about 60 items can be arrayed in the central 30 degrees of the visual field while still allowing attentional access to each individually. Our data show that selection has a coarse grain, much coarser than visual resolution. These measures of the resolution of attention are based solely on the selection of location and are not confounded with preattentive feature interactions that may contribute to measures from flanker and crowding tasks. The results suggest that the parietal area is the most likely locus of this selection mechanism and that it acts by pointing to the spatial coordinates (or cortical coordinates) of items of interest rather than by holding a representation of the items themselves.     

Biases of spatial attention in vision and audition

Neurologically normal observers misperceive the midpoint of horizontal lines as systematically leftward of veridical center, a phenomenon known as pseudoneglect. Pseudoneglect is attributed to a tonic asymmetry of visuospatial attention favoring left hemispace. Whereas visuospatial attention is biased toward left hemispace, some evidence suggests that audiospatial attention may possess a right hemispatial bias. If spatial attention is supramodal, then the leftward bias observed in visual line bisection should also be expressed in auditory bisection tasks. If spatial attention is modality specific then bisection errors in visual and auditory spatial judgments are potentially dissociable. Subjects performed a bisection task for spatial intervals defined by auditory stimuli, as well as a tachistoscopic visual line bisection task. Subjects showed a significant leftward bias in the visual line bisection task and a significant rightward bias in the auditory interval bisection task. Performance across both tasks was, however, significantly positively correlated. These results imply the existence of both modality specific and supramodal attentional mechanisms where visuospatial attention has a prepotent leftward vector and audiospatial attention has a prepotent rightward vector of attention. In addition, the biases of both visuospatial and audiospatial attention are correlated.     

Integration of spatial information across vision and language

Three experiments investigated whether spatial information acquired from vision and language is maintained in distinct spatial representations on the basis of the input modality. Participants studied a visual and a verbal layout of objects at different times from either the same (Experiments 1 and 2) or different learning perspectives (Experiment 3) and then carried out a series of pointing judgments involving objects from the same or different layouts. Results from Experiments 1 and 2 indicated that participants pointed equally fast on within- and between-layout trials; coupled with verbal reports from participants, this result suggests that they integrated all locations in a single spatial representation during encoding. However, when learning took place from different perspectives in Experiment 3, participants were faster to respond to within- than between-layout trials and indicated that they kept separate representations during learning. Results are compared to those from similar studies that involved layouts learned from perception only.     

Hand position alters vision by biasing processing through different visual pathways

The present study investigated the mechanisms responsible for the difference between visual processing of stimuli near and far from the observer's hands. The idea that objects near the hands are immediate candidates for action led us to hypothesize that vision near the hands would be biased toward the action-oriented magnocellular visual pathway that supports processing with high temporal resolution but low spatial resolution. Conversely, objects away from the hands are not immediate candidates for action and, therefore, would benefit from a bias toward the perception-oriented parvocellular visual pathway that supports processing with high spatial resolution but low temporal resolution. We tested this hypothesis based on the psychophysical characteristics of the two pathways. Namely, we presented subjects with two tasks: a temporal-gap detection task which required the high temporal acuity of the magnocellular pathway and a spatial-gap detection task that required the spatial acuity of the parvocellular pathway. Consistent with our prediction, we found better performance on the temporal-gap detection task and worse performance on the spatial-gap detection task when stimuli were presented near the hands compared to when they were far from the hands. These findings suggest that altered visual processing near the hands may be due to changes in the contribution of the two visual pathways.     

Peripheral vision benefits spatial learning by guiding eye movements

The loss of peripheral vision impairs spatial learning and navigation. However, the mechanisms underlying these impairments remain poorly understood. One advantage of having peripheral vision is that objects in an environment are easily detected and readily foveated via eye movements. The present study examined this potential benefit of peripheral vision by investigating whether competent performance in spatial learning requires effective eye movements. In Experiment 1, participants learned room-sized spatial layouts with or without restriction on direct eye movements to objects. Eye movements were restricted by having participants view the objects through small apertures in front of their eyes. Results showed that impeding effective eye movements made subsequent retrieval of spatial memory slower and less accurate. The small apertures also occluded much of the environmental surroundings, but the importance of this kind of occlusion was ruled out in Experiment 2 by showing that participants exhibited intact learning of the same spatial layouts when luminescent objects were viewed in an otherwise dark room. Together, these findings suggest that one of the roles of peripheral vision in spatial learning is to guide eye movements, highlighting the importance of spatial information derived from eye movements for learning environmental layouts.     

Image reconstruction and Gestalt formation in human spatial vision

A sampling theoretical and experimental framework for the study of spatial vision is introduced. It is suggested that spatial Gestalt perception can be fruitfully analyzed by applying the concepts and methods of modern spatial filtering theory as they are known in the theory of image sampling and reconstruction. Demonstrations of the sampling processes in spatial vision are given and an experimental method for estimating the spatial reconstruction power of the human visual system is described. The experimental results presented suggest that high spatial frequency information has a special significance for human vision. Evidently, high frequency information is transmitted more easily through the visual system than has been generally assumed on the basis of contrast sensitivity studies.     

Learning directions of objects specified by vision,spatial audition,or auditory spatial language

The modality by which object azimuths (directions) are presented affects learning of multiple locations. In Experiment 1, participants learned sets of three and five object azimuths specified by a visual virtual environment, spatial audition (3D sound), or auditory spatial language. Five azimuths were learned faster when specified by spatial modalities (vision, audition) than by language. Experiment 2 equated the modalities for proprioceptive cues and eliminated spatial cues unique to vision (optic flow) and audition (differential binaural signals). There remained a learning disadvantage for spatial language. We attribute this result to the cost of indirect processing from words to spatial representations.     

Motor coordination uses external spatial coordinates independent of developmental vision

The constraints that guide bimanual movement coordination are informative about the processing principles underlying movement planning in humans. For example, symmetry relative to the body midline benefits finger and hand movements independent of hand posture. This symmetry constraint has been interpreted to indicate that movement coordination is guided by a perceptual code. Although it has been assumed implicitly that the perceptual system at the heart of this constraint is vision, this relationship has not been tested. Here, congenitally blind and sighted participants made symmetrical and non-symmetrical (that is, parallel) bimanual tapping and finger oscillation movements. For both groups, symmetrical movements were executed more correctly than parallel movements, independent of anatomical constraints like finger homology and hand posture. For the blind, the reliance on external spatial factors in movement coordination stands in stark contrast to their use of an anatomical reference frame in perceptual processing. Thus, the externally coded symmetry constraint evident in bimanual coordination can develop in the absence of the visual system, suggesting that the visual system is not critical for the establishment of an external-spatial reference frame in movement coordination.     

How attention enhances spatial resolution: evidence from selective adaptation to spatial frequency

In this study, we investigated how spatial resolution and covert attention affect performance in a texture segmentation task in which performance peaks at midperiphery and drops at peripheral and central retinal locations. The central impairment is called the central performance drop (CPD; Kehrer, 1989). It has been established that attending to the target location improves performance in the periphery where resolution is too low for the task, but impairs it at central locations where resolution is too high. This is called the central attention impairment (CAI; Yeshurun & Carrasco, 1998, 2000). We employed a cuing procedure in conjunction with selective adaptation to explore (1) whether the CPD is due to the inhibition of low spatial frequency responses by high spatial frequency responses in central locations, and (2) whether the CAI is due to attention's shifting sensitivity to higher spatial frequencies. We found that adaptation to low spatial frequencies does not change performance in this texture segmentation task. However, adaptation to high spatial frequencies diminishes the CPD and eliminates the CAI. These results indicate that the CPD is primarily due to the dominance of high spatial frequency responses and that covert attention enhances spatial resolution by shifting sensitivity to higher spatial frequencies.     

The role of vision in the temporal and spatial control of handwriting.

The general observation that handwriting is not noticeably impaired by the withdrawal of vision can be explained in two ways. One might argue that vision is not needed during the act of writing. Micro-analyses should then reveal that spatial as well as temporal writing features are identical in conditions of vision and no vision. Alternatively, it is possible that vision is needed during the act of writing, but that without vision possible errors and inaccuracies have to be prevented. Assuming that the latter would place an extra demand on movement control, this should be revealed by an increase in processing time. We have found evidence for the latter view in the present study in which 12 subjects wrote a nonsense letter sequence with and without vision. Close examination showed that writing shapes remained equally invariant under both vision conditions, suggesting that spatial control was unaffected by withdrawing vision. The prediction that invariance of shapes is preserved in the absence of vision at the expense of processing time increments was confirmed. The increase of reaction time observed when visual guidance was withdrawn suggests that more processing time was needed prior to the movement start. Moreover, the RT increment was larger when a short writing duration was instructed. The present findings will be discussed in light of the remarkable flexibility of writing as a motor skill in which writers appear to be able to employ specific strategies to preserve shape in the absence of visual guidance.