A DEVELOPMENTAL DEFICIT IN LOCALIZING OBJECTS FROM VISION

Abstract— We describe a college student, A. H., with a developmental deficit in determining the location of objects from vision. The deficit is selective in that (a) localization from auditory or tactile information is intact, (b) A H reports the identity of mislocalized objects accurately, (c) visual localization errors preserve certain parameters of the target location, and (d) visual localization is severely impaired under certain stimulus conditions, but nearly intact under other conditions. These results bear on the representation and processing of location information in the visual system, and also have implications for understanding developmental dyslexia.     

The many directions of time

Event duration perception is fundamental to cognitive functioning. Recent research has shown that localized sensory adaptation compresses perceived duration of brief visual events in the adapted location; however, there is disagreement on whether the source of these temporal distortions is cortical or pre-cortical. The current study reveals that spatially localized duration compression can also be direction contingent, in that duration compression is induced when adapting and test stimuli move in the same direction but not when they move in opposite directions. Because of its direction-contingent nature, the induced duration compression reported here is likely to be cortical in origin. A second experiment shows that the adaptation processes driving duration compression can occur at or beyond human cortical area MT+, a specialized motion center located upstream from primary visual cortex. The direction-specificity of these temporal mechanisms, in conjunction with earlier reports of pre-cortical temporal mechanisms driving duration perception, suggests that our encoding of subsecond event duration is driven by activity at multiple levels of processing.     

Patterns of interocular transfer of visuomotor coordination reveal differences in the representation of visual space

Acquisition and interocular transfer of adaptation to optical transformations of input were examined in strabismic and orthotropic subjects. Distinct patterns of behavior were displayed by three groups: strabismic alternating suppressors, strabismic and orthotropic constant suppressors, and orthotropes with normal binocularity of vision. It is suggested that these behaviors result from the way in which visual space is represented in each group, an outcome of the pattern of use of the eyes during early development. The conditions for modification of the representation of visual space appear to parallel those for initial acquisition.     

Haploscopic colour mixtures with and without contours in subjects with normal and disturbed binocular vision

Binocular mixtures of equiluminous components of different wavelengths were matched with additive monoptic mixtures of the same components. After a satisfactory match had been achieved, the luminance of each colour in the monoptic mixture was measured photometrically. After presentation of an orthogonal grating superimposed on the colour shown to one eye, the colour matching was repeated. The grating induced a strong dominance of the colour with which it was combined. Yet the uncontoured colour was not entirely suppressed, but contributed to the binocular colour to various degrees. In three subjects with anisometropic amblyopia in one eye the colour presented to the amblyopic eye contributed little or nothing to the haploscopic colour mixture, depending on the degree of amblyopia. This diminished contribution could not be enhanced by a grid. In three cases with strabismic amblyopia and in one case with strabismus alternans no haploscopic colour mixture effects could be demonstrated. The observations are discussed in the context of neurophysiological findings in the visual system of primates, and it is suggested that colour and contour are not transmitted through independent channels from the retina to the cortex.     

3-D vision and figure-ground separation by visual cortex

A neural network theory of three-dimensional (3-D) vision, called FACADE theory, is described. The theory proposes a solution of the classical figure-ground problem for biological vision. It does so by suggesting how boundary representations and surface representations are formed within a boundary contour system (BCS) and a feature contour system (FCS). The BCS and FCS interact reciprocally to form 3-D boundary and surface representations that are mutually consistent. Their interactions generate 3-D percepts wherein occluding and occluded object parts are separated, completed, and grouped. The theory clarifies how preattentive processes of 3-D perception and figure-ground separation interact reciprocally with attentive processes of spatial localization, object recognition, and visual search. A new theory of stereopsis is proposed that predicts how cells sensitive to multiple spatial frequencies, disparities, and orientations are combined by context-sensitive filtering, competition, and cooperation to form coherent BCS boundary segmentations. Several factors contribute to figure-ground pop-out, including: boundary contrast between spatially contiguous boundaries, whether due to scenic differences in luminance, color, spatial frequency, or disparity-partially ordered interactions from larger spatial scales and disparities to smaller scales and disparities; and surface filling-in restricted to regions surrounded by a connected boundary. Phenomena such as 3-D pop-out from a 2-D picture, Da Vinci stereopsis, 3-D neon color spreading, completion of partially occluded objects, and figure-ground reversals are analyzed. The BCS and FCS subsystems model aspects of how the two parvocellular cortical processing streams that join the lateral geniculate nucleus to prestriate cortical area V4 interact to generate a multiplexed representation of Form-And-Color-And-DEpth, orfacade, within area V4. Area V4 is suggested to support figure-ground separation and to interact with cortical mechanisms of spatial attention, attentive object learning, and visual search. Adaptive resonance theory (ART) mechanisms model aspects of how prestriate visual cortex interacts reciprocally with a visual object recognition system in inferotemporal (IT) cortex for purposes of attentive object learning and categorization. Object attention mechanisms of the What cortical processing stream through IT cortex are distinguished from spatial attention mechanisms of the Where cortical processing stream through parietal cortex. Parvocellular BCS and FCS signals interact with the model What stream. Parvocellular FCS and magnocellular motion BCS signals interact with the model Where stream. Reciprocal interactions between these visual, What, and Where mechanisms are used to discuss data about visual search and saccadic eye movements, including fast search of conjunctive targets, search of 3-D surfaces, selective search of like-colored targets, attentive tracking of multielement groupings, and recursive search of simultaneously presented targets.     

A continuous smooth map of space in the primary visual cortex of the common marmoset

We examined the fine-scale mapping of the visual world within the primary visual cortex of the marmoset monkey (Callithrix jacchus) using differential optical imaging. We stimulated two sets of complementary stripe-like locations in turn, subtracting them to generate the cortical representations of continuous bands of visual space. Rotating this stimulus configuration makes it possible to map different spatial axes within the primary visual cortex. In a similar manner, shifting the stimulated locations between trials makes it possible to map retinotopy at an even finer scale. Using these methods we found no evidence of any local anisotropies or distortions in the cortical representation of visual space. This is despite the fact that orientation preference is mapped in a discontinuous manner across the surface of marmoset V1. Overall, our results indicate that space is mapped in a continuous and smooth manner in the primary visual cortex of the common marmoset.     

Do deaf individuals see better?

The possibility that, following early auditory deprivation, the remaining senses such as vision are enhanced has been met with much excitement. However, deaf individuals exhibit both better and worse visual skills than hearing controls. We show that, when deafness is considered to the exclusion of other confounds, enhancements in visual cognition are noted. The changes are not, however, widespread but are selective, limited, as we propose, to those aspects of vision that are attentionally demanding and would normally benefit from auditory-visual convergence. The behavioral changes are accompanied by a reorganization of multisensory areas, ranging from higher-order cortex to early cortical areas, highlighting cross-modal interactions as a fundamental feature of brain organization and cognitive processing.     

Abnormal retinotopic representations in human visual cortex revealed by fMRI

The representation of the visual field in early visual areas is retinotopic. The point-to-point relationship on the retina is therefore maintained on the convoluted cortical surface. Functional magnetic resonance imaging (fMRI) has been able to demonstrate the retinotopic representation of the visual field in occipital cortex of normal subjects. Furthermore, visual areas that are retinotopic can be identified on computationally flattened cortical maps on the basis of positions of the vertical and horizontal meridians. Here, we investigate abnormal retinotopic representations in human visual cortex with fMRI. We present three case studies in which patients with visual disorders are investigated. We have tested a subject who only possesses operating rod photoreceptors. We find in this case that the cortex undergoes a remapping whereby regions that would normally represent central field locations now map more peripheral positions in the visual field: In a human albino we also find abnormal visual cortical activity. Monocular stimulation of each hemifield resulted in activations in the hemisphere contralateral to the stimulated eye. This is consistent with abnormal decussation at the optic chiasm in albinism. Finally, we report a case where a lesion to white matter has resulted in a lack of measurable activity in occipital cortex. The activity was absent for a small region of the visual field, which was found to correspond to the subject's field defect. The cases selected have been chosen to demonstrate the power of fMRI in identifying abnormalities in the cortical representations of the visual field in patients with visual dysfunction. Furthermore, the experiments are able to show how the cortex is capable of modifying the visual field representation in response to abnormal input.     

Ophthalmological problems of the premature infant

Preterm infants are more likely than term infants to have significant abnormalities of all parts of the visual system leading to reduced vision. The most common problem is retinopathy of prematurity (ROP). The frequency and severity of this disorder is inversely related to gestational age. Damage ranges from minor to catastrophic. Preterm infants also have higher rates of amblyopia, strabismus, refractive error, and cortical visual impairment. The later problem is largely associated with neonatal brain injury. Years later, these children may develop glaucoma and retinal detachments.     

Inter-hemispheric remapping between arm proprioception and vision of the hand is disrupted by single pulse TMS on the left parietal cortex

Parietal cortical areas are involved in sensori-motor transformations for their respective contralateral hemifield/body. When arms of the subjects are crossed while their gaze is fixed straight ahead, vision of the hand is processed by the hemisphere ipsilateral to the arm position and proprioception of the arm by the contralateral hemisphere. It induces interhemispheric transfer and remapping. Our objective was to investigate whether a single pulse TMS applied to the left parietal cortical area would disturb interhemispheric remapping in a similar case, and would increase a simple reaction time (RT) with respect to a control single pulse TMS applied to the frontal cortical area. Two LED were superimposed and located in front of the subjects on the saggital axis. Subjects were asked to carefully fixate on these LED during each trial. The lighting of the red LED was used as a warning signal. Following the green one was illuminated after a variable delay and served as a go-signal. The hand for the response was determined before the start of each trial. TMS was applied to the left parietal, the left frontal cortical areas, or not applied to the subject. Results revealed that: (1) Irrespective of its location, single pulse TMS induced a non-specific effect similar to a startle reflex and reduced RT substantially (15 ms on average) with respect to a control condition without TMS (mean value = 153 ms). (2) Irrespective of TMS, RT were shorter when the right or the left hand was positioned in the right visual hemi-field (i.e. normal and crossed positions respectively). (3) Finally, RT increased when single pulse TMS was applied to the left parietal area and when hands were crossed irrespective of which hand was used. We concluded that interhemispheric sensori-motor remapping was disrupted by a single pulse TMS that was applied to the left parietal cortex. This effect was also combined with some visual attention directed towards the hand located on the right visual hemi-field.     

The representation and perception of 3D space: Interactions between 2D location and depth

ABSTRACT

We live in a 3D world, and yet the majority of vision research is restricted to 2D phenomena, with depth research typically treated as a separate field. Here we ask whether 2D spatial information and depth information interact to form neural representations of 3D space, and if so, what are the perceptual implications? Using fMRI and behavioural methods, we reveal that human visual cortex gradually transitions from 2D to 3D spatial representations, with depth information emerging later along the visual hierarchy, and demonstrate that 2D location holds a fundamentally special place in early visual processing.     

Reduced visual acuity is mirrored in low vision imagery

Research has examined the nature of visual imagery in normally sighted and blind subjects, but not in those with low vision. Findings with normally sighted subjects suggest that imagery involves primary visual areas of the brain. Since the plasticity of visual cortex appears to be limited in adulthood, we might expect imagery of those with adult-onset low vision to be relatively unaffected by these losses. But if visual imagery is based on recent and current experience, we would expect images of those with low vision to share some properties of impaired visual perception. We examined key parameters of mental images reported by normally sighted subjects, compared to those with early- and late-onset low vision, and with a group of subjects with restricted visual fields using an imagery questionnaire. We found evidence that those with reduced visual acuity report the imagery distances of objects to be closer than those with normal acuity and also depict objects in imagery with lower resolution than those with normal visual acuity. We also found that all low vision groups, like the normally sighted, image objects at a substantially greater distance than when asked to place them at a distance that ‘just fits’ their imagery field (overflow distance). All low vision groups, like the normally sighted, showed evidence of a limited visual field for imagery, but our group with restricted visual fields did not differ from the other groups in this respect. We conclude that imagery of those with low vision is similar to that of those with normal vision in being dependent on the size of objects or features being imaged, but that it also reflects their reduced visual acuity. We found no evidence for a dependence on imagery of age of onset or number of years of vision impairment.     

The topography of training-induced visual field recovery: Perimetric maps and subjective representations

The cognitive representation of blind regions varies considerably between patients with vision loss and may influence compensatory behaviour and treatment motivation. We therefore measured “objective” visual field topography (perimetry) in 19 patients with postgeniculate visual system lesions and related this to the subjective scotoma representation as expressed by patients’ drawings of the defect and monitored changes of these measures during training-induced recovery of function. Blind regions were mostly adequately represented; however, central regions were overestimated and peripheral areas underestimated in size. Perimetric and subjective defect size decreased significantly during training. Again, training-induced visual field border shifts in central regions were larger in subjective than in perimetric maps but vice versa in the peripheral field. Thus, vision restoration therapy improves “objective” visual field size along with its cognitive representation. The subjective topography is shaped by the functional importance of visual field regions and is a function of cortical magnification, thus resembling the neural representation in visual cortex.     

Apparent Distortions in Photography and the Geometry of Visual Space

In this paper I contrast the geometric structure of phenomenal visual space with that of photographic images. I argue that topologically both are two-dimensional and that both involve central projections of scenes being depicted. However, I also argue that the metric structures of the spaces differ inasmuch as two types of “apparent distortions”—marginal distortion in wide-angle photography and close-up distortions—which occur in photography do not occur in the corresponding visual experiences. In particular, I argue that the absence of marginal distortions in vision is evidence for a holistic metric of visual space that is spherical, and that the absence of close-up distortions shows that the local metric structure possesses a dynamic variable curvature which is dependent upon the distance away of objects being viewed at a given time.     

The cortex in multidimensional space: where do cortical areas come from?

The concept of a cortical ‘area’ as a discrete phylogenetic, developmental and computational unit is evaluated. Evidence including the comparative organization of the forebrain in vertebrates, the organization of cortex in different mammals, the scaling of the areas of the isocortex in mammals, and the early molecular differentiation of the cortex all suggest a special status for the primary sensory cortical areas, particularly the visual cortex. Furthermore, the overlapping gradients of early molecular expression and the patterning of cortical structure and connectivity by thalamic input suggest a new view of cortical organization that is different from the traditional view of a developmentally mosaic cortex; this view proposes that distinct cortical areas arise combinatorily from the multiple overlapping processes imposed upon the developing cortex.     

Intact visual perceptual discrimination in humans in the absence of perirhinal cortex

While the role of the perirhinal cortex in declarative memory has been well established, it has been unclear whether the perirhinal cortex might serve an additional nonmnemonic role in visual perception. Evidence that the perirhinal cortex might be important for visual perception comes from a recent report that monkeys with perirhinal cortical lesions are impaired on difficult (but not on simple) visual discrimination tasks. We administered these same tasks to nine amnesic patients, including three severely impaired patients with complete damage to perirhinal cortex bilaterally (E.P., G.P., and G.T.). The patients performed all tasks as well as controls. We suggest that the function of perirhinal cortex as well as antero-lateral temporal cortex may differ between humans and monkeys.     

Visual awareness due to neuronal activities in subcortical structures: a proposal

It has been shown that visual awareness in the blind hemifield of hemianopic cats that have undergone unilateral ablations of visual cortex can be restored by sectioning the commissure of the superior colliculus or by destroying a portion of the substantia nigra contralateral to the cortical lesion (the Sprague effect). We propose that the visual awareness that is recovered is due to synchronized oscillatory activities in the superior colliculus ipsilateral to the cortical lesion. These oscillatory activities are normally partially suppressed by the inhibitory, GABAergic contralateral nigrotectal projection, and the destruction of the substantia nigra, or the sectioning of the collicular commissure, disinhibits the collicular neurons, causing an increase in the extent of oscillatory activity and/or synchronization between activities at different sites. This increase in the oscillatory and synchronized character is sufficient for the activities to give rise to visual awareness. We argue that in rodents and lower vertebrates, normal visual awareness is partly due to synchronized oscillatory activities in the optic tectum and partly due to similar activities in visual cortex. It is only in carnivores and primates that visual awareness is wholly due to cortical activities. Based on von Baerian recapitulation theory, we propose that, even in humans, there is a period in early infancy when visual awareness is partially due to activities in the superior colliculus, but that this awareness gradually disappears as the nigrotectal projection matures.     

Visual stimuli for strabismic suppression

The effects of orientation and spatial frequency of grating stimuli upon suppression were examined with a binocular rivalry paradigm in a group of ten strabismic patients and in a control normal group. Duration, frequency, and period of rivalry were examined as functions of differences in orientation and spatial frequency of dichoptic achromatic sinusoidal gratings. Records were made of responses by the sighting and by the nonsighting eye as well as responses during periods of combined binocular vision. Strabismic subjects reported normal binocular rivalry when presented with gratings of dissimilar orientation. Suppression of the deviating eye in strabismic subjects occurred with stimuli of similar orientation and was unaffected by spatial-frequency differences between dichoptic stimuli. Suppression was most intense under conditions that normally stimulate stereopsis and sensory fusion.     

Misperception of exocentric directions in auditory space

Previous studies have demonstrated large errors (over 30 degrees ) in visually perceived exocentric directions (the direction between two objects that are both displaced from the observer's location; e.g., Philbeck et al. [Philbeck, J. W., Sargent, J., Arthur, J. C., & Dopkins, S. (2008). Large manual pointing errors, but accurate verbal reports, for indications of target azimuth. Perception, 37, 511-534]). Here, we investigated whether a similar pattern occurs in auditory space. Blindfolded participants either attempted to aim a pointer at auditory targets (an exocentric task) or gave a verbal estimate of the egocentric target azimuth. Targets were located at 20-160 degrees azimuth in the right hemispace. For comparison, we also collected pointing and verbal judgments for visual targets. We found that exocentric pointing responses exhibited sizeable undershooting errors, for both auditory and visual targets, that tended to become more strongly negative as azimuth increased (up to -19 degrees for visual targets at 160 degrees ). Verbal estimates of the auditory and visual target azimuths, however, showed a dramatically different pattern, with relatively small overestimations of azimuths in the rear hemispace. At least some of the differences between verbal and pointing responses appear to be due to the frames of reference underlying the responses; when participants used the pointer to reproduce the egocentric target azimuth rather than the exocentric target direction relative to the pointer, the pattern of pointing errors more closely resembled that seen in verbal reports. These results show that there are similar distortions in perceiving exocentric directions in visual and auditory space.     

Contribution of acetylcholine to visual cortex plasticity

Acetylcholine is involved in a variety of brain functions. In the visual cortex, the pattern of cholinergic innervation varies considerably across different mammalian species and across different cortical layers within the same species. The physiological effects of acetylcholine in the visual cortex display complex responses, which are likely due to cholinergic receptor subtype composition in cytoplasm membrane as well as interaction with other transmitter systems within the local neural circuitry. The functional role of acetylcholine in visual cortex is believed to improve the signal-to-noise ratio of cortical neurons during visual information processing. Available evidence suggests that acetylcholine is also involved in experience-dependent visual cortex plasticity. At the level of synaptic transmission, activation of muscarinic receptors has been shown to play a permissive role in visual cortex plasticity. Among the muscarinic receptor subtypes, the M(1) receptor seems to make a predominant contribution towards modifications of neural circuitry. The signal transduction cascade of the cholinergic pathway may act synergistically with that of the NMDA receptor pathway, whose activation is a prerequisite for cortical plasticity.