A sensorimotor account of vision and visual consciousness

Many current neurophysiological, psychophysical, and psychological approaches to vision rest on the idea that when we see, the brain produces an internal representation of the world. The activation of this internal representation is assumed to give rise to the experience of seeing. The problem with this kind of approach is that it leaves unexplained how the existence of such a detailed internal representation might produce visual consciousness. An alternative proposal is made here. We propose that seeing is a way of acting. It is a particular way of exploring the environment. Activity in internal representations does not generate the experience of seeing. The outside world serves as its own, external, representation. The experience of seeing occurs when the organism masters what we call the governing laws of sensorimotor contingency. The advantage of this approach is that it provides a natural and principled way of accounting for visual consciousness, and for the differences in the perceived quality of sensory experience in the different sensory modalities. Several lines of empirical evidence are brought forward in support of the theory, in particular: evidence from experiments in sensorimotor adaptation, visual "filling in," visual stability despite eye movements, change blindness, sensory substitution, and color perception.     

Action influences spatial perception: Neuropsychological evidence

We present neuropsychological evidence indicating that action influences spatial perception. First, we review evidence indicating that actions using a tool can modulate unilateral visual neglect and extinction, where patients are unaware of stimuli presented on one side of space. We show that, at least for some patients, modulation comes about through a combination of visual and motor cueing of attention to the affected side (Experiment 1). Subsequently, we review evidence that action‐relations between stimuli reduce visual extinction; there is less extinction when stimuli fall in the correct colocations for action relative to when they fall in the incorrect relations for action and relative to when stimuli are just associatively related. Finally, we demonstrate that action relations between stimuli can also influence the binding of objects to space, in a patient with Balint's syndrome (Experiment 2). These neuropsychological data indicate that perception–action couplings can be crucial to our conscious representation of space.     

Neuropsychological dissociations between priming and recognition: a single-system connectionist account

A key claim of current theoretical analyses of the memory impairments associated with amnesia is that certain distinct forms of learning and memory are spared. A compelling example is that amnesic patients and controls are indistinguishable in repetition priming but amnesic patients are impaired at recognizing the study items. The authors show that this pattern of results is predicted by a single-system connectionist model of learning in which amnesia is simulated by a reduced learning rate. They also demonstrate that the model can reproduce the converse pattern in which priming but not recognition is impaired if the input is assumed to be additionally degraded in a priming test. The authors conclude that dissociations between priming and recognition do not require functionally or neurally distinct memory systems.     

A test of the sensorimotor account of vision and visual perception

Two theories define the relationship between sensory experience and perception of location. The doctrine of specific nerve energies relies on hard-wired, genetically specified relationships between stimulation and perception, modifiable only within limits by adaptation. In a newer sensorimotor account, experience tunes the relationship between stimulation and perception. The perception of pressure phosphenes can differentiate the two theories, because the phosphene appears at a location predicted by physiological optics and in a modality predicted by specific nerve energies. Moving a finger vertically along the outer orbit of the eye while pressing gently on it through the lid during nasally directed gaze results in apparent motion of the phosphene out of phase with the finger, therefore in contradiction to information from motor efference to the finger, tactile sense at the fingertip, eyelid and bulb, joint receptors, and proprioception from muscles driving the finger. A test of the sensorimotor theory giving it every advantage had six observers in darkness moving their fingers along the eye and observing phosphenes for 1 h and 2400 motion cycles; the phosphene always obeyed the doctrine of specific nerve energies, never adapting or changing modality as the sensorimotor theory predicts.     

A computational account of deep dysphasia: evidence from a single case study.

We present a case study of a patient, NC, who demonstrates the defining characteristics of deep dysphasia including semantic errors in repetition and an inability to repeat nonwords. In addition, NC's single word repetition and lexical decision performances are influenced by the imageability of the word input. NC also demonstrates a severely restricted phonological short-term memory (one digit, one word). Although his phonological discrimination is good in a minimal pairs judgment task, it becomes impaired when a delay is imposed or rehearsal is prevented between presentation of each member of a pair. NC's output is fluent but contains many formal paraphasias and neologisms. NC's total language profile is evaluated within the framework of Dell's (1986) interactive spreading activation model of language production. Adapting this output model to input processes, we account for all of NC's deep dysphasic symptoms as well as his pattern of production in a way that is more parsimonious than other attempts to model this disorder. In particular, we suggest that the semantic and formal paraphasias in naming and repetition result from a pathological increase in the rate of decay of primed nodes in the semantic-lexical-phonological network. This rapid decay increases the probability that phonologically and/or semantically related lexical nodes primed by top-down and bottom-up feedback during the operation of lexical activation and retrieval will be activated and selected instead of the lexical target. The advantages of using this model to account for aphasic symptoms and the implications for other lexical theories are discussed.     

Brain lateralization of complex movement: Neuropsychological evidence from unilateral stroke

Complex movement (CM) refers to the representation of a goal-oriented action and is classified as either transitive (use of tools) or intransitive (communication gestures). Both types of CM have three specific components: temporal, spatial, and content, which are subdivided into specific error types (SET). Since there is debate regarding the contribution of each brain hemisphere for the types of CM, our objective was to describe the brain lateralization of components and SET of transitive and intransitive CM. We studied 14 patients with a left hemisphere stroke (LH), 12 patients with a right hemisphere stroke (RH), and 16 control subjects. The Florida Apraxia Screening Test-Revised (FAST-R, Rothi et al., 1988) was used for the assessment of CM. Both clinical groups showed a worse performance than the control group on the total FAST-R and transitive movement scores (p < 0.001). Failures in Spatial and Temporal components were found in both clinical groups, but only LH patients showed significantly more Content errors (p < 0.01) than the control group. Also, only the LH group showed a higher number of errors for intransitive movements score (p = 0.017), due to lower scores in the content component, compared to the control group (p = 0.04). Transitive and intransitive CMs differ in their neurocognitive representation; transitive CM shows a bilateral distribution of its components when compared to intransitive CM, which shows a preferential left hemisphere representation. This could result from higher neurocognitive demands for movements that require use of tools, compared with more automatic communication gestures.     

Neuropsychological evidence for case-specific reading: Multi-letter units in visual word recognition

We describe a patient (GK) who shows symptoms associated with Balint's syndrome and attentional dyslexia. GK was able to read words, but not nonwords. He also made many misidentification and mislocation errors when reporting letters in words, suggesting that his word-naming ability did not depend upon preserved position-coded, letter identification. We show that GK was able to read lower-case words better than upper-case words, but upper-case abbreviations better than lower-case abbreviations. Spacing the letters in abbreviations disrupted identification, as did mixing the case of letters within words. These data cannot be explained in terms of letter-based reading or preserved holistic word recognition. We propose that GK was sensitive to the visual familiarity of adjacent letter forms.     

A holistic account of the own-race effect in face recognition: evidence from a cross-cultural study

A robust finding in the cross-cultural research is that people's memories for faces of their own race are superior to their memories for other-race faces. However, the mechanisms underlying the own-race effect have not been well defined. In this study, a holistic explanation was examined in which Caucasian and Asian participants were asked to recognize features of Caucasian and Asian faces presented in isolation and in the whole face. The main finding was that Caucasian participants recognized own-race faces more holistically than Asian faces whereas Asian participants demonstrated holistic recognition for both own-race and other-race faces. The differences in holistic recognition between Caucasian and Asian participants mirrored differences in their relative experience with own-race and other-race faces. These results suggest that the own-race effect may arise from the holistic recognition of faces from a highly familiar racial group.     

Mutual inhibition in collaborative recall: evidence for a retrieval-based account

In Experiment 1 participants gave 3 successive free recalls of items learned either individually or in pairwise collaboration. The first and third recalls were performed individually, the second alone or in collaboration. Collaborative recall led to an inhibitory effect after individual learning but not after collaborative learning, in which partners had similar retrieval strategies. Consistent with a retrieval locus for collaborative inhibition, non-recalled items reappeared in subsequent individual recall. Experiment 2 showed that collaborative inhibition was eliminated when a separate retrieval cue was given for each item. Experiments 2 and 3 also showed that when participants learned items in the same order, their retrieval strategies were more similar and they showed less collaborative inhibition. It is concluded that mutual interference in collaborative recall is due to the mutual disruption of individual retrieval strategies.     

Aging neuromodulation impairs associative binding: a neurocomputational account

Relative to young adults, older adults are particularly impaired in episodic memory tasks requiring associative binding of separate components into compound episodes, such as tasks requiring item-context and item-item binding. This associative-binding deficit has been attributed to senescent changes in frontal-hippocampal circuitry but has not been formally linked to impaired neuromodulation involving this circuitry. Previous neurocomputational work showed that impaired neuromodulation could result in less distinct neurocognitive representations. Here we extend this computational principle to simulate aging-related deficits in associative binding. As expected, networks with simulated deficiency in neuromodulation resulted in less distinct internal representations than did networks simulating the processing and performance of young adults, and were also more impaired under task conditions that required associative binding. The findings suggest that senescent changes in neuromodulatory mechanisms may play a basic role in aging-related impairment in associative binding by reducing the efficacy of distributed conjunctive coding.     

Adaptive filtering in spatial vision: evidence from feature marking in plaids

Much evidence shows that early vision employs an array of spatial filters tuned for different spatial frequencies and orientations. We suggest that for moderately low spatial frequencies these preliminary filters are not treated independently, but are used to perform grouping and segmentation in the patchwise Fourier domain. For example, consider a stationary plaid made from two superimposed sinusoidal gratings of the same contrast and spatial frequency oriented +/- 45 degrees from vertical. Most of the energy in a wavelet-like (e.g. simple-cell) transform of this stimulus is in the oblique orientations, but typically it looks like a compound structure containing blurred vertical and horizontal edges. This checkerboard structure corresponds with the locations of zero crossings in the output of an isotropic (circular) filter, synthesised from the linear sum of a set of oriented basis-filters (Georgeson, 1992 Proceedings of the Royal Society of London, Series B 249 235-245). However, the addition of a third harmonic in square-wave phase causes almost complete perceptual segmentation of the plaid into two overlapping oblique gratings. Here we confirm this result psychophysically using a feature-marking technique, and argue that this perceptual segmentation cannot be understood in terms of the zero crossings marked in the output of any static linear filter that is sensitive to all of the plaid's components. If it is assumed that zero crossings or similar are an appropriate feature-primitive in human vision, our results require a flexible process that combines and segments early basis-filters according to prevailing image conditions. Thus, we suggest that combination and segmentation of spatial filters in the patchwise Fourier domain underpins the perceptual segmentation observed in our experiments. Under this kind of image-processing scheme, registration across spatial scales occurs at the level of spatial filters, before features are extracted. This contrasts with many previous schemes where feature correspondence is required between spatial edge-maps at different spatial scales.     

Motivation and Personality: A Neuropsychological Perspective

Personality is strongly influenced by motivation systems that organise responses to rewards and punishments and that drive approach and avoidance behavior. Neuropsychological research has identified: (a) two avoidance systems, one related to pure active avoidance and escape, and one to passive avoidance and behavioral inhibition produced by goal‐conflict; and (b) two approach systems, one related to the actions of reward seeking and one to experience and behavior related to pleasure on receiving reward. These systems mediate fluid moment‐by‐moment reactions to changing stimuli, with relatively stable person‐specific sensitivities to these stimuli manifested in personality traits. We review what is known about these motivational traits, integrating the theory‐driven approach based on animal learning paradigms with the empirical tradition of the Big Five personality model.     

Neuropsychological evidence for "word-meaning deafness" in a Spanish-speaking patient

In this paper we present a case of "word-meaning deafness," characterised by serious problems in the comprehension of spoken language, whilst repetition and writing words and non-words from dictation are preserved. This performance indicates the impossibility of correctly accessing phonological representation from the semantic representation of words. Neuropsychological evidence on specific alterations in word-meaning disorders is scarce, and this study contributes new findings with a Spanish-speaking patient. The nature of the processes involved in understanding language and the cerebral mechanisms that might be affected in each case were discussed, in accordance with current neuropsychological theories.     

Mechanisms of percept-percept and image-percept integration in vision: behavioral and electrophysiological evidence

Previous research has shown that the detection of a visual target can be guided not only by the temporal integration of two percepts, but also by integrating a percept and an image held in working memory. Behavioral and event-related brain potential (ERP) measures were obtained in a target detection task that required temporal integration of 2 successively presented stimuli in the left or right hemifield. Task performance was good when both displays followed each other immediately (percept-percept integration) and when displays were separated by a 300- or 900-ms interval (image-percept integration), but was poor with intermediate interstimulus intervals. An enhanced posterior negativity at electrodes contralateral to the side of the target was observed for percept-percept and for image-percept integration, demonstrating that both are based on spatiotopic representations. However, this contralateral negativity emerged later and was more sustained on trials with long interstimulus intervals, indicating that image-percept integration is slower and involves a sustained activation of working memory.     

Neuropsychological findings in two children diagnosed with hamartoses: evidence of a NLD phenotypic profile.

Hamartoses (HM) are defined as disorders involving nonneoplastic tissue overgrowth. Studies have examined the neuropsychological profiles of children with common HM, such as neurofibromatosis type 1. Limited information is known regarding neuropsychological profiles of rare HM such as Osteochondromatosis Syndrome (OS) and Klippel-Trenaunay Syndrome (KTS). The current investigation is, to our knowledge, the first attempt to define the cognitive phenotypes in two boys with OS and KTS. Results revealed significantly greater impairments involving sensorimotor and visuospatial skills, while verbal memory and language skills appeared relatively preserved. Significant neurobehavioral problems and marked social difficulties were evident. These findings suggest that these syndromes are on a Nonverbal Learning Disorder (NLD) continuum, with varying degrees of severity.