Visual object agnosia without prosopagnosia or alexia: Evidence for hierarchical theories of visual recognition

Abstract

A single case study is presented of a patient, Mr. W, with a selective deficit in recognizing pictures and real objects, linked to impaired stored visual knowledge about objects. Despite this, Mr. W maintained a preserved ability both to read aloud printed words and to recognize famous faces, when compared with age-matched control subjects. In addition, his access to semantic information from words was superior to that from pictures. The data provide evidence that visual agnosia can occur without alexia or prosopagnosia, contrary to recent proposals (Farah 1990, 1991). This finding is consistent with a hierarchical model of visual object recognition in which agnosia can reflect impaired stored knowledge of objects without accompanying perceptual deficits. The selective recognition deficit for objects further indicates that stored knowledge concerning different classes of visual stimuli (common objects, faces, and words) is separately represented in the brain.     

Prosopagnosia and visual object agnosia: A behavioral study

A left-handed woman developed visual object agnosia, prosopagnosia, and visual disorientation after resection of the right occipital lobe. Color agnosia and alexia were absent. When asked to identify objects presented visually, the patient's errors represented visually related objects (underspecifications) or perseverations. Identification was facilitated when she observed the object being used in a natural way. Identification was impaired by surrounding the object with unrelated objects, decreasing the background illumination, decreasing the duration of exposure of the object to the patient, and probably also by decreasing the visual angle subtended by the object. In addition, there were disturbances of visualization (i.e., imaging in the absence of a visual stimulus) that paralleled the perceptual difficulties. We conclude that: (1) A deficit in visual perception, characterized by insufficient feature analysis of visual stimuli, was the basis of the visual agnosia in this case. (2) The visual agnosia could not be explained by (a) a vision-language disconnection syndrome, (b) decay of visual memory traces, or (c) deficiencies in the visual fields (pathologic Funktionswandel). (3) The ability to visualize (visual imagery) probably utilizes some of the same neural pathways used in perception. (4) The results in this case probably can be generalized to some but not all cases of visual agnosia; in particular, the deficit in most previously reported patients with prosopagnosia is similar to that of our case. However, agnosic alexia and color agnosia usually have a different neuropsychological basis.     

Shape Integration for Visual Object Recognition and Its Implication in Category-Specific Visual Agnosia

A series of experiments was conducted on a patient (ELM) with bilateral inferior temporal lobe damage and category-specific visual agnosia in order to specify the nature of his functional impairment. In Experiment 1, ELM performed a task of picture/word matching that used line drawings of fruits and vegetables as stimuli. The pattern of confusions exhibited by the patient suggested a failure in processing the full range of shape features necessary for the unique specification of the target relative to other structurally related items. This hypothesis of a shape integration impairment was tested and verified by subsequent visual recognition experiments (Experiments 2-4), which used synthetic stimuli with shapes precisely defined on the dimensions of elongation, curvature, and tapering. Furthermore, it was determined (Experiment 5) that the integration deficit is specific to the retrieval of shape knowledge from memory and does not affect the encoding of the properties of visual stimuli. It is argued that these findings have critical implications for cognitive theories of visual object recognition and for an interpretation of the visual function of the inferior temporal cortex. Finally, it was shown that the patient's deficit for structural knowledge integration is modulated by the semantic properties of the objects (Experiment 6), thereby demonstrating the applicability of the present findings to an explanation of category-specific visual agnosia.     

Optic aphasia, optic apraxia, and loss of dreaming

A 47-year-old man with a left temporo-occipital infarct in the area of the posterior cerebral artery is presented. The neuropsychological examination did not reveal aphasia or gross mental deficits. The patient presented with alexia without agraphia, color agnosia, but few visual perceptual deficits. The main impairment was in confrontation naming; he was incapable of naming objects and pictures, not from lack of recognition (excluding visual agnosia) but from lack of access to the appropriate word (optic aphasia). The patient also exhibited a deficit in the evocation of gesture from the visual presentation of an object (optic apraxia) and a difficulty in "conjuring up" visual images of objects (impaired visual imagery) and loss of dreams. The fundamental deficit of this patient is tentatively explained in terms of visuoverbal and visuogestural disconnection and a deficit of mental imagery.     

Dissociation between the mental rotation of visual images and motor images in unilateral brain-damaged patients

Deficits in the mental rotation of body parts and of external objects can be doubly dissociated (Rumiati, Tomasino, Vorano, Umiltà, & De Luce, 2001; Sirigu & Duhamel, 2001; Tomasino, Rumiati, & Umità, in press). The aim of this study was to replicate this finding and to then investigate the relevance of the specific hemispheres in these deficits. Nine patients with unilateral lesions (five in the Left Hemisphere and four in the Right) and 20 control subjects, performed a single task requiring mental rotation of hands, and two tasks requiring mental rotation of external objects. RH patients were impaired in the rotation of external objects, but showed intact performance on the rotation of hands; the opposite pattern was found for LH patients. These results support the view that the LH contributes to the mental rotation of hands, recruiting processes specific to motor preparation, while the RH is specialized for mental rotation of external objects.     

Animals and artifacts may not be treated equally: differentiating strong and weak forms of category-specific visual agnosia

We examined a categorical dissociation hypothesis of category-specific agnosia using hierarchical regression to predict the naming responses of three agnosia patients while controlling a wide variety of perceptual and conceptual between-category differences. The living-nonliving distinction remained a significant predictor for two of the patients after controlling for all the other factors. For one remaining patient, the categorical variable was not significant once the form-function correlation of different objects was controlled. We argue that the visual system may use various subprocesses at different stages, some of which reflect true categorical organization and some of which reflect a unitary feature-based system that distinguishes kinds.     

Impaired drawing from memory in a visual agnosic patient

A case is reported of an associative visual agnosic patient who could not draw from memory objects he could recognize, even though he could copy drawings flawlessly. His ability to generate mental visual images was found to be spared, as was his ability to operate upon mental images. These data suggest that the patient could generate mental images but could not draw from memory because he did not have access to stored knowledge about pictorial attributes of objects. A similar functional impairment can be found in some other visual agnosic patients and in patients affected by optic aphasia. The present case allows a discussion of relationships among drawing from memory, imagery, and copying procedures.     

Object Recognition Difficulty in Visual Apperceptive Agnosia

Two patients with visual apperceptive agnosia were examined on tasks assessing the appreciation of visual material. Elementary visual functioning was relatively preserved, but they had profound difficulty recognizing and naming line drawings. More detailed evaluation revealed accurate recognition of regular geometric shapes and colors, but performance deteriorated when the shapes were made more complex visually, when multiple-choice arrays contained larger numbers of simple targets and foils, and when a mental manipulation such as a rotation was required. The recognition of letters and words was similarly compromised. Naming, recognition, and anomaly judgments of colored pictures and real objects were more accurate than similar decisions involving black-and-white line drawings. Visual imagery for shapes, letters, and objects appeared to be more accurate than visual perception of the same materials. We hypothesize that object recognition difficulty in visual apperceptive agnosia is due to two related factors: the impaired appreciation of the visual perceptual features that constitute objects, and a limitation in the cognitive resources that are available for processing demanding material within the visual modality.     

Naming without knowing and appearance without associations: Evidence for constructive processes in semantic memory?

Abstract

This study describes a patient (SE) with temporal lobe injury resulting from Herpes Simplex Encephalitis, who displayed a previously unreported impairment in which his knowledge of associative and functional attributes of animals was disproportionately impaired by comparison with his knowledge of their sensory attributes (including their visual properties and characteristic sounds). His knowledge of man-made objects was preserved. A striking aspect of the present case was that the patient remained able to name many animals from their pictures, despite making gross errors in generating associative information about these same animals. This suggests that a semantic representation incorporating stored sensory knowledge may be sufficient for naming (at least for biological categories) and associative information may be unnecessary. Semantic knowledge may normally incorporate more information than is necessary for identification. SE's errors were found to be confabulatory and reconstructive in nature and it is argued that this aspect of his performance challenges passive conceptions of semantic memory couched in terms of a catalogue of stored representations. It is proposed that the patient's disorder affects a dynamic, constructive, and inferential component of his knowledge base, and that this component is sensitive to semantic category.     

Looking at anything that is green when hearing “frog”: How object surface colour and stored object colour knowledge influence language-mediated overt attention

Three eye-tracking experiments investigated the influence of stored colour knowledge, perceived surface colour, and conceptual category of visual objects on language-mediated overt attention. Participants heard spoken target words whose concepts are associated with a diagnostic colour (e.g., “spinach”; spinach is typically green) while their eye movements were monitored to (a) objects associated with a diagnostic colour but presented in black and white (e.g., a black-and-white line drawing of a frog), (b) objects associated with a diagnostic colour but presented in an appropriate but atypical colour (e.g., a colour photograph of a yellow frog), and (c) objects not associated with a diagnostic colour but presented in the diagnostic colour of the target concept (e.g., a green blouse; blouses are not typically green). We observed that colour-mediated shifts in overt attention are primarily due to the perceived surface attributes of the visual objects rather than stored knowledge about the typical colour of the object. In addition our data reveal that conceptual category information is the primary determinant of overt attention if both conceptual category and surface colour competitors are copresent in the visual environment.     

Visual search for object orientation can be modulated by canonical orientation

The authors studied the influence of canonical orientation on visual search for object orientation. Displays consisted of pictures of animals whose axis of elongation was either vertical or tilted in their canonical orientation. Target orientation could be either congruent or incongruent with the object's canonical orientation. In Experiment 1, vertical canonical targets were detected faster when they were tilted (incongruent) than when they were vertical (congruent). This search asymmetry was reversed for tilted canonical targets. The effect of canonical orientation was partially preserved when objects were high-pass filtered, but it was eliminated when they were low-pass filtered, rendering them as unfamiliar shapes (Experiment 2). The effect of canonical orientation was also eliminated by inverting the objects (Experiment 3) and in a patient with visual agnosia (Experiment 4). These results indicate that orientation search with familiar objects can be modulated by canonical orientation, and they indicate a top-down influence on orientation processing.     

Hierarchies, similarity, and interactivity in object recognition: "category-specific" neuropsychological deficits.

Category-specific impairments of object recognition and naming are among the most intriguing disorders in neuropsychology, affecting the retrieval of knowledge about either living or nonliving things. They can give us insight into the nature of our representations of objects: Have we evolved different neural systems for recognizing different categories of object? What kinds of knowledge are important for recognizing particular objects? How does visual similarity within a category influence object recognition and representation? What is the nature of our semantic knowledge about different objects? We review the evidence on category-specific impairments, arguing that deficits even for one class of object (e.g., living things) cannot be accounted for in terms of a single information processing disorder across all patients; problems arise at contrasting loci in different patients. The same apparent pattern of impairment can be produced by damage to different loci. According to a new processing framework for object recognition and naming, the hierarchical interactive theory (HIT), we have a hierarchy of highly interactive stored representations. HIT explains the variety of patients in terms of (1) lesions at different levels of processing and (2) different forms of stored knowledge used both for particular tasks and for particular categories of object.     

You’re looking for what? Comparing search for familiar,nameable objects to search for unfamiliar,novel objects

Searching for items in one’s environment often includes considerable reliance on semantic knowledge. The present study examines the importance of semantic information in visual and memory search, especially with respect to whether the items reside in long-term or working memory. In Experiment 1, participants engaged in hybrid visual memory search for items that were either highly familiar or novel. Importantly, the relatively large number of targets in this hybrid search task necessitated that targets be stored in some form of long-term memory. We found that search for familiar objects was more efficient than search for novel objects. In Experiment 2, we investigated search for familiar versus novel objects when the number of targets was low enough to be stored in working memory. We also manipulated how often participants in Experiment 2 were required to update their target (every trial vs. every block) in order to control for target templates that were stored in long-term memory as a result of repeated exposure over trials. We found no differences in search efficiency for familiar versus novel objects when templates were stored in working memory. Our results suggest that while semantic information may provide additional individuating features that are useful for object recognition in hybrid search, this information could be irrelevant or even distracting when searching for targets stored in working memory.     

The role of sensory-motor information in object recognition: evidence from category-specific visual agnosia

The role of sensory-motor representations in object recognition was investigated in experiments involving AD, a patient with mild visual agnosia who was impaired in the recognition of visually presented living as compared to non-living entities. AD named visually presented items for which sensory-motor information was available significantly more reliably than items for which such information was not available; this was true when all items were non-living. Naming of objects from their associated sound was normal. These data suggest that both information about object form computed in the ventral visual system as well as sensory-motor information specifying the manner of manipulation contribute to object recognition.     

Transport and use of common objects: Influence of weight on action planning

Internal knowledge and visual cues about object's weight play an important role in grasping and lifting objects. It has been shown that both visual cues and internal knowledge might influence movement kinematics and force production depending on action goal (use vs. transport). However, there is little evidence about weight's influence on action planning as reflected by initiation time. In the present study we investigated this issue. In Experiment 1, participants had to grasp light and heavy objects (without moving them) to either use or transport them. In Experiment 2 we asked another group of participants to actually use or transport the same objects. We observed that initiation times were faster for heavy objects than for light objects in both the transport and use tasks, but only in Experiment 2. Thus, weight influenced the planning of use and transport actions, only when the end-goal of the action was really achieved. These data are incompatible with the hypothesis that only use actions are supported by stored object's representations. They rather suggest that in some circumstances, depending of the end-goal of the action and the physical constraints the planning of both use and transport actions are based on stored object representation.     

Toddlers' language-mediated visual search: They need not have the words for it

Eye movements made by listeners during language-mediated visual search reveal a strong link between visual processing and conceptual processing. For example, upon hearing the word for a missing referent with a characteristic colour (e.g., “strawberry”), listeners tend to fixate a colour-matched distractor (e.g., a red plane) more than a colour-mismatched distractor (e.g., a yellow plane). We ask whether these shifts in visual attention are mediated by the retrieval of lexically stored colour labels. Do children who do not yet possess verbal labels for the colour attribute that spoken and viewed objects have in common exhibit language-mediated eye movements like those made by older children and adults? That is, do toddlers look at a red plane when hearing “strawberry”? We observed that 24-month-olds lacking colour term knowledge nonetheless recognized the perceptual–conceptual commonality between named and seen objects. This indicates that language-mediated visual search need not depend on stored labels for concepts.     

Superior single dimension relative to "exclusive or" categorization performance by a patient with category-specific visual agnosia: empirical data and an ALCOVE simulation

ELM, a patient with category-specific visual agnosia, was tested on a single-dimension categorization problem, and the "exclusive or" (XOR) categorization problem. Stimuli were computer-generated shapes in which exemplars within a shape set shared values across two visual dimensions (curvature and thickness). In single-dimension categorization only curvature was relevant, and ELM performed as well as normal participants. In the XOR problem, categorization depended on being able to extract from memory values on curvature AND thickness for each exemplar, and ELM was significantly impaired on this task. A computer simulation using ALCOVE (Kruschke, 1992) reproduced ELM's behavior by changing a single (specificity) parameter related to how easily proximate objects within a multidimensional shape space could be disambiguated.     

Potentiation of action by undetected affordant objects

The physical attributes of objects that are relevant to motor behaviour, or action, are referred to as affordances (Gibson, 1979). Recent evidence has shown that an object's affordance can potentiate an unrelated motor response even when there is no intention to respond to it (e.g., Tucker & Ellis, 1998). In the five experiments, we examined whether conscious perception of an affordance is necessary to produce motor priming by presenting images of affordant objects (e.g., hammer) under conditions which cause them to be undetectable: Brief masked exposure (BME) and attentional blink (AB). We successfully demonstrated that conscious perception is not necessary for an object's affordance to produce motor priming. Since these findings are consistent with the abilities/disabilities of patients with blindsight and visual form agnosia, it is possible that processing accomplished by the dorsal stream produced this effect, though more research is needed to confirm this assertion.     

Visual cognition influences early vision: the role of visual short-term memory in amodal completion

A partly occluded visual object is perceptually filled in behind the occluding surface, a process known as amodal completion or visual interpolation. Previous research focused on the image-based properties that lead to amodal completion. In the present experiments, we examined the role of a higher-level visual process-visual short-term memory (VSTM)-in amodal completion. We measured the degree of amodal completion by asking participants to perform an object-based attention task on occluded objects while maintaining either zero or four items in visual working memory. When no items were stored in VSTM, participants completed the occluded objects; when four items were stored in VSTM, amodal completion was halted (Experiment 1). These results were not caused by the influence of VSTM on object-based attention per se (Experiment 2) or by the specific location of to-be-remembered items (Experiment 3). Items held in VSTM interfere with amodal completion, which suggests that amodal completion may not be an informationally encapsulated process, but rather can be affected by high-level visual processes.