Object recognition and Random Image Structure Evolution

We present a technique called Random Image Structure Evolution (RISE) for use in experimental investigations of high-level visual perception. Potential applications of RISE include the quantitative measurement of perceptual hysteresis and priming, the study of the neural substrates of object perception, and the assessment and detection of subtle forms of agnosia. In simple terms, RISE involves the measurement of perceptual and/or neural responses as visual stimuli are systematically transformed—in particular, as recognizable objects evolve from, then dissolve into, randomness. Points along the sequences corresponding to the onset and offset of subjects’ percepts serve as markers for quantitatively and objectively characterizing several perceptual phenomena. Notably, these image sequences are created in a manner that strictly controls a number of important low-level image properties, such as luminance and frequency spectra, thus reducing confounds in the analysis of high-level visual processes. Here we describe the RISE paradigm, report the results of a few basic RISE experiments, and discuss a number of experimental and clinical applications of this approach.     

Object recognition memory and the rodent hippocampus

In rodents, the novel object recognition task (NOR) has become a benchmark task for assessing recognition memory. Yet, despite its widespread use, a consensus has not developed about which brain structures are important for task performance. We assessed both the anterograde and retrograde effects of hippocampal lesions on performance in the NOR task. Rats received 12 5-min exposures to two identical objects and then received either bilateral lesions of the hippocampus or sham surgery 1 d, 4 wk, or 8 wk after the final exposure. On a retention test 2 wk after surgery, the 1-d and 4-wk hippocampal lesion groups exhibited impaired object recognition memory. In contrast, the 8-wk hippocampal lesion group performed similarly to controls, and both groups exhibited a preference for the novel object. These same rats were then given four postoperative tests using unique object pairs and a 3-h delay between the exposure phase and the test phase. Hippocampal lesions produced moderate and reliable memory impairment. The results suggest that the hippocampus is important for object recognition memory.Recognition memory refers to the ability to judge a previously encountered item as familiar and depends on the integrity of the medial temporal lobe (Squire et al. 2007). Tasks that assess recognition memory (and object recognition memory in particular) have become increasingly useful tools for basic and preclinical research investigating the neural basis of memory (Winters et al. 2008). Perhaps the best known of these tasks is the novel object recognition task (NOR) (also known as the visual paired-comparison task in studies with humans and monkeys).Studies of the NOR task in humans with hippocampal damage (McKee and Squire 1993; Pascalis et al. 2004) and in monkeys with selective damage to the hippocampus (Pascalis and Bachevalier 1999; Zola et al. 2000; Nemanic et al. 2004) have resulted in clear and consistent findings. Damage limited to the hippocampus is sufficient to produce impaired recognition memory (Squire et al. 2007, Box 1). In rats and mice, the NOR task has become particularly popular and is currently a benchmark task for assessing recognition memory. Yet despite its widespread use in rodents, the findings are rather mixed. For example, in the rat, although there is agreement that the perirhinal cortex is critically important for normal NOR performance, there is less agreement about the hippocampus (for review, see Winters et al. 2008). Although some of the discrepancies between studies may be attributed to differences in lesion size and in the length of the retention delay (Broadbent et al. 2004), these factors cannot account for all the findings (Squire et al. 2007).Whereas most studies have investigated the effects of hippocampal lesions on postoperative NOR performance, there is also interest in the effects of hippocampal lesions on memory for previously encountered objects. For a number of tasks, hippocampal lesions produce temporally graded retrograde amnesia, such that memory acquired recently is impaired and memory acquired more remotely is spared (for review, see Squire et al. 2004; Frankland and Bontempi 2005). In the case of the single study of retrograde memory that has involved the NOR task, recognition memory was impaired when a 5-wk interval intervened between training and hippocampal surgery (Gaskin et al. 2003). It remains possible that memory might be spared if a longer delay was imposed between training and surgery.The aim of the present study was to assess both the anterograde and retrograde effects of hippocampal lesions on recognition memory using the NOR task. To thoroughly assess the effects of hippocampal lesions we used (1) large groups of animals, (2) multiple tests of NOR memory, (3) a scoring method that allowed object preference to be determined on a second-by-second basis during the recognition tests, and (4) a novel training protocol that permitted the evaluation of recognition memory even after a retention interval as long as 10 wk.     

Object recognition is mediated by extraretinal information

Many previous studies of object recognition have found view-dependent recognition performance when view changes are produced by rotating objects relative to a stationary viewing position. However, the assumption that an object rotation is equivalent to an observer viewpoint change ignores the potential contribution of extraretinal information that accompanies observer movement. In four experiments, we investigated the role of extraretinal information on real-world object recognition. As in previous studies focusing on the recognition of spatial layouts across view changes, observers performed better in an old/new object recognition task when view changes were caused by viewer movement than when they were caused by object rotation. This difference between viewpoint and orientation changes was due not to the visual background, but to the extraretinal information available during real observer movements. Models of object recognition need to consider other information available to an observer in addition to the retinal projection in order to fully understand object recognition in the real world.     

Object recognition and object segregation in 4.5-month-old infants

Six experiments investigated how 4.5-month-old infants' perception of a display is affected by an immediate prior experience with an object similar to part of the test display. Prior research (A. Needham & R. Baillargeon, 1998) showed that when infants see an object alone and then see it next to a novel object, this prior experience allows them to determine the location of a boundary between the two objects. The present experiments investigated whether infants would also use an object similar, but not identical, to a test object in the same kind of task. The results indicate that infants' use of a prior experience is disrupted by changes in the features of the object, but not by a change in its spatial orientation. These findings suggest that, like adults, infants may expect that changes in the features of an object are associated with a change in the identity of the object, but do not have the same expectation for changes in spatial orientation.     

Object recognition and segmentation by a fragment-based hierarchy

How do we learn to recognize visual categories, such as dogs and cats? Somehow, the brain uses limited variable examples to extract the essential characteristics of new visual categories. Here, I describe an approach to category learning and recognition that is based on recent computational advances. In this approach, objects are represented by a hierarchy of fragments that are extracted during learning from observed examples. The fragments are class-specific features and are selected to deliver a high amount of information for categorization. The same fragments hierarchy is then used for general categorization, individual object recognition and object-parts identification. Recognition is also combined with object segmentation, using stored fragments, to provide a top-down process that delineates object boundaries in complex cluttered scenes. The approach is computationally effective and provides a possible framework for categorization, recognition and segmentation in human vision.     

Object recognition in Williams syndrome: uneven ventral stream activation

Williams syndrome (WS) is a genetic disorder associated with severe visuospatial deficits, relatively strong language skills, heightened social interest, and increased attention to faces. On the basis of the visuospatial deficits, this disorder has been characterized primarily as a deficit of the dorsal stream, the occipitoparietal brain regions that subserve visuospatial processing. However, some evidence indicates that this disorder may also affect the development of the ventral stream, the occipitotemporal cortical regions that subserve face and object recognition. The present studies examined ventral stream function in WS, with the hypothesis that faces would produce a relatively more mature pattern of ventral occipitotemporal activation, relative to other objects that are also represented across these visual areas. Using functional magnetic imaging, we compared activation patterns during viewing of human faces, cat faces, houses and shoes in individuals with WS (age 14-27), typically developing 6-9-year-olds (matched approximately on mental age), and typically developing 14-26-year-olds (matched on chronological age). Typically developing individuals exhibited changes in the pattern of activation over age, consistent with previous reports. The ventral stream topography of individuals with WS differed from both control groups, however, reflecting the same level of activation to face stimuli as chronological age matches, but less activation to house stimuli than either mental age or chronological age matches. We discuss the possible causes of this unusual topography and implications for understanding the behavioral profile of people with WS.     

Object recognition with severe spatial deficits in Williams syndrome: sparing and breakdown

Williams syndrome (WS) is a rare genetic disorder that results in severe visual-spatial cognitive deficits coupled with relative sparing in language, face recognition, and certain aspects of motion processing. Here, we look for evidence for sparing or impairment in another cognitive system-object recognition. Children with WS, normal mental-age (MA) and chronological age-matched (CA) children, and normal adults viewed pictures of a large range of objects briefly presented under various conditions of degradation, including canonical and unusual orientations, and clear or blurred contours. Objects were shown as either full-color views (Experiment 1) or line drawings (Experiment 2). Across both experiments, WS and MA children performed similarly in all conditions while CA children performed better than both WS group and MA groups with unusual views. This advantage, however, was eliminated when images were also blurred. The error types and relative difficulty of different objects were similar across all participant groups. The results indicate selective sparing of basic mechanisms of object recognition in WS, together with developmental delay or arrest in recognition of objects from unusual viewpoints. These findings are consistent with the growing literature on brain abnormalities in WS which points to selective impairment in the parietal areas of the brain. As a whole, the results lend further support to the growing literature on the functional separability of object recognition mechanisms from other spatial functions, and raise intriguing questions about the link between genetic deficits and cognition.     

Object recognition contributions to figure-ground organization: Operations on outlines and subjective contours

In previous research, replicated here, we found that some object recognition processes influence figure-ground organization. We have proposed that these object recognition processes operate on edges (or contours)detected early in visual processing, rather than on regions. Consistent with this proposal, influences from object recognition on figure-ground organization were previously observed in both pictures and stereograms depicting regions of different luminance, but not in randomdot stereograms, where edges arise late in processing (Peterson & Gibson, 1993). In the present experiments, we examined whether or not two other types of contours—outlines and subjective contours—enable object recognition influences on figure-ground organization. For both types of contours we observed a pattern of effects similar to that originally obtained with luminance edges. The results of these experiments are valuable for distinguishing between alternative views of the mechanisms mediating object recognition influences on figure-ground organization. In addition, in both Experiments 1 and 2, fixated regions were seen as figure longer than nonfixated regions, suggesting that fixation location must be included among the variables relevant to figure-ground organization.     

Search for a category target in clutter

An airport security worker searching a suitcase for a weapon is engaging in an especially difficult search task: the target is not well-specified, it is not salient, and it is not predicted by its context. Under these conditions, search may proceed item-by-item. In the experiment reported here we tested whether the items for this form of search are whole familiar objects. Our displays were composed of color photographs of ordinary objects, that were either uniform in color and texture (simple), or had two or more parts with different colors or textures (compound). The observer's task was to detect the presence of a target belonging to a broad category (food). We found that when the objects were presented in a sparse array, search times to find the target were similar for displays composed of simple and compound objects. But when the same objects were presented as dense clutter, search functions were steeper for displays composed of compound objects. We attribute this difference to the difficulty of segmenting compound objects in clutter: compared with simple objects, compound objects are less likely to be organized into a single object by bottom--up grouping processes. Our results indicate that while search rates in a sparse display may be determined by the number of objects, search rates in clutter are also affected by the number of object parts.     

The depth of distractor processing in search with clutter

Some search tasks involve looking for a category target in clutter. This is the task faced, for example, by a baggage screener looking for weapons in a suitcase. Such tasks presumably involve the segmentation and recognition of the target object, but it is unknown whether they also involve the segmentation and recognition of the distractor objects. To examine the depth of distractor processing in this task, we had observers search through cluttered displays composed of normal and chimerical distractors. The normal distractors were photographs of recognizable objects, while the chimerical distractors were created by interchanging parts between the normal objects. The obsever's task was to identify the display quadrant that contained an animal or a vehicle target. We varied the difficulty of the search task by varying target and distractor discriminability, target uncertainty, and target occlusion. Only when the target was partially occluded did we find an effect of distractor type. In this case, observers may have found the target through a process of mentally eliminating whole distractor objects. When the target was unoccluded, we found no evidence that observers selected and rejected whole distractors during search. This second result supports our previous claim that often the items for search in clutter are not whole objects.     

Age, clutter, and competitive selection

Modern theory explains visual selective attention as a competition for receptive fields in the extrastriate cortex. The present study examined whether this competition contributes to older adults' difficulty in processing visual clutter. In 2 experiments, young and older adult subjects made same-different judgments of target shapes in displays with or without clutter. The target shapes were either high or low in discriminability. The spatial separation between targets varied across trials, and the effects of competitive selection were gauged through decrements in task performance that resulted as separation decreased. Both age groups showed a competition-in-clutter effect, evincing a stronger influence of target separation within cluttered displays. However, the costs of clutter in general and the strength of the competition-in-clutter effect more specifically were both substantially larger for older adults. Effects of clutter and competition also varied with stimulus discriminability; judgments of highly discriminable stimuli evinced no intertarget competition in uncluttered displays for either age group, while judgments of less discriminable stimuli showed competition whether clutter was present or not. Results suggest that clutter disproportionately degrades older adults' visual performance by forcing more careful stimulus resolution, engendering stronger competition for selection. (PsycINFO Database Record (c) 2012 APA, all rights reserved).     

When an Object Appears Unexpectedly: Object Circumvention in Adults

Obstacles often appear unexpectedly in our pathway and these require us to make immediate adjustments. Despite how regularly we encounter such situations only few studies have considered how we adjust to unexpected obstacles in the pathway that require us to walk around them. The authors considered how adults adjust to the possibility of an obstacle appearing and then also how foot placement is adjusted to circumvent an obstacle. Fifteen healthy adults walked down an 11-m walkway, initially they were told this was a clear pathway and nothing in the environment would change (no gate), they then performed a series of trials in which a gate may (gate close) or may not (gate open) partially obstruct their pathway. The authors found that mediolateral trunk velocity and acceleration was significantly increased when there was the possibility of an obstacle but before the obstacle appeared. This demonstrates an adaptive walking strategy that seems to enable healthy young adults to successfully circumvent obstacles. The authors also categorized foot placement adjustments and found that adults favored making shorter and wider steps away from the obstacle. They suggest this combination of adjustments allows participants to maintain stability while successfully circumventing the obstacle.     

Object permanence in lemurs

Object permanence, the ability to mentally represent objects that have disappeared from view, should be advantageous to animals in their interaction with the natural world. The objective of this study was to examine whether lemurs possess object permanence. Thirteen adult subjects representing four species of diurnal lemur (Eulemur fulvus rufus, Eulemur mongoz, Lemur catta and Hapalemur griseus) were presented with seven standard Piagetian visible and invisible object displacement tests, plus one single visible test where the subject had to wait predetermined times before allowed to search, and two invisible tests where each hiding place was made visually unique. In all visible tests lemurs were able to find an object that had been in clear view before being hidden. However, when lemurs were not allowed to search for up to 25-s, performance declined with increasing time-delay. Subjects did not outperform chance on any invisible displacements regardless of whether hiding places were visually uniform or unique, therefore the upper limit of object permanence observed was Stage 5b. Lemur species in this study eat stationary foods and are not subject to stalking predators, thus Stage 5 object permanence is probably sufficient to solve most problems encountered in the wild.     

Young Children's Self-Generated Object Views and Object Recognition

Two important and related developments in children between 18 and 24 months of age are the rapid expansion of object name vocabularies and the emergence of an ability to recognize objects from sparse representations of their geometric shapes. In the same period, children also begin to show a preference for planar views (i.e., views of objects held perpendicular to the line of sight) of objects they manually explore. Are children's emerging view preferences somehow related to contemporary changes in object name vocabulary and object perception? Children aged 18 to 24 months old explored richly detailed toy objects while wearing a head camera that recorded their object views. Both children's vocabulary size and their success in recognizing sparse three-dimensional representations of the geometric shapes of objects were significantly related to their spontaneous choice of planar views of those objects during exploration. The results suggest important interdependencies among developmental changes in perception, action, word learning, and categorization in very young children.     

Comparing theories of consciousness: Object position,not probe modality,reliably influences experience and accuracy in object recognition tasks

People often claim seeing images completely despite performing poorly. This highlights an issue with conscious representations. We introduce an experimental manipulation aiming to disentangle two prevalent positions: Rich views posit that people virtually represent the external world with unlimited capacity; Sparse views state that representations are reconstructed from expectations and information. In two experiments using the object recognition task, we tested two probe types: Images, which should aid reconstruction more, and Words, which should aid it less. From a sparse view, one should expect that Images lead to greater accuracy and reported experience. We found no reliable differences in accuracy and reported experience across probe types; however, we observed that the object positions influenced both accuracy and reported experience, which is surprising from a Rich view as it seemingly requires assumptions of different access across the visual field. Both theoretical positions thus currently need further development to explain our results.