Action representations activated by task‐irrelevant information: Is it really irrelevant?

Accessing action knowledge is believed to rely on the activation of action representations through the retrieval of functional, manipulative, and spatial information associated with objects. However, it remains unclear whether action representations can be activated in this way when the object information is irrelevant to the current judgment. The present study investigated this question by independently manipulating the correctness of three types of action‐related information: the functional relation between the two objects, the grip applied to the objects, and the orientation of the objects. In each of three tasks in Experiment 1, participants evaluated the correctness of only one of the three information types (function, grip or orientation). Similar results were achieved with all three tasks: “correct” judgments were facilitated when the other dimensions were correct; however, “incorrect” judgments were facilitated when the other two dimensions were both correct and also when they were both incorrect. In Experiment 2, when participants attended to an action‐irrelevant feature (object color), there was no interaction between function, grip, and orientation. These results clearly indicate that action representations can be activated by retrieval of functional, manipulative, and spatial knowledge about objects, even though this is task‐irrelevant information.     

Action comprehension: deriving spatial and functional relations

A perceived action can be understood only when information about the action carried out and the objects used are taken into account. It was investigated how spatial and functional information contributes to establishing these relations. Participants observed static frames showing a hand wielding an instrument and a potential target object of the action. The 2 elements could either match or mismatch, spatially or functionally. Participants were required to judge only 1 of the 2 relations while ignoring the other. Both irrelevant spatial and functional mismatches affected judgments of the relevant relation. Moreover, the functional relation provided a context for the judgment of the spatial relation but not vice versa. The results are discussed in respect to recent accounts of action understanding.     

Developmental changes in the discrimination of dynamic human actions in infancy

Recent evidence suggests that adults selectively attend to features of action, such as how a hand contacts an object, and less to configural properties of action, such as spatial trajectory, when observing human actions. The current research investigated whether this bias develops in infancy. We utilized a habituation paradigm to assess 4-month-old and 10-month-old infants' discrimination of action based on featural, configural, and temporal sources of action information. Younger infants were able to discriminate changes to all three sources of information, but older infants were only able to reliably discriminate changes to featural information. These results highlight a previously unknown aspect of early action processing, and suggest that action perception may undergo a developmental process akin to perceptual narrowing.     

Defining the cortical visual systems: "what", "where", and "how"

The visual system historically has been defined as consisting of at least two broad subsystems subserving object and spatial vision. These visual processing streams have been organized both structurally as two distinct pathways in the brain, and functionally for the types of tasks that they mediate. The classic definition by Ungerleider and Mishkin labeled a ventral "what" stream to process object information and a dorsal "where" stream to process spatial information. More recently, Goodale and Milner redefined the two visual systems with a focus on the different ways in which visual information is transformed for different goals. They relabeled the dorsal stream as a "how" system for transforming visual information using an egocentric frame of reference in preparation for direct action. This paper reviews recent research from psychophysics, neurophysiology, neuropsychology and neuroimaging to define the roles of the ventral and dorsal visual processing streams. We discuss a possible solution that allows for both "where" and "how" systems that are functionally and structurally organized within the posterior parietal lobe.     

Differential use of distance and location information for spatial localization

Five experiments are reported in which subjects judged the movement or spatial location of a visible object that underwent a combination of real and induced (illusory) motion. When subjects attempted to reproduce the distance that the object moved by moving their unseen hands, they were more affected by the illusion than when they pointed to the object's perceived final location. Furthermore, pointing to the final location was more affected by the illusion when the hand movement began from the same position as that at which the object initially appeared, as compared with responses that began from other positions. The results suggest that people may separately encode two distinct types of spatial information: (1) information about the distance moved by an object and (2) information about the absolute spatial location of the object. Information about distance is more susceptible to the influence of an induced motion illusion, and people appear to rely differentially on the different types of spatial information, depending on features of the pointing response. The results have important implications for the mechanisms that underlie spatially oriented behavior in general.     

Physical imagery: kinematic versus dynamic models.

Physical imagery occurs when people imagine one object causing a change to a second object. To make inferences through physical imagery, people must represent information that coordinates the interactions among the imagined objects. The current research contrasts two proposals for how this coordinating information is realized in physical imagery. In the traditional kinematic formulation, imagery transformations are coordinated by geometric information in analog spatial representations. In the dynamic formulation, transformations may also be regulated by analog representations of force and resistance. Four experiments support the dynamic formulation. They show, for example, that without making changes to the spatial properties of a problem, dynamic perceptual information (e.g., torque) and beliefs about physical properties (e. g., viscosity) affect the inferences that people draw through imagery. The studies suggest that physical imagery is not so much an analog of visual perception as it is an analog of physical action. A simple model that represents force as a rate helps explain why inferences can emerge through imagined actions even though people may not know the answer explicitly. It also explains how and when perception, beliefs, and learning can influence physical imagery.     

Binding object features to locations: Does the “spatial congruency bias” update with object movement?

One of the fundamental challenges of visual cognition is how our visual systems combine information about an object’s features with its spatial location. A recent phenomenon related to object–location binding, the “spatial congruency bias,” revealed that two objects are more likely to be perceived as having the same identity or features if they appear in the same spatial location, versus if the second object appears in a different location. The spatial congruency bias suggests that irrelevant location information is automatically encoded with and bound to other object properties, biasing perceptual judgments. Here we further explored this new phenomenon and its role in object–location binding by asking what happens when an object moves to a new location: Is the spatial congruency bias sensitive to spatiotemporal contiguity cues, or does it remain linked to the original object location? Across four experiments, we found that the spatial congruency bias remained strongly linked to the original object location. However, under certain circumstances—for instance, when the first object paused and remained visible for a brief time after the movement—the congruency bias was found at both the original location and the updated location. These data suggest that the spatial congruency bias is based more on low-level visual information than on spatiotemporal contiguity cues, and reflects a type of object–location binding that is primarily tied to the original object location and that may only update to the object’s new location if there is time for the features to be re-encoded and rebound following the movement.     

可操作性在物体表征中的作用

近10年来, 越来越多的研究表明, 对可操作物体的识别不仅依赖物体的视觉信息, 同时也依赖操作它的动作信息和知识, 即可操作性。来自行为实验、脑成像和脑损伤病人的研究都表明, 物体的可操作性在物体识别中会被激活, 并起着重要的作用。可操作性的研究不但重新解释了生物与非生物、名词与动词的分离现象, 而且对于研究物体表征, 以及视觉物体识别的神经通路有着重要的理论意义。     

Fitting objects into holes: on the development of spatial cognition skills

The authors examined 14- to 26-month-old infants' understanding of the spatial relationships between objects and apertures in an object manipulation task. The task was to insert objects with various cross-sections (circular, square, rectangular, ellipsoid, and triangular) into fitting apertures. A successful solution required the infant to mentally rotate the object to be fit into the aperture and use that information to plan the action. The object was presented standing up in half of the trials; in the other half, it was lying down. The results showed that infants solved the problem consistently from age 22 months and that a successful solution was associated with appropriate preadjustments before the hand arrived with the block to the aperture. No sex differences were found.     

Spatial memory of domestic dogs (Canis familiaris) for hidden objects in a detour task

Spatial memory of domestic dogs (Canis familiaris) for hidden objects was investigated via a visible displacement problem of object permanence with a detour paradigm. Experiment 1 showed that dogs were able to spontaneously locate a disappearing object in a detour situation. In Experiments 2 and 3, dead reckoning and allocentric spatial information were put in conflict. Results revealed that dogs simultaneously encoded both sources of information when they had to bypass an obstacle to locate a hidden object. Experiment 3 also revealed that, over the course of testing, dogs gradually learned to rely predominantly on allocentric cues when the detour involved several reorientations. The current study reveals that spatial memory of dogs for hidden objects in a detour task was guided by flexibility in processing spatial information. Dogs could simultaneously encode dead reckoning and allocentric information to locate a disappearing object and used them hierarchically according to the complexity of the detour they encountered in the environment.     

Role of spatial location in integration of pictorial information across saccades

Identification of a fixated object in a visual display is facilitated by integrating information from a preview of that object in the periphery with information extracted on the subsequent foveal fixation (Pollatsek, Rayner, & Collins, 1984). These experiments investigated the extent to which this integration is dependent on the spatial location of the information remaining constant. Two preview objects were presented in the periphery; Ss fixated that region and named a single target object that appeared in the same spatial location in which one of the two preview objects had been presented. Of primary interest was the facilitative effect when a preview object was identical to the target object as a function of whether they were in the same spatial location. The major finding was that although there was a small effect of switching, there was still a substantial preview benefit even when the location of the identical object switched. In addition, the switching effect did not interact with the level of identity between the preview and target. There was also a preview benefit in conditions in which there were no eye movements and the preview and target objects were at least 5 degrees apart. Thus, the data indicate that the process object identification is relatively insensitive to location information and that object information and location information are coded fairly independently.     

Egocentric search for disappearing objects in domestic dogs: evidence for a geometric hypothesis of direction

In several species, the ability to locate a disappearing object is an adaptive component of predatory and social behaviour. In domestic dogs, spatial memory for hidden objects is primarily based on an egocentric frame of reference. We investigated the geometric components of egocentric spatial information used by domestic dogs to locate an object they saw move and disappear. In experiment 1, the distance and the direction between the position of the animal and the hiding location were put in conflict. Results showed that the dogs primarily used the directional information between their own spatial coordinates and the target position. In experiment 2, the accuracy of the dogs in finding a hidden object by using directional information was estimated by manipulating the angular deviation between adjacent hiding locations and the position of the animal. Four angular deviations were tested: 5, 7.5, 10 and 15°. Results showed that the performance of the dogs decreased as a function of the angular deviations but it clearly remained well above chance, revealing that the representation of the dogs for direction is precise. In the discussion, we examine how and why domestic dogs determine the direction in which they saw an object disappear.     

Visual working memory as the substrate for mental rotation

In mental rotation, a mental representation of an object must be rotated while the actual object remains visible. Where is this representation stored while it is being rotated? To answer this question, observers were asked to perform a mental rotation task during the delay interval of a visual working memory task. When the working memory task required the storage of object features, substantial bidirectional interference was observed between the memory and rotation tasks, and the interference increased with the degree of rotation. However, rotation-dependent interference was not observed when a spatial working memory task was used instead of an object working memory task. Thus, the object working memory subsystem—not the spatial working memory subsystem—provides the buffer in which object representations are stored while they undergo mental rotation. More broadly, the nature of the information being stored—not the nature of the operations performed on this information—may determine which subsystem stores the information.     

三维图形的客体和空间工作记忆存储时程研究

研究采用单探测变化检测范式,探讨了三维图形在视觉客体和空间工作记忆中的存储时程。实验一的三维图形由不同颜色、形状组成,实验二的图形由不同颜色、图案组成。两个实验的结果均发现:被试的正确率随刺激间隔时间的延长而显著下降; 空间工作记忆任务的正确率显著高于客体工作记忆任务。研究结果表明,视觉刺激消失后,不论是客体信息还是空间信息,均随间隔时间的延长而逐渐衰退,且客体信息衰退的速度比空间信息快。总体来看,三维图形的客体和空间信息在视觉工作记忆满负荷条件下能保持大约3～5秒的时间。     

Egocentric metric representations in peripersonal space: A bridge between motor resources and spatial memory

Research on visuospatial memory has shown that egocentric (subject-to-object) and allocentric (object-to-object) reference frames are connected to categorical (non-metric) and coordinate (metric) spatial relations, and that motor resources are recruited especially when processing spatial information in peripersonal (within arm reaching) than extrapersonal (outside arm reaching) space. In order to perform our daily-life activities, these spatial components cooperate along a continuum from recognition-related (e.g., recognizing stimuli) to action-related (e.g., reaching stimuli) purposes. Therefore, it is possible that some types of spatial representations rely more on action/motor processes than others. Here, we explored the role of motor resources in the combinations of these visuospatial memory components. A motor interference paradigm was adopted in which participants had their arms bent behind their back or free during a spatial memory task. This task consisted in memorizing triads of objects and then verbally judging what was the object: (1) closest to/farthest from the participant (egocentric coordinate); (2) to the right/left of the participant (egocentric categorical); (3) closest to/farthest from a target object (allocentric coordinate); and (4) on the right/left of a target object (allocentric categorical). The triads appeared in participants' peripersonal (Experiment 1) or extrapersonal (Experiment 2) space. The results of Experiment 1 showed that motor interference selectively damaged egocentric-coordinate judgements but not the other spatial combinations. The results of Experiment 2 showed that the interference effect disappeared when the objects were in the extrapersonal space. A third follow-up study using a within-subject design confirmed the overall pattern of results. Our findings provide evidence that motor resources play an important role in the combination of coordinate spatial relations and egocentric representations in peripersonal space.     

Object recognition is mediated by extraretinal information

Many previous studies of object recognition have found view-dependent recognition performance when view changes are produced by rotating objects relative to a stationary viewing position. However, the assumption that an object rotation is equivalent to an observer viewpoint change ignores the potential contribution of extraretinal information that accompanies observer movement. In four experiments, we investigated the role of extraretinal information on real-world object recognition. As in previous studies focusing on the recognition of spatial layouts across view changes, observers performed better in an old/new object recognition task when view changes were caused by viewer movement than when they were caused by object rotation. This difference between viewpoint and orientation changes was due not to the visual background, but to the extraretinal information available during real observer movements. Models of object recognition need to consider other information available to an observer in addition to the retinal projection in order to fully understand object recognition in the real world.     

Intrinsic frames of reference in haptic spatial learning

It has been proposed that spatial reference frames with which object locations are specified in memory are intrinsic to a to-be-remembered spatial layout (intrinsic reference theory). Although this theory has been supported by accumulating evidence, it has only been collected from paradigms in which the entire spatial layout was simultaneously visible to observers. The present study was designed to examine the generality of the theory by investigating whether the geometric structure of a spatial layout (bilateral symmetry) influences selection of spatial reference frames when object locations are sequentially learned through haptic exploration. In two experiments, participants learned the spatial layout solely by touch and performed judgments of relative direction among objects using their spatial memories. Results indicated that the geometric structure can provide a spatial cue for establishing reference frames as long as it is accentuated by explicit instructions (Experiment 1) or alignment with an egocentric orientation (Experiment 2). These results are entirely consistent with those from previous studies in which spatial information was encoded through simultaneous viewing of all object locations, suggesting that the intrinsic reference theory is not specific to a type of spatial memory acquired by the particular learning method but instead generalizes to spatial memories learned through a variety of encoding conditions. In particular, the present findings suggest that spatial memories that follow the intrinsic reference theory function equivalently regardless of the modality in which spatial information is encoded.     

Visual working memory for observed actions

Human society depends on the ability to remember the actions of other individuals, which is information that must be stored in a temporary buffer to guide behavior after actions have been observed. To date, however, the storage capacity, contents, and architecture of working memory for observed actions are unknown. In this article, the author shows that it is possible to retain information about only 2-3 actions in visual working memory at once. However, it is also possible to retain 9 properties distributed across 3 actions almost as well as 3 properties distributed across 3 actions, showing that working memory stores integrated action representations rather than individual properties. Finally, the author shows that working memory for observed actions is independent from working memory for object and spatial information. These results provide evidence for a previously undocumented system in working memory for storing information about actions. Further, this system operates by the same storage principles as visual working memory for object information. Thus, working memory consists of a series of distinct yet computationally similar mechanisms for retaining different types of visual information.     

Changing priority maps in 12- to 18-month-olds: An emerging role for object properties

Everyday action in the world requires the coordination of “where,” “when,” and “how” with “what.” In late infancy, there appear to be changes in how these different streams of information are integrated into the sequential organization of action. An experiment with 12-, 15-, and 18-month-olds was conducted in order to determine the influence of object properties and locations on the sequential selection of targets for reaching. The results reveal a developmental trend from reach decisions’ being influenced only by the spatial layout of locations to the overall pattern of reaching’s being influenced by the global configuration of object properties to object properties’ influencing the sequential decision of what to reach to next. This trend is a new finding regarding the development of goal-directed action in late infancy.     

Delay-dependent involvement of the rat entorhinal cortex in habituation to a novel environment

Evidence has accumulated that the entorhinal cortex (EC) is involved in memory operations underlying formation of a long-term memory. Because entorhinal-lesioned rats are impaired for long delays in delayed matching and non-matching to sample tasks, it has been proposed that EC contributes to the maintenance of information in short-term memory. In the present study, we asked whether such a time-limited role applies also when learning complex spatial information in a novel environment. We therefore examined the effects of EC lesions on habituation in an object exploration task in which a delay of either 4 min or 10 min is imposed between successive sessions. EC-lesioned rats exhibited a deficit in habituation at 10 min but not 4 min delays. Following habituation, reactions to spatial change (object configuration) and non-spatial change (novel object) were also examined. EC-lesioned rats were impaired in detecting the spatial change but were able to detect a non-spatial change, irrespective of the delay. Overall, the results suggest that EC is involved in maintaining a large amount of novel, multidimensional information in short-term memory therefore enabling formation of long-term memory. Switching to a novelty detection mode would then allow the animal to rapidly adapt to environmental changes. In this mode, EC would preferentially process spatial information rather than non-spatial information.