Working memory for relations among objects

Across many areas of study in cognition, the capacity of working memory (WM) is widely agreed to be roughly three to five items: three to five objects (i.e., bound collections of object features) in the literature on visual WM or three to five role bindings (i.e., objects in specific relational roles) in the literature on memory and reasoning. Three experiments investigated the capacity of observers’ WM for the spatial relations among objects in a visual display, and the results suggest that the “items” in WM are neither simply objects nor simply role bindings. The results of Experiment 1 are most consistent with a model that treats an “item” in visual WM as an object, along with the roles of all its relations to one other object. Experiment 2 compared observers’ WM for object size with their memory for relative size and provided evidence that observers compute and store objects’ relations per se (rather than just absolute size) in WM. Experiment 3 tested and confirmed several more nuanced predictions of the model supported by Experiment 1. Together, these findings suggest that objects are stored in visual WM in pairs (along with all the relations between the objects in a pair) and that, from the perspective of WM, a given object in one pair is not the same “item” as that same object in a different pair.     

On the relations between action planning, object identification, and motor representations of observed actions and objects

Recent evidence suggests that viewing a static prime object (a hand grasp), can activate action representations that affect the subsequent identification of graspable target objects. The present study explored whether stronger effects on target object identification would occur when the prime object (a hand grasp) was made more action-rich and dynamic. Of additional interest was whether this type of action prime would affect the generation of motor activity normally elicited by the target object. Three experiments demonstrated that grasp observation improved the identification of grasp-congruent target objects relative to grasp-incongruent target objects. We argue from this data that identifying a graspable object includes the processing of its action-related attributes. In addition, grasp observation was shown to influence the motor activity elicited by the target object, demonstrating interplay between action-based and object-based motor coding.     

Action priming by briefly presented objects

Three experiments investigated how visual objects prime the actions they afford. The principal concern was whether such visuomotor priming depends upon a concurrent visual input--as would be expected if it is mediated by on-line dorsal system processes. Experiment 1 showed there to be essentially identical advantages for making afforded over non-afforded responses when these were made to objects still in view and following brief (30 or 50 ms) object exposures that were backward masked. Experiment 2 showed that affordance effects were also unaffected by stimulus degradation. Finally, Experiment 3 showed there to be statistically equal effects from images of objects and their names. The results suggest that an active object representation is sufficient to generate affordance compatibility effects based on associated actions, whether or not the object is concurrently visible.     

Effects of binding in the identification of objects

The binding problem requires a solution at the level of individual neurons, but no definite mechanism has yet be given. Therefore, the neuronal level is as yet inadequate for modeling cognitive processes in which binding plays a crucial role. Moreover, the neuronal level involves too many details that are unlikely to be essential for understanding cognition. A general model of cognitive brain functioning is described in which cognitive tasks are represented in a network of cell assemblies. In the network, binding is functionally defined in a way that is compatible with the neuronal level. A computer simulation of the model clarifies how the binding of location and identity of a set of simultaneously presented letters takes place and how questions about the location and identity of the letters are answered. From the simulation of the task three predictions on the logistics of neural processes are derived: 1. When the cell assembly representing a letter participates in more than one temporary excitation loop, it will reach its critical threshold faster. At the behavioral level this means that as the number of identical letters in the display increases, responses will be faster. 2. In order to answer questions about the location and identity of presented letters cell assemblies representing the target location and the target identity have to become bound to their appropriate values. As a consequence the facilitatory effect of identical letters will be stronger if they involve the target location or the target identity than when identical non-targets are involved. 3. Negative identifications are more dependent on the presentation time of the letters than positive identifications because the excitation loops involved take more time to reach the critical threshold. Therefore, the facilitatory effect of identical letters is stronger when the external activation is relatively strong, i.e., when presentation time of the letters is sufficiently long. The reaction times obtained in three behavioral experiments support these hypotheses. Effects of binding can therefore be predicted on the basis of the general logistics of neural processes, without assumptions about a specific binding mechanism at the neuronal level.     

Sensitivity to viewpoint in children's drawings of objects and relations between objects.

Previous literature suggests that young children are relatively insensitive to viewpoint, only showing their view when the task is manipulated to provoke it. In contrast, older children appear to become more sensitive to viewpoint and it has been claimed that there is a developmental progression toward use of linear perspective as a means of drawing a view-specific scene. This study investigates sensitivity to viewpoint by manipulating it directly. Children between the ages of 6 and 14 years were asked to draw an L-shaped array of three cubes from one of three views: frontal eye level, frontal looking down, and corner looking down. At every age children showed sensitivity to their view in the sense that there were consistent differences between the drawings produced in the three viewing conditions. In the case of younger children this did not lead to an accurate portrayal of either their view or the array relations. Older children portrayed their view and the array relations more accurately, and viewpoint had a strong effect on the choice of projection system both within and between objects. There was no evidence of a general progression toward use of linear perspective.     

On the theory of relations based on the theory of objects

Summary The theory of relations presented in this article consists of the general and the special theory of relations. The formulae of the former are meaningful and its laws valid for relations of any type. The meaningfulness of expressions and the validity of laws of the latter are restricted to relations of a certain special type. The special theory of relations is distinguished from the applied theory of relations. The applied theory of relations is the general theory applied to relations of a special type, the difference between the general and the applied being in the form of the variables. The special theory of relations and the applied theory, when concerned with relations of the same special type, may differ with respect to the form of constants without differing with respect to variables.     

Effects of action relations on the configural coding between objects

Configural coding is known to take place between the parts of individual objects but has never been shown between separate objects. We provide novel evidence here for configural coding between separate objects through a study of the effects of action relations between objects on extinction. Patients showing visual extinction were presented with pairs of objects that were or were not co-located for action. We first confirmed the reduced extinction effect for objects co-located for action. Consistent with prior results showing that inversion disrupts configural coding, we found that inversion disrupted the benefit for action-related object pairs. This occurred both for objects with a standard canonical orientation (e.g., teapot and teacup) and those without, but where grasping and using the objects was made more difficult by inversion (e.g., spanner and nut). The data suggest that part of the affordance effect may reflect a visuo-motor response to the configural relations between stimuli. Experiment 2 showed that distorting the relative sizes of the objects also reduced the advantage for action-related pairs. We conclude that action-related pairs are processed as configurations.     

Category-specific effects on the identification of non-manipulable objects

Theories of category-specific effects on visual object identification predict easier identification of non-living than living objects. The Sensory-Functional theory credits greater representational weighting of the visual properties of living objects independent of greater weighting of the functional properties of non-living objects. It predicts a lost or reversed non-living advantage for non-manipulable objects. Normal participants matched pictures of non-manipulable objects with words describing three levels of identity while visual object similarity, and concept familiarity were controlled. Consistent with the Sensory-Functional theory, living objects were matched faster than non-living objects. Concept familiarity facilitated subordinate matches. Visual similarity hampered subordinate matches and facilitated basic matches.     

Haptic identification of objects and their depictions

Haptic identification of real objects is superior to that of raised two-dimensional (2-D) depictions. Three explanations of real-object superiority were investigated: contribution of material information, contribution of 3-D shape and size, and greater potential for integration across the fingers. In Experiment 1, subjects, while wearing gloves that gently attenuated material information, haptically identified real objects that provided reduced cues to compliance, mass, and part motion. The gloves permitted exploration with free hand movement, a single outstretched finger, or five outstretched fingers. Performance decreased over these three conditions but was superior to identification of pictures of the same objects in all cases, indicating the contribution of 3-D structure and integration across the fingers. Picture performance was also better with five fingers than with one. In Experiment 2, the subjects wore open-fingered gloves, which provided them with material information. Consequently, the effect of type of exploration was substantially reduced but not eliminated. Material compensates somewhat for limited access to object structure but is not the primary basis for haptic object identification.     

The effects of contextual scenes on the identification of objects

Memory & Cognition - This experiment demonstrates the influence of the prior presentation of visual scenes on the identification of briefly presented drawings of real-world objects. Different...     

Conceptual structures, representation of objects and object relations]

This article provides an overview of psychological studies of object concepts, highlighting the more recent re-conceptualizations, and the latest developments in research in this field. These developments have tended to focus on the notion of context, as well as on the notion of causal relations between features. Our theoretical analysis of this field is backed up by experimental illustrations. We complete with an examination of "category-specific impairments" studies, in the light of the evolution of concept theories.     

Formation of visual "objects" in the early computation of spatial relations

Perceptual grouping is the process by which elements in the visual image are aggregated into larger and more complex structures, i.e., "objects." This paper reports a study of the spatial factors and time-course of the development of objects over the course of the first few hundred milliseconds of visual processing. The methodology uses the now well-established idea of an "object benefit" for certain kinds of tasks (here, faster within-object than between-objects probe comparisons) to test what the visual system in fact treats as an object at each point during processing. The study tested line segment pairs in a wide variety of spatial configurations at a range of exposure times, in each case measuring the strength of perceptual grouping as reflected in the magnitude of the object benefit. Factors tested included nonaccidental properties such as collinearity, cotermination, and parallelism; contour relatability; Gestalt factors such as symmetry and skew symmetry, and several others, all tested at fine (25 msec) time-slices over the course of processing. The data provide detailed information about the comparative strength of these factors in inducing grouping at each point in processing. The result is a vivid picture of the chronology of object formation, as objects progressively coalesce, with fully bound visual objects completed by about 200 msec of processing.     

Orientation-invariant transfer of training in the identification of rotated natural objects

The effects of stimulus orientation on naming were examined in two experiments in which subjects identified line drawings of natural objects following practice with the objects at the same or different orientations. Half the rotated objects were viewed in the orientation that matched the earlier presentations, and half were viewed at an orientation that mismatched the earlier presentations. Systematic effects of orientation on naming time were found during the early presentations. These effects were reduced during later presentations, and the size of this reduction did not depend on the orientation in which the object had been seen originally. The results are consistent with a dual-systems model of object identification in which initially large effects of disorientation are the result of a normalization process such as mental rotation, and in which attenuation of the effects is due to a shift from the normalization system to a feature/part-based     

Effects of stimulus orientation on the identification of common polyoriented objects

Experimental evidence has shown that the time taken to recognize objects is often dependent on stimulus orientation in the image plane. This effect has been taken as evidence that recognition is mediated by orientation-specific stored representations of object shapes. However, the factors that determine the orientation specificity of these representations remain unclear. This issue is examined using a word-picture verification paradigm in which subjects identified line drawings of common mono- and polyoriented objects at different orientations. A detailed analysis of the results showed that, in contrast to mono-oriented objects, the recognition of polyoriented objects is not dependent on stimulus orientation. This interaction provides a further constraint on hypotheses about the factors that determine the apparent orientation specificity of stored shape representations. In particular, they support previous proposals that objects are encoded in stored representations at familiar stimulus orientations.     

Action video game players form more detailed representation of objects

Previous research has clearly demonstrated action video game improvements in visual and spatial attention. The present study investigated action video game related changes in the resolution of representations for both dynamic and stationary objects by comparing video game players (VGP) and non-video game players (NVGP). In a color wheel task (adapted from Zhang & Luck, 2008) where viewers were asked to freely recall the color of briefly presented objects, we found that VGPs were more accurate than NVGPs. Furthermore, in the Multiple Identity Tracking task (Horowitz et al., 2007), we found that VGPs were able to track not only more objects but also maintain identity of tracked objects better than NVGPs. Finally, we demonstrated that VGPs had greater attentional breadth and higher spatial representation resolution.     

Concurrent processing of spatial relations and objects in two cerebral hemispheres

This study examined hemispheric asymmetry for concurrent processing of object and spatial information. Participants viewed two successive stimuli, each of which consisted of two digits and two pictures that were randomly located and judged them as identical or different. A sample stimulus was presented in a central visual field, followed by a matching stimulus presented briefly in a left or right visual field. The matching stimuli were different from the sample stimuli with respect to the object (digit or picture) or spatial (locations or distances of items) aspect. No visual field asymmetry was found in the detection of object change. However, a left visual field advantage was found in the detection of spatial change. This result can be explained by the double filtering by frequency theory of Ivry and Robertson, who asserted that the left hemisphere has a bias for processing information contained in relatively high spatial frequencies whereas the right hemisphere has a bias for processing information contained in relatively low spatial frequencies. Based upon this evidence, the importance of interhemispheric integration for visual scene perception is discussed.     

Action comprehension: deriving spatial and functional relations

A perceived action can be understood only when information about the action carried out and the objects used are taken into account. It was investigated how spatial and functional information contributes to establishing these relations. Participants observed static frames showing a hand wielding an instrument and a potential target object of the action. The 2 elements could either match or mismatch, spatially or functionally. Participants were required to judge only 1 of the 2 relations while ignoring the other. Both irrelevant spatial and functional mismatches affected judgments of the relevant relation. Moreover, the functional relation provided a context for the judgment of the spatial relation but not vice versa. The results are discussed in respect to recent accounts of action understanding.     

Visuo-haptic integration in object identification using novel objects

Although some studies have shown that haptic and visual identification seem to rely on similar processes, few studies have directly compared the two. We investigated haptic and visual object identification by asking participants to learn to recognize (Experiments 1, and 3), or to match (Experiment 2) novel objects that varied only in shape. Participants explored objects haptically, visually, or bimodally, and were then asked to identify objects haptically and/or visually. We demonstrated that patterns of identification errors were similar across identification modality, independently of learning and testing condition, suggesting that the haptic and visual representations in memory were similar. We also demonstrated that identification performance depended on both learning and testing conditions: visual identification surpassed haptic identification only when participants explored the objects visually or bimodally. When participants explored the objects haptically, haptic and visual identification were equivalent. Interestingly, when participants were simultaneously presented with two objects (one was presented haptically, and one was presented visually), object similarity only influenced performance when participants were asked to indicate whether the two objects were the same, or when participants had learned about the objects visually—without any haptic input. The results suggest that haptic and visual object representations rely on similar processes, that they may be shared, and that visual processing may not always lead to the best performance.