Perceptual-cognitive universals as reflections of the world

The universality, invariance, and elegance of principles governing the universe may be reflected in principles of the minds that have evolved in that universe—provided that the mental principles are formulated with respect to the abstract spaces appropriate for the representation of biologically significant objects and their properties. (1)Positions andmotions of objects conserve theirshapes in the geometrically fullest and simplest way when represented as points and connecting geodesic paths in the six-dimensional manifold jointly determined by the Euclidean group of three-dimensional space and the symmetry group of each object. (2)Colors of objects attain constancy when represented as points in a three-dimensional vector space in which each variation in natural illumination is cancelled by application of its inverse from the three-dimensional linear group of terrestrial transformations of the invariant solar source. (3)Kinds of objects support optimal generalization and categorization when represented, in an evolutionarily shaped space of possible objects, as connected regions with associated weights determined by Bayesian revision of maximum-entropy priors.     

The representation of uniform motion in vision

For veridical detection of object motion any moving detecting system must allocate motion appropriately between itself and objects in space. A model for such allocation is developed for simplified situations (points of light in uniform motion in a frontoparallel plane). It is proposed that motion of objects is registered and represented successively at four levels within frames of reference that are defined by the detectors themselves or by their movements. The four levels are referred to as retinocentric, orbitocentric, egocentric, and geocentric. Thus the retinocentric signal is combined with that for eye rotation to give an orbitocentric signal, and the left and right orbitocentric signals are combined to give an egocentric representation. Up to the egocentric level, motion representation is angular rather than three-dimensional. The egocentric signal is combined with signals for head and body movement and for egocentric distance to give a geocentric representation. It is argued that although motion perception is always geocentric, relevant registrations also occur at the three earlier levels. The model is applied to various veridical and nonveridical motion phenomena.     

Object representations are biased toward each other through statistical learning

The visual system is remarkably efficient at extracting regularities from the environment through statistical learning. While such extraction has extensive consequences on cognition, it is unclear how statistical learning shapes the representations of the individual objects that comprise the regularities. Here we examine how statistical learning alters object representations. In three experiments, participants were exposed to either random arrays containing objects in a random order, or structured arrays containing object pairs where two objects appeared next to each other in fixed spatial or temporal configurations. After exposure, one object in each pair was briefly presented and participants judged the location or the orientation of the object without seeing the other object in the pair. We found that when an object reliably appeared next to another object in space, it was judged as being closer to the other object in space even though the other object was never presented (Experiments 1 and 2). Likewise, when an object reliably preceded another object in time, its orientation was biased toward the orientation of the other object even though the other object was never presented (Experiment 3). These results demonstrated that statistical learning fundamentally shapes how individual objects are represented in visual memory, by biasing the representation of one object toward its co-occurring partner. Importantly, participants in all experiments were not explicitly aware of the regularities. Thus, the bias in object representations was implicit. The current study reveals a novel impact of statistical learning on object representation: spatially co-occurring objects are represented as being closer in space, and temporally co-occurring objects are represented as having more similar features.     

On the system of representations in a group situation

Relations between the representations of group members with respect to different elements in the group set-up: The task, the others, the self and the group as a whole are analyzed from data collected in four experiments. Results show that the interrelations between these representations in the subjects' cognitive universe are determined by a combination of three separate principles which deal respectively with: 1) the degree of generality, complexity or semantic ‘globality’ of each element of the situation in the subjects' representation thereof; 2) the functional importance (particularly in determining behaviours in the situation) of each representation, as well as its centrality within the subjects' representational system. The functional importance and centrality of a given representation seem to be directly related in turn to the perceived normative character of the represented objects in terms of the group's objectives; 3) a process of social comparison between the self and others, according to which each group member tends to perceive himself as being more in harmony than the others with the norms and requirements of the situation as he perceives them. The discussion deals with the generality of the above results.     

Localization of targets by strabismic subjects: Contrasting patterns in constant and alternating suppressors

Strabismic subjects in whom vision in one eye is constantly suppressed localized targets at different points in space when using each eye. Whether they were esotropes or exotropes determined the relation between the two locations and the angle of their vergence error correlated with the magnitude of the interocular discrepancy. These relationships suggest that constant suppressors utilize information about posture of the dominant eye in reaching toward targets presented to the normally suppressed eye. Neither orthotropes nor strabismics in whom vision in each eye is alternately suppressed showed this anomaly. These results were attributed to differences in the way in which visual space is represented, an outcome of the pattern of use of the eyes during early development.     

Central visual persistences: II. Effects of hand and head rotations

In an earlier paper, kinesthetic effects on central visual persistences (CPs) were reported, including the ability to move these images by hand following eye closure. While all CPs could be translated anywhere within the frontal field, the present report documents a more selective influence of manual rotations on CPs in the same subjects. When common objects or figures drawn on cards were rotated (while holding one end of the object or one corner of a card between thumb and forefinger), it was found that CPs of larger objects rotated with the hand. By contrast, CPs of smaller objects, parts of objects, and textures remained stable in space as the hand rotated. It is proposed that CPs of smaller stimuli and textures are represented mainly by the ventral stream (temporal cortex) while larger CPs, which rotate, are represented mainly by the dorsal stream (parietal cortex). A second discovery was that CPs of small objects (but not of line segments or textures) could be rotated when the thumb and fingers surrounded the edges of the object. It is proposed that neuronal convergence of visual and tactile information about shape increases parietal responses to small objects, so that their CPs will rotate. Experiments with CPs offer new tools to infer visual coding differences between ventral and dorsal streams in man.     

Infants chunk object arrays into sets of individuals

Research suggests that, using representations from object-based attention, infants can represent only 3 individuals at a time. For example, infants successfully represent 1, 2, or 3 hidden objects, but fail with 4 (Developmental Science 6 (2003) 568), and a similar limit is seen in adults' tracking of multiple objects (see Cognitive Psychology 38 (1999) 259). In the present experiments we used a manual search procedure to ask whether infants can overcome this limit of 3 by chunking individuals into sets. Experiments 1 and 2 replicate infants' failure to represent a total of 4 objects. We then show that infants can exceed this limit when items are spatiotemporally grouped into two sets of 2 prior to hiding, leading infants to successfully represent a total of 4 objects. Experiment 3 demonstrates that infants tracked the 4 objects as two sets of 2, searching for each set in its correct hiding location. That infants represented the number of individuals in each set is demonstrated by their reaching for the correct number of objects in each location. These results suggest that by binding individuals into sets, infants can increase their representational capacity. This is the first evidence for chunking abilities in infants.     

Object-based apparent motion

The interpretation of a dynamic visual scene requires integrating information within frames (grouping and completion) and across frames (correspondence matching). Fragmentary views of objects were used in five experiments. These views could not be matched with each other by any similarity transformation on the basis of their explicit visual features, but their completed versions were related by a rotational transformation. When the fragmentary images were successively presented to observers, it was found that they produced apparent motion in the picture plane and in depth. Thus, apparent motion is capable of establishing correspondence at the level of perceptually recovered objects in three-dimensional space.     

Learning to recognize objects

Evidence from neurophysiological and psychological studies is coming together to shed light on how we represent and recognize objects. This review describes evidence supporting two major hypotheses: the first is that objects are represented in a mosaic-like form in which objects are encoded by combinations of complex, reusable features, rather than two-dimensional templates, or three-dimensional models. The second hypothesis is that transform-invariant representations of objects are learnt through experience, and that this learning is affected by the temporal sequence in which different views of the objects are seen, as well as by their physical appearance.     

Emergent two-dimensional patterns in images rotated in depth

Once a person has observed a three-dimensional scene, how accurately can he or she then imagine the appearance of that scene from different viewing angles? In a series of experiments addressed to this question, subjects formed mental images of a set of objects hanging in a clear cylinder and mentally rotated their images as they physically rotated the cylinder by various amounts. They were asked to perform four tasks, each demanding the ability to "see" the two-dimensional patterns that should emerge in their images if the images depicted the new perspective view accurately--(a) Subjects described the two-dimensional geometric shape that the imagined objects formed in an image rotated 90 degrees; (b) they "scanned" horizontally from one imagined object to another in a rotated image; (c) they physically rotated the empty cylinder together with their image until two of the imagined objects were vertically aligned; and (d) they adjusted a marker to line up with a single object in a rotated image. The experimental results converged to suggest that subjects' images accurately displayed the two-dimensional patterns emerging from a rotation in depth. However, the amount by which they rotated their image differed systematically from the amount specified by the experimenter. Results are discussed in the context of a model of the mental representation of physical space that incorporates two types of structures, one representing the three-dimensional layout of a scene, and the other representing the two-dimensional perspective view of the scene from a given vantage point.     

Principles of Object Perception

Research on human infants has begun to shed light on early-developing processes for segmenting perceptual arrays into objects. Infants appear to perceive objects by analyzing three-dimensional surface arrangements and motions. Their perception does not accord with a general tendency to maximize figural goodness or to attend to nonaccidental geometric relations in visual arrays. Object perception does accord with principles governing the motions of material bodies: Infants divide perceptual arrays into units that move as connected wholes, that move separately from one another, that tend to maintain their size and shape over motion, and that tend to act upon each other only on contact. These findings suggest that o general representation of object unity and boundaries is interposed between representations of surfaces and representations of objects of familiar kinds. The processes that construct this representation may be related to processes of physical reasoning.     

The relation between hierarchical and euclidean models for psychological distances

In one well-known model for psychological distances, objects such as stimuli are placed in a hierarchy of clusters like a phylogenetic tree; in another common model, objects are represented as points in a multidimensional Euclidean space. These models are shown theoretically to be mutually exclusive and exhaustive in the following sense. The distances among a set ofn objects will be strictly monotonically related either to the distances in a hierarchical clustering system, or else to the distances in a Euclidean space of less thann — 1 dimensions, but not to both. Consequently, a lower bound on the number of Euclidean dimensions necessary to represent a set of objects is one less than the size of the largest subset of objects whose distances satisfy the ultrametric inequality, which characterizes the hierarchical model.This work was supported in part by Grant GB-13588X from the National Science Foundation. I would like to thank L. M. Kelly and A. A. J. Marley for their helpful comments and suggestions.     

Preschool children's ability to visually represent relations

The developmental origins of mapping temporal relations onto space was investigated in N = 122 3- to 5-year-old children and adults. Spontaneous production and comprehension were investigated. Production was investigated in two conditions: an iconic condition (three-dimensional objects depicting the events or objects to be represented) and an abstract condition (plain discs). Consistent with findings by Tversky, Kugelmass and Winter (1991), 5-year-olds performed on an adult-like level. Developmental progress was observed between the ages of 3 and 4 years, with comprehension preceding production. Consistent with DeLoache's findings (2000), 4-year-olds' performance was better in abstract than in iconic conditions, indicating that dual representational demands may have affected task performance in the iconic condition. In sum, abilities to map temporal relations onto spatial relations appear to develop spontaneously, even before children have experience with conventional notational systems.     

Framing pictures: the role of knowledge in automatized encoding and memory for gist

In general, frame theories are theories about the representation and use of knowledge for pattern recognition. In the present article, the general properties of frame theories are discussed with regard to their implications for psychological processes, and an experiment is presented which tests whether this approach yields viable predictions about the manner in which people comprehend and remember pictures of real-world scenes. Normative ratings were used to construct six target pictures, each of which contained both expected and unexpected objects. Eye movements were then recorded as subjects who anticipated a difficult recognition test viewed the targets for 30 sec each. Then, the subjects were asked to discriminate the target pictures from distractors in which either expected or unexpected objects had been changed. One consequence of the embeddedness of frame systems is that global frames may function as "semantic pattern detectors," so that the perceptual knowledge in them could be used for relatively automatic pattern recognition and comprehension. Thus, subjects might be able to identify expected objects by using automatized encoding procedures that operate on global physical features. In contrast, identification of unexpected objects (i.e., objects not represented in the currently active frame) should generally require more analysis of local visual details. These hypotheses were confirmed with the fixation duration data: First fixations to the unexpected objects were approximately twice as long as first fixations to the expected objects. On the recognition test, subjects generally noticed only the changes that had been made to the unexpected objects, despite the fact that the proportions of correct rejections were made conditional on whether the target objects had been fixated. These data are again consistent with the idea that local visual details of objects represented in the frame are not neccesary for identification and are thus not generally encoded. Further, since subjects usually did not notice when expected objects were deleted or replaced with different expected objects, it was concluded that if two events instantiate the same frame, they may often be indistinguishable, as long as any differences between them are represented as arguments in the frame. Thus, for the most part, the only information about an event that is episodically "tagged" is information which distinguishes that particular event from others of the same general class. The data reinforce the utility of a frame theory approach to perception and memory.     

Picture recognition of food by macaques (<Emphasis Type="Italic">Macaca silenus</Emphasis>)

Pictorial representations of three-dimensional objects are often used to investigate animal cognitive abilities; however, investigators rarely evaluate whether the animals conceptualize the two-dimensional image as the object it is intended to represent. We tested for picture recognition in lion-tailed macaques by presenting five monkeys with digitized images of familiar foods on a touch screen. Monkeys viewed images of two different foods and learned that they would receive a piece of the one they touched first. After demonstrating that they would reliably select images of their preferred foods on one set of foods, animals were transferred to images of a second set of familiar foods. We assumed that if the monkeys recognized the images, they would spontaneously select images of their preferred foods on the second set of foods. Three monkeys selected images of their preferred foods significantly more often than chance on their first transfer session. In an additional test of the monkeys’ picture recognition abilities, animals were presented with pairs of food images containing a medium-preference food paired with either a high-preference food or a low-preference food. The same three monkeys selected the medium-preference foods significantly more often when they were paired with low-preference foods and significantly less often when those same foods were paired with high-preference foods. Our novel design provided convincing evidence that macaques recognized the content of two-dimensional images on a touch screen. Results also suggested that the animals understood the connection between the two-dimensional images and the three-dimensional objects they represented.     

Clusteringn objects intok groups under optimal scaling of variables

We propose a method to reduce many categorical variables to one variable withk categories, or stated otherwise, to classifyn objects intok groups. Objects are measured on a set of nominal, ordinal or numerical variables or any mix of these, and they are represented asn points inp-dimensional Euclidean space. Starting from homogeneity analysis, also called multiple correspondence analysis, the essential feature of our approach is that these object points are restricted to lie at only one ofk locations. It follows that thesek locations must be equal to the centroids of all objects belonging to the same group, which corresponds to a sum of squared distances clustering criterion. The problem is not only to estimate the group allocation, but also to obtain an optimal transformation of the data matrix. An alternating least squares algorithm and an example are given.The authors thank Eveline Kroezen and Teije Euverman for their comments on a previous draft of this paper.     

Visual selective attention with virtual barriers

Previous studies have shown that interference effects in the flanker task are reduced when physical barriers (e.g., hands) are placed around rather than below a target flanked by distractors. One explanation of this finding is the referential coding hypothesis, whereby the barriers serve as reference objects for allocating attention. In five experiments, the generality of the referential coding hypothesis was tested by investigating whether interference effects are modulated by the placement of virtual barriers (e.g., parentheses). Modulation of flanker interference was found only when target and distractors differed in size and the virtual barriers were beveled wood-grain objects. Under these conditions and those of previous studies, the author conjectures that an impression of depth was produced when the barriers were around the target, such that the target was perceived to be on a different depth plane than the distractors. Perception of depth in the stimulus display might have led to referential coding of the stimuli in three-dimensional (3-D) space, influencing the allocation of attention beyond the horizontal and vertical dimensions. This 3-D referential coding hypothesis is consistent with research on selective attention in 3-D space that shows flanker interference is reduced when target and distractors are separated in depth.     

Segregation by color and stereoscopic depth in three-dimensional visual space

Two experiments were conducted to investigate how color and stereoscopic depth information are used to segregate objects for visual search in three-dimensional (3-D) visual space. Eight observers were asked to indicate the alphanumeric category (letter or digit) of the target which had its unique color and unique depth plane. In Experiment 1, distractors sharing a common depth plane or a common color appeared in spatial contiguity in thexy plane. The results suggest that visual search for the target involves examination of kernels formed by homogeneous items sharing the same color and depth. In Experiment 2, thexy contiguity of distractors sharing a common color or a common depth plane was varied. The results showed that when target-distractor distinction becomes more difficult on one dimension, the other dimension becomes more important in performing visual search, as indicated by a larger effect on search time. This suggests that observers can make optimal use of the information available. Finally, color had a larger effect on search time than did stereoscopic depth. Overall, the results support models of visual processing which maintain that perceptual segregation and selective attention are determined by similarity among objects in 3-D visual space on both spatial and nonspatial stimulus dimensions.     

Visual search asymmetry for viewing direction

In visual search experiments, we examined the existence of a search asymmetry for the direction with which three-dimensional objects are viewed. It was found that an upward-tilted target object among downward-tilted distracting objects was detected faster than when the orientation of target and distractors was reversed. This indicates that the early visual process regards objects tilted downward with respect to the observer as the situation that is more likely to be encountered. That is, the system is set up to expect to see the tops of these objects. We also found a visual field anisotropy, in that the asymmetry was more pronounced in the lower visual field. These findings are consistent with the idea that the tops of objects are usually situated in the lower visual field and less often in the upper field. Examination of the conditions under which the asymmetry and the anisotropy occur demonstrated the importance of the three-dimensional nature of the stimulus objects. Early visual processing thus makes use of heuristics that take into account specific relationships between the relative locations in space of the observer and 3-D objects.