Semantic consistency versus perceptual salience in visual scenes: Findings from change detection

In a one-shot change detection task, we investigated the relationship between semantic properties (high consistency, i.e., diagnosticity, versus inconsistency with regard to gist) and perceptual properties (high versus low salience) of objects in guiding attention in visual scenes and in constructing scene representations. To produce the change an object was added or deleted in either the right or left half of coloured drawings of daily-life events. Diagnostic object deletions were more accurately detected than inconsistent ones, indicating rapid inclusion into early scene representation for the most predictable objects. Detection was faster and more accurate for high salience than for low salience changes. An advantage was found for diagnostic object changes in the high salience condition, although it was limited to additions when considering response speed. For inconsistent objects of high salience, deletions were detected faster than additions. These findings may indicate that objects are primarily selected on a perceptual basis with subsequent and supplementary effect of semantic consistency, in the sense of facilitation due to object diagnosticity or lengthening of processing time due to inconsistency.     

Incremental grouping of image elements in vision

One important task for the visual system is to group image elements that belong to an object and to segregate them from other objects and the background. We here present an incremental grouping theory (IGT) that addresses the role of object-based attention in perceptual grouping at a psychological level and, at the same time, outlines the mechanisms for grouping at the neurophysiological level. The IGT proposes that there are two processes for perceptual grouping. The first process is base grouping and relies on neurons that are tuned to feature conjunctions. Base grouping is fast and occurs in parallel across the visual scene, but not all possible feature conjunctions can be coded as base groupings. If there are no neurons tuned to the relevant feature conjunctions, a second process called incremental grouping comes into play. Incremental grouping is a time-consuming and capacity-limited process that requires the gradual spread of enhanced neuronal activity across the representation of an object in the visual cortex. The spread of enhanced neuronal activity corresponds to the labeling of image elements with object-based attention.     

The detection of temporally defined objects does not require focused attention

Perceptual grouping is crucial to distinguish objects from their background. Recent studies have shown that observers can detect an object that does not have any unique qualities other than unique temporal properties. A crucial question is whether focused attention is needed for this type of grouping. In two visual search experiments, we show that searching for an object defined by temporal grouping can occur in parallel. These findings suggest that focused attention is not needed for temporal grouping to occur. It is proposed that temporal grouping may occur because the neurons representing the changing object elements adopt firing frequencies that cause the visual system to bind these elements together without the need for focused attention.     

The detection of temporally defined objects does not require focused attention

Perceptual grouping is crucial to distinguish objects from their background. Recent studies have shown that observers can detect an object that does not have any unique qualities other than unique temporal properties. A crucial question is whether focused attention is needed for this type of grouping. In two visual search experiments, we show that searching for an object defined by temporal grouping can occur in parallel. These findings suggest that focused attention is not needed for temporal grouping to occur. It is proposed that temporal grouping may occur because the neurons representing the changing object elements adopt firing frequencies that cause the visual system to bind these elements together without the need for focused attention.     

身份凸显性：启动自我的开关

当意识到自己特定的身份时, 个人往往在这个身份的框架内来感知周围的世界。身份凸显性指特定身份在社会情境中启动的可能性。相关研究者分别从人格, 自我归类和社会建构的角度来认识身份凸显性, 它与自我概念整合存在紧密关系。身份凸显性的影响因素主要包括：身份承诺水平, 情绪, 群体规模和地位, 以及情境中相关线索的优势水平。另外, 阐述了几个抑制或干扰身份凸显性的策略：去类别化、再类别化和次类别化。未来研究需关注不同水平身份如何相互作用, 自我概念整合, 从社会构建的角度探索抑制或干扰身份凸显性的策略, 以及跨文化研究。     

The role of representational volatility in recognizing pre- and postchange objects

Theories relating attention to change blindness (CB) imply that representations of objects in the focus of attention are stable and coherent. However, CB occurs for objects in the focus of attention. Here, we explore this apparent contradiction and the possibility that changes can be detected without having a complete and stable representation of the prechange object. The first experiment required observers to recognize a prechange object and a postchange object after viewing arrays of various sizes in which the prechange object was replaced by the postchange object after a brief delay. Results indicated that the representation of the prechange object was strong enough to cue a change but not strong enough to support accurate recognition. The remaining experiments demonstrated that the representation of the prechange object is volatile in that a shift in the display or the presence of a postchange object can disrupt the representation. These findings add to current theories of attention and representations by showing that attention may result in volatile representations that can support change detection without supporting accurate recognition.     

Object-based attention: strength of object representation and attentional guidance

Two or more features belonging to a single object are identified more quickly and more accurately than are features belonging to different objects--a finding attributed to sensory enhancement of all features belonging to an attended or selected object. However, several recent studies have suggested that this "single-object advantage" may be a product of probabilistic and configural strategic prioritizations rather than of object-based perceptual enhancement per se, challenging the underlying mechanism that is thought to give rise to object-based attention. In the present article, we further explore constraints on the mechanisms of object-based selection by examining the contribution of the strength of object representations to the single-object advantage. We manipulated factors such as exposure duration (i.e., preview time) and salience of configuration (i.e., objects). Varying preview time changes the magnitude of the object-based effect, so that if there is ample time to establish an object representation (i.e., preview time of 1,000 msec), then both probability and configuration (i.e., objects) guide attentional selection. If, however, insufficient time is provided to establish a robust object-based representation, then only probabilities guide attentional selection. Interestingly, at a short preview time of 200 msec, when the two objects were sufficiently different from each other (i.e., different colors), both configuration and probability guided attention selection. These results suggest that object-based effects can be explained both in terms of strength of object representations (established at longer exposure durations and by pictorial cues) and probabilistic contingencies in the visual environment.     

Scarcity,engagement, and value

Scarcity has been found to intensify value, positive or negative, rather than simply enhancing it. Some researchers have proposed that scarcity affects value by increasing how much attention is paid to a stimulus. We conceptualized sustained attention as stronger engagement and operationalized a situation of scarcity by telling participants who were choosing between two objects that the object that was chosen would then be replaced (Replenish) or not replaced (Scarce). To distinguish sustained attention-stronger engagement in a situation of scarcity from grabbing attention (salience from distinctiveness), the choice was between one option with a single instance (solitary-high salience) and a second option with several duplicates (abundant-low salience). We predicted that stronger engagement from a situation of scarcity would, first, intensify the value of the chosen item regardless of whether it was solitary or abundant, with positive items becoming more positive and negative items becoming more negative, and second, the stronger engagement from the situation of scarcity would transfer intensification to another separate object in the same setting. The results of Studies 1 and 2 supported both of these predictions. Study 3 tested a boundary condition for these scarcity–engagement effects in terms of how real participants experienced the choice items to be, where ‘realness’ is another source of engagement strength. As expected, the scarcity–engagement effect on intensifying value was replicated for participants who experienced the activity as real but was eliminated for those who did not.     

A new method for calibrating perceptual salience across dimensions in infants: the case of color vs. luminance

We report a new method for calibrating differences in perceptual salience across feature dimensions, in infants. The problem of inter-dimensional salience arises in many areas of infant studies, but a general method for addressing the problem has not previously been described. Our method is based on a preferential looking paradigm, adapted to determine the relative salience of two stimuli. We report here on the case of stimuli differing in color and luminance, though the method has wider potential. We were able to determine on a psychophysical curve the point at which a color contrast was equally salient to infants as a given luminance contrast. We then used these calibrated, 'iso-salient' stimuli in an object memory study. Results showed that 6.5-month-old infants noticed a color, but not a luminance, change while tracking an occluded object. Our method should have numerous applications in the study of bottom-up effects on infant attention and visual working memory.     

How different spatial representations interact in virtual environments: the role of mental frame syncing

This experiment is aimed at understanding how egocentric experiences, allocentric viewpoint-dependent representations, and allocentric viewpoint-independent representations interact when encoding and retrieving a spatial environment. Although several cognitive theories have highlighted the interaction between reference frames, it is less clear about the role of a real-time presentation of allocentric viewpoint-dependent representation on the spatial organization of information. Sixty participants were asked to navigate in two virtual cities to memorize the position of one hidden object. Half of the participants had the possibility to visualize the virtual city with an interactive aerial view. Then, they were required to find the position of the object in three different experimental conditions (“retrieval with an interactive aerial view” vs. “retrieval on a map” vs. “retrieval without an interactive aerial view”). Results revealed that participants were significantly more precise in retrieving the position of the object when immersed in an egocentric experience with the interactive aerial view. The retrieval of spatial information is facilitated by the presence of the interactive aerial view of the city, since it provides a real-time allocentric viewpoint-dependent representation. More participants with high preference for using cardinal points tend to be more accurate when they were asked to retrieve the position of the object on the map. As suggested by the mental frame syncing hypothesis, the presence of an allocentric viewpoint-dependent representation during the retrieval seems to ease the imposition on a specific viewpoint on the stored abstract allocentric viewpoint-independent representation. Our findings represent another significant step toward the comprehension of the organization of spatial representations of our environment.     

Usage of spatial scales for the categorization of faces, objects, and scenes

The role of spatial scales (or spatial frequencies) in the processing of faces, objects, and scenes has recently seen a surge of research activity. In this review, we will critically examine two main theories of scale usage. The fixed theory proposes that spatial scales are used in a fixed, perceptually determined order (coarse to fine). The flexible theory suggests instead that usage of spatial scales is flexible, depending on the requirements of visual information for the categorization task at hand. The implications of the theories are examined for face, object, and scene categorization, attention, perception, and representation.     

Face processing in different brain areas,and critical band masking

Neurophysiological evidence is described showing that some neurons in the macaque inferior temporal visual cortex have responses that are invariant with respect to the position, size, view, and spatial frequency of faces and objects, and that these neurons show rapid processing and rapid learning. Critical band spatial frequency masking is shown to be a property of these face‐selective neurons and of the human visual perception of faces. Which face or object is present is encoded using a distributed representation in which each neuron conveys independent information in its firing rate, with little information evident in the relative time of firing of different neurons. This ensemble encoding has the advantages of maximizing the information in the representation useful for discrimination between stimuli using a simple weighted sum of the neuronal firing by the receiving neurons, generalization, and graceful degradation. These invariant representations are ideally suited to provide the inputs to brain regions such as the orbitofrontal cortex and amygdala that learn the reinforcement associations of an individual's face, for then the learning, and the appropriate social and emotional responses generalize to other views of the same face. A theory is described of how such invariant representations may be produced by self‐organizing learning in a hierarchically organized set of visual cortical areas with convergent connectivity. The theory utilizes either temporal or spatial continuity with an associative synaptic modification rule. Another population of neurons in the cortex in the superior temporal sulcus encodes other aspects of faces such as face expression, eye‐gaze, face view, and whether the head is moving. These neurons thus provide important additional inputs to parts of the brain such as the orbitofrontal cortex and amygdala that are involved in social communication and emotional behaviour. Outputs of these systems reach the amygdala, in which face‐selective neurons are found, and also the orbitofrontal cortex, in which some neurons are tuned to face identity and others to face expression. In humans, activation of the orbitofrontal cortex is found when a change of face expression acts as a social signal that behaviour should change; and damage to the human orbitofrontal and pregenual cingulate cortex can impair face and voice expression identification, and also the reversal of emotional behaviour that normally occurs when reinforcers are reversed.     

Mirror-image confusions: Implications for representation and processing of object orientation

Perceiving the orientation of objects is important for interacting with the world, yet little is known about the mental representation or processing of object orientation information. The tendency of humans and other species to confuse mirror images provides a potential clue. However, the appropriate characterization of this phenomenon is not entirely clear, in part because the stimuli used in most previous studies were not adequate for distinguishing various forms of mirror-image and non-mirror-image error. In the present study we explore the nature of mirror-image confusion and what the phenomenon can reveal about object-orientation representations. We report several experiments in which participants reported the orientations of pictures. In all of the experiments mirror-reflection errors were more frequent than other orientation errors. However, whereas mirror-image confusion has previously been described as a tendency to confuse stimuli that are related by reflection across an extrinsic (usually vertical) axis, the vast majority of mirror-image errors in our experiments were reflections across an object axis. This finding calls into question several hypotheses proposed to explain mirror-image confusion. We describe a coordinate-system orientation representation (COR) hypothesis that can account for our results (McCloskey, Valtonen, & Sherman, 2006). COR assumes that orientation representations map an object-centered reference frame onto a reference frame extrinsic to the object, with this mapping specified by several parameters. According to COR, mirror-image confusions and other orientation errors arise from failures in representing or processing specific parameters. Considered in light of COR, our results suggest that orientation representations are compositional, and that object-centered reference frames play a central role in orientation representation.     

Parts, cavities, and object representation in infancy

Part representation is not only critical to object perception but also plays a key role in a number of basic visual cognition functions, such as figure-ground segregation, allocation of attention, and memory for shapes. Yet, virtually nothing is known about the development of part representation. If parts are fundamental components of object shape representation early in life, then the infant visual system should give priority to parts over other aspects of objects. We tested this hypothesis by examining whether part shapes are more salient than cavity shapes to infants. Five-month-olds were habituated to a stimulus that contained a part and a cavity. In a subsequent novelty preference test, 5-month-olds exhibited a preference for the cavity shape, indicating that part shapes were more salient than cavity shapes during habituation. The differential processing of part versus cavity contours in infancy is consistent with theory and empirical findings in the literature on adult figure-ground perception and indicates that basic aspects of part-based object processing are evident early in life.     

Un modèle neurobiologique de la perception et de l'estimation du temps

Frontal-striatal circuits provide an important neurobiological substrate for timing and time perception as well as for working memory. In this review, we outline recent theoretical and empirical work to suggest that interval timing and working memory rely not only on the same anatomic structures, but also on the same neural representation of a specific stimulus. In the striatal beat-frequency model, cortical neurons fire in an oscillatory fashion to form representations of stimuli, and striatal medium spiny neurons detect those patterns of cortical firing that occur co-incident to important temporal events. Information about stimulus identity can be extracted from the specific cortical networks that are involved in the representation, and information about duration can be extracted from the relative phase of neural firing. The properties derived from these neurobiological models fit well with the psychophysics of timing and time perception as well as with information-processing models that emphasize the importance of temporal coding in a variety of working-memory phenomena.     

Featural selective attention,exemplar representation,and the inverse base-rate effect

Selective attention plays a central role in theories of category learning and representation. In exemplar theory, selective attention has typically been formalized as operating uniformly across entire stimulus dimensions. Selective featural attention operating within dimensions has been recognized as a conceptual possibility, but relatively little research has focused on evaluating it. In the present research, we explored the usefulness of selective featural attention in the context of exemplar representation. We report the results of embedding the feature-to-category relations typically associated with the inverse base-rate effect—a classic and paradoxical category-learning result— perceptual category-learning task using a category structure with three multivalued feature dimensions. An exemplar model incorporating featural selective attention accurately accounted for the inverse base-rate effect that occurred but failed to do so with only dimensional attention.     

The spatial distribution of attention within and across objects

Attention operates to select both spatial locations and perceptual objects. However, the specific mechanism by which attention is oriented to objects is not well understood. We examined the means by which object structure constrains the distribution of spatial attention (i.e., a "grouped array"). Using a modified version of the Egly et al. object cuing task, we systematically manipulated within-object distance and object boundaries. Four major findings are reported: 1) spatial attention forms a gradient across the attended object; 2) object boundaries limit the distribution of this gradient, with the spread of attention constrained by a boundary; 3) boundaries within an object operate similarly to across-object boundaries: we observed object-based effects across a discontinuity within a single object, without the demand to divide or switch attention between discrete object representations; and 4) the gradient of spatial attention across an object directly modulates perceptual sensitivity, implicating a relatively early locus for the grouped array representation.     

Meaning guides attention during scene viewing,even when it is irrelevant

During real-world scene viewing, humans must prioritize scene regions for attention. What are the roles of low-level image salience and high-level semantic meaning in attentional prioritization? A previous study suggested that when salience and meaning are directly contrasted in scene memorization and preference tasks, attentional priority is assigned by meaning (Henderson & Hayes in Nature Human Behavior, 1, 743–747, 2017). Here we examined the role of meaning in attentional guidance using two tasks in which meaning was irrelevant and salience was relevant: a brightness rating task and a brightness search task. Meaning was represented by meaning maps that captured the spatial distribution of semantic features. Meaning was contrasted with image salience, represented by saliency maps. Critically, both maps were represented similarly, allowing us to directly compare how meaning and salience influenced the spatial distribution of attention, as measured by fixation density maps. Our findings suggest that even in tasks for which meaning is irrelevant and salience is relevant, meaningful scene regions are prioritized for attention over salient scene regions. These results support theories in which scene semantics play a dominant role in attentional guidance in scenes.     

Weapon Focus and Gender Differences in Eyewitness Accuracy: Arousal Versus Salience

Competing theories of arousal versus salience and object enhancement vs. reduced perceptual processing as explanations for the weapon focus effect in eyewitness identification were examined. Male and female students ( N = 200) viewed a videotape of a male or female intruder rudely barging into a classroom while carrying a book, a gun, or an unusual object and demanding to know the whereabouts of another student. Feature accuracy recall of both the intruder and the object were assessed on a postexperimental questionnaire. Results supported the salience and reduced-perceptual-processing hypotheses, suggesting that weapon focus may be a special instance of a more general salient object effect. An own-gender bias in eyewitness identification was replicated when no weapon or unusual objects distracted eyewitnesses, but was reversed when a weapon or an unusual object was present.