Scrutinizing visual images: The role of gaze in mental imagery and memory

Gaze was monitored by use of an infrared remote eye-tracker during perception and imagery of geometric forms and figures of animals. Based on the idea that gaze prioritizes locations where features with high information content are visible, we hypothesized that eye fixations should focus on regions that contain one or more local features that are relevant for object recognition. Most importantly, we predicted that when observers looked at an empty screen and at the same time generated a detailed visual image of what they had previously seen, their gaze would probabilistically dwell within regions corresponding to the original positions of salient features or parts. Correlation analyses showed positive relations between gaze’s dwell time within locations visited during perception and those in which gaze dwelled during the imagery generation task. Moreover, the more faithful an observer’s gaze enactment, the more accurate was the observer’s memory, in a separate test, of the dimension or size in which the forms had been perceived. In another experiment, observers saw a series of pictures of animals and were requested to memorize them. They were then asked later, in a recall phase, to answer a question about a property of one of the encoded forms; it was found that, when retrieving from long-term memory a previously seen picture, gaze returned to the location of the part probed by the question. In another experimental condition, the observers were asked to maintain fixation away from the original location of the shape while thinking about the answer, so as to interfere with the gaze enactment process; such a manipulation resulted in measurable costs in the quality of memory. We conclude that the generation of mental images relies upon a process of enactment of gaze that can be beneficial to visual memory.     

Time in the eye of the beholder: Gaze position reveals spatial-temporal associations during encoding and memory retrieval of future and past

Time is grounded in various ways, and previous studies point to a “mental time line” with past associated with the left, and future with the right side. In this study, we investigated whether spontaneous eye movements on a blank screen would follow a mental timeline during encoding, free recall, and recognition of past and future items. In all three stages of processing, gaze position was more rightward during future items compared to past items. Moreover, horizontal gaze position during encoding predicted horizontal gaze position during free recall and recognition. We conclude that mental time line and the stored gaze position during encoding assist memory retrieval of past versus future items. Our findings highlight the spatial nature of temporal representations.     

The Simulation of Smiles (SIMS) model: Embodied simulation and the meaning of facial expression

Recent application of theories of embodied or grounded cognition to the recognition and interpretation of facial expression of emotion has led to an explosion of research in psychology and the neurosciences. However, despite the accelerating number of reported findings, it remains unclear how the many component processes of emotion and their neural mechanisms actually support embodied simulation. Equally unclear is what triggers the use of embodied simulation versus perceptual or conceptual strategies in determining meaning. The present article integrates behavioral research from social psychology with recent research in neurosciences in order to provide coherence to the extant and future research on this topic. The roles of several of the brain's reward systems, and the amygdala, somatosensory cortices, and motor centers are examined. These are then linked to behavioral and brain research on facial mimicry and eye gaze. Articulation of the mediators and moderators of facial mimicry and gaze are particularly useful in guiding interpretation of relevant findings from neurosciences. Finally, a model of the processing of the smile, the most complex of the facial expressions, is presented as a means to illustrate how to advance the application of theories of embodied cognition in the study of facial expression of emotion.     

Visible embodiment: Gestures as simulated action

Spontaneous gestures that accompany speech are related to both verbal and spatial processes. We argue that gestures emerge from perceptual and motor simulations that underlie embodied language and mental imagery. We first review current thinking about embodied cognition, embodied language, and embodied mental imagery. We then provide evidence that gestures stem from spatial representations and mental images. We then propose the gestures-as-simulated-action framework to explain how gestures might arise from an embodied cognitive system. Finally, we compare this framework with other current models of gesture production, and we briefly outline predictions that derive from the framework.     

Understanding the directedness of gaze: three ways of doing it

It is argued that alongside the mentalistic and the behaviouristic forms, there is a third kind of gaze understanding. Gaze may be understood to be subjective in the sense that there can be diversity across self and other in terms of what is seen, without it being understood to be representational. This form of gaze understanding is more consistent with the evidence on toddlers' understanding of gaze and may well represent a developmentally intermediate form between the behaviouristic and mentalistic forms discussed in the target article. Copyright © 2006 John Wiley & Sons, Ltd.     

Art, dreams and active imagination: a post-Jungian approach to transference and the image

The term active imagination is sometimes applied rather uncritically to describe all forms of creative activity that take place in depth psychology. Whilst there are many forms of expression that evoke or are evoked by active imagination, they cannot automatically be classed as active imagination. In this article investigation of visualized mental imagery, dreams and art reveals three distinct forms of image-based psychological activity. Integrated and mediated within the transference and countertransference dynamic, it is proposed that the engagement in active imagination reflects and is influenced by the transference. Distinctions between sign and symbol, simple and big dreams as well as diagrammatic and embodied imagery clarify the differences. Examples from clinical practice demonstrate each mode in action within the analytic frame.     

Geometrical gaze following in common marmosets (Callithrix jacchus)

A series of experiments investigating the degree of gaze understanding in common marmosets (Callithrix jacchus) is reported. Results show that marmosets follow the gaze of a human experimenter readily and also use the gaze to locate food in a modified version of the object choice task if influences of chance probabilities and prepotent response tendencies are controlled for. In addition, this new version of the task allows the assessment of the accuracy of gaze following. Marmosets precisely extrapolate gaze direction, past distracting objects and from considerable distances, thereby meeting the criteria of so-called geometrical gaze following. The presence of this ability in common marmosets suggests that higher forms of gaze following might be more widely distributed among nonhuman primates than previously thought.     

Why does the gaze of others direct visual attention?

Viewing another person directing his or her gaze can produce automatic shifts of covert visual attention in the same direction. This holds true even when the task‐relevant target is much more likely to occur at the uncued location. These findings, along with other evidence, have been taken to suggest that gaze represents a “special” stimulus—the foundation of a social cognition system that can make inferences about the mental states of other people. However, gaze‐driven cueing effects could simply be due to spatial compatibility between cue and target. We compared the attentional effects of gaze shifts to a face with the tongue extended laterally to the left or right. When tongue direction was a nonpredictive cue, we found cueing effects from tongues that were indistinguishable from those produced by gaze. However, in contrast to previous findings with gaze, tongue cues did not overcome a validity manipulation in which targets were four times more likely to appear at the uncued location. We conclude that simple attentional cueing effects from gaze may be better explained by spatial compatibility, and that more complex, unique features of cueing from gaze may be better indices into perceptual systems specialized for social cognition.     

权力具身效应的影响因素及机制

具身认知为人们解读“权力”提供了新的理论基础和方法论,但以往多数研究强调语言层面上权力的概念表征,较少关注权力的社会具身效应。本文通过梳理国内外权力具身认知研究的文献,从情境、文化因素、个体因素等方面分析权力具身效应的影响因素,并揭示身体经验影响权力认知和行为的心理机制和过程——模态启动。在此基础上进一步明确未来的研究方向,应从社会具身效应的作用机制、多重心理机制、权力具身效应的神经机制、应用研究等方面进行深入研究。     

Orienting to eye gaze and face processing

The author conducted 7 experiments to examine possible interactions between orienting to eye gaze and specific forms of face processing. Participants classified a letter following either an upright or inverted face with averted, uninformative eye gaze. Eye gaze orienting effects were recorded for upright and inverted faces, irrespective of whether the faces were simple, schematic faces or more realistic faces. In contrast, inversion affected orienting to targets appearing along the vertical axis. Switching the contrast between the iris and sclera reversed orienting to eye gaze. Lifting the eyelid to expose more of the iris-sclera contrast led to a potentiation of orienting to eye gaze. Raising the eyebrow alone without the eyelid did not affect orienting. The findings suggest that local perceptual information is critical for orienting to eye gaze and that the effect can occur with a degree of independence from certain types of face processing.     

Memory and attention for social threat: anxious hypercoding-avoidance and submissive gaze aversion

Rivalry for dominance is a recurrent challenge in human social interaction. During these social dominance interactions, some people rapidly break eye contact, whereas others merely try to avoid such eye-to-eye confrontations. The first is an example of submissive gaze aversion, whereas the second reflects anxious gaze avoidance. We tested these distinct forms of gaze behavior within a social-memory setting and show that anxious individuals vigilantly attend to, superiorly remember, and subsequently avoid social threats (i.e., angry faces). Furthermore, submissive individuals, as indexed by high trait anxiety and low trait anger, exhibit rapid gaze aversion from facial anger. Mechanisms of hypervigilance-avoidance thus seem to underlie natural gaze behavior and enhanced memory for threat in anxiety. Accordingly, we propose the term hypercoding-avoidance, which describes how anxious individuals habitually scan their immediate social environment for threat, remember its location, and subsequently avoid it. Moreover, this is the first experimental evidence showing that submissive gaze aversion is distinct from anxious gaze avoidance.     

The 'body–container': A new perspective on the 'body–ego'

Psychoanalytic theory and practice tend to focus on metaphorical and symbolic mental representations in a way that often pushes aside the importance of a bodily 'presence' possessing qualities that can not and should not be subordinated to the representational structure. By introducing the 'body – container' model, this paper reintroduces the concrete physical body into the psychoanalytic discourse in a more direct way. This clinical – theoretical model links the 'body-ego' ( Freud, 1923 ) to the container idea ( Bion, 1962 ) aiming to creates a new integrative psyche-soma scheme. The 'body – container' experience is available as a subjective realization through a priori psycho-physical forms structured as an envelope and a central vertical axis. These forms are the outcome of our given bodily structure experienced under the 'magnetic' force of object relation. The mental envelope is already discussed in psychoanalytic theory ( Anzieu, 1989, 1990 ; Bick, 1968 ) and I wish to introduce the characteristics of the vertical axis which I call 'the frontal spine', emphasizing its constitutional reciprocity with the skin envelope. The proposed model offers new insights into the psycho-physical organization in primitive mental states and may contribute to the understanding of the complementary structural relation between embodied and represented in human experience. Two clinical examples illustrate the therapeutic work relevant to disturbances in the primal psycho-physical space organization at different developmental levels.     

Mental-state attribution drives rapid, reflexive gaze following

When presented with a face stimulus whose gaze is diverted, observers’ attention shifts to locations fixated by the face. Such “gaze following” has been characterized by some previous studies as a consequence of sophisticated theory of mind processes, but by others (particularly those employing the “gaze-cuing” paradigm) as an involuntary response that is triggered directly and reflexively by the physical features of a face. To address this apparent contradiction, we modified the gaze-cuing paradigm using a deception procedure to convince observers that prerecorded videos of an experimenter making head turns and wearing mirrored goggles were a “live” video link to an adjacent room. In two experiments, reflexive gaze following was found when observers believed that the model was wearing transparent goggles and could see, but it was significantly reduced when they believed that the experimenter wore opaque goggles and could not see. These results indicate that the attribution of the mental state “seeing” to a face plays a role in controlling even reflexive gaze following.     

Embodied female experience through the lens of imagination

Abstract: In 1971, I made a film entitled Self Portrait of a Nude Model Turned Cinematographer in which I explore the objectifying ‘male’ gaze on my body in contrast to the subjective lived experience of my body. The film was a radical challenge to the gaze that objectifies woman – and thus imprisons her – which had hitherto dominated narrative cinema. Since the objectification of women has largely excluded us from the privileged phallogocentric discourses, in this paper I hope to bring into the psychoanalytic dialogue a woman's lived experience. I will approach this by exploring how remembering this film has become a personally transformative experience as I look back on it through the lens of postmodern and feminist discourses that have emerged since it was made. In addition, I will explore how this process of imaginatively looking back on an artistic creation to generate new discourses in the present is similar to the transformative process of analysis. Lastly, I will present a clinical example, where my embodied countertransference response to a patient's subjection to the objectifying male gaze opens space for a new discourse about her body to emerge.     

The role of maternal affect attunement in dyadic and triadic communication

The influence of maternal affect attunement on the relationship between gaze monitoring during dyadic communication at 3 months and coordinated attention during triadic communication at 5, 7 and 10 months was examined in a longitudinal study. Although most infants engaged in gaze monitoring at 3 months and in coordinated attention at 5, 7 and 10 months, a regression analysis revealed that gaze monitoring at 3 months significantly predicted coordinated attention at 10 months only when maternal affect attunement was high. These findings are discussed in terms of theories that emphasize the role of social interaction in the development of meaningful communication and continuity in mental state awareness during the first year of life.     

Synthetic Neuroethology

Computation and philosophy intersect three times in this essay. Computation is considered as an object, as a method, and as a model used in a certain line of philosophical inquiry concerning the relation of mind to matter. As object, the question considered is whether computation and related notions of mental representation constitute the best ways to conceive of how physical systems give rise to mental properties. As method and model, the computational techniques of artificial life and embodied evolutionary connectionism are used to conduct prosthetically enhanced thought experiments concerning the evolvability of mental representations. Central to this essay is a discussion of the computer simulation and evolution of three-dimensional synthetic animals with neural network controllers. The minimally cognitive behavior of finding food by exhibiting positive chemotaxis is simulated with swimming and walking creatures. These simulations form the basis of a discussion of the evolutionary and neurocomputational bases of the incremental emergence of more complex forms of cognition. Other related work has been used to attack computational and representational theories of cognition. In contrast, I argue that the proper understanding of the evolutionary emergence of minimally cognitive behaviors is computational and representational through and through.     

The development of fine-grained sensitivity to eye contact after 6 years of age

Adults use eye contact as a cue to the mental and emotional states of others. Here, we examined developmental changes in the ability to discriminate between eye contact and averted gaze. Children (6-, 8-, 10-, and 14-year-olds) and adults (n=18/age) viewed photographs of a model fixating the center of a camera lens and a series of positions to the left/right or upward/downward and judged whether the model's gaze was direct or averted to the left/right or upward/downward. The horizontal range of fixation positions leading to the perception of direct gaze (the cone of gaze) was more than 50% larger in 6-year-olds than in adults, but it was adult-like and smaller than the vertical cone of gaze by 8 years of age. The vertical cone of gaze was large and statistically adult-like by age 6, with only a small linear reduction thereafter. In all age groups, the horizontal cone of gaze was centered on the bridge of the participant's nose and the vertical cone was centered slightly below the participant's eye height. These findings indicate that until after age 6, relatively poor sensitivity to direct versus averted gaze limits children's ability to use gaze cues to make social judgments.     

What is so special about embodied simulation?

Simulation theories of social cognition abound in the literature, but it is often unclear what simulation means and how it works. The discovery of mirror neurons, responding both to action execution and observation, suggested an embodied approach to mental simulation. Over the past few years this approach has been hotly debated and alternative accounts have been proposed. We discuss these accounts and argue that they fail to capture the uniqueness of embodied simulation (ES). ES theory provides a unitary account of basic social cognition, demonstrating that people reuse their own mental states or processes represented with a bodily format in functionally attributing them to others.     

I see what you’re saying: Voice signals influence children’s judgments of direct and averted gaze

Adults use gaze and voice signals as cues to the mental and emotional states of others. We examined the influence of voice cues on children’s judgments of gaze. In Experiment 1, 6-year-olds, 8-year-olds, and adults viewed photographs of faces fixating the center of the camera lens and a series of positions to the left and right and judged whether gaze was direct or averted. On each trial, participants heard the participant-directed voice cue (e.g., “I see you”), an object-directed voice cue (e.g., “I see that”), or no voice. In 6-year-olds, the range of directions of gaze leading to the perception of eye contact (the cone of gaze) was narrower for trials with object-directed voice cues than for trials with participant-directed voice cues or no voice. This effect was absent in 8-year-olds and adults, both of whom had a narrower cone of gaze than 6-year-olds. In Experiment 2, we investigated whether voice cues would influence adults’ judgments of gaze when the task was made more difficult by limiting the duration of exposure to the face. Adults’ cone of gaze was wider than in Experiment 1, and the effect of voice cues was similar to that observed in 6-year-olds in Experiment 1. Together, the results indicate that object-directed voice cues can decrease the width of the cone of gaze, allowing more adult-like judgments of gaze in young children, and that voice cues may be especially effective when the cone of gaze is wider because of immaturity (Experiment 1) or limited exposure (Experiment 2).     

Are you looking at me? Eye gaze and person perception

Previous research has highlighted the pivotal role played by gaze detection and interpretation in the development of social cognition. Extending work of this kind, the present research investigated the effects of eye gaze on basic aspects of the person–perception process, namely, person construal and the extraction of category–related knowledge from semantic memory. It was anticipated that gaze direction would moderate the efficiency of the mental operations through which these social–cognitive products are generated. Specifically, eye gaze was expected to influence both the speed with which targets could be categorized as men and women and the rate at which associated stereotypic material could be accessed from semantic memory. The results of two experiments supported these predictions: Targets with nondeviated (i.e., direct) eye gaze elicited facilitated categorical responses. The implications of these findings for recent treatments of person perception are considered.