Observation of another's action but not eye gaze triggers allocentric visual perspective

In the present paper, we investigated whether observation of bodily cues—that is, hand action and eye gaze—can modulate the onlooker's visual perspective taking. Participants were presented with scenes of an actor gazing at an object (or straight ahead) and grasping an object (or not) in a 2?×?2 factorial design and a control condition with no actor in the scene. In Experiment 1, two groups of subjects were explicitly required to judge the left/right location of the target from their own (egocentric group) or the actor's (allocentric group) point of view, whereas in Experiment 2 participants did not receive any instruction on the point of view to assume. In both experiments, allocentric coding (i.e., the actor's point of view) was triggered when the actor grasped the target, but not when he gazed towards it, or when he adopted a neutral posture. In Experiment 3, we demonstrate that the actor's gaze but not action affected participants' attention orienting. The different effects of others' grasping and eye gaze on observers' behaviour demonstrated that specific bodily cues convey distinctive information about other people's intentions.     

Attentional shift by eye gaze requires joint attention: Eye gaze cues are unique to shift attention1

Researchers have demonstrated that attentional shift triggered by gaze direction is reflexive. However, here we show that attentional shift by gaze direction was not always reflexive, but could be modulated by another's perspective. In Experiment 1, a schematic face's line of sight to a peripheral target was obstructed by a vertical barrier located between the face and the target under two conditions. However, the line of sight of the face was clear under another two conditions, in which the barrier was located behind the line of sight by utilizing a depth cue. The gaze cue shifted attention only when the line of sight was not blocked (i.e. joint attention was attained). The arrow cue did not shift attention regardless of the obstruction conditions in Experiment 2. These results suggest that attentional shift by gaze cues, but not arrow cues, involve a higher social cognitive process such as interpretation of the gaze.     

Developmental changes in the control of saccadic eye movements in response to directional eye gaze and arrows

We investigated developmental differences in oculomotor control between 10-year-old children and adults using a central interference task. In this task, the colour of a fixation point instructed participants to saccade either to the left or to the right. These saccade directions were either congruent or incongruent with two types of distractor cue: either the direction of eye gaze of a centrally presented schematic face, or the direction of arrows. Children had greater difficulties inhibiting the distractor cues than did adults, which revealed itself in longer saccade latencies for saccades that were incongruent with the distractor cues as well as more errors on these incongruent trials than on congruent trials. Counter to our prediction, in terms of saccade latencies, both children and adults had greater difficulties inhibiting the arrow than the eye gaze distractors.     

Horizontal eye movements foster approach to negative pictures but do not change emotional valence: A dopaminergic regulation hypothesis

A new dopaminergic regulation hypothesis is proposed based on two experiments exploring eye-movement effects. In the Eye Movement Desensitization and Reprocessing (EMDR) and Saccade-Induced Retrieval Enhancement (SIRE) domains, eye-movement mechanisms are mainly studied with explicit measures. Here implicit and explicit measures of emotion and memory for positive and negative pictures were investigated after eye movements or fixation in extreme right-handers. Eye movements enhanced explicit recognition predominantly for negative pictures. The absence of implicit repetition priming in both experiments supported a dissociation between implicit and explicit memory. Motivational eye-movement effects emerged but implicit and explicit affect remained unchanged. Experiment 2 revealed, after initial freezing to negative pictures, an acceleration, particularly of approach responses. Eye movements are postulated to foster approach towards negative memories, and promote, though dopaminergic pathways from the Superior Colliculus, enhanced explicit memory and active emotion regulation, primarily in persons with a collateralization of eye and dopamine dominance.     

The planning and execution of sequential eye movements: saccades do not show the one target advantage

The present experiment examined the one-target advantage (OTA) with regard to saccadic eye movements. The OTA, previously found with manual pointing responses, refers to the finding that movements are executed faster when the limb is allowed to stop on the target compared to the situation where it has to proceed and hit a second target. Using an adapted limb movement OTA task, saccades of 5 degrees and 15 degrees were made to (a) a single target (one-target), (b) one target and immediately to another target without a change in direction (two-target-extension), and (c) one target and immediately back to the start location (two-target-reversal). Unlike manual movements, the movement times for the initial saccade in the two-target-extension condition were not prolonged compared to either of the other two conditions. Moreover, this pattern of results was found for both the shorter and longer amplitude saccades. The results indicate that the OTA does not occur in the oculomotor system and therefore is not a general motor control phenomenon.     

Incidental learning speeds visual search by lowering response thresholds, not by improving efficiency: evidence from eye movements

When observers search for a target object, they incidentally learn the identities and locations of "background" objects in the same display. This learning can facilitate search performance, eliciting faster reaction times for repeated displays. Despite these findings, visual search has been successfully modeled using architectures that maintain no history of attentional deployments; they are amnesic (e.g., Guided Search Theory). In the current study, we asked two questions: 1) under what conditions does such incidental learning occur? And 2) what does viewing behavior reveal about the efficiency of attentional deployments over time? In two experiments, we tracked eye movements during repeated visual search, and we tested incidental memory for repeated nontarget objects. Across conditions, the consistency of search sets and spatial layouts were manipulated to assess their respective contributions to learning. Using viewing behavior, we contrasted three potential accounts for faster searching with experience. The results indicate that learning does not result in faster object identification or greater search efficiency. Instead, familiar search arrays appear to allow faster resolution of search decisions, whether targets are present or absent.     

Neuro-cognitive mechanisms of decision making in joint action: a human-robot interaction study

In this paper we present a model for action preparation and decision making in cooperative tasks that is inspired by recent experimental findings about the neuro-cognitive mechanisms supporting joint action in humans. It implements the coordination of actions and goals among the partners as a dynamic process that integrates contextual cues, shared task knowledge and predicted outcome of others’ motor behavior. The control architecture is formalized by a system of coupled dynamic neural fields representing a distributed network of local but connected neural populations. Different pools of neurons encode task-relevant information about action means, task goals and context in the form of self-sustained activation patterns. These patterns are triggered by input from connected populations and evolve continuously in time under the influence of recurrent interactions. The dynamic model of joint action is evaluated in a task in which a robot and a human jointly construct a toy object. We show that the highly context sensitive mapping from action observation onto appropriate complementary actions allows coping with dynamically changing joint action situations.     

Claiming a moral minority, saccades help create a biased majority: Tracking eye movements to base rates in social predictions

How do people hold erroneous views about their own moral behavior? This study investigated the use of distributional information in self and social predictions by measuring eye movements to base rates. Across 15 scenarios, participants claimed moral superiority over a comparison peer by predicting that base rates would be less predictive of one’s own behaviors than a comparison peer’s. In support of the differential use of distributional information hypothesis, participants looked less often to base rate information when making self rather than social predictions. Eye movements mediated the relationship between target of the prediction and the strength of the relationship between base rates and behavioral likelihood estimates. Implications for self-deception in self and social judgment are discussed.     

Gibbons (Hylobates pileatus, H. moloch, H. lar, Symphalangus syndactylus) follow human gaze, but do not take the visual perspective of others

We investigated four gibbon species of two different genera (Hylobates pileatus, H. moloch, H. lar, Symphalangus syndactylus) in terms of their looking behavior in response to a human who either looked up or looked at the gibbon. Comparing those two conditions, gibbons as a group looked up more when the human was looking up, but they also performed more looks in other directions and thus generally looked more in this condition. Unlike great apes, gibbons did not respond differently between conditions when only the first look on every trial was considered. Furthermore, they did not perform double looks up to check where the human was looking and also did not habituate to the human’s looks up. This suggests that gibbons co-orient with human gaze, but unlike great apes, they do not take the visual perspective of others.     

Eye movements and spoken language comprehension: effects of visual context on syntactic ambiguity resolution

When participants follow spoken instructions to pick up and move objects in a visual workspace, their eye movements to the objects are closely time-locked to referential expressions in the instructions. Two experiments used this methodology to investigate the processing of the temporary ambiguities that arise because spoken language unfolds over time. Experiment 1 examined the processing of sentences with a temporarily ambiguous prepositional phrase (e.g., "Put the apple on the towel in the box") using visual contexts that supported either the normally preferred initial interpretation (the apple should be put on the towel) or the less-preferred interpretation (the apple is already on the towel and should be put in the box). Eye movement patterns clearly established that the initial interpretation of the ambiguous phrase was the one consistent with the context. Experiment 2 replicated these results using prerecorded digitized speech to eliminate any possibility of prosodic differences across conditions or experimenter demand. Overall, the findings are consistent with a broad theoretical framework in which real-time language comprehension immediately takes into account a rich array of relevant nonlinguistic context.     

In sight, out of mind: the role of eye movements in the rapid resumption of visual search

Three experiments investigated the role of eye movements in the rapid resumption of an interrupted search. Passive monitoring of eye position in Experiment 1 showed that rapid resumption was associated with a short distance between the eye and the target on the next-to-last look before target detection. Experiments 2 and 3 used two different methods for presenting the target to the point of eye fixation on some trials. If eye position alone is predictive, rapid resumption should increase when the target is near fixation. The results showed that gaze-contingent targets increased overall search success, but that the proportion of rapid responses decreased dramatically. We conclude that rather than depending on a high-quality single look at a search target, rapid resumption of search depends on two glances; a first glance in which a hypothesis is formed, and a second glance in which the hypothesis is confirmed.     

Crossmodal transfer of arousal, but not pleasantness, from the musical to the visual domain

Arousal and valence (pleasantness) are considered primary dimensions of emotion. However, the degree to which these dimensions interact in emotional processing across sensory modalities is poorly understood. We addressed this issue by applying a crossmodal priming paradigm in which auditory primes (Romantic piano solo music) varying in arousal and/or pleasantness were sequentially paired with visual targets (IAPS pictures). In Experiment 1, the emotion spaces of 120 primes and 120 targets were explored separately in addition to the effects of musical training and gender. Thirty-two participants rated their felt pleasantness and arousal in response to primes and targets on equivalent rating scales as well as their familiarity with the stimuli. Musical training was associated with elevated familiarity ratings for high-arousing music and a trend for elevated arousal ratings, especially in response to unpleasant musical stimuli. Males reported higher arousal than females for pleasant visual stimuli. In Experiment 2, 40 nonmusicians rated their felt arousal and pleasantness in response to 20 visual targets after listening to 80 musical primes. Arousal associated with the musical primes modulated felt arousal in response to visual targets, yet no such transfer of pleasantness was observed between the two modalities. Experiment 3 sought to rule out the possibility of any order effect of the subjective ratings, and responses of 14 nonmusicians replicated results of Experiment 2. This study demonstrates the effectiveness of the crossmodal priming paradigm in basic research on musical emotions.     

Impulse processing: a dynamical systems model of incremental eye movements in the visual world paradigm

The Visual World Paradigm (VWP) presents listeners with a challenging problem: They must integrate two disparate signals, the spoken language and the visual context, in support of action (e.g., complex movements of the eyes across a scene). We present Impulse Processing, a dynamical systems approach to incremental eye movements in the visual world that suggests a framework for integrating language, vision, and action generally. Our approach assumes that impulses driven by the language and the visual context impinge minutely on a dynamical landscape of attractors corresponding to the potential eye-movement behaviors of the system. We test three unique predictions of our approach in an empirical study in the VWP, and describe an implementation in an artificial neural network. We discuss the Impulse Processing framework in relation to other models of the VWP.     

The development of perceptual averaging: learning what to do,not just how to do it

The mature visual system condenses complex scenes into simple summary statistics (e.g., average size, location, orientation, etc.). However, children, often perform poorly on perceptual averaging tasks. Children's difficulties are typically thought to represent the suboptimal implementation of an adult‐like strategy. This paper examines another possibility: that children actually make decisions in a qualitatively different way to adults (optimal implementation of a non‐ideal strategy). Ninety children (6–7, 8–9, 10–11 years) and 30 adults were asked to locate the middle of randomly generated dot‐clouds. Nine plausible decision strategies were formulated, and each was fitted to observers' trial‐by‐trial response data (Reverse Correlation). When the number of visual elements was low (N < 6), children used a qualitatively different decision strategy from adults: appearing to “join up the dots” and locate the gravitational center of the enclosing shape. Given denser displays, both children and adults used an ideal strategy of arithmetically averaging individual points. Accounting for this difference in decision strategy explained 29% of children's lower precision. These findings suggest that children are not simply suboptimal at performing adult‐like computations, but may at times use sensible, but qualitatively different strategies to make perceptual judgments. Learning which strategy is best in which circumstance might be an important driving factor of perceptual development.     

A moving video window or mask yoked to eye movements: A system to permit free ocular scanning within delimited areas of the visual field

A system is described for generating a video window or mask that is yoked to a subject’s eye movements and that can be used to mask off either the left or the right visual field, while still permitting prolonged examination of simple or complex visual stimuli. It can also be used to simulate various visual field defects or scotomata and to ensure that subjects maintain fixation during extended stimulus presentations. Circuitry is provided, and two additional options are suggested.     

What to do and how to do it: sequence learning of action effects and transformation rules

Many goal-oriented actions, for example in tool use, can be characterized by the involvement of two components: The effect that the acting person wants to achieve and the transformation rule that defines the relationship between a bodily movement and the associated action effect. Both in conjunction specify the concrete action that has to be executed. In our experiments, we utilized a sequence learning paradigm to investigate whether these components are represented separately or are bound together to form a more holistic representation of the action. Participants switched between different transformation rules to achieve certain action effects. In one group, there was a fixed sequence of action effects, with randomly varying transformation rules. In the other group, the sequence of transformation rules was fixed, whereas the action effects were randomly varying. Results indicate that both kinds of sequences can be learned and provide evidence for the notion that transformation rules and action effects are represented separately.     

More to it than meets the eye: how eye movements can elucidate the development of episodic memory

The ability to recognise past events along with the contexts in which they occurred is a hallmark of episodic memory, a critical capacity. Eye movements have been shown to track veridical memory for the associations between events and their contexts (relational binding). Such eye-movement effects emerge several seconds before, or in the absence of, explicit response, and are linked to the integrity and function of the hippocampus. Drawing from research from infancy through late childhood, and by comparing to investigations from typical adults, patient populations, and animal models, it seems increasingly clear that eye movements reflect item–item, item–temporal, and item–spatial associations in developmental populations. We analyse this line of work, identify missing pieces in the literature and outline future avenues of research, in order to help elucidate the development of episodic memory.     

Directing gaze: The effect of disclaimer labels on women's visual attention to fashion magazine advertisements

In an effort to combat the known negative effects of exposure to unrealistic thin ideal images, there is increasing worldwide pressure on fashion, media and advertising industries to disclose when images have been digitally altered. The current study used eye tracking technology to investigate experimentally how digital alteration disclaimer labels impact women's visual attention to fashion magazine advertisements. Participants were 60 female undergraduate students who viewed four thin ideal advertisements with either no disclaimer, a generic disclaimer, or a specific more detailed disclaimer. It was established that women did attend to the disclaimers. The nature of the disclaimer had no effect on time spent looking at particular body parts, but did affect the direction of gaze following reading of the disclaimer. This latter effect was found to be greater for women high on trait appearance comparison. Further research is paramount in guiding effective policy around the use of disclaimer labels.     

Spatial representation in body coordinates: evidence from errors in remembering positions of visual and auditory targets after active eye, head, and body movements.

Eight participants were presented with auditory or visual targets and then indicated the target's remembered positions relative to their head eight seconds after actively moving their eyes, head or body to pull apart head, retinal, body, and external space reference frames. Remembered target position was indicated by repositioning sounds or lights. Localization errors were found related to head-on-body position but not of eye-in-head or body-in-space for both auditory (0.023 dB/deg in the direction of head displacement) and visual targets (0.068 deg/deg in the direction opposite to head displacement). The results indicate that both auditory and visual localization use head-on-body information, suggesting a common coding into body coordinates--the only conversion that requires this information.