Observation of another's action but not eye gaze triggers allocentric visual perspective

In the present paper, we investigated whether observation of bodily cues—that is, hand action and eye gaze—can modulate the onlooker's visual perspective taking. Participants were presented with scenes of an actor gazing at an object (or straight ahead) and grasping an object (or not) in a 2?×?2 factorial design and a control condition with no actor in the scene. In Experiment 1, two groups of subjects were explicitly required to judge the left/right location of the target from their own (egocentric group) or the actor's (allocentric group) point of view, whereas in Experiment 2 participants did not receive any instruction on the point of view to assume. In both experiments, allocentric coding (i.e., the actor's point of view) was triggered when the actor grasped the target, but not when he gazed towards it, or when he adopted a neutral posture. In Experiment 3, we demonstrate that the actor's gaze but not action affected participants' attention orienting. The different effects of others' grasping and eye gaze on observers' behaviour demonstrated that specific bodily cues convey distinctive information about other people's intentions.     

Developmental changes in the control of saccadic eye movements in response to directional eye gaze and arrows

We investigated developmental differences in oculomotor control between 10-year-old children and adults using a central interference task. In this task, the colour of a fixation point instructed participants to saccade either to the left or to the right. These saccade directions were either congruent or incongruent with two types of distractor cue: either the direction of eye gaze of a centrally presented schematic face, or the direction of arrows. Children had greater difficulties inhibiting the distractor cues than did adults, which revealed itself in longer saccade latencies for saccades that were incongruent with the distractor cues as well as more errors on these incongruent trials than on congruent trials. Counter to our prediction, in terms of saccade latencies, both children and adults had greater difficulties inhibiting the arrow than the eye gaze distractors.     

The planning and execution of sequential eye movements: saccades do not show the one target advantage

The present experiment examined the one-target advantage (OTA) with regard to saccadic eye movements. The OTA, previously found with manual pointing responses, refers to the finding that movements are executed faster when the limb is allowed to stop on the target compared to the situation where it has to proceed and hit a second target. Using an adapted limb movement OTA task, saccades of 5 degrees and 15 degrees were made to (a) a single target (one-target), (b) one target and immediately to another target without a change in direction (two-target-extension), and (c) one target and immediately back to the start location (two-target-reversal). Unlike manual movements, the movement times for the initial saccade in the two-target-extension condition were not prolonged compared to either of the other two conditions. Moreover, this pattern of results was found for both the shorter and longer amplitude saccades. The results indicate that the OTA does not occur in the oculomotor system and therefore is not a general motor control phenomenon.     

Neuro-cognitive mechanisms of decision making in joint action: a human-robot interaction study

In this paper we present a model for action preparation and decision making in cooperative tasks that is inspired by recent experimental findings about the neuro-cognitive mechanisms supporting joint action in humans. It implements the coordination of actions and goals among the partners as a dynamic process that integrates contextual cues, shared task knowledge and predicted outcome of others’ motor behavior. The control architecture is formalized by a system of coupled dynamic neural fields representing a distributed network of local but connected neural populations. Different pools of neurons encode task-relevant information about action means, task goals and context in the form of self-sustained activation patterns. These patterns are triggered by input from connected populations and evolve continuously in time under the influence of recurrent interactions. The dynamic model of joint action is evaluated in a task in which a robot and a human jointly construct a toy object. We show that the highly context sensitive mapping from action observation onto appropriate complementary actions allows coping with dynamically changing joint action situations.     

Incidental learning speeds visual search by lowering response thresholds, not by improving efficiency: evidence from eye movements

When observers search for a target object, they incidentally learn the identities and locations of "background" objects in the same display. This learning can facilitate search performance, eliciting faster reaction times for repeated displays. Despite these findings, visual search has been successfully modeled using architectures that maintain no history of attentional deployments; they are amnesic (e.g., Guided Search Theory). In the current study, we asked two questions: 1) under what conditions does such incidental learning occur? And 2) what does viewing behavior reveal about the efficiency of attentional deployments over time? In two experiments, we tracked eye movements during repeated visual search, and we tested incidental memory for repeated nontarget objects. Across conditions, the consistency of search sets and spatial layouts were manipulated to assess their respective contributions to learning. Using viewing behavior, we contrasted three potential accounts for faster searching with experience. The results indicate that learning does not result in faster object identification or greater search efficiency. Instead, familiar search arrays appear to allow faster resolution of search decisions, whether targets are present or absent.     

Claiming a moral minority, saccades help create a biased majority: Tracking eye movements to base rates in social predictions

How do people hold erroneous views about their own moral behavior? This study investigated the use of distributional information in self and social predictions by measuring eye movements to base rates. Across 15 scenarios, participants claimed moral superiority over a comparison peer by predicting that base rates would be less predictive of one’s own behaviors than a comparison peer’s. In support of the differential use of distributional information hypothesis, participants looked less often to base rate information when making self rather than social predictions. Eye movements mediated the relationship between target of the prediction and the strength of the relationship between base rates and behavioral likelihood estimates. Implications for self-deception in self and social judgment are discussed.     

Gibbons (Hylobates pileatus, H. moloch, H. lar, Symphalangus syndactylus) follow human gaze, but do not take the visual perspective of others

We investigated four gibbon species of two different genera (Hylobates pileatus, H. moloch, H. lar, Symphalangus syndactylus) in terms of their looking behavior in response to a human who either looked up or looked at the gibbon. Comparing those two conditions, gibbons as a group looked up more when the human was looking up, but they also performed more looks in other directions and thus generally looked more in this condition. Unlike great apes, gibbons did not respond differently between conditions when only the first look on every trial was considered. Furthermore, they did not perform double looks up to check where the human was looking and also did not habituate to the human’s looks up. This suggests that gibbons co-orient with human gaze, but unlike great apes, they do not take the visual perspective of others.     

Eye movements and spoken language comprehension: effects of visual context on syntactic ambiguity resolution

When participants follow spoken instructions to pick up and move objects in a visual workspace, their eye movements to the objects are closely time-locked to referential expressions in the instructions. Two experiments used this methodology to investigate the processing of the temporary ambiguities that arise because spoken language unfolds over time. Experiment 1 examined the processing of sentences with a temporarily ambiguous prepositional phrase (e.g., "Put the apple on the towel in the box") using visual contexts that supported either the normally preferred initial interpretation (the apple should be put on the towel) or the less-preferred interpretation (the apple is already on the towel and should be put in the box). Eye movement patterns clearly established that the initial interpretation of the ambiguous phrase was the one consistent with the context. Experiment 2 replicated these results using prerecorded digitized speech to eliminate any possibility of prosodic differences across conditions or experimenter demand. Overall, the findings are consistent with a broad theoretical framework in which real-time language comprehension immediately takes into account a rich array of relevant nonlinguistic context.     

In sight, out of mind: the role of eye movements in the rapid resumption of visual search

Three experiments investigated the role of eye movements in the rapid resumption of an interrupted search. Passive monitoring of eye position in Experiment 1 showed that rapid resumption was associated with a short distance between the eye and the target on the next-to-last look before target detection. Experiments 2 and 3 used two different methods for presenting the target to the point of eye fixation on some trials. If eye position alone is predictive, rapid resumption should increase when the target is near fixation. The results showed that gaze-contingent targets increased overall search success, but that the proportion of rapid responses decreased dramatically. We conclude that rather than depending on a high-quality single look at a search target, rapid resumption of search depends on two glances; a first glance in which a hypothesis is formed, and a second glance in which the hypothesis is confirmed.     

Crossmodal transfer of arousal, but not pleasantness, from the musical to the visual domain

Arousal and valence (pleasantness) are considered primary dimensions of emotion. However, the degree to which these dimensions interact in emotional processing across sensory modalities is poorly understood. We addressed this issue by applying a crossmodal priming paradigm in which auditory primes (Romantic piano solo music) varying in arousal and/or pleasantness were sequentially paired with visual targets (IAPS pictures). In Experiment 1, the emotion spaces of 120 primes and 120 targets were explored separately in addition to the effects of musical training and gender. Thirty-two participants rated their felt pleasantness and arousal in response to primes and targets on equivalent rating scales as well as their familiarity with the stimuli. Musical training was associated with elevated familiarity ratings for high-arousing music and a trend for elevated arousal ratings, especially in response to unpleasant musical stimuli. Males reported higher arousal than females for pleasant visual stimuli. In Experiment 2, 40 nonmusicians rated their felt arousal and pleasantness in response to 20 visual targets after listening to 80 musical primes. Arousal associated with the musical primes modulated felt arousal in response to visual targets, yet no such transfer of pleasantness was observed between the two modalities. Experiment 3 sought to rule out the possibility of any order effect of the subjective ratings, and responses of 14 nonmusicians replicated results of Experiment 2. This study demonstrates the effectiveness of the crossmodal priming paradigm in basic research on musical emotions.     

Impulse processing: a dynamical systems model of incremental eye movements in the visual world paradigm

The Visual World Paradigm (VWP) presents listeners with a challenging problem: They must integrate two disparate signals, the spoken language and the visual context, in support of action (e.g., complex movements of the eyes across a scene). We present Impulse Processing, a dynamical systems approach to incremental eye movements in the visual world that suggests a framework for integrating language, vision, and action generally. Our approach assumes that impulses driven by the language and the visual context impinge minutely on a dynamical landscape of attractors corresponding to the potential eye-movement behaviors of the system. We test three unique predictions of our approach in an empirical study in the VWP, and describe an implementation in an artificial neural network. We discuss the Impulse Processing framework in relation to other models of the VWP.     

What to do and how to do it: sequence learning of action effects and transformation rules

Many goal-oriented actions, for example in tool use, can be characterized by the involvement of two components: The effect that the acting person wants to achieve and the transformation rule that defines the relationship between a bodily movement and the associated action effect. Both in conjunction specify the concrete action that has to be executed. In our experiments, we utilized a sequence learning paradigm to investigate whether these components are represented separately or are bound together to form a more holistic representation of the action. Participants switched between different transformation rules to achieve certain action effects. In one group, there was a fixed sequence of action effects, with randomly varying transformation rules. In the other group, the sequence of transformation rules was fixed, whereas the action effects were randomly varying. Results indicate that both kinds of sequences can be learned and provide evidence for the notion that transformation rules and action effects are represented separately.     

A moving video window or mask yoked to eye movements: A system to permit free ocular scanning within delimited areas of the visual field

A system is described for generating a video window or mask that is yoked to a subject’s eye movements and that can be used to mask off either the left or the right visual field, while still permitting prolonged examination of simple or complex visual stimuli. It can also be used to simulate various visual field defects or scotomata and to ensure that subjects maintain fixation during extended stimulus presentations. Circuitry is provided, and two additional options are suggested.     

Directing gaze: The effect of disclaimer labels on women's visual attention to fashion magazine advertisements

In an effort to combat the known negative effects of exposure to unrealistic thin ideal images, there is increasing worldwide pressure on fashion, media and advertising industries to disclose when images have been digitally altered. The current study used eye tracking technology to investigate experimentally how digital alteration disclaimer labels impact women's visual attention to fashion magazine advertisements. Participants were 60 female undergraduate students who viewed four thin ideal advertisements with either no disclaimer, a generic disclaimer, or a specific more detailed disclaimer. It was established that women did attend to the disclaimers. The nature of the disclaimer had no effect on time spent looking at particular body parts, but did affect the direction of gaze following reading of the disclaimer. This latter effect was found to be greater for women high on trait appearance comparison. Further research is paramount in guiding effective policy around the use of disclaimer labels.     

Spatial representation in body coordinates: evidence from errors in remembering positions of visual and auditory targets after active eye, head, and body movements.

Eight participants were presented with auditory or visual targets and then indicated the target's remembered positions relative to their head eight seconds after actively moving their eyes, head or body to pull apart head, retinal, body, and external space reference frames. Remembered target position was indicated by repositioning sounds or lights. Localization errors were found related to head-on-body position but not of eye-in-head or body-in-space for both auditory (0.023 dB/deg in the direction of head displacement) and visual targets (0.068 deg/deg in the direction opposite to head displacement). The results indicate that both auditory and visual localization use head-on-body information, suggesting a common coding into body coordinates--the only conversion that requires this information.     

Assignment of reference to reflexives and pronouns in picture noun phrases: evidence from eye movements

Most structural Binding Theories predict a complementary distribution between reflexives and pronouns in picture noun phrases containing possessors (e.g. "Ken's picture of himself/him"). In two head-mounted eye-tracking experiments, listeners frequently violated Binding Theory predictions for reflexives, often interpreting the reflexives as taking an antecedent outside of the binding domain, and violating complementarity assumptions. Moreover, the pattern and timing of the eye movements showed Binding Theory violations for reflexives during the earliest moments of reference resolution. The results demonstrate that either binding constraints must be reformulated to decouple pronouns and reflexives or all reflexives in picture noun phrases must be treated as logophors, and thus exempt from structural Binding Theory.     

EMDR: eye movements superior to beeps in taxing working memory and reducing vividness of recollections

Posttraumatic stress disorder (PTSD) is effectively treated with eye movement desensitization and reprocessing (EMDR) with patients making eye movements during recall of traumatic memories. Many therapists have replaced eye movements with bilateral beeps, but there are no data on the effects of beeps. Experimental studies suggest that eye movements may be beneficial because they tax working memory, especially the central executive component, but the presence/degree of taxation has not been assessed directly. Using discrimination Reaction Time (RT) tasks, we found that eye movements slow down RTs to auditive cues (experiment I), but binaural beeps do not slow down RTs to visual cues (experiment II). In an arguably more sensitive “Random Interval Repetition” task using tactile stimulation, working memory taxation of beeps and eye movements were directly compared. RTs slowed down during beeps, but the effects were much stronger for eye movements (experiment III). The same pattern was observed in a memory experiment with healthy volunteers (experiment IV): vividness of negative memories was reduced after both beeps and eye movements, but effects were larger for eye movements. Findings support a working memory account of EMDR and suggest that effects of beeps on negative memories are inferior to those of eye movements.     

Effects of social context, reinforcer probability, and reinforcer magnitude on humans' choices to compete or not to compete.

In the first two experiments, subjects' choices to earn points (exchangeable for money) either by competing with a fictitious opponent or by not competing were studied. Buskist, Barry, Morgan, and Rossi's (1984) competitive fixed-interval schedule was modified to include a second response option, a noncompetitive fixed-interval schedule. After choosing to enter either option, the opportunity for reinforcers became available after the fixed-interval's duration had elapsed. Under the no-competition condition, points were always available after the interval had elapsed. Under the competition condition, points were available based on a predetermined probability of delivery. Experiments 1 and 2 examined how reinforcer probabilities and reinforcer magnitudes affected subjects' choices to compete. Several general conclusions can be made about the results: (a) Strong preferences to compete were observed at high and moderate reinforcer probabilities; (b) competing was observed even at very low reinforcer probabilities; (c) response rates were always higher in the competition component than in the no-competition component; and (d) response rates and choices to compete were insensitive to reinforcer-magnitude manipulations. In Experiment 3, the social context of this choice schedule was removed to determine whether the high levels of competing observed in the first two experiments were due to a response preference engendered by the social context provided by the experimenters through instructions. In contrast to the first two experiments, these subjects preferred the 60-s fixed-interval schedule (formerly the no-competition option), indicating that the instructions themselves were responsible for the preference to compete. This choice paradigm may be useful to future researchers interested in the effects of other independent variables (e.g., drugs, social context, instructions) on competitive behavior.