The time course of anticipatory constraint integration

Several studies have demonstrated that as listeners hear sentences describing events in a scene, their eye movements anticipate upcoming linguistic items predicted by the unfolding relationship between scene and sentence. While this may reflect active prediction based on structural or contextual expectations, the influence of local thematic priming between words has not been fully examined. In Experiment 1, we presented verbs (e.g., arrest) in active (Subject–Verb–Object) sentences with displays containing verb-related patients (e.g., crook) and agents (e.g., policeman). We examined patient and agent fixations following the verb, after the agent role had been filled by another entity, but prior to bottom-up specification of the object. Participants were nearly as likely to fixate agents “anticipatorily” as patients, even though the agent role was already filled. However, the patient advantage suggested simultaneous influences of both local priming and active prediction. In Experiment 2, using passive sentences (Object–Verb–Subject), we found stronger, but still graded influences of role prediction when more time elapsed between verb and target, and more syntactic cues were available. We interpret anticipatory fixations as emerging from constraint-based processes that involve both non-predictive thematic priming and active prediction.     

Eye contact facilitates awareness of faces during interocular suppression

Eye contact captures attention and receives prioritized visual processing. Here we asked whether eye contact might be processed outside conscious awareness. Faces with direct and averted gaze were rendered invisible using interocular suppression. In two experiments we found that faces with direct gaze overcame such suppression more rapidly than faces with averted gaze. Control experiments ruled out the influence of low-level stimulus differences and differential response criteria. These results indicate an enhanced unconscious representation of direct gaze, enabling the automatic and rapid detection of other individuals making eye contact with the observer.     

Emotional attention: effects of emotion and gaze direction on overt orienting of visual attention

In the present study we considered the two factors that have been advocated for playing a role in emotional attention: perception of gaze direction and facial expression of emotions. Participants performed an oculomotor task in which they had to make a saccade towards one of the two lateral targets, depending on the colour of the fixation dot which appeared at the centre of the computer screen. At different time intervals (stimulus onset asynchronies, SOAs: 50,100,150 ms) following the onset of the dot, a picture of a human face (gazing either to the right or to the left) was presented at the centre of the screen. The gaze direction of the face could be congruent or incongruent with respect to the location of the target, and the expression could be neutral or angry. In Experiment 1 the facial expressions were presented randomly in a single block, whereas in Experiment 2 they were shown in separate blocks. Latencies for correct saccades and percentage of errors (saccade direction errors) were considered in the analyses. Results showed that incongruent trials determined a significantly higher percentage of saccade direction errors with respect to congruent trials, thus confirming that gaze direction, even when task-irrelevant, interferes with the accuracy of the observer’s oculomotor behaviour. The angry expression was found to hold attention for a longer time with respect to the neutral one, producing delayed saccade latencies. This was particularly evident at 100 ms SOA and for incongruent trials. Emotional faces may then exert a modulatory effect on overt attention mechanisms.     

Contextual override of pragmatic anomalies: evidence from eye movements

Readers typically experience processing difficulty when they encounter a word that is anomalous within the local context, such as 'The mouse picked up the dynamite...'. The research reported here demonstrates that by placing a sentence in a fictional scenario that is already well known to the reader (e.g., a Tom and Jerry cartoon, as a context for the example sentence above), the difficulty usually associated with these pragmatic anomalies can be immediately eliminated, as reflected in participants' eye movement behaviour. This finding suggests that readers can rapidly integrate information from their common ground, specifically, their cultural knowledge, whilst interpreting incoming text, and provides further evidence that incoming words are immediately integrated within the global discourse.     

Coordinating cognition: the costs and benefits of shared gaze during collaborative search

Collaboration has its benefits, but coordination has its costs. We explored the potential for remotely located pairs of people to collaborate during visual search, using shared gaze and speech. Pairs of searchers wearing eyetrackers jointly performed an O-in-Qs search task alone, or in one of three collaboration conditions: shared gaze (with one searcher seeing a gaze-cursor indicating where the other was looking, and vice versa), shared-voice (by speaking to each other), and shared-gaze-plus-voice (by using both gaze-cursors and speech). Although collaborating pairs performed better than solitary searchers, search in the shared gaze condition was best of all: twice as fast and efficient as solitary search. People can successfully communicate and coordinate their searching labor using shared gaze alone. Strikingly, shared gaze search was even faster than shared-gaze-plus-voice search; speaking incurred substantial coordination costs. We conclude that shared gaze affords a highly efficient method of coordinating parallel activity in a time-critical spatial task.     

Time course of selective attention in clinically depressed young adults: an eye tracking study

Depressed individuals display biased attention for emotional information when stimuli are presented for relatively “long” (e.g., 1 s) durations. The current study examined whether attentional biases are sustained over a much longer period. Specifically, clinically depressed and never depressed young adults simultaneously viewed images from four emotion categories (sad, threat, positive, neutral) for 30 s while line of visual gaze was assessed. Depressed individuals spent significantly more time viewing dysphoric images and less time viewing positive images than their never depressed counterparts. Time course analyses indicated that these biases were maintained over the course of the trial. Results suggest that depressed participants' attentional biases for dysphoric information are sustained for relatively long periods even when other emotional stimuli are present. Mood congruent information-processing biases appear to be a robust feature of depression and may have an important role in the maintenance of the disorder.     

Discourse-mediation of the mapping between language and the visual world: Eye movements and mental representation

Two experiments explored the mapping between language and mental representations of visual scenes. In both experiments, participants viewed, for example, a scene depicting a woman, a wine glass and bottle on the floor, an empty table, and various other objects. In Experiment 1, participants concurrently heard either ‘The woman will put the glass on the table’ or ‘The woman is too lazy to put the glass on the table’. Subsequently, with the scene unchanged, participants heard that the woman ‘will pick up the bottle, and pour the wine carefully into the glass.’ Experiment 2 was identical except that the scene was removed before the onset of the spoken language. In both cases, eye movements after ‘pour’ (anticipating the glass) and at ‘glass’ reflected the language-determined position of the glass, as either on the floor, or moved onto the table, even though the concurrent (Experiment 1) or prior (Experiment 2) scene showed the glass in its unmoved position on the floor. Language-mediated eye movements thus reflect the real-time mapping of language onto dynamically updateable event-based representations of concurrently or previously seen objects (and their locations).     

Errors, efficiency, and the interplay between attention and category learning

Learning to identify objects as members of categories is an essential cognitive skill and learning to deploy attention effectively is a core component of that process. The present study investigated an assumption imbedded in formal models of categorization: error is necessary for attentional learning. Eye-trackers were used to record participants’ allocation of attention to task relevant and irrelevant features while learning a complex categorization task. It was found that participants optimized their fixation patterns in the absence of both performance errors and corrective external feedback. Optimization began immediately after each category was mastered and continued for many trials. These results demonstrate that error is neither necessary nor sufficient for all forms of attentional learning.     

Covert shifts of attention function as an implicit aid to insight

Previous research shows that directed actions can unconsciously influence higher-order cognitive processing, helping learners to retain knowledge and guiding problem solvers to useful insights (e.g. Cook, S. W., Mitchell, Z., & Goldin-Meadow, S. (2008). Gesturing makes learning last. Cognition, 106, 1047-1058; Thomas, L. E., & Lleras, A. (2007). Moving eyes and moving thought: on the spatial compatibility between eye movements and cognition. Psychonomic Bulletin and Review, 14, 663-668). We examined whether overt physical movement is necessary for these embodied effects on cognition, or whether covert shifts of attention are sufficient to influence cognition. We asked participants to try to solve Duncker’s radiation problem while occasionally directing them, via an unrelated digit-tracking task, to shift their attention (while keeping their eyes fixed) in a pattern related to the problem’s solution, to move their eyes in this pattern, or to keep their eyes and their attention fixed in the center of the display. Although they reported being unaware of any relationship between the digit-tracking task and the radiation problem, participants in both the eye-movement and attention-shift groups were more likely to solve the problem than were participants who maintained fixation. Our results show that by shifting attention in a pattern compatible with a problem’s solution, we can aid participants’ insight even in the absence of overt physical movements.