Gaze direction and facial expressions exert combined but different effects on attentional resources

Gaze direction and facial expressions are critical components of face processing and have been shown to influence attention deployment. We investigated whether gaze direction (direct vs. averted) combined with a neutral or angry expression modulates the deployment of attentional resources over time. In a Rapid Serial Visual Presentation (RSVP) paradigm participants had to decide the gender of a neutral or an angry target face with direct or averted gaze (T1) and then to judge the orientation of a target picture of a landscape (T2), following the face at different time intervals. Results showed no attentional blink effect (i.e., no deterioration in T2 accuracy) when T1 was an angry face with direct gaze, whereas it was present for angry faces with averted gaze or neutral faces with either averted or direct gaze. These findings are consistent with appraisal theories and are discussed against the background of automatic processing of threat stimuli.     

The effect of facial expression and gaze direction on memory for unfamiliar faces

We report data from an experiment that investigated the influence of gaze direction and facial expression on face memory. Participants were shown a set of unfamiliar faces with either happy or angry facial expressions, which were either gazing straight ahead or had their gaze averted to one side. Memory for faces that were initially shown with angry expressions was found to be poorer when these faces had averted as opposed to direct gaze, whereas memory for individuals shown with happy faces was unaffected by gaze direction. We suggest that memory for another individual's face partly depends on an evaluation of the behavioural intention of that individual.     

The time course of gaze bias in visual decision tasks

In three experiments, we used eyetracking to investigate the time course of biases in looking behaviour during visual decision making. Our study replicated and extended prior research by Shimojo, Simion, Shimojo, and Scheier (2003), and Simion and Shimojo (2006). Three groups of participants performed forced-choice decisions in a two-alternative free-viewing condition (Experiment 1a), a two-alternative gaze-contingent window condition (Experiment 1b), and an eight-alternative free-viewing condition (Experiment 1c). Participants viewed photographic art images and were instructed to select the one that they preferred (preference task), or the one that they judged to be photographed most recently (recency task). Across experiments and tasks, we demonstrated robust bias towards the chosen item in either gaze duration, gaze frequency or both. The present gaze bias effect was less task specific than those reported previously. Importantly, in the eight-alternative condition we demonstrated a very early gaze bias effect, which rules out a postdecision response-related explanation.     

Gaze bias: Selective encoding and liking effects

People look longer at things that they choose than things they do not choose. How much of this tendency—the gaze bias effect—is due to a liking effect compared to the information encoding aspect of the decision-making process? Do these processes compete under certain conditions? We monitored eye movements during a visual decision-making task with four decision prompts: Like, dislike, older, and newer. The gaze bias effect was present during the first dwell in all conditions except the dislike condition, when the preference to look at the liked item and the goal to identify the disliked item compete. Colour content (whether a photograph was colour or black-and-white), not decision type, influenced the gaze bias effect in the older/newer decisions because colour is a relevant feature for such decisions. These interactions appear early in the eye movement record, indicating that gaze bias is influenced during information encoding.     

Are transposition effects specific to letters?

Recent research has consistently shown that pseudowords created by transposing two letters are perceptually similar to their corresponding base words (e.g., jugde–judge). In the framework of the overlap model (Gomez, Ratcliff, & Perea, 2008), this effect is due to a noisy process in the localization of the “objects” (e.g., letters, kana syllables). In the present study, we examine whether this effect is specific to letter strings or whether it also occurs with other “objects” (namely, digits, symbols, and pseudoletters). To that end, we conducted a series of five masked priming experiments using the same–different task. Results showed robust effects of transposition for all objects, except for pseudoletters. This is consistent with the view that locations of familiar objects (i.e., letters, numbers, and symbols) can be best understood as distributions along a dimension rather than as precise points.     

Effects of visual cue and response assignment on spatial stimulus coding in stimulus–response compatibility

Tlauka and McKenna (2000 Tlauka, M. and McKenna, F. P. 2000. Hierarchical knowledge influences stimulus–response compatibility effects. Quarterly Journal of Experimental Psychology, 53A: 85–103.  [Google Scholar]) reported a reversal of the traditional stimulus–response compatibility (SRC) effect (faster responding to a stimulus presented on the same side than to one on the opposite side) when the stimulus appearing on one side of a display is a member of a superordinate unit that is largely on the opposite side. We investigated the effects of a visual cue that explicitly shows a superordinate unit, and of assignment of multiple stimuli within each superordinate unit to one response, on the SRC effect based on superordinate unit position. Three experiments revealed that stimulus–response assignment is critical, while the visual cue plays a minor role, in eliciting the SRC effect based on the superordinate unit position. Findings suggest bidirectional interaction between perception and action and simultaneous spatial stimulus coding according to multiple frames of reference, with contribution of each coding to the SRC effect flexibly varying with task situations.     

Impairment of gaze-directed spatial coding in recent-onset schizophrenia

Patients with schizophrenia show deficits in core cognitive functions as well as in social cognition. The aim of the present study was to test whether deficits in social cognition influence nonsocial, “cold”, cognition. Thirty-five patients with recent-onset schizophrenia (SC) and 30 healthy controls (HC) performed a Simon task with social and simple geometric stimuli. We investigated whether the Simon effect, the slowing of reaction times produced by stimulus incongruities in the task-irrelevant spatial domain, differs between patients and healthy participants as a function of the social nature of the cues. The Simon effect was generated by a schematic drawing of human eyes (social cues) or rectangles (nonsocial cues). Overall, patients had longer reaction times than HC. In the eye-like condition, the Simon effect was significantly stronger for HC than for SC. In HC the Simon effect was significantly stronger in the eye-like than in the rectangle condition. In patients, the Simon effect did not differ significantly between both conditions. Thus, the influence of social cues was greatly reduced in the patient group. Current psychopathology or antipsychotic treatment did not influence results. The present study supports earlier findings of altered processing of schematic social cues in patients with schizophrenia, especially when gaze is task-irrelevant.     

Visual working memory is enhanced by mixed strategy use and semantic coding

Visual working memory is enhanced by processes related to verbalisation. However, the mechanism underlying this enhancement is unclear. Experiment 1 investigated the potential contribution of the phonological loop of working memory, by assessing the effects of articulatory suppression on two versions of the Visual Patterns Test—one low and one high in availability of verbal coding. The lack of interaction suggested that the phonological loop is not responsible; however, active use of combined verbal and visual strategies, as well as activated semantic knowledge, both appear to be related to increased capacity. Experiment 2 assessed the role of central executive resources. Because central executive suppression removed the benefit of the high verbal coding task version, central executive resources, assumed to relate to the temporary maintenance of multimodal codes in the episodic buffer, appear to underlie the benefit associated with verbalisation.