Emotions in word and face processing: Early and late cortical responses

Recent research suggests that emotion effects in word processing resemble those in other stimulus domains such as pictures or faces. The present study aims to provide more direct evidence for this notion by comparing emotion effects in word and face processing in a within-subject design. Event-related brain potentials (ERPs) were recorded as participants made decisions on the lexicality of emotionally positive, negative, and neutral German verbs or pseudowords, and on the integrity of intact happy, angry, and neutral faces or slightly distorted faces. Relative to neutral and negative stimuli both positive verbs and happy faces elicited posterior ERP negativities that were indistinguishable in scalp distribution and resembled the early posterior negativities reported by others. Importantly, these ERP modulations appeared at very different latencies. Therefore, it appears that similar brain systems reflect the decoding of both biological and symbolic emotional signals of positive valence, differing mainly in the speed of meaning access, which is more direct and faster for facial expressions than for words.     

Two routes to face perception: evidence from psychophysics and computational modeling

The aim of this study was to separately analyze the role of featural and configural face representations. Stimuli containing only featural information were created by cutting the faces into their parts and scrambling them. Stimuli only containing configural information were created by blurring the faces. Employing an old-new recognition task, the aim of Experiments 1 and 2 was to investigate whether unfamiliar faces (Exp. 1) or familiar faces (Exp. 2) can be recognized if only featural or configural information is provided. Both scrambled and blurred faces could be recognized above chance level. A further aim of Experiments 1 and 2 was to investigate whether our method of creating configural and featural stimuli is valid. Pre-activation of one form of representation did not facilitate recognition of the other, neither for unfamiliar faces (Exp. 1) nor for familiar faces (Exp. 2). This indicates a high internal validity of our method for creating configural and featural face stimuli. Experiment 3 examined whether features placed in their correct categorical relational position but with distorted metrical distances facilitated recognition of unfamiliar faces. These faces were recognized no better than the scrambled faces in Experiment 1, providing further evidence that facial features are stored independently of configural information. From these results we conclude that both featural and configural information are important to recognize a face and argue for a dual-mode hypothesis of face processing. Using the psychophysical results as motivation, we propose a computational framework that implements featural and configural processing routes using an appearance-based representation based on local features and their spatial relations. In three computational experiments (Experiments 4–6) using the same sets of stimuli, we show how this framework is able to model the psychophysical data.     

Multiple perceptual strategies used by macaque monkeys for face recognition

Successful integration of individuals in macaque societies suggests that monkeys use fast and efficient perceptual mechanisms to discriminate between conspecifics. Humans and great apes use primarily holistic and configural, but also feature-based, processing for face recognition. The relative contribution of these processes to face recognition in monkeys is not known. We measured face recognition in three monkeys performing a visual paired comparison task. Monkey and humans faces were (1) axially rotated, (2) inverted, (3) high-pass filtered, and (4) low-pass filtered to isolate different face processing strategies. The amount of time spent looking at the eyes, mouth, and other facial features was compared across monkey and human faces for each type of stimulus manipulation. For all monkeys, face recognition, expressed as novelty preference, was intact for monkey faces that were axially rotated or spatially filtered and was supported in general by preferential looking at the eyes, but was impaired for inverted faces in two of the three monkeys. Axially rotated, upright human faces with a full range of spatial frequencies were also recognized, however, the distribution of time spent exploring each facial feature was significantly different compared to monkey faces. No novelty preference, and hence no inferred recognition, was observed for inverted or low-pass filtered human faces. High-pass filtered human faces were recognized, however, the looking pattern on facial features deviated from the pattern observed for monkey faces. Taken together these results indicate large differences in recognition success and in perceptual strategies used by monkeys to recognize humans versus conspecifics. Monkeys use both second-order configural and feature-based processing to recognize the faces of conspecifics, but they use primarily feature-based strategies to recognize human faces.     

Left gaze bias in humans, rhesus monkeys and domestic dogs

While viewing faces, human adults often demonstrate a natural gaze bias towards the left visual field, that is, the right side of the viewee’s face is often inspected first and for longer periods. Using a preferential looking paradigm, we demonstrate that this bias is neither uniquely human nor limited to primates, and provide evidence to help elucidate its biological function within a broader social cognitive framework. We observed that 6-month-old infants showed a wider tendency for left gaze preference towards objects and faces of different species and orientation, while in adults the bias appears only towards upright human faces. Rhesus monkeys showed a left gaze bias towards upright human and monkey faces, but not towards inverted faces. Domestic dogs, however, only demonstrated a left gaze bias towards human faces, but not towards monkey or dog faces, nor to inanimate object images. Our findings suggest that face- and species-sensitive gaze asymmetry is more widespread in the animal kingdom than previously recognised, is not constrained by attentional or scanning bias, and could be shaped by experience to develop adaptive behavioural significance.     

Face processing in humans and new world monkeys: the influence of experiential and ecological factors

This study tests whether the face-processing system of humans and a nonhuman primate species share characteristics that would allow for early and quick processing of socially salient stimuli: a sensitivity toward conspecific faces, a sensitivity toward highly practiced face stimuli, and an ability to generalize changes in the face that do not suggest a new identity, such as a face differently oriented. The look rates by adult tamarins and humans toward conspecific and other primate faces were examined to determine if these characteristics are shared. A visual paired comparison (VPC) task presented subjects with either a human face, chimpanzee face, tamarin face, or an object as a sample, and then a pair containing the previous stimulus and a novel stimulus was presented. The stimuli were either presented all in an upright orientation, or all in an inverted orientation. The novel stimulus in the pair was either an orientation change of the same face/object or a new example of the same type of face/object, and the stimuli were shown either in an upright orientation or in an inverted orientation. Preference to novelty scores revealed that humans attended most to novel individual human faces, and this effect decreased significantly if the stimuli were inverted. Tamarins showed preferential looking toward novel orientations of previously seen tamarin faces in the upright orientation, but not in an inverted orientation. Similarly, their preference to look longer at novel tamarin and human faces within the pair was reduced significantly with inverted stimuli. The results confirmed prior findings in humans that novel human faces generate more attention in the upright than in the inverted orientation. The monkeys also attended more to faces of conspecifics, but showed an inversion effect to orientation change in tamarin faces and to identity changes in tamarin and human faces. The results indicate configural processing restricted to particular kinds of primate faces by a New World monkey species, with configural processing influenced by life experience (human faces and tamarin faces) and specialized to process orientation changes specific to conspecific faces.     

Why neuroscience matters to cognitive neuropsychology

The broad issue in this paper is the relationship between cognitive psychology and neuroscience. That issue arises particularly sharply for cognitive neurospsychology, some of whose practitioners claim a methodological autonomy for their discipline. They hold that behavioural data from neuropsychological impairments are sufficient to justify assumptions about the underlying modular structure of human cognitive architecture, as well as to make inferences about its various components. But this claim to methodological autonomy can be challenged on both philosophical and empirical grounds. A priori considerations about (cognitive) multiple realisability challenge the thesis on philosophical grounds, and neuroscientific findings from developmental disorders substantiate that challenge empirically. The conclusion is that behavioural evidence alone is inadequate for scientific progress since appearances of modularity can be thoroughly deceptive, obscuring both the dynamic processes of neural development and the endstate network architecture of real cognitive systems.     

Using automatic face analysis to score infant behaviour from video collected online

Online testing of infants by recording video with a webcam has the potential to improve the replicability of developmental studies by facilitating larger sample sizes and by allowing methods (including recruitment) to be specified in code. However, the recorded video still needs to be manually scored. This labour-intensive process puts downward pressure on sample sizes and requires subjective judgements that may not be reproducible in a different laboratory. Here we present the first fully automatic pipeline, using a face analysis software-as-a-service and a discriminant-analysis classifier to score infant videos acquired online. We compare human and machine performance for looking time and preferential looking paradigms; machine performance demonstrates a promising proof of principle for looking time and is above chance in classifying preferential looking. Additionally, we studied the characteristics of the video and the child that influenced automated scoring, so that future studies can acquire data that maximises the performance of automatic gaze coding and/or focus on improving automatic coding for particularly challenging data. We believe this technology has great promise for developmental science.     

Visual search for schematic emotional faces: Angry faces are more than crosses

Recent studies of the face in the crowd effect, the faster detection of angry than of happy faces in visual search, suggest that for schematic faces it reflects on perceptual features like inward pointing lines rather than on emotional expressions. Removing a potential confound, Experiments 1–2 replicate the preferential detection of stimuli with inward pointing lines, but Experiment 2a indicates that a surrounding circle is required for the effect to emerge. Experiments 3–7 failed to find evidence for faster detection of schematic faces comprising only the elements critical for the faster detection of angry faces according to a low level visual feature account, inward tilted brows and upturned mouth. Faster detection of anger was evident if eyes or eyes and noses were added, but only if their placement was consistent with the first order relations among these elements in a human face. Drawing the critical elements in thicker, higher contrast lines also led to an anger advantage, but this was smaller than that seen for the complete faces. The present results suggest that, while able to support faster target detection, a prevalence of inward pointing lines is not sufficient to explain the detection advantage of angry schematic faces.     

Improving Identity Matching of Newly Encountered Faces: Effects of Multi-image Training

1. Download high-res image (107KB)
2. Download full-size image