The relationships between processing facial identity,emotional expression,facial speech,and gaze direction during development

Four experiments were conducted with 5- to 11-year-olds and adults to investigate whether facial identity, facial speech, emotional expression, and gaze direction are processed independently of or in interaction with one another. In a computer-based, speeded sorting task, participants sorted faces according to facial identity while disregarding facial speech, emotional expression, and gaze direction or, alternatively, according to facial speech, emotional expression, and gaze direction while disregarding facial identity. Reaction times showed that children and adults were able to direct their attention selectively to facial identity despite variations of other kinds of face information, but when sorting according to facial speech and emotional expression, they were unable to ignore facial identity. In contrast, gaze direction could be processed independently of facial identity in all age groups. Apart from shorter reaction times and fewer classification errors, no substantial change in processing facial information was found to be correlated with age. We conclude that adult-like face processing routes are employed from 5 years of age onward.     

Effects of facial expression and gaze direction on approach-avoidance behaviour

Humans must coordinate approach-avoidance behaviours with the social cues that elicit them, such as facial expressions and gaze direction. We hypothesised that when someone is observed looking in a particular direction with a happy expression, the observer would tend to approach that direction, but that when someone is observed looking in a particular direction with a fearful expression, the observer would tend to avoid that direction. Twenty-eight participants viewed stimulus faces with averted gazes and happy or fearful expressions on a computer screen. Participants were asked to grasp (approach) or withdraw from (avoid) a left- or right-hand button depending on the stimulus face's expression. The results were consistent with our hypotheses about avoidance responses, but not with respect to approach responses. Links between social cues and adaptive behaviour are discussed.     

The interaction between gaze direction and facial expressions in newborns

The ability to decode facial expressions is an important component of social interaction and functioning. This ability is even more fundamental early in life, prior to the development of verbal communication. However, it is still unclear whether newborns can detect, discriminate and process facial expressions, and, if so, what the mechanisms underlying this ability are. In this study, we extend the investigation of perceived emotional expression by manipulating gaze direction with different facial expressions. Specifically, newborns were presented with faces displaying neutral, fearful, or happy facial expressions accompanied with direct or averted gaze, and tested in a visual preference paradigm. Four experiments were conducted in which different combinations of expression and gaze were used. However, only in the fourth experiment did newborns show a visual preference for a specific emotional display; they looked significantly longer at a happy face than a neutral one only when both were accompanied with direct gaze. These results provide support for the advantage of happy facial expressions in the development of a face processing system and suggest that this preference reflects experience acquired during the first few days after birth.     

Influence of emotional expression on the processing of gaze direction

Research demonstrates an influence of gaze direction in emotion recognition. Here we examined whether facial affect similarly influences recognition of gaze direction. Across two studies we found that averted relative to direct gaze was processed more quickly and accurately when coupled with fear, and direct relative to averted gaze with anger. Also evident was that slower overall gaze processing was associated with increased interaction effects between emotion and gaze. Examining individual differences, therefore, enabled us to extend previous research examining speed of processing as a moderator of the interaction effect, while holding constant task demands and stimulus features. Unexpectedly, a main effect emerged such that averted relative to direct gaze was found to be processed more quickly and accurately overall. This effect was not moderated by processing speed and is discussed as a potential stimulus-driven effect that may help explain discrepant findings in the literature.

Perceiver and poser asymmetries in processing facial emotion

This study examined both perceiver and poser asymmetries in processing facial emotion. Posers were left brain-damaged (LBD), right brain-damaged (RBD), and normal control (NC) right-handed males videotaped while expressing happiness and anger. Perceivers rated the facial expressions for asymmetry in original and reversed orientations. Overall, expressions viewed in the reversed orientation were rated as more left-sided than in the original orientation. In the reversed orientation, the more extensive left hemiface of the NCs and LBDs fell in the perceiver's left hemispace. This finding is consistent with previous research demonstrating a left hemispace bias for free-field viewing of emotional faces. Expressions were produced significantly more intensely on the left than the right hemiface by NCs and LBDs; expressions of RBDs were not significantly lateralized.     

Perceptual biases in processing facial identity and emotion

Normal observers demonstrate a bias to process the left sides of faces during perceptual judgments about identity or emotion. This effect suggests a right cerebral hemisphere processing bias. To test the role of the right hemisphere and the involvement of configural processing underlying this effect, young and older control observers and patients with right hemisphere damage completed two chimeric faces tasks (emotion judgment and face identity matching) with both upright and inverted faces. For control observers, the emotion judgment task elicited a strong left-sided perceptual bias that was reduced in young controls and eliminated in older controls by face inversion. Right hemisphere damage reversed the bias, suggesting the right hemisphere was dominant for this task, but that the left hemisphere could be flexibly recruited when right hemisphere mechanisms are not available or dominant. In contrast, face identity judgments were associated most clearly with a vertical bias favouring the uppermost stimuli that was eliminated by face inversion and right hemisphere lesions. The results suggest these tasks involve different neurocognitive mechanisms. The role of the right hemisphere and ventral cortical stream involvement with configural processes in face processing is discussed.     

Sex differences in the lateralized processing of facial emotion

Two reaction time tasks were administered to male and female normal subjects, involving judgments of facial emotion. In the Word-Face task, judgments of similarity or difference of a centrally presented emotion word and an emotional face presented in the left or right visual field were required, and in the Face-Face task, comparisons of a centrally presented and a laterally presented emotional face were required. Results were significant for the matching trials only. Reaction times to negative emotions were faster overall than to positive emotions, and an Emotional Valence by Visual Field interaction was found such that reaction times were faster for negative emotions in the left visual field and for positive emotions in the right visual field. This interaction was significant for the female but not the male subjects, although similar patterns were observed in both sexes. Further, an interaction of Gender, Task, and Emotional Valence was found, such that the two tasks had opposite effects for the two sexes. The Face-Face task appeared to inhibit the performance of the male subjects and facilitate the performance of the female subjects in terms of reaction time. It was suggested that specifying the target emotion by an emotional face elicits a greater emotional response on the part of the subject than specification by a word, and that this emotional elicitation may result in a reactive inhibition in the male subjects and in an elaboration of the emotional response in the female subjects.     

Consistent left gaze bias in processing different facial cues

While viewing faces, humans often demonstrate a natural gaze bias towards the left visual field, that is, the right side of the viewee’s face is often inspected first and for longer periods. Previous studies have suggested that this gaze asymmetry is a part of the gaze pattern associated with face exploration, but its relation with perceptual processing of facial cues is unclear. In this study we recorded participants’ saccadic eye movements while exploring face images under different task instructions (free viewing, judging familiarity and judging facial expression). We observed a consistent left gaze bias in face viewing irrespective of task demands. The probability of the first fixation and the proportion of overall fixations directed at the left hemiface were indistinguishable across different task instructions or across different facial expressions. It seems that the left gaze bias is an automatic reflection of hemispheric lateralisation in face processing, and is not necessarily correlated with the perceptual processing of a specific type of facial information.     

Evidence for strong dissociation between emotion and facial displays: the case of surprise

Eight experiments examined facial expressions of surprise in adults. Surprise was induced by disconfirming a previously established schema or expectancy. Self-reports and behavioral measures indicated the presence of surprise in most participants, but surprise expressions were observed only in 4%-25%, and most displays consisted of eyebrow raising only; the full, 3-component display was never seen. Experimental variations of surprise intensity, sociality, and duration/complexity of the surprising event did not change these results. Electromyographic measurement failed to detect notably more brow raisings and, in one study, revealed a decrease of frontalis muscle activity in the majority of the participants. Nonetheless, most participants believed that they had shown a strong surprise expression.     

Effects of early experience on children's recognition of facial displays of emotion

The present research examines visual perception of emotion in both typical and atypical development. To examine the processes by which perceptual mechanisms become attuned to the contingencies of affective signals in the environment, the authors measured the sequential, content-based properties of feature detection in emotion recognition processes. To evaluate the role of experience, they compared typically developing children with physically abused children, who were presumed to have experienced high levels of threat and hostility. As predicted, physically abused children accurately identified facial displays of anger on the basis of less sensory input than did controls, which suggests that physically abused children have facilitated access to representations of anger. The findings are discussed in terms of experiential processes in perceptual learning.     

Social anxiety and interpretation biases for facial displays of emotion: emotion detection and ratings of social cost

The current study assessed the processing of facial displays of emotion (Happy, Disgust, and Neutral) of varying emotional intensities in participants with high vs. low social anxiety. Use of facial expressions of varying intensities allowed for strong external validity and a fine-grained analysis of interpretation biases. Sensitivity to perceiving negative evaluation in faces (i.e., emotion detection) was assessed at both long (unlimited) and brief (60 ms) stimulus durations. In addition, ratings of perceived social cost were made indicating what participants judged it would be like to have a social interaction with a person exhibiting the stimulus emotion. Results suggest that high social anxiety participants did not demonstrate biases in their sensitivity to perceiving negative evaluation (i.e. disgust) in facial expressions. However, high social anxiety participants did estimate the perceived cost of interacting with someone showing disgust to be significantly greater than low social anxiety participants, regardless of the intensity of the disgust expression. These results are consistent with a specific type of interpretation bias in which participants with social anxiety have elevated ratings of the social cost of interacting with individuals displaying negative evaluation.     

The effect of facial expression and gaze direction on memory for unfamiliar faces

We report data from an experiment that investigated the influence of gaze direction and facial expression on face memory. Participants were shown a set of unfamiliar faces with either happy or angry facial expressions, which were either gazing straight ahead or had their gaze averted to one side. Memory for faces that were initially shown with angry expressions was found to be poorer when these faces had averted as opposed to direct gaze, whereas memory for individuals shown with happy faces was unaffected by gaze direction. We suggest that memory for another individual's face partly depends on an evaluation of the behavioural intention of that individual.     

The combined effect of gaze direction and facial expression on cueing spatial attention

Empirical evidence shows an effect of gaze direction on cueing spatial attention, regardless of the emotional expression shown by a face, whereas a combined effect of gaze direction and facial expression has been observed on individuals' evaluative judgments. In 2 experiments, the authors investigated whether gaze direction and facial expression affect spatial attention depending upon the presence of an evaluative goal. Disgusted, fearful, happy, or neutral faces gazing left or right were followed by positive or negative target words presented either at the spatial location looked at by the face or at the opposite spatial location. Participants responded to target words based on affective valence (i.e., positive/negative) in Experiment 1 and on letter case (lowercase/uppercase) in Experiment 2. Results showed that participants responded much faster to targets presented at the spatial location looked at by disgusted or fearful faces but only in Experiment 1, when an evaluative task was used. The present findings clearly show that negative facial expressions enhance the attentional shifts due to eye-gaze direction, provided that there was an explicit evaluative goal present.     

Emotional attention: effects of emotion and gaze direction on overt orienting of visual attention

In the present study we considered the two factors that have been advocated for playing a role in emotional attention: perception of gaze direction and facial expression of emotions. Participants performed an oculomotor task in which they had to make a saccade towards one of the two lateral targets, depending on the colour of the fixation dot which appeared at the centre of the computer screen. At different time intervals (stimulus onset asynchronies, SOAs: 50,100,150 ms) following the onset of the dot, a picture of a human face (gazing either to the right or to the left) was presented at the centre of the screen. The gaze direction of the face could be congruent or incongruent with respect to the location of the target, and the expression could be neutral or angry. In Experiment 1 the facial expressions were presented randomly in a single block, whereas in Experiment 2 they were shown in separate blocks. Latencies for correct saccades and percentage of errors (saccade direction errors) were considered in the analyses. Results showed that incongruent trials determined a significantly higher percentage of saccade direction errors with respect to congruent trials, thus confirming that gaze direction, even when task-irrelevant, interferes with the accuracy of the observer’s oculomotor behaviour. The angry expression was found to hold attention for a longer time with respect to the neutral one, producing delayed saccade latencies. This was particularly evident at 100 ms SOA and for incongruent trials. Emotional faces may then exert a modulatory effect on overt attention mechanisms.     

Shame,guilt, and facial emotion processing: initial evidence for a positive relationship between guilt-proneness and facial emotion recognition ability

Shame and guilt are closely related self-conscious emotions of negative affect that give rise to divergent self-regulatory and motivational behaviours. While guilt-proneness has demonstrated positive relationships with self-report measures of empathy and adaptive interpersonal functioning, shame-proneness tends to be unrelated or inversely related to empathy and is associated with interpersonal difficulties. At present, no research has examined relationships between shame and guilt-proneness with facial emotion recognition ability. Participants (N?=?363) completed measures of shame and guilt-proneness along with a facial emotion recognition task which assessed the ability to identify displays of anger, sadness, happiness, fear, disgust, and shame. Guilt-proneness was consistently positively associated with facial emotion recognition ability. In contrast, shame-proneness was unrelated to capacity for facial emotion recognition. Findings provide support for theory arguing that guilt and empathy operate synergistically and may also help explain the inverse relationship between guilt-proneness and propensity for aggressive behaviour.     

Gender moderates the relationship between emotion and perceived gaze

Recent evidence shows that gender modulates the morphology of facial expressions and might thus alter the meaning of those expressions. Consequently, we hypothesized that gender would moderate the relationship between facial expressions and the perception of direct gaze. In Study 1, participants viewed male and female faces exhibiting joy, anger, fear, and neutral expressions displayed with direct and averted gazes. Perceptions of direct gaze were most likely for male faces expressing anger or joy and for female faces expressing joy. Study 2 established that these results were due to facial morphology and not to gender stereotypes. Thus, the morphology of male and female faces amplifies or constrains emotional signals and accordingly alters gaze perception.     

Perceived intimacy of expressed emotion

Research on norms for emotional expression and self-disclosure provided the basis for two hypotheses concerning the perceived intimacy of emotional self-disclosure. The first hypothesis was that the perceived intimacy of negative emotional disclosure would be greater than that of positive emotional disclosure; the second was that disclosures of more intense emotional states would be perceived as more intimate than disclosures of less intense emotional states for both negative and positive disclosures. Both hypotheses received support when male students in Canada rated the perceived intimacy of self-disclosures that were equated for topic and that covered a comprehensive sample of emotions and a range of emotional intensities. The effects were observed across all the topics of disclosure examined.     

Segregated processing of facial identity and emotion in the human brain: A pet study

Abstract

The brain is organized into segregated areas of relative functional autonomy and specialization. This basic principle of cerebral organization is well documented for cognitive functions that differ drastically from one another, but less so for functions that belong to the same domain, such as face processing. Yet several sources of evidence point to a functional and structural dissociation of various aspects of face processing, as suggested by (1) an analysis of the perceptual and cognitive demands made by the processing of diverse properties conveyed by facial configurations, (2) selective impairment of aspects of face processing in brain-damaged patients, and (3) different localizations of face cells responsive to properties conveyed by faces such as identity and emotion in the monkey's brain. This study used positron emission tomography (PET) and magnetic resonance imaging (MRI) to delineate better the neurofunctional organization of face processing in the human brain, by measuring cerebral blood flow while subjects performed tasks involving the recognition of faces or the recognition of emotions expressed by faces. The results showed segregated processing of facial identity and facial emotion, with the former being performed predominantly in the ventro-mesial region of the right hemisphere including the limbic system, whereas the latter was carried out predominantly in the latter part of the right hemisphere and the dorsal region of the limbic system. This structural organization allows the parallel processing of different information contained in physiognomies and underlies the high efficiency with which humans process faces.     

Luminance-induced shift in the apparent direction of gaze

Changing the luminance of one side of the sclera induces an apparent shift of the perceived direction of gaze toward the darker side of the sclera. This luminance-induced gaze shift was measured in photographic and schematic images of eyes. The effect was substantial: a moderate darkening of one side of the sclera induced an apparent shift of 8 to 10 deg of gaze; the maximum darkening induced a shift of 15 deg of gaze or more. The effect of scleral darkening was also compared to the gaze shift induced by an actual shift of the iris. The effects of the two cues were measured independently and in combination. When pitted against each other, their effects could be nulled, demonstrating that they act on a common level. Predictions of the relative strengths of the luminance and iris shift cues were developed for two simple luminance-based mechanisms: flux ratio and luminance centroid. The data showed the luminance cue was less effective than the models predicted in determining gaze direction. As an alternative source for the gaze shift, irradiation effects on apparent size could create a perceived shift in the iris position but a direct measure of the irradiation shift showed that this was far too small. The results suggest that at least one important mechanism for gaze judgment is based on low-level analysis of the luminance configuration within the eye.     

The effect of gaze on gaze direction while looking at art

In highly controlled cuing experiments, conspecific gaze direction has powerful effects on an observer’s attention. We explored the generality of this effect by using paintings in which the gaze direction of a key character had been carefully manipulated. Our observers looked at these paintings in one of three instructional states (neutral, social, or spatial) while we monitored their eye movements. Overt orienting was much less influenced by the critical gaze direction than what the cuing literature might suggest: An analysis of the direction of saccades following the first fixation of the critical gaze showed that observers were weakly biased to orient in the direction of the gaze. Over longer periods of viewing, however, this effect disappeared for all but the social condition. This restriction of gaze as an attentional cue to a social context is consistent with the idea that the evolution of gaze direction detection is rooted in social communication. The picture stimuli from this experiment can be downloaded from the Psychonomic Society’s Archive of Norms, Stimuli, and Data, www.psychonomic.org/archive.