Peekaboo: a new look at infants' perception of emotion expressions.

Infants' responsiveness to others' affective expressions was investigated in the context of a peekaboo game. Forty 4-month-olds participated in a peekaboo game in which the typical happy/surprised expression was systematically replaced with a different emotion, depending on group assignment. Infants viewed three typical peekaboo trials followed by a change (anger, fear, or sadness) or no-change (happiness/surprise) trial, repeated over two blocks. Infants' looking time and affective responsiveness were measured. Results revealed differential patterns of visual attention and affective responsiveness to each emotion. These results underscore the importance of contextual information for facilitating recognition of emotion expressions as well as the efficacy of using converging measures to assess such understanding. Infants as young as 4 months appear to discriminate and respond in meaningful ways to others' emotion expressions.     

Recognizing vocal emotions in Mandarin Chinese: A validated database of Chinese vocal emotional stimuli

To establish a valid database of vocal emotional stimuli in Mandarin Chinese, a set of Chinese pseudosentences (i.e., semantically meaningless sentences that resembled real Chinese) were produced by four native Mandarin speakers to express seven emotional meanings: anger, disgust, fear, sadness, happiness, pleasant surprise, and neutrality. These expressions were identified by a group of native Mandarin listeners in a seven-alternative forced choice task, and items reaching a recognition rate of at least three times chance performance in the seven-choice task were selected as a valid database and then subjected to acoustic analysis. The results demonstrated expected variations in both perceptual and acoustic patterns of the seven vocal emotions in Mandarin. For instance, fear, anger, sadness, and neutrality were associated with relatively high recognition, whereas happiness, disgust, and pleasant surprise were recognized less accurately. Acoustically, anger and pleasant surprise exhibited relatively high mean f0 values and large variation in f0 and amplitude; in contrast, sadness, disgust, fear, and neutrality exhibited relatively low mean f0 values and small amplitude variations, and happiness exhibited a moderate mean f0 value and f0 variation. Emotional expressions varied systematically in speech rate and harmonics-to-noise ratio values as well. This validated database is available to the research community and will contribute to future studies of emotional prosody for a number of purposes. To access the database, please contact pan.liu@mail.mcgill.ca.     

Dynamic emotional messages differentially affect 6-month-old infants’ attention to eyes and gaze cues

Infants often experience interactions in which caregivers use dynamic messages to convey their affective and communicative intent. These dynamic emotional messages may shape the development of emotion discrimination skills and shared attention by influencing infants’ attention to internal facial features and their responses to eye gaze cues. However, past research examining infants’ responses to emotional faces has predominantly focused on classic, stereotyped expressions (e.g., happy, sad, angry) that may not reflect the variability that infants experience in their daily interactions. The present study therefore examined forty-two 6-month-old infants’ attention to eyes vs. mouth and gaze cueing responses across multiple dynamic emotional messages that are common to infant-directed interactions. Overall, infants looked more to the eyes during messages with negative affect, but this increased attention to the eyes during these message conditions did not directly facilitate gaze cueing. Infants instead showed reliable gaze cueing only after messages with positive and neutral affect. We additionally observed gender differences in infants’ attention to internal face features and subsequent gaze cueing responses. Female infants spent more time looking at the eyes during the dynamic emotional messages and showed increased initial orienting and longer looking to gaze-cued objects following positive messages, whereas male infants showed these gaze cueing effects following neutral messages. These results suggest that variability in caregivers' communication can shape infants’ attention to and processing of emotion and gaze information.     

Are you talking to me?! Separating the people from the problem when expressing emotions in negotiation

Emotions such as anger and happiness have pervasive interpersonal effects in negotiations. We propose that the nature of the effects depends on the target of the emotion, that is, whether the emotion is directed toward a person or a specific behavior. In a computer-mediated negotiation (N = 87), participants received either angry or happy messages from a simulated opponent, which were either behavior-oriented or person-directed. Behavior-oriented anger elicited larger concessions than behavior-oriented happiness, whereas person-directed anger elicited smaller concessions than person-directed happiness. This reversal could be attributed to the strategic value of the emotional expression, which was higher in the behavior-oriented condition than in the person-directed condition. These findings show that the interpersonal effects of anger and happiness depend critically on the target of the emotion.     

Toddlers’ Understanding of Peers’ Emotions

The second year of life sees dramatic developments in infants’ ability to understand emotions in adults alongside their growing interest in peers. In this study, the authors used a social-referencing paradigm to examine whether 12-, 18-, and 24-month-old children could use a peer's positive or negative emotion messages about toys to regulate their own behavior with the toys. They found that 12-month-olds decreased their play with toys toward which a peer had expressed either positive or negative emotion compared with play following a peer's neutral attention toward a toy. Also, 18-month-olds did not respond systematically, but 24-month-old children increased their toy play after watching a peer display negative affect toward the toy. Regardless of their age, children with siblings decreased their play with toys toward which they had seen a peer display fear, the typical social-referencing response. The authors discuss results in the context of developmental changes in social understanding and peer interaction over the second year of life.     

Learning of syllable-object relations by preverbal infants: The role of temporal synchrony and syllable distinctiveness

The role of temporal synchrony and syllable distinctiveness in preverbal infants’ learning of word-object relations was investigated. In Experiment 1, 7- and 8-month-olds (N = 64) were habituated under conditions where two similar-sounding syllables, /tah/ and /gah/, were spoken simultaneously with the motions of one of two sets of objects (synchronous) or out of phase with the motions (asynchronous). On test trials, 8-month-olds, but not 7-month-olds, showed learning of the relations in the synchronous condition but not in the asynchronous condition. Furthermore, in Experiment 2, following habituation to one of the synchronous syllable-object pairs, 7-month-olds (n = 8) discriminated the syllables and the objects. In Experiment 3, following habituation to two distinct syllables, /tah/-/gih/ or /gah/-/tih/, paired with identical objects, 7-month-olds (n = 40) showed learning of the relations, again only in the synchronous condition. Thus, synchrony, which mothers naturally provide between words and object motions, facilitated the mapping onto objects of similar-sounding syllables at 8 months of age and distinct syllables at 7 months of age. These findings suggest an interaction between infants’ synchrony and syllable distinctiveness perception during early word mapping development.     

Recognition of all basic emotions varies in accuracy and reaction time: A new verbal method of measurement

To study different aspects of facial emotion recognition, valid methods are needed. The more widespread methods have some limitations. We propose a more ecological method that consists of presenting dynamic faces and measuring verbal reaction times. We presented 120 video clips depicting a gradual change from a neutral expression to a basic emotion (anger, disgust, fear, happiness, sadness and surprise), and recorded hit rates and reaction times of verbal labelling of emotions. Our results showed that verbal responses to six basic emotions differed in hit rates and reaction times: happiness > surprise > disgust > anger > sadness > fear (this means these emotional responses were more accurate and faster). Generally, our data are in accordance with previous findings, but our differentiation of responses is better than the data from previous experiments on six basic emotions.     

Preschoolers' use of dynamic facial, bodily, and vocal cues to emotion

In daily experience, children have access to a variety of cues to others’ emotions, including face, voice, and body posture. Determining which cues they use at which ages will help to reveal how the ability to recognize emotions develops. For happiness, sadness, anger, and fear, preschoolers (3-5 years, N = 144) were asked to label the emotion conveyed by dynamic cues in four cue conditions. The Face-only, Body Posture-only, and Multi-cue (face, body, and voice) conditions all were well recognized (M > 70%). In the Voice-only condition, recognition of sadness was high (72%), but recognition of the three other emotions was significantly lower (34%).     

The contribution of self‐deceptive enhancement to display rules in the United States and Japan

Socially desirable responding was tested as a mediator of American and Japanese college student differences in display rules. Americans endorsed the expression of anger, contempt, disgust, fear, happiness, and surprise more than the Japanese. Americans also exhibited more self‐deceptive enhancement than the Japanese, and self‐deceptive enhancement partially mediated country differences on the endorsement of anger, disgust, happiness, and surprise, but not contempt and fear. These findings highlight the role of self‐deceptive enhancement in contributing to expressive display rules and support the point of view that socially desirable responding is a reflection of one's personality and culture rather than a statistical nuisance.     

Visual search for expressions and anti-expressions

We used visual search to explore whether the preattentive mechanisms that enable rapid detection of facial expressions are driven by visual information from the displacement of features in expressions, or other factors such as affect. We measured search slopes for luminance and contrast equated images of facial expressions and anti-expressions of six emotions (anger, fear, disgust, surprise, happiness, and sadness). Anti-expressions have an equivalent magnitude of facial feature displacements to their corresponding expressions, but different affective content. There was a strong correlation between these search slopes and the magnitude of feature displacements in expressions and anti-expressions, indicating feature displacement had an effect on search performance. There were significant differences between search slopes for expressions and anti-expressions of happiness, sadness, anger, and surprise, which could not be explained in terms of feature differences, suggesting preattentive mechanisms were sensitive to other factors. A categorization task confirmed that the affective content of expressions and anti-expressions of each of these emotions were different, suggesting signals of affect might well have been influencing attention and search performance. Our results support a picture in which preattentive mechanisms may be driven by factors at a number of levels, including affect and the magnitude of feature displacement. We note that indirect effects of feature displacement, such as changes in local contrast, may well affect preattentive processing. These are most likely to be nonlinearly related to feature displacement and are, we argue, an important consideration for any study using images of expression to explore how affect guides attention. We also note that indirect effects of feature displacement (for example, changes in local contrast) may well affect preattentive processing. We argue that such effects are an important consideration for any study using images of expression to explore how affect guides attention.     

A Voxel-based lesion study on facial emotion recognition after circumscribed prefrontal cortex damage

Previous studies have shown inconsistent findings regarding the contribution of the different prefrontal regions in emotion recognition. Moreover, the hemispheric lateralization hypothesis posits that the right hemisphere is dominant for processing all emotions regardless of affective valence, whereas the valence specificity hypothesis posits that the left hemisphere is specialized for processing positive emotions while the right hemisphere is specialized for negative emotions. However, recent findings suggest that the evidence for such lateralization has been less consistent. In this study, we investigated emotion recognition of fear, surprise, happiness, sadness, disgust, and anger in 30 patients with focal prefrontal cortex lesions and 30 control subjects. We also examined the impact of lesion laterality on recognition of the six basic emotions. The results showed that compared to control subjects, the frontal subgroups were impaired in recognition of three negative basic emotions of fear, sadness, and anger – regardless of the lesion laterality. Therefore, our findings did not establish that each hemisphere is specialized for processing specific emotions. Moreover, the voxel-based lesion symptom mapping analysis showed that recognition of fear, sadness, and anger draws on a partially common bilaterally distributed prefrontal network.     

Perceptual learning and recognition confusion reveal the underlying relationships among the six basic emotions

The six basic emotions (disgust, anger, fear, happiness, sadness, and surprise) have long been considered discrete categories that serve as the primary units of the emotion system. Yet recent evidence indicated underlying connections among them. Here we tested the underlying relationships among the six basic emotions using a perceptual learning procedure. This technique has the potential of causally changing participants’ emotion detection ability. We found that training on detecting a facial expression improved the performance not only on the trained expression but also on other expressions. Such a transfer effect was consistently demonstrated between disgust and anger detection as well as between fear and surprise detection in two experiments (Experiment 1A, n?=?70; Experiment 1B, n?=?42). Notably, training on any of the six emotions could improve happiness detection, while sadness detection could only be improved by training on sadness itself, suggesting the uniqueness of happiness and sadness. In an emotion recognition test using a large sample of Chinese participants (n?=?1748), the confusion between disgust and anger as well as between fear and surprise was further confirmed. Taken together, our study demonstrates that the “basic” emotions share some common psychological components, which might be the more basic units of the emotion system.     

The effects of exposure to dynamic expressions of affect on 5-month-olds’ memory

The purpose of this study was to examine the behavioral effects of adults’ communicated affect on 5-month-olds’ visual recognition memory. Five-month-olds were exposed to a dynamic and bimodal happy, angry, or neutral affective (face–voice) expression while familiarized to a novel geometric image. After familiarization to the geometric image and exposure to the affective expression, 5-month-olds received either a 5-min or 1-day retention interval. Following the 5-min retention interval, infants exposed to the happy affective expressions showed a reliable preference for a novel geometric image compared to the recently familiarized image. Infants exposed to the neutral or angry affective expression failed to show a reliable preference following a 5-min delay. Following the 1-day retention interval, however, infants exposed to the neutral expression showed a reliable preference for the novel geometric image. These results are the first to demonstrate that 5-month-olds’ visual recognition memory is affected by the presentation of affective information at the time of encoding.     

Attributing the sources of accuracy in unequal-power dyadic communication: Who is better and why?

A study was conducted to assess accuracy of deliberate nonverbal communication of affective messages between individuals assigned to different power roles within dyads. In phase 1, participants (N = 158) were assigned to unequal- or to equal-power roles and asked to send positive, negative, and neutral messages to their partner using nonverbal cues while the partner guessed which kind of message it was. In phase 2, naïve decoders (N = 294) made judgments of the videotapes from phase 1 to resolve the confounding of sender and decoder factors in the within-dyad communication paradigm. Results showed that subordinates were more accurate at decoding superiors than vice versa, and that this difference was due to subordinates sending less clear messages to superiors than superiors sent to subordinates. Comparison with the equal-power group’s expressions revealed that the subordinates’ expressions were also less clear than those sent by the equal-power group.     

How infant-directed actions enhance infants’ attention,learning, and exploration: Evidence from EEG and computational modeling

When teaching infants new actions, parents tend to modify their movements. Infants prefer these infant-directed actions (IDAs) over adult-directed actions and learn well from them. Yet, it remains unclear how parents’ action modulations capture infants’ attention. Typically, making movements larger than usual is thought to draw attention. Recent findings, however, suggest that parents might exploit movement variability to highlight actions. We hypothesized that variability in movement amplitude rather than higher amplitude is capturing infants’ attention during IDAs. Using EEG, we measured 15-month-olds’ brain activity while they were observing action demonstrations with normal, high, or variable amplitude movements. Infants’ theta power (4–5 Hz) in fronto-central channels was compared between conditions. Frontal theta was significantly higher, indicating stronger attentional engagement, in the variable compared to the other conditions. Computational modelling showed that infants’ frontal theta power was predicted best by how surprising each movement was. Thus, surprise induced by variability in movements rather than large movements alone engages infants’ attention during IDAs. Infants with higher theta power for variable movements were more likely to perform actions successfully and to explore objects novel in the context of the given goal. This highlights the brain mechanisms by which IDAs enhance infants’ attention, learning, and exploration.     

Bodily maps of emotions across child development

Different basic emotions (anger, fear, disgust, happiness, sadness, and surprise) are consistently associated with distinct bodily sensation maps, which may underlie subjectively felt emotions. Here we investigated the development of bodily sensations associated with basic emotions in 6‐ to 17‐year‐old children and adolescents (n = 331). Children as young as 6 years of age associated statistically discernible, discrete patterns of bodily sensations with happiness, fear, and surprise, as well as with emotional neutrality. The bodily sensation maps changed from less to more specific, adult‐like patterns as a function of age. We conclude that emotion‐related bodily sensations become increasingly discrete over child development. Developing awareness of their emotion‐related bodily sensations may shape the way children perceive, label, and interpret emotions.     

Beyond the information given: Infants’ transfer of actions learned through imitation

Five experiments were conducted to investigate infants’ ability to transfer actions learned via imitation to new objects and to examine what components of the original context are critical to such transfer. Infants of 15 months observed an experimenter perform an action with one or two toys and then were offered a novel toy that was not demonstrated for them. In all experiments, infants performed target actions with the novel toy more frequently than infants who were offered the same toy but had seen no prior demonstrations. Infants exhibited transfer even when the specific part to be manipulated looked different across the toys, even when they had not performed the actions with the demonstration toys themselves, even when the actions produced no effects on the demonstrations, and even when the actions were demonstrated with only a single exemplar toy. Transfer was especially robust when infants not only observed but also practiced the target actions on the demonstration trials. Learning action affordances (“means”) seems to be a central aspect of human imitation, and the propensity to apply these learned action affordances in new object contexts may be an important basis for technological innovation and invention.     

Can children recognize pride?

Recent research has shown that pride, like the "basic" emotions of anger, disgust, fear, happiness, sadness, and surprise, has a distinct, nonverbal expression that can be recognized by adults (J. L. Tracy & R. W. Robins, 2004b). In 2 experiments, the authors examined whether young children can identify the pride expression and distinguish it from expressions of happiness and surprise. Results suggest that (a) children can recognize pride at above-chance levels by age 4 years; (b) children recognize pride as well as they recognize happiness; (c) pride recognition, like happiness and surprise recognition, improves from age 3 to 7 years; and (d) children's ability to recognize pride cannot be accounted for by the use of a process of elimination (i.e., an exclusion rule) to identify an unknown entity. These findings have implications for the development of emotion recognition and children's ability to perceive and communicate pride.     

Infants’ recognition of objects using canonical color

We explored infants’ ability to recognize the canonical colors of daily objects, including two color-specific objects (human face and fruit) and a non-color-specific object (flower), by using a preferential looking technique. A total of 58 infants between 5 and 8 months of age were tested with a stimulus composed of two color pictures of an object placed side by side: a correctly colored picture (e.g., red strawberry) and an inappropriately colored picture (e.g., green-blue strawberry). The results showed that, overall, the 6- to 8-month-olds showed preference for the correctly colored pictures for color-specific objects, whereas they did not show preference for the correctly colored pictures for the non-color-specific object. The 5-month-olds showed no significant preference for the correctly colored pictures for all object conditions. These findings imply that the recognition of canonical color for objects emerges at 6 months of age.     

A happy story: Developmental changes in children’s sensitivity to facial expressions of varying intensities

Using 20 levels of intensity, we measured children’s thresholds to discriminate the six basic emotional expressions from neutral and their misidentification rates. Combined with the results of a previous study using the same method (Journal of Experimental Child Psychology, 102 (2009) 503-521), the results indicate that by 5 years of age, children are adult-like, or nearly adult-like, for happy expressions on all measures. Children’s sensitivity to other expressions continues to improve between 5 and 10 years of age (e.g., surprise, disgust, fear) or even after 10 years of age (e.g., anger, sad). The results indicate that there is a slow development of sensitivity to the expression of all basic emotions except happy. This slow development may impact children’s social and cognitive development by limiting their sensitivity to subtle expressions of disapproval or disappointment.