It's not what you say but the way you say it: matching faces and voices

Recent studies have shown that the face and voice of an unfamiliar person can be matched for identity. Here the authors compare the relative effects of changing sentence content (what is said) and sentence manner (how it is said) on matching identity between faces and voices. A change between speaking a sentence as a statement and as a question disrupted matching performance, whereas changing the sentence itself did not. This was the case when the faces and voices were from the same race as participants and speaking a familiar language (English; Experiment 1) or from another race and speaking an unfamiliar language (Japanese; Experiment 2). Altering manner between conversational and clear speech (Experiment 3) or between conversational and casual speech (Experiment 4) was also disruptive. However, artificially slowing (Experiment 5) or speeding (Experiment 6) speech did not affect cross-modal matching performance. The results show that bimodal cues to identity are closely linked to manner but that content (what is said) and absolute tempo are not critical. Instead, prosodic variations in rhythmic structure and/or expressiveness may provide a bimodal, dynamic identity signature.     

The Role of Face Familiarity in Judgments of Personality and Intelligence

Personality judgments based on facial features are a common occurrence. The face familiarity overgeneralization hypothesis states that people make judgments of unknown faces based on their similarity to known faces. However, there is a dearth of research regarding how face familiarity relates to perceptions of personality and intelligence in strangers. The current article used two studies to provide evidence for the relationship between face familiarity and judgments of personality and intelligence. Study 1 showed that photographs perceived as familiar by one set of participants were rated more positively regarding personality and intelligence by a second group of participants. Study 2 found that high perceived familiarity resulted in positive judgments of personality and intelligence, whereas familiarity based on exposure did not. These findings indicate both that perceived familiarity significantly impacts positive judgments of personality and intelligence and that the face familiarity overgeneralization hypothesis is a useful framework for this area of research.     

The naive perception of masculinity-femininity on the basis of expressive cues

Groups of naive judges rated 18 videotaped stimulus persons on masculinity, femininity, “dominance, assertiveness,” and “compassion, sensitivity to others.” Stimulus persons were broken down by sex and sex-typing—half were male, half female—and within sexes one third were classified as masculine, feminine, and androgynous on the basis of their scores on the Bem Sex Role Inventory. Two experiments are reported in which groups of judges rate stimulus persons on the basis of such different expressive information as videotaped pictures and recorded voices, videotaped pictures alone, videotaped bodies, videotaped heads, recorded voices, and still photos. The results showed: (1) Judges reliably rated masculinity-femininity from largely expressive cues: (2) judgments of masculinity-femininity were not predominantly determined by judgments of sex role-related traits: (3) the naive judgment of masculinity-femininity significantly corresponded to stimulus subjects' assessed sex roles; (4) stimulus subjects (particulary males) showed a consistent display of masculinity-femininity across expressive channels; and (5) judges used different expressive cues in judging masculinity-femininity in males and females. These results are related to broader questions concerning the relation between expressive behavior and personality.     

It’s not just what you say but when you say it: Self-presentation and temporal construal

Three experiments demonstrated that the use and effectiveness of self-presentation strategies are affected by time. In Experiment 1, participants used more indirect self-presentation statements for the distant than near future, but used more direct self-presentation statements for the near than distant future. In Experiment 2, participants for whom indirect self-presentation strategies were made accessible rated a future interview as more temporally distant than those for whom direct self-presentation strategies were made accessible. In Experiment 3, participants rated their self-presentation attempts as more effective if they used direct strategies for the near future and indirect strategies for the distant future. Implications for studying the timing of self-presentation and its relation to temporal construal levels are discussed.     

From body motion to cheers: Speakers’ body movements as predictors of applause

Appearance cues and brief displays of behavior are related to people’s personality, to their performance at work and to the outcomes of elections. Thus, people present themselves to others on different communication channels, while their interaction partners form first impressions on the basis of the displayed cues. In the current study we examined whether people are able to read information from politicians’ body motion. For a rating experiment we translated short video clips of politicians giving a speech into animated stick-figures and had these animations rated on trustworthiness, dominance, competence and the Big Five personality dimensions. Afterwards we correlated the ratings with the applause and the hecklings that the speakers received throughout their entire speech. This revealed that speakers whose body movements were perceived as high on dominance, as high on extraversion and as low on agreeableness received more applause. Although the results obtained need support from additional studies they indicate that body motion is an informative cue in real life settings.     

Attitude and the perception of faces

To assess the effects of affective orientation on the judgment of facial attriutes, 165 subjects were asked to make judgments of the attributes of each of two faces. For each face, subjects were either given no information about the person in the photo, or were given biographical information connoting either a favorable or unfavorable personality. It was predicted that when subjects make judgments along dimensions that were evaluatively loaded (e.g., smilling vs frowning mouth), manipulated attitude would influence these judgments. For the seven dimensions rated by the subjects, four dimensions showed the predicted effect. The other three dimensions, which did not show the effect, were the only ones that showed a significant effect due to the face itself. It was concluded that for dimensions that are not highly structured by the characteristics of the face, attitude can significantly influence judgments of facial attributes.     

Smile when you say that: Effects of willingness on dispositional inferences

A large body of research has investigated how perceivers integrate a target’s behavior with information about situational forces. However, little research has investigated how the willingness with which a behavior is performed affects inferences. Two experiments examined the effect of behavioral willingness on dispositional inferences. In experiment 1, a target’s willingness to help had a strong effect on inferences. In experiment 2, effects of willingness were even stronger under cognitive load. Implications are discussed.     

Careful what you say to yourself: Exploring self-talk and youth tennis performance via hierarchical linear modeling

Researchers have examined self-talk and performance in tennis matches, but the current understanding of speech-to-performance associations in tennis is hindered by conflicting evidence from self-report and observation, and by the use of relatively simple statistical analyses that fail to account for speech and performance events being nested within both points and individuals over time throughout a tennis match. In the current study, 28 youth tennis players (M_age = 12 years) were observed, and their speech and performance coded with the Self-Talk and Gestures Rating Scale. The relation between self-talk and performance was measured on the same point (K), as well as on the subsequent point (K+1). Bivariate (non-nested) analyses supported a concurrent, but not a predictive relation between self-talk and performance, consistent with prior work. With multivariate, hierarchical linear modeling that accounts for total points played in a set within person, and player behavior on the prior point, we found that positive and negative self-talk were strongly related to concurrent point performance, and to a less extent, to subsequent K+1 point performance. The occurrence of positive self-talk on point K appeared to increase the odds of winning the subsequent point compared to when positive self-talk talk did not appear, but the margin was small. Researchers should continue to observe self-talk in athletes, as well as examine multilevel speech-to-performance associations, especially when data are gathered within naturalistic settings in real time.     

How Much Older Do You Get When a Wrinkle Appears on Your Face? Modifying Age Estimates by Number of Wrinkles

ABSTRACT

The present study investigated the influence of wrinkles on facial age judgments. In Experiment 1, preadolescents, young adults, and middle-aged adults made categorical age judgments for male and female faces. The qualitative (type of wrinkle) and quantitative (density of wrinkles and depth of furrows) contributions of wrinkles were analyzed. Results indicated that the greater the number of wrinkles and the depth of furrows, the older a face was rated. The roles of the gender of the face and the age of the participants were discussed. In Experiment 2, participants performed relative age judgments by comparing pairs of faces. Results revealed that the number of wrinkles had more influence on the perceived facial age than the type of wrinkle. A MDS analysis showed the main dimensions on which participants based their judgments, namely, the number of wrinkles and the depth of furrows. We conclude that the quantitative component is more likely to increase perceived facial age. Nevertheless, other variables, such as the gender of the face and the age of the participants, also seem to be involved in the age estimation process.     

That's easy for you to say: action identification and speech fluency

Action identification theory holds that an action can be identified by the performer in different ways, and that these various act identities differ in their appropriateness for maintaining the action effectively. Optimal action identification exists when a personally easy action is identified in relatively high-level terms (i.e., the action's effects and implications) or a personally difficult action is identified in relatively low-level terms (i.e., the action's mechanical details). To test the optimality hypothesis with respect to speech fluency, subjects were asked to deliver a speech to either an easy-to-persuade audience or a difficult-to-persuade audience and induced to think about the action in either high-level or low-level terms. As predicted, subjects made fewer speech errors and felt more satisfied with their performance when the task was personally easy and identified at high level and when the task was personally difficult and identified at low level. Optimal action identification made things easier for them to say.     

Rater Correction Processes in Applicant Selection Using Videoconference Technology: The Role of Attributions1

Increasing global competition for the best employees has resulted in a significant increase in the recruiting and selection of geographically dispersed applicants. Innovative telecommunication technologies (e.g., videoconferencing) have provided a means to interview distant applicants at relatively low cost, compared to face‐to‐face interviews. However, some have suggested that interviewer ratings could be affected by the use of communication media to conduct the interview. In the present laboratory study, we tested a model of rater decision processes to help explain a mechanism for inflated ratings of videoconference‐based applicants. Participants who believed that they were making judgments for a real selection process rated simulated videoconference or face‐to‐face interviews. Raters who perceived interview media to be lower in richness were more likely to make external attributions for the applicant's performance, and consequently rated him more favorably.     

Perception of intersensory synchrony in audiovisual speech: not that special

Perception of intersensory temporal order is particularly difficult for (continuous) audiovisual speech, as perceivers may find it difficult to notice substantial timing differences between speech sounds and lip movements. Here we tested whether this occurs because audiovisual speech is strongly paired (“unity assumption”). Participants made temporal order judgments (TOJ) and simultaneity judgments (SJ) about sine-wave speech (SWS) replicas of pseudowords and the corresponding video of the face. Listeners in speech and non-speech mode were equally sensitive judging audiovisual temporal order. Yet, using the McGurk effect, we could demonstrate that the sound was more likely integrated with lipread speech if heard as speech than non-speech. Judging temporal order in audiovisual speech is thus unaffected by whether the auditory and visual streams are paired. Conceivably, previously found differences between speech and non-speech stimuli are not due to the putative “special” nature of speech, but rather reflect low-level stimulus differences.     

Predicting the Importance of Freedom of Speech and the Perceived Harm of Hate Speech

Although freedom of speech is a fundamental value in the United States, individuals vary in the importance they place on it. The purpose of this study was to examine personality and attitudinal factors that may influence an individual's judgments of the importance of freedom of speech and, secondarily, the harm of hate speech. As expected, the importance of freedom of speech was positively related to intellect, individualism, separate knowing, and negatively related to right‐wing authoritarianism. Men rated freedom of speech more important than did women. The perceived harm of hate speech was positively related to intellect and liberalism, and women perceived a greater harm of hate speech than did men.     

When dynamic, the head and face alone can express pride

Prior research suggested that pride is recognized only when a head and facial expression (e.g., tilted head with a slight smile) is combined with a postural expression (e.g., expanded body and arm gestures). However, these studies used static photographs. In the present research, participants labeled the emotion conveyed by four dynamic cues to pride, presented as video clips: head and face alone, body posture alone, voice alone, and an expression in which head and face, body posture, and voice were presented simultaneously. Participants attributed pride to the head and face alone, even when postural or vocal information was absent. Pride can be conveyed without body posture or voice.     

Integrating social knowledge and physical cues when judging the attractiveness of potential mates

Although many women find masculine men physically attractive, the perception that such men are prone to infidelity may limit their appeal as romantic partners. To explore this issue, we first investigated the interplay between the effects of men's face shape (masculinity versus femininity) and social knowledge of men's behavior in previous romantic relationships (faithful versus unfaithful) on women's judgments of men's attractiveness. Analyses suggested that the extent to which women rated masculine men to be more attractive than feminine men was significantly greater when judging men labeled as faithful than when judging men labeled as unfaithful. In a second experiment, we obtained similar results when the women in our study were instructed to imagine they were on a date with each of the men and that, while on the date, they observed him either flirting or not flirting with another woman. These interactions suggest that social knowledge about men's behavior in romantic relationships can offset one of the costs that women associate with choosing a masculine mate, increasing the appeal of masculine men. More fundamentally, these findings suggest integration of social knowledge and information from facial cues in women's attractiveness judgments.     

The Role of the Face and Body in Unfamiliar Person Identification

Information useful for identifying a person can be found both in the face and body. Previous studies indicate that when an entire person is visible, we rely strongly on the face for identification, even if the body can be useful. We measured the utility of the face versus body for identification, by using images of unfamiliar people that varied in the quality of identity information in the face. Face quality was varied using similarity scores generated by state‐of‐the‐art face recognition algorithms from an international competition. These algorithms estimated the similarity of faces in a large set (>1 000 000) of image pairs that showed ‘people’, including the face and the top half of the body. By using these similarity scores, image pairs were stratified into three groups representing good, moderate, and poor performance for the face recognition algorithm. Participants matched identity in image pairs sampled from the three groups, by using versions of the stimuli edited digitally to show only the face or body. Consistent with the algorithm stratifications, performance with the face declined across the three conditions. The face supported more accurate identification than the body in the good and moderate conditions. In the poor condition, performance from the face and body was comparable. Using data from a previous study, we compared the face‐only and body‐only identity judgments with judgments based on the original image. The original unedited image supported the best overall performance in the good and moderate conditions. Notably, performance in the poor condition was equivalent for the face, body, and original images. The results indicate that in poor viewing conditions, identification decisions from the body may be as accurate as those made from the face or the entire person. Copyright © 2013 John Wiley & Sons, Ltd.     

Affective evaluations of objects are influenced by observed gaze direction and emotional expression

Gaze direction signals another person's focus of interest. Facial expressions convey information about their mental state. Appropriate responses to these signals should reflect their combined influence, yet current evidence suggests that gaze-cueing effects for objects near an observed face are not modulated by its emotional expression. Here, we extend the investigation of perceived gaze direction and emotional expression by considering their combined influence on affective judgments. While traditional response-time measures revealed equal gaze-cueing effects for happy and disgust faces, affective evaluations critically depended on the combined product of gaze and emotion. Target objects looked at with a happy expression were liked more than objects looked at with a disgust expression. Objects not looked at were rated equally for both expressions. Our results demonstrate that facial expression does modulate the way that observers utilize gaze cues: Objects attended by others are evaluated according to the valence of their facial expression.     

Facial and vocal cues of deception and honesty

Facial expressions and vocal cues (filtered speech) of honest and deceptive messages were examined in posed and spontaneous situations. The question of interest was the degree to which nonverbal cues transmit information about deception. Results indicated that (a) for both the facial and vocal channels, posing (as compared to spontaneous behavior) produced a higher level of communication accuracy; (b) facial expressions of deceptive (as compared to honest) messages were rated as less pleasant, while vocal expressions of deception were rated as less honest, less assertive, and less dominant, particularly in the posed condition; (c) the sender's ability to convey honesty was negatively correlated with his/her ability to convey deception, suggesting the existence of a demeanor bias—individual senders tend to appear and sound consistently honest (or dishonest) regardless of whether they deliver an honest or a deceptive message; (d) in the posing condition, the sender's abilities to convey honesty/deception via facial and vocal cues were positively and significantly correlated, whereas in the spontaneous condition they were not; and (e) senders whose full (unfiltered) speech indicated more involvement with their responses were judged as more honest from both their vocal (filtered speech) and facial cues, in both the honest and deceptive conditions.     

Audio-visual speech perception off the top of the head

The study examined whether people can extract speech related information from the talker's upper face that was presented using either normally textured videos (Experiments 1 and 3) or videos showing only the outlined of the head (Experiments 2 and 4). Experiments 1 and 2 used within- and cross-modal matching tasks. In the within-modal task, observers were presented two pairs of short silent video clips that showed the top part of a talker's head. In the cross-modal task, pairs of audio and silent video clips were presented. The task was to determine the pair in which the talker said the same sentence. Performance on both tasks was better than chance for the outline as well as textured presentation suggesting that judgments were primarily based on head movements. Experiments 3 and 4 tested if observing the talker's upper face would help identify speech in noise. The results showed the viewing the talker's moving upper head produced a small but reliable improvement in speech intelligibility, however, this effect was only secure for the expressive sentences that involved greater head movements. The results suggest that people are sensitive to speech related head movements that extend beyond the mouth area and can use these to assist in language processing.