Emotion recognition: The role of featural and configural face information

Several studies investigated the role of featural and configural information when processing facial identity. A lot less is known about their contribution to emotion recognition. In this study, we addressed this issue by inducing either a featural or a configural processing strategy (Experiment 1) and by investigating the attentional strategies in response to emotional expressions (Experiment 2). In Experiment 1, participants identified emotional expressions in faces that were presented in three different versions (intact, blurred, and scrambled) and in two orientations (upright and inverted). Blurred faces contain mainly configural information, and scrambled faces contain mainly featural information. Inversion is known to selectively hinder configural processing. Analyses of the discriminability measure (A′) and response times (RTs) revealed that configural processing plays a more prominent role in expression recognition than featural processing, but their relative contribution varies depending on the emotion. In Experiment 2, we qualified these differences between emotions by investigating the relative importance of specific features by means of eye movements. Participants had to match intact expressions with the emotional cues that preceded the stimulus. The analysis of eye movements confirmed that the recognition of different emotions rely on different types of information. While the mouth is important for the detection of happiness and fear, the eyes are more relevant for anger, fear, and sadness.     

Impaired holistic and analytic face processing in congenital prosopagnosia: Evidence from the eye-contingent mask/window paradigm

There is abundant evidence that face recognition, in comparison to the recognition of other objects, is based on holistic processing rather than analytic processing. One line of research that provides evidence for this hypothesis is based on the study of people who experience pronounced difficulties in visually identifying conspecifics on the basis of their face. Earlier, we developed a behavioural paradigm to directly test analytic vs. holistic face processing. In comparison to a to be remembered reference face stimulus, one of two test stimuli was either presented in full view, with an eye-contingently moving window (only showing the fixated face feature, and therefore only affording analytic processing), or with an eye-contingently moving mask or scotoma (masking the fixated face feature, but still allowing holistic processing). In the present study we use this paradigm (that we used earlier in acquired prosopagnosia) to study face perception in congenital prosopagnosia (people having difficulties recognizing faces from birth on, without demonstrable brain damage). We observe both holistic and analytic face processing deficits in people with congenital prosopagnosia. Implications for a better understanding, both of congenital prosopagnosia and of normal face perception, are discussed.     

The effects of precedence on Navon-induced processing bias in face recognition

Macrae and Lewis (2002) Macrae, C. N. and Lewis, H. L. 2002. Do I know you? Processing orientation and face recognition. Psychological Science, 13: 194–196. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] showed that repeated reporting of the global dimension of Navon stimuli improved performance in a subsequent face identification task, whilst reporting the features of the Navon stimuli impaired performance. Using a face composite task, which is assumed to require featural processing, Weston and Perfect (2005) Weston, N. J. and Perfect, T. J. 2005. The effects of processing bias on the composite effect. /precode>. Psychonomic Bulletin and Review, 12: 1038–1042. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] showed the complementary pattern: Featural responding to Navon letters speeded performance. However, both studies used Navon stimuli with global precedence, in which the overall configuration is easier to report than the features. Here we replicate the two studies above, whilst manipulating the precedence (global or featural) of the letter stimuli in the orientation task. Both studies replicated the previously reported findings with global precedence stimuli, but showed the reverse pattern with local precedence stimuli. These data raise important questions as to what is transferred between the Navon orientation task and the face-processing tasks that follow.     

The development of spatial frequency biases in face recognition

Previous research has suggested that a mid-band of spatial frequencies is critical to face recognition in adults, but few studies have explored the development of this bias in children. We present a paradigm adapted from the adult literature to test spatial frequency biases throughout development. Faces were presented on a screen with particular spatial frequencies blocked out by noise masks. A mid-band bias was found in adults and 9- and 10-year-olds for upright faces but not for inverted faces, suggesting a face-sensitive effect. However, 7- and 8-year-olds did not demonstrate the mid-band bias for upright faces but rather processed upright and inverted faces similarly. This suggests that specialization toward the mid-band for upright face recognition develops gradually during childhood and may relate to an advanced level of face expertise.     

Tolerance for distorted faces: Challenges to a configural processing account of familiar face recognition

Face recognition is widely held to rely on ‘configural processing’, an analysis of spatial relations between facial features. We present three experiments in which viewers were shown distorted faces, and asked to resize these to their correct shape. Based on configural theories appealing to metric distances between features, we reason that this should be an easier task for familiar than unfamiliar faces (whose subtle arrangements of features are unknown). In fact, participants were inaccurate at this task, making between 8% and 13% errors across experiments. Importantly, we observed no advantage for familiar faces: in one experiment participants were more accurate with unfamiliars, and in two experiments there was no difference. These findings were not due to general task difficulty – participants were able to resize blocks of colour to target shapes (squares) more accurately. We also found an advantage of familiarity for resizing other stimuli (brand logos). If configural processing does underlie face recognition, these results place constraints on the definition of ‘configural’. Alternatively, familiar face recognition might rely on more complex criteria – based on tolerance to within-person variation rather than highly specific measurement.     

Carryover of scanning behaviour affects upright face recognition differently to inverted face recognition

Face perception is characterized by a distinct scanpath. While eye movements are considered functional, there has not been direct evidence that disrupting this scanpath affects face recognition performance. The present experiment investigated the influence of an irrelevant letter-search task (with letter strings arranged horizontally, vertically, or randomly) on the subsequent scanning strategies in processing upright and inverted famous faces. Participants’ response time to identify the face and the direction of their eye movements were recorded. The orientation of the letter search influenced saccadic direction when viewing the face images, such that a direct carryover-effect was observed. Following a vertically oriented letter-search task, the recognition of famous faces was slower and less accurate for upright faces, and faster for inverted faces. These results extend the carryover findings of Thompson and Crundall into a novel domain. Crucially they also indicate that upright and inverted faces are better processed by different eye movements, highlighting the importance of scanpaths in face recognition.     

面孔识别的认知发展机制

关于面孔识别能力的认知发展机制问题,目前存在两种不同的观点。一种是面孔特殊性发展理论,认为儿童的面孔识别之所以不如成人,是由于儿童和成人对面孔的加工方式不同,代表性理论有部分加工-结构加工理论,内部特征-外部特征加工理论,多维空间理论等。另一种是一般认知能力观点,认为儿童很早就具备了成人式的面孔加工方式,之后面孔识别任务中成绩的提高都可归因于一般认知能力的发展。在对两种观点进行评述的基础上,对未来的面孔识别研究提出了建议。     

Sensitivity of 4-year-olds to featural and second-order relational changes in face distinctiveness

Sensitivity to adult ratings of facial distinctiveness (how much an individual stands out in a crowd) has been demonstrated previously in children age 5 years or older. Experiment 1 extended this result to 4-year-olds using a "choose the more distinctive face" task. Children's patterns of choice across item pairs also correlated well with those of adults. In Experiment 2, original faces were made more distinctive via local feature changes (e.g., bushier eyebrows) or via relational changes (spacing changes, e.g., eyes closer together). Some previous findings suggest that children's sensitivity develops more slowly to relational changes than to featural changes. However, when we matched featural and relational changes for effects on distinctiveness in adult participants, 4-year-olds were equally sensitive to both. Our results suggest that (a) 4-year-olds' face space has important aspects of structure in common with that of adults and that (b) there is no specific developmental delay for a second-order relational component of configural/holistic processing.     

A unique look at face processing: the impact of masked faces on the processing of facial features

This experiment utilized a masked priming paradigm to explore the early processes involved in face recognition. The first experiment investigated implicit processing of the eyes and mouth in an upright face, using prime durations of 33 and 50 ms. The results demonstrate implicit processing of both the eyes and mouth, and support the configural processing theory of face processing. The second experiment used the same method with inverted faces and the third experiment was a combination of Experiments 1 and 2. The fourth experiment utilized misaligned faces as the primes. Based on the pattern of results from these experiments, we suggest that, when a face is inverted, the eyes and mouth are initially processed individually and are not linked until a later stage of processing. An upright face is proposed to be processed by analysis of its configuration, whereas an inverted face is initially processed using first-order relational information, and then converted to an upright representation and transferred to face specific regions for configural analysis.     

Perceptual specialization and configural face processing in infancy

Adults’ face processing expertise includes sensitivity to second-order configural information (spatial relations among features such as distance between eyes). Prior research indicates that infants process this information in female faces. In the current experiments, 9-month-olds discriminated spacing changes in upright human male and monkey faces but not in inverted faces. However, they failed to process matching changes in upright house stimuli. A similar pattern of performance was exhibited by 5-month-olds. Thus, 5- and 9-month-olds exhibited specialization by processing configural information in upright primate faces but not in houses or inverted faces. This finding suggests that, even early in life, infants treat faces in a special manner by responding to changes in configural information more readily in faces than in non-face stimuli. However, previously reported differences in infants’ processing of human versus monkey faces at 9 months of age (but not at younger ages), which have been associated with perceptual narrowing, were not evident in the current study. Thus, perceptual narrowing is not absolute in the sense of loss of the ability to process information from other species’ faces at older ages.     

An own-race advantage for components as well as configurations in face recognition

The own-race advantage in face recognition has been hypothesized as being due to a superiority in the processing of configural information for own-race faces. Here we examined the contributions of both configural and component processing to the own-race advantage. We recruited 48 Caucasian participants in Australia and 48 Chinese participants in Hong Kong, and had them study Caucasian and Chinese faces. After study, they were shown old faces (along with distractors) that were either blurred (isolating configural processing), in which high spatial frequencies were removed from the intact faces, or scrambled (isolating component processing), in which the locations of all face components were rearranged. Participants performed better on the memory test for own-race faces in both the blurred (configural) and scrambled (component) conditions, showing an own-race advantage for both configural and component processing. These results suggest that the own-race advantage in face recognition is due to a general facilitation in different forms of face processing.     

Faces as perceptual wholes: The interplay between component and configural properties in face processing

The relative dominance of component and configural properties in face processing is a controversial issue. We examined this issue by testing whether the discriminability of components predicts the discrimination of faces with similar versus dissimilar configurations. Discrimination of faces with similar configurations was determined by components discriminability, indicating independent processing of facial components. The presence of configural variation had no effect on discriminating faces with highly discriminable components, suggesting that discrimination was based on the components. The presence of configural variation, however, facilitated the discrimination of faces with more difficult-to-discriminate components, above and beyond what would be predicted by the configural or componential discriminability, indicating interactive processing. No effect of configural variation was observed in discriminating inverted faces. These results suggest that both component and configural properties contribute to the processing of upright faces and no property necessarily dominates the other. Upright face discrimination can rely on components, configural properties, or interactive processing of component and configural properties, depending on the information available and the discriminability of the properties. Inverted faces are dominated by componential processing. The finding that interactive processing of component and configural properties surfaced when the properties were of similar, not very high discriminability, suggests that such interactive processing may be the dominant form of face processing in everyday life.     

Distinct eye movements for different cognitive processes as expressed in the face recognition task

Contemporary research literature indicates that eye movements during the learning and testing phases can predict and affect future recognition processes. Nevertheless, only partial information exists regarding eye movements in the various components of recognition processes: Hits, Correct rejections, Misses and False Alarms (FA). In an attempt to address this issue, participants in this study viewed human faces in a yes/no recognition memory paradigm. They were divided into two groups – one group that carried out the testing phase immediately after the learning phase (n?=?30) and another group with a 15-minute delay between phases (n?=?28). The results showed that the Immediate group had a lower FA rate than the Delay group, and that no Hit rate differences were observed between the two groups. Eye movements differed between the recognition processes in the learning and the testing phases, and this pattern interacted with the group type. Hence, eye movement measures seem to track memory accuracy during both learning and testing phases and this pattern also interacts with the length of delay between learning and testing. This pattern of results suggests that eye movements are indicative of present and future recognition processes.     

Early maturity of face recognition: No childhood development of holistic processing, novel face encoding, or face-space

Historically, it was believed the perceptual mechanisms involved in individuating faces developed only very slowly over the course of childhood, and that adult levels of expertise were not reached until well into adolescence. Over the last 10 years, there has been some erosion of this view by demonstrations that all adult-like behavioural properties are qualitatively present in young children and infants. Determining the age of maturity, however, requires quantitative comparison across age groups, a task made difficult by the need to disentangle development in face perception from development in all the other cognitive factors that affect task performance. Here, we argue that full quantitative maturity is reached early, by 5-7 years at the latest and possibly earlier. This is based on a comprehensive literature review of results in the 5-years-to-adult age range, with particular focus on the results of the few previous studies that are methodologically suitable for quantitative comparison of face effects across age, plus three new experiments testing development of holistic/configural processing (faces versus objects, disproportionate inversion effect), ability to encode novel faces (assessed via implicit memory) and face-space (own-age bias).     

Multiple perceptual strategies used by macaque monkeys for face recognition

Successful integration of individuals in macaque societies suggests that monkeys use fast and efficient perceptual mechanisms to discriminate between conspecifics. Humans and great apes use primarily holistic and configural, but also feature-based, processing for face recognition. The relative contribution of these processes to face recognition in monkeys is not known. We measured face recognition in three monkeys performing a visual paired comparison task. Monkey and humans faces were (1) axially rotated, (2) inverted, (3) high-pass filtered, and (4) low-pass filtered to isolate different face processing strategies. The amount of time spent looking at the eyes, mouth, and other facial features was compared across monkey and human faces for each type of stimulus manipulation. For all monkeys, face recognition, expressed as novelty preference, was intact for monkey faces that were axially rotated or spatially filtered and was supported in general by preferential looking at the eyes, but was impaired for inverted faces in two of the three monkeys. Axially rotated, upright human faces with a full range of spatial frequencies were also recognized, however, the distribution of time spent exploring each facial feature was significantly different compared to monkey faces. No novelty preference, and hence no inferred recognition, was observed for inverted or low-pass filtered human faces. High-pass filtered human faces were recognized, however, the looking pattern on facial features deviated from the pattern observed for monkey faces. Taken together these results indicate large differences in recognition success and in perceptual strategies used by monkeys to recognize humans versus conspecifics. Monkeys use both second-order configural and feature-based processing to recognize the faces of conspecifics, but they use primarily feature-based strategies to recognize human faces.     

Dissociation of facial attractiveness and distinctiveness processing in congenital prosopagnosia

According to the influential model of Bruce and Young (1986) socially relevant facial information is processed separately from facial information leading to individual face recognition. In recent years functional imaging has identified a network of distinct occipitotemporal cortex areas for the processing of these two kinds of information. Functionally it is not clear at which processing level the “social” and the “recognition” pathways diverge. The study of subjects with a profound face recognition and learning deficit (congenital prosopagnosia—cPA) promises for a better understanding of this issue. We therefore tested the perception of attractiveness (a cue of prime social importance) and distinctiveness (a facial feature related to recognition) in 14 people with cPA. Although attractiveness ratings were highly consistent with controls, cPA subjects' distinctiveness ratings showed random patterns. This dissociation of normal attractiveness processing and impaired distinctiveness processing in cPA helps to specifies the nature of the impairment in this condition while shedding light on the functional architecture of normal face processing.     

Investigation of effects of face rotation on race processing: An ERPs study

Recent ERP research has indicated that the processing of faces of other races (OR) and same race (SR) as the perceiver differs at the perceptual level, more precisely for the N170 component. The purpose of the present study was to continue the investigation of the race-of-face processing across multiple orientations. Event-related brain potentials (ERPs) and performance were recorded when Caucasian participants were required to categorize by race Caucasian and African faces presented in eight different angles of orientation. Three main observations were made: (1) the face-sensitive N170 is modulated by the race of faces, being larger in response to OR compared to SR faces; (2) face rotation affected this component in the same pattern for both racial groups; (3) the N170-ORE progressively disappeared as the faces moved away from their canonical orientation at the right hemisphere only. Thus, the current findings suggest that configural/holisitic information is extracted from faces of both racial groups, but that upright OR faces require increased demands.     

Long-term effects of covert face recognition

Covert face recognition has previously been thought to produce only very short-lasting effects. In this study we demonstrate that manipulating subjects' attentional load affects explicit, but not implicit memory for faces, and that implicit effects can persist over much longer intervals than is normally reported. Subjects performed letter-string tasks of high vs. low perceptual load (Lavie, N. (1995). Perceptual load as a necessary condition for selective attention. Journal of Experimental Psychology: Human Perception and Perfomance. 21, 451-468.), while ignoring task-irrelevant celebrity faces. Memory for the faces was then assessed using (a) a surprise recognition test for the celebrities' names, and (b) repetition priming in a face familiarity task. The load manipulation strongly influenced explicit recognition memory, but had no effect on repetition priming from the same items. Moreover, faces from the high load condition produced the same amount of priming whether they were explicitly remembered or not. This result resolves a long-standing anomaly in the face recognition literature, and is discussed in relation to covert processing in prosopagnosia.     

Individual differences in (non-visual) processing style predict the face inversion effect

Recent research suggests that individuals with relatively weak global precedence (i.e., a smaller propensity to view visual stimuli in a configural manner) show a reduced face inversion effect (FIE). Coupled with such findings, a number of recent studies have demonstrated links between an advantage for feature-based processing and the presentation of traits associated with autism among the general population. The present study sought to bridge these findings by investigating whether a relationship exists between the possession of autism-associated traits (i.e., as indicated by individuals'"autism quotient" [(AQ) and the size of the FIE. Participants completed an on-line study in which the AQ was measured prior to a standard face recognition task where half of the faces were inverted at test. The results confirmed that higher AQ levels were predictive of smaller FIEs. Implications for a common underlying factor relating to processing orientation are discussed.