Things are looking up: differential decline in face recognition following pitch and yaw rotation

Previous research into the effects of viewpoint change on face recognition has typically dealt with rotations around the head's vertical axis (yaw). Another common, although less studied, source of viewpoint variation in faces is rotation around the head's horizontal pitch axis (pitch). In the current study we used both a sequential matching task and an old/new recognition task to examine the effect of viewpoint change following rotation about both pitch and yaw axes on human face recognition. The results of both tasks showed that recognition performance was better for faces rotated about yaw compared to pitch. Further, recognition performance for faces rotated upwards on the pitch axis was better than for faces rotated downwards. Thus, equivalent angular rotations about pitch and yaw do not produce equivalent viewpoint-dependent declines in recognition performance.     

Features are also important: contributions of featural and configural processing to face recognition

It has been suggested that face recognition is primarily based on configural information, with featural information playing little or no role. We investigated this idea by comparing the prototype effect for face prototypes that emphasized either featural or configural processing. In Experiment 1, participants showed a tendency to commit false alarms in response to nonstudied prototypes, and this tendency was equivalent for featural and configural prototypes. Experiment 2 replicated this finding, and provided support for the assumption that the two types of prototypes differed in terms of featural and configural processing: Face inversion eliminated the prototype effect for configural prototypes but not for featural prototypes. These results suggest that both featural and configural processing make important contributions to face recognition, and that their effects are dissociable.     

Emotion recognition: The role of featural and configural face information

Several studies investigated the role of featural and configural information when processing facial identity. A lot less is known about their contribution to emotion recognition. In this study, we addressed this issue by inducing either a featural or a configural processing strategy (Experiment 1) and by investigating the attentional strategies in response to emotional expressions (Experiment 2). In Experiment 1, participants identified emotional expressions in faces that were presented in three different versions (intact, blurred, and scrambled) and in two orientations (upright and inverted). Blurred faces contain mainly configural information, and scrambled faces contain mainly featural information. Inversion is known to selectively hinder configural processing. Analyses of the discriminability measure (A′) and response times (RTs) revealed that configural processing plays a more prominent role in expression recognition than featural processing, but their relative contribution varies depending on the emotion. In Experiment 2, we qualified these differences between emotions by investigating the relative importance of specific features by means of eye movements. Participants had to match intact expressions with the emotional cues that preceded the stimulus. The analysis of eye movements confirmed that the recognition of different emotions rely on different types of information. While the mouth is important for the detection of happiness and fear, the eyes are more relevant for anger, fear, and sadness.     

Two routes to face perception: evidence from psychophysics and computational modeling

The aim of this study was to separately analyze the role of featural and configural face representations. Stimuli containing only featural information were created by cutting the faces into their parts and scrambling them. Stimuli only containing configural information were created by blurring the faces. Employing an old-new recognition task, the aim of Experiments 1 and 2 was to investigate whether unfamiliar faces (Exp. 1) or familiar faces (Exp. 2) can be recognized if only featural or configural information is provided. Both scrambled and blurred faces could be recognized above chance level. A further aim of Experiments 1 and 2 was to investigate whether our method of creating configural and featural stimuli is valid. Pre-activation of one form of representation did not facilitate recognition of the other, neither for unfamiliar faces (Exp. 1) nor for familiar faces (Exp. 2). This indicates a high internal validity of our method for creating configural and featural face stimuli. Experiment 3 examined whether features placed in their correct categorical relational position but with distorted metrical distances facilitated recognition of unfamiliar faces. These faces were recognized no better than the scrambled faces in Experiment 1, providing further evidence that facial features are stored independently of configural information. From these results we conclude that both featural and configural information are important to recognize a face and argue for a dual-mode hypothesis of face processing. Using the psychophysical results as motivation, we propose a computational framework that implements featural and configural processing routes using an appearance-based representation based on local features and their spatial relations. In three computational experiments (Experiments 4–6) using the same sets of stimuli, we show how this framework is able to model the psychophysical data.     

Effects of geometric distortions on face-recognition performance

The importance of 'configural' processing for face recognition is now well established, but it remains unclear precisely what it entails. Through four experiments we attempted to clarify the nature of configural processing by investigating the effects of various affine transformations on the recognition of familiar faces. Experiment 1 showed that recognition was markedly impaired by inversion of faces, somewhat impaired by shearing or horizontally stretching them, but unaffected by vertical stretching of faces to twice their normal height. In experiment 2 we investigated vertical and horizontal stretching in more detail, and found no effects of either transformation. Two further experiments were performed to determine whether participants were recognising stretched faces by using configural information. Experiment 3 showed that nonglobal vertical stretching of faces (stretching either the top or the bottom half while leaving the remainder undistorted) impaired recognition, implying that configural information from the stretched part of the face was influencing the process of recognition--ie that configural processing involves global facial properties. In experiment 4 we examined the effects of Gaussian blurring on recognition of undistorted and vertically stretched faces. Faces remained recognisable even when they were both stretched and blurred, implying that participants were basing their judgments on configural information from these stimuli, rather than resorting to some strategy based on local featural details. The tolerance of spatial distortions in human face recognition suggests that the configural information used as a basis for face recognition is unlikely to involve information about the absolute position of facial features relative to each other, at least not in any simple way.     

Configural face encoding and spatial frequency information

Configural relations and a critical band of spatial frequencies (SFs) in the middle range are particularly important for face recognition. We report the results of four experiments in which the relationship between these two types of information was examined. In Experiments 1, 2A, and 2B, the face inversion effect (FIE) was used to probe configural face encoding. Recognition of upright and inverted faces and nonface objects was measured in four conditions: a no-filter condition and three SF conditions (low, medium, and high frequency). We found significant FIEs of comparable magnitudes for all frequency conditions. In Experiment 3, discrimination of faces on the basis of either configural or featural modifications was measured under the same four conditions. Although the ability to discriminate configural modifications was superior in the medium-frequency condition, so was the ability to discriminate featural modifications. We conclude that the band of SF that is critical for face recognition does not contribute preferentially to configural encoding.     

Contribution of upper trunk rotation to hand forward-backward movement and propulsion in front crawl strokes

The study aims to test three hypotheses: (a) the rotation of the upper trunk consists of roll, pitch and yaw of frequencies harmonic to the stroke frequency of the front crawl stroke, (b) the rotation of the upper trunk generates back-and-forth movements of the shoulders, which enhances the movements of the stroking arms, and (c) the angular velocities of roll, pitch and yaw are associated with hand propulsion (HP). Front crawl strokes performed by twenty male swimmers were measured with a motion capture system. The roll, pitch and yaw angles about the three orthogonal axes embedded in the upper trunk were determined as three sequential Cardan angles and their angular velocities were determined as the three respective components of the angular velocity. HP and the drag and lift components of HP (HP_D and HP_L) were estimated by the hand positions and the data from twelve pressure sensors attached on hands. The roll, pitch, and yaw angles were altered in frequencies harmonic to the stroke frequency during the front crawl stroke. Shoulders alternately moved back and forth due to the upper trunk rotation. In the pull phase the angular velocity of roll was correlated with HP_L (r = −0.62, p = 0.004). Based on the back-and-forth movements of the shoulders and roll motion relative to a hand movement, the arm-stroke technique of the front crawl swimming was discussed in terms of increasing the hand velocity and HP.     

Configural information is processed differently in human action

Recent evidence indicates that observers' sensitivity to configural information in dynamic human action is disrupted when action is inverted, whereas sensitivity to featural action information is not. The current research involved two experiments that expand upon this basic finding. Experiment 1 revealed that featural and configural action information are processed similarly in static representations of action as in dynamic action. Experiment 2 indicated that configural processing is uniquely sensitive to orientation only in human action as compared to a similar control stimulus. These findings further support the idea that the perception of action recruits specialized orientation-specific configural processing, and parallel similar findings in face perception and visual expertise.     

人脸特征信息反转效应的实验研究

结构信息和特征信息的研究是近年来人脸认知的热点,特征信息是否存在反转效应不同的理论对此有不同的看法。通过对平均人脸特征信息阈限的研究,发现:平均人脸特征信息的阈限具有明显的反转效应;特征信息的识别难度是决定特征信息的识别是否出现反转效应的重要因素。研究支持整体假设,认为成人是将人脸作为一个整体进行认知的。     

Faces elicit different scanning patterns depending on task demands

Eye movements were recorded while participants discriminated upright and inverted faces that differed with respect to either configural or featural information. Two hypotheses were examined: (1) whether featural and configural information processing elicit different scanning patterns; (2) whether fixations on a specific region of the face dominate scanning patterns. Results from two experiments were compared to examine whether participants’ prior knowledge of the kind of information that would be relevant for the task (i.e., configural vs featural) influences eye movements. In Experiment 1, featural and configural discrimination trials were presented in random order such that participants were unaware of the information that would be relevant on any given trial. In Experiment 2, featural and configural discrimination trials were blocked and participants were informed of the nature of the discriminations. The results of both experiments suggest that faces elicit different scanning patterns depending on task demands. When participants were unaware of the nature of the information relevant for the task at hand, face processing was dominated by attention to the eyes. When participants were aware that relational information was relevant, scanning was dominated by fixations to the center of the face. We conclude that faces elicit scanning strategies that are driven by task demands.     

Influence of subjective difficulty on the degree of configural and featural processing in face recognition1

This study aimed to assess the effect of subjective difficulty on the degree of featural or configural processing in face recognition. It could be assumed that featural processing is analytic processing ( Peterson & Rhodes, 2003 ), while configural processing is automatic processing ( Dunning & Stern, 1994 ). It has been suggested that task difficulty affected the automaticity of processing. Task difficulty was manipulated using a number of alternatives or time pressure. Subjective difficulty could also affect the automaticity of processing. If so, then subjective difficulty may in turn affect the degree of featural or configural processing. Participants in a difficult condition were given instructions mentioning that the face‐recognition task was difficult, while participants in the control condition were given no such instruction. The amount of retrieved featural information in the former condition was less than that in the latter. These results suggested that the degree of featural processing decreased when the participants found the task difficult.     

Interfering with memory for faces: The cost of doing two things at once

We inferred the processes critical for episodic retrieval of faces by measuring susceptibility to memory interference from different distracting tasks. Experiment 1 examined recognition of studied faces under full attention (FA) or each of two divided attention (DA) conditions requiring concurrent decisions to auditorily presented letters. Memory was disrupted in both DA relative to FA conditions, a result contrary to a material-specific account of interference effects. Experiment 2 investigated whether the magnitude of interference depended on competition between concurrent tasks for common processing resources. Studied faces were presented either upright (configurally processed) or inverted (featurally processed). Recognition was completed under FA, or DA with one of two face-based distracting tasks requiring either featural or configural processing. We found an interaction: memory for upright faces was lower under DA when the distracting task required configural than featural processing, while the reverse was true for memory of inverted faces. Across experiments, the magnitude of memory interference was similar (a 19% or 20% decline from FA) regardless of whether the materials in the distracting task overlapped with the to-be-remembered information. Importantly, interference was significantly larger (42%) when the processing demands of the distracting and target retrieval task overlapped, suggesting a processing-specific account of memory interference.     

Features and their configuration in face recognition

Tanaka and Farah (1993) have proposed a holistic approach to face recognition in which information about the features of a face and their configuration are combined together in the face representation. An implication of the holistic hypothesis is that alterations in facial configuration should interfere with retrieval of features. In four experiments, the effect of configuration on feature recognition was investigated by creating two configurations of a face, one with eyes close together and one with eyes far apart. After subjects studied faces presented in one of the two configurations (eyes-close or eyes-far), they were tested for their recognition of features shown in isolation, in a new face configuration, and in the old face configuration. It was found that subjects recognized features best when presented in the old configuration, next best in the new configuration, and poorest in isolation. Moreover, subjects were not sensitive to configural information in inverted faces (Experiment 2) or nonface stimuli (i.e., houses; Experiments 3 and 4). Importantly, for normal faces, altering the spatial location of the eyes not only impaired subjects’ recognition of the eye features but also impaired their recognition of the nose and mouth features—features whose spatial locations were not directly altered. These findings emphasize the interdependency of featural and configural information in a holistic face representation.     

Is there a linear or a nonlinear relationship between rotation and configural processing of faces?

Research suggests that inverted faces are harder to recognise than upright faces because of a disruption in processing their configural properties. Reasons for this difficulty were explored by investigating people's ability to identify faces at intermediate angles of rotation. Participants were asked to discriminate blurred famous and unfamiliar faces presented at nine angles. Blurred faces were used to minimise featural processing strategies, and to assess the effects of rotation that are specific to configural processing. The results indicate a linear relationship between angle of rotation and recognition accuracy. It appears that configural processing becomes gradually more disrupted the further a face is oriented away from the upright. The implications of these findings for competing explanations of the face-inversion effect are discussed.     

Face recognition in 4- to 7-year-olds: processing of configural, featural, and paraphernalia information.

We tested 4- to 7-year-old children's face recognition by manipulating the faces' configural and featural information and the presence of superfluous paraphernalia. Results indicated that even with only a single 5-s exposure to the target face, most children could use configural and feature cues to make identity judgments. Repeated exposure and experimenter feedback enabled other children to do so as well. Even after attaining proficiency at identifying the target face, however, children's recognition was impaired when a superfluous hat was added to the face. Thus, although young children can process featural and configural face information, their memories are highly susceptible to disruption from superfluous paraphernalia.     

Losing face: impaired discrimination of featural and configural information in the mouth region of an inverted face

Given that all faces share the same set of features—two eyes, a nose, and a mouth—that are arranged in similar configuration, recognition of a specific face must depend on our ability to discern subtle differences in its featural and configural properties. An enduring question in the face-processing literature is whether featural or configural information plays a larger role in the recognition process. To address this question, the face dimensions task was designed, in which the featural and configural properties in the upper (eye) and lower (mouth) regions of a face were parametrically and independently manipulated. In a same–different task, two faces were sequentially presented and tested in their upright or in their inverted orientation. Inversion disrupted the perception of featural size (Exp. 1), featural shape (Exp. 2), and configural changes in the mouth region, but it had relatively little effect on the discrimination of featural size and shape and configural differences in the eye region. Inversion had little effect on the perception of information in the top and bottom halves of houses (Exp. 3), suggesting that the lower-half impairment was specific to faces. Spatial cueing to the mouth region eliminated the inversion effect (Exp. 4), suggesting that participants have a bias to attend to the eye region of an inverted face. The collective findings from these experiments suggest that inversion does not differentially impair featural or configural face perceptions, but rather impairs the perception of information in the mouth region of the face.     

Sources of information for discriminating dynamic human actions

Despite the importance of action identification and discrimination in action perception and social cognition more broadly, little research has investigated how these processes are achieved. To this end, we sought to identify the extent to which adults capitalize on featural versus configural sources of information when discriminating small-scale human actions such as grasp and place. Results across two experiments indicate adults are sensitive to both sources of information in action discrimination, but selectively attend to featural over configural action information. The findings also parallel what is known regarding face processing: processing of configural information is especially disrupted by inversion, whereas processing of featural information is specifically affected by low-pass filtering.     

Understanding the role of configural processing in face emotion recognition in Parkinson’s disease

This investigation examined whether impairment in configural processing could explain deficits in face emotion recognition in people with Parkinson’s disease (PD). Stimuli from the Radboud Faces Database were used to compare recognition of four negative emotion expressions by older adults with PD (n = 16) and matched controls (n = 17). Participants were tasked with categorizing emotional expressions from upright and inverted whole faces and facial composites; it is difficult to derive configural information from these two types of stimuli so featural processing should play a larger than usual role in accurate recognition of emotional expressions. We found that the PD group were impaired relative to controls in recognizing anger, disgust and fearful expressions in upright faces. Then, consistent with a configural processing deficit, participants with PD showed no composite effect when attempting to identify facial expressions of anger, disgust and fear. A face inversion effect, however, was observed in the performance of all participants in both the whole faces and facial composites tasks. These findings can be explained in terms of a configural processing deficit if it is assumed that the disruption caused by facial composites was specific to configural processing, whereas inversion reduced performance by making it difficult to derive both featural and configural information from faces.     

Reorienting in images of a three-dimensional environment

Adult humans searched for a hidden goal in images depicting 3-dimensional rooms. Images contained either featural cues, geometric cues, or both, which could be used to determine the correct location of the goal. In Experiment 1, participants learned to use featural and geometric information equally well. However, men and women showed significant differences in their use of distant featural cues and the spontaneous encoding of geometric information when trained with features present. Transformation tests showed that participants could use either the color or the shape of the features independently to locate the goal. Experiment 2 showed that participants could use either configural or surface geometry when searching for the goal. However, their weighing of these geometric cues was dependent on initial training experience.