Diagnostic colors mediate scene recognition

In this research, we aim to ground scene recognition on information other than the identity of component objects. Specifically we seek to understand the structure of color cues that allows the express recognition of scene gists. Using the L*a*b* color space we examined the conditions under which chromatic cues concur with brightness to allow a viewer to recognize scenes at a glance. Using different methods, Experiments 1 and 2 tested the hypothesis that colors do contribute when they are diagnostic (i.e., predictive) of a scene category. Experiment 3 examined the structure of colored cues at different spatial scales that are responsible for the effects of color diagnosticity reported in Experiments 1 and 2. Together, the results suggest that colored blobs at a coarse spatial scale concur with luminance cues to form the relevant spatial layout that mediates express scene recognition.     

The contribution of shape and surface information in the other-race face effect

Faces from another race are generally more difficult to recognize than faces from one's own race. However, faces provide multiple cues for recognition and it remains unknown what are the relative contribution of these cues to this “other-race effect”. In the current study, we used three-dimensional laser-scanned head models which allowed us to independently manipulate two prominent cues for face recognition: the facial shape morphology and the facial surface properties (texture and colour). In Experiment 1, Asian and Caucasian participants implicitly learned a set of Asian and Caucasian faces that had both shape and surface cues to facial identity. Their recognition of these encoded faces was then tested in an old/new recognition task. For these face stimuli, we found a robust other-race effect: Both groups were more accurate at recognizing own-race than other-race faces. Having established the other-race effect, in Experiment 2 we provided only shape cues for recognition and in Experiment 3 we provided only surface cues for recognition. Caucasian participants continued to show the other-race effect when only shape information was available, whereas Asian participants showed no effect. When only surface information was available, there was a weak pattern for the other-race effect in Asians. Performance was poor in this latter experiment, so this pattern needs to be interpreted with caution. Overall, these findings suggest that Asian and Caucasian participants rely differently on shape and surface cues to recognize own-race faces, and that they continue to use the same cues for other-race faces, which may be suboptimal for these faces.     

Are there qualitative differences between face processing in photographic positive and negative?

The question whether face recognition in photographic negative relies more on external features and pictorial cues than in photographic positive was studied in five experiments. Recognition of whole faces as well as both external and internal features of the faces was compared in experiments 1 and 2. The conditions in which views of faces between learning and test were either identical (hence providing maximum pictorial cues) or different (hence reducing such cues) were compared in experiments 3, 4, and 5. The results showed that recognition of internal features in two-tone and multi-tone images suffered more from use of photographic negatives than recognition of external features. Testing with both multi-tone and two-tone images revealed that the deficit caused by view changes between learning and test was no more severe with negatives than with positives. Finally, removing external features made recognition of different views equally more difficult for positives and negatives. Overall, these results point to a qualitative rather than quantitative difference between processing face images in photographic positive and negative.     

Females excel at basic face perception

Females are generally better than males at recognizing facial emotions. However, it is not entirely clear whether and in what way females may also excel at non-affective face recognition. Here, we tested males and females on two perceptual face recognition tasks that involved only neutral expressions: detection and identity discrimination. On face detection (Experiment 1), females were significantly more accurate than males in detecting upright faces. This gender difference was reduced during inverted face detection, and not present during tree detection, suggesting that the magnitude of the gender difference for performance co-varies with the extent to which face processing mechanisms are involved. On facial identity discrimination (Experiment 2), females again outperformed males, particularly when face images were masked by visual noise, or the delay between comparison face images was extended from 0.5 to 3 s. These results reveal a female advantage in processing face-specific information and underscore the role of perceptual factors in socially relevant gender differences.     

Real-world face recognition: the importance of surface reflectance properties

The face recognition task we perform [corrected] most often in everyday experience is the identification of people with whom we are familiar. However, because of logistical challenges, most studies focus on unfamiliar-face recognition, wherein subjects are asked to match or remember images of unfamiliar people's faces. Here we explore the importance of two facial attributes -shape and surface reflectance-in the context of a familiar-face recognition task. In our experiment, subjects were asked to recognise color images of the faces of their friends. The images were manipulated such that only reflectance or only shape information was useful for recognizing any particular face. Subjects were actually better at recognizing their friends' faces from reflectance information than from shape information. This provides evidence that reflectance information is important for face recognition in ecologically relevant contexts.     

How color enhances visual memory for natural scenes

We offer a framework for understanding how color operates to improve visual memory for images of the natural environment, and we present an extensive data set that quantifies the contribution of color in the encoding and recognition phases. Using a continuous recognition task with colored and monochrome gray-scale images of natural scenes at short exposure durations, we found that color enhances recognition memory by conferring an advantage during encoding and by strengthening the encoding-specificity effect. Furthermore, because the pattern of performance was similar at all exposure durations, and because form and color are processed in different areas of cortex, the results imply that color must be bound as an integral part of the representation at the earliest stages of processing.     

The importance of internal facial features in learning new faces

For familiar faces, the internal features (eyes, nose, and mouth) are known to be differentially salient for recognition compared to external features such as hairstyle. Two experiments are reported that investigate how this internal feature advantage accrues as a face becomes familiar. In Experiment 1, we tested the contribution of internal and external features to the ability to generalize from a single studied photograph to different views of the same face. A recognition advantage for the internal features over the external features was found after a change of viewpoint, whereas there was no internal feature advantage when the same image was used at study and test. In Experiment 2, we removed the most salient external feature (hairstyle) from studied photographs and looked at how this affected generalization to a novel viewpoint. Removing the hair from images of the face assisted generalization to novel viewpoints, and this was especially the case when photographs showing more than one viewpoint were studied. The results suggest that the internal features play an important role in the generalization between different images of an individual's face by enabling the viewer to detect the common identity-diagnostic elements across non-identical instances of the face.     

Emotional information in body and background hampers recognition memory for faces

Emotional influences on memory for events have long been documented yet surprisingly little is known about how emotional signals conveyed by contextual cues influence memory for face identity. This study investigated how positively and negatively valenced contextual emotion cues conveyed by body expressions or background scenes influence face memory. The results provide evidence of emotional context influence on face recognition memory and show that faces encoded in emotional (either fearful or happy) contexts (either the body or background scene) are less well recognized than faces encoded in neutral contexts and this effect is larger for body context than for scene context. The findings are compatible with the hypothesis that emotional signals in visual scenes trigger orienting responses which may lead to a less elaborate processing of featural details like the identity of a face, in turn resulting in a decreased facial recognition memory.     

Categorical perception of face identity in noise isolates configural processing.

Neuropsychological evidence suggests that face recognition based on configural (holistic) information can occur in isolation from recognition based on local feature cues. The present study shows that configural processing can be isolated experimentally in normal subjects. A phenomenon is reported that exists only for upright whole faces, namely categorical perception (CP) of face identity in noise. Three discrimination tasks (ABX, better likeness, and similarity ratings) were used to test for perceptual distortion across the category boundary predicted from binary classification of face morphs. Noise was added such that any single local region provided unreliable cues to identity. Under these conditions, CP was found for upright faces but not for inverted faces or single features, even with more than 10,000 trials. The CP-in-noise signature phenomenon was then used to show that configural processing survives image plane rotations of 45 degrees-90 degrees.     

Dissecting the time course of person recognition in natural viewing environments

Person recognition often unfolds over time and distance as a person approaches, with the quality of identity information from faces, bodies, and motion in constant flux. Participants were familiarized with identities using close‐up and distant videos. Recognition was tested with videos of people approaching from a distance. We varied the timing of prompted responses in the test videos, the amount of video seen, and whether the face, body, or whole person was visible. A free response condition was also included to allow participants to respond when they felt ‘confident’. The pattern of accuracy across conditions indicated that recognition judgments were based on the most recently available information, with no contribution from qualitatively diverse and statistically useful person cues available earlier in the video. Body recognition was stable across viewing distance, whereas face recognition improved with proximity. The body made an independent contribution to recognition only at the farthest distance tested. Free response latencies indicated meta‐knowledge of the optimal proximity for recognition from faces versus bodies. Notably, response bias varied strongly as a function of participants’ expectation about whether closer proximity video was forthcoming. These findings lay the groundwork for developing person recognition theories that generalize to natural viewing environments.     

The flip side of the other‐race coin: They all look different to me

Poorer recognition of other‐race faces than own‐races faces has been attributed to a problem of discrimination (i.e., telling faces apart). The conclusion that ‘they all look the same to me' is based on studies measuring the perception/memory of highly controlled stimuli, typically involving only one or two images of each identity. We hypothesized that such studies underestimate the challenge involved in recognizing other‐race faces because in the real world, an individual's appearance varies in a number of ways (e.g., lighting, expression, hairstyle), reducing the utility of relying on pictorial cues to identity. In two experiments, Caucasian and East Asian participants completed a perceptual sorting task in which they were asked to sort 40 photographs of two unfamiliar identities into piles such that each pile contained all photographs of a single identity. Participants perceived more identities when sorting other‐race faces than own‐race faces, both when sorting celebrity (Experiment 1) and non‐celebrity (Experiment 2) faces, suggesting that in the real world, ‘they all look different to me'. We discuss these results in the light of models in which each identity is represented as a region in a multidimensional face space; we argue that this region is smaller for other‐race than own‐race faces.     

身份识别的脑功能成像研究

身份识别在日常生活中具有重要作用。身份识别可以单独通过面孔或语音来完成,也可以通过面孔和语音共同完成。文章首先从面孔和语音两个方面分别对身份识别的脑功能成像研究进行介绍,包括对身份整体性的识别和对种族、年龄、性别、熟悉性等身份亚成分的识别,然后对面孔和语音在身份识别中的关系进行介绍,最后进行了总结和展望     

The role of higher level adaptive coding mechanisms in the development of face recognition

Developmental improvements in face identity recognition ability are widely documented, but the source of children’s immaturity in face recognition remains unclear. Differences in the way in which children and adults visually represent faces might underlie immaturities in face recognition. Recent evidence of a face identity aftereffect (FIAE), in which adaptation (exposure) to a particular identity causes a previously neutral face to take on the computationally opposite identity, suggests that adults code faces in an opponent fashion relative to an average face. One previous study showed comparable FIAEs in 8-year-olds and adults but did not demonstrate that adaptation was selective for high-level representations in both groups. Using a developmentally appropriate FIAE task, we investigated whether children show adult-like adaptation for facial identity when adapting and test images differ in size. Both age groups showed an equivalent FIAE, suggesting that qualitative changes in the use of higher level adaptive coding mechanisms do not drive the developmental improvements in face recognition ability, at least from 8 years of age.     

The State of Ecological Psychology

We report on two experiments that investigated the role of facial motion in the recognition of degraded famous face images. The results of these experiments suggest that seeing a face move is advantageous for the correct recognition of identity. This effect is not solely due to the extra static-based information contained in a moving sequence but is also due to additional dynamic information available from a moving face. Furthermore, famous faces were recognized more accurately when the original dynamic characteristics of the motion were maintained (Experiment 1), compared to when either the tempo or the direction of motion were altered (Experiment 2). It is suggested that there may be general benefit for viewing naturally moving faces, not specific benefit to any particular face identity. Alternatively, individual faces may have associated characteristic motion signatures.     

Bilingual infants excel at foreign‐language talker recognition

Bilingual and monolingual infants differ in how they process linguistic aspects of the speech signal. But do they also differ in how they process non‐linguistic aspects of speech, such as who is talking? Here, we addressed this question by testing Canadian monolingual and bilingual 9‐month‐olds on their ability to learn to identify native Spanish‐speaking females in a face‐voice matching task. Importantly, neither group was familiar with Spanish prior to participating in the study. In line with our predictions, bilinguals succeeded in learning the face‐voice pairings, whereas monolinguals did not. We consider multiple explanations for this finding, including the possibility that simultaneous bilingualism enhances perceptual attentiveness to talker‐specific speech cues in infancy (even in unfamiliar languages), and that early bilingualism delays perceptual narrowing to language‐specific talker recognition cues. This work represents the first evidence that multilingualism in infancy affects the processing of non‐linguistic aspects of the speech signal, such as talker identity.     

A bottleneck in face identification: repetition priming from flanker images

There is evidence that face processing is capacity-limited in distractor interference tasks and in tasks requiring overt recognition memory. We examined whether capacity limits for faces can be observed with a more sensitive measure of visual processing, by measuring repetition priming of flanker faces that were presented alongside a face or a nonface target. In Experiment 1, we found identity priming for face flankers, by measuring repetition priming across a change in image, during task-relevant nonface processing, but not during the processing of a concurrently-presented face target. Experiment 2 showed perceptual priming of the flanker faces, across identical images at prime and test, when they were presented alongside a face target. In a third Experiment, all of these effects were replicated by measuring identity priming and perceptual priming within the same task. Overall, these results imply that face processing is capacity limited, such that only a single face can be identified at one time. Merely attending to a target face appears sufficient to trigger these capacity limits, thereby extinguishing identification of a second face in the display, although our results demonstrate that the additional face remains at least subject to superficial image processing.     

How dogs scan familiar and inverted faces: an eye movement study

Faces play an important role in communication and identity recognition in social animals. Domestic dogs often respond to human facial cues, but their face processing is weakly understood. In this study, facial inversion effect (deficits in face processing when the image is turned upside down) and responses to personal familiarity were tested using eye movement tracking. A total of 23 pet dogs and eight kennel dogs were compared to establish the effects of life experiences on their scanning behavior. All dogs preferred conspecific faces and showed great interest in the eye area, suggesting that they perceived images representing faces. Dogs fixated at the upright faces as long as the inverted faces, but the eye area of upright faces gathered longer total duration and greater relative fixation duration than the eye area of inverted stimuli, regardless of the species (dog or human) shown in the image. Personally, familiar faces and eyes attracted more fixations than the strange ones, suggesting that dogs are likely to recognize conspecific and human faces in photographs. The results imply that face scanning in dogs is guided not only by the physical properties of images, but also by semantic factors. In conclusion, in a free-viewing task, dogs seem to target their fixations at naturally salient and familiar items. Facial images were generally more attractive for pet dogs than kennel dogs, but living environment did not affect conspecific preference or inversion and familiarity responses, suggesting that the basic mechanisms of face processing in dogs could be hardwired or might develop under limited exposure.     

The role of color in human face detection

Significant advances have been made in understanding human face recognition . However, a fundamental aspect of this process, how faces are located in our visual environment, is poorly understood and little studied. Here we examine the role of color in human face detection. We demonstrate that detection performance declines when color information is removed from faces, regardless of whether the surrounding scene context is rendered in color. Furthermore, faces rendered in unnatural colors are hard to detect, suggesting a role beyond simple segmentation. When faces are presented such that half the surface is colored appropriately, and half unnaturally, performance declines. This suggests that observers are not simply using the presence of skin color "patches" to detect faces. Rather, our data suggest that detection operates via a face template combining diagnostic color and face-shape information. These findings are consistent with color-template approaches used in some computer-based face detection systems.     

Familiarity matters: A review on prioritized processing of personally familiar faces

In this review, we synthesize the existing literature investigating personally familiar face processing and highlight the remarkable, enhanced processing efficiency resulting from real-life experience. Highly learned identity-specific visual and semantic information associated with personally familiar face representations facilitates detection, recognition of identity and social cues, and activation of person knowledge. These optimizations afford qualitatively different processing of personally familiar as compared to unfamiliar faces, which manifests on both the behavioural and neural level.     

Face age and sex modulate the other-race effect in face recognition

Faces convey a variety of socially relevant cues that have been shown to affect recognition, such as age, sex, and race, but few studies have examined the interactive effect of these cues. White participants of two distinct age groups were presented with faces that differed in race, age, and sex in a face recognition paradigm. Replicating the other-race effect, young participants recognized young own-race faces better than young other-race faces. However, recognition performance did not differ across old faces of different races (Experiments 1, 2A). In addition, participants showed an other-age effect, recognizing White young faces better than White old faces. Sex affected recognition performance only when age was not varied (Experiment 2B). Overall, older participants showed a similar recognition pattern (Experiment 3) as young participants, displaying an other-race effect for young, but not old, faces. However, they recognized young and old White faces on a similar level. These findings indicate that face cues interact to affect recognition performance such that age and sex information reliably modulate the effect of race cues. These results extend accounts of face recognition that explain recognition biases (such as the other-race effect) as a function of dichotomous ingroup/outgroup categorization, in that outgroup characteristics are not simply additive but interactively determine recognition performance.