Face aftereffects suggest interdependent processing of expression and sex and of expression and race

Bruce and Young (1986) proposed that functionally different aspects of faces (e.g., sex, identity, and expression) are processed independently. Although interdependent processing of identity and expression and of identity and sex have been demonstrated previously, evidence for interdependent processing of sex and expression is equivocal. Using a visual adaptation paradigm, we show that expression aftereffects can be simultaneously induced in different directions along anger–fear continua for male and female faces (Experiment 1) and for East Asian and Black African faces (Experiment 2). These findings for sex- and race-contingent expression aftereffects suggest that processing of expression is interdependent with processing of sex and race and are therefore problematic for models of face perception that have emphasized independent processing of functionally different aspects of faces. By contrast, our findings are consistent with models of face processing that propose that invariant physical aspects of faces and changeable social cues can be processed interdependently.     

Face processing in different brain areas,and critical band masking

Neurophysiological evidence is described showing that some neurons in the macaque inferior temporal visual cortex have responses that are invariant with respect to the position, size, view, and spatial frequency of faces and objects, and that these neurons show rapid processing and rapid learning. Critical band spatial frequency masking is shown to be a property of these face‐selective neurons and of the human visual perception of faces. Which face or object is present is encoded using a distributed representation in which each neuron conveys independent information in its firing rate, with little information evident in the relative time of firing of different neurons. This ensemble encoding has the advantages of maximizing the information in the representation useful for discrimination between stimuli using a simple weighted sum of the neuronal firing by the receiving neurons, generalization, and graceful degradation. These invariant representations are ideally suited to provide the inputs to brain regions such as the orbitofrontal cortex and amygdala that learn the reinforcement associations of an individual's face, for then the learning, and the appropriate social and emotional responses generalize to other views of the same face. A theory is described of how such invariant representations may be produced by self‐organizing learning in a hierarchically organized set of visual cortical areas with convergent connectivity. The theory utilizes either temporal or spatial continuity with an associative synaptic modification rule. Another population of neurons in the cortex in the superior temporal sulcus encodes other aspects of faces such as face expression, eye‐gaze, face view, and whether the head is moving. These neurons thus provide important additional inputs to parts of the brain such as the orbitofrontal cortex and amygdala that are involved in social communication and emotional behaviour. Outputs of these systems reach the amygdala, in which face‐selective neurons are found, and also the orbitofrontal cortex, in which some neurons are tuned to face identity and others to face expression. In humans, activation of the orbitofrontal cortex is found when a change of face expression acts as a social signal that behaviour should change; and damage to the human orbitofrontal and pregenual cingulate cortex can impair face and voice expression identification, and also the reversal of emotional behaviour that normally occurs when reinforcers are reversed.     

First impressions from faces in the real world: Commentary on Sutherland and Young (2022)

The study of first impressions from faces now emphasizes the need to understand trait inferences made to naturalistic face images (British Journal of Psychology, 113, 2022, 1056). Face recognition algorithms based on deep convolutional neural networks simultaneously represent invariant, changeable and environmental variables in face images. Therefore, we suggest them as a comprehensive ‘face space’ model of first impressions of naturalistic faces. We also suggest that to understand trait inferences in the real world, a logical next step is to consider trait inferences made to whole people (faces and bodies). On the role of cultural contributions to trait perception, we think it is important for the field to begin to consider the way in which trait inferences motivate (or not) behaviour in independent and interdependent cultures.     

How chromatic phenomenality largely overflow its cognitive accessibility

It has been suggested (Block, 2007) that the core neural bases for visual phenomenal consciousness and for access consciousness are located in anatomically separate regions. If this is correct, and if, as Block suggests, the core neural substrate of visual phenomenality is located early in the visual cortex where detailed chromatic information is available, then it would be reasonable to infer that our intuitions of chromatically rich visual phenomenality are plausible. It is furthermore suggested that during perception cognitive access to this chromatic cornucopia is mediated through mereologically superordinate (MS) concepts that regionally characterize both semantic and quantitative integrated properties within complex visual percepts. Such concepts contain much less information than do the particulars that they characterize, implying that the information represented in phenomenal consciousness greatly exceeds the information in the accompanying access consciousness.     

The role of facial colour and luminance in visual and audiovisual speech perception

We conducted four experiments to investigate the role of colour and luminance information in visual and audiovisual speech perception. In experiments 1a (stimuli presented in quiet conditions) and 1b (stimuli presented in auditory noise), face display types comprised naturalistic colour (NC), grey-scale (GS), and luminance inverted (LI) faces. In experiments 2a (quiet) and 2b (noise), face display types comprised NC, colour inverted (CI), LI, and colour and luminance inverted (CLI) faces. Six syllables and twenty-two words were used to produce auditory and visual speech stimuli. Auditory and visual signals were combined to produce congruent and incongruent audiovisual speech stimuli. Experiments 1a and 1b showed that perception of visual speech, and its influence on identifying the auditory components of congruent and incongruent audiovisual speech, was less for LI than for either NC or GS faces, which produced identical results. Experiments 2a and 2b showed that perception of visual speech, and influences on perception of incongruent auditory speech, was less for LI and CLI faces than for NC and CI faces (which produced identical patterns of performance). Our findings for NC and CI faces suggest that colour is not critical for perception of visual and audiovisual speech. The effect of luminance inversion on performance accuracy was relatively small (5%), which suggests that the luminance information preserved in LI faces is important for the processing of visual and audiovisual speech.     

人类颜色视觉的计算理论

该文有机地结合了计算视觉理论和生态学视觉理论,指出颜色信息处理的根本任务是检测环境中的光不变量。在此基础上,作者提出了颜色视觉的计算理论以及计算理论本身的生物学标准。初级视觉计算是典型的不适定问题,动物的视觉系统则利用视环境中存在的条件将该不适定问题转化为定解问题。本文引入颜色视觉计算的免要条件,客观性约束,以及颜色认知的神经表象,证明了上述约束下颜色算法的存在性。本文给出了构造颜色知觉的基本假设。同时,该文还讨论了与上述问题密切相关的几个基本问题:神经表象的完备性,主观色觉的客观性,明度知觉和颜色知觉的统一,人类主观色觉的实现方式。     

Development of upper visual field bias for faces in infants

The spatial location of the face and body seen in daily life influences human perception and recognition. This contextual effect of spatial locations suggests that daily experience affects how humans visually process the face and body. However, it remains unclear whether this effect is caused by experience, or innate neural pathways. To address this issue, we examined the development of visual field asymmetry for face processing, in which faces in the upper visual field were processed preferentially compared to the lower visual field. We found that a developmental change occurred between 6 and 7 months. Older infants aged 7–8 months showed bias toward faces in the upper visual field, similar to adults, but younger infants of 5–6 months showed no such visual field bias. Furthermore, older infants preferentially memorized faces in the upper visual field, rather than in the lower visual field. These results suggest that visual field asymmetry is acquired through development, and might be caused by the learning of spatial location in daily experience.     

Visual adaptation of the perception of “life”: Animacy is a basic perceptual dimension of faces

One critical component of understanding another’s mind is the perception of “life” in a face. However, little is known about the cognitive and neural mechanisms underlying this perception of animacy. Here, using a visual adaptation paradigm, we ask whether face animacy is (1) a basic dimension of face perception and (2) supported by a common neural mechanism across distinct face categories defined by age and species. Observers rated the perceived animacy of adult human faces before and after adaptation to (1) adult faces, (2) child faces, and (3) dog faces. When testing the perception of animacy in human faces, we found significant adaptation to both adult and child faces, but not dog faces. We did, however, find significant adaptation when morphed dog images and dog adaptors were used. Thus, animacy perception in faces appears to be a basic dimension of face perception that is species specific but not constrained by age categories.     

Holistic processing underlies gender judgments of faces

In three experiments, we investigated whether holistic processing underlies gender judgments about faces. Chinese participants were asked to make gender judgments for inverted, scrambled, or composite faces. Results showed that judgments were dramatically impaired by these manipulations (as compared with performance for normal upright faces), demonstrating three hallmark effects of holistic face processing that have been observed in perception of face identity. Whether the test faces were Chinese or Caucasian showed no effect on holistic processing of gender perception, in contrast to studies of identity analysis. These results suggest that holistic processing is a general mechanism for different aspects of face perception and are consistent with the idea that physiognomic properties that determine the gender of a face are universal, rather than race specific.     

Functional connectivity during working memory maintenance

Neurophysiological experiments with monkeys have demonstrated that working memory (WM) is associated with persistent neural activity in multiple brain regions, such as the prefrontal cortex (PFC), the parietal cortex, and posterior unimodal association areas. WM maintenance is believed to require the coordination of these brain regions, which do not function in isolation but, rather, interact to maintain visual percepts that are no longer present in the environment. However, single-unit physiology studies and traditional univariate analyses of functional brain imaging data cannot evaluate interactions between distant brain regions, and so evidence of regional integration during WM maintenance is largely indirect. In this study, we utilized a recently developed multivariate analysis method that allows us to explore functional connectivity between brain regions during the distinct stages of a delayed face recognition task. To characterize the neural network mediating the on-line maintenance of faces, the fusiform face area (FFA) was defined as a seed and was then used to generate whole-brain correlation maps. A random effects analysis of the correlation data revealed a network of brain regions exhibiting significant correlations with the FFA seed during the WM delay period. This maintenance network included the dorsolateral and ventrolateral PFC, the premotor cortex, the intraparietal sulcus, the caudate nucleus, the thalamus, the hippocampus, and occipitotemporal regions. These findings support the notion that the coordinated functional interaction between nodes of a widely distributed network underlies the active maintenance of a perceptual representation.     

Visual and audiovisual speech perception with color and gray-scale facial images

Research has shown that auditory speech recognition is influenced by the appearance of a talker's face, but the actual nature of this visual information has yet to be established. Here, we report three experiments that investigated visual and audiovisual speech recognition using color, gray-scale, and point-light talking faces (which allowed comparison with the influence of isolated kinematic information). Auditory and visual forms of the syllables /ba/, /bi/, /ga/, /gi/, /va/, and /vi/ were used to produce auditory, visual, congruent, and incongruent audiovisual speech stimuli. Visual speech identification and visual influences on identifying the auditory components of congruent and incongruent audiovisual speech were identical for color and gray-scale faces and were much greater than for point-light faces. These results indicate that luminance, rather than color, underlies visual and audiovisual speech perception and that this information is more than the kinematic information provided by point-light faces. Implications for processing visual and audiovisual speech are discussed.     

Visual perception and visual mental imagery of emotional faces generate similar expression aftereffects

What is the relationship between visual perception and visual mental imagery of emotional faces? We investigated this question using a within-emotion perceptual adaptation paradigm in which adaptation to a strong version of an expression was paired with a test face displaying a weak version of the same emotion category. We predicted that within-emotion adaptation to perception and imagery of expressions would generate similar aftereffects, biasing perception of weak emotional test faces toward a more neutral value. Our findings confirmed this prediction. Adaptation to mental images yielded aftereffects that inhibited emotion recognition of test expressions, as participants were less accurate at recognising these stimuli compared to baseline. While the same inhibitory effect was observed when expressions were visually perceived, the size of the aftereffects was greater for perception than imagery. These findings suggest the existence of expression-selective neural mechanisms that subserve both visual perception and visual mental imagery of emotional faces.     

Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making

Research on the neural basis that underlies decision making in humans has revealed that these processes are mediated by distributed neural networks that incorporate different regions of the frontal lobes, the amygdala, the ventral striatum, and the dopamine system. In the present article, we review recent studies in rodents investigating the contribution of these systems to different forms of cost-benefit decision making and focus on evaluations related to delays, effort, or risks associated with certain rewards. Anatomically distinct regions of the medial and orbital prefrontal cortex make dissociable contributions to different forms of decision making, although lesions of these regions can induce variable effects, depending on the type of tasks used to assess these functions. The basolateral amygdala and the nucleus accumbens play a more fundamental role in these evaluations, helping an organism overcome different costs to obtain better rewards. Dopamine activity biases behavior toward more costly yet larger rewards, although abnormal increases in dopamine transmission can exert opposing actions on different types of decision making. The fact that similar neural circuits are recruited to solve these types of problems in both humans and animals suggests that animal models of decision making will prove useful in elucidating the mechanisms mediating these processes.     

Competition-induced visual field differences in search

Do visual field effects point to differences in cortical representation, or do they reflect differences in the way these representations are used by other brain regions? This study explored three attributes of visual search that provide strong evidence in favor of differences in use. Competition refers to the finding that visual field differences in search efficiency are larger in whole- than in half-field displays (both left-right and upper-lower half-fields). Task specialization refers to the finding that some tasks favor one hemisphere whereas other tasks favor the other hemisphere, even though the same stimulus displays are used in both tasks. Anatomical alignment refers to the finding that competition effects are altered if the quadrants of the visual display are not aligned with the cortical quadrants of the observer. We propose that visual field specialization in search is the result of a competition involving limited access to cortical visual representations by the extended neural networks of attention.     

面部表情识别与面孔身份识别的独立加工与交互作用机制

面孔识别功能模型认为,面部表情识别与面孔身份识别是两条独立的并行路径。以往诸多研究者都认可并遵循二者分离的原则。但近期研究表明,面部表情识别与面孔身份识别存在交互作用。首先总结和分析已有的面部表情识别的研究成果,评述神经心理学与认知神经科学研究中的论争,然后介绍人脸知觉的分布式神经机制以及相关的实验证据,最后提出面部表情识别与面孔身份识别的多级整合模型,并展望研究前景。