Categorizing facial identities, emotions, and genders: attention to high- and low-spatial frequencies by children and adults

Three age groups of participants (5-6 years, 7-8 years, adults) matched faces on the basis of facial identity. The procedure involved either low- or high-pass filtered faces or hybrid faces composed from two faces associated with different spatial bandwidths. The comparison stimuli were unfiltered faces. In the three age groups, the data indicated a significant bias for processing of low-pass information in priority. In a second task, participants were asked to identify the emotion (smiling or grimacing) or gender (male or female) of hybrid high-pass/low-pass faces. Opposite results emerged in the two tasks irrespective of the age group; the gender discrimination task indicated a bias for low-pass information, and the emotion task indicated a bias for high-pass information. These differences suggest independent processing routes for functionally different types of information such as emotion, gender, and identity. These routes are already established by 5 years of age.     

Faces are "spatial"--holistic face perception is supported by low spatial frequencies

Faces are perceived holistically, a phenomenon best illustrated when the processing of a face feature is affected by the other features. Here, the authors tested the hypothesis that the holistic perception of a face mainly relies on its low spatial frequencies. Holistic face perception was tested in two classical paradigms: the whole-part advantage (Experiment 1) and the composite face effect (Experiments 2-4). Holistic effects were equally large or larger for low-pass filtered faces as compared to full-spectrum faces and significantly larger than for high-pass filtered faces. The disproportionate composite effect found for low-pass filtered faces was not observed when holistic perception was disrupted by inversion (Experiment 3). Experiment 4 showed that the composite face effect was enhanced only for low spatial frequencies, but not for intermediate spatial frequencies known be critical for face recognition. These findings indicate that holistic face perception is largely supported by low spatial frequencies. They also suggest that holistic processing precedes the analysis of local features during face perception.     

The effect of spatial frequency content on parameters of eye movements

Two experiments were conducted to examine the influence of the spatial frequency content of natural images on saccadic size and fixation duration. In the first experiment 10 pictures of natural textures were low-pass filtered (0.04-0.76 cycles/deg) and high-pass filtered (1.91-19.56 cycles/deg) and presented with the unfiltered originals in random order, each for 10 s, to 18 participants, with the instruction to inspect them in order to find a suitable name. The participants' eye movements were recorded. It was found that low-pass filtered images resulted in larger saccadic amplitudes compared with high-pass filtered images. A second experiment was conducted with natural stimuli selected for different power spectra which supported the results outlined above. In general, low-spatial frequencies elicit larger saccades associated with shorter fixation durations whereas high-spatial frequencies elicit smaller saccades with longer fixation durations.     

The role of low-spatial frequencies in lexical decision and masked priming

Spatial frequency filtering was used to test the hypotheses that low-spatial frequency information in printed text can: (1) lead to a rapid lexical decision or (2) facilitate word recognition. Adult proficient readers made lexical decisions in unprimed and masked repetition priming experiments with unfiltered, low-pass, high-pass and notch filtered letter strings. In the unprimed experiments, a filtered target was presented for 105 or 400 ms followed by a pattern mask. Sensitivity (d′) was lowest for the low-pass filtered targets at both durations with a bias towards a ‘non-word’ response. Sensitivity was higher in the high-pass and notch filter conditions. In the priming experiments, a forward mask was followed by a filtered prime then an unfiltered target. Primed words, but not non-words, were identified faster than unprimed words in both the low-pass and high-pass filtered conditions. These results do not support a unique role for low-spatial frequency information in either facilitating or making rapid lexical decisions.     

Spatial frequency requirements for audiovisual speech perception

Spatial frequency band-pass and low-pass filtered images of a talker were used in an audiovisual speech-in-noise task. Three experiments tested subjects' use of information contained in the different filter bands with center frequencies ranging from 2.7 to 44.1 cycles/face (c/face). Experiment 1 demonstrated that information from a broad range of spatial frequencies enhanced auditory intelligibility. The frequency bands differed in the degree of enhancement, with a peak being observed in a mid-range band (11-c/face center frequency). Experiment 2 showed that this pattern was not influenced by viewing distance and, thus, that the results are best interpreted in object spatial frequency, rather than in retinal coordinates. Experiment 3 showed that low-pass filtered images could produce a performance equivalent to that produced by unfiltered images. These experiments are consistent with the hypothesis that high spatial resolution information is not necessary for audiovisual speech perception and that a limited range of spatial frequency spectrum is sufficient.     

The role of high spatial frequencies in face perception

The relevance of low and high spatial-frequency information for the recognition of photographs of faces has been investigated by testing recognition of faces that have been either low-pass (LP) or high-pass (HP) filtered in the spatial-frequency domain. The highest resolvable spatial frequency was set at 15 cycles per face width (cycles fw-1). Recognition was much less accurate for images that contained only the low spatial frequencies (up to 5 cycles fw-1) than for images that contained only spatial frequencies higher than 5 cycles fw-1. For faces HP filtered above 8 cycles fw-1, recognition was almost as accurate as for faces LP filtered below 8 cycles fw-1, although the energy content of the latter greatly exceeded that of the former. These findings show that information conveyed by the higher spatial frequencies is not redundant. Rather, it is sufficient by itself to ensure recognition.     

The effects of spatial frequency overlap on face recognition

The effects of spatial frequency overlap between pairs of low-pass versus high-pass images on face recognition and matching were examined in 6 experiments. Overlap was defined as the range of spatial frequencies shared by a pair of filtered images. This factor was manipulated by processing image pairs with high-pass/low-pass filter pairs whose 50% cutoff points varied in their separation from one another. The effects of the center frequency of filter pairs were also investigated. In general, performance improved with greater overlap and higher center frequency. In control conditions, the image pairs were processed with identical filters and thus had complete overlap. Even severely filtered low-pass or high-pass images in these conditions produced superior performance. These results suggest that face recognition is more strongly affected by spatial frequency overlap than by the frequency content of the images.     

Attention to low- and high-spatial frequencies in categorizing facial identities, emotions and gender in children with autism

This study was aimed at investigating face categorization strategies in children with autistic spectrum disorders (ASD). Performance of 17 children with ASD was compared to that of 17 control children in a face-matching task, including hybrid faces (composed of two overlapping faces of different spatial bandwidths) and either low- or high-pass filtered faces. Participants were asked to match faces on the basis of identity, emotion or gender. Results revealed that children with ASD used the same strategies as controls when matching faces by gender. By contrast, in the identity and the emotion conditions, children with ASD showed a high-pass bias (i.e., preference for local information), contrary to controls. Consistent with previous studies on autism, these findings suggest that children with ASD do use atypical (local-oriented) strategies to process faces.     

Influence of task and input factors on hemispheric involvement in face processing

Two experiments examined the respective role of the cerebral hemispheres in face perception and the nature of their contribution depending on task demands and on the spatial-frequency composition of the stimuli. Sixteen faces of members of the subjects' department were presented as stimuli, with men and women, and professors and nonprofessors being equally represented. In Experiment 1, high-resolution black-and-white photographs of faces were used in three reaction-time tasks: verbal identification, manual membership categorization, and manual male/female categorization, in a within-subject design. Identification and membership categorization were significantly better performed in right-visual-field presentations, whereas the male/female categorization yielded a nonsignificant left-visual-field superiority. In Experiment 2, two versions of the same faces were used: digitized low-pass (0 to 2 cycles/degree of visual angle) and digitized broad-pass (0 to 32 cycles/degree) faces. Broad-pass faces produced the same laterality pattern as in Experiment 1, while low-pass faces were better processed in left-visual-field presentations for all three tasks. The results suggest that the two hemispheres play a role in face perception, and their contribution may vary as a function of the task demands and of the spatial-frequency components of the incoming information.     

Mr. Grimace or Ms. Smile: does categorization affect perceptual processing in autism?

This study compared the influence of categorization on perceptual processing in adults with autistic spectrum disorders (ASD) and normal control participants. Participants were asked to categorize hybrid faces (composed of two overlapped faces of different spatial bandwidths) by gender and emotion. Control participants exhibited a bias for low-pass information during gender categorization and a bias for high-pass information during emotion categorization. By contrast, adults with ASD showed the same low-pass bias in both tasks. This absence of a shift in processing style in the ASD group is discussed in terms of diminished top-down modulation in autism.     

The role of spatial frequency in emotional face classification

Previous studies with emotional face stimuli have revealed that our ability to identify different emotional states is dependent on the faces’ spatial frequency content. However, these studies typically only tested a limited number of emotional states. In the present study, we measured the consistency with which 24 different emotional states are classified when the faces are unfiltered, high-, or low-pass filtered, using a novel rating method that simultaneously measures perceived arousal (high to low) and valence (pleasant to unpleasant). The data reveal that consistent ratings are made for every emotional state independent of spatial frequency content. We conclude that emotional faces possess both high- and low-frequency information that can be relied on to facilitate classification.     

Multiple perceptual strategies used by macaque monkeys for face recognition

Successful integration of individuals in macaque societies suggests that monkeys use fast and efficient perceptual mechanisms to discriminate between conspecifics. Humans and great apes use primarily holistic and configural, but also feature-based, processing for face recognition. The relative contribution of these processes to face recognition in monkeys is not known. We measured face recognition in three monkeys performing a visual paired comparison task. Monkey and humans faces were (1) axially rotated, (2) inverted, (3) high-pass filtered, and (4) low-pass filtered to isolate different face processing strategies. The amount of time spent looking at the eyes, mouth, and other facial features was compared across monkey and human faces for each type of stimulus manipulation. For all monkeys, face recognition, expressed as novelty preference, was intact for monkey faces that were axially rotated or spatially filtered and was supported in general by preferential looking at the eyes, but was impaired for inverted faces in two of the three monkeys. Axially rotated, upright human faces with a full range of spatial frequencies were also recognized, however, the distribution of time spent exploring each facial feature was significantly different compared to monkey faces. No novelty preference, and hence no inferred recognition, was observed for inverted or low-pass filtered human faces. High-pass filtered human faces were recognized, however, the looking pattern on facial features deviated from the pattern observed for monkey faces. Taken together these results indicate large differences in recognition success and in perceptual strategies used by monkeys to recognize humans versus conspecifics. Monkeys use both second-order configural and feature-based processing to recognize the faces of conspecifics, but they use primarily feature-based strategies to recognize human faces.     

Dr. Angry and Mr. Smile: when categorization flexibly modifies the perception of faces in rapid visual presentations

Are categorization and visual processing independent, with categorization operating late, on an already perceived input, or are they intertwined, with the act of categorization flexibly changing (i.e. cognitively penetrating) the early perception of the stimulus? We examined this issue in three experiments by applying different categorization tasks (gender, expressive or not, which expression and identity) to identical face stimuli. Stimuli were hybrids: they combined a man or a woman with a particular expression at a coarse spatial scale with a face of the opposite gender with a different expression at the fine spatial scale. Results suggested that the categorization task changes the spatial scales preferentially used and perceived for rapid recognition. A perceptual set effect is shown whereby the scale preference of an important categorization (e.g. identity) transfers to resolve other face categorizations (e.g. expressive or not, which expression). Together, the results suggest that categorization can be closely bound to perception.     

Effects of high-pass and low-pass spatial filtering on face identification

If face images are degraded by block averaging, there is a nonlinear decline in recognition accuracy as block size increases, suggesting that identification requires a critical minimum range of object spatial frequencies. The identification of faces was measured with equivalent Fourier low-pass filtering and block averaging preserving the same information and with high-pass transformations. In Experiment 1, accuracy declined and response time increased in a significant nonlinear manner in all cases as the spatial-frequency range was reduced. However, it did so at a faster rate for the quantized and high-passed images. A second experiment controlled for the differences in the contrast of the high-pass faces and found a reduced but significant and nonlinear decline in performance as the spatial-frequency range was reduced. These data suggest that face identification is preferentially supported by a band of spatial frequencies of approximately 8-16 cycles per face; contrast or line-based explanations were found to be inadequate. The data are discussed in terms of current models of face identification.     

Spatial frequency filtering and the direct control of fixation durations during scene viewing

The present study employed a saccade-contingent change paradigm to investigate the effect of spatial frequency filtering on fixation durations during scene viewing. Subjects viewed grayscale scenes while encoding them for a later memory test. During randomly chosen saccades, the scene was replaced with an alternate version that remained throughout the critical fixation that followed. In Experiment 1, during the critical fixation, the scene could be changed to high-pass and low-pass spatial frequency filtered versions. Under both conditions, fixation durations increased, and the low-pass condition produced a greater effect than the high-pass condition. In subsequent experiments, we manipulated the familiarity of scene information during the critical fixation by flipping the filtered scenes upside down or horizontally. Under these conditions, we observed lengthening of fixation durations but no difference between the high-pass and low-pass conditions, suggesting that the filtering effect is related to the mismatch between information extracted within the critical fixation and the ongoing scene representation in memory. We also conducted control experiments that tested the effect of changes to scene orientation (Experiment 2a) and the addition of color to a grayscale scene (Experiment 2b). Fixation distribution analysis suggested two effects on the distribution fixation durations: a fast-acting effect that was sensitive to all transsaccadic changes tested and a later effect in the tail of the distribution that was likely tied to the processing of scene information. These findings are discussed in the context of theories of oculomotor control during scene viewing.     

Low spatial frequencies dominate apparent motion

Experiments are reported which have been designed to establish what features of a pair of figures can be used as an input for apparent motion. The display consisted of a central figure, A, which appeared briefly and was followed immediately afterwards by two figures, B and C, which appeared on either side of the original location of A. Figure A can thus move towards either B or C. When A was a low-pass filtered square it moved towards C (a low-pass filtered square that was similar to A but 'rotated' by 45 degrees) rather than toward B (a high-pass filtered square identical to A in orientation and size). When A was an unfiltered square it moved towards C (a low-pass filtered square of identical orientation) rather than towards B (a high-pass filtered square of identical orientation). Lastly, when A was a 'solid' square it moved towards C (a solid circle) rather than towards B (an outline square). All three experiments suggest that the direction of perceived movement is determined exclusively by low spatial frequencies rather than by similarity of oriented edges, especially when speed of alternation is rapid.     

Effects on Face Recognition of Spatial-Frequency Information Contained in Inspection and Test Stimuli

Researchers often assume a critical band of spatial frequencies is required for face recognition. Also, many studies have not measured the contrast required for recognition. On Day 1, observers viewed high-pass-filtered (HP), low-pass-filtered (LP), or unfiltered (UF) faces. On Day 2, they viewed a variety of faces, some of which were LP filtered, HP filtered, and UF. Observers adjusted contrast until they achieved both detection and recognition. Observers were most accurate and sensitive when filtered faces agreed in spatial-frequency content across days. Faces differing in spatial-frequency content were least well recognized. Unfiltered faces always fell between the 2 extremes. Observers generally used less contrast to recognize unfiltered than filtered faces. Correspondence of information between inspection and testing seemed more important than any particular range of frequencies.     

Effects on face recognition of spatial-frequency information contained in inspection and test stimuli

Researchers often assume a critical band of spatial frequencies is required for face recognition. Also, many studies have not measured the contrast required for recognition. On Day 1, observers viewed high-pass-filtered (HP), low-pass-filtered (LP), or unfiltered (UF) faces. On Day 2, they viewed a variety of faces, some of which were LP filtered, HP filtered, and UF. Observers adjusted contrast until they achieved both detection and recognition. Observers were most accurate and sensitive when filtered faces agreed in spatial-frequency content across days. Faces differing in spatial-frequency content were least well recognized. Unfiltered faces always fell between the 2 extremes. Observers generally used less contrast to recognize unfiltered than filtered faces. Correspondence of information between inspection and testing seemed more important than any particular range of frequencies.     

ERP evidence for task modulations on face perceptual processing at different spatial scales

Does the perceptual processing of faces flexibly adapt to the requirements of the categorization task at hand, or does it operate independently of this cognitive context? Behavioral studies have shown that the fine and coarse spatial scales of a face are differentially processed depending on the categorization task performed, thus suggesting that the latter can influence stimulus perception. Here, we investigated the time course of these task influences on perceptual processing by examining the visual N170 face‐sensitive Event‐Related Potential (ERP), while observers categorized faces for their gender and familiarity. Stimuli were full spectrum, or filtered versions that preserved either coarse or fine scale information of the faces. Behavioral results replicated previous findings of a differential processing of coarse and fine spatial scales across tasks. In addition, the N170 amplitude was larger in the Gender task as compared to the Familiarity task for LSF faces exclusively, thus showing that task demands differentially modulated the spatial scale processing on faces. These results suggest that the diagnosticity of scale‐specific cues in categorization tasks can modulate face processing.     

Conscious and unconscious processing of facial expressions: Evidence from two split‐brain patients

We investigated how the brain's hemispheres process explicit and implicit facial expressions in two ‘split‐brain’ patients (one with a complete and one with a partial anterior resection). Photographs of faces expressing positive, negative or neutral emotions were shown either centrally or bilaterally. The task consisted in judging the friendliness of each person in the photographs. Half of the photograph stimuli were ‘hybrid faces’, that is an amalgamation of filtered images which contained emotional information only in the low range of spatial frequency, blended to a neutral expression of the same individual in the rest of the spatial frequencies. The other half of the images contained unfiltered faces. With the hybrid faces the patients and a matched control group were more influenced in their social judgements by the emotional expression of the face shown in the left visual field (LVF). When the expressions were shown explicitly, that is without filtering, the control group and the partially callosotomized patient based their judgement on the face shown in the LVF, whereas the complete split‐brain patient based his ratings mainly on the face presented in the right visual field. We conclude that the processing of implicit emotions does not require the integrity of callosal fibres and can take place within subcortical routes lateralized in the right hemisphere.