Evidence for distinct contributions of form and motion information to the recognition of emotions from body gestures

The importance of kinematics in emotion perception from body movement has been widely demonstrated. Evidence also suggests that the perception of biological motion relies to some extent on information about spatial and spatiotemporal form, yet the contribution of such form-related cues to emotion perception remains unclear. This study reports, for the first time, the relative effects on emotion recognition of inverting and motion-reversing patch-light compared to fully illuminated displays of whole-body emotion gestures. Inverting the gesture movies or playing them backwards significantly impaired emotion classification accuracy, but did so more for patch-light displays than for identical but fully illuminated movement sequences. This result suggests that inversion impairs the processing of form information related to the configuration of body parts, and reversal impairs the sequencing of form changes, more than these manipulations impair the processing of kinematic cues. This effect was strongest for inversion, suggesting an important role for configural information in emotion recognition. Nevertheless, even in combination these stimulus manipulations did not abolish above chance recognition of any of the emotions, suggesting that kinematics help distinguish emotions expressed by body gestures. Disproportionate impairments in recognition accuracy were observed for fear and disgust under inversion, and for fear under motion reversal, suggesting a greater role for form-related cues in the perception of these emotions.     

Repetition priming and the haptic recognition of familiar and unfamiliar objects

In four experiments, we examined the haptic recognition of 3-D objects. In Experiment 1, blindfolded participants named everyday objects presented haptically in two blocks. There was significant priming of naming, but no cost of an object changing orientation between blocks. However, typical orientations of objects were recognized more quickly than nonstandard orientations. In Experiment 2, participants accurately performed an unannounced test of memory for orientation. The lack of orientation-specific priming in Experiment 1, therefore, was not because participants could not remember the orientation at which they had first felt an object. In Experiment 3, we examined haptic naming of objects that were primed either haptically or visually. Haptic priming was greater than visual priming, although significant cross-modal priming was also observed. In Experiment 4, we tested recognition memory for familiar and unfamiliar objects using an old-new recognition task. Objects were recognized best when they were presented in the same orientation in both blocks, suggesting that haptic object recognition is orientation sensitive. Photographs of the unfamiliar objects may be downloaded from www.psychonomic.org/archive.     

The role of rigid motion in newborns' face recognition

The study investigated whether dynamic information promotes newborns' ability to recognize a face. After being habituated to a face undergoing an ordered sequential head rigid motion (Exp. 1), 1- to 3-day-old newborns fully recognized the familiar face shown in the profile pose, as documented by a preference for the profile pose of a novel face. When familiarized to an ordered sequence of different viewpoint static images of a face (Exp. 2), newborns failed to recognize the profile pose of the familiar face, their visual exploration of the familiar and novel faces being at chance. Habituation to a random head rigid motion (Exp. 3) allowed only a partial recognition of face identity, as newborns preferred the profile pose of the familiar, rather than the novel, face. Rigid head motion is an important source of information for newborns' face recognition, probably aiding the derivation of a three-dimensional face structure.     

Infant perception of causal motion produced by humans and inanimate objects

Both the movements of people and inanimate objects are intimately bound up with physical causality. Furthermore, in contrast to object movements, causal relationships between limb movements controlled by humans and their body displacements uniquely reflect agency and goal-directed actions in support of social causality. To investigate the development of sensitivity to causal movements, we examined the looking behavior of infants between 9 and 18 months of age when viewing movements of humans and objects. We also investigated whether individual differences in gender and gross motor functions may impact the development of the visual preferences for causal movements. In Experiment 1, infants were presented with walking stimuli showing either normal body translation or a “moonwalk” that reversed the horizontal motion of body translations. In Experiment 2, infants were presented with unperformable actions beyond infants’ gross motor functions (i.e., long jump) either with or without ecologically valid body displacement. In Experiment 3, infants were presented with rolling movements of inanimate objects that either complied with or violated physical causality. We found that female infants showed longer looking times to normal walking stimuli than to moonwalk stimuli, but did not differ in their looking time to movements of inanimate objects and unperformable actions. In contrast, male infants did not show sensitivity to causal movement for either category. Additionally, female infants looked longer at social stimuli of human actions than male infants. Under the tested circumstances, our findings indicate that female infants have developed a sensitivity to causal consistency between limb movements and body translations of biological motion, only for actions with previous visual and motor exposures, and demonstrate a preference toward social information.     

The relationship between apparent motion and object files

Object files (OFs) play an important role in theories of mid-level vision. On some influential views, OFs operate and persist only via spatiotemporal continuity. One open question concerns what occurs when direct spatiotemporal continuity is absent: Do OFs move in accordance with any motion correspondence ultimately resolved? Specifically, do OFs accord with apparent motion (AM) correspondences, which arise despite a lack of continuous spatiotemporal stimulation? In Experiment 1, subjects were presented with an AM display consisting of two circles that, across two frames, were seen as moving between two noncontiguous locations. The two objects were primed with two symbols and were then moved in a single step; a third symbol appeared, and could either match the symbol from the closer or the further object. We found a robust object specific preview benefit (OSPB) for the shorter path, in other words, the path along which AM was perceived. In order to control for the possibility that priming occurs at any nearby object, in Experiment 2, the original two objects never disappeared, but two new objects appeared in the would-be AM locations. No AM was perceived, and no OSPB obtained. In the third experiment the OSPB effect persisted even when motion along the shorter path included an unlikely featural transformation (circles turning into squares). In Experiment 4, which was nearly identical to Experiment 2, no OSPB obtained despite unique featural matches between the initial and new objects, seemingly because no AM was perceived. In Experiment 5, we failed to find an effect of featural priming, even when distance between the objects was equated. Finally, we extended the OSPB effect to two additional kinds of AM—line motion (Experiment 6) and phi motion (Experiment 7), supplying strong evidence that AM correspondences and OF correspondences are controlled by the same basic rules.     

The effect of inversion on 3- to 5-year-olds’ recognition of face and nonface visual objects

This study compared the effect of stimulus inversion on 3- to 5-year-olds’ recognition of faces and two nonface object categories matched with faces for a number of attributes: shoes (Experiment 1) and frontal images of cars (Experiments 2 and 3). The inversion effect was present for faces but not shoes at 3 years of age (Experiment 1). Analogous results were found for boys when faces were compared with frontal images of cars. For girls, stimulus inversion impaired recognition of both faces and cars at 3 to 4 years of age, becoming specific to faces only at 5 years of age (Experiments 2 and 3). Evidence demonstrates that the ability to extract the critical cues that lead to adults’ efficient face recognition is selectively tuned to faces during preschool years.     

自然场景与身体动作对面孔表情识别的影响

本研究以消极情绪间感知相似性较低的厌恶、恐惧面孔表情为材料,提供5个情绪性语言标签减少文字背景对面孔识别的促进作用,通过2个实验对自然场景以及身体动作对面孔表情识别的影响进行了研究,旨在考察面孔表情与自然场景间的情绪一致性对情绪面孔识别和自然场景加工的影响,以及加入与自然场景情绪相冲突的身体动作对面孔表情识别可能产生的影响。研究结果表明:(1)尽管增加了情绪性语言标签选项数量,自然场景的情绪对面孔表情识别的影响依旧显著;(2)当面孔表情与自然场景情绪不一致时,面孔识别需要更多依赖对自然场景的加工,因此对自然场景的加工程度更高;(3)身体动作会在一定程度上干扰自然场景对面孔表情识别的影响,但自然场景依然对情绪面孔的表情识别有重要作用。     

Lateralized effects of categorical and coordinate spatial processing of component parts on the recognition of 3D non-nameable objects

Participants performed two object-matching tasks for novel, non-nameable objects consisting of geons. For each original stimulus, two transformations were applied to create comparison stimuli. In the categorical transformation, a geon connected to geon A was moved to geon B. In the coordinate transformation, a geon connected to geon A was moved to a different position on geon A. The Categorical task consisted of the original and the categorically transformed objects. The Coordinate task consisted of the original and the coordinately transformed objects. The original object was presented to the central visual field, followed by a comparison object presented to the right or left visual half-fields (RVF and LVF). The results showed an RVF advantage for the Categorical task and an LVF advantage for the Coordinate task. The possibility that categorical and coordinate spatial processing subsystems would be basic computational elements for between- and within-category object recognition was discussed.     

The influence of perceived rotary motion on the recognition of rotated objects

Subjects either named rotated objects or decided whether the objects would face left or right if they were upright. Response time in the left-right task was influenced by a rotation aftereffect or by the physical rotation of the object, which is consistent with the view that the objects were mentally rotated to the upright and that, depending on its direction, the perceived rotary motion of the object either speeded or slowed mental rotation. Perceived rotary motion did not influence naming time, which suggests that the identification of rotated objects does not involve mental rotation.     

The role of surface-based representations of shape in visual object recognition

This study contrasted the role of surfaces and volumetric shape primitives in three-dimensional object recognition. Observers (N?=?50) matched subsets of closed contour fragments, surfaces, or volumetric parts to whole novel objects during a whole–part matching task. Three factors were further manipulated: part viewpoint (either same or different between component parts and whole objects), surface occlusion (comparison parts contained either visible surfaces only, or a surface that was fully or partially occluded in the whole object), and target–distractor similarity. Similarity was varied in terms of systematic variation in nonaccidental (NAP) or metric (MP) properties of individual parts. Analysis of sensitivity (d′) showed a whole–part matching advantage for surface-based parts and volumes over closed contour fragments—but no benefit for volumetric parts over surfaces. We also found a performance cost in matching volumetric parts to wholes when the volumes showed surfaces that were occluded in the whole object. The same pattern was found for both same and different viewpoints, and regardless of target–distractor similarity. These findings challenge models in which recognition is mediated by volumetric part-based shape representations. Instead, we argue that the results are consistent with a surface-based model of high-level shape representation for recognition.     

The neural regions sustaining episodic encoding and recognition of objects

In this functional MRI experiment, encoding of objects was associated with activation in left ventrolateral prefrontal/insular and right dorsolateral prefrontal and fusiform regions as well as in the left putamen. By contrast, correct recognition of previously learned objects (R judgments) produced activation in left superior frontal, bilateral inferior frontal, and right cerebellar regions, whereas correct rejection of distractor objects (N judgments) was associated with activation in bilateral prefrontal and anterior cingulate cortices, in right parietal and cerebellar regions, in the left putamen, and in the right caudate nucleus. The R minus N comparison showed activation in the left lateral prefrontal cortex and in bilateral cingulate cortices and precunei, while the N minus R comparison did not reveal any positive signal change. These results support the view that similar regions of the frontal lobe are involved in episodic encoding and retrieval processes, and that the successful episodic retrieval of newly learned objects is mainly based on a frontoparietal network.     

The effect of changes in posture and clothing on the development of unfamiliar person recognition

In contrast to face recognition little is known about the development of unfamiliar whole‐person recognition. Various cues in a person's appearance may contribute to recognition performance. An age‐related influence of different features on person recognition performance is possible. Here, we investigated two variable features of person recognition, namely posture and clothing, in 4‐year‐olds, 6‐year‐olds, 8‐year‐olds, 10‐year‐olds and adults. The experimental methodology of a short‐term recognition‐test with an immediate four alternative forced choice (4AFC)‐array was used. Targets were shown for 5 seconds. Experiment 1 clearly indicates that a variation of both posture and clothing decreases performance in all age groups compared to a standard, i.e. a no‐change condition. An interaction age×variation of posture and clothing was not observed. In order to untangle the two aspects of posture and clothing, Experiment 2 varied only posture between encoding and recognition. An age‐effect was shown, but no other significant result occurred. Experiment 3 investigated variation of clothing only, and found main effects of clothing and age. Because there was no interaction between the two factors we infer that a change of clothing impairs all subjects' recognition performance. Children's person recognition performance suffers in a way similar to adults' person recognition performance when clothing is varied. In contrast, changing posture does not necessarily decrease recognition accuracy, neither in children nor in adults. No developmental gains were found for dealing with the transformation of posture and clothing between the encoding and recognition phase. Copyright © 2003 John Wiley & Sons, Ltd.     

Novel object detection and recognition system based on points of interest selection and SVM classification

Due to the progression in computer vision technology, object recognition systems have gained considerable research interest. Though there are numerous object recognition systems in the literature, there is always a constant demand for better object recognition systems. Taking this as a challenge, this work proposes a novel object recognition system based on points of interest and feature extraction. Initially, the points of interest of the image are selected by means of Derivative Kadir-Brady (DKB) detector and the neighbourhood pixels of a particular window size are selected for further processing. The gabor and curvelet features are extracted from the area of interest, followed by the Support Vector Machine (SVM) classification. The performance of the proposed object recognition system is evaluated against three analogous techniques in terms of accuracy, precision, recall and F-measure. On experimental analysis, it is proven that the proposed approach outperforms the existing approaches and the performance of the proposed work is satisfactory.     

The effects of precedence on Navon-induced processing bias in face recognition

Macrae and Lewis (2002) Macrae, C. N. and Lewis, H. L. 2002. Do I know you? Processing orientation and face recognition. Psychological Science, 13: 194–196. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] showed that repeated reporting of the global dimension of Navon stimuli improved performance in a subsequent face identification task, whilst reporting the features of the Navon stimuli impaired performance. Using a face composite task, which is assumed to require featural processing, Weston and Perfect (2005) Weston, N. J. and Perfect, T. J. 2005. The effects of processing bias on the composite effect. /precode>. Psychonomic Bulletin and Review, 12: 1038–1042. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] showed the complementary pattern: Featural responding to Navon letters speeded performance. However, both studies used Navon stimuli with global precedence, in which the overall configuration is easier to report than the features. Here we replicate the two studies above, whilst manipulating the precedence (global or featural) of the letter stimuli in the orientation task. Both studies replicated the previously reported findings with global precedence stimuli, but showed the reverse pattern with local precedence stimuli. These data raise important questions as to what is transferred between the Navon orientation task and the face-processing tasks that follow.     

肢体识别的倒置效应

肢体识别加工的研究常常以倒置肢体作为对象.肢体倒置效应是指, 与正立肢体相比, 人们识别倒置肢体的时间更长,正确率更低.该现象为探究肢体识别提供了新的思路.近些年, 研究者们使用多种技术考察了这一效应及肢体构形加工的特异机制与神经基础.其中, 头部信息在肢体倒置效应中的作用引起了一些研究者的争论.此外, 构形加工理论和构形加工连续量理论都肯定了构形加工在该效应产生中的作用, 但对于构形加工所包含的子成分还存在一些分歧.未来需要进一步拓展该领域的特殊群体研究, 揭示头部信息的具体作用, 完善相关理论解释以及探索更具有生态效度的肢体倒置效应.     

Identifying the mechanisms underpinning recognition of structured sequences of action

We present three experiments to identify the specific information sources that skilled participants use to make recognition judgements when presented with dynamic, structured stimuli. A group of less skilled participants acted as controls. In all experiments, participants were presented with filmed stimuli containing structured action sequences. In a subsequent recognition phase, participants were presented with new and previously seen stimuli and were required to make judgements as to whether or not each sequence had been presented earlier (or were edited versions of earlier sequences). In Experiment 1, skilled participants demonstrated superior sensitivity in recognition when viewing dynamic clips compared with static images and clips where the frames were presented in a nonsequential, randomized manner, implicating the importance of motion information when identifying familiar or unfamiliar sequences. In Experiment 2, we presented normal and mirror-reversed sequences in order to distort access to absolute motion information. Skilled participants demonstrated superior recognition sensitivity, but no significant differences were observed across viewing conditions, leading to the suggestion that skilled participants are more likely to extract relative rather than absolute motion when making such judgements. In Experiment 3, we manipulated relative motion information by occluding several display features for the duration of each film sequence. A significant decrement in performance was reported when centrally located features were occluded compared to those located in more peripheral positions. Findings indicate that skilled participants are particularly sensitive to relative motion information when attempting to identify familiarity in dynamic, visual displays involving interaction between numerous features.     

Empirical evaluation of the uncanny valley hypothesis fails to confirm the predicted effect of motion

The uncanny valley hypothesis states that the acceptability of an artificial character will not increase linearly in relation to its likeness to human form. Instead, after an initial rise in acceptability there will be a pronounced decrease when the character is similar, but not identical to human form (Mori, 1970/2012). Moreover, it has been claimed but never directly tested that movement would accentuate this dip and make moving characters less acceptable. We used a number of full-body animated computer characters along with a parametrically defined motion set to examine the effect of motion quality on the uncanny valley. We found that improving the motion quality systematically improved the acceptability of the characters. In particular, the character classified in the deepest location of the uncanny valley became more acceptable when it was animated. Our results showed that although an uncanny valley was found for static characters, the deepening of the valley with motion, originally predicted by Mori (1970/2012), was not obtained.     

The effects of schema on recognition memories and subjective experiences for actions and objects

We examined how the schema affects recognition memories and subjective experiences for actions and objects. First, participants watched consecutive slides that described a man in the kitchen. In the slides, the man performed schema‐consistent actions and schema‐inconsistent actions, and schema‐consistent objects and schema‐inconsistent objects were left in the kitchen space. After watching the slides, participants completed a recognition test, a remember/know test, and a Perception/Thought/Emotion/Context questionnaire. For objects, the discrimination between targets and distracters was more accurate for schema‐inconsistent items than for schema‐consistent items, owing to perceptual, thought, and emotional recollections for schema‐inconsistent object targets. For actions, schema‐consistent targets were more frequently recognized than schema‐inconsistent targets, with more remember judgments based on perceptual and contextual recollections. While item‐specific information of schema‐inconsistent targets could be elaborated for objects, the perceptual details and the contextual relationship of schema‐consistent targets could be elaborated for actions. We also found less false recognitions for schema‐consistent action distracters than for schema‐consistent object distracters. The retrieval of the perceptual details of schema‐consistent action targets could prevent false recognitions for schema‐consistent action distracters.     

Rats’ visual-spatial working memory: New object choice accuracy as a function of number of objects in the study array

When rats had to find new (jackpot) objects for rewards from among previously sampled baited objects, increasing the number of objects in the sample (study) segment of a trial from 3 to 5 and then to 7 (Experiment 1) or from 3 to 6 and 9 (Experiments 2 and 3) or from 6 to 9 and 12 (Experiment 4) did not reduce rats’ test segment performance. Increasing study segment size improved test segment performance contrary the limited-capacity hypothesis concerning rats’ spatial working memory. This effect occurred when objects either differed visually (Experiments 1, 2, 4) or only by odor (Experiment 3). Rats performed no better than chance in finding a jackpot on their first choice from among three visually different objects in Experiments 1 and 2. Furthermore, results from Experiments 2 and 3 indicate that differences in the probability of finding a jackpot by chance in Experiment 1 were not responsible for failure to find the predicted inverse relationship. Results from Experiment 4 indicate that those from Experiments 2 and 3 were not solely due to size of test arrays. We discussed whether our findings could be attributed to innate foraging or perceptual isolation processes during testing or to perceptual encoding processes during exposure to study segment arrays.     

The role of motion and speech in face recognition at birth

Newborns, a few hours after birth, already encounter many different faces, talking or silently moving. How do they process these faces and which cues are important in early face recognition? In a series of six experiments, newborns were familiarized with an unfamiliar face in different contexts (photographs, talking, silently moving, and with only external movements of the head with speech sound). At test, they saw the familiar and a new faces either in photographs, silently moving, or talking. A novelty preference was evidenced at test when photographs were presented in the two phases. This result supports those already evidenced in several studies. A familiarity preference appeared only when the face was seen talking in the familiarization phase and in a photograph or talking again at test. This suggests that the simultaneous presence of speech sound, and rigid and nonrigid movements present in a talking face enhances recognition of interactive faces at birth.