Age and culture modulate object processing and object—scene binding in the ventral visual area

Behavioral differences in the visual processing of objects and backgrounds as a function of cultural group are well documented. Recent neuroimaging evidence also points to cultural differences in neural activation patterns. Compared with East Asians, Westerners’ visual processing is more object focused, and they activate neural structures that reflect this bias for objects. In a recent adaptation study, East Asian older adults showed an absence of an object-processing area but normal adaptation for background areas. In the present study, 75 young and old adults (half East Asian and half Western) were tested in an fMR-adaptation study to examine differences in object and background processing as well as object—background binding. We found equivalent background processing in the parahippocampal gyrus in all four groups, diminished binding processes in the hippocampus in elderly East Asians and Westerners, and diminished object processing in elderly versus young adults in the lateral occipital complex. Moreover, elderly East Asians showed significantly less adaptation response in the object areas than did elderly Westerners. These findings demonstrate the malleability of perceptual processes as a result of differences in cohort-specific experiences or in cultural exposure over time.     

Culture and context: East Asian American and European American differences in P3 event-related potentials and self-construal

Research has demonstrated differences in social and cognitive processes between East Asians and European Americans. Whereas East Asians have been characterized as being more sensitive to situational context and attending more to the perceptual field, European Americans have been characterized as being more focused on the object and being more field independent. The goal of the present experiment was to investigate differences in neural responses to target objects and stimulus context between East Asian Americans and European Americans using a three-stimulus novelty P3 event-related potential design. As hypothesized, European Americans displayed relatively greater target P3 amplitudes, indexing attention to target events, whereas East Asian Americans displayed relatively greater novelty P3 amplitudes, indexing attention to contextually deviant events. Furthermore, the authors found that interdependent self-construal mediated the relationship between culture and the novelty P3. These findings identify a specific pattern of neural activity associated with established cultural differences in contextual sensitivity.     

不同情绪载体的神经活动及其异同——脑成像研究的ALE元分析

情绪识别一直是学界关注的热点。虽然已有研究探讨了动态面孔表情、动态身体表情和声音情绪的脑机制, 但对每种情绪载体的整体认识相对不完善, 同时对不同情绪载体之间神经机制的共性和区别知之甚少。因此, 本研究首先通过三项独立的激活似然估计元分析来识别每种情绪模式的大脑激活区域, 然后进行对比分析以评估三种情绪载体之间共同的和独特的神经活动。结果显示, 动态面孔表情的大脑活动包括广泛的额叶、枕叶、颞叶和部分顶叶皮层以及海马、小脑、丘脑、杏仁核等皮层下区域; 动态身体表情的激活集中于颞/枕叶相关脑区以及小脑和海马; 声音情绪则引起了颞叶、额叶、杏仁核、尾状核和脑岛的激活。联合分析表明, 三种情绪载体跨模态激活了左侧颞中回和右侧颞上回。对比分析的结果证明了视觉刺激比听觉刺激更占优势, 动态面孔表情尤为突出, 同时动态身体表情也发挥着重要作用, 但声音情绪有其独特性。总之, 这些发现验证和拓展了三种情绪载体的现有神经模型, 揭示了情绪处理中心的、普遍性的区域, 但每种情绪载体又有自己可靠的特异性神经回路。     

Effect of background information on object identification

Previous research using briefly presented displays has indicated that objects in a coherent scene are easier to identify than are objects in incoherent backgrounds. Of interest is whether the identification of the target object depends on the identification of the scene or the identification of other diagnostic objects in the scene. Experiment 1 indicated objects are more difficult to identify when located in an "episodically" inconsistent background even when the same diagnostic objects are present in both inconsistent and consistent backgrounds. Experiment 2 demonstrated that the degree to which noncued (cohort) objects are consistent with the target object has no effect on the object identification task. Experiment 3 showed consistent episodic background information facilitated object identification and inconsistent episodic background information did not interfere relative to "nonsense" backgrounds roughly equated on visual characteristics. Implications for models of scene perception are discussed.     

Culture and change blindness

Research on perception and cognition suggests that whereas East Asians view the world holistically, attending to the entire field and relations among objects, Westerners view the world analytically, focusing on the attributes of salient objects. These propositions were examined in the change-blindness paradigm. Research in that paradigm finds American participants to be more sensitive to changes in focal objects than to changes in the periphery or context. We anticipated that this would be less true for East Asians and that they would be more sensitive to context changes than would Americans. We presented participants with still photos and with animated vignettes having changes in focal object information and contextual information. Compared to Americans, East Asians were more sensitive to contextual changes than to focal object changes. These results suggest that there can be cultural variation in what may seem to be basic perceptual processes.     

Cortical dynamics of contextually cued attentive visual learning and search: spatial and object evidence accumulation

How do humans use target-predictive contextual information to facilitate visual search? How are consistently paired scenic objects and positions learned and used to more efficiently guide search in familiar scenes? For example, humans can learn that a certain combination of objects may define a context for a kitchen and trigger a more efficient search for a typical object, such as a sink, in that context. The ARTSCENE Search model is developed to illustrate the neural mechanisms of such memory-based context learning and guidance and to explain challenging behavioral data on positive-negative, spatial-object, and local-distant cueing effects during visual search, as well as related neuroanatomical, neurophysiological, and neuroimaging data. The model proposes how global scene layout at a first glance rapidly forms a hypothesis about the target location. This hypothesis is then incrementally refined as a scene is scanned with saccadic eye movements. The model simulates the interactive dynamics of object and spatial contextual cueing and attention in the cortical What and Where streams starting from early visual areas through medial temporal lobe to prefrontal cortex. After learning, model dorsolateral prefrontal cortex (area 46) primes possible target locations in posterior parietal cortex based on goal-modulated percepts of spatial scene gist that are represented in parahippocampal cortex. Model ventral prefrontal cortex (area 47/12) primes possible target identities in inferior temporal cortex based on the history of viewed objects represented in perirhinal cortex.     

Context Sensitivity in Canadian and Japanese Children’s Judgments of Emotion

Previous studies showed that East Asians are more sensitive than North Americans to contextual information, and that the cultural differences in context sensitivity emerge in preschool children. Yet, little is known about whether this generalizes to children’s emotional judgments. The present study tested Canadian and Japanese preschool children and examined cross-culturally the extent to which facial expressions of surrounding people influence judgments of a target person’s emotion. Japanese children were more likely than Canadian children to judge an emotionally-neutral target as more negative (positive) when the background emotion was negative (positive), demonstrating an assimilation effect. Canadian children, however, showed a contrast effect: judging the target person’s neutral emotion as more negative when the background emotion was positive. These data extend extant understanding of emotion recognition by illuminating nuances in perceptual processes across developmental and cultural lines.     

Scene perception and memory revealed by eye movements and receiver-operating characteristic analyses: Does a cultural difference truly exist?

Cultural differences have been observed in scene perception and memory: Chinese participants purportedly attend to the background information more than did American participants. We investigated the influence of culture by recording eye movements during scene perception and while participants made recognition memory judgements. Real-world pictures with a focal object on a background were shown to both American and Chinese participants while their eye movements were recorded. Later, memory for the focal object in each scene was tested, and the relationship between the focal object (studied, new) and the background context (studied, new) was manipulated. Receiver-operating characteristic (ROC) curves show that both sensitivity and response bias were changed when objects were tested in new contexts. However, neither the decrease in accuracy nor the response bias shift differed with culture. The eye movement patterns were also similar across cultural groups. Both groups made longer and more fixations on the focal objects than on the contexts. The similarity of eye movement patterns and recognition memory behaviour suggests that both Americans and Chinese use the same strategies in scene perception and memory.     

Scene perception and memory revealed by eye movements and receiver-operating characteristic analyses: does a cultural difference truly exist?

Cultural differences have been observed in scene perception and memory: Chinese participants purportedly attend to the background information more than did American participants. We investigated the influence of culture by recording eye movements during scene perception and while participants made recognition memory judgements. Real-world pictures with a focal object on a background were shown to both American and Chinese participants while their eye movements were recorded. Later, memory for the focal object in each scene was tested, and the relationship between the focal object (studied, new) and the background context (studied, new) was manipulated. Receiver-operating characteristic (ROC) curves show that both sensitivity and response bias were changed when objects were tested in new contexts. However, neither the decrease in accuracy nor the response bias shift differed with culture. The eye movement patterns were also similar across cultural groups. Both groups made longer and more fixations on the focal objects than on the contexts. The similarity of eye movement patterns and recognition memory behaviour suggests that both Americans and Chinese use the same strategies in scene perception and memory.     

Selection can be performed effectively without temporal binding,but could be even more effective with it

Experiments using spatial cues and spatial probes provide strong evidence for an attention mechanism that chooses a location and selects all information at that location. This selection process can work very quickly; so quickly that selection probably begins before segmentation and grouping. It can be implemented in a neural network simply and efficiently without temporal binding. In conjunction with this spatial attention, however, temporal binding can potentially enhance visual selection in complex scenes. First, it would allow a target object to be selected without also selecting a superimposed distractor. Second, it could maintain representations of objects after attention has moved to another object. Third, it could allow multiple parts of an object or scene to be selected, segmented, and analysed simultaneously. Thus, temporal synchrony should be more likely to appear during tasks with overlapping targets and distractors, and tasks that require that multiple objects or multipart objects be analysed and remembered simultaneously.     

He is smarter when he looks smart in front of many versus a few others: Impact of audience size on target appraisals in a cross-cultural context

Will a person be seen as more superior if he or she receives an award in front of a large audience in comparison with a small audience? We predicted that this would hold true for East Asians, whose cultural logic of face asserts that a person's worth can only be conferred by collective others, but would not hold true for European Americans, whose cultural logic of dignity promotes the judgement of a person's worth based on their own perspective. This study found an audience-size effect for East Asians, in which participants gave higher appraisals to a target when they imagined the target's high performance to have been seen by 10 other people (vs. one other person) even when the target's performance level remained constant. In contrast, Westerners were not affected by the size of the audience witnessing the target's performance. In addition, perceived social reputation was found to mediate the audience-size effect; the participants imagining the target performing well in front of 10 others (vs. one other) perceived others as thinking more highly of the target; this in turn led participants to give higher appraisals to the target. As expected, this mediation effect was only found for East Asians.     

Cultural influences on Facebook photographs

Prior research in social psychology indicates that East Asians from collectivistic and interdependent sociocultural systems are more sensitive to contextual information than Westerners, whereas Westerners with individualistic and independent representation have a tendency to process focal and discrete attributes of the environment. Here we have demonstrated that such systematic cultural variations can also be observed in cyberspace, focusing on self‐presentation of photographs on Facebook, the most popular worldwide online social network site. We examined cultural differences in face/frame ratios for Facebook profile photographs in two studies. For Study 1, 200 digital profile face photographs of active Facebook users were randomly selected from native and immigrant Taiwanese and Americans. For Study 2, 312 Facebook profiles of undergraduate students of six public universities in East Asia (Hong Kong, Singapore, and Taiwan) and the United States (California and Texas) were randomly selected. Overall, the two studies clearly showed that East Asian Facebook users are more likely to deemphasize their faces compared to Americans. Specifically, East Asians living in Hong Kong, Singapore, and Taiwan exhibited a predilection for context inclusiveness in their profile photographs, whereas Americans tended to prioritize their focal face at the expense of the background. Moreover, East Asian Facebook users had lower intensity of facial expression than Americans on their photographs. These results demonstrate marked cultural differences in context‐inclusive styles versus object‐focused styles between East Asian and American Facebook users. Our findings extend previous findings from the real world to cyberspace, and provide a novel approach to investigate cognition and behaviors across cultures by using Facebook as a data collection platform.     

Scene perception: Detecting and judging objects undergoing relational violations

Five classes of relations between an object and its setting can characterize the organization of objects into real-world scenes. The relations are (1) Interposition (objects interrupt their background), (2) Support (objects tend to rest on surfaces), (3) Probability (objects tend to be found in some scenes but not others), (4) Position (given an object is probable in a scene, it often is found in some positions and not others), and (5) familiar Size (objects have a limited set of size relations with other objects). In two experiments subjects viewed brief (150 msec) presentations of slides of scenes in which an object in a cued location in the scene was either in a normal relation to its background or violated from one to three of the relations. Such objects appear to (1) have the background pass through them, (2) float in air, (3) be unlikely in that particular scene, (4) be in an inappropriate position, and (5) be too large or too small relative to the other objects in the scene. In Experiment I, subjects attempted to determine whether the cued object corresponded to a target object which had been specified in advance by name. With the exception of the Interposition violation, violation costs were incurred in that the detection of objects undergoing violations was less accurate and slower than when those same objects were in normal relations to their setting. However, the detection of objects in normal relations to their setting (innocent bystanders) was unaffected by the presence of another object undergoing a violation in that same setting. This indicates that the violation costs were incurred not because of an unsuccessful elicitation of a frame or schema for the scene but because properly formed frames interfered with (or did not facilitate) the perceptibility of objects undergoing violations. As the number of violations increased, target detectability generally decreased. Thus, the relations were accessed from the results of a single fixation and were available sufficiently early during the time course of scene perception to affect the perception of the objects in the scene. Contrary to expectations from a bottom-up account of scene perception, violations of the pervasive physical relations of Support and Interposition were not more disruptive on object detection than the semantic violations of Probability, Position and Size. These are termed semantic because they require access to the referential meaning of the object. In Experiment II, subjects attempted to detect the presence of the violations themselves. Violations of the semantic relations were detected more accurately than violations of Interposition and at least as accurately as violations of Support. As the number of violations increased, the detectability of the incongruities between an object and its setting increased. These results provide converging evidence that semantic relations can be accessed from the results of a single fixation. In both experiments information about Position was accessed at least as quickly as information on Probability. Thus in Experiment I, the interference that resulted from placing a fire hydrant in a kitchen was not greater than the interference from placing it on top of a mail ? in a street scene. Similarly, violations of Probability in Experiment II were not more detectable than violations of Position. Thus, the semantic relations which were accessed included information about the detailed interactions among the objects—information which is more specific than what can be inferred from the general setting. Access to the semantic relations among the entities in a scene is not deferred until the completion of spatial and depth processing and object identification. Instead, an object's semantic relations are accessed simultaneously with its physical relations as well as with its own identification.     

Neural responses to meaningless pseudosigns: evidence for sign-based phonetic processing in superior temporal cortex

To identify neural regions that automatically respond to linguistically structured, but meaningless manual gestures, 14 deaf native users of American Sign Language (ASL) and 14 hearing non-signers passively viewed pseudosigns (possible but non-existent ASL signs) and non-iconic ASL signs, in addition to a fixation baseline. For the contrast between pseudosigns and baseline, greater activation was observed in left posterior superior temporal sulcus (STS), but not in left inferior frontal gyrus (BA 44/45), for deaf signers compared to hearing non-signers, based on VOI analyses. We hypothesize that left STS is more engaged for signers because this region becomes tuned to human body movements that conform the phonological constraints of sign language. For deaf signers, the contrast between pseudosigns and known ASL signs revealed increased activation for pseudosigns in left posterior superior temporal gyrus (STG) and in left inferior frontal cortex, but no regions were found to be more engaged for known signs than for pseudosigns. This contrast revealed no significant differences in activation for hearing non-signers. We hypothesize that left STG is involved in recognizing linguistic phonetic units within a dynamic visual or auditory signal, such that less familiar structural combinations produce increased neural activation in this region for both pseudosigns and pseudowords.     

Local and global contextual constraints on the identification of objects in scenes.

Objects likely to appear in a given real-world scene are frequently found to be easier to recognize. Two different sources of contextual information have been proposed as the basis for this effect: global scene background and individual companion objects. The present paper examines the relative importance of these two elements in explaining the context-sensitivity of object identification in full scenes. Specific sequences of object fixations were elicited during free scene exploration, while fixation times on designated target objects were recorded as a measure of ease of target identification. Episodic consistency between the target, the global scene background, and the object fixated just prior to the target (the prime), were manipulated orthogonally. Target fixation times were examined for effects of prime and background. Analyses show effects of both factors, which are modulated by the chronology and spatial extent of scene exploration. The results are discussed in terms of their implications for a model of visual object recognition in the context of real-world scenes.     

动词论元结构复杂性加工的认知神经机制

动词论元结构复杂性表现在论元数量、论元范畴选择模式、题元角色指派模式和映射方式四个方面。大部分实证研究表明, 更多的论元数量、选择性论元范畴、选择性题元角色指派以及非典型映射, 使动词论元结构加工的认知神经机制更复杂。多论元加工功能脑区主要涉及左侧额下回和外侧裂周后部; 选择性论元范畴加工功能脑区主要涉及左侧额下回、额叶中后部、颞上回和颞叶中后部; 选择性题元角色指派加工功能脑区主要涉及外侧裂周后部、左侧额叶中后部和额下回; 非典型映射加工功能脑区主要涉及左侧额下回、颞上回、颞中回和颞叶后部。左侧额下回可能涉及初始句法加工、动词次范畴确定、句法移位和非宾格动词语义加工, 左侧额叶中后部可能涉及初始句法加工和动词次范畴确定, 左侧颞上回和颞叶中后部可能涉及表层句法加工和表层论元句法-语义整合, 外侧裂周后部可能涉及论元语义表征。动词论元结构加工过程和动词词汇特征表明, 复杂性某些方面存在交互作用。动词论元结构复杂性与加工难易的对应关系、复杂性加工难度层级和交互作用的认知神经机制以及汉语动词论元结构复杂性加工认知神经机制等议题, 有待进一步探讨。     

Neural dichotomy of word concreteness: a view from functional neuroimaging

Our perception about the representation and processing of concrete and abstract concepts is based on the fact that concrete words are highly imagined and remembered faster than abstract words. In order to explain the processing differences between abstract and concrete concepts, various theories have been proposed, yet there is no unanimous consensus about its neural implication. The present study investigated the processing of concrete and abstract words during an orthography judgment task (implicit semantic processing) using functional magnetic resonance imaging to validate the involvement of the neural regions. Relative to non-words, both abstract and concrete words show activation in the regions of bilateral hemisphere previously associated with semantic processing. The common areas (conjunction analyses) observed for abstract and concrete words are bilateral inferior frontal gyrus (BA 44/45), left superior parietal (BA 7), left fusiform gyrus and bilateral middle occipital. The additional areas for abstract words were noticed in bilateral superior temporal and bilateral middle temporal region, whereas no distinct region was noticed for concrete words. This suggests that words with abstract concepts recruit additional language regions in the brain.     

Haptic face identification activates ventral occipital and temporal areas: an fMRI study

Many studies in visual face recognition have supported a special role for the right fusiform gyrus. Despite the fact that faces can also be recognized haptically, little is known about the neural correlates of haptic face recognition. In the current fMRI study, neurologically intact participants were intensively trained to identify specific facemasks (molded from live faces) and specific control objects. When these stimuli were presented in the scanner, facemasks activated left fusiform and right hippocampal/parahippocampal areas (and other regions) more than control objects, whereas the latter produced no activity greater than the facemasks. We conclude that these ventral occipital and temporal areas may play an important role in the haptic identification of faces at the subordinate level. We further speculate that left fusiform gyrus may be recruited more for facemasks than for control objects because of the increased need for sequential processing by the haptic system.     

Haptic face identification activates ventral occipital and temporal areas: An fMRI study

Many studies in visual face recognition have supported a special role for the right fusiform gyrus. Despite the fact that faces can also be recognized haptically, little is known about the neural correlates of haptic face recognition. In the current fMRI study, neurologically intact participants were intensively trained to identify specific facemasks (molded from live faces) and specific control objects. When these stimuli were presented in the scanner, facemasks activated left fusiform and right hippocampal/parahippocampal areas (and other regions) more than control objects, whereas the latter produced no activity greater than the facemasks. We conclude that these ventral occipital and temporal areas may play an important role in the haptic identification of faces at the subordinate level. We further speculate that left fusiform gyrus may be recruited more for facemasks than for control objects because of the increased need for sequential processing by the haptic system.     

Constructing visual representations of natural scenes: the roles of short- and long-term visual memory

A "follow-the-dot" method was used to investigate the visual memory systems supporting accumulation of object information in natural scenes. Participants fixated a series of objects in each scene, following a dot cue from object to object. Memory for the visual form of a target object was then tested. Object memory was consistently superior for the two most recently fixated objects, a recency advantage indicating a visual short-term memory component to scene representation. In addition, objects examined earlier were remembered at rates well above chance, with no evidence of further forgetting when 10 objects intervened between target examination and test and only modest forgetting with 402 intervening objects. This robust prerecency performance indicates a visual long-term memory component to scene representation.