空间-时间关联的中介共同表征结构:来自反转STEARC效应的证据

通过3个双任务实验(诱导任务和特征任务)探讨空间-时间联合编码(STEARC)效应的加工机制。实验1采用时间信息作为诱导任务材料,实验2采用空间信息作为诱导任务材料,在特征任务中都发现映射不一致组被试(看到过去/左侧刺激时按右键反应,看到未来/右侧刺激时按左键反应)出现反转STEARC效应,映射一致组被试表现出常规的STEARC效应,表明从时间信息加工到空间反应过程符合中介共同表征结构。实验3分离两种任务的反应方式(手动和眼动),发现不一致映射规则下,被试仍然表现出常规的STEARC效应,表明这种中介共同表征结构存在特定联结效应,即在不同反应器中出现时间和空间相互独立的表征结构。总体而言,研究支持空间-时间关联符合中介共同表征结构,并且这种关联中存在反应器特定联结效应。     

Is Complex Visual Information Implicated During Language Comprehension? The Case of Cast Shadows

Previous research showed that sensorimotor information affects the perception of properties associated with implied perceptual context during language comprehension. Three experiments addressed a novel question of whether perceptual context may contribute to a simulation of information about such out-of-sight objects as cast shadows. In Experiment 1, participants read a sentence that implied a particular shadow cast on a target (blinds vs. an open window) and then verified the picture of the object onto which a shadow was cast. Responses were faster when the shadow of blinds cast on the object matched that implied by the sentence. However, the data did not show the same matching effect for pictures with cast shadows from an open window. In Experiments 2 and 3, we found that verification times for pictures with no cast shadows were faster when preceded by an “open window” sentence, thus suggesting that reading the sentence does not elicit a visual simulation of any specific shadow. Experiment 3 showed that the objects superimposed with a cast shadow of the blinds and blinds themselves were verified faster after reading a “blinds” sentence. However, the results of an order analysis showed the temporal stability of the “blinds shadows” effect, but the disappearance of the “blinds” effect in the second half of the data. We conclude that the results are compatible, to a lesser or greater extent, with multiple accounts, and discuss our findings in the context of a mental imagery view, a mental simulation view, and an amodal representation view.     

The perception of 3-D shape from shadows cast onto curved surfaces

In a natural environment, cast shadows abound. Objects cast shadows both upon themselves and upon background surfaces. Previous research on the perception of 3-D shape from cast shadows has only examined the informativeness of shadows cast upon flat background surfaces. In outdoor environments, however, background surfaces often possess significant curvature (large rocks, trees, hills, etc.), and this background curvature distorts the shape of cast shadows. The purpose of this study was to determine the extent to which observers can “discount” the distorting effects of curved background surfaces. In our experiments, observers viewed deforming or static shadows of naturally shaped objects, which were cast upon flat and curved background surfaces. The results showed that the discrimination of 3-D object shape from cast shadows was generally invariant over the distortions produced by hemispherical background surfaces. The observers often had difficulty, however, in identifying the shadows cast onto saddle-shaped background surfaces. The variations in curvature which occur in different directions on saddle-shaped background surfaces cause shadow distortions that lead to difficulties in object recognition and discrimination.     

Invariant recognition of natural objects in the presence of shadows

Shadows are frequently present when we recognize natural objects, but it is unclear whether they help or hinder recognition. Shadows could improve recognition by providing information about illumination and 3-D surface shape, or impair recognition by introducing spurious contours that are confused with object boundaries. In three experiments, we explored the effect of shadows on recognition of natural objects. The stimuli were digitized photographs of fruits and vegetables displayed with or without shadows. In experiment 1, we evaluated the effects of shadows, color, and image resolution on naming latency and accuracy. Performance was not affected by the presence of shadows, even for gray-scale, blurry images, where shadows are difficult to identify. In experiment 2, we explored recognition of two-tone images of the same objects. In these images, shadow edges are difficult to distinguish from object and surface edges because all edges are defined by a luminance boundary. Shadows impaired performance, but only in the early trials. In experiment 3, we examined whether shadows have a stronger impact when exposure time is limited, allowing little time for processing shadows; no effect of shadows was found. These studies show that recognition of natural objects is highly invariant to the complex luminance patterns caused by shadows.     

Action for perception: a motor-visual attentional effect

Five experiments investigated whether preparation of a grasping movement affects detection and discrimination of visual stimuli. Normal human participants were required to prepare to grasp a bar and then to grasp it as fast as possible on presentation of a visual stimulus. On the basis of the degree of sharing of their intrinsic properties with those of the to-be-grasped bar, visual stimuli were categorized as "congruent" or "incongruent." Results showed that grasping reaction times to congruent visual stimuli were faster than reaction times to incongruent ones. These data indicate that preparation to act on an object produces faster processing of stimuli congruent with that object. The same facilitation was present also when, after the preparation of hand grasping, participants were suddenly instructed to inhibit the prepared grasping movement and to respond with a different motor effector. The authors suggest that these findings could represent an extension of the premotor theory of attention, from orienting of attention to spatial locations to orienting of attention to graspable objects.     

The temporal dynamics of the perceptual consequences of action-effect prediction

An essential aspect of voluntary action control is the ability to predict the perceptual effects of our actions. Although the influence of action-effect prediction on humans’ behavior and perception is unequivocal, it remains unclear when action-effect prediction is generated by the brain. The present study investigates the dynamics of action effect anticipation by tracing the time course of its perceptual consequences. Participants completed an acquisition phase during which specific actions (left and right key-presses) were associated with specific visual effects (upward and downward dots motion). In the test phase they performed a 2 AFC identification task in which they were required to indicate whether the dots moved upward or downward. To isolate any effects of action-effect prediction on perception, participants were presented with congruent and incongruent dot motion in which the association participants learned in the previous acquisition phase was respected and violated, respectively. Crucially, to assess the temporal dynamics of action prediction, congruent and incongruent stimuli were presented at different intervals before or after action execution. We observed higher sensitivity (d′) to motion discrimination in congruent vs. incongruent trials only when stimuli were presented from about 220 ms before the action to 280 ms after the action. The temporal dynamics of our effect suggest that action-effect prediction modulates perception at later stages of motor preparation.     

Rapid processing of cast and attached shadows

We used a visual-search method to investigate the role of shadows in the rapid discrimination of scene properties. Targets and distractors were light or dark 2-D crescents of identical shape and size, on a mid-grey background. From the dark stimuli, illusory 3-D shapes can be created by blurring one arc of the crescent. If the inner arc is blurred, the stimulus is perceived as a curved surface with attached shadow. If the outer arc is blurred, the stimulus is perceived as a flat surface casting a shadow. In a series of five experiments, we used this simple stimulus to map out the shadow properties that the human visual system can rapidly detect and discriminate. To subtract out 2-D image factors, we compared search performance for dark-shadow stimuli with performance for light-shadow stimuli which generally do not elicit strong 3-D percepts. We found that the human visual system is capable of rapid discrimination based upon a number of different shadow properties, including the type of the shadow (cast or attached), the direction of the shadow, and the displacement of the shadow. While it is clear that shadows are not simply discounted in rapid search, it is unclear at this stage whether rapid discrimination is acting upon shadows per se or upon representations of 3-D object shape and position elicited by perceived shadows.     

Use of interreflection and shadow for surface contact

The interaction of light with surfaces results in a number of lighting effects that may serve as valuable visual cues. Previous research on shadows has shown them to be effective in determining the three-dimensional (3-D) layout of a scene, but interreflections have been ignored as cues for spatial layout. Interreflections as well as shadows may help to disambiguate the 3-D layout of objects by providing information about an object's contact with a surface. We generated computer images of a box on an extended textured ground plane that was either in contact with the ground or was slightly above the ground. Images were rendered for four conditions: (1) no shadow + no interreflection, (2) shadow only, (3) interreflection only, and (4) shadow + interreflection. A photometrically incorrect condition was also included. The participants rated the degree of contact for each image on a scale, which was used to generate receiver operating characteristic (ROC) curves and a measure of sensitivity. In the images with no shadows or interreflections, the participants performed at chance levels. Interreflections, shadows, and a combination of interreflections and shadows all resulted in high sensitivity for judging object contact. More important, information from shadows and interreflections can be combined, resulting in near-perfect judgment of surface contact. Interreflections and shadows can be effective cues for object contact.     

Performance of unimanual and bimanual multiphased prehensile movements

By manipulating task action demands in 2 experiments, the author investigated whether the context-dependent effects seen in unimanual multiphase movements are also present in bimanual movements. Participants (N = 14) in Experiment 1 either placed or tossed objects into targets. The results indicated that the intention to perform a subsequent action with an object could influence the performance of an earlier movement in a sequence in both unimanual and bimanual tasks. Furthermore, assimilation effects were found when the subsequent tasks being performed by the 2 hands were incongruent. In Experiment 2, the author investigated in 12 participants whether planning in a multiphase movement includes some representation of the accuracy demands of the subsequent task. The accuracy demands of a subsequent task did not appear to influence initial movement planning. Instead, the present results support the notion that it is the action requirements of the subsequent movement that lead to context-dependent effects.     

Perception of the motion trajectory of objects from moving cast shadows in infant Japanese macaques (Macaca fuscata)

The shadows cast by moving objects enable human adults and infants to infer the motion trajectories of objects. Nonhuman animals must also be able to discriminate between objects and their shadows and infer the spatial layout of objects from cast shadows. However, the evolutionary and comparative developmental origins of sensitivity to cast shadows have not been investigated. In this study, we used a familiarity/novelty preferential looking procedure to assess the ability of infant macaques, aged 7–24 weeks, to discriminate between a ‘depth’ display containing a ball and cast shadow moving diagonally and an ‘up’ display containing a ball with a diagonal trajectory and a shadow with a horizontal trajectory. The infant macaques could discriminate the trajectories of the balls based on the moving shadows. These findings suggest that the ability to perceive the motion trajectory of an object from the moving shadow is common to both humans and macaques.     

Colour vision brings clarity to shadows

We have revealed a new role for colour vision in visual scene analysis: colour vision facilitates shadow identification. Shadows are important features of the visual scene, providing information about the shape, depth, and movement of objects. To be useful for perception, however, shadows must be distinguished from other types of luminance variation, principally the variation in object reflectance. A potential cue for distinguishing shadows from reflectance variations is colour, since chromatic changes typically occur at object but not shadow boundaries. We tested whether colour cues were exploited by the visual system for shadow identification, by comparing the ability of human test subjects to identify simulated shadows on chromatically variegated versus achromatically variegated backgrounds with identical luminance compositions. Performance was superior with the chromatically variegated backgrounds. Furthermore, introducing random colour contrast across the shadow boundaries degraded their identification. These findings demonstrate that the visual system exploits inbuilt assumptions about the relationships between colour and luminance in the natural visual world.     

Action Understanding in the Superior Temporal Sulcus Region

ABSTRACT— The posterior superior temporal sulcus (STS) region plays an important role in the perception of social acts, although its full role has not been completely clarified. This functional magnetic resonance imaging experiment examined activity in the STS region as participants viewed actions that were congruent or incongruent with intentions established by a previous emotional context. Participants viewed an actress express either a positive or a negative emotion toward one of two objects and then subsequently pick up one of them. If the object that was picked up had received positive regard, or if the object that was not picked up had received negative regard, the action was congruent; otherwise, the action was incongruent. Activity in the right posterior STS region was sensitive to the congruency between the action and the actress's emotional expression (i.e., STS activity was greater on incongruent than on congruent trials). These findings suggest that the posterior STS represents not only biological motion, but also how another person's motion is related to his or her intentions.     

The influence of environmental context in interpersonal observation–execution

Cyclical upper-limb movements involuntarily deviate from a primary movement direction when the actor concurrently observes incongruent biological motion. We examined whether environmental context influences such motor interference during interpersonal observation–execution. Participants executed continuous horizontal arm movements while observing congruent horizontal or incongruent curvilinear biological movements with or without the presence of an object positioned as an obstacle or distractor. When participants were observing a curvilinear movement, an object located within the movement space became an obstacle, and, thus, the curvilinear trajectory was essential to reach into horizontal space. When acting as a distractor, or with no object, the curvilinear trajectory was no longer essential. For observing horizontal movements, objects were located at the same relative locations as in the curvilinear movement condition. We found greater involuntary movement deviation when observing curvilinear than horizontal movements. Also, there was an influence of context only when observing horizontal movements, with greater deviation exhibited in the presence of a large obstacle. These findings suggest that the influence of environmental context is underpinned by the (mis-)matching of observed and executed actions as incongruent biological motion is primarily coded via bottom-up sensorimotor processes, whilst the congruent condition incorporates surrounding environmental features to modulate the bottom-up sensorimotor processes.     

Stuck on semantics: Processing of irrelevant object-scene inconsistencies modulates ongoing gaze behavior

People have an amazing ability to identify objects and scenes with only a glimpse. How automatic is this scene and object identification? Are scene and object semantics—let alone their semantic congruity—processed to a degree that modulates ongoing gaze behavior even if they are irrelevant to the task at hand? Objects that do not fit the semantics of the scene (e.g., a toothbrush in an office) are typically fixated longer and more often than objects that are congruent with the scene context. In this study, we overlaid a letter T onto photographs of indoor scenes and instructed participants to search for it. Some of these background images contained scene-incongruent objects. Despite their lack of relevance to the search, we found that participants spent more time in total looking at semantically incongruent compared to congruent objects in the same position of the scene. Subsequent tests of explicit and implicit memory showed that participants did not remember many of the inconsistent objects and no more of the consistent objects. We argue that when we view natural environments, scene and object relationships are processed obligatorily, such that irrelevant semantic mismatches between scene and object identity can modulate ongoing eye-movement behavior.     

Size From Shadow: Some Informational Paths Less Traveled

This article deals with informational structure in cast shadows. Most research on cast shadows has focused on retrieving various geometric properties of the scene from shadow patterns, the shape of objects and distances between objects being the foremost features. Size appears to be a rather neglected aspect. However, shadows contain a wealth of information about size. I explore first a simple heuristic (approximate equivalence of size of shadow and size of object) and some complicating factors: elongated shadows, shadows from pinholes, and penumbra. Finally, I discuss the case of relative size of objects in multiobject scenes with shadows.     

Orientation priming of grasping decision for drawings of objects and blocks,and words

This study tested the influence of orientation priming on grasping decisions. Two groups of 20 healthy participants had to select a preferred grasping orientation (horizontal, vertical) based on drawings of everyday objects, geometric blocks or object names. Three priming conditions were used: congruent, incongruent and neutral. The facilitating effects of priming were observed in the grasping decision task for drawings of objects and blocks but not object names. The visual information about congruent orientation in the prime quickened participants’ responses but had no effect on response accuracy. The results are discussed in the context of the hypothesis that an object automatically potentiates grasping associated with it, and that the on-line visual information is necessary for grasping potentiation to occur. The possibility that the most frequent orientation of familiar objects might be included in object-action representation is also discussed.     

The effect of colour congruency on shape discriminations of novel objects

Although visual object recognition is primarily shape driven, colour assists the recognition of some objects. It is unclear, however, just how colour information is coded with respect to shape in long-term memory and how the availability of colour in the visual image facilitates object recognition. We examined the role of colour in the recognition of novel, 3-D objects by manipulating the congruency of object colour across the study and test phases, using an old/new shape-identification task. In experiment 1, we found that participants were faster at correctly identifying old objects on the basis of shape information when these objects were presented in their original colour, rather than in a different colour. In experiments 2 and 3, we found that participants were faster at correctly identifying old objects on the basis of shape information when these objects were presented with their original part-colour conjunctions, rather than in different or in reversed part-colour conjunctions. In experiment 4, we found that participants were quite poor at the verbal recall of part-colour conjunctions for correctly identified old objects, presented as grey-scale images at test. In experiment 5, we found that participants were significantly slower at correctly identifying old objects when object colour was incongruent across study and test, than when background colour was incongruent across study and test. The results of these experiments suggest that both shape and colour information are stored as part of the long-term representation of these novel objects. Results are discussed in terms of how colour might be coded with respect to shape in stored object representations.     

The interplay of bottom-up and top-down mechanisms in visual guidance during object naming

An ongoing issue in visual cognition concerns the roles played by low- and high-level information in guiding visual attention, with current research remaining inconclusive about the interaction between the two. In this study, we bring fresh evidence into this long-standing debate by investigating visual saliency and contextual congruency during object naming (Experiment 1), a task in which visual processing interacts with language processing. We then compare the results of this experiment to data of a memorization task using the same stimuli (Experiment 2). In Experiment 1, we find that both saliency and congruency influence visual and naming responses and interact with linguistic factors. In particular, incongruent objects are fixated later and less often than congruent ones. However, saliency is a significant predictor of object naming, with salient objects being named earlier in a trial. Furthermore, the saliency and congruency of a named object interact with the lexical frequency of the associated word and mediate the time-course of fixations at naming. In Experiment 2, we find a similar overall pattern in the eye-movement responses, but only the congruency of the target is a significant predictor, with incongruent targets fixated less often than congruent targets. Crucially, this finding contrasts with claims in the literature that incongruent objects are more informative than congruent objects by deviating from scene context and hence need a longer processing. Overall, this study suggests that different sources of information are interactively used to guide visual attention on the targets to be named and raises new questions for existing theories of visual attention.     

The role of color diagnosticity in object recognition and representation

The role of color diagnosticity in object recognition and representation was assessed in three Experiments. In Experiment 1a, participants named pictured objects that were strongly associated with a particular color (e.g., pumpkin and orange). Stimuli were presented in a congruent color, incongruent color, or grayscale. Results indicated that congruent color facilitated naming time, incongruent color impeded naming time, and naming times for grayscale items were situated between the congruent and incongruent conditions. Experiment 1b replicated Experiment 1a using a verification task. Experiment 2 employed a picture rebus paradigm in which participants read sentences one word at a time that included pictures of color diagnostic objects (i.e., pictures were substituted for critical nouns). Results indicated that the “reading” times of these pictures mirrored the pattern found in Experiment 1. In Experiment 3, an attempt was made to override color diagnosticity using linguistic context (e.g., a pumpkin was described as painted green). Linguistic context did not override color diagnosticity. Collectively, the results demonstrate that color information is regularly utilized in object recognition and representation for highly color diagnostic items.     

Why cast shadows are expendable: insensitivity of human observers and the inherent ambiguity of cast shadows in pictorial art

The kinds of visual cues artists choose to use or not use in their work can offer insight into perceptual processes. On the basis of the observed paucity of the use of cast shadow in pictorial art, we hypothesized that cast shadows might be relatively expendable as pictorial cues. In this study, we investigated two potential reasons for this expendability: first, viewers might be insensitive to much of the information that cast shadows provide; and, second, ambiguities about what is shadow and what is pigment can often be resolved only through motion-something that static media are ill-equipped to deal with. In experiment 1, we used a visual-search paradigm in which viewers had to determine if there were odd cast shadows in sets of 4, 8, 16, and 32 objects. In experiment 2, viewers had to discriminate between shadow/pigment ambiguities in both still and moving images. Our results demonstrate that viewers are neither particularly sensitive to static cast-shadow incongruities, nor are they able to disambiguate cast shadow from pigment without continuous motion information. Taken together, these results may help explain why cast shadows are relatively rare in static pictorial work.