S-R correspondence effects of irrelevant visual affordance: Time course and specificity of response activation

It has been suggested that representations for action, elicited by an object's visual affordance, serve to potentiate motor components (such as a specific hand) to respond to the most afforded action. In three experiments, participants performed speeded left-right button press responses to an imperative target superimposed onto a prime image of an object suggesting a visual affordance oriented to left or right visual space. The time course of response activation was measured by varying the onset time between the prime and target. Long-lasting and gradually developing correspondence effects were found between the suggested affordance of the prime and the side of response, with little effect of response modality (hands uncrossed, hands crossed, or foot response). We conclude that visual affordances can evoke an abstract spatial response code, potentiating a wide variety of lateralized responses corresponding with the affordance.     

Attention-dependent visual capture in double vision

When the visual image of a body part, such as a finger, is doubled by a prism, the 'felt' position of that body part is captured by one of its visual images. Moving eye fixation from one to the other visual image is accompanied by a quick shift of the felt position. When focal attention is dissociated from foveation, the former determines visual capture. These new observations underline an active role of focal attention in intersensory integration and sensory-motor coordination of body parts.     

视觉表象产生的大脑半球专门化效应

采用Kosslyn单侧视野速示技术, 以英文字母图片为学习材料, 通过三个实验考察了视觉表象产生的大脑半球专门化效应。实验一提出在两种类型的视觉表象产生任务中, 有两种截然不同的加工起作用, 但却不能直接证实这两种不同加工机制的存在。实验二和实验三则进一步证实了两种表象产生任务具有不同的认知加工机制, 并表现出不同的大脑半球专门化效应。上述研究表明: 大脑两半球均参与产生视觉心理表象, 但分工不同, 并表现出不同的单侧化效应: 大脑左半球通过运用类别空间关系产生表象更有效, 大脑右半球运用数量空间关系产生表象更有效。结果进一步拓展了Kosslyn关于视觉空间关系加工的大脑半球专门化观点。     

Attention and saccadic eye movements

Four threshold detection experiments addressed three issues concerning the relationship between movements of spatial attention and saccadic eye movements: (a) the time course of attention shifts wit saccades, (b) the response of the two systems to changes in stimulus parameters, and (c) the relationship of attention to saccadic suppression. These issues bear on the more general question of the degree of independence between the saccadic and attentional movement systems. The results of these experiments support the contention that the mechanisms that shift attention are separate from those that control saccadic eye movements. Relevant events in the visual field periphery, however, will trigger both a saccade and attention shift. The attentional response to such events does not appear to be under subjects' control. The implication of these results for theories of saccadic suppression is discussed.     

上下意象图式对羌族亲属词认知的影响

采用亲属词判断任务和真假词判断任务, 考查了“上下意象图式”对羌族被试认知隐含辈分关系的羌族亲属词的影响, 并通过空间识别任务检验亲属词辈份概念加工能否自动地激活空间意象图式, 引导空间注意朝向与空间意象图式一致的位置。实验1表明, 在羌族被试对羌族亲属词的认知中, 存在着“隐喻一致性效应”：高辈分的亲属词呈现在计算机屏幕的上方加工得更快, 低辈分的亲属词呈现在计算机屏幕的下方加工得更快。实验2表明, 当目标刺激的空间位置与亲属词的辈分信息一致时, 羌族被试对目标刺激的辨认速度更快。整个研究表明, 羌族亲属词隐含的辈分关系可以用垂直空间关系来理解, 并引导被试的空间注意朝向与上下意象图式一致的位置, 证明对抽象概念的理解基于感觉运动的加工, 符合概念隐喻理论的预言。     

Semantic interference from visual object recognition on visual imagery

A new technique for examining the interaction between visual object recognition and visual imagery is reported. The "image-picture interference" paradigm requires participants to generate and make a response to a mental image of a previously memorized object, while ignoring a simultaneously presented picture distractor. Responses in 2 imagery tasks (making left-right higher spatial judgments and making taller-wider judgments) were longer when the simultaneous picture distractor was categorically related to the target distractor relative to unrelated and neutral target-distractor combinations. In contrast, performance was not influenced in this way when the distractor was a related word, when a semantic categorization decision was made to the target, or when distractor and target were visually but not categorically related to one another. The authors discuss these findings in terms of the semantic representations shared by visual object recognition and visual imagery that mediate performance.     

Qualitative analyses of critical aspects of adaptation to the visually left-right reversed world

In this article, mechanisms of perceptual adaptation to the transposed world are analyzed based on introspective and behavioral performance data gathered during an extended period of wearing left-right reversing goggles. Three aspects central to this study were the mental map of the living space surrounding the subject, body image (both seen and felt), and the sensorimotor coordination system, which reflects the relationship between the subject and surroundings. These were investigated through map-drawing tests, self-representation tests when postures other than face forward were adopted, and after effects observed immediately after removal of the reversing goggles. It was concluded that the main course of the perceptual adaptation to the visually left-right reversed world consists of double reversals of the mental map and body image as well as the establishment of a new sensorimotor coordination system. In sharp contrast to the proprioceptive-change hypothesis, the importance of the visual nature of the body image was emphasized.     

The role of sensory-motor information in object recognition: evidence from category-specific visual agnosia

The role of sensory-motor representations in object recognition was investigated in experiments involving AD, a patient with mild visual agnosia who was impaired in the recognition of visually presented living as compared to non-living entities. AD named visually presented items for which sensory-motor information was available significantly more reliably than items for which such information was not available; this was true when all items were non-living. Naming of objects from their associated sound was normal. These data suggest that both information about object form computed in the ventral visual system as well as sensory-motor information specifying the manner of manipulation contribute to object recognition.     

Effects of image background on spatial-frequency thresholds for face recognition

A great deal of work has been devoted to the question of which spatial frequencies, if any, are optimal for various visual tasks, such as face and object recognition. However, to date these studies have all been carried out with stimuli set against a uniform background. It is possible that this type of stimulus does not produce ecologically valid results. The natural world in which visual tasks normally take place involves a great deal of luminance variation and distracting visual structure, which may alter the spatial frequencies necessary for a task. We conducted two experiments that examined the effects of image background on the spatial-frequency thresholds (50% maximum of a low-pass or high-pass Butterworth filter) for face recognition by the psychophysical methods of adjustment and constant stimuli. In both experiments we found no significant difference in spatial-frequency thresholds between uniform-grey backgrounds and natural-scene backgrounds, and only minor differences between uniform-grey backgrounds and fractal noise backgrounds. This suggests that results obtained with uniform backgrounds are ecologically valid and that background effects, if they exist, are small.     

Imagined spatial transformation of one's body

This study examined two related phenomena: (a) the judgment of whether a human body part belongs to the left or right half of the body and (b) the imagined spatial transformation of one's body. In three experiments, observers made left-right judgments of a part of a body whose orientation differed from their own by a rotation about one of 13 axes. To do so, they imagined themselves passing to the orientation of the stimulus. Time for (a) left-right judgments and (b) accompanying imagined spatial transformations depended on the extent of the orientation difference (OD) between the observer and stimulus. More important, time for phenomena (a) and (b) depended strongly, and in the same way, on the direction of OD. Further results showed that the rate of imagined spatial transformations can vary strongly for different axes and directions of rotation about an axis. These and other results (e.g., Parsons, 1987a) suggest that temporal and kinematic properties of imagined spatial transformations are more object-specific than could be previously assumed.     

The effect of combinations of image degradations in a discrimination task

This paper explores the ways in which combinations of image degradations affect discrimination. Nine experiments are described that examine the discriminability of visual images that are degraded with three types of information reducing transformations: random punctate visual interference, lowpass spatial frequency filtering, and local area (i.e., block) averaging. The results of these experiments characterize a powerful visual ability to discriminate highly degraded stimuli unless that ability is severely challenged by relatively high levels of random visual interference. Discriminative commutativity of the orders in which the other two degradations are imposed is demonstrated. That is, the order in which the degradations are applied does not affect the final discriminative outcome. This result is in contrast to predictions from relevant mathematics and direct examination of the images produced by both orders of degradation. The commutativity is attributed to the particularly strong effect of the low-pass spatial frequency filtering degradation on the discrimination process. This study also demonstrates that combinations of degradations in a discrimination task always result in a reduction in performance, and never in the improvement that has been reported for recognition. This difference is attributed to the fact that form discrimination is mediated mainly by local features and high-frequency spatial components, whereas recognition is mediated mainly by global features and low-frequency spatial components.     

Dissociable Coordinate Frames of Unilateral Spatial Neglect: “Viewer-Centered” Neglect

Detailed analyses of reading and nonlexical tasks by three patients with unilateral spatial neglect (USN) secondary to stroke indicate that the USN in each of these patients affects the left side (contralateral to brain damage) of the viewer, with respect to the viewer's head, mid-sagittal plane of the body, or line of sight. In one case, the neglect was further specified as concerning the left side of the viewer's line of sight (the left half of her residual visual field). Thus, the frame of reference of USN in these three cases appears to have viewer-centered (in at least one case, specifically retinotopic) coordinates. The performance of these patients is contrasted to that of other patients in the literature whose USN appears to have a frame of reference with stimulus-centered or object-centered coordinates. These results are interpreted within a model of visual processing (adapted from Marr, 1980 and others) with at least three coordinate frames. It is argued that USN can affect one or more of these coordinate frames independently.     

Experimental disorientation in the horizontal plane

Twenty-eight subjects were examined on a visual matching task for their ability to maintain an orientation with respect to a particular direction in the horizontal plane following a voluntary rotary body movement through 180 degrees. Each subject was examined with respect to eight different directions.

Numerous gross errors occurred when visual information was reduced to the display of an arrow indicating a direction and a second arrow manipulated by the subject. The magnitude and distribution of the errors suggest that, under the conditions of this experiment, visual information as to direction in the horizontal plane is analysed according to the two horizontal dimensions defined by the sagittal and coronal planes of the head. In correcting for the rotary body movement, failure may occur with respect to either or both of these two dimensions. The frequency of a failure to make any correction at all (i.e. 180-degree errors) is consistent with independent failure in each of the two horizontal dimensions.

Failure is markedly more frequent in the fore-aft dimension than in the left-right dimension. It is suggested that this may be explained in terms of the ambiguous spatial significance of vertical disposition on the retina and the possibility of contamination between the two systems of conceptual analysis which identify the vertical and the fore-aft dimensions of visual space.

It is demonstrated that when minimal “landmarks” are provided they tend to be utilized as reference points in attempts to maintain orientation, even when the subject is aware that the “landmarks” are misleading. Such a use of “landmarks” does not suppress the previously mentioned mechanism of dimensional orientation.

The relevance of these results to normal human orientation is discussed.     

The Representation of Left-Right Orientation: A Dissociation Between Imagery and Perceptual Recognition

Eight experiments were conducted to determine whether visual mental imagery preserves left-right orientation in conditions where recognition memory apparently does not. Such a dissociation would suggest that information in memory preserves left-right orientation, but the process that matches input to such representations does not respect this distinction. In the experiments reported here, participants were asked to use one of two methods to indicate which way Abraham Lincoln faces on a US penny: Either they selected the correct profile from two sketches, or they formed a mental image and then specified the direction. If participants had just viewed pennies and were asked to visualize a particular one, they performed far better than chance; in contrast, if imagery was discouraged, they performed poorly when recognizing the profiles perceptually. However, unless actively discouraged from doing so, most participants reported spontaneously visualizing pennies prior to perceptual recognition if they had recently seen pennies.     

Sensory-motor and cognitive functions of the human posterior parietal cortex involved in manual actions

The posterior parietal cortex (PPC) is considered the dominant structure in the dorsal stream of visual processing, defined in the context of systems for perception and action. It is well-established that the human PPC is critical to sensory-motor transformations involved in online manual actions. A related body of literature identifies the PPC as important to cognitive aspects of action representation such as imagery, tool use, and gestures. The goal of the present paper is to review and compare the PPC contribution to representations of both motor control and motor cognition. Relating the sensory-motor and cognitive components of PPC function is important for an understanding of integrative representations of manual actions and the relation between perception, action, and cognition. Proposed theories of multiple dorsal stream systems supporting different action-relevant goals are discussed.     

Failure to exploit learned spatial value information during visual search

ABSTRACT

In recent years there has been rapid proliferation of studies demonstrating how reward learning guides visual search. However, most of these studies have focused on feature-based reward, and there has been scant evidence supporting the learning of space-based reward. We raise the possibility that the visual search apparatus is impenetrable to spatial value contingencies, even when such contingencies are learned and represented online in a separate knowledge domain. In three experiments, we interleaved a visual choice task with a visual search task in which one display quadrant produced greater monetary rewards than the remaining quadrants. We found that participants consistently exploited this spatial value contingency during the choice task but not during the search task – even when these tasks were interleaved within the same trials and when rewards were contingent on response speed. These results suggest that the expression of spatial value information is task specific and that the visual search apparatus could be impenetrable to spatial reward information. Such findings are consistent with an evolutionary framework in which the search apparatus has little to gain from spatial value information in most real world situations.     

Stimulus-response compatibility for absolute and relative spatial correspondence in reaching and in button pressing

Three experiments tested whether stimulus-response (S-R) compatibility might be a function of absolute (as opposed to relative) spatial correspondence-that is, the distance between a stimulus and the place of response. Experiment 1 studied reaching movements toward one of two targets in response to one of six visual stimuli. Stimulus-response pairs that shared relative position were faster than those that did not, and reaction time was faster when the stimulus and one of the potential targets were in close proximity. In Experiment 2 the same effects were found when the hands started from a different position, implicating stimulus target distance, rather than stimulus-hand distance as the critical variable. Experiment 3 employed keypress responses instead of reaches, and the distance effect was nearly absent. The implications of these results are discussed in terms of categorical (e.g. left-right) vs. quantitative (e.g. distance) S-R variables in spatial compatibility.     

Visual and verbal codes: Spatial information survives the icon

Three experiments are reported to demonstrate partial independence of identity and spatial position information concerning visually presented symbols. Experiment I shows that performance on these forms of information improves at different rates as a function of exposure duration. Experiment II shows that performance on one can be traded against the other. Experiment III demonstrates partial statistical independence of item and position responses and shows that increases in the duration and delay of the probe facilitate performance. Some implications of these experiments for theories involving mandatory verbal encoding of visual symbol-arrays are discussed. A model is proposed comprising visual and name stores with different acquisition rates and capacities. Both are indexed by identity but the visual code can also be interrogated by spatial cues.     

Brain dynamics of visual anticipation during spatial occlusion tasks in expert tennis players

Stimulus identification and action outcome understanding for a rapid and accurate response selection, play a fundamental role in racquet sports. Here, we investigated the neurodynamics of visual anticipation in tennis manipulating the postural and kinematic information associated with the body of opponents by means of a spatial occlusion protocol. Event Related Potentials (ERPs) were evaluated in two groups of professional tennis players (N = 37) with different levels of expertise, while they observed pictures of opponents and predicted the landing position as fast and accurately as possible. The observed action was manipulated by deleting different body districts of the opponent (legs, ball, racket and arm, trunk). Full body image (no occlusion) was used as control condition. The worst accuracy and the slowest response time were observed in the occlusion of trunk and ball. The former was associated with a reduced amplitude of the ERP components likely linked to body processing (the N1 in the right hemisphere) and visual-motor integration awareness (the pP1), as well as with an increase of the late frontal negativity (the pN2), possibly reflecting an effort by the insula to recover and/or complete the most correct sensory-motor representation. In both occlusions, a decrease in the pP2 may reflect an impairment of decisional processes upon action execution following sensory evidence accumulation. Enhanced amplitude of the P3 and the pN2 components were found in more experienced players, suggesting a greater allocation of resources in the process connecting sensory encoding and response execution, and sensory-motor representation.