The nature of altered vision near the hands: Evidence for the magnocellular enhancement account from object correspondence through occlusion

A growing body of evidence indicates that the perception of visual stimuli is altered when they occur near the observer’s hands, relative to other locations in space (see Brockmole, Davoli, Abrams, & Witt, 2013, for a review). Several accounts have been offered to explain the pattern of performance across different tasks. These have typically focused on attentional explanations (attentional prioritization and detailed attentional evaluation of stimuli in near-hand space), but more recently, it has been suggested that near-hand space enjoys enhanced magnocellular (M) input. Here we differentiate between the attentional and M-cell accounts, via a task that probes the roles of position consistency and color consistency in determining dynamic object correspondence through occlusion. We found that placing the hands near the visual display made observers use only position consistency, and not color, in determining object correspondence through occlusion, which is consistent with the fact that M cells are relatively insensitive to color. In contrast, placing observers’ hands far from the stimuli allowed both color and position contribute. This provides evidence in favor of the M-cell enhancement account of altered vision near the hands.     

Near-hand effects are robust: Three OSF pre-registered replications of visual biases in perihand space

ABSTRACT

Although previous work provides evidence that observers experience biases in visual processing when they view stimuli in perihand space, a few recent investigations have questioned the reliability of these near-hand effects. We addressed this controversy by running three pre-registered replication experiments. Experiment 1 was a replication of one of the initial studies on facilitated target detection near the hands in which participants performed an attentional cueing task while placing a single hand either near or far from the display. Experiment 2 tested the same paradigm while adopting the design of a recent experiment that called into question near-hand facilitation. Experiment 3 was a replication of a study in which hand proximity influenced working memory performance in a change detection paradigm. Across all three experiments, we found significant interactions between hand position and stimulus characteristics that indicated the hands’ presence altered visual processing, bolstering evidence favouring the robustness of near-hand effects.     

手近效应：研究内容、影响因素与神经机制

把手放在刺激旁边,会对知觉、记忆、语义和执行控制等认知加工产生影响,这类现象被称为手近效应。手近效应反映了身体与环境的互动对认知的塑造作用,为具身认知提供了新证据。本文从手近效应的内容,影响因素,及其认知、神经机制等方面对相关研究进行梳理。并从手近效应的神经机制,应用研究,以及动作意图和人际社会因素的调节作用等方面探讨当前手近效应还未解决的问题。     

From body shadows to bodily attention: Automatic orienting of tactile attention driven by cast shadows

Body shadows orient attention to the body-part casting the shadow. We have investigated the automaticity of this phenomenon, by addressing its time-course and its resistance to contextual manipulations. When targets were tactile stimuli at the hands (Exp.1) or visual stimuli near the body-shadow (Exp.2), cueing effects emerged regardless of the delay between shadow and target onset (100, 600, 1200, 2400 ms). This suggests a fast and sustained attention orienting to body-shadows, that involves both the space occupied by shadows (extra-personal space) and the space the shadow refers to (own body). When target type became unpredictable (tactile or visual), shadow-cueing effects remained robust only for tactile targets, as visual stimuli showed no overall reliable effects, regardless of whether they occurred near the shadow (Exp.3) or near the body (Exp.4). We conclude that mandatory attention shifts triggered by body-shadows are limited to tactile targets and, instead, are less automatic for visual stimuli.     

Contributions of parvocellular and magnocellular pathways to visual perception near the hands are not fixed,but can be dynamically altered

Visual perception is altered near the hands, and several mechanisms have been proposed to account for this, including differences in attention and a bias toward magnocellular-preferential processing. Here we directly pitted these theories against one another in a visual search task consisting of either magnocellular- or parvocellular-preferred stimuli. Surprisingly, we found that when a large number of items are in the display, there is a parvocellular processing bias in near-hand space. Considered in the context of existing results, this indicates that hand proximity does not entail an inflexible bias toward magnocellular processing, but instead that the attentional demands of the task can dynamically alter the balance between magnocellular and parvocellular processing that accompanies hand proximity.     

Reduced visual feature binding in the near-hand space

Growing evidence suggests that visual information is processed differently in the near-hand space, relative to the space far from the hands. To account for the existing literature, we recently proposed that the costs and benefits of hand proximity may be due to differential contributions of the action-oriented magnocellular (M) and the perception-oriented parvocellular (P) pathways. Evidence suggests that, relative to the space far from the hands, in near-hand space the contribution of the M pathway increases while the contribution of the P pathway decreases. The present study tested an important consequence of this account for visual representation. Given the P pathway’s role in feeding regions in which visual representations of unified objects (with bound features) are formed, we predicted that hand proximity would reduce feature binding. Consistent with this prediction, two experiments revealed signs of reduced feature binding in the near-hand space, relative to the far-hand space. We propose that the higher contribution of the M pathway, along with the reduced contribution of the P pathway, shifts visual perception away from an object-based perceptual mode toward a feature-based mode. These results are discussed in light of the distinction between action-oriented and perception-oriented vision.     

The closer the better: Hand proximity dynamically affects letter recognition accuracy

A growing literature has suggested that processing of visual information presented near the hands is facilitated. In this study, we investigated whether the near-hands superiority effect also occurs with the hands moving. In two experiments, participants performed a cyclical bimanual movement task requiring concurrent visual identification of briefly presented letters. For both the static and dynamic hand conditions, the results showed improved letter recognition performance with the hands closer to the stimuli. The finding that the encoding advantage for near-hand stimuli also occurred with the hands moving suggests that the effect is regulated in real time, in accordance with the concept of a bimodal neural system that dynamically updates hand position in external space.     

Effects of Expectancy and Attention in Vibrotactile Choice Reaction Time Tasks

The orienting of attention in space has not been considered in the tactile domain. This issue is examined using a modified version of a visual paradigm initially adopted by Posner, Snyder, and Davidson (1980), which manipulates the probability of a stimulus occurring at different spatial locations. Slower RTs at an unexpected stimulus location are thought to reflect the time required to shift attention from the expected to the unexpected location. In two experiments involving vibrotactile choice RT between left and right hands, the two hands were either crossed or uncrossed, and the hands were held both on the left side of the body, both on the right, or one on either side of the midline. There was no evidence to suggest that spatial location (left or right) affected the orienting of attention in the tactual modality. As predicted, RTs were slower when the arms were crossed compared with uncrossed, though this effect was smaller for the expected trials. A coding conflict hypothesis may explain both these findings, but the smaller effect in the expected trials may also reflect attentional factors. Both the relative and absolute location of the hands affected the magnitude of the crossed-arm effect and indicated that attention may play a role in the perceptual division of space into left and right sides. Possible reasons for hand or hemispace asymmetries in different simple and choice RT paradigms were discussed.     

Inhibition of return: A “depth-blind” mechanism?

When attention is oriented to a peripheral visual event, observers respond faster to stimuli presented at a cued location than at an uncued location. Following initial reaction time facilitation responses are slower to stimuli subsequently displayed at the cued location, an effect known as inhibition of return (IOR). Both facilitatory and inhibitory effects have been extensively investigated in two-dimensional space. Facilitation has also been documented in three-dimensional space, however the presence of IOR in 3D space is unclear, possibly because IOR has not been evaluated in an empty 3D space. Determining if IOR is sensitive to the depth plane of stimuli or if only their bi-dimensional location is inhibited may clarify the nature of the IOR. To address this issue, we used an attentional cueing paradigm in three-dimensional (3D) space. Results were obtained from fourteen participants showed IOR components in 3D space when binocular disparity was used to induce depth. We conclude that attentional orienting in depth operates as efficiently as in the bi-dimensional space.     

Switching between global and local scopes of attention is resisted near the hands

Recently, several changes in perception, attention, and visual working memory have been reported when stimuli are near to compared to far from the hands, suggesting that such stimuli receive enhanced scrutiny. A mechanism that inhibits the disengagement of attention from objects near the hands, thus forcing a more thorough inspection, has been proposed to underlie such effects. Up until now, this possibility has been tested only in a limited number of tasks. In the present study we examined whether changes in one's global or local attentional scope are similarly affected by hand proximity. Participants analysed stimuli according to either their global shape or the shape of their constituent local elements while holding their hands near to or far from the stimuli. Switches between global and local processing were markedly slower near the hands, reflecting an attentional mechanism that compels an observer to more fully evaluate objects near their hands by inhibiting changes in attentional scope. Such a mechanism may be responsible for some of the changes observed in other tasks, and reveals the special status conferred to objects near the hands.     

Implied body action directs spatial attention

Research confirms that the body influences perception, but little is known about the embodiment of attention. We investigated whether the implied actions of others direct spatial attention, using a lateralized covert-orienting task with nonpredictive central cues depicting static, right/left-facing bodies poised in midaction. Validity effects (decreased response times for validly compared with invalidly cued trials) indicated orienting in the direction of the implied action. In Experiment 1, we compared action (running, throwing) with nonaction (standing) cues. Only the action cues produced validity effects, suggesting that implied action directs attention. The action cues produced faster responses overall, suggesting that action cues prime motor responses. In Experiment 2, we determined whether action cues shifted attention in a specific direction rather than to a general side of space: Two cues had similar action speed and motor effort but differed in implied direction (jumping, vertical; throwing, horizontal). Validity effects were found only for the throw cues for which the implied motion direction was consistent with lateralized target locations. In Experiment 3, we compared block-like stimuli to the throwing action stimuli to examine whether lower level perceptual information could account for the attention effects alone. Validity effects were found only for the human-action stimuli. Overall, the results suggest that predictive simulations of action shift attention in action-consistent directions.     

Hand position alters vision by biasing processing through different visual pathways

The present study investigated the mechanisms responsible for the difference between visual processing of stimuli near and far from the observer's hands. The idea that objects near the hands are immediate candidates for action led us to hypothesize that vision near the hands would be biased toward the action-oriented magnocellular visual pathway that supports processing with high temporal resolution but low spatial resolution. Conversely, objects away from the hands are not immediate candidates for action and, therefore, would benefit from a bias toward the perception-oriented parvocellular visual pathway that supports processing with high spatial resolution but low temporal resolution. We tested this hypothesis based on the psychophysical characteristics of the two pathways. Namely, we presented subjects with two tasks: a temporal-gap detection task which required the high temporal acuity of the magnocellular pathway and a spatial-gap detection task that required the spatial acuity of the parvocellular pathway. Consistent with our prediction, we found better performance on the temporal-gap detection task and worse performance on the spatial-gap detection task when stimuli were presented near the hands compared to when they were far from the hands. These findings suggest that altered visual processing near the hands may be due to changes in the contribution of the two visual pathways.     

Continuous hand movement induces a far-hand bias in attentional priority

Previous research on the interaction between manual action and visual perception has focused on discrete movements or static postures and discovered better performance near the hands (the near-hand effect). However, in everyday behaviors, the hands are usually moving continuously between possible targets. Therefore, the current study explored the effects of continuous hand motion on the allocation of visual attention. Eleven healthy adults performed a visual discrimination task during cyclical concealed hand movements underneath a display. Both the current hand position and its movement direction systematically contributed to participants’ visual sensitivity. Discrimination performance increased substantially when the hand was distant from but moving toward the visual probe location (a far-hand effect). Implications of this novel observation are discussed.     

Seeing your own touched hands in a mirror modulates cross-modal interactions

In mirror reflections, visual stimuli in near peripersonal space (e.g., an object in the hand) can project the retinal image of far, extrapersonal stimuli "beyond" the mirror. We studied the interaction of such visual reflections with tactile stimuli in a cross-modal congruency task. We found that visual distractors produce stronger interference on tactile judgments when placed close to the stimulated hand, but observed indirectly as distant mirror reflections, than when directly observed in equivalently distant far space, even when in contact with a dummy hand or someone else's hand in the far location. The stronger visual-tactile interference for the mirror condition implies that near stimuli seen as distant reflections in a mirror view of one's own hands can activate neural networks coding peripersonal space, because these visual stimuli are coded as having a true source near to the body.     

The role of spatial attention and other processes on the magnitude and time course of cueing effects

We are quite often exposed to multiple objects present in the visual scene, thus attentional selection is necessary in order to selectively respond to the relevant information. Objects can be selected on the basis of the location they occupy by orienting attention in space. In this paper, we review the evidence showing that attention can be oriented in space either endogenously, on the basis of central cues, predictive of the relevant location, or exogenously, automatically triggered by the salient properties of visual stimuli (peripheral cues). Several dissociations observed between orienting on the basis of the two types of cues have led to the conclusion that they do not represent just two modes of triggering the orienting of the very same attentional mechanism, but rather they modulate processing differently. We present a theoretical framework according to which endogenous predictive cues facilitate target processing by orienting attention, thus amplifying processing at the attended location. In contrast, apart from attentional orienting, peripherally presented discrepant cues might trigger additional cue-target event-integration and event-segregation processes, which modulate processing in a different way, thus leading to cueing effects that are exclusively triggered by peripheral cues.     

Hand proximity—not arm posture—alters vision near the hands

Recent research has revealed remarkable changes in vision and cognition when participants place their hands near the stimuli that they are evaluating. In this paradigm, participants perform a task both with their hands on the sides of the monitor (near) and with their hands on their laps (far). However, that experimental setup has typically confounded hand position with body posture: When participants had their hands near the stimuli, they also always had their hands up around shoulder height. Thus, it is possible that the reported changes “near the hands” are instead artifacts of this posture. In the present study, participants performed a visual search task with their hands near and far from the stimuli. However, in the hands-near condition, participants rested their hands on a table, and in the hands-far condition, they had their arms raised. After eliminating the postural confound, we still found evidence for slower search rates near the hands—replicating earlier results and indicating that the hands’ proximity to the stimuli is truly what affects vision.     

Relevance drives attention: Attentional bias for gain- and loss-related stimuli is driven by delayed disengagement

Attentional bias to gain- and loss-related stimuli was investigated in a dot-probe task. We used coloured stimuli that had acquired their valence during the experiment by signalling the chance to either win or lose points in a game task. Replicating previous findings with the additional singleton paradigm, we found attentional bias effects for both gain- and loss-related colours. The effects were due to delayed disengagement from valent stimuli, especially if they were positive, and could not be explained by nonattentional processes like behavioural freezing. Our findings suggest that stimuli signalling opportunities and dangers hold attention, supporting a general motivational relevance principle of the orienting of attention.     

Enhanced cognitive control near the hands

Recent research has shown that objects near the hands receive preferential visual processing. However, it is not known whether proximity to the hands can affect executive functions. Here we show, using two popular paradigms, that people exhibit enhanced cognitive control for stimuli that are near their hands: We observed reduced interference from incongruent flankers in a visual attention task, and reduced costs when switching to an alternative task in a task-switching paradigm. The results reveal a remarkable influence of posture on cognitive function and have implications for assessing the potential benefits of working on handheld devices.     

Inhibition of return

Immediately following an event at a peripheral location there is facilitation for the processing of other stimuli near that location. This is said to reflect a reflexive shift of attention towards the source of stimulation. After attention is removed from such a peripheral location, there is then delayed responding to stimuli subsequently displayed there. This inhibitory aftereffect, first described in 1984 and later labeled 'inhibition of return (IOR)', encourages orienting towards novel locations and hence might facilitate foraging and other search behaviors. Since its relatively recent discovery, IOR has been the subject of intensive investigation, from many angles and with a wide variety of approaches. After describing the seminal contribution of Posner and Cohen ('Who'), this review will discuss what causes IOR and, once initiated, what effects IOR has on subsequent processing ('What'). The time course ('When') and spatial distribution ('Where') of IOR, and what is known about IOR's neural implementation ('How') and functional significance ('Why') are also discussed.     

The power of the imagination to affect peripersonal space representations

It is known that visual processing is altered for objects near the hands as well as for objects near the imagined position of the hands, indicating that the imagination can be used to remap peri-hand space. Little is known, however, about the physical conditions that allow for this remapping. In the present study, participants in one experiment performed visual searches through displays that were beyond reach while imagining that their hands were near the display. This imagined impossible posture slowed visual search rates, showing that imagination effectively remapped peri-hand space to be near the display. In another experiment, participants searched displays they were holding, but sometimes imagined their hands to be far away. This produced faster search rates, revealing a remapping of peri-hand space away from the monitor. The results provide new insights into the mechanisms involved in the representation of peri-hand space and about the power of imagined actions to influence body representations.