Hand position alters vision by biasing processing through different visual pathways

The present study investigated the mechanisms responsible for the difference between visual processing of stimuli near and far from the observer's hands. The idea that objects near the hands are immediate candidates for action led us to hypothesize that vision near the hands would be biased toward the action-oriented magnocellular visual pathway that supports processing with high temporal resolution but low spatial resolution. Conversely, objects away from the hands are not immediate candidates for action and, therefore, would benefit from a bias toward the perception-oriented parvocellular visual pathway that supports processing with high spatial resolution but low temporal resolution. We tested this hypothesis based on the psychophysical characteristics of the two pathways. Namely, we presented subjects with two tasks: a temporal-gap detection task which required the high temporal acuity of the magnocellular pathway and a spatial-gap detection task that required the spatial acuity of the parvocellular pathway. Consistent with our prediction, we found better performance on the temporal-gap detection task and worse performance on the spatial-gap detection task when stimuli were presented near the hands compared to when they were far from the hands. These findings suggest that altered visual processing near the hands may be due to changes in the contribution of the two visual pathways.     

Differential effect of one versus two hands on visual processing

Hand position in the visual field influences performance in several visual tasks. Recent theoretical accounts have proposed that hand position either (a) influences the allocation of spatial attention, or (b) biases processing toward the magnocellular visual pathway. Comparing these accounts is difficult as some studies manipulate the distance of one hand in the visual field while others vary the distance of both hands, and it is unclear whether single and dual hand manipulations have the same impact on perception. We ask if hand position affects the spatial distribution of attention, with a broader distribution of attention when both hands are near a visual display and a narrower distribution when one hand is near a display. We examined the effects of four hand positions near the screen (left hand, right hand, both hands, no hands) on both temporal and spatial discrimination tasks. Placing two hands near the display compared to two hands distant resulted in improved sensitivity for the temporal task and reduced sensitivity in the spatial task, replicating previous results. However, the single hand manipulations showed the opposite pattern of results. Together these results suggest that visual attention is focused on the graspable space for a single hand, and expanded when two hands frame an area of the visual field.     

手近效应：研究内容、影响因素与神经机制

把手放在刺激旁边,会对知觉、记忆、语义和执行控制等认知加工产生影响,这类现象被称为手近效应。手近效应反映了身体与环境的互动对认知的塑造作用,为具身认知提供了新证据。本文从手近效应的内容,影响因素,及其认知、神经机制等方面对相关研究进行梳理。并从手近效应的神经机制,应用研究,以及动作意图和人际社会因素的调节作用等方面探讨当前手近效应还未解决的问题。     

When meaning matters,look but don’t touch: The effects of posture on reading

Much of the reading that we do occurs near our hands. Previous research has revealed that spatial processing is enhanced near the hands, potentially benefiting several processes involved in reading; however, it is unknown whether semantic processing—another critical aspect of reading—is affected near the hands. While holding their hands either near to or far from a visual display, our subjects performed two tasks that drew on semantic processing: evaluation of the sensibleness of sentences, and the Stroop color-word interference task. We found evidence for impoverished semantic processing near the hands in both tasks. These results suggest a trade-off between spatial processing and semantic processing for the visual space around the hands. Readers are encouraged to be aware of this trade-off when choosing how to read a text, since both kinds of processing can be beneficial for reading.     

Hand proximity—not arm posture—alters vision near the hands

Recent research has revealed remarkable changes in vision and cognition when participants place their hands near the stimuli that they are evaluating. In this paradigm, participants perform a task both with their hands on the sides of the monitor (near) and with their hands on their laps (far). However, that experimental setup has typically confounded hand position with body posture: When participants had their hands near the stimuli, they also always had their hands up around shoulder height. Thus, it is possible that the reported changes “near the hands” are instead artifacts of this posture. In the present study, participants performed a visual search task with their hands near and far from the stimuli. However, in the hands-near condition, participants rested their hands on a table, and in the hands-far condition, they had their arms raised. After eliminating the postural confound, we still found evidence for slower search rates near the hands—replicating earlier results and indicating that the hands’ proximity to the stimuli is truly what affects vision.     

The closer the better: Hand proximity dynamically affects letter recognition accuracy

A growing literature has suggested that processing of visual information presented near the hands is facilitated. In this study, we investigated whether the near-hands superiority effect also occurs with the hands moving. In two experiments, participants performed a cyclical bimanual movement task requiring concurrent visual identification of briefly presented letters. For both the static and dynamic hand conditions, the results showed improved letter recognition performance with the hands closer to the stimuli. The finding that the encoding advantage for near-hand stimuli also occurred with the hands moving suggests that the effect is regulated in real time, in accordance with the concept of a bimodal neural system that dynamically updates hand position in external space.     

The nature of altered vision near the hands: Evidence for the magnocellular enhancement account from object correspondence through occlusion

A growing body of evidence indicates that the perception of visual stimuli is altered when they occur near the observer’s hands, relative to other locations in space (see Brockmole, Davoli, Abrams, & Witt, 2013, for a review). Several accounts have been offered to explain the pattern of performance across different tasks. These have typically focused on attentional explanations (attentional prioritization and detailed attentional evaluation of stimuli in near-hand space), but more recently, it has been suggested that near-hand space enjoys enhanced magnocellular (M) input. Here we differentiate between the attentional and M-cell accounts, via a task that probes the roles of position consistency and color consistency in determining dynamic object correspondence through occlusion. We found that placing the hands near the visual display made observers use only position consistency, and not color, in determining object correspondence through occlusion, which is consistent with the fact that M cells are relatively insensitive to color. In contrast, placing observers’ hands far from the stimuli allowed both color and position contribute. This provides evidence in favor of the M-cell enhancement account of altered vision near the hands.     

Relation between cognitive and motor-oriented systems of visual position perception

Although subjects failed to detect a target displacement if it occurred near the time of a saccadic eye movement (a cognitive visual task), they were still able to point to the center of the target with an unseen pointer (a motor visual task). Pointing performance was not affected by detecting or failing to detect a stimulus displacement. The experiments demonstrate that some information that is available to a motor-oriented visual system is unavailable to the cognitive visual system, under conditions simulating normal perception.     

Continuous hand movement induces a far-hand bias in attentional priority

Previous research on the interaction between manual action and visual perception has focused on discrete movements or static postures and discovered better performance near the hands (the near-hand effect). However, in everyday behaviors, the hands are usually moving continuously between possible targets. Therefore, the current study explored the effects of continuous hand motion on the allocation of visual attention. Eleven healthy adults performed a visual discrimination task during cyclical concealed hand movements underneath a display. Both the current hand position and its movement direction systematically contributed to participants’ visual sensitivity. Discrimination performance increased substantially when the hand was distant from but moving toward the visual probe location (a far-hand effect). Implications of this novel observation are discussed.     

Seeing your own touched hands in a mirror modulates cross-modal interactions

In mirror reflections, visual stimuli in near peripersonal space (e.g., an object in the hand) can project the retinal image of far, extrapersonal stimuli "beyond" the mirror. We studied the interaction of such visual reflections with tactile stimuli in a cross-modal congruency task. We found that visual distractors produce stronger interference on tactile judgments when placed close to the stimulated hand, but observed indirectly as distant mirror reflections, than when directly observed in equivalently distant far space, even when in contact with a dummy hand or someone else's hand in the far location. The stronger visual-tactile interference for the mirror condition implies that near stimuli seen as distant reflections in a mirror view of one's own hands can activate neural networks coding peripersonal space, because these visual stimuli are coded as having a true source near to the body.     

Raised visual detection thresholds depend on the level of complexity of cognitive foveal loading.

The objective of the study was to measure the interactions between visual thresholds for a simple light (the secondary task) presented peripherally and a simultaneously performed cognitive task (the primary task) presented foveally The primary task was highly visible but varied according to its cognitive complexity. Interactions between the tasks were determined by measuring detection thresholds for the peripheral task and accuracy of performance of the foveal task. Effects were measured for 5, 10, 20, and 30 deg eccentricity of the peripherally presented light and for three levels of cognitive complexity. Mesopic conditions (0.5 lx) were used. As expected, the concurrent presentation of the foveal cognitive task reduced peripheral sensitivity. Moreover, performance of the foveal task was adversely affected when conducting the peripheral task. Performance on both tasks was reduced as the level of complexity of the cognitive task increased. There were qualitative differences in task interactions between the central 10 deg and at greater eccentricities. Within 10 deg there was a disproportionate effect of eccentricity, previously interpreted as the 'tunnel-vision' model of visual field narrowing. Interactions outside 10 deg were less affected by eccentricity. These results are discussed in terms of the known neurophysiological characteristics of the primary visual pathway.     

Touching for knowing in infancy: The development of manual abilities in very young infants

This aim of this paper was twofold: (1) to display the various competencies of the infant's hands for processing information about the shape of objects; and (2) to show that the infant's haptic mode shares some common mechanisms with the visual mode. Several experiments on infants from birth and up to five months of age using a habituation/dishabituation procedure, intermodal transfer task between touch and vision, and various cognitive tasks revealed that infants may perceive and understand the physical world through their hands without visual control. From birth, infants can habituate to shape and detect discrepancies between shapes. But information exchanges between vision and touch are partial in cross-modal transfer tasks. Plausibly, modal specificities such as discrepancies in information gathering between the two modalities and the different functions of the hands (perceptual and instrumental) limit the links between the visual and haptic modes. In contrast, when infants abstract information from an event not totally felt or seen, amodal mechanisms underlie haptic and visual knowledge in early infancy. Despite various discrepancies between the sensory modes, conceiving the world is possible with hands as with eyes.     

Altered vision near the hands

The present study explored the manner in which hand position may affect visual processing. We studied three classic visual attention tasks (visual search, inhibition of return, and attentional blink) during which the participants held their hands either near the stimulus display, or far from the display. Remarkably, the hands altered visual processing: people shifted their attention between items more slowly when their hands were near the display. The same results were observed for both visible and invisible hands. This enhancement in vision for objects near the hands reveals a mechanism that could facilitate the detailed evaluation of objects for potential manipulation, or the assessment of potentially dangerous objects for a defensive response.     

Near-hand effects are robust: Three OSF pre-registered replications of visual biases in perihand space

ABSTRACT

Although previous work provides evidence that observers experience biases in visual processing when they view stimuli in perihand space, a few recent investigations have questioned the reliability of these near-hand effects. We addressed this controversy by running three pre-registered replication experiments. Experiment 1 was a replication of one of the initial studies on facilitated target detection near the hands in which participants performed an attentional cueing task while placing a single hand either near or far from the display. Experiment 2 tested the same paradigm while adopting the design of a recent experiment that called into question near-hand facilitation. Experiment 3 was a replication of a study in which hand proximity influenced working memory performance in a change detection paradigm. Across all three experiments, we found significant interactions between hand position and stimulus characteristics that indicated the hands’ presence altered visual processing, bolstering evidence favouring the robustness of near-hand effects.     

A bias to detail: how hand position modulates visual learning and visual memory

In this report, we examine whether and how altered aspects of perception and attention near the hands affect one’s learning of to-be-remembered visual material. We employed the contextual cuing paradigm of visual learning in two experiments. Participants searched for a target embedded within images of fractals and other complex geometrical patterns while either holding their hands near to or far from the stimuli. When visual features and structural patterns remained constant across to-be-learned images (Exp. 1), no difference emerged between hand postures in the observed rates of learning. However, when to-be-learned scenes maintained structural pattern information but changed in color (Exp. 2), participants exhibited substantially slower rates of learning when holding their hands near the material. This finding shows that learning near the hands is impaired in situations in which common information must be abstracted from visually unique images, suggesting a bias toward detail-oriented processing near the hands.     

What clocks tell us about the neural correlates of spatial imagery

We review a series of experimental studies aimed at answering some critical questions about the neural basis of spatial imagery. Our group used functional magnetic resonance imaging (fMRI) to explore the neural correlates of an online behaviourally controlled spatial imagery task without need for visual presentation—the mental clock task. Subjects are asked to imagine pairs of times that are presented acoustically and to judge at which of the two times the clock hands form the greater angle. The cortical activation elicited by this task was contrasted with that obtained during other visual, perceptual, verbal, and spatial imagery tasks in several block design studies. Moreover, our group performed an event‐related fMRI study on the clock task to investigate the representation of component cognitive processes in spatial imagery. The bulk of our findings demonstrates that cortical areas in the posterior parietal cortex (PPC), along the intraparietal sulcus, are robustly involved in spatial mental imagery and in other tasks requiring spatial transformations. PPC is bilaterally involved in different kinds of spatial judgement. Yet the degree to which right and left PPC are activated in different tasks is a function of task requirements. From event‐related fMRI data we obtained evidence that left and right PPC are activated asynchronously during the clock task and this could reflect their different functional role in subserving cognitive components of visuospatial imagery.     

The hands shield attention from visual interference

Recent investigations have revealed enhanced processing of information that is presented within hand space. A potential consequence of such enhancement could be that simultaneous processing of information outside of hand space is diminished, but this possibility has yet to be tested. Here, we considered the possibility that the hands can serve as a natural remedy for unwanted interference, by acting as a physical manifestation of the attentional window. Participants performed a flanker task in which they identified a central target letter in the presence of flanking letters that varied in their degrees of compatibility with the target. Participants either held their hands around the target, such that the flankers appeared outside of the hands (but in clear view), or held their hands away from the display, and thus not around any of the stimuli. Flanker interference was markedly reduced when the hands were around the target, and these effects were not attributable to visual differences across the conditions. Collectively, these results indicate that the hands effectively shield attention from visual interference.     

Working memory load and distraction: dissociable effects of visual maintenance and cognitive control

We establish a new dissociation between the roles of working memory (WM) cognitive control and visual maintenance in selective attention as measured by the efficiency of distractor rejection. The extent to which focused selective attention can prevent distraction has been shown to critically depend on the level and type of load involved in the task. High perceptual load that consumes perceptual capacity leads to reduced distractor processing, whereas high WM load that reduces WM ability to exert priority-based executive cognitive control over the task results in increased distractor processing (e.g., Lavie, Trends in Cognitive Sciences, 9(2), 75–82, 2005). WM also serves to maintain task-relevant visual representations, and such visual maintenance is known to recruit the same sensory cortices as those involved in perception (e.g., Pasternak & Greenlee, Nature Reviews Neuroscience, 6(2), 97–107, 2005). These findings led us to hypothesize that loading WM with visual maintenance would reduce visual capacity involved in perception, thus resulting in reduced distractor processing—similar to perceptual load and opposite to WM cognitive control load. Distractor processing was assessed in a response competition task, presented during the memory interval (or during encoding; Experiment 1a) of a WM task. Loading visual maintenance or encoding by increased set size for a memory sample of shapes, colors, and locations led to reduced distractor response competition effects. In contrast, loading WM cognitive control with verbal rehearsal of a random letter set led to increased distractor effects. These findings confirm load theory predictions and provide a novel functional distinction between the roles of WM maintenance and cognitive control in selective attention.     

Interference in visual perception by verbal and spatial cognitive activity

In two experiments we tested the hypothesis that cognitive processing based on spatial imagery produces more deterioration of visual perception than cognitive processing based on verbal codes. So, we studied the effect on visual perception of two cognitive tasks, one of spatial imagery and the other a verbal task. In the first one, with 30 participants, we analyzed the mental load and ocular behaviors in both cognitive tasks. In the second experiment, with 29 participants, we studied the effect of both tasks on a visual search task, using a dual-task experimental paradigm. The verbal task presented higher mental load than the imagery task when both tasks were carried out with visual search task, and there was more deterioration in stimulus detection with the verbal task. We can conclude that: (1) cognitive tasks produce important deterioration in the capacities of visual search and identification of stimuli; (2) this deterioration has two components: (a) an inefficient search, associated with alterations of the gaze patterns while performing cognitive tasks, and (b) a general interference, nonspecific to spatial codes, in the process of identification of looked-at stimuli; (3) this cognitive interference is related to the mental load or effort required by the cognitive task.     

Asynchrony in discrete bimanual aiming: Evidence for visual strategies of coordination

The bimanual coupling literature supposes an inherent drive for synchrony between the upper limbs when making discrete bimanual movements. The level of synchrony is argued to be task dependent, reliant on the visual demands of the two targets, and the result of a complex pattern of hand and eye movements (Bingham, Hughes, & Mon-Williams, 2008 ; Riek, Tresilian, Mon-Williams, Coppard, & Carson, 2003 ). However, recent work by Bruyn and Mason ( 2009 ) suggests that temporal coordination is not solely influenced by visual saccades. In this experimental series, a total of 8 participants performed congruent movements to targets either near or far from the midline. Targets far from the midline, requiring a visual saccade, resulted in greater terminal asynchrony. Initial and terminal asynchrony were not consistent, but linked to the task demands at that stage of the movement. If the asynchrony evident at the end of a bimanual movement is due to a complex pattern of hand and eye movements then the removal of visual feedback should result in an increase in synchrony. Sixteen participants then completed congruent and incongruent bimanual aiming movements to near and/or far targets. Movements were made with or without visual feedback of hands and targets. Analyses revealed that movements made without visual feedback showed increased synchrony between the limbs, yet movements to incongruent targets still showed greater asynchrony. We suggest that visual constraints are not the sole cause of asynchrony in discrete bimanual movements.