Segmenting the body into parts: Evidence from biases in tactile perception

How do we individuate body parts? Here, we investigated the effect of body segmentation between hand and arm in tactile and visual perception. In a first experiment, we showed that two tactile stimuli felt farther away when they were applied across the wrist than when they were applied within a single body part (palm or forearm), indicating a “category boundary effect”. In the following experiments, we excluded two hypotheses, which attributed tactile segmentation to other, nontactile factors. In Experiment 2, we showed that the boundary effect does not arise from motor cues. The effect was reduced during a motor task involving flexion and extension movements of the wrist joint. Action brings body parts together into functional units, instead of pulling them apart. In Experiments 3 and 4, we showed that the effect does not arise from perceptual cues of visual discontinuities. We did not find any segmentation effect for the visual percept of the body in Experiment 3, nor for a neutral shape in Experiment 4. We suggest that the mental representation of the body is structured in categorical body parts delineated by joints, and that this categorical representation modulates tactile spatial perception.     

Categorical perception of tactile distance

The tactile surface forms a continuous sheet covering the body. And yet, the perceived distance between two touches varies across stimulation sites. Perceived tactile distance is larger when stimuli cross over the wrist, compared to when both fall on either the hand or the forearm. This effect could reflect a categorical distortion of tactile space across body-part boundaries (in which stimuli crossing the wrist boundary are perceptually elongated) or may simply reflect a localised increased in acuity surrounding anatomical landmarks (in which stimuli near the wrist are perceptually elongated). We tested these two interpretations across two experiments, by comparing a well-documented bias to perceive mediolateral tactile distances across the forearm/hand as larger than proximodistal ones along the forearm/hand at three different sites (hand, wrist, and forearm). According to the ‘categorical’ interpretation, tactile distances should be elongated selectively in the proximodistal axis thus reducing the anisotropy. According to the ‘localised acuity’ interpretation, distances will be perceptually elongated in the vicinity of the wrist regardless of orientation, leading to increased overall size without affecting anisotropy. Consistent with the categorical account, we found a reduction in the magnitude of anisotropy at the wrist, with no evidence of a corresponding localised increase in precision. These findings demonstrate that we reference touch to a representation of the body that is categorically segmented into discrete parts, which consequently influences the perception of tactile distance.     

Spatial patterns in tactile perception: is there a tactile field?

Previous studies of tactile spatial perception focussed either on a single point of stimulation, on local patterns within a single skin region such as the fingertip, on tactile motion, or on active touch. It remains unclear whether we should speak of a tactile field, analogous to the visual field, and supporting spatial relations between stimulus locations. Here we investigate this question by studying perception of large-scale tactile spatial patterns on the hand, arm and back. Experiment 1 investigated the relation between perception of tactile patterns and the identification of subsets of those patterns. The results suggest that perception of tactile spatial patterns is based on representing the spatial relations between locations of individual stimuli. Experiment 2 investigated the spatial and temporal organising principles underlying these relations. Experiment 3 showed that tactile pattern perception makes reference to structural representations of the body, such as body parts separated by joints. Experiment 4 found that precision of pattern perception is poorer for tactile patterns that extend across the midline, compared to unilateral patterns. Overall, the results suggest that the human sense of touch involves a tactile field, analogous to the visual field. The tactile field supports computation of spatial relations between individual stimulus locations, and thus underlies tactile pattern perception.     

Part‐based representations of the body in early childhood: evidence from perceived distortions of tactile space across limb boundaries

Studies show that touch in adults is referenced to a representation of the body that is structured topologically according to body parts; the perceived distance between two stimuli crossing over a body part boundary is elongated relative to the perceived distance between two stimuli presented within one body part category. Here we investigate this influence of body parts on tactile space perception in children of 5, 6 and 7 years of age. We presented children with pairs of tactile stimuli on the left hand/arm, either within the hand, within the forearm, or over the wrist. With their eyes closed children were asked to adjust the distance between the thumb and forefinger of their right hand to represent the felt distance between the two tactile stimuli. Like adults, the children perceived the distance between two stimuli that cross the body part boundary to be further apart than those that were presented within the hand or arm. They also perceive tactile distance to be greater on the hand than the arm which is the first observation of Weber's illusion in young children. We propose that a topological mode of body representation is particularly advantageous during early life given that body part categories remain constant while the metric proportions of the body change substantially as the child grows.     

“有声有色”的触觉体验：来自多感觉通道整合的线索

虚拟现实技术通过提供视觉、听觉和触觉等信息为用户创造身临其境的感知体验, 其中触觉反馈面临诸多技术瓶颈使得虚拟现实中的自然交互受限。基于多感官错觉的伪触觉技术可以借助其他通道的信息强化和丰富触觉感受, 是目前虚拟现实环境中优化触觉体验的有效途径。本文聚焦于触觉中最重要的维度之一——粗糙度, 试图为解决虚拟现实中触觉反馈的受限问题提供新思路。探讨了粗糙度感知中, 视、听、触多感觉通道整合的关系, 分析了视觉线索(表面纹理密度、表面光影、控制显示比)和听觉线索(音调/频率、响度)如何影响触觉粗糙度感知, 总结了当下调控这些因素来改变粗糙度感知的方法。最后, 探讨了使用伪触觉反馈技术时, 虚拟现实环境中视、听、触觉信息在呈现效果、感知整合等方面与真实世界相比可能存在的差异, 提出可借鉴的改善触觉体验的适用方法和未来待研究的方向。     

Rôle des propriétés inertielles segmentaires sur la perception de l’étendue de l’espace péripersonnel

Previous studies have suggested that the perception of peripersonal space can hardly be achieved using only scene-based visual cues and requires combining visual information with motor representations. Motor representation can be viewed as a component of a predictive system, which includes a neural process that simulates through motor imagery the dynamic behaviour of the body in relation to the environment. In this study, we analysed whether modifying the force required to reach a visual target influences the perception of what is reachable. In a visuomotor task, the experimental group (n = 10) adapted to a 1.5 kg weight attached to the right wrist while performing a series of pointing movements. The control group (n = 10) performed the motor task without inertial perturbation. A perceptual judgement task of what is reachable was performed before and after the motor task. Results showed that inertial perturbation produced initially an undershoot of the target suggesting a lack of motor force to overcome the inertial perturbation, but spatial errors receded progressively through movement rehearsal. Perceptual estimates of what is reachable slightly overestimated action capacities but were not affected by motor adaptation. Thus, modifying motor force required to compensate for inertial perturbation had no direct effect on the perception of peripersonal space. When interpreted in regard to previous experimental work, this result suggests that motor representations may provide information about the sensory or spatial consequences of action rather than the sense of effort associated with motor production.     

Weber's illusion and body shape: anisotropy of tactile size perception on the hand

The perceived distance between touches on a single skin surface is larger on regions of high tactile sensitivity than those with lower acuity, an effect known as Weber's illusion. This illusion suggests that tactile size perception involves a representation of the perceived size of body parts preserving characteristics of the somatosensory homunculus. Here, we investigated how body shape is coded within this representation by comparing tactile distances presented in different orientations on the hand. Participants judged which of two tactile distances on the dorsum of their left hand felt larger. One distance was aligned with the proximodistal axis (along the hand), the other with the mediolateral axis (across the hand). Across distances were consistently perceived as larger than along ones. A second experiment showed that this effect is specific to the hairy skin of the hand dorsum and does not occur on glabrous skin of the palm. A third experiment demonstrated that this bias reflects orientation on the hand surface, rather than an eye- or torso-centered reference frame. These results mirror known orientational anisotropies of both tactile acuity and of tactile receptive fields (RFs) of cortical neurons. We suggest that the dorsum of the hand is implicitly represented as wider than it actually is and that the shape of tactile RFs may partly explain distortions of mental body representations.     

语言标签和自我关联对新颖客体类别知觉的影响

类别知觉(Categorical perception)是人类最基本的认知活动之一, 探讨语言对类别知觉的影响是心理语言学领域的热门话题之一。在这个研究的3个实验中, 分别在高、低不同的语言标签表征强度下、高、低不同的客体自我关联程度下观察新颖客体类别知觉的过程。研究发现, 语言标签表征程度的增强可促进新颖客体类别知觉的右视野优势效应; 客体与自我关联程度的提高会促进左、右视野的类别知觉效应; 语言标签的表征程度和客体与自我关联程度同时增强时, 语言标签的作用依旧表现出来, 但与自我关联的影响产生权衡分配, 且其影响力并不足以产生右视野优势效应。     

Congruency effects between auditory and tactile motion: Extending the phenomenon of cross-modal dynamic capture

Behavioral studies of multisensory integration in motion perception have focused on the particular case of visual and auditory signals. Here, we addressed a new case: audition and touch. In Experiment 1, we tested the effects of an apparent motion stream presented in an irrelevant modality (audition or touch) on the perception of apparent motion streams in the other modality (touch or audition, respectively). We found significant congruency effects (lower performance when the direction of motion in the irrelevant modality was incongruent with the direction of the target) for the two possible modality combinations. This congruency effect was asymmetrical, with tactile motion distractors having a stronger influence on auditory motion perception than vice versa. In Experiment 2, we used auditory motion targets and tactile motion distractors while participants adopted one of two possible postures: arms uncrossed or arms crossed. The effects of tactile motion on auditory motion judgments were replicated in the arms-uncrossed posture, but they dissipated in the arms-crossed posture. The implications of these results are discussed in light of current findings regarding the representation of tactile and auditory space.     

Lost in the move? Secondary task performance impairs tactile change detection on the body

Change blindness, the surprising inability of people to detect significant changes between consecutively-presented visual displays, has recently been shown to affect tactile perception as well. Visual change blindness has been observed during saccades and eye blinks, conditions under which people’s awareness of visual information is temporarily suppressed. In the present study, we demonstrate change blindness for suprathreshold tactile stimuli resulting from the execution of a secondary task requiring bodily movement. In Experiment 1, the ability of participants to detect changes between two sequentially-presented vibrotactile patterns delivered on their arms and legs was compared while they performed a secondary task consisting of either the execution of a movement with the right arm toward a visual target or the verbal identification of the target side. The results demonstrated that a motor response gave rise to the largest drop in perceptual sensitivity (as measured by changes in d′) in detecting changes to the tactile display. In Experiment 2, we replicated these results under conditions in which the participants had to detect tactile changes while turning a steering wheel instead. These findings are discussed in terms of the role played by bodily movements, sensory suppression, and higher order information processing in modulating people’s awareness of tactile information across the body surface.     

Color term knowledge does not affect categorical perception of color in toddlers

Categorical perception of color is shown when colors from the same category are discriminated less easily than equivalently spaced colors that cross a category boundary. The current experiments tested various models of categorical perception. Experiment 1 tested for categorical responding in 2- to 4-year-olds, the age range for the onset establishment of color term knowledge. Experiment 2 tested for categorical responding in Himba toddlers, whose language segments the color space differently from the way in which the English language does so. Experiment 3 manipulated the conditions of the task to explore whether the categorical responding in Experiments 1 and 2 was equivalent to categorical perception. Categorical perception was shown irrespective of naming and was not stronger in those children with more developed color term knowledge. Cross-cultural differences in the extent of categorical perception were not found. These findings support universalistic models of color categorization and suggest that color term knowledge does not modify categorical perception, at least during the early stages of childhood.     

Use of visual information in speech perception: evidence for a visual rate effect both with and without a McGurk effect

The McGurk effect, where an incongruent visual syllable influences identification of an auditory syllable, does not always occur, suggesting that perceivers sometimes fail to use relevant visual phonetic information. We tested whether another visual phonetic effect, which involves the influence of visual speaking rate on perceived voicing (Green & Miller, 1985), would occur in instances when the McGurk effect does not. In Experiment 1, we established this visual rate effect using auditory and visual stimuli matching in place of articulation, finding a shift in the voicing boundary along an auditory voice-onset-time continuum with fast versus slow visual speech tokens. In Experiment 2, we used auditory and visual stimuli differing in place of articulation and found a shift in the voicing boundary due to visual rate when the McGurk effect occurred and, more critically, when it did not. The latter finding indicates that phonetically relevant visual information is used in speech perception even when the McGurk effect does not occur, suggesting that the incidence of the McGurk effect underestimates the extent of audio-visual integration.     

Observing or producing a motor action improves later perception of biological motion: Evidence for a gender effect

Two experiments are presented addressing the issue of whether observing (visual priming) or producing (motor priming) a running activity during a very short period (30 s) facilitates the perception of the direction of a point-light runner embedded in a dense dynamical mask. Experiment 1 showed that perceptual judgements improved and response time increased in the visual priming compared to the neutral priming condition (video of a moving car) in which judgements were at random. Because this effect was observed for male participants only, we performed a second experiment with the aim of evaluating the role of gender congruency in the visual priming condition. Results confirmed the facilitation effect and demonstrated that this effect was strictly dependent on the gender congruency between the perceiver and the priming information. Moreover, we found that actually producing a motor activity similar to the one presented in the video sequence improved to the same extent participants’ judgement of the direction of the point-light runner, without any gender effect. As a whole, these findings argue in favour of common representation for the perception and the production of human movement and showed that the perception of biological motion can be improved by prior motor activity either performed or observed. However, the gender-dependent effect of visual priming suggested that motor repertoire differed in males and females.     

Perceptual and categorical judgements of colour similarity

Consideration is given to the tasks that make judgements of colour similarity based on perceptual similarity rather than categorical similarity. Irrespective of whether colour categories are taken to be universal (Berlin & Kay, 1969) or language induced (Davidoff, Davies, & Roberson, 1999), it is widely assumed that colour boundaries, and hence categorical similarity, would be used when categorising colours. However, we argue that categorical similarity is more reliably used in implicit than in explicit categorisation. Thus, in Experiment 1, we found that category boundaries may be overridden in the explicit task of matching-to-sample: There was a similar strong tendency to ignore colour boundaries and to divide the range of coloured stimuli into two equal groups in both Westerners and in a remote population (Himba). In Experiment 2, we showed that a distinctive stimulus (focal colour) in the range affected the equal division in a matching-to-sample task. Experiment 3 tested the stability of a category boundary in an implicit task (visual search) that assessed categorical perception; only for this task was categorisation largely immune to range effects and largely based on categorical similarity. It is concluded that, even after colour categories are acquired, perceptual rather than categorical similarity is commonly used in judgements of colour similarity.     

Crossmodal interactions in the perception of expressivity in musical performance

In musical performance, bodily gestures play an important role in communicating expressive intentions to audiences. Although previous studies have demonstrated that visual information can have an effect on the perceived expressivity of musical performances, the investigation of audiovisual interactions has been held back by the technical difficulties associated with the generation of controlled, mismatching stimuli. With the present study, we aimed to address this issue by utilizing a novel method in order to generate controlled, balanced stimuli that comprised both matching and mismatching bimodal combinations of different expressive intentions. The aim of Experiment 1 was to investigate the relative contributions of auditory and visual kinematic cues in the perceived expressivity of piano performances, and in Experiment 2 we explored possible crossmodal interactions in the perception of auditory and visual expressivity. The results revealed that although both auditory and visual kinematic cues contribute significantly to the perception of overall expressivity, the effect of visual kinematic cues appears to be somewhat stronger. These results also provide preliminary evidence of crossmodal interactions in the perception of auditory and visual expressivity. In certain performance conditions, visual cues had an effect on the ratings of auditory expressivity, and auditory cues had a small effect on the ratings of visual expressivity.     

Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision

Three experiments investigated cross-modal links between touch, audition, and vision in the control of covert exogenous orienting. In the first two experiments, participants made speeded discrimination responses (continuous vs. pulsed) for tactile targets presented randomly to the index finger of either hand. Targets were preceded at a variable stimulus onset asynchrony (150,200, or 300 msec) by a spatially uninformative cue that was either auditory (Experiment 1) or visual (Experiment 2) on the same or opposite side as the tactile target. Tactile discriminations were more rapid and accurate when cue and target occurred on the same side, revealing cross-modal covert orienting. In Experiment 3, spatially uninformative tactile cues were presented prior to randomly intermingled auditory and visual targets requiring an elevation discrimination response (up vs. down). Responses were significantly faster for targets in both modalities when presented ipsilateral to the tactile cue. These findings demonstrate that the peripheral presentation of spatially uninforrnative auditory and visual cues produces cross-modal orienting that affects touch, and that tactile cues can also produce cross-modal covert orienting that affects audition and vision.     

Embodied representation of the body contains veridical spatial information

In two experiments, the extent to which mental body representations contain spatial information was examined. Participants were asked to compare distances between various body parts. Similar to what happens when people compare distances on a real visual stimulus, they were faster as the distance differences between body parts became larger (Experiment 1), and this effect could not (only) be explained by the crossing of major bodily categories (umbilicus to knee vs. knee to ankle; Experiment 2). In addition, participants also performed simple animate/inanimate verification on a set of nouns. The nouns describing animate items were names of body parts. A spatial priming effect was found: Verification was faster for body part items preceded by body parts in close spatial proximity. This suggests automatic activation of spatial body information. Taken together, results from the distance comparison task and the property verification task showed that mental body representations contain both categorical and more metric spatial information. These findings are further discussed in terms of recent embodied cognition theories.     

Embodied representation of the body contains veridical spatial information

In two experiments, the extent to which mental body representations contain spatial information was examined. Participants were asked to compare distances between various body parts. Similar to what happens when people compare distances on a real visual stimulus, they were faster as the distance differences between body parts became larger (Experiment 1), and this effect could not (only) be explained by the crossing of major bodily categories (umbilicus to knee vs. knee to ankle; Experiment 2). In addition, participants also performed simple animate/inanimate verification on a set of nouns. The nouns describing animate items were names of body parts. A spatial priming effect was found: Verification was faster for body part items preceded by body parts in close spatial proximity. This suggests automatic activation of spatial body information. Taken together, results from the distance comparison task and the property verification task showed that mental body representations contain both categorical and more metric spatial information. These findings are further discussed in terms of recent embodied cognition theories.     

Visual body-size adaptation and estimation of tactile distance

Estimating the size of bodies is crucial for interactions with physical and social environments. Body-size perception is malleable and can be altered using visual adaptation paradigms. However, it is unclear whether such visual adaptation effects also transfer to other modalities and influence, for example, the perception of tactile distances. In this study, we employed a visual adaptation paradigm. Participants were exposed to images of expanded or contracted versions of self- or other-identity bodies. Before and after this adaptation, they were asked to manipulate the width of body stimuli to appear as ‘normal’ as possible. We replicated an effect of visual adaptation such that the body-size selected as most ‘normal’ was larger after exposure to expanded and thinner after exposure to contracted adaptation stimuli. In contrast, we did not find evidence that this adaptation effect transfers to distance estimates for paired tactile stimuli delivered to the abdomen. A Bayesian analysis showed that our data provide moderate evidence that there is no effect of visual body-size adaptation on the estimation of spatial parameters in a tactile task. This suggests that visual body-size adaptation effects do not transfer to somatosensory body-size representations.     

Somatosensory prior entry assessed with temporal order judgments and simultaneity judgments

Attention is central to perception, yet a clear understanding of how attention influences the latency of perception has proven surprisingly elusive. Recent research has indicated that spatially attended stimuli are perceived earlier than unattended stimuli across a range of sensory modalities-an effect termed prior entry. However, the method commonly used to measure this, the temporal order judgment (TOJ) task, has been criticized as susceptible to response bias, despite deliberate attempts to minimize such bias. A preferred alternative is the simultaneity judgment (SJ) task. We tested the prior-entry hypothesis for somatosensory stimuli using both a TOJ task (replicating an earlier experiment) and an SJ task. Prior-entry effects were found for both, though the effect was reduced in the SJ task. Additional experiments (TOJ and SJ) using visual cues established that the earlier perception of cued tactile targets does not result from intramodal sensory interactions between tactile cues and targets.