Temporal perception is enhanced for goal-directed biological actions

ABSTRACT

Research into the visual perception of goal-directed human action indicates that human action perception makes use of specialized processing systems, similar to those that operate in visual expertise. Against this background, the current research investigated whether perception of temporal information in goal-directed human action is enhanced relative to similar motion stimuli. Experiment 1 compared observers’ sensitivity to speed changes in upright human action to a kinematic control (an animation yoked to the motion of the human hand), and also to inverted human action. Experiment 2 compared human action to a non-human motion control (a tool moved the object). In both experiments observers’ sensitivity to detecting the speed changes was higher for the human stimuli relative to the control stimuli, and inversion in Experiment 1 did not alter observers’ sensitivity. Experiment 3 compared observers’ sensitivity to speed changes in goal-directed human and dog actions, in order to determine if enhanced temporal perception is unique to human actions. Results revealed no difference between human and dog stimuli, indicating that enhanced speed perception may exist for any biological motion. Results are discussed with reference to theories of biological motion perception and perception in visual expertise.     

Peak velocity as a cue in audiovisual synchrony perception of rhythmic stimuli

This study investigated audiovisual synchrony perception in a rhythmic context, where the sound was not consequent upon the observed movement. Participants judged synchrony between a bouncing point-light figure and an auditory rhythm in two experiments. Two questions were of interest: (1) whether the reference in the visual movement, with which the auditory beat should coincide, relies on a position or a velocity cue; (2) whether the figure form and motion profile affect synchrony perception. Experiment 1 required synchrony judgment with regard to the same (lowest) position of the movement in four visual conditions: two figure forms (human or non-human) combined with two motion profiles (human or ball trajectory). Whereas figure form did not affect synchrony perception, the point of subjective simultaneity differed between the two motions, suggesting that participants adopted the peak velocity in each downward trajectory as their visual reference. Experiment 2 further demonstrated that, when judgment was required with regard to the highest position, the maximal synchrony response was considerably low for ball motion, which lacked a peak velocity in the upward trajectory. The finding of peak velocity as a cue parallels results of visuomotor synchronization tasks employing biological stimuli, suggesting that synchrony judgment with rhythmic motions relies on the perceived visual beat.     

Audiovisual influences on the perception of visual apparent motion: exploring the effect of a single sound

Previous research has shown that irrelevant sounds can facilitate the perception of visual apparent motion. Here the effectiveness of a single sound to facilitate motion perception was investigated in three experiments. Observers were presented with two discrete lights temporally separated by stimulus onset asynchronies from 0 to 350 ms. After each trial, observers classified their impression of the stimuli using a categorisation system. A short sound presented temporally (and spatially) midway between the lights facilitated the impression of motion relative to baseline (lights without sound), whereas a sound presented either before the first or after the second light or simultaneously with the lights did not affect motion impression. The facilitation effect also occurred with sound presented far from the visual display, as well as with continuous-sound that was started with the first light and terminated with the second light. No facilitation of visual motion perception occurred if the sound was part of a tone sequence that allowed for intramodal perceptual grouping of the auditory stimuli prior to the critical audiovisual stimuli. Taken together, the findings are consistent with a low-level audiovisual integration approach in which the perceptual system merges temporally proximate sound and light stimuli, thereby provoking the impression of a single multimodal moving object.     

The effect of brief auditory stimuli on visual apparent motion

When two discrete stimuli are presented in rapid succession, observers typically report a movement of the lead stimulus toward the lag stimulus. The object of this study was to investigate crossmodal effects of irrelevant sounds on this illusion of visual apparent motion. Observers were presented with two visual stimuli that were temporally separated by interstimulus onset intervals from 0 to 350 ms. After each trial, observers classified their impression of the stimuli using a categorisation system. The presentation of short sounds intervening between the visual stimuli facilitated the impression of apparent motion relative to baseline (visual stimuli without sounds), whereas sounds presented before the first and after the second visual stimulus as well as simultaneously presented sounds reduced the motion impression. The results demonstrate an effect of the temporal structure of irrelevant sounds on visual apparent motion that is discussed in light of a related multisensory phenomenon, 'temporal ventriloquism', on the assumption that sounds can attract lights in the temporal dimension.     

Apparent motion enhances visual rhythm discrimination in infancy

Many studies have demonstrated that infants exhibit robust auditory rhythm discrimination, but research on infants' perception of visual rhythm is limited. In particular, the role of motion in infants' perception of visual rhythm remains unknown, despite the prevalence of motion cues in naturally occurring visual rhythms. In the present study, we examined the role of motion in 7-month-old infants' discrimination of visual rhythms by comparing experimental conditions with apparent motion in the stimuli versus stationary rhythmic stimuli. Infants succeeded at discriminating visual rhythms only when the visual rhythm occurred with an apparent motion component. These results support the view that motion plays a role in infants' perception of visual temporal information, consistent with the manner in which natural rhythms appear in the visual world.     

Auditory and visual attention-based apparent motion share functional parallels

A perception of coherent motion can be obtained in an otherwise ambiguous or illusory visual display by directing one's attention to a feature and tracking it. We demonstrate an analogous auditory effect in two separate sets of experiments. The temporal dynamics associated with the attention-dependent auditory motion closely matched those previously reported for attention-based visual motion. Since attention-based motion mechanisms appear to exist in both modalities, we also tested for multimodal (audiovisual) attention-based motion, using stimuli composed of interleaved visual and auditory cues. Although subjects were able to track a trajectory using cues from both modalities, no one spontaneously perceived "multimodal motion" across both visual and auditory cues. Rather, they reported motion perception only within each modality, thereby revealing a spatiotemporal limit on putative cross-modal motion integration. Together, results from these experiments demonstrate the existence of attention-based motion in audition, extending current theories of attention-based mechanisms from visual to auditory systems.     

Duration discrimination in the context of age,sex, and cognition

It has been proposed that the perception of very short duration is governed by sensory mechanisms, whereas the perception of longer duration depends on cognitive capacities. Four duration discrimination tasks (modalities: visual, auditory; base duration: 100 ms, 1000 ms) were used to study the relation between time perception, age, sex, and cognitive abilities (alertness, visual and verbal working memory, general fluid reasoning) in 100 subjects aged between 21 and 84 years. Temporal acuity was higher (Weber fractions are lower) for longer stimuli and for the auditory modality. Age was related to the visual 100 ms condition only, with lower temporal acuity in elder participants. Alertness was significantly related to auditory and visual Weber fractions for shorter stimuli only. Additionally, visual working memory was a significant predictor for shorter visual stimuli. These results indicate that alertness, but also working memory, are associated with temporal discrimination of very brief duration.     

On the relation between time and space in the visual discrimination of velocity.

Is the perception of velocity determined by the prior discrimination of spatial and temporal distances? Two experiments sought to answer this question by comparing the discriminabilities of moving stimuli varied in spatial extent, temporal duration, or in redundant combinations of both variables. The subject's task was to identify which of two alternative stimuli was presented on each trial. A set of four stimuli was constructed from two values of spatial extent and two values of temporal duration. Separate conditions required discrimination of each of the six possible pairs of these stimuli. Experiment 1 examined continuous motion and Experiment 2 examined apparent motion for stimuli with short (50 versus 65 msec) and with long (500 versus 650 msec) interstimulus intervals. With continuous motion and with good apparent motion (short intervals), the discrimination between the different-velocity bivariate pairs was too accurate to be attributed only to discriminations of the spatial and temporal extents of the motion. This did not occur with poor apparent motion. Evidently, time and space are perceptually related.     

判断框架对时序知觉位置启动效应的影响

研究采用包含两种判断框架（判断刺激出现的先后次序）的时序判断任务探讨了决策偏向对时序知觉位置启动效应的影响。实验结果表明,时序知觉中存在着位置启动效应,而且在两个靶刺激出现时间间隔不同时,被试在“哪个靶刺激先出现”和“哪个靶刺激后出现”两种判断框架下的正确率存在显著差异,但在两个靶刺激同时出现时并没有出现显著的判断框架效应。因此,本研究推测时序知觉位置启动效应的作用机制不仅包括知觉增强加工过程,而且也与认知决策有关,这为反应偏向理论提供了新的支持证据。     

The dynamics of the visual system in combining conflicting KDE and binocular stereopsis cues

The dynamics of the visual system in combining multiple depth cues were investigated by measuring the temporal change in the perceived 3-D shape of a random-dot stimulus with conflicting kinetic depth effect (KDE) and binocular stereopsis cues. The KDE shape perception dominated for the first few seconds, and then was gradually supplanted by the stereo shape perception. The effects of various pre-adaptation stimuli suggested that the temporal change in the perceived shape resulted from a self-adaptation of the KDE mechanism that occurs mainly at the levels of motion and relative motion detection.     

Spatial patterns in tactile perception: is there a tactile field?

Previous studies of tactile spatial perception focussed either on a single point of stimulation, on local patterns within a single skin region such as the fingertip, on tactile motion, or on active touch. It remains unclear whether we should speak of a tactile field, analogous to the visual field, and supporting spatial relations between stimulus locations. Here we investigate this question by studying perception of large-scale tactile spatial patterns on the hand, arm and back. Experiment 1 investigated the relation between perception of tactile patterns and the identification of subsets of those patterns. The results suggest that perception of tactile spatial patterns is based on representing the spatial relations between locations of individual stimuli. Experiment 2 investigated the spatial and temporal organising principles underlying these relations. Experiment 3 showed that tactile pattern perception makes reference to structural representations of the body, such as body parts separated by joints. Experiment 4 found that precision of pattern perception is poorer for tactile patterns that extend across the midline, compared to unilateral patterns. Overall, the results suggest that the human sense of touch involves a tactile field, analogous to the visual field. The tactile field supports computation of spatial relations between individual stimulus locations, and thus underlies tactile pattern perception.     

Feature-based attention influences later temporal perception

We investigated the influence of feature-based visual attention on later temporal perception. Although there is ample evidence that space-based attention modulates temporal perception, it is not known whether feature-based attention also serves this function. The present study combined a visual selection task with a temporal interval production task to determine whether feature-based attention interacted with temporal perception. The results indicated that temporal perception of visual stimuli depended on whether the same stimulus had been attended to or ignored in a previous visual selection task. The temporal production of previously ignored stimuli was longer than the temporal production of either previously attended to or novel stimuli. This is the first demonstration of the effect of feature-based attention on later temporal perception. We concluded that temporal perception is affected by previously ignored stimuli.     

Perceptual organization of apparent motion in the Ternus display

A typical Ternus display has three sequentially presented frames, in which frame 1 consists of three motion tokens, frame 2 (blank) defines the interstimulus interval, and frame 3 has similar motion tokens with their relative positions shifted to the right. Interestingly, what appears to be a seemingly simple arrangement of stimuli can induce one of two distinct apparent-motion percepts in the observer. The first is an element-motion perception where the left-end token is seen to jump over its two neighboring tokens (inner tokens) to the right end of the display. The second is a group-motion perception where the entire display of the three tokens is seen to move to the right. How does the visual system choose between these two apparent-motion perceptions? It is hypothesized that the choice of motion perception is determined in part by the perceptual organization of the motion tokens. Specifically, a group-motion perception is experienced when a strong grouping tendency exists among the motion tokens belonging to the same frame. Conversely, an element-motion perception is experienced when a strong grouping tendency exists between the inner motion tokens in frames 1 and 3 (i.e. the two tokens that overlap in space between frames). We tested this hypothesis by varying the perceptual organization of the motion tokens. Both spatial (form similarity, 3-D proximity, common surface/common region, and occlusion) and temporal (motion priming) factors of perceptual organization were tested. We found that the apparent-motion perception of the Ternus display can be predictably affected, in a manner consistent with the perceptual organization hypothesis.     

Temporal structure coding with and without awareness

In order to interpret a constantly changing environment, visual events far apart in space and time must be integrated into a unified percept. While spatial properties of invisible signals are known to be encoded without awareness, the fate of temporal properties remains largely unknown. Here, we probed temporal integration for two distinct motion stimuli that were either visible or rendered invisible using continuous flash suppression. We found that when invisible, both the direction of apparent motion and the gender of point-light walkers were processed only when defined across short time periods (i.e., respectively 100 ms and 1000 ms). This limitation was not observed under full visibility. These similar findings at two different hierarchical levels of processing suggest that temporal integration windows shrink in the absence of perceptual awareness. We discuss this phenomenon as a key prediction of the global neuronal workspace and the information integration theories of consciousness.     

Simultaneous motion perception along multiple attributes: A new class of stimuli

This paper describes a novel class of visual stimuli that have been created to study stroboscopic motion perception along multiple attributes. The stimuli are composed of discrete elements, each of which can be characterized by an arbitrary number of attributes (color, luminance, spatial frequency, binocular disparity, etc.). There are two choices for the spatiotemporal arrangement of each attribute: to elicit either unambiguous (unidirectional) motion perception or ambiguous (bidirectional) motion perception. This affords the unique ability to elicit simultaneous motion perception in opposing directions from identical stimuli. The prevailing direction depends on the relative strength of the attributes’ contribution to the motion mechanisms (for short frame duration), or on the particular attribute being attended to (for long frame duration). Thus, this class of stimuli opens up the possibility of isolating specific motion mechanisms in the visual system.     

Task-irrelevant sounds influence both temporal order and apparent-motion judgments about tactile stimuli applied to crossed and uncrossed hands

It has been suggested that judgments about the temporal–spatial order of successive tactile stimuli depend on the perceived direction of apparent motion between them. Here we manipulated tactile apparent-motion percepts by presenting a brief, task-irrelevant auditory stimulus temporally in-between pairs of tactile stimuli. The tactile stimuli were applied one to each hand, with varying stimulus onset asynchronies (SOAs). Participants reported the location of the first stimulus (temporal order judgments: TOJs) while adopting both crossed and uncrossed hand postures, so we could scrutinize skin-based, anatomical, and external reference frames. With crossed hands, the sound improved TOJ performance at short (≤300 ms) and at long (>300 ms) SOAs. When the hands were uncrossed, the sound induced a decrease in TOJ performance, but only at short SOAs. A second experiment confirmed that the auditory stimulus indeed modulated tactile apparent motion perception under these conditions. Perceived apparent motion directions were more ambiguous with crossed than with uncrossed hands, probably indicating competing spatial codes in the crossed posture. However, irrespective of posture, the additional sound tended to impair potentially anatomically coded motion direction discrimination at a short SOA of 80 ms, but it significantly enhanced externally coded apparent motion perception at a long SOA of 500 ms. Anatomically coded motion signals imply incorrect TOJ responses with crossed hands, but correct responses when the hands are uncrossed; externally coded motion signals always point toward the correct TOJ response. Thus, taken together, these results suggest that apparent-motion signals are likely taken into account when tactile temporal–spatial information is reconstructed.

     

Superior temporal activation in response to dynamic audio-visual emotional cues

Perception of emotion is critical for successful social interaction, yet the neural mechanisms underlying the perception of dynamic, audio-visual emotional cues are poorly understood. Evidence from language and sensory paradigms suggests that the superior temporal sulcus and gyrus (STS/STG) play a key role in the integration of auditory and visual cues. Emotion perception research has focused on static facial cues; however, dynamic audio-visual (AV) cues mimic real-world social cues more accurately than static and/or unimodal stimuli. Novel dynamic AV stimuli were presented using a block design in two fMRI studies, comparing bimodal stimuli to unimodal conditions, and emotional to neutral stimuli. Results suggest that the bilateral superior temporal region plays distinct roles in the perception of emotion and in the integration of auditory and visual cues. Given the greater ecological validity of the stimuli developed for this study, this paradigm may be helpful in elucidating the deficits in emotion perception experienced by clinical populations.     

孤独症谱系障碍者的生物运动探测障碍：基于行为与神经的证据

关于孤独症谱系障碍(autism spectrum disorder, ASD)个体探测生物运动(biological motion)的能力是否受损,已有行为研究尚存分歧。导致分歧的原因可能源于实验刺激、实验任务和测量指标存在差异。然而,神经研究却一致证实其潜在的神经机制存在异常。领域特殊性观点认为该障碍可能是基于后侧颞上沟功能异常也可能是基于镜像神经元功能异常,而领域一般性观点认为该障碍可能是基于背侧视觉流功能异常的视运动知觉障碍也可能基于脑功能联结异常的弱中央统合障碍。据此,本文将从研究范式、行为表现及潜在机制三个方面梳理相关研究,以期为后续研究提供新方向。     

编码时间对序列视觉信息整合的影响

本研究采用空白单元格定位任务,探讨序列刺激整合的时间特性。实验1重复前人的实验,验证了时间间隔对整合绩效的影响;实验2系统操纵了对先前刺激的编码时间与时间间隔,结果发现,编码时间越长,记忆的效果越好,虽然会妨碍对随后刺激的知觉,但整合绩效越高;而随着时间间隔的延长,延长编码时间带来的优势逐渐减弱。结论提示,人们能够整合视觉短时记忆和视知觉的信息,而且这种整合的时间特性不同于知觉整合。     

The reference frame for encoding and retention of motion depends on stimulus set size

The goal of this study was to investigate the reference frames used in perceptual encoding and storage of visual motion information. In our experiments, observers viewed multiple moving objects and reported the direction of motion of a randomly selected item. Using a vector-decomposition technique, we computed performance during smooth pursuit with respect to a spatiotopic (nonretinotopic) and to a retinotopic component and compared them with performance during fixation, which served as the baseline. For the stimulus encoding stage, which precedes memory, we found that the reference frame depends on the stimulus set size. For a single moving target, the spatiotopic reference frame had the most significant contribution with some additional contribution from the retinotopic reference frame. When the number of items increased (Set Sizes 3 to 7), the spatiotopic reference frame was able to account for the performance. Finally, when the number of items became larger than 7, the distinction between reference frames vanished. We interpret this finding as a switch to a more abstract nonmetric encoding of motion direction. We found that the retinotopic reference frame was not used in memory. Taken together with other studies, our results suggest that, whereas a retinotopic reference frame may be employed for controlling eye movements, perception and memory use primarily nonretinotopic reference frames. Furthermore, the use of nonretinotopic reference frames appears to be capacity limited. In the case of complex stimuli, the visual system may use perceptual grouping in order to simplify the complexity of stimuli or resort to a nonmetric abstract coding of motion information.