Perceptual exploration and intersensory merging in a visual–haptic Necker cube

Background

Perceiving the three-dimensional structure of an object often involves merging vision and haptics over extended periods of exploration. An interesting feature of this process is that as exploration progresses, new information may require changing how the two sensory signals are treated.

Aims

We tested whether (1) bimodal interactions during extended observation can adjust to changes in the quality of unimodal sensory signals; and (2) there are specific temporal constraints on these adjustments.

Methods

When viewing a three-dimensional Necker cube with one eye, participants experience illusory reversals even while they feel the cube with their hands. This surprising property makes the visual–haptic Necker cube an excellent model to investigate bimodal processes when previously consistent bimodal signals change in quality over time or begin to conflict. Our participants reported reversals while they viewed the cube and, at the same time, they either held it with two-finger grips, felt it with while their hands remained stationary, or actively explored it by moving one hand.

Results

Consistent with a multisensory approach to three-dimensional form perception, touch had a clear effect on both the number and the duration of illusory percepts. Additionally, when observers alternated between stationary and moving periods during exploration, transitions from stationary to moving-hand haptics played a crucial role in inhibiting illusory reversals. A temporal analysis of the probability of first reversals occurring after different types of motor transition revealed a “vetoing window” initiating approximately 2 s after the transition and lasting at least another 1–2 s.

Conclusions

These results suggest that intersensory merging is sensitive to changes in the quality of unimodal signals during exploration, and that adjustments caused by these changes are characterized by specific temporal dynamics.

     

Effects of internal clock and memory disorders on duration reproductions and duration productions in patients with Parkinson's disease

Patients with Parkinson's disease (PD) exhibit deficits in perceptual and motor timing as well as impairments in memory and attentional processes that are related to dysfunction of dopaminergic systems in the basal ganglia. The aim of the present study was to assess the relationships existing between impaired duration judgments and defective memory and attention in PD patients. We compared time performance of medicated PD patients and control subjects on a duration reproduction task that is highly memory-dependent, and on a duration production task that could reveal effects of changes in the speed of internal time-keeping mechanisms. Each task was performed in a control counting condition and in a condition requiring divided attention between the temporal task and a concurrent reading task. Moreover, PD patients and control subjects were assessed on memory and attention using a battery of neuropsychological tests. The results revealed that in the concurrent reading condition of the reproduction task, duration judgments tended to be more variable in PD patients than in control subjects. Moreover, variability of duration reproductions was correlated with both measures of memory and of disease severity. In the concurrent reading condition of the production task, duration judgments were significantly shorter in PD patients than in control subjects, and accuracy of duration productions was correlated with scores on sub-tests of short-term memory. The findings suggest that the administration of dopamine did not entirely remove the memory deficits in PD patients. Moreover, DA treatment would have abnormally accelerated the rate of the internal clock leading to shorter duration productions in PD patients. The whole results indicate that dopamine administration in patients might have overshadowed the slowing rate of the internal clock usually reported in non medicated PD patients, without entirely restoring all of the memory functions.     

Sensorimotor synchronization: A review of the tapping literature

Sensorimotor synchronization (SMS), the rhythmic coordination of perception and action, occurs in many contexts, but most conspicuously in music performance and dance. In the laboratory, it is most often studied in the form of finger tapping to a sequence of auditory stimuli. This review summarizes theories and empirical findings obtained with the tapping task. Its eight sections deal with the role of intention, rate limits, the negative mean asynchrony, variability, models of error correction, perturbation studies, neural correlates of SMS, and SMS in musical contexts. The central theoretical issue is considered to be how best to characterize the perceptual information and the internal processes that enable people to achieve and maintain SMS. Recent research suggests that SMS is controlled jointly by two error correction processes (phase correction and period correction) that differ in their degrees of cognitive control and may be associated with different brain circuits. They exemplify the general distinction between subconscious mechanisms of action regulation and conscious processes involved in perceptual judgment and action planning.     

Psycholinguistic norms for action photographs in French and their relationships with spoken and written latencies

A set of 142 photographs of actions (taken from Fiez & Tranel, 1997) was standardized in French on name agreement, image agreement, conceptual familiarity, visual complexity, imageability, age of acquisition, and duration of the depicted actions. Objective word frequency measures were provided for the infinitive modal forms of the verbs and for the cumulative frequency of the verbal forms associated with the photographs. Statistics on the variables collected for action items were provided and compared with the statistics on the same variables collected for object items. The relationships between these variables were analyzed, and certain comparisons between the current database and other similar published databases of pictures of actions are reported. Spoken and written naming latencies were also collected for the photographs of actions, and multiple regression analyses revealed that name agreement, image agreement, and age of acquisition are the major determinants of action naming speed. Finally, certain analyses were performed to compare object and action naming times. The norms and the spoken and written naming latencies corresponding to the pictures are available on the Internet (http://www.psy.univ-bpclermont.fr/~pbonin/pbonin-eng.html) and should be of great use to researchers interested in the processing of actions.     

Time-course of attention for threatening pictures in high and low trait anxiety

Cognitive studies about anxiety suggest that the interplay between automatic and strategic biases in attention to threat is related to the persistence of fear. In the present study, the time-course of attention to pictures with varying threat levels was investigated in high trait anxious (HTA, n=21) and low trait anxious (LTA, n=22) students. In a visual probe detection task, high and mild threat pictures were presented at three durations: 100, 500, and 1250 ms. Results indicated that all individuals attended to the high threat pictures for the 100 ms condition. Differential responding between HTA and LTA individuals was found for the 500 ms condition: only HTA individuals showed an attentional bias for mild threatening stimuli. For the 1250 ms condition, the HTA individuals attended away from high and mild threat pictures. The observed pattern of differential attention to threatening pictures may explain the persistence of fear in HTA individuals.     

Amodal completion in visual search: preemption or context effects?

In a previous study, search for a notched-disk target abutting a square among complete-disk nontargets and squares was inefficient in 250-ms exposures, but relatively efficient in 100-ms exposures. This finding was interpreted as evidence that amodal completion proceeds through a mosaic and then a completion stage, with the latter preempting the former. We used the same target but changed its context: Nontargets were instead notched disks near squares. Task set was also different: Participants searched for a complete disk. Contrary to the prediction of the preemption model, search was efficient in the 100-ms condition and inefficient in the 250-ms condition. We propose that in both the present and the previous studies, the target was ambiguous, and task set and context affected how it was perceived. In both experiments, set effects were evident for 100-ms exposures; context effects were evident for 250-ms exposures.     

A comparison of masking by visual and transcranial magnetic stimulation: implications for the study of conscious and unconscious visual processing

Visual stimuli as well as transcranial magnetic stimulation (TMS) can be used: (1) to suppress the visibility of a target and (2) to recover the visibility of a target that has been suppressed by another mask. Both types of stimulation thus provide useful methods for studying the microgenesis of object perception. We first review evidence of similarities between the processes by which a TMS mask and a visual mask can either suppress the visibility of targets or recover such suppressed visibility. However, we then also point out a significant difference that has important implications for the study of the time course of unconscious and conscious visual information processing and for theoretical accounts of the processes involved. We present evidence and arguments showing: (a) that visual masking techniques, by revealing more detailed aspects of target masking and target recovery, support a theoretical approach to visual masking and visual perception that must take into account activities in two separate neural channels or processing streams and, as a corollary, (b) that at the current stage of methodological sophistication visual masks, by acting in more highly specifiable ways on these pathways, provide information about the microgenesis of form perception not available with TMS masks.     

Unconscious priming by color and form: different processes and levels

Using a metacontrast masking paradigm, prior studies have shown (a) that a target's color information and form information, can be processed without awareness and (b) that unconscious color processing occurs at early, wavelength-dependent levels in the cortical information processing hierarchy. Here we used a combination of paracontrast and metacontrast masking techniques to explore unconscious color and form priming effects produced by blue, green, and neutral stimuli. We found that color priming in normal observers is significantly reduced when an additional paracontrast mask precedes the target at optimal masking SOAs. However, no reduction of form-priming effects was obtained at similar optimal paracontrast SOAs. We conclude that unconscious color priming depends on an early, wavelength- or stimulus-dependent response of color neurons located at early cortical levels whereas unconscious form priming occurs at later levels.     

Measuring surface achromatic color: Toward a common measure for increments and decrements

Surface color is traditionally measured by matching methods. However, in some conditions, the color of certain surfaces cannot be measured: The surface simply looks brighter or darker than all the patches on a matching scale. We studied the reliability, validity, and range of application of three different types of simulated Munsell scales (white-, black-, and split-surrounded) as methods for measuring surface colors in simple disk-ring displays. All the scales were equally reliable for matching both increments and decrements, but about 20% of the increments were unmatchable on the white-surrounded scale, about 13% of the decrements were unmatchable on the black-surrounded scale, and about 9% of the increments were unmatchable on the split-surrounded scale. However, matches on all the scales were linearly related. Therefore, it is possible to convert them to common units, using regression parameters. These units provide an extended metric for measuring all increments and decrements in the stimulus space, effectively removing ceiling and floor effects, and providing measures even for surfaces that were perceived as out of range on some of the scales.     

Obligatory “expectations” of expressive timing induced by perception of musical structure

Previous research has shown that, in a task requiring the detection of local deviations from mechanically precise timing in music, the relative detectability of deviations in different positions is closely related to the typical expressive timing pattern musicians produce when playing the music. This result suggests that listeners expect to hear music expressively timed and compensate for the absence of expressive timing. Three new detection experiments shed additional light on the nature of these timing expectations in musically trained listeners. Experiment 1 shows that repeated exposure to an atypically (but not unmusically) timed performance leaves listeners' timing expectations unaffected. Experiment 2 demonstrates that the expectations do not manifest themselves when listeners merely imagine the music in synchrony with a click track. Experiment 3, however, shows that the timing expectations are fully operational when the click track is superimposed on the music. These results reveal timing “expectations” to be an obligatory consequence of the ongoing auditory perception of musical structure. Received: 5 November 1996 / Accepted: 26 February 1997