On the interdependence of temporal and spatial judgments

Three experiments are reported on the tau and kappa effects, the dependence of judgments of distance upon duration (tau) and of judgments of duration upon distance (kappa). In Experiment 1, three lights in a horizontal sequence were used to define two temporal and two spatial intervals over a total duration of 160 msec. The subject was required to choose the shorter of either the two durations or the two distances. The results confirmed Collyer’s (1977) findings that the two effects are inconsistently observed across subjects when the display duration is brief. In Experiment 2, display duration was systematically manipulated from 160 to 1,500 msec. It is argued that relative temporal judgments should become easier as the total display duration is increased and that, hence, the kappa effect should become less marked. On the other hand, relative spatial judgments should become more difficult as the total duration of the display is increased, and the tau effect should become more marked. The data were in conformity with the hypothesis. In Experiment 3, data are presented for a tau experiment which fit the assumption that the effect depends upon a weighted average of distance and the expected distance which would be traversed in the given time at constant velocity.     

Task effects on tactile temporal order judgments: when space does and does not matter

The ability to report the temporal order of 2 tactile stimuli (1 applied to each hand) has been shown to decline when the arms are crossed over compared with when they are uncrossed. However, these effects have only been measured when temporal order was reported by stimulus location. It is unknown whether this spatial manipulation of the body affects all tactile temporal order judgments (TOJs) or only those judgments that are spatially defined. The authors examined the effect of crossing the arms on tactile TOJs when stimuli were identified by either spatial (location) or nonspatial (frequency or duration) attributes. Spatial TOJs were significantly impaired when the arms were in crossed compared with uncrossed postures, but there was no effect of posture when order was judged by nonspatial attributes. Task-dependent modulation of the effects of posture was also evident when response complexity was reduced to go/no-go responses. These results suggest that crossing the arms impairs tactile localization and thus spatial TOJs. However, the data also suggest that localization is not a necessary precursor when temporal order can be computed by nonspatial means.     

Concurrent learning of temporal and spatial sequences

In a serial reaction time task, stimulus events simultaneously defined spatial and temporal sequences. Responses were based on the spatial dimension. The temporal sequence was incidental to the task, defined by the response-to-stimulus intervals in Experiment 1 and stimulus onset asynchronies in Experiment 2. The two sequences were either of equal length and correlated or of unequal length. In both experiments, spatial learning occurred regardless of sequence length condition. In contrast, temporal learning occurred only in the correlated condition. These results suggest that timing is an integrated part of action representations and that incidental learning for a temporal pattern does not occur independently from the action. Interestingly, sequence learning was enhanced in the correlated condition, reflecting the integration of spatial-temporal information.     

Temporal and intensitive factors in comparative judgments of tactile space.

Temporal imbalances between the successive stimulation of pairs of loci on each forearm altered judgments of the equality of the spatial extents between sets of loci. The spatial judgments became increasingly inaccurate as the temporal imbalance was increased, i.e., the Tau effect. Changes in stimulus intensity also influenced the dependency of spatial judgments on temporal factors. The data suggest that concomitant variations of spatial, temporal, and intensitive components of a vibrotactile stimulus "package" can produce systematic perceptual effects of potential significance in the design of vibrotactile sensory substitution systems.     

A walk down the block: spatial and temporal parameters of aesthetic judgments about ordinary streetscapes

An experiment is reported based on 12 streetscapes and 25 participants on how five spatial/temporal factors influenced aesthetic judgments about ordinary streets. Overall, aesthetic judgments were more strongly related to the temporal variables of total time, stationary time, and decision time rather than the spatial variables of path length or number of turns made to obtain different views. It is suggested that fancy simulations or detailed scrutiny are probably not needed to evaluate streetscapes as seen by people in the street.     

Effects of redundant visual stimuli on temporal order judgments

Four experiments were conducted in order to compare the effects of stimulus redundancy on temporal order judgments (TOJs) and reaction times (RTs). In Experiments 1 and 2, participants were presented in each trial with a tone and either a single visual stimulus or two redundant visual stimuli. They were asked to judge whether the tone or the visual display was presented first. Judgments of the relative onset times of the visual and the auditory stimuli were virtually unaffected by the presentation of redundant, rather than single, visual stimuli. Experiments 3 and 4 used simple RT tasks with the same stimuli, and responses were much faster to redundant than to single visual stimuli. It appears that the traditional speedup of RT associated with redundant visual stimuli arises after the stimulus detection processes to which TOJs are sensitive.     

Task-irrelevant sounds influence both temporal order and apparent-motion judgments about tactile stimuli applied to crossed and uncrossed hands

It has been suggested that judgments about the temporal–spatial order of successive tactile stimuli depend on the perceived direction of apparent motion between them. Here we manipulated tactile apparent-motion percepts by presenting a brief, task-irrelevant auditory stimulus temporally in-between pairs of tactile stimuli. The tactile stimuli were applied one to each hand, with varying stimulus onset asynchronies (SOAs). Participants reported the location of the first stimulus (temporal order judgments: TOJs) while adopting both crossed and uncrossed hand postures, so we could scrutinize skin-based, anatomical, and external reference frames. With crossed hands, the sound improved TOJ performance at short (≤300 ms) and at long (>300 ms) SOAs. When the hands were uncrossed, the sound induced a decrease in TOJ performance, but only at short SOAs. A second experiment confirmed that the auditory stimulus indeed modulated tactile apparent motion perception under these conditions. Perceived apparent motion directions were more ambiguous with crossed than with uncrossed hands, probably indicating competing spatial codes in the crossed posture. However, irrespective of posture, the additional sound tended to impair potentially anatomically coded motion direction discrimination at a short SOA of 80 ms, but it significantly enhanced externally coded apparent motion perception at a long SOA of 500 ms. Anatomically coded motion signals imply incorrect TOJ responses with crossed hands, but correct responses when the hands are uncrossed; externally coded motion signals always point toward the correct TOJ response. Thus, taken together, these results suggest that apparent-motion signals are likely taken into account when tactile temporal–spatial information is reconstructed.

     

Word recognition and temporal order judgments: semantics turns back the clock.

This paper examines the consequences that codes activated during reading have on activities unrelated to reading by investigating the effects of semantics on temporal order judgments. Participants judged which of two word targets appeared first. Targets appeared either synchronously, or were separated by varying stimulus onset asynchronies (SOAs). For one group of participants, one target on each trial was related to a prime word shown at the beginning of the trial. This priming relation affected temporal order judgments such that participants sometimes reported related targets as having appeared first, even when they appeared second. It is suggested that this effect is best explained as showing that codes activated during word recognition affect the attentional selection aspects of the temporal order judgment task.     

The effects of voluntary movements on auditory-haptic and haptic-haptic temporal order judgments

In two experiments we investigated the effects of voluntary movements on temporal haptic perception. Measures of sensitivity (JND) and temporal alignment (PSS) were obtained from temporal order judgments made on intermodal auditory-haptic (Experiment 1) or intramodal haptic (Experiment 2) stimulus pairs under three movement conditions. In the baseline, static condition, the arm of the participants remained stationary. In the passive condition, the arm was displaced by a servo-controlled motorized device. In the active condition, the participants moved voluntarily. The auditory stimulus was a short, 500Hz tone presented over headphones and the haptic stimulus was a brief suprathreshold force pulse applied to the tip of the index finger orthogonally to the finger movement. Active movement did not significantly affect discrimination sensitivity on the auditory-haptic stimulus pairs, whereas it significantly improved sensitivity in the case of the haptic stimulus pair, demonstrating a key role for motor command information in temporal sensitivity in the haptic system. Points of subjective simultaneity were by-and-large coincident with physical simultaneity, with one striking exception in the passive condition with the auditory-haptic stimulus pair. In the latter case, the haptic stimulus had to be presented 45ms before the auditory stimulus in order to obtain subjective simultaneity. A model is proposed to explain the discrimination performance.     

Audiotactile temporal order judgments

We report a series of three experiments in which participants made unspeeded 'Which modality came first?' temporal order judgments (TOJs) to pairs of auditory and tactile stimuli presented at varying stimulus onset asynchronies (SOAs) using the method of constant stimuli. The stimuli were presented from either the same or different locations in order to explore the potential effect of redundant spatial information on audiotactile temporal perception. In Experiment 1, the auditory and tactile stimuli had to be separated by nearly 80 ms for inexperienced participants to be able to judge their temporal order accurately (i.e., for the just noticeable difference (JND) to be achieved), no matter whether the stimuli were presented from the same or different spatial positions. More experienced psychophysical observers (Experiment 2) also failed to show any effect of relative spatial position on audiotactile TOJ performance, despite having much lower JNDs (40 ms) overall. A similar pattern of results was found in Experiment 3 when silent electrocutaneous stimulation was used rather than vibrotactile stimulation. Thus, relative spatial position seems to be a less important factor in determining performance for audiotactile TOJ than for other modality pairings (e.g., audiovisual and visuotactile).     

Evidence for auditory temporal distinctiveness: modality effects in order and frequency judgments

Two new, long-lasting phenomena involving modality of stimulus presentation are documented. In one series of experiments we investigated effects of modality of presentation on order judgments. Order judgments for auditory words were more accurate than order judgments for visual words at both the beginning and the end of lists, and the auditory advantage increased with the temporal separation of the successive items. A second series of experiments investigated effects of modality on estimates of presentation frequency. Frequency estimates of repeated auditory words exceeded frequency estimates of repeated visual words. The auditory advantage increased with frequency of presentation, and this advantage was not affected by the retention interval. These various effects were taken as support for a temporal coding assumption, that auditory presentation produces a more accurate encoding of time of presentation than does visual presentation.     

The interdependence of pitch and temporal judgments by absolute pitch possessors

The auditory tau and the kappa effects show that there is time-pitch interdependence in our perception. Our judgments of pitch separation between two tones depend on the temporal interval between them (the auditory tau effect), and our judgments of the tones’ temporal interval depend on their pitch separation (the kappa effect). The mechanisms underlying this interdependence were investigated by studying the auditory tau and the kappa effect in three experiments. Comparisons were made between results obtained from subjects with absolute pitch and those who did not have absolute pitch, and two frequency ranges of pure tones (octave and whole-tone conditions) were selected. The procedures had been used in previous experiments (Shigeno, 1986), in which the auditory tau and the kappa effects were compared in speech and nonspeech stimuli. The present results demonstrate that the auditory tau effect does not occur when possessors of absolute pitch judge the closeness of stimuli in pitch, except when the stimulus continuum consists of tones that do not correspond to musical notes in the whole-tone condition. The kappa effect was obtained in the judgment of possessors of absolute pitch in both the octave and the whole-tone conditions. These findings suggest that the interaction between temporal interval and pitch judgment might be explained in terms of the two different memory modes for retaining the pitch of tones, and that these effects occur at the precategorical level.     

The induced asynchrony effect: Its role in visual judgments of temporal order and its relation to other dynamic perceptual phenomena

A context-induced “illusion” in visual judgments of temporal order, termed the induced asynchrony effect (IAE), is reported. It consists of an apparent ordering in time of two simultaneous light onsets, produced by the preceding, asynchronous offsets of two other lights. The joint effect of a real stimulus onset asynchrony and a preceding stimulus offset asynchrony bn judgments of onset order appears to be additive, given a Gaussian transformation of response probability. This result is shown to be consistent with a simple statistical decision model, which provides a conceptual framework for drawing inferences from temporal order judgment data. However, it is emphasized that certain interpretations of such models are not empirically testable on the basis of temporal order data alone. An attempt is made to relate the IAE to three other dynamic perceptual phenomena; all four effects may reflect a tendency of observers to perceive the velocity of apparent motion as being constant. Questions raised by the demonstration of the IAE are discussed, and directions for further research are suggested.     

The effects of spatial frequency and temporal waveform on three measures of temporal processing

The effects of spatial frequency and temporal transition of sine-wave grating onset and offset were assessed using measures of reaction time, visual persistence, and temporal order judgements. The stimuli were lateralized fields, separated by 1 degree of visual angle. Slow temporal transition resulted in significantly poorer performance than did abrupt onset and offset, but spatial frequency had a minimal effect. Thus, the latency, temporal resolution, and temporal ordering of events are mediated by a mechanism that is sensitive to abrupt temporal transients. The stimulus conditions employed did not result in a shift in the point of subjective simultaneity.     

Temporal ventriloquism in a purely temporal context

This study examines how audiovisual signals are combined in time for a temporal analogue of the ventriloquist effect in a purely temporal context, that is, no spatial grounding of signals or other spatial facilitation. Observers were presented with two successive intervals, each defined by a 1250-ms tone, and indicated in which interval a brief audiovisual stimulus (visual flash + noise burst) occurred later. In "test" intervals, the audiovisual stimulus was presented with a small asynchrony, while in "probe" intervals it was synchronous and presented at various times guided by an adaptive staircase to find the perceived temporal location of the asynchronous stimulus. As in spatial ventriloquism, and consistent with maximum likelihood estimation (MLE), the asynchronous audiovisual signal was shifted toward the more reliably localized component (audition, for all observers). Moreover, these temporal shifts could be forward or backward in time, depending on the asynchrony order, suggesting perceived timing is not entirely determined by physical timing. However, the critical signature of MLE combination--better bimodal than unimodal precision--was not found. Regardless of the underlying model, these results demonstrate temporal ventriloquism in a paradigm that is defined in a purely temporal context.     

The effect of temporal and spatial frequency on phantom-contour detection

Phantom contours are a visual illusion that can define regions with distinctive boundaries when no real surrounding edges exist. Spatial-frequency sensitivity is known to vary reliably across the visual-processing pathways, as does temporal-frequency sensitivity. Given that the effect of temporal frequency on phantom-contour detection has been previously established, and that the relationship between spatial frequency and temporal frequency is known, two experiments were designed to measure the highest level of spatial frequency that would still allow reliable pattern detection at different temporal frequencies by using the phantom-contour paradigm. The results revealed that phantom-contour detection is impaired when the stimulus has a high spatial-frequency content and that phantom-contour perception is supported by low spatial frequencies.     

Children's temporal judgments for autobiographical past and future events

We compared the performance of twenty 5-7-year-olds on two spatial-temporal judgment tasks. In a semantic task, children located temporal distances from today that were described using conventional, temporal terms on a spatial timeline. In an autobiographical task, children judged temporal distances on the same spatial timeline for events that they had experienced, or were going to experience, presented without explicit temporal references. Six-year-olds were equally accurate in judging temporal distances in the semantic and autobiographical tasks, but 7-year-olds were more accurate in the semantic task. Older children were more accurate than younger children in the semantic task, but no significant age differences were found for autobiographical events. Surprisingly, children were equally accurate in locating past and future events in time. Children at both ages were more accurate judging temporal distances up to one week away (both past and future) as compared to distances of two to four weeks across both tasks. Results suggest that knowledge of recurring time patterns and conventional time measurement systems is necessary, but not sufficient, for locating autobiographical events in time, and temporal distance plays an important role in children's temporal judgments.     

The influence of synchronous audiovisual distractors on audiovisual temporal order judgments

Participants made unspeeded temporal order judgments (TOJs) regarding which occurred first, anauditory or a visual target stimulus, when they were presented at a variety of different stimulus onset asynchronies. The target stimuli were presented either in isolation or positioned randomly among a stream of three synchronous audiovisual distractors. The largest just noticeable differences were reported when the targets were presented in the middle of the distractor stream. When the targets were presented at the beginning of the stream, performance was no worse than when the audiovisual targets were presented in isolation. Subsequent experiments revealed that performance improved somewhat when the position of the target was fixed or when the target was made physically distinctive from the distractors. These results show that audiovisual TOJs are impaired by the presence of audiovisual distractors and that this cost can be ameliorated by directing attention to the appropriate temporal position within the stimulus stream.     

Directional verbal probabilities: inconsistencies between preferential judgments and numerical meanings

Verbal probability expressions (e.g., it is possible or doubtful) convey not only vague numerical meanings (i.e., probability) but also semantic functions, called directionality. We performed two experiments to examine whether preferential judgments are consistent with numerical meanings of verbal probabilities regardless of directionality. The results showed that because of the effects of directionality, perceived degrees of certainty for verbal probabilities differed between a binary choice and a numerical translation (Experiment 1), and decisions based on a verbal probability do not correspond to those based on a numerical translation for verbal probabilities (Experiment 2). These findings suggest that directionality of verbal probabilities is an independent feature from numerical meanings; hence numerical meanings of verbal probability alone remain insufficient to explain the effects of directionality on preferential judgments.     

Multisensory temporal order judgments: when two locations are better than one

In Experiment 1, participants were presented with pairs of stimuli (one visual and the other tactile) from the left and/or right of fixation at varying stimulus onset asynchronies and were required to make unspeeded temporal order judgments (TOJs) regarding which modality was presented first. When the participants adopted an uncrossed-hands posture, just noticeable differences (JNDs) were lower (i.e., multisensory TOJs were more precise) when stimuli were presented from different positions, rather than from the same position. This spatial redundancy benefit was reduced when the participants adopted a crossed-hands posture, suggesting a failure to remap visuotactile space appropriately. In Experiment 2, JNDs were also lower when pairs of auditory and visual stimuli were presented from different positions, rather than from the same position. Taken together, these results demonstrate that people can use redundant spatial cues to facilitate their performance on multisensory TOJ tasks and suggest that previous studies may have systematically overestimated the precision with which people can make such judgments. These results highlight the intimate link between spatial and temporal factors in determining our perception of the multimodal objects and events in the world around us.