Reaction time and temporal serial judgment: corroboration or dissociation?]

Dissociations between a motor response and the subject's verbal report have been reported from various experiments that investigated special experimental effects (e.g., metacontrast or induced motion). To examine whether similar dissociations can also be observed under standard experimental conditions, we compared reaction times (RT) and temporal order judgments (TOJ) to visual and auditory stimuli of three intensity levels. Data were collected from six subjects, each of which served for nine sessions. The results showed a strong, highly significant modality dissociation: While RTs to auditory stimuli were shorter than RTs to visual stimuli, the TOJ data indicated longer processing times for auditory than for visual stimuli. This pattern was found over the whole range of intensities investigated. Light intensity had similar effects on RT and TOJ, while there was a marginally significant tendency of tone intensity to affect RT more strongly than TOJ. It is concluded that modality dissociation is an example of "direct parameter specification", where the pathway from stimulus to response in the simple RT experiment is (at least partially) separate from the pathway that leads to a conscious, reportable representation. Two variants of this notion and alternatives to it are discussed.     

Attentional bias toward low-intensity stimuli: an explanation for the intensity dissociation between reaction time and temporal order judgment?

If two stimuli need different times to be processed, this difference should in principle be reflected both by response times (RT) and by judgments of their temporal order (TOJ). However, several dissociations have been reported between RT and TOJ, e.g., RT is more affected than TOJ when stimulus intensity decreases. One account for these dissociations is to assume differences in the allocation of attention induced by the two tasks. To test this hypothesis, different distributions of attention were induced in the present study between two stimulus positions (above and below fixation). Only bright stimuli appeared in one position and either bright or dim stimuli in the other. In the two RT experiments, participants had to respond to every stimulus appearing in one of the two positions. Reaction times to bright stimuli were faster when they appeared in the position where dim stimuli were likely to occur. This finding suggests that the allocation of attention was adapted to the asymmetrical arrangement of stimuli, not suggested by explicit instruction. In the two TOJ experiments, the temporal order of stimuli appearing in the two positions had to be judged. Although bright stimuli appearing at the bright-and-dim location were judged to be earlier, this effect was small and insignificant. Further, the intensity dissociation between RT and TOJ was insensitive to random vs blockwise presentations of intensities, therefore was not modified by attentional preferences. Thus, asymmetrical arrangement of stimuli has an impact on the allocation of attention, but only in the RT task. Therefore dissociations between TOJ and response times cannot be accounted for by an attentional bias in the TOJ task but probably by different use of temporal information in the two tasks.     

Dissociations between reaction times and temporal order judgments: a diffusion model approach

A diffusion model for simple reaction time (RT) and temporal order judgment (TOJ) tasks was developed to account for a commonly observed dissociation between these 2 tasks: Most stimulus manipulations (e.g., intensity) have larger effects in RT tasks than in TOJ tasks. The model assumes that a detection criterion determines the level of sensory evidence needed to conclude that a stimulus has been presented. Analysis of the performance that would be achieved with different possible criterion settings revealed that performance was optimal with a lower criterion setting for the TOJ task than for the RT task. In addition, the model predicts that effects of stimulus manipulations should increase with the size of the detection criterion. Thus, the model suggests that commonly observed dissociations between RT and TOJ tasks may simply be due to performance optimization in the face of conflicting task demands.     

Differential effects of visual-spatial attention on response latency and temporal-order judgment

Summary Theorists from both classical structuralism and modern attention research have claimed that attention to a sensory stimulus enhances processing speed. However, they have used different operations to measure this effect, viz., temporal-order judgment (TOJ) and reaction-time (RT) measurement. We report two experiments that compared the effect of a spatial cue on RT and TOJ. Experiment 1 demonstrated that a nonmasked, peripheral cue (the brief brightening of a box) affected both RT and TOJ. However, the former effect was significantly larger than the latter. A masked cue had a smaller, but reliable, effect on TOJ. In Experiment 2, the effects of a masked cue on RT and TOJ were compared under identical stimulus conditions. While the cue had a strong effect on RT, it left TOJ unaffected. These results suggest that a spatial cue may have dissociable effects on response processes and the processes that lead to a conscious percept. Implications for the concept of direct parameter specification and for theories of visual attention are discussed.     

Temporal, but not spatial, context modulates a masked prime's effect on temporal order judgment, but not on response latency

Three experiments investigated a dissociation originally described by Neumann, Esselmann, and Klotz. Stimuli were geometric shapes, preceded by similar shapes that were masked by metacontrast. Each experiment consisted of three parts. In the reaction time (RT) part, participants saw an array of geometric shapes, one of which was marked by bars, and had to respond to the marked shape's position by pressing an appropriate button. A prime (a similar, but smaller stimulus) preceded either the marked or an unmarked stimulus. In the temporal order judgment (TOJ) part, the task was to judge the temporal order of the marked and the unmarked stimulus. In the detection part, detectability of the prime was tested. Although its detectability was zero or close to zero, the prime affected both RT and the apparent onset as measured by TOJ. The effect on RT was significantly larger than the effect on TOJ (Exp. 1). Increasing the spatial context (number of non-target stimuli in the display) did not affect this pattern (Exp. 2). By contrast, reducing the temporal context (range of stimulus onset asynchronies) abolished the prime's effect in the TOJ task, although the prime affected RT under identical conditions. It is concluded that partially different mechanisms mediate the prime's effect in the two tasks and that the effect of stimulus context on TOJ found in the Neumann et al. study was due to temporal, not spatial context. Received: 17 December 1997 / Accepted: 15 December 1998     

The Ornstein-Uhlenbeck model for decision time in cognitive tasks: An example of control of nonlinear network dynamics

The Ornstein-Uhlenbeck (OU) model for human decision-making has been successfully applied to account for response accuracy and response time (RT) data in recent two-choice decision models. A variant of the OU model is shown to arise from the response dynamics of a nonlinear network consisting of randomly connected neural processing units. When feedback control of the network is effected by the stimulus onset, the average network response is an autocorrelated random signal satisfying the stochastic differential equation for the OU process. An alternative, more general, stimulus detection procedure is proposed which involves the use of an adaptive Kalman filter process to track any temporal change in autoregressive parameters. The predicted decision time distributions suggest that both the OU and the Kalman filter processes can serve as alternative models for RT data in experimental tasks. Received: 15 October 1998 / Accepted: 27 May 1999     

Disinhibition of return: Unnecessary and unlikely

Recently, from data obtained with a temporal order judgment (TOJ) task, Gibson and Egeth (1994) concluded that inhibition of return (IOR; a response time effect that reveals slower responding to targets at previously cued versus uncued locations) reflects impaired perceptual processing. By replotting their data, we demonstrate that the perception of temporal order is influenced only by the facilitatory effect of a cue at short stimulus onset asynchronies (SOAs) and is unaffected by IOR at long SO As. The target paper proposed that, when extra stimuli are presented at task-relevant locations (i.e., in the TOJ task), IOR is prevented by a hypothetical process that is known as disinhibition of return (DOR). We argue that the assumptions that IOR affects perceptual processing and that DOR exists are unnecessary, as a more parsimonious response-based interpretation of IOR is consistent with their data. Further, we summarize recent results and present new data that demonstrate that DOR is unlikely.     

Audiovisual synchrony and temporal order judgments: effects of experimental method and stimulus type

When an audio-visual event is perceived in the natural environment, a physical delay will always occur between the arrival of the leading visual component and that of the trailing auditory component. This natural timing relationship suggests that the point of subjective simultaneity (PSS) should occur at an auditory delay greater than or equal to 0 msec. A review of the literature suggests that PSS estimates derived from a temporal order judgment (TOJ) task differ from those derived from a synchrony judgment (SJ) task, with (unnatural) auditory-leading PSS values reported mainly for the TOJ task. We report data from two stimulus types that differed in terms of complexity--namely, (1) a flash and a click and (2) a bouncing ball and an impact sound. The same participants judged the temporal order and synchrony of both stimulus types, using three experimental methods: (1) a TOJ task with two response categories ("audio first" or "video first"), (2) an SJ task with two response categories ("synchronous" or "asynchronous"; SJ2), and (3) an SJ task with three response categories ("audio first," "synchronous," or "video first"; SJ3). Both stimulus types produced correlated PSS estimates with the SJ tasks, but the estimates from the TOJ procedure were uncorrelated with those obtained from the SJ tasks. These results suggest that the SJ task should be preferred over the TOJ task when the primary interest is i n perceived audio-visualsynchrony.     

Temporal preparation improves temporal resolution: Evidence from constant foreperiods

Recent research shows that temporal preparation within a constant foreperiod design improves the spatial resolution of visual perception. The present experiments were designed to investigate whether similar benefits of temporal preparation can be observed in a task that requires high temporal resolution. In three experiments, we assessed the effect of temporal preparation on temporal order judgments (TOJs). In Experiment 1, short foreperiods facilitated TOJ for two spatially adjacent dots. This finding was replicated in Experiment 2, in which the temporal order of two spatially overlapping stimuli (“+” and “x”) had to be discriminated. Experiment 3 investigated the time course of temporal preparation by extending these findings to a wide range of different foreperiod durations. The present findings corroborate recent evidence for a perceptual locus of temporal preparation. Most importantly, they show that temporal preparation within a constant foreperiod design improves the temporal resolution of visual perception, independently of whether TOJ requires a decision about the location or about the identity of the target stimuli.     

Task-irrelevant sounds influence both temporal order and apparent-motion judgments about tactile stimuli applied to crossed and uncrossed hands

It has been suggested that judgments about the temporal–spatial order of successive tactile stimuli depend on the perceived direction of apparent motion between them. Here we manipulated tactile apparent-motion percepts by presenting a brief, task-irrelevant auditory stimulus temporally in-between pairs of tactile stimuli. The tactile stimuli were applied one to each hand, with varying stimulus onset asynchronies (SOAs). Participants reported the location of the first stimulus (temporal order judgments: TOJs) while adopting both crossed and uncrossed hand postures, so we could scrutinize skin-based, anatomical, and external reference frames. With crossed hands, the sound improved TOJ performance at short (≤300 ms) and at long (>300 ms) SOAs. When the hands were uncrossed, the sound induced a decrease in TOJ performance, but only at short SOAs. A second experiment confirmed that the auditory stimulus indeed modulated tactile apparent motion perception under these conditions. Perceived apparent motion directions were more ambiguous with crossed than with uncrossed hands, probably indicating competing spatial codes in the crossed posture. However, irrespective of posture, the additional sound tended to impair potentially anatomically coded motion direction discrimination at a short SOA of 80 ms, but it significantly enhanced externally coded apparent motion perception at a long SOA of 500 ms. Anatomically coded motion signals imply incorrect TOJ responses with crossed hands, but correct responses when the hands are uncrossed; externally coded motion signals always point toward the correct TOJ response. Thus, taken together, these results suggest that apparent-motion signals are likely taken into account when tactile temporal–spatial information is reconstructed.

     

The role of tone duration in dichotic temporal order judgment

Over the past two decades, a number of studies have been based on the dichotic temporal order judgment (TOJ) paradigm, to compare auditory temporal processing in various subpopulations to that of young, normal controls. The reported estimates of dichotic TOJ thresholds, expressed as the interstimulus intervals (ISIs) for 75 % accuracy among the controls, have varied. In the present study, we examined the influence of tone duration, within the 10- to 40-msec range, on dichotic TOJ accuracy and threshold. The results indicated that increases in either ISI or tone duration increased dichotic TOJ accuracy similarly, implying that changes in tone duration may affect dichotic TOJs simply by adding to the delay between onset of the tone at the lead ear and onset of the tone at the lag ear. The dichotic TOJ thresholds from three published studies that had used tones as stimuli and the dichotic thresholds from the present study all fell within 0.5 standard deviations from the theoretical line of a 10-msec reduction in threshold for every 10-msec increase in tone duration. When the dichotic TOJ threshold data from the present study and from the published studies were converted to stimulus onset asynchronies (SOAs) and plotted as a function of tone duration, they fell very close to or on a zero-slope line, indicating that when ISI and duration are summed to yield an SOA, dichotic TOJ thresholds are invariant to tone duration within the range of 10–40 msec.     

Do working memory-driven attention shifts speed up visual awareness?

Previous research has shown that content representations in working memory (WM) can bias attention in favor of matching stimuli in the scene. Using a visual prior-entry procedure, we here investigate whether such WM-driven attention shifts can speed up the conscious awareness of memory-matching relative to memory-mismatching stimuli. Participants were asked to hold a color cue in WM and to subsequently perform a temporal order judgment (TOJ) task by reporting either of two different-colored circles (presented to the left and right of fixation with a variable temporal interval) as having the first onset. One of the two TOJ circles could match the memory cue in color. We found that awareness of the temporal order of the circle onsets was not affected by the contents of WM, even when participants were explicitly informed that one of the TOJ circles would always match the WM contents. The null effect of WM on TOJs was not due to an inability of the memory-matching item to capture attention, since response times to the target in a follow-up experiment were improved when it appeared at the location of the memory-matching item. The present findings suggest that WM-driven attention shifts cannot accelerate phenomenal awareness of matching stimuli in the visual field.     

Somatosensory prior entry assessed with temporal order judgments and simultaneity judgments

Attention is central to perception, yet a clear understanding of how attention influences the latency of perception has proven surprisingly elusive. Recent research has indicated that spatially attended stimuli are perceived earlier than unattended stimuli across a range of sensory modalities-an effect termed prior entry. However, the method commonly used to measure this, the temporal order judgment (TOJ) task, has been criticized as susceptible to response bias, despite deliberate attempts to minimize such bias. A preferred alternative is the simultaneity judgment (SJ) task. We tested the prior-entry hypothesis for somatosensory stimuli using both a TOJ task (replicating an earlier experiment) and an SJ task. Prior-entry effects were found for both, though the effect was reduced in the SJ task. Additional experiments (TOJ and SJ) using visual cues established that the earlier perception of cued tactile targets does not result from intramodal sensory interactions between tactile cues and targets.     

Temporal order judgment criteria are affected by synchrony judgment sensitivity

Synchrony perception for audio-visual stimulus pairs is typically studied by using temporal order judgment (TOJ) or synchrony judgment (SJ) tasks. Research has shown that estimates of the point of subjective simultaneity (PSS) obtained using these two methods do not necessarily correspond. Here, we investigate the hypothesis that the PSS estimate obtained in a TOJ task is shifted in the direction of the most sensitive part of the synchrony judgment curve, as obtained in an SJ task. The results confirm that criterion shifts in the TOJ task move the PSS toward regions of the audio-visual temporal interval continuum where discriminations are most sensitive.     

Motor Planning Influences the Perceived Timing of Vibrotactile Stimuli in an Amplitude-Dependent Manner

The authors characterized how motor planning influences temporal order judgment (TOJ) tasks. They examined this by applying vibrotactile stimulation during the planning stages of a bimanual arm movement that would bring the arms into a crossed configuration. The authors have previously shown that planning to cross the arms induces a subjective reversal of spatially defined temporal order judgments that evolves over the course of the planning period. It was unclear, however, whether this effect is modulated by the extent to which the arms would be crossed after movement. The authors examined this issue by having participants plan to move to 4 different targets that would leave the arms in crossed configurations of varying extents. The results demonstrate that even though cutaneous stimuli were applied before the movements, if participants were planning to move into a more crossed configuration, performance on the TOJ task worsened depending on where they were in the planning process. This data suggest the brain uses planning signals to predict sensations from impending movements in a context-dependent manner.     

Inhibition and disinhibition of return: Evidence from temporal order judgments

In the present study the temporal order judgment (TOJ) task was used to investigate whether or not inhibition of return (IOR) affects perceptual processing. Previous failures to obtain IOR in the TOJ task have been taken to suggest that IOR does not affect perceptual processing (e.g., Maylor, 1985). The present study showed that IOR is modulated by the temporal disparity between successive targets as well as the relative order in which they appear at cued and uncued locations. Consequently, IOR affects TOJs in some conditions but not in others. The selective occurrence of IOR in the TOJ task provides converging support for the notion that IOR does affect perceptual processing, and also accounts for the previous failures to observe IOR in the TOJ task. Moreover, these and other results suggest that inhibitory processing at the cued location can be dis-inhibited when stimulation occurs at other locations.     

On the discrepant results in synchrony judgment and temporal-order judgment tasks: a quantitative model

Research on the perception of temporal order uses either temporal-order judgment (TOJ) tasks or synchrony judgment (SJ) tasks, in both of which two stimuli are presented with some temporal delay and observers must judge the order of presentation. Results generally differ across tasks, raising concerns about whether they measure the same processes. We present a model including sensory and decisional parameters that places these tasks in a common framework that allows studying their implications on observed performance. TOJ tasks imply specific decisional components that explain the discrepancy of results obtained with TOJ and SJ tasks. The model is also tested against published data on audiovisual temporal-order judgments, and the fit is satisfactory, although model parameters are more accurately estimated with SJ tasks. Measures of latent point of subjective simultaneity and latent sensitivity are defined that are invariant across tasks by isolating the sensory parameters governing observed performance, whereas decisional parameters vary across tasks and account for observed differences across them. Our analyses concur with other evidence advising against the use of TOJ tasks in research on perception of temporal order.     

Fitting model-based psychometric functions to simultaneity and temporal-order judgment data: MATLAB and R routines

Research on temporal-order perception uses temporal-order judgment (TOJ) tasks or synchrony judgment (SJ) tasks in their binary SJ2 or ternary SJ3 variants. In all cases, two stimuli are presented with some temporal delay, and observers judge the order of presentation. Arbitrary psychometric functions are typically fitted to obtain performance measures such as sensitivity or the point of subjective simultaneity, but the parameters of these functions are uninterpretable. We describe routines in MATLAB and R that fit model-based functions whose parameters are interpretable in terms of the processes underlying temporal-order and simultaneity judgments and responses. These functions arise from an independent-channels model assuming arrival latencies with exponential distributions and a trichotomous decision space. Different routines fit data separately for SJ2, SJ3, and TOJ tasks, jointly for any two tasks, or also jointly for the three tasks (for common cases in which two or even the three tasks were used with the same stimuli and participants). Additional routines provide bootstrap p-values and confidence intervals for estimated parameters. A further routine is included that obtains performance measures from the fitted functions. An R package for Windows and source code of the MATLAB and R routines are available as Supplementary Files.     

触觉时序知觉手臂交叉效应的性别差异

本研究探讨触觉时序知觉的手臂交叉效应是否存在性别差异。通过两个实验在较短和较长的SOA条件下考察男性和女性被试在基于体觉和基于外部空间的触觉时序判断任务中的表现。结果表明,男性与女性被试在基于体觉和基于外部空间的触觉时序判断任务中均存在手臂交叉效应,SOA较短时男性被试的手臂交叉效应显著小于女性被试,但在SOA较长的条件下手臂交叉效应没有明显的性别差异。触觉时序知觉手臂交叉效应的性别差异可能与空间知觉能力和生理解剖学因素有关。     

Temporal-order judgment and reaction time for short and long stimuli

Summary The effect of intensity on visual latency was investigated. Visual latency was measured by two methods: simple motor reaction time (RT) and temporalorder judgment (TOJ). It was found, in accordance with previous studies, that the changes in RT were larger than TOJ latency when measured in the same range of intensity. Moreover, the relationship between TOJ latency and intensity was compared in two conditions: under so-called with-offset, the information about offset order was available for the subject, while under without-offset conditions it was not. It was hypothesized on the ground of Jakowski's 1991 study that the TOJ latency-intensity relation should differ for these two conditions because of the effect of intensity on visual persistence. We were unable to find any such effect.