Temporal order judgment criteria are affected by synchrony judgment sensitivity

Synchrony perception for audio-visual stimulus pairs is typically studied by using temporal order judgment (TOJ) or synchrony judgment (SJ) tasks. Research has shown that estimates of the point of subjective simultaneity (PSS) obtained using these two methods do not necessarily correspond. Here, we investigate the hypothesis that the PSS estimate obtained in a TOJ task is shifted in the direction of the most sensitive part of the synchrony judgment curve, as obtained in an SJ task. The results confirm that criterion shifts in the TOJ task move the PSS toward regions of the audio-visual temporal interval continuum where discriminations are most sensitive.     

Audiovisual synchrony and temporal order judgments: effects of experimental method and stimulus type

When an audio-visual event is perceived in the natural environment, a physical delay will always occur between the arrival of the leading visual component and that of the trailing auditory component. This natural timing relationship suggests that the point of subjective simultaneity (PSS) should occur at an auditory delay greater than or equal to 0 msec. A review of the literature suggests that PSS estimates derived from a temporal order judgment (TOJ) task differ from those derived from a synchrony judgment (SJ) task, with (unnatural) auditory-leading PSS values reported mainly for the TOJ task. We report data from two stimulus types that differed in terms of complexity--namely, (1) a flash and a click and (2) a bouncing ball and an impact sound. The same participants judged the temporal order and synchrony of both stimulus types, using three experimental methods: (1) a TOJ task with two response categories ("audio first" or "video first"), (2) an SJ task with two response categories ("synchronous" or "asynchronous"; SJ2), and (3) an SJ task with three response categories ("audio first," "synchronous," or "video first"; SJ3). Both stimulus types produced correlated PSS estimates with the SJ tasks, but the estimates from the TOJ procedure were uncorrelated with those obtained from the SJ tasks. These results suggest that the SJ task should be preferred over the TOJ task when the primary interest is i n perceived audio-visualsynchrony.     

触觉时序知觉手臂交叉效应的性别差异

本研究探讨触觉时序知觉的手臂交叉效应是否存在性别差异。通过两个实验在较短和较长的SOA条件下考察男性和女性被试在基于体觉和基于外部空间的触觉时序判断任务中的表现。结果表明,男性与女性被试在基于体觉和基于外部空间的触觉时序判断任务中均存在手臂交叉效应,SOA较短时男性被试的手臂交叉效应显著小于女性被试,但在SOA较长的条件下手臂交叉效应没有明显的性别差异。触觉时序知觉手臂交叉效应的性别差异可能与空间知觉能力和生理解剖学因素有关。     

Better late than never: how onsets and offsets influence prior entry and exit

The three experiments presented in the paper examine visual prior entry (determining which of two stimuli appeared first) and prior exit (determining which of two stimuli disappeared first) effects with a temporal order judgment (TOJ) task. In addition to using onset and offset targets, the preceding cues also consisted of either onset or offset stimuli. Typical, and equivalent, prior entry effects were found when either onset or offset cues preceded the onset targets. Unexpectedly large prior exit effects where found with the offset targets, with offset cues producing greater capture effects than onset cues. These findings are consistent with the notion that more attention is allocated to searching the visual field when targets are more difficult to find. In addition, the results indicate that attentional control settings may be more likely to occur with more difficult searches. In addition, these findings demonstrate that TOJ tasks provide extremely precise measures of the allocation of attention and are very sensitive to a range of task manipulations.     

Task-irrelevant sounds influence both temporal order and apparent-motion judgments about tactile stimuli applied to crossed and uncrossed hands

It has been suggested that judgments about the temporal–spatial order of successive tactile stimuli depend on the perceived direction of apparent motion between them. Here we manipulated tactile apparent-motion percepts by presenting a brief, task-irrelevant auditory stimulus temporally in-between pairs of tactile stimuli. The tactile stimuli were applied one to each hand, with varying stimulus onset asynchronies (SOAs). Participants reported the location of the first stimulus (temporal order judgments: TOJs) while adopting both crossed and uncrossed hand postures, so we could scrutinize skin-based, anatomical, and external reference frames. With crossed hands, the sound improved TOJ performance at short (≤300 ms) and at long (>300 ms) SOAs. When the hands were uncrossed, the sound induced a decrease in TOJ performance, but only at short SOAs. A second experiment confirmed that the auditory stimulus indeed modulated tactile apparent motion perception under these conditions. Perceived apparent motion directions were more ambiguous with crossed than with uncrossed hands, probably indicating competing spatial codes in the crossed posture. However, irrespective of posture, the additional sound tended to impair potentially anatomically coded motion direction discrimination at a short SOA of 80 ms, but it significantly enhanced externally coded apparent motion perception at a long SOA of 500 ms. Anatomically coded motion signals imply incorrect TOJ responses with crossed hands, but correct responses when the hands are uncrossed; externally coded motion signals always point toward the correct TOJ response. Thus, taken together, these results suggest that apparent-motion signals are likely taken into account when tactile temporal–spatial information is reconstructed.

     

Audiotactile temporal order judgments

We report a series of three experiments in which participants made unspeeded 'Which modality came first?' temporal order judgments (TOJs) to pairs of auditory and tactile stimuli presented at varying stimulus onset asynchronies (SOAs) using the method of constant stimuli. The stimuli were presented from either the same or different locations in order to explore the potential effect of redundant spatial information on audiotactile temporal perception. In Experiment 1, the auditory and tactile stimuli had to be separated by nearly 80 ms for inexperienced participants to be able to judge their temporal order accurately (i.e., for the just noticeable difference (JND) to be achieved), no matter whether the stimuli were presented from the same or different spatial positions. More experienced psychophysical observers (Experiment 2) also failed to show any effect of relative spatial position on audiotactile TOJ performance, despite having much lower JNDs (40 ms) overall. A similar pattern of results was found in Experiment 3 when silent electrocutaneous stimulation was used rather than vibrotactile stimulation. Thus, relative spatial position seems to be a less important factor in determining performance for audiotactile TOJ than for other modality pairings (e.g., audiovisual and visuotactile).     

判断框架对时序知觉位置启动效应的影响

研究采用包含两种判断框架（判断刺激出现的先后次序）的时序判断任务探讨了决策偏向对时序知觉位置启动效应的影响。实验结果表明,时序知觉中存在着位置启动效应,而且在两个靶刺激出现时间间隔不同时,被试在“哪个靶刺激先出现”和“哪个靶刺激后出现”两种判断框架下的正确率存在显著差异,但在两个靶刺激同时出现时并没有出现显著的判断框架效应。因此,本研究推测时序知觉位置启动效应的作用机制不仅包括知觉增强加工过程,而且也与认知决策有关,这为反应偏向理论提供了新的支持证据。     

The effect of motion on tactile and visual temporal order judgments

Four experiments were conducted, three with tactile stimuli and one with visual stimuli, in which subjects made temporal order judgments (TOJs). The tactile stimuli were patterns that moved laterally across the fingerpads. The subject's task was to judge which finger received the pattern first. Even though the movement was irrelevant to the task, the subjects' TOJs were greatly affected by the direction of movement of the patterns. Accuracy in judging temporal order was enhanced when the patterns moved in a direction that was consistent with the temporal order of presentation--for example, when the movement on each fingerpad was from right to left and the temporally leading site of stimulation was to the right of the temporally trailing site of stimulation. When movement was inconsistent with the temporal order of presentation, accuracy was considerably reduced, often well below chance.The bias in TOJs was unaffected by training or by presenting the stimuli to fingers on opposite hands. In a fourth experiment, subjects judged the temporal order of visual stimuli that, like the tactile stimuli, moved in a direction that was either consistent or inconsistent with the TOJ. The results were similar to those obtained with tactile stimuli. It is suggested that the bias may be affected by attentional mechanisms and by apparent motion generated between the two sites on the skin.     

On the discrepant results in synchrony judgment and temporal-order judgment tasks: a quantitative model

Research on the perception of temporal order uses either temporal-order judgment (TOJ) tasks or synchrony judgment (SJ) tasks, in both of which two stimuli are presented with some temporal delay and observers must judge the order of presentation. Results generally differ across tasks, raising concerns about whether they measure the same processes. We present a model including sensory and decisional parameters that places these tasks in a common framework that allows studying their implications on observed performance. TOJ tasks imply specific decisional components that explain the discrepancy of results obtained with TOJ and SJ tasks. The model is also tested against published data on audiovisual temporal-order judgments, and the fit is satisfactory, although model parameters are more accurately estimated with SJ tasks. Measures of latent point of subjective simultaneity and latent sensitivity are defined that are invariant across tasks by isolating the sensory parameters governing observed performance, whereas decisional parameters vary across tasks and account for observed differences across them. Our analyses concur with other evidence advising against the use of TOJ tasks in research on perception of temporal order.     

Change of reference frame for tactile localization during child development

Temporal order judgements (TOJ) for two tactile stimuli, one presented to the left and one to the right hand, are less precise when the hands are crossed over the midline than when the hands are uncrossed. This ‘crossed hand’ effect has been considered as evidence for a remapping of tactile input into an external reference frame. Since late, but not early, blind individuals show such remapping, it has been hypothesized that the use of an external reference frame develops during childhood. Five‐ to 10‐year‐old children were therefore tested with the tactile TOJ task, both with uncrossed and crossed hands. Overall performance in the TOJ task improved with age. While children older than 5½ years displayed a crossed hand effect, younger children did not. Therefore the use of an external reference frame for tactile, and possibly multisensory, localization seems to be acquired at age 5.     

Fitting model-based psychometric functions to simultaneity and temporal-order judgment data: MATLAB and R routines

Research on temporal-order perception uses temporal-order judgment (TOJ) tasks or synchrony judgment (SJ) tasks in their binary SJ2 or ternary SJ3 variants. In all cases, two stimuli are presented with some temporal delay, and observers judge the order of presentation. Arbitrary psychometric functions are typically fitted to obtain performance measures such as sensitivity or the point of subjective simultaneity, but the parameters of these functions are uninterpretable. We describe routines in MATLAB and R that fit model-based functions whose parameters are interpretable in terms of the processes underlying temporal-order and simultaneity judgments and responses. These functions arise from an independent-channels model assuming arrival latencies with exponential distributions and a trichotomous decision space. Different routines fit data separately for SJ2, SJ3, and TOJ tasks, jointly for any two tasks, or also jointly for the three tasks (for common cases in which two or even the three tasks were used with the same stimuli and participants). Additional routines provide bootstrap p-values and confidence intervals for estimated parameters. A further routine is included that obtains performance measures from the fitted functions. An R package for Windows and source code of the MATLAB and R routines are available as Supplementary Files.     

Dissociations between reaction times and temporal order judgments: a diffusion model approach

A diffusion model for simple reaction time (RT) and temporal order judgment (TOJ) tasks was developed to account for a commonly observed dissociation between these 2 tasks: Most stimulus manipulations (e.g., intensity) have larger effects in RT tasks than in TOJ tasks. The model assumes that a detection criterion determines the level of sensory evidence needed to conclude that a stimulus has been presented. Analysis of the performance that would be achieved with different possible criterion settings revealed that performance was optimal with a lower criterion setting for the TOJ task than for the RT task. In addition, the model predicts that effects of stimulus manipulations should increase with the size of the detection criterion. Thus, the model suggests that commonly observed dissociations between RT and TOJ tasks may simply be due to performance optimization in the face of conflicting task demands.     

Inhibition and disinhibition of return: Evidence from temporal order judgments

In the present study the temporal order judgment (TOJ) task was used to investigate whether or not inhibition of return (IOR) affects perceptual processing. Previous failures to obtain IOR in the TOJ task have been taken to suggest that IOR does not affect perceptual processing (e.g., Maylor, 1985). The present study showed that IOR is modulated by the temporal disparity between successive targets as well as the relative order in which they appear at cued and uncued locations. Consequently, IOR affects TOJs in some conditions but not in others. The selective occurrence of IOR in the TOJ task provides converging support for the notion that IOR does affect perceptual processing, and also accounts for the previous failures to observe IOR in the TOJ task. Moreover, these and other results suggest that inhibitory processing at the cued location can be dis-inhibited when stimulation occurs at other locations.     

Multisensory temporal order judgments: when two locations are better than one

In Experiment 1, participants were presented with pairs of stimuli (one visual and the other tactile) from the left and/or right of fixation at varying stimulus onset asynchronies and were required to make unspeeded temporal order judgments (TOJs) regarding which modality was presented first. When the participants adopted an uncrossed-hands posture, just noticeable differences (JNDs) were lower (i.e., multisensory TOJs were more precise) when stimuli were presented from different positions, rather than from the same position. This spatial redundancy benefit was reduced when the participants adopted a crossed-hands posture, suggesting a failure to remap visuotactile space appropriately. In Experiment 2, JNDs were also lower when pairs of auditory and visual stimuli were presented from different positions, rather than from the same position. Taken together, these results demonstrate that people can use redundant spatial cues to facilitate their performance on multisensory TOJ tasks and suggest that previous studies may have systematically overestimated the precision with which people can make such judgments. These results highlight the intimate link between spatial and temporal factors in determining our perception of the multimodal objects and events in the world around us.     

Disinhibition of return: Unnecessary and unlikely

Recently, from data obtained with a temporal order judgment (TOJ) task, Gibson and Egeth (1994) concluded that inhibition of return (IOR; a response time effect that reveals slower responding to targets at previously cued versus uncued locations) reflects impaired perceptual processing. By replotting their data, we demonstrate that the perception of temporal order is influenced only by the facilitatory effect of a cue at short stimulus onset asynchronies (SOAs) and is unaffected by IOR at long SO As. The target paper proposed that, when extra stimuli are presented at task-relevant locations (i.e., in the TOJ task), IOR is prevented by a hypothetical process that is known as disinhibition of return (DOR). We argue that the assumptions that IOR affects perceptual processing and that DOR exists are unnecessary, as a more parsimonious response-based interpretation of IOR is consistent with their data. Further, we summarize recent results and present new data that demonstrate that DOR is unlikely.     

Somatosensory prior entry

The perceived timing of sensory events does not necessarily match the actual timing. In the present study, we investigated the effect of location of attention on the perceived timing of somatosensory stimuli. Participants judged the temporal order of two taps, delivered one to each hand, with taps presented at different elevations (upper and lower) on the opposing hands. The task was to discriminate the elevation of the tap presented first (or second). This vertical discrimination task was orthogonal to the horizontal attentional cuing manipulation, removing the response bias confound that has undermined earlier studies investigating the impact of attention on the perceived timing of sensory stimuli. We manipulated spatial attention either (1) exogenously (Experiment 1) in 13 participants, using brief taps to either the left or right hand, or (2) endogenously (Experiment 2) in 22 participants, using centrally presented symbolic cues. The results supported the hypothesis that attended stimuli are perceived more rapidly than unattended stimuli. This effect was larger when attention was exogenously manipulated. Previous research has demonstrated a similar effect for visual stimuli. The present study, which extends this result to somatosensory perception, indicates that the phenomenon may represent a more global feature of the perceptual system, which is possibly mediated by a common modality-independent mechanism.     

Attentional bias toward low-intensity stimuli: an explanation for the intensity dissociation between reaction time and temporal order judgment?

If two stimuli need different times to be processed, this difference should in principle be reflected both by response times (RT) and by judgments of their temporal order (TOJ). However, several dissociations have been reported between RT and TOJ, e.g., RT is more affected than TOJ when stimulus intensity decreases. One account for these dissociations is to assume differences in the allocation of attention induced by the two tasks. To test this hypothesis, different distributions of attention were induced in the present study between two stimulus positions (above and below fixation). Only bright stimuli appeared in one position and either bright or dim stimuli in the other. In the two RT experiments, participants had to respond to every stimulus appearing in one of the two positions. Reaction times to bright stimuli were faster when they appeared in the position where dim stimuli were likely to occur. This finding suggests that the allocation of attention was adapted to the asymmetrical arrangement of stimuli, not suggested by explicit instruction. In the two TOJ experiments, the temporal order of stimuli appearing in the two positions had to be judged. Although bright stimuli appearing at the bright-and-dim location were judged to be earlier, this effect was small and insignificant. Further, the intensity dissociation between RT and TOJ was insensitive to random vs blockwise presentations of intensities, therefore was not modified by attentional preferences. Thus, asymmetrical arrangement of stimuli has an impact on the allocation of attention, but only in the RT task. Therefore dissociations between TOJ and response times cannot be accounted for by an attentional bias in the TOJ task but probably by different use of temporal information in the two tasks.     

Do working memory-driven attention shifts speed up visual awareness?

Previous research has shown that content representations in working memory (WM) can bias attention in favor of matching stimuli in the scene. Using a visual prior-entry procedure, we here investigate whether such WM-driven attention shifts can speed up the conscious awareness of memory-matching relative to memory-mismatching stimuli. Participants were asked to hold a color cue in WM and to subsequently perform a temporal order judgment (TOJ) task by reporting either of two different-colored circles (presented to the left and right of fixation with a variable temporal interval) as having the first onset. One of the two TOJ circles could match the memory cue in color. We found that awareness of the temporal order of the circle onsets was not affected by the contents of WM, even when participants were explicitly informed that one of the TOJ circles would always match the WM contents. The null effect of WM on TOJs was not due to an inability of the memory-matching item to capture attention, since response times to the target in a follow-up experiment were improved when it appeared at the location of the memory-matching item. The present findings suggest that WM-driven attention shifts cannot accelerate phenomenal awareness of matching stimuli in the visual field.     

Increased visual bias in children with developmental coordination disorder: Evidence from a visual-tactile temporal order judgment task

BackgroundPrevious studies have suggested that children with developmental coordination disorder (DCD) rely heavily on vision to perform movements, which may contribute to their clumsy movements. However, few studies have objectively and quantitatively investigated the perceptual biases of children with DCD.MethodsA visual-tactile temporal order judgment (TOJ) task was used to measure and compare the perceptual biases of 19 children with DCD and 19 age- and sex-matched typically developing children. The point of subjective equality, which demonstrates when “visual first” and “tactile first” judgment probabilities are equal (50%), obtained by analyzing the results of the visual-tactile TOJ task, was used as an indicator of perceptual biases. Further, variables (age and manual dexterity in all participants; motor function, autism spectrum disorder and attention-deficit hyperactivity disorder traits, and depressive symptoms in children with DCD) associated with perceptual biases were examined with correlation analysis.ResultsChildren with DCD had significantly stronger visual bias than typically developing children. Overall correlation analysis showed that increased visual bias was significantly correlated with poor manual dexterity.ConclusionChildren with DCD had a strong visual bias, which was associated with poor manual dexterity.     

Investigating the time course of tactile reflexive attention using a non-spatial discrimination task

Peripheral cues are thought to facilitate responses to stimuli presented at the same location because they lead to exogenous attention shifts. Facilitation has been observed in numerous studies of visual and auditory attention, but there have been only four demonstrations of tactile facilitation, all in studies with potential confounds. Three studies used a spatial (finger versus thumb) discrimination task, where the cue could have provided a spatial framework that might have assisted the discrimination of subsequent targets presented on the same side as the cue. The final study circumvented this problem by using a non-spatial discrimination; however, the cues were informative and interspersed with visual cues which may have affected the attentional effects observed. In the current study, therefore, we used a non-spatial tactile frequency discrimination task following a non-informative tactile white noise cue. When the target was presented 150 ms after the cue, we observed faster discrimination responses to targets presented on the same side compared to the opposite side as the cue; by 1000 ms, responses were significantly faster to targets presented on the opposite side to the cue. Thus, we demonstrated that tactile attentional facilitation can be observed in a non-spatial discrimination task, under unimodal conditions and with entirely non-predictive cues. Furthermore, we provide the first demonstration of significant tactile facilitation and tactile inhibition of return within a single experiment.