On the discrepant results in synchrony judgment and temporal-order judgment tasks: a quantitative model

Research on the perception of temporal order uses either temporal-order judgment (TOJ) tasks or synchrony judgment (SJ) tasks, in both of which two stimuli are presented with some temporal delay and observers must judge the order of presentation. Results generally differ across tasks, raising concerns about whether they measure the same processes. We present a model including sensory and decisional parameters that places these tasks in a common framework that allows studying their implications on observed performance. TOJ tasks imply specific decisional components that explain the discrepancy of results obtained with TOJ and SJ tasks. The model is also tested against published data on audiovisual temporal-order judgments, and the fit is satisfactory, although model parameters are more accurately estimated with SJ tasks. Measures of latent point of subjective simultaneity and latent sensitivity are defined that are invariant across tasks by isolating the sensory parameters governing observed performance, whereas decisional parameters vary across tasks and account for observed differences across them. Our analyses concur with other evidence advising against the use of TOJ tasks in research on perception of temporal order.     

Temporal order judgment criteria are affected by synchrony judgment sensitivity

Synchrony perception for audio-visual stimulus pairs is typically studied by using temporal order judgment (TOJ) or synchrony judgment (SJ) tasks. Research has shown that estimates of the point of subjective simultaneity (PSS) obtained using these two methods do not necessarily correspond. Here, we investigate the hypothesis that the PSS estimate obtained in a TOJ task is shifted in the direction of the most sensitive part of the synchrony judgment curve, as obtained in an SJ task. The results confirm that criterion shifts in the TOJ task move the PSS toward regions of the audio-visual temporal interval continuum where discriminations are most sensitive.     

Somatosensory prior entry assessed with temporal order judgments and simultaneity judgments

Attention is central to perception, yet a clear understanding of how attention influences the latency of perception has proven surprisingly elusive. Recent research has indicated that spatially attended stimuli are perceived earlier than unattended stimuli across a range of sensory modalities-an effect termed prior entry. However, the method commonly used to measure this, the temporal order judgment (TOJ) task, has been criticized as susceptible to response bias, despite deliberate attempts to minimize such bias. A preferred alternative is the simultaneity judgment (SJ) task. We tested the prior-entry hypothesis for somatosensory stimuli using both a TOJ task (replicating an earlier experiment) and an SJ task. Prior-entry effects were found for both, though the effect was reduced in the SJ task. Additional experiments (TOJ and SJ) using visual cues established that the earlier perception of cued tactile targets does not result from intramodal sensory interactions between tactile cues and targets.     

Audiovisual synchrony and temporal order judgments: effects of experimental method and stimulus type

When an audio-visual event is perceived in the natural environment, a physical delay will always occur between the arrival of the leading visual component and that of the trailing auditory component. This natural timing relationship suggests that the point of subjective simultaneity (PSS) should occur at an auditory delay greater than or equal to 0 msec. A review of the literature suggests that PSS estimates derived from a temporal order judgment (TOJ) task differ from those derived from a synchrony judgment (SJ) task, with (unnatural) auditory-leading PSS values reported mainly for the TOJ task. We report data from two stimulus types that differed in terms of complexity--namely, (1) a flash and a click and (2) a bouncing ball and an impact sound. The same participants judged the temporal order and synchrony of both stimulus types, using three experimental methods: (1) a TOJ task with two response categories ("audio first" or "video first"), (2) an SJ task with two response categories ("synchronous" or "asynchronous"; SJ2), and (3) an SJ task with three response categories ("audio first," "synchronous," or "video first"; SJ3). Both stimulus types produced correlated PSS estimates with the SJ tasks, but the estimates from the TOJ procedure were uncorrelated with those obtained from the SJ tasks. These results suggest that the SJ task should be preferred over the TOJ task when the primary interest is i n perceived audio-visualsynchrony.     

Better late than never: how onsets and offsets influence prior entry and exit

The three experiments presented in the paper examine visual prior entry (determining which of two stimuli appeared first) and prior exit (determining which of two stimuli disappeared first) effects with a temporal order judgment (TOJ) task. In addition to using onset and offset targets, the preceding cues also consisted of either onset or offset stimuli. Typical, and equivalent, prior entry effects were found when either onset or offset cues preceded the onset targets. Unexpectedly large prior exit effects where found with the offset targets, with offset cues producing greater capture effects than onset cues. These findings are consistent with the notion that more attention is allocated to searching the visual field when targets are more difficult to find. In addition, the results indicate that attentional control settings may be more likely to occur with more difficult searches. In addition, these findings demonstrate that TOJ tasks provide extremely precise measures of the allocation of attention and are very sensitive to a range of task manipulations.     

Spatial attention is necessary for object-based attention: Evidence from temporal-order judgments

Attentional selection is a dynamic process that relies on multiple types of representations. That object representations contribute to attentional selection has been known for decades; however, most evidence for this contribution has been gleaned from studies that have relied on various forms of spatial cueing (some endogenous and some exogenous). It has thus remained unclear whether object-based attentional selection is a direct result of spatial cuing, or whether it still emerges without any spatial marker. Here we used a novel method—the temporal-order judgment (TOJ)—to examine whether object-based guidance emerges in the absence of spatial cuing. Participants were presented with two rectangles oriented either horizontally or vertically. Following a 150-ms preview time, two target stimuli were presented on the same or on different objects, and participants were asked to report which of the two stimuli had appeared first. The targets consisted of stimuli that formed a percept of a “hole” or a “hill.” First, we demonstrated that the “hill” target was indeed processed faster, as evidenced by a positive perceived simultaneity (PSS) measure. We then demonstrated that if two targets appeared with equal probabilities on the same and on different objects, the PSS values, although positive, were not modulated by the objects. In a subsequent set of experiments, we showed that objects can modulate attentional allocation—however, only when they are biased by a spatial (endogenous) cue. In other words, in the absence of a spatial cue or bias, object representations do not guide attentional selection. In addition to providing new constraints for theories of object-based attentional guidance, these experiments introduce a novel paradigm for measuring object-based attentional effects.     

Perception of Temporal Order: The Effects of Age,Sex, and Cognitive Factors

ABSTRACT

The present paper investigates the effects of age, sex, and cognitive factors on temporal-order perception. Nine temporal-order tasks were employed using two and four stimuli presented in the auditory and visual modalities. Significantly increased temporal-order thresholds (TOT) in the elderly were found for almost all tasks, while sex differences were only observed for two tasks. Multiple regression analyses show that the performance on most temporal-order tasks can be predicted by cognitive factors, such as speed of fluid reasoning, short-term memory, and attention. However, age was a significant predictor of TOT in three tasks using visual stimuli. We conclude (1) that age-related differences can often be attributed to cognitive factors involved in temporal-order perception, and (2) that the concept of temporal-order perception is more complex than implied by the current models.     

Differential effects of visual-spatial attention on response latency and temporal-order judgment

Summary Theorists from both classical structuralism and modern attention research have claimed that attention to a sensory stimulus enhances processing speed. However, they have used different operations to measure this effect, viz., temporal-order judgment (TOJ) and reaction-time (RT) measurement. We report two experiments that compared the effect of a spatial cue on RT and TOJ. Experiment 1 demonstrated that a nonmasked, peripheral cue (the brief brightening of a box) affected both RT and TOJ. However, the former effect was significantly larger than the latter. A masked cue had a smaller, but reliable, effect on TOJ. In Experiment 2, the effects of a masked cue on RT and TOJ were compared under identical stimulus conditions. While the cue had a strong effect on RT, it left TOJ unaffected. These results suggest that a spatial cue may have dissociable effects on response processes and the processes that lead to a conscious percept. Implications for the concept of direct parameter specification and for theories of visual attention are discussed.     

Crossmodal temporal order and processing acuity in developmentally dyslexic young adults

We investigated crossmodal temporal performance in processing rapid sequential nonlinguistic events in developmentally dyslexic young adults (ages 20-36 years) and an age- and IQ-matched control group in audiotactile, visuotactile, and audiovisual combinations. Two methods were used for estimating 84% correct temporal acuity thresholds: temporal order judgment (TOJ) and temporal processing acuity (TPA). TPA requires phase difference detection: the judgment of simultaneity/nonsimultaneity of brief stimuli in two parallel, spatially separate triplets. The dyslexic readers' average temporal performance was somewhat poorer in all six comparisons; in audiovisual comparisons the group differences were not statistically significant, however. A principal component analysis indicated that temporal acuity and phonological awareness are related in dyslexic readers. The impairment of temporal input processing seems to be a general correlative feature of dyslexia in children and adults, but the overlap in performance between dyslexic and normal readers suggests that it is not a sufficient reason for developmental reading difficulties.     

触觉时序知觉手臂交叉效应的性别差异

本研究探讨触觉时序知觉的手臂交叉效应是否存在性别差异。通过两个实验在较短和较长的SOA条件下考察男性和女性被试在基于体觉和基于外部空间的触觉时序判断任务中的表现。结果表明,男性与女性被试在基于体觉和基于外部空间的触觉时序判断任务中均存在手臂交叉效应,SOA较短时男性被试的手臂交叉效应显著小于女性被试,但在SOA较长的条件下手臂交叉效应没有明显的性别差异。触觉时序知觉手臂交叉效应的性别差异可能与空间知觉能力和生理解剖学因素有关。     

Perception of intersensory synchrony in audiovisual speech: not that special

Perception of intersensory temporal order is particularly difficult for (continuous) audiovisual speech, as perceivers may find it difficult to notice substantial timing differences between speech sounds and lip movements. Here we tested whether this occurs because audiovisual speech is strongly paired (“unity assumption”). Participants made temporal order judgments (TOJ) and simultaneity judgments (SJ) about sine-wave speech (SWS) replicas of pseudowords and the corresponding video of the face. Listeners in speech and non-speech mode were equally sensitive judging audiovisual temporal order. Yet, using the McGurk effect, we could demonstrate that the sound was more likely integrated with lipread speech if heard as speech than non-speech. Judging temporal order in audiovisual speech is thus unaffected by whether the auditory and visual streams are paired. Conceivably, previously found differences between speech and non-speech stimuli are not due to the putative “special” nature of speech, but rather reflect low-level stimulus differences.     

Attentional bias toward low-intensity stimuli: an explanation for the intensity dissociation between reaction time and temporal order judgment?

If two stimuli need different times to be processed, this difference should in principle be reflected both by response times (RT) and by judgments of their temporal order (TOJ). However, several dissociations have been reported between RT and TOJ, e.g., RT is more affected than TOJ when stimulus intensity decreases. One account for these dissociations is to assume differences in the allocation of attention induced by the two tasks. To test this hypothesis, different distributions of attention were induced in the present study between two stimulus positions (above and below fixation). Only bright stimuli appeared in one position and either bright or dim stimuli in the other. In the two RT experiments, participants had to respond to every stimulus appearing in one of the two positions. Reaction times to bright stimuli were faster when they appeared in the position where dim stimuli were likely to occur. This finding suggests that the allocation of attention was adapted to the asymmetrical arrangement of stimuli, not suggested by explicit instruction. In the two TOJ experiments, the temporal order of stimuli appearing in the two positions had to be judged. Although bright stimuli appearing at the bright-and-dim location were judged to be earlier, this effect was small and insignificant. Further, the intensity dissociation between RT and TOJ was insensitive to random vs blockwise presentations of intensities, therefore was not modified by attentional preferences. Thus, asymmetrical arrangement of stimuli has an impact on the allocation of attention, but only in the RT task. Therefore dissociations between TOJ and response times cannot be accounted for by an attentional bias in the TOJ task but probably by different use of temporal information in the two tasks.     

听觉丧失对听障学生时间知觉的影响

本研究采用同时判断任务和时距二分任务,探讨了听觉丧失对听障学生视觉通道的时间知觉的影响及其机制。两个系列实验结果表明,听觉丧失损伤了听障学生视觉通道的时序知觉准确性、敏感性以及时距知觉的敏感性,支持了普遍缺陷假设;但是,听障学生视觉通道的时距知觉的准确性却未受到听觉丧失的显著影响,支持了知觉补偿假设。因此,听觉丧失对听障学生视觉通道的时间知觉的影响可能是基于选择性的机制,这主要取决于不同的时间任务以及知觉属性等因素。     

Two-stage model for order discrimination

Ulrich (1987), exploring the shapes of psychometric functions obtained in the ternary-response paradigm, indicated several inconsistencies between observed and predicted relationships providing evidence against most popular models of temporal-order judgment. In this paper, a new model is presented. It assumes that there are two mechanisms involved in the order discrimination task: one is responsible for the recognition of whether or not the stimuli are successive, and the second is able to determine their order. The model was tested using Allan's (1975a, 1975b) and Ulrich's (1987) data; the model predictions were found to be consistent with the experimental results.     

The "temporal processing deficit" hypothesis in dyslexia: new experimental evidence

The notion that developmental dyslexia may result from a general, nonspecific, defect in perceiving rapidly changing auditory signals is a current subject of debate (so-called "temporal processing deficit" hypothesis). Thirteen phonological dyslexics (age 10-13 years) and 10 controls matched for chronological and reading age were compared on a temporal order judgment (TOJ) task using the succession of two consonants (/p/-/s/) within a cluster. In order to test the relevance of the temporal deficit hypothesis, the task also included two additional conditions where either the two stimuli were artificially slowed or the interstimulus interval was expanded. As expected, the TOJ performance was significantly poorer in dyslexics than in controls. Moreover, in the "slowed speech" condition dyslexics' performance improved to reach the normal controls' level, whereas no significant improvement occurred when increasing the interstimulus interval. Finally dyslexics' performances, especially on the slowed condition, were found correlated with several tests of phonological processing (phoneme deletion, rhyme judgment, and nonword spelling tasks). These results lend support to the general temporal deficit theory of dyslexia.     

Estimating discrimination performance in two-alternative forced choice tasks: Routines for MATLAB and R

Ulrich and Vorberg (Attention, Perception, & Psychophysics 71: 1219–1227, 2009) introduced a novel approach for estimating discrimination performance in two-alternative forced choice (2AFC) tasks. This approach avoids pitfalls that are inherent when the order of the standard and the comparison is neglected in estimating the difference limen (DL), as in traditional approaches. The present article provides MATLAB and R routines that implement this novel procedure for estimating DLs. These routines also allow to account for processing failures such as lapses or finger errors and can be applied to experimental designs in which the standard and comparison differ only along the task-relevant dimension, as well as to designs in which the stimuli differ in more than one dimension. In addition, Monte Carlo simulations were conducted to check the quality of our routines.     

Dissociations between reaction times and temporal order judgments: a diffusion model approach

A diffusion model for simple reaction time (RT) and temporal order judgment (TOJ) tasks was developed to account for a commonly observed dissociation between these 2 tasks: Most stimulus manipulations (e.g., intensity) have larger effects in RT tasks than in TOJ tasks. The model assumes that a detection criterion determines the level of sensory evidence needed to conclude that a stimulus has been presented. Analysis of the performance that would be achieved with different possible criterion settings revealed that performance was optimal with a lower criterion setting for the TOJ task than for the RT task. In addition, the model predicts that effects of stimulus manipulations should increase with the size of the detection criterion. Thus, the model suggests that commonly observed dissociations between RT and TOJ tasks may simply be due to performance optimization in the face of conflicting task demands.     

Intensity resolution and subjective magnitude in psychophysical scaling

Several successful theories of psychophysical judgment imply that exponents of power functions in scaling tasks should covary with measures of intensity resolution such asd’ in the same tasks, whereas the prevailing metatheory of ideal psychophysical scaling asserts the independence of the two. In a direct test of this relationship, three prominent psychophysical scaling paradigms were studied: category judgment without an identification function, absolute magnitude estimation, and cross-modality matching with light intensity as the response continuum. Separate groups of subjects for each scaling paradigm made repeated judgments of the loudnesses of the pure tones that constituted each of two stimulus ensembles. The narrow- and wide-range ensembles shared six identical stimulus intensities in the middle of each set. Intensity resolution, as measured byd’-like distances, of these physically identical stimuli was significantly worse for the wide-range set for all three methods. Exponents of power functions fitted to geometric mean responses, and in magnitude estimation and cross-modality matching the geometric mean responses themselves, were also significantly smaller in the wide-range condition. The variation of power function exponents, and of psychophysical scale values, for stimulus intensities that were identical in the two stimulus sets with the intensities of other members of the ensembles is inconsistent with the metatheory on which modern psychophysical scaling practice is based, although it is consistent with other useful approaches to measurement of psychological magnitudes.     

The role of tone duration in dichotic temporal order judgment

Over the past two decades, a number of studies have been based on the dichotic temporal order judgment (TOJ) paradigm, to compare auditory temporal processing in various subpopulations to that of young, normal controls. The reported estimates of dichotic TOJ thresholds, expressed as the interstimulus intervals (ISIs) for 75 % accuracy among the controls, have varied. In the present study, we examined the influence of tone duration, within the 10- to 40-msec range, on dichotic TOJ accuracy and threshold. The results indicated that increases in either ISI or tone duration increased dichotic TOJ accuracy similarly, implying that changes in tone duration may affect dichotic TOJs simply by adding to the delay between onset of the tone at the lead ear and onset of the tone at the lag ear. The dichotic TOJ thresholds from three published studies that had used tones as stimuli and the dichotic thresholds from the present study all fell within 0.5 standard deviations from the theoretical line of a 10-msec reduction in threshold for every 10-msec increase in tone duration. When the dichotic TOJ threshold data from the present study and from the published studies were converted to stimulus onset asynchronies (SOAs) and plotted as a function of tone duration, they fell very close to or on a zero-slope line, indicating that when ISI and duration are summed to yield an SOA, dichotic TOJ thresholds are invariant to tone duration within the range of 10–40 msec.     

Temporal order and processing acuity of visual,auditory, and tactile perception in developmentally dyslexic young adults

We studied the temporal acuity of 16 developmentally dyslexic young adults in three perceptual modalities. The control group consisted of 16 age- and IQ-matched normal readers. Two methods were used. In the temporal order judgment (TOJ) method, the stimuli were spatially separate fingertip indentations in the tactile system, tone bursts of different pitches in audition, and light flashes in vision. Participants indicated which one of two stimuli appeared first. To test temporal processing acuity (TPA), the same 8-msec nonspeech stimuli were presented as two parallel sequences of three stimulus pulses. Participants indicated, without order judgments, whether the pulses of the two sequences were simultaneous or nonsimultaneous. The dyslexic readers were somewhat inferior to the normal readers in all six temporal acuity tasks on average. Thus, our results agreed with the existence of a pansensory temporal processing deficit associated with dyslexia in a language with shallow orthography (Finnish) and in well-educated adults. The dyslexic and normal readers' temporal acuities overlapped so much, however, that acuity deficits alone would not allow dyslexia diagnoses. It was irrelevant whether or not the acuity task required order judgments. The groups did not differ in the nontemporal aspects of our experiments. Correlations between temporal acuity and reading-related tasks suggested that temporal acuity is associated with phonological awareness.