Stochastic Dynamic Models of Response Time and Accuracy: A Foundational Primer

A large class of statistical decision models for performance in simple information processing tasks can be described by linear, first-order, stochastic differential equations (SDEs), whose solutions are diffusion processes. In such models, the first passage time for the diffusion process through a response criterion determines the time at which an observer makes a decision about the identity of a stimulus. Because the assumptions of many cognitive models lead to SDEs that are time inhomogeneous, classical methods for solving such first passage time problems are usually inapplicable. In contrast, recent integral equation methods often yield solutions to both the one-sided and the two-sided first passage time problems, even in the presence of time inhomogeneity. These methods, which are of particular relevance to the cognitive modeler, are described in detail, together with illustrative applications. Copyright 2000 Academic Press.     

Unilateral versus bilateral presentation methods in the reaction time paradigm

The use of bilateral presentation in lateralized tachistoscopic reaction time (RT) tasks has been precluded by problems of how to instruct the subject to respond to the left visual field (LVF) or right visual field (RVF) stimulus and by the necessity of fixation control with bilateral presentation. Schmuller and Goodman, 1979 and Schmuller and Goodman, 1980, Brain and Language, 11, 12–18) offered a method, applied to date only in recognition accuracy studies, which can overcome these problems. They used an “arrowhead pointer” at fixation. This instructs the subject as to which stimulus to report first and also controls fixation. We adapted the method to the RT paradigm by having subjects report only the stimulus indicated and applied it in a bilateral presentation version of the Object Naming Latency Task (W. F. McKeever & T. L. Jackson, 1979, Brain and Language, 7, 175–190). Fifty subjects received the unilateral task and 50 received the bilateral task. The bilateral task yielded right visual field superiority in 98% of the subjects and the magnitude of the superiority was over three times as large as in the unilateral task. Different sex × familial sinistrality × VHF interactions obtained on the tasks. Combining the advantages of reaction time and bilateral presentation methods may substantially increase the resolving power of lateralized tachistoscopic tasks.     

7岁超常和常态儿童的信息加工速度

该研究以超常和常态儿童各25名(平均年龄分别为6岁10个月和6岁11个月)为被试,以选择反应、图形匹配、心理旋转、和抽象匹配为基本认知任务,对超常和常态儿童的信息加工速度作了比较研究。研究者对被试的正确率和反应时作了分析。结果表明：(1)超常儿童基本信息加工能力显著优于普通儿童,具体表现在反应时更短,或正确率更高。(2)超常儿童与常态儿童信息、加工的差异与任务难度有关,在选择反应和图形匹配任务中,超常儿童的反应时显著短于常态儿童。而且,在图形匹配任务中,任务难度越大,差异越显著。而在心里旋转和抽象匹配任务中,超常儿童的正确率显著高于常态儿童。(3)任务的难度无论对超常组被试还是常态组被试的反应时及反应正确率都有影响,但影响方式不太一样。在反应时上,随着任务难度的增加,两组被试的反应时都明显延长;但在正确率上,则随着任务难度的增加,常态组被试的正确率降低,而超常组被试的正确率基本稳定在一个较高的水平上,即任务难度问的差异不显著。     

定长CD-CAT中两种新的题目曝光控制方法

提出了两种适用于定长CD-CAT的题目曝光控制方法（HIRP、HIRT）,这些方法在保证较高分类准确率的同时还有较合理的题目曝光率,新方法由二分化方法和RP及RT方法进行结合并适当调整而得到。模拟研究比较了其与RP、RT、SM、SMIE、RHA和SDBS的表现,结果表明: （1）HIRP的分类准确率和题目曝光率均好于SM、SMIE和SDBS;（2）HIRT的题目曝光率较RP、SM、SMIE、RHA和SDBS稍差,但分类准确率更高;（3）HIRP的分类准确率低于RT和RP,但题目曝光控制要更好。     

An ARC-REM model for accuracy and response time in recognition and recall

This article presents a model for accuracy and response time (RT) in recognition and cued recall, fitted to free-response and signal-to-respond data from Experiment 1 of P. A. Nobel and R. M. Shiffrin (2001). The model posits that recognition operates through parallel activation in a single retrieval step and cued recall operates as a sequential search. Because the data for recognition showed that variations in list length and study time per list had a large effect on accuracy but a small or negligible effect on (a) free-response RT distributions and (b) retrieval dynamics in signal-to-respond, the timing of the recognition decision is based on an assessment of retrieval completion (ARC), rather than on a sufficiency of evidence in favor of 1 of the response options. By assuming within-trial forgetting, the model predicts both the dissociation of accuracy and RT and the finding that errors are slower than correct responses. For cued recall, this model was incorporated as the 1st step in a search consisting of cycles of sampling and recovery.     

反应时方法的新进展

反应时以数量化的方式来反映人的各种心理和生理指标,是实验心理学中常用的反应变量之一。反应时经过两个发展阶段之后,在认知心理学(特别是内隐社会认知研究)和测量仪器两个方面又有了新的发展。由于反应时是时间和速度的测量内容,为了保证研究结果的准确性,在采用反应时法时必须考虑速度-准确性权衡问题。     

The Ornstein-Uhlenbeck model for decision time in cognitive tasks: An example of control of nonlinear network dynamics

The Ornstein-Uhlenbeck (OU) model for human decision-making has been successfully applied to account for response accuracy and response time (RT) data in recent two-choice decision models. A variant of the OU model is shown to arise from the response dynamics of a nonlinear network consisting of randomly connected neural processing units. When feedback control of the network is effected by the stimulus onset, the average network response is an autocorrelated random signal satisfying the stochastic differential equation for the OU process. An alternative, more general, stimulus detection procedure is proposed which involves the use of an adaptive Kalman filter process to track any temporal change in autoregressive parameters. The predicted decision time distributions suggest that both the OU and the Kalman filter processes can serve as alternative models for RT data in experimental tasks. Received: 15 October 1998 / Accepted: 27 May 1999     

Distinguishing common and task-specific processes in word identification: a matter of some moment?

The same 500 words were presented in 6 different word identification tasks (Experiment 1: lexical decision, semantic categorization, and 3 speeded naming tasks; Experiment 2: delayed naming). Reaction time (RT) distributions were estimated for each task and analyses tested for the effects of word frequency and animacy on various parameters of the RT distribution. Low frequency words yielded more skewed distributions than high frequency words in all tasks except delayed naming. The differential skew was most marked for tasks that required lexical discrimination. The semantic categorization task yielded highly skewed distributions for all words, but the word frequency effect was due to shifts in the location of the RT distributions rather than changes in skew. The results are used to evaluate the relative contributions of a common lexical access process and task-specific processes to performance in lexical discrimination and naming tasks.     

Individual and group differences in intelligence and speed of information processing

A battery of eight different reaction time (RT) tests, measuring the speed with which individuals perform various elementary cognitive processes, and a group test of scholastic aptitude (the Armed Services Vocational Aptitude Battery, ASVAB) were given to 50 black and 56 white male vocational college students. The regression of the general factor scores of the ASVAB on the RT measures yielded a shrunken multiple correlation of 0.465. Although discriminant analyses, when applied separately to the ASVAB subtests and to the RT variables, showed highly comparable overall discrimination (over 70% correct classification) between the black and white groups, factor scores derived from the general factor (labeled ‘speed of information processing’) of the RT battery show only about one-third as large a mean black-white difference as the mean group difference on the general factor scores derived from the ASVAB. Comparisons were also made between the 106 vocational college students and 100 university students of higher average academic aptitude who had previously been tested on the same RT battery (Vernon, 1983a). These groups showed marked differences on the RT variables, the largest differences occuring on the tests that required more complex cognitive processing. The more complex RT tests also correlate most highly with the psychometric measures of ability within each group. The results are consistent with the hypothesis that individual differences and the mean differences between groups in psychometric abilities and scholastic achievement are related to differences in the speed of information processing as measured in elementary cognitive tasks.     

The Effect of Feedback Schedule Manipulation on Speech Priming Patterns and Reaction Time

Speech priming tasks are frequently used to delineate stages in the speech process such as lexical retrieval and motor programming. These tasks, often measured in reaction time (RT), require fast and accurate responses, reflecting maximized participant performance, to result in robust priming effects. Encouraging speed and accuracy in responding can take many forms, including verbal instructions and feedback, and often involves visually displayed RT feedback. However, it is uncertain how manipulation of the schedule of this RT feedback influences speech RT speed and, ultimately, the priming effect. This experiment examined the effect of visually presented RT feedback schedules on priming patterns in 20 older healthy adults. Results suggested that feedback schedule manipulation had a differential effect on reaction time, depending on the interstimulus interval between the prime and the target, but no effect on response priming patterns.     

Equivalent effects of grouping by time, voice, and location on response timing in verbal serial memory

The grouping of list items is known to improve serial memory accuracy and constrain the nature of temporal errors. A recent study (M. T. Maybery, F. B. R. Parmentier, & D. M. Jones, 2002) showed that grouping results in a temporal organization of the participants' responses that mimics the list structure but not the timing of its presentation. Here the authors tested the prediction that the temporal grouping of responses should yield the same pattern of response time (RT) irrespective of the method of grouping at presentation. Comparing temporal, location, and voice grouping, the results show that although these methods impact on recall accuracy to varying degrees, all 3 conditions produce significant and equivalent peaks in RT at the first position of each group. The RT data were accurately simulated through a model based on ACT-R's (J. R. Anderson & M. Matessa, 1997) basic principles. Altogether, the data suggest that the temporal organization of responses in verbal serial recall results from (a) declarative knowledge about the list's structure that is independent of the perceptual means by which grouping is induced at presentation and (b) the level of activation of the items per se.     

Item selection methods with exposure and time control for computerized classification test

Computerized classification testing (CCT) commonly chooses items maximizing information at the cut score, which yields the most information for decision-making. However, a corollary problem is that all examinees will be given the same set of items, resulting in high test overlap rate and unbalanced item bank usage, which threatens test security. Moreover, another pivotal issue for CCT is time control. Since both the extremely long response time (RT) and large RT variability across examinees intensify time-induced anxiety, it is crucial to reduce the number of examinees exceeding the time limitation and the differences between examinees' test-taking times. To satisfy these practical needs, this paper proposes the novel idea of stage adaptiveness to tailor the item selection process to the decision-making requirement in each step and generate fresh insight into the existing response time selection method. Results indicate that a balanced item usage as well as short and stable test times across examinees can be achieved via the new methods.     

The inability to ignore auditory distractors as a function of visual task perceptual load

Using a response competition paradigm, we investigated the ability to ignore target response-compatible, target response-incompatible, and neutral visual and auditory distractors presented during a visual search task. The perceptual load model of attention (e.g., Lavie & Tsal, 1994) states that task-relevant processing load determines irrelevant distractor processing in such a way that increasing processing load prevents distractor processing. In three experiments, participants searched sets of one (easy search) or six (hard search) similar items. In Experiment 1, visual distractors influenced reaction time (RT) and accuracy only for easy searches, following the perceptual load model. Surprisingly, auditory distractors yielded larger distractor compatibility effects (median RT for incompatible trials minus median RT for compatible trials) for hard searches than for easy searches. In Experiments 2 and 3, during hard searches, consistent RT benefits with response-compatible and RT costs with response-incompatible auditory distractors occurred only for hard searches. We suggest that auditory distractors are processed regardless of visual perceptual load but that the ability to inhibit cross-modal influence from auditory distractors is reduced under high visual load.     

Psychometric Modeling of response speed and accuracy with mixed and conditional regression

Human performance in cognitive testing and experimental psychology is expressed in terms of response speed and accuracy. Data analysis is often limited to either speed or accuracy, and/or to crude summary measures like mean response time (RT) or the percentage correct responses. This paper proposes the use of mixed regression for the psychometric modeling of response speed and accuracy in testing and experiments. Mixed logistic regression of response accuracy extends logistic item response theory modeling to multidimensional models with covariates and interactions. Mixed linear regression of response time extends mixed ANOVA to unbalanced designs with covariates and heterogeneity of variance. Related to mixed regression is conditional regression, which requires no normality assumption, but is limited to unidimensional models. Mixed and conditional methods are both applied to an experimental study of mental rotation. Univariate and bivariate analyzes show how within-subject correlation between response and RT can be distinguished from between-subject correlation, and how latent traits can be detected, given careful item design or content analysis. It is concluded that both response and RT must be recorded in cognitive testing, and that mixed regression is a versatile method for analyzing test data.I am grateful to Rogier Donders for putting his data at my disposal.     

Does a time-monitoring deficit influence older adults' delayed retrieval shift during skill acquisition?

The authors evaluated age-related time-monitoring deficits and their contribution to older adults' reluctance to shift to memory retrieval in the noun-pair lookup (NP) task. Older adults (M = 67 years) showed slower rates of response time (RT) improvements than younger adults (M = 19 years), because of a delayed strategy shift. Older adults estimated scanning latencies as being faster than they actually were and showed poor resolution in discriminating short from long RTs early in practice. The difference in estimated RT for retrieval and scanning strategies predicted retrieval use, independent of actual RT differences. Separate scanning and recognition memory tasks revealed larger time-monitoring differences for older adults than in the NP task. Apparently, the context of heterogeneous RTs as a result of strategy use in the NP task improved older adults' accuracy of RT estimates. RT feedback had complex effects on time-monitoring accuracy, although it generally improved absolute and relative accuracy of RT estimates. Feedback caused older adults to shift more rapidly to the retrieval strategy in the NP task. Results suggest that deficient time monitoring plays a role in older adults' delayed retrieval shift, although other factors (e.g., confidence in the retrieval strategy) also play a role.     

Effects of graded doses of alcohol on speed-accuracy tradeoff in choice reaction time

The inconsistency of previous results concerning the effects of alcohol on reaction time (RT) may be related to possible tradeoffs between speed and accuracy. In the present experiment, complete speed-accuracy tradeoff functions were generated for each of five doses of alcohol (0-1.33 ml/kg) in a choice RT task. Such functions permit RT differences resulting from changes in performance efficiency to be distinguished from those due to changes in subjects’ speed accuracy criteria. Increasing doses of alcohol produced a progressive decrease in the slope parameter of linear equations fit to the speed-accuracy data, but did not significantly alter the intercept of the functions with the RT axis. Thus, alcohol reduced performance efficiency by decreasing the rate of growth of accuracy per unit time. A change in speed-accuracy criterion was combined with the decrease in efficiency at the highest alcohol dose.     

Working memory components that predict word problem solving: Is it merely a function of reading,calculation, and fluid intelligence?

The purpose of this study was to assess whether the differential effects of working memory (WM) components (the central executive, phonological loop, and visual–spatial sketchpad) on math word problem-solving accuracy in children (N?=?413, ages 6–10) are completely mediated by reading, calculation, and fluid intelligence. The results indicated that all three WM components predicted word problem solving in the nonmediated model, but only the storage component of WM yielded a significant direct path to word problem-solving accuracy in the fully mediated model. Fluid intelligence was found to moderate the relationship between WM and word problem solving, whereas reading, calculation, and related skills (naming speed, domain-specific knowledge) completely mediated the influence of the executive system on problem-solving accuracy. Our results are consistent with findings suggesting that storage eliminates the predictive contribution of executive WM to various measures Colom, Rebollo, Abad, & Shih (Memory & Cognition, 34: 158-171, 2006). The findings suggest that the storage component of WM, rather than the executive component, has a direct path to higher-order processing in children.     

Use of simple reaction time in motor programming studies: a reply to Klapp, Wyatt and Lingo

Following a more explicit explanation of the 1960 memory-drum theory and the reasons for using the simple (rather than choice) RT method in testing predictions based on it, the eight experiments utilizing large-scale precued arm movements constrained as to directional accuracy are reviewed. In all cases, increasing complexity of the movement consistently increased response latency; control RT levels agreed with well-established typical values for auditory and visual stimuli. Following practice the complexity effect leveled off, retaining a significant latency differential. Results from experiments varying duration of a held movement position (with movement minimal and complexity invariant) are not relevant to these studies.     

Reaction time task as unconditional stimulus

Nonaversive unconditional stimuli (USs) are seldom used in human classic conditioning of autonomic responses. One major objection to their use is that they produce deficits in electrodermal (ED) second- and third-interval response conditioning. However, a nonaversive reaction time (RT) task that includes feedback of success has been shown to be an effective US while avoiding this disadvantage (Lipp and Vaitl 1988). The present study compared this new RT task (RT-new) with a traditional RT task (RT-old) and with a standard aversive US (shock) in differential classic conditioning of ED, heart rate (HR), and digital pulse volume (DPV) responses. Eight-second-delay differential conditioning was applied in three groups of 12 subjects each. Simple geometric features (square, cross) displayed on a television screen served as conditional stimuli (CS⁺ and CS^?). In acquisition, there were no statistically significant differences among the groups; differential conditioning did occur in HR, first- and second-interval ED responses, and first-interval DPV responses. Separate analyses within each group, however, revealed that there was no second-interval ED conditioning in the RT-old group. During extinction, neither DPV nor second-interval ED conditioning could be obtained, whereas HR and first-interval ED conditioning occurred in each group. In third-interval omission ED responses, RT-old and shock groups exhibited extinction, while response differentiation was maintained in the RT-new group throughout extinction. The RT task including feedback proved to be as reliable a US as a standard aversive US, whereas application of a traditional RT task again yielded some weaknesses in second-interval ED conditioning.     

Comparing exemplar-retrieval and decision-bound models of speeded perceptual classification

The authors compared the exemplar-based random-walk (EBRW) model of Nosofsky and Palmeri (1997) and the decision-bound model (DBM) of Ashby and Maddox (1994; Maddox & Ashby, 1996) on their ability to predict performance in Garner’s (1974) speeded classification tasks. A key question was the extent to which the models could predict facilitation in the correlated task and interference in the filtering task, in situations involving integral-dimension stimuli. To obtain rigorous constraints for model evaluation, the goal was to fit the detailed structure of the response time (RT) distribution data associated with each individual stimulus in each task. Both models yielded reasonably good global quantitative fits to the RT distribution and accuracy data. However, the DBM failed to properly characterize the interference effects in the filtering task. Apparently, a fundamental limitation of the DBM is that it predicts that the fastest RTs in the filtering task should be faster than the fastest RTs in the control task, whereas the opposite pattern was observed in our data.