Combining speed and accuracy to assess error-free cognitive processes

Both the speed and accuracy of responding are important measures of performance. A well-known interpretive difficulty is that participants may differ in their strategy, trading speed for accuracy, with no change in underlying competence. Another difficulty arises when participants respond slowly and inaccurately (rather than quickly but inaccurately), e.g., due to a lapse of attention. We introduce an approach that combines response time and accuracy information and addresses both situations. The modeling framework assumes two latent competing processes. The first, the error-free process, always produces correct responses. The second, the guessing process, results in all observed errors and some of the correct responses (but does so via non-specific processes, e.g., guessing in compliance with instructions to respond on each trial). Inferential summaries of the speed of the error-free process provide a principled assessment of cognitive performance reducing the influences of both fast and slow guesses. Likelihood analysis is discussed for the basic model and extensions. The approach is applied to a data set on response times in a working memory test. The authors wish to thank Roger Ratcliff, Christopher Chabris, and three anonymous referees for their helpful comments, and Aureliu Lavric for providing the data analyzed in this paper.     

Local response-rate constancy on concurrent variable-interval schedules of reinforcement

Concurrent variable-interval schedules were arranged with a main key that alternated in color and schedule assignment, along with a changeover key on which a small fixed ratio was required to changeover. Acceptable matching was observed with pigeons in two replications, but there was a tendency toward overmatching. Local response rates were found to differ for unequal schedules of a concurrent pair: local response rate was greater for the variable-interval schedule with the smaller average interreinforcement interval, but qualifications based on an interresponse-time analysis were discussed. In a second experiment, two 3-minute variable-interval schedules were arranged concurrently, and the experimental variable was the changeover procedure: either a changeover delay was incurred by each changeover or a small fixed ratio on a changeover key was required to complete a changeover. Changeover delays of 2 and 5 seconds were compared with a fixed-ratio changeover of five responses. The response output on the main key (associated with the variable-interval schedules) was greater when a changeover delay was arranged than when a fixed ratio was required to changeover. A detailed analysis of stripchart records showed that a 2-second delay generated an increased response rate for 3 seconds after a changeover, while the fixed-ratio requirement generated an increased rate during the first second only, followed by a depressed response rate for 2 seconds.     

A molecular analysis of multiple schedule interactions: negative contrast

The present experiments investigated the relationship between changes in the relative reinforced interresponse-time distributions and the occurrence of positive and negative contrast in multiple variable-interval—variable-interval and multiple variable-interval—extinction schedules of reinforcement. Experiment I demonstrated that changes in the interresponse-time distributions were consistently correlated with response-rate changes referred to as positive and negative contrast. Corresponding changes in the reinforced interresponse-time distributions suggested that negative contrast resulted as an inductive effect of selectively reinforcing long interresponse times in the altered component at the moment the baseline schedule was reintroduced. Experiment II demonstrated that the magnitude of the negative-contrast effect could be significantly decreased if the altered component schedule was modified in order to prevent the reinforcement of these interresponse times during the first few sessions of baseline recovery. The results supported a proposal that interresponse time—reinforcer relations may act as amplifiers or attenuators of negative contrast.     

驾驶员的动态反应时研究

本研究应用DFY-1型动态反应时测试仪,以解放CA10B 型卡车为实验用车,结合日常运输任务,对三种年龄组(20—29岁、30—39岁、40—49岁)的30名驾驶员,在三种车速(静态,30公里/小时及50公里/小时)条件下的反应时、动作时及制动反应时进行了测试。结果表明:车速对驾驶员的反应时及制动反应时有显著影响,而对动作时则无显著影响;驾驶员的年龄对反应时、动作时及制动反应时均无显著影响.本研究结果为加强驾驶员的安全教育与管理,控制车速提供了佐证。更高车速条件下驾驶员的反应时特点尚待进一步研究。     

Interresponse-time punishment: a basis for shock-maintained behavior.

Lever pressing of squirrel monkeys postponed brief electric shock according to a free-operant shock-postponement procedure. Pressing also produced shock with a probability proportional to the duration of the current interresponse time in some conditions, or to the fifth ordinally-preceding interresponse time in others. These conditions provided equal frequencies and temporal distributions of response-produced shocks either contingent on or independent of the current interresponse-time duration, respectively. Shock delivered contingent on the current interresponse-time duration resulted in shorter mean interresponse times and higher overall response rates that shock delivered independent of the current interresponse time. In subsequent conditions, response-produced shocks were sufficient to maintain responding following suspension of the postponement procedure only when those shocks were contingent on the current interresponse time. Presenting shock independent of the current interresponse time, conversely, suppressed response rate and ultimately led to cessation of responding in the absence of a conjoint shock-postponement procedure. These results demonstrate interresponse-time punishment in the absence of any indirect avoidance contingencies based on overall shock-frequency reduction, and strongly support similar interpretation at the more local level of shock-frequency reduction correlated with particular interresponse times. Differential punishment of long interresponse times also provides both an a priori basis for predicting whether a schedule of shock presentation will maintain or suppress responding and a framework for interpreting many of the functional relations between overall response rate and parameters of consequent shock presentation. Finally, these results and others indicate the importance of response-consequence contiguity above and beyong any notion of noncontiguous contingency in the control of behavior.     

行为可见增加利他偏好及其社会规范机制

在不同社会偏好类型中,研究者较为关注利他偏好及其信号功能。本研究探究在独裁者游戏中,决策者的利他偏好如何受到分配方案对接受者可见性的影响。实验1采用行为实验结合计算建模的方法,发现无论在选择或评分条件下,相比于行为不可见,当分配者的行为能够为接受者所见时,分配者都表现出更大程度的利他偏好。此外,相比于评分条件,在选择时人们更加在意分配效率。实验2仅使用选择条件,并操纵社会规范,发现行为可见增加利他偏好的作用依赖于利他的社会规范,当存在非利他社会规范时,行为可见的影响减小。本研究结果表明,在利他社会规范下,当行为对接受者可见时,人们将表现出更多利他偏好。     

A hierarchical latent response model for inferences about examinee engagement in terms of guessing and item-level non-response

In low-stakes assessments, test performance has few or no consequences for examinees themselves, so that examinees may not be fully engaged when answering the items. Instead of engaging in solution behaviour, disengaged examinees might randomly guess or generate no response at all. When ignored, examinee disengagement poses a severe threat to the validity of results obtained from low-stakes assessments. Statistical modelling approaches in educational measurement have been proposed that account for non-response or for guessing, but do not consider both types of disengaged behaviour simultaneously. We bring together research on modelling examinee engagement and research on missing values and present a hierarchical latent response model for identifying and modelling the processes associated with examinee disengagement jointly with the processes associated with engaged responses. To that end, we employ a mixture model that identifies disengagement at the item-by-examinee level by assuming different data-generating processes underlying item responses and omissions, respectively, as well as response times associated with engaged and disengaged behaviour. By modelling examinee engagement with a latent response framework, the model allows assessing how examinee engagement relates to ability and speed as well as to identify items that are likely to evoke disengaged test-taking behaviour. An illustration of the model by means of an application to real data is presented.     

Utilizing response times in cognitive diagnostic computerized adaptive testing under the higher-order deterministic input,noisy ‘and’ gate model

Methods of cognitive diagnostic computerized adaptive testing (CD-CAT) under higher-order cognitive diagnosis models have been developed to simultaneously provide estimates of the attribute mastery statuses of examinees for formative assessment and estimates of a latent continuous trait for overall summative evaluation. In a typical CD-CAT environment, examinees are often subject to a time limit, and the examinees’ response times (RTs) for specific test items can be routinely recorded by custom-made programs. Because examinees are individually administered tailored sets of test items from the item pool, they may experience different levels of speededness during testing and different levels of risk of running out of time. In this study, RTs were considered during the item-selection procedure to control the test speededness and the RTs were treated as useful information for improving latent trait estimation in CD-CAT under the higher-order deterministic input, noisy ‘and’ gate (DINA) model. A modified posterior-weighted Kullback–Leibler (PWKL) method that maximizes the item information per time unit and a shadow-test method that assembles a provisional test subject to a specified time constraint were developed. Two simulation studies were conducted to assess the effects of the proposed methods on the quality of CD-CAT for fixed- and variable-length exams. The results show that, compared with the traditional PWKL method, the proposed methods preserve a lower risk of running out of time while ensuring satisfactory attribute estimation and providing more accurate estimates of the latent trait and speed parameters. Finally, several suggestions for future research are proposed.     

The Effects of Regulatory Fit between Explanation Framing and Applicants’ Regulatory Foci on Applicant Reaction

Abstract

Drawing from regulatory fit theory and the literature on persuasion, the current study is the first to explore whether the fit between explanation framing and applicants’ regulatory foci could enhance applicant reaction. We hypothesized that a positively framed explanation fits with applicants’ promotion foci and that a negatively framed explanation fits with applicants’ prevention foci. Three studies were conducted in which participants with different regulatory foci rated their perceived procedural fairness and organizational attractiveness after reading differently framed recruitment advertisements, rejection letters, and job offer letters. The results supported our hypothesis by showing significant interactions between explanation framing and participants’ regulatory foci on procedural fairness and organizational attractiveness perception in the contexts of recruitment advertising and rejection letters. In these contexts, compared with receiving a negatively framed explanation, promotion-focused recipients reported higher levels of perceived fairness and organizational attractiveness after receiving a positively framed explanation, and promotion-focused recipients’ fairness and attractiveness perceptions were higher than prevention-focused recipients’, after receiving a positively framed explanation. Moreover, perceived procedural fairness mediated the relationship between regulatory fit and perceived organizational attractiveness. However, regulatory fit effects were not found in the context of job offer letters.     

Stuttering and sensory gating: a study of acoustic startle prepulse inhibition

It was hypothesized that stuttering may be related to impaired sensory gating, leading to overflow of superfluous disturbing auditory feedback and breakdown of the speech sequence. This hypothesis was tested using the acoustic startle prepulse inhibition (PPI) paradigm. A group of 22 adults with developmental stuttering were compared with controls regarding the degree of PPI. No significant differences were found between the stuttering adults and the control group; the groups showed similar means and distribution. Likewise, no relation between the degree of PPI and the effect of altered auditory feedback on stuttering was found. In summary, the results of the study indicate that there is no relation between stuttering and PPI.