Reliability of test scores in nonparametric item response theory

Three methods for estimating reliability are studied within the context of nonparametric item response theory. Two were proposed originally by Mokken (1971) and a third is developed in this paper. Using a Monte Carlo strategy, these three estimation methods are compared with four classical lower bounds to reliability. Finally, recommendations are given concerning the use of these estimation methods.The authors are grateful for constructive comments from the reviewers and from Charles Lewis.     

Varying response-reinforcer contiguity in a recycling conjunctive schedule

Three experiments describe the effects of manipulating the frequency of response-reinforcer contiguity in a recycling conjunctive schedule. The schedule arranged that a reinforcer was delivered after 30 s provided at least one response had occurred; otherwise the next cycle started immediately. In Experiment 1, this schedule produced the typical pause–respond–pause pattern, with most responses at mid-interval; and, when a limited number of contiguities between responses and food delivery were added, the pattern became more like the monotonic scallop seen on fixed-interval schedules. In Experiment 2, the schedule was initially presented with an additional contingency that allowed contiguity on every trial. Fixed-interval-like behavior occurred and tended to persist as contiguities were gradually eliminated. In Experiment 3, the recycling conjunctive schedule alternated with a condition in which a large number of contiguities occurred. The pause–respond–pause pattern and fixed-interval-like performance occurred with few or many contiguities, respectively. The results of all three experiments illustrate how contiguity interacts with a small number of other variables to determine performance on interval schedules and illuminate previous findings with fixed-interval and fixed-time schedules.     

Units of analysis and kinetic structure of behavioral repertoires

It is suggested that molar streams of behavior are constructed of various arrangements of three elementary constituents (elicited, evoked, and emitted response classes). An eight-cell taxonomy is elaborated as a framework for analyzing and synthesizing complex behavioral repertoires based on these functional units. It is proposed that the local force binding functional units into a smoothly articulated kinetic sequence arises from temporally arranged relative response probability relationships. Behavioral integration is thought to reflect the joint influence of the organism's hierarchy of relative response probabilities, fluctuating biological states, and the arrangement of environmental and behavioral events in time.     

A taxonomy of item response models

A number of models for categorical item response data have been proposed in recent years. The models appear to be quite different. However, they may usefully be organized as members of only three distinct classes, within which the models are distinguished only by assumptions and constraints on their parameters. “Difference models” are appropriate for ordered responses, “divide-by-total” models may be used for either ordered or nominal responses, and “left-side added” models are used for multiple-choice responses with guessing. The details of the taxonomy and the models are described in this paper. The present study was supported in part by two postdoctoral fellowships awarded to Lynne Steinberg: an Educational Testing Service Postdoctoral Fellowship at ETS, Princeton, NJ and an NIMH Individual National Research Service Award at Stanford University, Stanford, CA. Helpful comments by the editor and three anonymous reviewers are gratefully acknowledged.     

Behavior regulation and learned performance: Some misapprehensions and disagreements

The behavior-regulation approach to learned performance has been the subject of misapprehension and disagreement concerning: (1) the nature and importance of behavior regulation, (2) the definition and role of behavioral set-points, (3) the relation of optimal schedule performance to behavioral set-points, and (4) the question of whether deviations from total responding or from response patterns are the primary determinant of molar responding under schedule constraint. After clarifying the nature and role of behavior regulation and set-points, this paper shows that the data used to question optimal schedule performance (Allison, 1981a) actually strongly support the general behavior-regulation approach. These data also indicate a role for response-pattern set-points in determining schedule behavior, but contradict the hypothesis that deviations from response-pattern characteristics are the primary determinant of molar schedule effects.     

Time reallocation in a multiresponse environment: Effects of restricting response classes

Four adult male rats were each placed for three hours daily into an apparatus that provided individual compartments for six separate location-defined responses. The available responses consisted of: (1) the opportunity to turn off room lighting, producing darkness; (2) the opportunity to view a female rat; (3) the opportunity to turn off white noise; (4) the opportunity to drink; (5) the opportunity to eat; and (6) "other," representing time in the hallway between compartments. Each subject underwent a series of conditions characterized as an A-B-A-C-A design. Manipulations consisted of the removal of a low-probability response (darkness) and of a high-probability response (escape from noise) in a counter-balanced manner across subjects. The dependent measure for all subjects was the percentage of total session time spent in each compartment. Four predictive rules concerning the redistribution of behavior after response restriction were tested, including the constant-ratio rule, equal time redistribution, the most probable alternative, and the sequential-dependency rule. The results indicate no support for any of the four predictive rules and suggest that empirical assessment of restriction effects is necessary in reinforcement studies involving temporally extended responses.     

Year of Zoom in a Year of Doom: Lessons Learned Delivering ERP Remotely During the COVID-19 Pandemic

In response to the COVID-19 pandemic and consequential shutdown measures, many mental health professionals started providing therapy to patients exclusively via telehealth. Our research center, which specializes in studying and treating obsessive-compulsive disorder (OCD), historically has provided in-person exposure and response prevention (ERP) to adults with OCD, but shifted to telehealth during the pandemic. Unlike in other modes of talk therapy, ERP’s emphasis on therapist-supervised exposures presented unique opportunities and challenges to delivering treatment entirely via a virtual platform. This paper provides case examples to illustrate lessons we learned delivering ERP exclusively via telehealth in New York from March 2020 through June 2021 and offers recommendations for future study and practice. Though we observed a number of drawbacks to fully remote ERP, we also discovered advantages to delivering ERP this way, meriting additional research attention.     

Systematic review of interruption and redirection procedures for autistic individuals

Interruption and redirection (IR) procedures involve systematically disrupting an undesirable behavior and prompting an individual to engage in an alternative behavior. These procedures have been frequently assessed for reducing repetitive behaviors for autistic individuals. The primary purpose of this review was to assess IR interventions to determine whether outcomes vary according to intervention characteristics, dependent variable types, design quality, or publication status. A secondary purpose was to assess the extent to which generalization and maintenance outcomes were measured and whether characteristics of these conditions were related to outcomes. IR interventions were moderately successful for reducing repetitive behaviors but less effective for improving corollary variables such as appropriate vocalizations and functional engagement. Generalization and maintenance outcomes, when measured, were poor. Results indicate the need for alternative or augmentative procedures that focus on engagement in meaningful interactions and activities.     

So you think you are an ally? Effects of (in)congruence between men's self-perceptions and women's perceptions of men's values and allyship on women's inclusion and vitality

As public consciousness of sexism is increasing in the workplace (e.g., #MeToo movement), labelling oneself as an ally (e.g., UN HeforShe campaign) is becoming more socially desirable for men. However, do women agree with such men in their assessments of being allies? Importantly, how does women's agreement (or not) with men's self-assessments of allyship affect women's inclusion-relevant outcomes? Using a multi-informant design and data from 101 men–women colleague pairs, this study considered men's self-perceptions and women's other-reports of men's key allyship-relevant characteristics—justice, moral courage, civility and allyship. Polynomial regression and response surface analyses revealed differential impacts of (in)congruence between men's and women's perceptions on women's sense of inclusion and vitality. Simply, when women perceived men as higher (or the same) in justice, moral courage and civility than men reported themselves, it positively predicted women's outcomes. This suggests that humble self-presentation by men on characteristics that are parallel to allyship (but not allyship) may be ideal. Yet, both under- and overestimation by men on allyship itself predicted poorer outcomes for women, suggesting that the ideal is for men to have an accurate assessment of their own strengths and weaknesses as an ally.     

Intentional response distortion during the COVID-19 pandemic

COVID-19 has abruptly and unexpectedly transformed nearly every aspect of work, including but not limited to increased unemployment rates and uncertainty regarding future job prospects. Response distortion has always been a concern given that many organizations rely on information that is self-reported by applicants regarding their potential employability (e.g., responses to self-reported personality instruments, resumes, interview responses). Drawing from the Valence-Instrumentality-Expectancy (VIE) theory of motivation, we propose that the uncertainty surrounding jobs may lead to amplified distorted responses on these measures in areas where COVID-19 was most salient. In a sample of 213 working adults [~50% female, age M = 38.48], the present study shows that increases in response distortion on a measure of conscientiousness were more pronounced as a function of (a) local COVID positivity rates and (b) job type, such that frontline workers distorted their responses the most. Findings are discussed in the context of VIE theory, personality measurement, and challenges with maintaining effective selection procedures.