TREATMENT INTEGRITY IN APPLIED BEHAVIOR ANALYSIS WITH CHILDREN

Functional analysis of behavior depends upon accurate measurement of both independent and dependent variables. Quantifiable and controllable operations that demonstrate these functional relationships are necessary for a science of human behavior. Failure to implement independent variables with integrity threatens the internal and external validity of experiments. A review of all applied behavior analysis studies with children as subjects that have been published in the Journal of Applied Behavior Analysis between 1980 and 1990 found that approximately 16% of these studies measured the accuracy of independent variable implementation. Two thirds of these studies did not operationally define the components of the independent variable. Specific recommendations for improving the accuracy of independent variable implementation and for defining independent variables are discussed.     

Independent Variable Integrity in Behavioral Research: A Review of the Literature

Abstract

Independent variable integrity has only rather recently been given serious attention in behavioral research. This paper highlights the critical importance of this methodological issue. It is argued that the integrity of independent variables is an essential criterion of whether at study demonstrates a believable functional relationship between the independent and the dependent variables.     

Effect of signaled reinforcement on response variability

Three experiments examined the effect of signaling reinforcement on rats' lever pressing on contingencies that reinforced variable responding to extend the exploration of signaled reinforcement to a schedule that has previously not been examined in this respect. In Experiment 1, rats responding on a lag-8 variability schedule with signaled reinforcement displayed greater levels of variability (U values) than rats on the same schedule lacking a reinforcement signal. In Experiment 2, rats responding on a differential reinforcement of least frequent responses schedule also displayed greater operant variability with a signal for reinforcement compared with rats without a reinforcement signal. In Experiment 3, a reinforcement signal decreased the variability of a response sequence when there was no variability requirement. These results offer empirical corroboration that operant variability responds to manipulations in the same manner as do other forms of operant response and that a reinforcement signal facilitates the emission of the required operant.     

What mediation analysis can (not) do

The present article is concerned with a common misunderstanding in the interpretation of statistical mediation analyses. These procedures can be sensibly used to examine the degree to which a third variable (Z) accounts for the influence of an independent (X) on a dependent variable (Y) conditional on the assumption that Z actually is a mediator. However, conversely, a significant mediation analysis result does not prove that Z is a mediator. This obvious but often neglected insight is substantiated in a simulation study. Using different causal models for generating Z (genuine mediator, spurious mediator, correlate of the dependent measure, manipulation check) it is shown that significant mediation tests do not allow researchers to identify unique mediators, or to distinguish between alternative causal models. This basic insight, although well understood by experts in statistics, is persistently ignored in the empirical literature and in the reviewing process of even the most selective journals.     

An inexpensive infrared detector to verify the delivery of food pellets

The reproducibility of experimental outcomes depends on consistent control of independent variables. In food-maintained operant performance, it is of utmost importance that the quantity of food delivered is reliable. To that end, some commercial food pellet dispensers have add-on attachments to sense the delivery of pellets. Not all companies, however, offer such add-ons. Aside from availability, cost and temporary reduction in throughput may be a problem for smaller labs. The present paper outlines our recent development of a simple, inexpensive infrared device to detect and confirm the delivery of pellets. The in-line construction of the detector routes the falling pellet through a barrel so that it passes between an infrared emitter and receiver. The circuitry was designed to be compatible with all commercially available behavioral measurement systems, and so may be retrofit to any existing system. Our tests with the detector so far have shown that it is 100% accurate in detecting pellet delivery. The individual unit cost is approximately 25 dollars. The low cost and versatility of the device offer an easy method to ensure the integrity of food delivery in operant settings.     

Citation Analysis of Skinner's Verbal Behavior: 1984-2004

The present study undertook an updated citation analysis of Skinner's (1957)Verbal Behavior. All articles that cited Verbal Behavior between 1984 and 2004 were recorded and content analyzed into one of five categories; four empirical and one nonempirical. Of the empirical categories, studies that employed a verbal operant from Skinner's analysis were assigned to either basic, applied, or observational categories. Empirical studies that did not employ a verbal operant were categorized as other-empirical. The total number of citations remained stable across the review period and averaged just over 52 per year. Of these, 80% were from nonempirical articles, 13.7% were from other-empirical articles, 4% were from applied articles, 1.4% were from basic articles, and 0.9% were from observational articles. An "obliteration" analysis was also conducted to identify articles that employed Skinner's verbal operant terms but did not cite Verbal Behavior. This analysis identified 44 additional articles, suggesting that a degree of obliteration had occurred in the half century since the publication of Verbal Behavior. In particular, the analysis suggests that the verbal operant of manding has sufficient presence in the applied empirical literature to render citation of Verbal Behavior redundant. Overall, Verbal Behavior continues to make an important contribution to the psychological literature.     

The operant and the classical in conditioned orientation of Drosophila melanogaster at the flight simulator

Ever since learning and memory have been studied experimentally, the relationship between operant and classical conditioning has been controversial. Operant conditioning is any form of conditioning that essentially depends on the animal's behavior. It relies on operant behavior. A motor output is called operant if it controls a sensory variable. The Drosophila flight simulator, in which the relevant behavior is a single motor variable (yaw torque), fully separates the operant and classical components of a complex conditioning task. In this paradigm a tethered fly learns, operantly or classically, to prefer and avoid certain flight orientations in relation to the surrounding panorama. Yaw torque is recorded and, in the operant mode, controls the panorama. Using a yoked control, we show that classical pattern learning necessitates more extensive training than operant pattern learning. We compare in detail the microstructure of yaw torque after classical and operant training but find no evidence for acquired behavioral traits after operant conditioning that might explain this difference. We therefore conclude that the operant behavior has a facilitating effect on the classical training. In addition, we show that an operantly learned stimulus is successfully transferred from the behavior of the training to a different behavior. This result unequivocally demonstrates that during operant conditioning classical associations can be formed.     

On the interpretation of removable interactions: A survey of the field 33 years after Loftus

In a classic 1978 Memory & Cognition article, Geoff Loftus explained why noncrossover interactions are removable. These removable interactions are tied to the scale of measurement for the dependent variable and therefore do not allow unambiguous conclusions about latent psychological processes. In the present article, we present concrete examples of how this insight helps prevent experimental psychologists from drawing incorrect conclusions about the effects of forgetting and aging. In addition, we extend the Loftus classification scheme for interactions to include those on the cusp between removable and nonremovable. Finally, we use various methods (i.e., a study of citation histories, a questionnaire for psychology students and faculty members, an analysis of statistical textbooks, and a review of articles published in the 2008 issue of Psychology and Aging) to show that experimental psychologists have remained generally unaware of the concept of removable interactions. We conclude that there is more to interactions in a 2 × 2 design than meets the eye.     

Effect analysis and causation in linear structural equation models

This paper considers total and direct effects in linear structural equation models. Adopting a causal perspective that is implicit in much of the literature on the subject, the paper concludes that in many instances the effects do not admit the interpretations imparted in the literature. Drawing a distinction between concomitants and factors, the paper concludes that a concomitant has neither total nor direct effects on other variables. When a variable is a factor and one or more intervening variables are concomitants, the notion of a direct effect is not causally meaningful. Even when the notion of a direct effect is meaningful, the usual estimate of this quantity may be inappropriate. The total effect is usually interpreted as an equilibrium multiplier. In the case where there are simultaneity relations among the dependent variables in tghe model, the results in the literature for the total effects of dependent variables on other dependent variables are not equilibrium multipliers, and thus, the usual interpretation is incorrect. To remedy some of these deficiencies, a new effect, the total effect of a factorX on an outcomeY, holding a set of variablesF constant, is defined. When defined, the total and direct effects are a special case of this new effect, and the total effect of a dependent variable on a dependent variable is an equilibrium multiplier.For helpful comments, I am grateful to G. Arminger, K. Bollen, W. Faris, R. m. Hauser, T. Petersen, three anonymous Psychometrikas reviewers, and the Editor. For computational assistance, I am grateful to B. D. Kim.     

EFFECTS OF TREATMENT INTEGRITY FAILURES DURING DIFFERENTIAL REINFORCEMENT OF ALTERNATIVE BEHAVIOR: A TRANSLATIONAL MODEL

Differential reinforcement of alternative behavior (DRA) is used frequently as a treatment for problem behavior. Previous studies on treatment integrity failures during DRA suggest that the intervention is robust, but research has not yet investigated the effects of different types of integrity failures. We examined the effects of two types of integrity failures on DRA, starting with a human operant procedure and extending the results to children with disabilities in a school setting. Human operant results (Experiment 1) showed that conditions involving reinforcement for problem behavior were more detrimental than failing to reinforce appropriate behavior alone, and that condition order affected the results. Experiments 2 and 3 replicated the effects of combined errors and sequence effects during actual treatment implementation.     

Weak measurement invariance with respect to unmeasured variables: An implication of strict factorial invariance

Measurement bias refers to systematic differences across subpopulations in the relation between observed test scores and the latent variant underlying the test scores. Comparisons of subpopulations with the same score on the latent variable can be expected to have the same observed test score. Measurement invariance is therefore one of the key issues in psychological testing. It has been established that strict factorial invariance (SFI) with respect to a selection variable V almost certainly implies weak measurement invariance with respect to V: given SFI, means and variances of observed scores do not depend on V. It is shown that this result can be extended. SFI in groups derived by selection on V has implications not only for V but also for potentially biasing variables W, if W and the selection variable V and/or if W and the factor underlying the observed test scores are statistically dependent. Given SFI with respect to V and prior knowledge concerning these dependencies, it is not necessary to measure and model variables W in order to exclude them as potentially biasing variables if the investigation focuses on groups selected on V.     

Operant Variability: A Conceptual Analysis

Some researchers claim that variability is an operant dimension of behavior. The present paper reviews the concept of operant behavior and emphasizes that differentiation is the behavioral process that demonstrates an operant relation. Differentiation is conceived as change in the overlap between two probability distributions: the distribution of reinforcement probability as a function of some response property (S distribution) and the probability distribution of the response property itself (R distribution). This concept implies that the differentiation process can be measured only if S distribution and R distribution are both established on the same response property. To determine whether the differentially reinforced behavioral variability fits the proposed concept of operant behavior, I examine the main procedures (lag n and threshold procedures) and the main dependent variable (U value) employed in the studies of operant variability. Because lag n and threshold procedures establish their S distributions on properties distinct from U value, differentiation cannot be measured over the change in U value. I conclude that studies of operant variability have failed to provide a direct demonstration that variability is an operant dimension of behavior. Hence, studies in which measures of variability provide a basis to measure differentiation can better support the claim that variability is an operant dimension of behavior.     

A science of meaning. Can behaviorism bring meaning to psychological science?

An argument is presented for making meaning a central dependent variable in psychological science. Principles of operant psychology are then interpreted as providing a basic foundation for a science of meaning. The emphasis here is on the generality of basic operant concepts, where learning is a process of meaning making that is governed largely by natural contingencies; reinforcement is an organic process in which environment-behavior relations are selected, defined here as a dialectical process of meaning making; and reinforcers are experiential consequences with acquired, ecologically derived meanings. The author concludes with a call for a more interdisciplinary science of psychology, focusing on the individual in society.     

Human behavioral momentum in a sample of older adults.

Behavioral momentum, the persistence of behavior under altered environmental contingencies, is derived from Newtonian physics and operant psychology. It has relevance to behavior analysis in terms of shaping strong behaviors and ensuring effective relapse prevention strategies in behavior modification and therapy. The authors investigated whether changing the operant schedule contingencies affects the responses of older humans to different stimuli when reinforcement density is systematically manipulated. Fifteen older adults participated in a computer study in which each of 2 keys in a baseline condition was associated with the same schedule of reinforcement and multiple variable intervals; the only difference was that 1 reinforcer was 10 times larger than the other. After 6 sessions, the authors changed the contingency schedule to either an extinction condition, a variable-time schedule, or a different variable-interval schedule, to assess how participants' responses persisted when reinforcement contingencies were systematically changed. The results were consistent with the predictions of behavioral momentum. The participants not only biased their responses in favor of the more densely reinforcing key, but when contingencies changed, they showed significantly biased responses. Results supported the conclusion that healthy older adults allocate their behaviors in a manner very sensitive to training stimuli conditions; consistent with the basic principles of behavioral momentum, they show a degree of resistance to change in their behaviors when the behavioral contingencies are altered.     

CONTINUOUS RECORDING AND INTEROBSERVER AGREEMENT ALGORITHMS REPORTED IN THE JOURNAL OF APPLIED BEHAVIOR ANALYSIS (1995–2005)

We reviewed all research articles in 10 recent volumes of the Journal of Applied Behavior Analysis (JABA): Vol. 28(3), 1995, through Vol. 38(2), 2005. Continuous recording was used in the majority (55%) of the 168 articles reporting data on free‐operant human behaviors. Three methods for reporting interobserver agreement (exact agreement, block‐by‐block agreement, and time‐window analysis) were employed in more than 10 of the articles that reported continuous recording. Having identified these currently popular agreement computation algorithms, we explain them to assist researchers, software writers, and other consumers of JABA articles.     

Amplitude measures of operant response: Implementation with Apple Pascal

Because operant conditioning studies involving force of response as a dependent variable require high-speed A/D conversion, conventional operant software, which treats the input datum as a dimensionless event, is generally unsuited for this kind of work. The author describes a complete Apple-based hardware-software ensemble that measures and records on diskette the peak force, duration, time integral of force, and interresponse time for individual operant responses. Data acquisition and control programs were written in Apple Pascal linked to selected assembly language modules. The real-time base was derived from an inexpensive crystal clock interfaced     

Computer control for operant oriented laboratories

A process control procedure using base rate polling within interrupt driven routines, segmentation of time dependent events, and a branch table execution structure was developed for an operant oriented behavioral pharmacology laboratory. Efficient independent control and analysis for eight experimental chambers was obtained utilizing the similarities between various operant techniques.     

Cooperative learning revisited

The endeavor to teach academic skills known as cooperative learningis of interest to behavioral educators due to its record of effectiveness, its use of behavioral procedures, and its relatively widespread adoption by regular educators. All forms of cooperative learning emphasize operations that encourage students to work together to achieve commonly held goals rather than competing with or ignoring the efforts of others. Despite the apparent soundness of the approach, the present commentary raises several issues. First, it states that some cooperative learning proponents fail to describe the behavioral processes underlying the approach. Second, it is pointed out that it is unclear whether cooperative learning is an independent or dependent variable. Given that cooperative learning applies group contingencies to academic behavior, the question is raised as to whether group contingencies do, in fact, produce desirable social interactions, and whether group contingencies are appropriate for academic behaviors. A concern is also raised as to whether the spontaneous peer tutoring generated by cooperative learning compares favorably with planned peer tutoring. Finally, it is claimed that the minor variations from academic group contingencies that cooperative learning proponents have introduced do not require identifying a new process.     

Interval timing as an emergent learning property

Interval timing in operant conditioning is the learned covariation of a temporal dependent measure such as wait time with a temporal independent variable such as fixed-interval duration. The dominant theories of interval timing all incorporate an explicit internal clock, or "pacemaker," despite its lack of independent evidence. The authors propose an alternative, pacemaker-free view that demonstrates that temporal discrimination can be explained by using only 2 assumptions: (a) variation and selection of responses through competition between reinforced behavior and all other, elicited, behaviors and (b) modulation of the strength of response competition by the memory for recent reinforcement. The model departs radically from existing timing models: It shows that temporal learning can emerge from a simple dynamic process that lacks a periodic time reference such as a pacemaker.     

“Operant” and “respondent” measures of dispositions: Sex differences in the degree of independence between needs, values, and traits

This study examined McClelland's (1981) hypothesis that operant and respondent personality measures generally assess independent domains of psychological thought. The conceptual basis for the measurement of needs and values is explored, through reference to unconscious and conscious levels of thought. It is questioned as to whether the relationship between needs, values, and traits is generally an independent one, and reference is made to the contribution of development and to different learning environments. An operant measure of needs and respondent measures of values and traits were administered to 203 male and female undergraduate students. Findings for males, but not females, supported McClelland's hypothesis. Results showed that for women, there was a significant relationship between needs and values, and between needs and traits, and that the relationship varied for particular personality variables and for particular age groups of women. Findings are discussed generally in terms of cognitive, affect, and information processing theories.