Using e-learning modules to teach ongoing-visual inspection of functional analyses

Despite the effectiveness of function-based treatments, most clinicians do not conduct functional analyses (FA). The time required to conduct an FA is a major barrier preventing their use. One way to increase FA efficiency is to discontinue the analysis as soon as it has produced clear results. Saini et al. (2018) evaluated a structured procedure for ongoing-visual inspection of FAs and found that it produced accurate interpretations while averaging 40% fewer sessions than author interpretation. This study evaluated the efficacy of an e-learning module for training registered behavior technicians (RBTs) to implement ongoing visual inspection of FAs. Following training, 5 of the 6 participants showed mastery of ongoing visual inspection, and the final participant did so with the addition of supplemental procedures. We discuss how this training may increase the efficiency of FAs by teaching individuals who are less experienced in FA methodology when to seek supervision from a supervising Board Certified Behavior Analyst® (BCBA).     

Interpreting functional analysis outcomes using automated nonparametric statistical analysis

Current methods employed to interpret functional analysis data include visual analysis and post-hoc visual inspection (PHVI). However, these methods may be biased by dataset complexity, hand calculations, and rater experience. We examined whether an automated approach using nonparametric rank-based statistics could increase the accuracy and efficiency of functional analysis data interpretation. We applied Automated Nonparametric Statistical Analysis (ANSA) to a sample of 65 published functional analyses for which additional experimental evidence was available to verify behavior function. Results showed that exact behavior function agreement between ANSA and the publications authors was 83.1%, exact agreement between ANSA and PHVI was 75.4%, and exact agreement across all 3 methods was 64.6%. These preliminary findings suggest that ANSA has the potential to support the data interpretation process. A web application that incorporates the calculations and rules utilized by ANSA is accessible at https://ansa.shinyapps.io/ansa/     

TOWARD THE DEVELOPMENT OF STRUCTURED CRITERIA FOR INTERPRETATION OF FUNCTIONAL ANALYSIS DATA

Using functional analysis results to prescribe treatments is the preferred method for developing behavioral interventions. Little is known, however, about the reliability and validity of visual inspection for the interpretation of functional analysis data. The purpose of this investigation was to develop a set of structured criteria for visual inspection of multielement functional analyses that, when applied correctly, would increase interrater agreement and agreement with interpretations reached by expert consensus. In Study 1, 3 predoctoral interns interpreted functional analysis graphs, and interrater agreement was low (M = .46). In Study 2, 64 functional analysis graphs were interpreted by a panel of experts, and then a set of structured criteria were developed that yielded interpretive results similar to those of the panel (exact agreement = .94). In Study 3, the 3 predoctoral interns from Study 1 were trained to use the structured criteria, and the mean interrater agreement coefficient increased to .81. The results suggest that (a) the interpretation of functional analysis data may be less reliable than is generally assumed, (b) decision-making rules used by experts in the interpretation of functional analysis data can be operationalized, and (c) individuals can be trained to apply these rules accurately to increase interrater agreement. Potential uses of the criteria are discussed.     

A Monte Carlo evaluation of masked visual analysis in response‐guided versus fixed‐criteria multiple‐baseline designs

We developed masked visual analysis (MVA) as a structured complement to traditional visual analysis. The purpose of the present investigation was to compare the effects of computer‐simulated MVA of a four‐case multiple‐baseline (MB) design in which the phase lengths are determined by an ongoing visual analysis (i.e., response‐guided) versus those in which the phase lengths are established a priori (i.e., fixed criteria). We observed an acceptably low probability (less than .05) of false detection of treatment effects. The probability of correctly detecting a true effect frequently exceeded .80 and was higher when: (a) the masked visual analyst extended phases based on an ongoing visual analysis, (b) the effects were larger, (c) the effects were more immediate and abrupt, and (d) the effects of random and extraneous error factors were simpler. Our findings indicate that MVA is a valuable combined methodological and data‐analysis tool for single‐case intervention researchers.     

CONSISTENT VISUAL ANALYSES OF INTRASUBJECT DATA

Visual inspection of single‐case data is the primary method of interpretation of the effects of an independent variable on a dependent variable in applied behavior analysis. The purpose of the current study was to replicate and extend the results of DeProspero and Cohen (1979) by reexamining the consistency of visual analysis across raters. We recruited members of the board of editors and associate editors for the Journal of Applied Behavior Analysis to judge graphs on a 100‐point scale of experimental control and by providing a dichotomous response (i.e., “yes” or “no” for experimental control). Results showed high interrater agreement across the three types of graphs, suggesting that visual inspection can lead to consistent interpretation of single‐case data among well‐trained raters.     

Visual aids and structured criteria for improving visual inspection and interpretation of single-case designs

Because behavior analysis is a data-driven process, a critical skill for behavior analysts is accurate visual inspection and interpretation of single-case data. Study 1 was a basic study in which we increased the accuracy of visual inspection methods for A-B designs through two refinements of the split-middle (SM) method called the dual-criteria (DC) and conservative dual-criteria (CDC) methods. The accuracy of these visual inspection methods was compared with one another and with two statistical methods (Allison & Gorman, 1993; Gottman, 1981) using a computer-simulated Monte Carlo study. Results indicated that the DC and CDC methods controlled Type I error rates much better than the SM method and had considerably higher power (to detect real treatment effects) than the two statistical methods. In Study 2, brief verbal and written instructions with modeling were used to train 5 staff members to use the DC method, and in Study 3, these training methods were incorporated into a slide presentation and were used to rapidly (i.e., 15 min) train a large group of individuals (N = 87). Interpretation accuracy increased from a baseline mean of 55% to a treatment mean of 94% in Study 2 and from a baseline mean of 71% to a treatment mean of 95% in Study 3. Thus, Study 1 answered basic questions about the accuracy of several methods of interpreting A-B designs; Study 2 showed how that information could be used to increase the accuracy of human visual inspectors; and Study 3 showed how the training procedures from Study 2 could be modified into a format that would facilitate rapid training of large groups of individuals to interpret single-case designs.     

An evaluation of the conservative dual-criterion method for teaching university students to visually inspect AB-design graphs

The present study evaluated the effects of both a traditional lecture and the conservative dual-criterion (CDC) judgment aid on the ability of 6 university students to visually inspect AB-design line graphs. The traditional lecture reliably failed to improve visual inspection accuracy, whereas the CDC method substantially improved the performance of each participant.     

Interview‐informed synthesized contingency analyses: Thirty replications and reanalysis

The speed with which a functional analysis (FA) provides a convincing demonstration of the variables that influence problem behavior may be termed efficiency. Multiple FA formats have been developed to improve analytic efficiency while the core components of the Iwata, Dorsey, Slifer, Bauman, and Richman (1982/1994) procedures are maintained. We attempted to illustrate an alternative efficient process for conducting FAs of problem behavior that relied on modifying those core components. In Study 1, we describe 30 applications of the interview‐informed synthesized contingency analysis (Hanley, Jin, Vanselow, & Hanratty, 2014), which required an average of 25 min of analysis. The first sessions of these analyses were reanalyzed in Study 2 to determine if contingencies that controlled problem behavior could be identified in only 3 to 5 min. This was the case in 80% of analyses.     

Efficiency in functional analysis of problem behavior: A quantitative and qualitative review

Originating in the mid-1960s, functional analysis (FA) has become the gold standard method for understanding the environmental variables that come to shape and maintain problematic behaviors such as aggression, self-injury, and property destruction. Over the decades, a number of studies have refined FA methods, attempting to improve the overall efficiency of the analysis through experimental design and procedural modifications. In the present review, we used ongoing visual-inspection criteria and basic probability theory to compare and analyze levels of efficiency across FA types. The multielement design and synthesized contingency analyses were about equally efficient with respect to the mean number of sessions conducted per function tested, and the trial-based and synthesized contingency analyses were the 2 most efficient with respect to the mean duration per function tested. We discuss the implications of these findings in the broader context of efficiency and provide recommendations for maximizing efficiency during an FA. We also discuss other qualitative procedural details that may influence the overall efficiency of an FA.     

Outcome summaries of latency‐based functional analyses conducted in hospital inpatient units

Latency‐based functional analysis (FA) may be a viable alternative to the standard, rate‐based, FA when frequently evoking problem behavior is not advisable. We conducted 18 latency‐based FAs of the problem behavior of children diagnosed with autism in inpatient hospital settings and identified functional relations during 44.4% (8 of 18) of latency‐based FAs. Implications for conducting FAs of severe problem behavior are discussed.     

An evaluation of the agreement between the conservative dual‐criterion method and expert visual analysis

The conservative dual‐criterion (CDC) method was developed to standardize the analysis of single‐subject experimental designs data, but to date its accuracy has been evaluated only by comparing results to the statistical parameters of graphs. Our study investigated agreement between expert visual analysts and the CDC method on 66 AB tiers from published multiple baseline graphs. We found strong agreement between the two methods for certain types of graphs and discuss implications of the findings and areas for future research.     

Data presentation options to manage variability in physical activity research

This paper presents seven tactics for managing the variability evident in some physical activity data. High levels of variability in daily step‐count data from pedometers or accelerometers can make typical visual inspection difficult. Therefore, the purpose of the current paper is to discuss several strategies that might facilitate the visual interpretation of highly variable data. The seven strategies discussed in this paper are phase mean and median lines, daily average per week, weekly cumulative, proportion of baseline, 7‐day moving average, change point detection, and confidence intervals. We apply each strategy to a data set and discuss the advantages and disadvantages.     

A comparison of isolated and synthesized contingencies in functional analyses

Recently, researchers have compared the utility of isolated versus synthesized contingencies in functional analysis (FA) methodology (e.g., Fisher et al., 2016; Slaton et al., 2017). A limitation of these studies is that there were other differences across FA methodologies (e.g., design, contingency) that did not allow for isolation of the influence of isolated versus synthesized contingencies. Therefore, the current study compared outcomes of FAs that involved isolated versus synthesized contingencies for problem behavior of 5 children while controlling for these other differences across FAs (Experiment 1). Next, the current study compared the effects of interventions based on the functions identified in the isolated and synthesized contingencies for each participant (Experiment 2). Results indicated isolated contingency FAs produced differentiated responding for 1 or both functions for all 5 participants, and there were little to no differences between treatments informed by isolated and synthesized contingency FAs.     

Effects of therapist‐worn protective equipment during functional analysis of aggression

The effects of therapist‐worn protective equipment (PE) on functional analysis (FA) outcomes for aggression were evaluated. Independent FAs with and without PE were conducted concurrently. Both FAs showed the same function of aggression for all participants. These results suggest that therapists may wear PE during FAs of aggression to reduce risk without altering the interpretation of the analysis.     

Progressing toward data intimacy: a review of within-session data analysis

Visual inspection of data is a common method for understanding, responding to, and communicating important behavior-environment relations in single-subject research. In a field that was once dominated by cumulative, moment-to-moment records of behavior, a number of graphic forms currently exist that aggregate data into larger units. In this paper, we describe the continuum of aggregation that ranges from distant to intimate displays of behavioral data. To aid in an understanding of the conditions under which a more intimate analysis is warranted (i.e., one that provides a richer analysis than that provided by condition or session aggregates), we review a sample of research articles for which within-session data depiction has enhanced the visual analysis of applied behavioral research.     

A translational evaluation of potential iatrogenic effects of single and combined contingencies during functional analysis

Recent research suggests that combining putative reinforcers for problem behavior into a single, synthesized contingency may increase efficiency in identifying behavioral function relative to traditional functional analysis (FA). Other research suggests potential shortcomings of synthesized contingency analysis (SCA), such as the potential for false-positive outcomes. In prior comparisons of traditional FAs and SCAs, investigators could not ascertain with certainty the true function(s) of the participants' problem behavior for use as the criterion variable. We conducted a translational study to circumvent this limitation by training a specific function for a surrogate destructive behavior prior to conducting a traditional FA and SCA. The traditional FA correctly identified the previously established function of the target response in all six cases and produced no iatrogenic effects. The SCA produced differentiated results in all cases and iatrogenic effects (i.e., an additional function) in three of six cases. We discuss these findings in terms of the mechanisms that may promote iatrogenic effects.     

TRIAL-BASED FUNCTIONAL ANALYSIS AND FUNCTIONAL COMMUNICATION TRAINING IN AN EARLY CHILDHOOD SETTING

Problem behavior is common in early childhood special education classrooms. Functional communication training (FCT; Carr & Durand, 1985 ) may reduce problem behavior but requires identification of its function. The trial‐based functional analysis (FA) is a method that can be used to identify problem behavior function in schools. We conducted trial‐based FAs and FCT with 3 children in an early childhood special education setting. All trial‐based FAs resulted in identification of behavioral functions, and subsequent FCT led to reductions in problem behavior and increases in communication.     

Enhanced visual performance in obsessive compulsive personality disorder

Visual performance is considered as commanding modality in human perception. We tested whether Obsessive–compulsive personality disorder (OCPD) people do differently in visual performance tasks than people without OCPD. One hundred ten students of Ferdowsi University of Mashhad and non‐student participants were tested by Structured Clinical Interview for DSM‐IV Axis II Personality Disorders (SCID‐II), among whom 18 (mean age = 29.55; SD = 5.26; 84% female) met the criteria for OCPD classification; controls were 20 persons (mean age = 27.85; SD = 5.26; female = 84%), who did not met the OCPD criteria. Both groups were tested on a modified Flicker task for two dimensions of visual performance (i.e., visual acuity: detecting the location of change, complexity, and size; and visual contrast sensitivity). The OCPD group had responded more accurately on pairs related to size, complexity, and contrast, but spent more time to detect a change on pairs related to complexity and contrast. The OCPD individuals seem to have more accurate visual performance than non‐OCPD controls. The findings support the relationship between personality characteristics and visual performance within the framework of top‐down processing model.     

Interview‐informed functional analyses: A comparison of synthesized and isolated components

Hanley, Jin, Vanselow, and Hanratty (2014) described a functional analysis (FA) format that relied on a synthesis of multiple contingencies described by caregivers during open‐ended interviews. These interview‐informed synthesized contingency analyses (IISCA) provided effective baselines from which to develop socially validated treatments, but the synthesis precluded a precise understanding of individual contingencies influencing problem behavior. We conducted IISCAs and standard FAs (Iwata, Dorsey, Slifer, Bauman, & Richman, 1982/1994) for nine children with autism to evaluate the likelihood of differentiation given a number of synthesized versus isolated variables. The IISCA was differentiated for all. The standard FA was differentiated for four; this number increased to six when we included precursors in the standard FA. We then compared treatments based on sets of differentiated analyses for four children. Treatment based on the IISCA was effective for all four; treatments based on the standard FA were effective for two. The role of synthesis in analysis is discussed.     

Effect size, power, and sample size determination for structured means modeling and mimic approaches to between-groups hypothesis testing of means on a single latent construct

While effect size estimates, post hoc power estimates, and a priori sample size determination are becoming a routine part of univariate analyses involving measured variables (e.g., ANOVA), such measures and methods have not been articulated for analyses involving latent means. The current article presents standardized effect size measures for latent mean differences inferred from both structured means modeling and MIMIC approaches to hypothesis testing about differences among means on a single latent construct. These measures are then related to post hoc power analysis, a priori sample size determination, and a relevant measure of construct reliability.I wish to convey my appreciation to the reviewers and Associate Editor, whose suggestions extended and strengthened the article's content immensely, and to Ralph Mueller of The George Washington University for enhancing the clarity of its presentation.