Effects of treatment‐integrity failures on a response‐cost procedure

Effects of incorrect or partial implementation (poor treatment integrity) on response cost are largely unknown. We evaluated reduced treatment integrity during response cost on rates of 2 concurrently available responses. College students earned points by clicking on either a black circle or a red circle on a computer screen. Experiment 1 compared 2 types of treatment‐integrity failures (omission and commission errors) across 2 levels of integrity (20% and 50%). Compared to 100% integrity conditions, omission errors did not suppress responding to the same extent, and commission errors reduced target responding but also decreased rates of alternative behavior. Experiment 2 compared the effects of 20% and 50% omission errors within subjects. Implementation at 50% integrity adequately suppressed responding, but treatment effects were lost at 20% integrity. There may be a critical level at which response cost must be implemented to suppress responding, which has important implications for application.     

Individual differences in 10‐month‐olds' performance on the A‐not‐B task

This study used the classical A‐not‐B task (Piaget, 1954 ) to explore individual differences in cognitive flexibility in 10‐month‐old infants by: (1) examining how differences in search performance during A trials relate to search performance during B trials; (2) studying the relation between temperamental dimensions and A‐not‐B performance; and (3) investigating differences in search performance between looking and reaching responses within the same task. Forty infants were tested on a fixed‐design‐version of the A‐not‐B task, not allowing for training or individual adjustment, but instead eliciting additional search behaviors than the common correct responses in A trials and perseverative errors in B trials. Infants were also rated by their parents on the temperamental scales Activity level and Attention span. The main findings were: (1) performance on A trials affected B trial performance, with infants being more correct on A trials having more incorrect and less ‘no search’ responses on B trials; (2) activity level, but not attention span, was related to performance on the A‐not‐B task, with infants performing better on A trials having a lower activity level; and (3) there were a few differences in performance with regard to modality, indicating that responding correctly by looking may be less cognitively demanding than doing so by reaching. This study demonstrated that 10‐month‐olds show a wide variation of search behaviors on this A‐not‐B task, resulting in individual differences in performance. These differences are suggested to reflect variation in temperamental activity level as well as maturity of short term/working memory, inhibition and cognitive flexibility.     

Age‐related change of location‐based visual selectivity depending on conflict frequency

Age‐related change in cognitive control for visual selectivity was examined using a conflict adaptation effect (CAE). The CAE reflects an increased stimulus compatibility effect for low levels of conflict frequency within blocks of trials. Younger (n = 20) and elderly (n = 20) adults received an Eriksen‐type flanker task involving compatible (e.g., “44444”) or incompatible (e.g., “44644”) arrays presented to either the left or right visual field (VF). The participants identified the central digit of an array. Relative frequency of conflict (incompatible) trials varied as a function of the VF. Also manipulated was the presentation order of more‐conflict VF and less‐conflict VF conditions over trial blocks. The results showed that a location‐based CAE appeared for both age groups in the first set of trial blocks, whereas in the final set of trial blocks the location‐based CAE appeared only for the younger adults. These results suggested that cognitive flexibility related to context‐dependent cognitive control diminishes with age.     

Personalizing Behavioral Interventions Through Single‐Patient (N‐of‐1) Trials

Behavioral interventions are typically studied with the use of a conventional between‐subject randomized controlled trial (RCT) design. In this design, the effect of an intervention on one group of patients is compared with the effect of a control condition on another group of patients, such that a between‐subject change is tested. A between‐subject design has an underlying assumption that there is a homogenous treatment effect for a behavioral intervention, drug, or psychotherapy and that the way the intervention operates in the study will tend to operate in the same way in many other patients. We review some of the philosophical and practical problems with the use of this design when a clinician is attempting to decide on a course of behavioral treatment aimed at within‐subject change in patients who are likely to have heterogeneous or unique responses to behavioral treatment. We also review the biases inherent in our current clinical practice model, which does not use any empirical data collection or design for testing if a treatment is useful, and also in the conventional between‐subject personalized medicine RCT designs. We propose increased use of single‐patient (also known as N‐of‐1) trials that employ within‐subject designs, in cases where treatment response is heterogeneous – as is the case for most psychological and behavioral treatments. Limitations of such designs include that they can only be used when the treatment is potentially reversible, the patient can act as their own control, and the outcome can be measured repeatedly. Increased use of within‐subject trials may address in many more instances the more clinically relevant question of how a specific patient will respond to a specific treatment and could introduce a more harmonious scientific approach into the way we treat our patients. We have incorporated a case presentation that illustrates the complexities of applying evidence drawn from these different designs to selecting and evaluating treatments for the behavioral issues commonly faced by clinicians and patients.     

Attachment‐based intervention for substance‐using mothers: A preliminary test of the proposed mechanisms of change

Although randomized controlled trials examining the efficacy of attachment‐based interventions have been increasing in recent years, adequate measurement of treatment integrity, integrity–outcome associations, and mechanisms of change has been rare. The aim of this investigation was to conduct a rigorous test of proposed mechanisms of change in the Mothers and Toddlers Program (MTP) treatment model, a 12‐session, attachment‐based individual therapy for substance‐using mothers of children birth to 3 years of age. The MTP aims to improve maternal reflective functioning (RF) and representation quality (RQ) to bring about second‐order change in maternal caregiving behavior. Following guidelines from M.K. Nock ( 2007 ), it was hypothesized that (a) therapist adherence to unique MTP treatment components would uniquely predict improvement in RF and RQ and that (b) improvement in RF and RQ would function as unique mechanisms of change (when compared with other potential mechanisms—reduction in depression and increase in abstinence from drug use) in the improvement of caregiving behavior. Findings supported each hypothesis, confirming the proposed mechanisms of the treatment model. However, improvement in maternal depression also uniquely predicted improvement in caregiving behavior. Results underscore the potential value of attachment‐based parenting interventions for improving mother–child relations and the importance of providing these interventions in clinic settings where mothers have access to comprehensive care (e.g., psychiatric services).     

Three‐mode analysis of multimode covariance matrices

Multimode covariance matrices, such as multitrait‐multimethod matrices, contain the covariances of subject scores on variables for different occasions or conditions. This paper presents a comparison of three‐mode component analysis and three‐mode factor analysis applied to such covariance matrices. The differences and similarities between the non‐stochastic and stochastic approaches are demonstrated by two examples, one of which has a longitudinal design. The empirical comparison is facilitated by deriving, as a heuristic device, a statistic based on the maximum likelihood function for three‐mode factor analysis and its associated degrees of freedom for the three‐mode component models. Furthermore, within the present context a case is made for interpreting the core array as second‐order components.     

Women are more sensitive than men to prior trial events on the Stop‐signal task

Sexual dimorphism in the brain and cognition is a topic of widespread interest. Many studies of sex differences have focused on visuospatial and verbal abilities, but few studies have investigated sex differences in executive functions. We examined two key components of executive function – response inhibition and response monitoring – in healthy men (n = 285) and women (n = 346) performing the Stop‐signal task. In this task, participants are required to make a key press to a stimulus, unless a tone is presented at some delay following the initial stimulus presentation; on these infrequent trials, participants are instructed to inhibit their planned response. Response inhibition was assessed with an estimate of the latency needed to inhibit a response (stop‐signal reaction time), and response monitoring was measured by calculating the degree to which participants adjusted their reaction times based on the immediately preceding trial (e.g., speeding following correct trials and slowing following errors). There were no sex differences in overall accuracy or response inhibition, but women showed greater sensitivity to trial history. Women sped up more than men following correct ‘Go’ trials, and slowed down more than men following errors. These small but statistically significant effects (Cohen's d = 0.25–0.3) suggest more flexible adjustments in speed–accuracy trade‐offs in women and greater cognitive flexibility associated with the responsive control of action.     

The role of error‐correction procedures in the reinforcement of errors

In Study 1 three different error‐correction procedures and a trial‐and‐error procedure were implemented in a Japanese word/phrase receptive identification task. Training procedures differed in the specific type of error that evoked error‐correction feedback. Outcomes indicated that when the error‐correction consequence was contingent on incorrect responses, incorrect responses predominated initially. When this feedback consequence followed no response, non‐responding initially prevailed. Task mastery was achieved in fewer trials with error‐correction procedures than with the no prompt/trial‐and‐error. However, post‐mastery probes 1 week after mastery indicated retention was greater for participants in the trial‐and‐error training condition. These patterns indicated that the feedback prompt itself could be functioning as a positive reinforcer. Demonstration of this effect would have been more definitive had individual participants been exposed to each experimental condition, and the limited number of participants in the trial‐and‐error group weakened conclusions from Study 1. These outcomes necessitated procedural replication. The initial question remained unanswered: if feedback were delivered contingent on trainee request and not contingent on errors, how would this affect errors and retention? Study 2, with a prompt‐request (‘Show me’) answered this question. Copyright © 2006 John Wiley & Sons, Ltd.     

The stability of disruptive childhood behaviors

The stability of child conduct and oppositional defiant behaviors during the period from 7 to 15 years was studied in a birth cohort of New Zealand children. These data were analyzed using two methods. In the first method the observed state to state changes in childhood behavioral tendencies were analyzed using empirical transition matrices. These results suggested that children classified as cases showed high rates of symptom remission, with approximately 50% of cases being classified as noncases 2 years later. In the second approach the data were analyzed using a latent Markov model which took account of errors of measurement in the classification of children. This analysis suggested the presence of strong continuities in childhood problem behaviors, with only 14% of children showing remission of behavioral problems within a 2-year period. The differences in the estimates yielded by the empirical transition matrices and the latent analyses were explained by the fact that there were relatively high probabilities that children who were cases were misclassified as a result of measurement errors.This research was funded by grants from the Health Research Council of New Zealand, the National Child Health Research Foundation, and the Canterbury Medical Research Foundation.     

Effect of video self‐monitoring on procedural integrity

A video self‐monitoring treatment package was used to evaluate the procedural integrity of staff implementing behavioral guidelines for one child with autism. Staff members with low procedural integrity scores were asked to participate. The treatment package incorporated an implementation video which reviewed the relevant behavioral guidelines and a procedural integrity monitoring system. Each participant was taught to score a pre‐training video, which highlighted components of implementing behavioral guidelines, with a procedural integrity tool denoting correct implementation of the procedures. The participant then scored their own baseline video using a similar tool constructed to highlight the target student's behavior plan. Participant scores were compared to experimenter scores and verbal feedback was given by the experimenter if the scores varied. Results showed increased procedural integrity implementing the behavior guidelines from baseline to 100% implementation for two out of three participants. Copyright © 2010 John Wiley & Sons, Ltd.     

An evaluation of estimation data collection to trial‐by trial data collection during discrete trial teaching

There are many data collection procedures used during discrete trial teaching including first‐trial data collection, probe data, trial‐by‐trial data collection, and estimation data. Continuous, or trial‐by‐trial data collection, consists of the interventionist collecting data on learner behavior on each trial. Estimation data consists of the interventionist estimating learner performance after a teaching session using a rating scale. The purpose of the present study was to compare trial‐by‐trial data collection to estimation data collection during discrete trial teaching to teach children expressive labels. The data collection procedures were examined in terms of accuracy of data collection, efficiency of teaching (i.e., number of trials delivered per session), and rate of child acquisition of targets. Results of the adapted alternating treatment design replicated across three participants and multiple targets found estimation data collection to be as accurate as trial‐by‐trial data collection in determining mastery of targets. Estimation data collected by the interventionist was also found to be accurate when compared to the actual trial‐by‐trial data collected after the study concluded.     

EQUIVALENCE CLASS FORMATION IN A TRACE STIMULUS PAIRING TWO‐RESPONSE FORMAT: EFFECTS OF RESPONSE LABELS AND PRIOR PROGRAMMED TRANSITIVITY INDUCTION

Three experiments identified factors that did and did not enhance the formation of two‐node four‐member equivalence classes when training and testing were conducted with trials presented in a trace stimulus pairing two‐response (SP2R) format. All trials contained two separately presented stimuli. Half of the trials, called within‐class trials, contained stimuli from the same class while the other half, called cross class trials, contained stimuli from different classes. On within class trials, making a YES response was correct and making a NO response was wrong. On cross class trials, making a NO response was correct and making a YES response was wrong. In Experiment 1, similar intermediate percentages of participants (about 50%) formed classes, regardless of whether the responses were labeled YES and NO or SAME and DIFF. Response labeling thus did not influence class formation. Regardless of response labels, failures of class formation were primarily due to failure of class‐indicative responding produced by within‐class transitivity probes. In Experiment 2, only 50% of participants formed classes without prior training, as in Experiment 1, but 100% of participants formed equivalence classes after the establishment of a generalized transitivity repertoire by use of a programmed transitivity induction protocol. Experiment 3 examined two components of the programmed transitivity induction protocol and found that the exclusion of AC trials had no effect on the percentage of participants who formed equivalence classes, while presenting the stimulus sets in randomized order interfered with equivalence class formation. A further analysis found that a number of stimulus control topographies differentiated between individuals who did and did not form equivalence classes. In general, then, these experiments demonstrate that equivalence classes can be formed reliably when training and testing are conducted in an SP2R format, supporting the view that equivalence class formation can account for the development of conceptual categories in natural settings.     

Improving Women's Self‐Compassion Through an Online Program: A Randomized Controlled Trial

The benefits of self‐compassion interventions have been well documented in the counseling literature. Despite these benefits, access to such interventions remains a considerable barrier for a range of populations. We addressed the issue of limited access by using a randomized controlled trial to evaluate an online, self‐guided course on self‐compassion specifically targeted toward women. Fifty‐seven women were randomly assigned to receive immediate or delayed access to a 10‐week course designed to increase self‐compassion and reduce self‐judgment, shame, and perfectionism. Analysis of the data revealed that participants in the treatment condition experienced significant increases in self‐compassion and decreases in self‐judgment, shame, and perfectionism compared with participants in the wait‐list group. Results provide evidence that self‐compassion can be fostered in a nonclinical population of women through participation in a self‐paced online course. Related findings and potential implications, including the use of such interventions to address accessibility concerns, are discussed within the existing literature.     

Twelve‐ to 14‐month‐old infants can predict single‐event probability with large set sizes

Previous research has revealed that infants can reason correctly about single‐event probabilities with small but not large set sizes ( Bonatti, 2008 ; Teglas et al., 2007 ). The current study asks whether infants can make predictions regarding single‐event probability with large set sizes using a novel procedure. Infants completed two trials: A preference trial to determine whether they preferred pink or black lollipops and a test trial where infants saw two jars, one containing mostly pink lollipops and another containing mostly black lollipops. The experimenter removed one occluded lollipop from each jar and placed them in two separate opaque cups. Seventy‐eight percent of infants searched in the cup that contained a lollipop from the jar with a higher proportion of their preferred color object, significantly better than chance. Thus infants can reason about single‐event probabilities with large set sizes in a choice paradigm, and contrary to most findings in the infant literature, the prediction task used here appears a more sensitive measure than the standard looking‐time task.     

Integrity Tests and the Five‐Factor Model of Personality: A Review and Empirical Test of Two Alternative Positions

The psychological meaning of integrity test scores has been explored predominantly in relation to the five‐factor model of personality (FFM). Two alternative positions on this topic can be identified in the literature which state, respectively, that integrity tests measure (a) a higher‐order factor of personality covering three FFM dimensions or (b) a linear composite of numerous facets from various domains within the FFM. An empirical test of these alternative positions, using structural equation modeling, revealed that the value of both views depended on the type of integrity test examined. With a personality‐based integrity test, position (a) had to be refuted, whereas position (b) was strongly supported. There was also more supportive evidence for position (b) with an overt test, but the difference was far less pronounced than for the personality‐based measure. Possible consequences for theories on the role of personality in personnel selection are discussed.     

Live training versus e‐learning to teach implementation of listener response programs

Discrete‐trial teaching is an effective teaching procedure that must be implemented with high integrity to produce optimal learning. Behavioral Skills Training (BST) has proven effective for staff training; however, BST is time and labor intensive. Computer‐based instruction (CBI) programs may provide a more efficient and cost‐effective alternative to live training if the CBI program is as effective as BST in producing accurate implementation. The current study compared CBI to BST to train novice undergraduate students to conduct discrete‐trial teaching. Participants were randomly assigned to one of the two conditions and assessed prior to and after the completion of training. Results indicated that although both BST and CBI were effective at training participants to implement discrete‐trial teaching, BST was slightly but significantly more effective whereas CBI quickly created a return on the investment of product development.     

Errors of Omission and Commission during Alternative Reinforcement of Compliance: The Effects of Varying Levels of Treatment Integrity

We conducted two experiments to evaluate the effects of errors of omission and commission during alternative reinforcement of compliance in young children. In Experiment 1, we evaluated errors of omission by examining two levels of integrity during alternative reinforcement (20 and 60 %) for child compliance following no treatment (baseline) versus treatment at full (i.e., 100 %) integrity. Results indicated that compliance varied according to the level of integrity in place. In addition, compliance in the 60 % integrity condition was high and stable when it followed baseline, but was substantially lower for one participant and slightly lower for a second participant when it followed the full integrity condition. In Experiment 2, we evaluated errors of commission. For three participants, we compared treatment at full integrity to a condition in which errors of commission were made on every trial (i.e., 0 % integrity). For one of these three participants, we also compared treatment at full integrity to baseline and to a condition in which errors of commission were made on 50 % of trials. Results of all four evaluations again indicate that compliance varied according to the level of integrity in place: compliance was low in both the 0 and 50 % integrity conditions, regardless of the preceding condition. These results suggest that during alternative reinforcement of compliance, the effect of occasional errors of omission may depend on the immediately preceding context but that errors of commission are more detrimental.     

Identifying learning patterns of children at risk for Specific Reading Disability

Differences in learning patterns of vocabulary acquisition in children at risk (+SRD) and not at risk (?SRD) for Specific Reading Disability (SRD) were examined using a microdevelopmental paradigm applied to the multi‐trial Foreign Language Learning Task (FLLT; Baddeley et al., 1995). The FLLT was administered to 905 children from rural Chitonga‐speaking Zambia. A multi‐group Latent Growth Curve Model (LGCM) was implemented to study interindividual differences in intraindividual change across trials. Results showed that the +SRD group recalled fewer words correctly in the first trial, learned at a slower rate during the subsequent trials, and demonstrated a more linear learning pattern compared to the ?SRD group. This study illustrates the promise of LGCM applied to multi‐trial learning tasks, by isolating three components of the learning process (initial recall, rate of learning, and functional pattern of learning). Implications of this microdevelopmental approach to SRD research in low‐to‐middle income countries are discussed.