The Development and Validation of the Memory Support Treatment Provider Checklist

Patient memory for the contents of treatment is staggeringly poor, and poor memory for treatment is associated with worse treatment outcome. Accordingly, the Memory Support Intervention was developed to improve patient memory for treatment as an adjunct to treatment as usual. As plans to disseminate the Memory Support Intervention are developed, it is important to have efficient, accurate methods of measuring fidelity to the intervention. However, the existing method of assessing fidelity to the Memory Support Intervention, the Memory Support Rating Scale (MSRS), is burdensome and requires trained independent-raters to spend multiple hours reviewing session recordings, which is not feasible in many routine mental health care settings. Hence, a provider-rated measure of fidelity to the MSI has been developed. The goal of this study is to examine the reliability and validity of scores on this measure—the Memory Support Treatment Provider Checklist. A sample of Memory Support Treatment Provider Checklists (N = 319) were completed by providers (N = 8) treating adults with depression (N = 84). Three metrics of the Memory Support Treatment Provider Checklist were evaluated: (a) the internal consistency and structural validity using confirmatory factor analysis based on prior research on the MSRS and the Memory Support Intervention, (b) construct validity, and (c) predictive validity. Results indicate that the Memory Support Treatment Provider Checklist yields reliable and valid scores of fidelity to the Memory Support Intervention. Overall, this checklist offers a viable, brief method of evaluating fidelity to the Memory Support Intervention.     

Patient Responsiveness to a Sleep and Circadian Intervention in a Sample of Adults With Serious Mental Illness

Understanding patient responsiveness, a component of fidelity, is essential as it impacts treatment outcome and ongoing use of treatment elements. This study evaluated patient responsiveness—operationalized as receptivity to treatment modules and ratings of the usefulness and the utilization of treatment elements—to the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) in a sample of adults with serious mental illness (SMI) and sleep/circadian dysfunction. Adults with SMI and sleep/circadian dysfunction (N = 104) received TranS-C in a community mental health setting. Independent raters rated TranS-C sessions to assess receptivity. At posttreatment and 6-month follow-up, participants completed a usefulness scale, utilization scale, the PROMIS Sleep Disturbance (PROMIS-SD) and Sleep-Related Impairment (PROMIS-SRI) scales, DSM-5 Cross-Cutting Measure (DSM-5-CC), and Sheehan Disability Scale (SDS). Receptivity was rated as somewhat to fully understood, and predicted a reduction on the DSM-5-CC. On average, participants rated TranS-C as moderately useful and utilized treatment elements occasionally. Ratings of usefulness were associated with the PROMIS-SD, PROMIS-SRI, and DSM-5-CC at posttreatment, but not with the SDS. Ratings of utilization were not associated with outcome. The findings add to the literature on patient responsiveness, an implementation outcome, and provide data on the utility of TranS-C within a community mental health setting.     

A Randomized Trial to Identify Accurate Measurement Methods for Adherence to Cognitive-Behavioral Therapy

Clinician fidelity to cognitive behavioral therapy (CBT) is an important mechanism by which desired clinical outcomes are achieved and is an indicator of care quality. Despite its importance, there are few fidelity measurement methods that are efficient and have demonstrated reliability and validity. Using a randomized trial design, we compared three methods of assessing CBT adherence—a core component of fidelity—to direct observation, the gold standard. Clinicians recruited from 27 community mental health agencies (n = 126; M age = 37.69 years, SD = 12.84; 75.7% female) were randomized 1:1:1 to one of three fidelity conditions: self-report (n = 41), chart-stimulated recall (semistructured interviews with the chart available; n = 42), or behavioral rehearsal (simulated role-plays; n = 43). All participating clinicians completed fidelity assessments for up to three sessions with three different clients that were recruited from clinicians’ caseloads (n = 288; M age = 13.39 years SD = 3.89; 41.7% female); sessions were also audio-recorded and coded for comparison to determine the most accurate method. All fidelity measures had parallel scales that yielded an adherence maximum score (i.e., the highest-rated intervention in a session), a mean of techniques observed, and a count total of observed techniques. Results of three-level mixed effects regression models indicated that behavioral rehearsal produced comparable scores to observation for all adherence scores (all ps > .01), indicating no difference between behavioral rehearsal and observation. Self-report and chart-stimulated recall overestimated adherence compared to observation (ps < .01). Overall, findings suggested that behavioral rehearsal indexed CBT adherence comparably to direct observation, the gold-standard, in pediatric populations. Behavioral rehearsal may at times be able to replace the need for resource-intensive direct observation in implementation research and practice.     

Competence in Delivering Cognitive Processing Therapy and the Therapeutic Alliance Both Predict PTSD Symptom Outcomes

Cognitive Processing Therapy (CPT) is efficacious in treating PTSD, but there remains a need to improve outcomes for individuals who do not fully respond to treatment. Differences between patient-therapist dyads in the fidelity (i.e., adherence and competence) of CPT delivery and the quality of the therapeutic relationship may partly explain differential levels of symptom improvement. Sessions were sampled from a randomized trial comparing different consultation conditions in training therapists new to CPT. Among 69 patients, one session from Sessions 1–3 and one session from Sessions 4–7 were reliably rated for adherence and competence using the CPT Therapist Adherence and Competence Scale, and for therapeutic alliance using the Working Alliance Inventory-Observer scale. Mixed models, including detrending using a fixed effect of session, predicted self-reported Posttraumatic Stress Disorder Checklist (PCL-IV) scores in one session using process scores from the previous session. The statistical interaction between fidelity and alliance scores to predict outcome was also examined. Alliance had significant, positive correlations (rs = 0.18–0.21) with same-session adherence and competence. Higher competence scores and higher therapeutic alliance scores in one session were independently associated with lower PCL-IV scores in the subsequent session. Adherence scores, which tended to be very high with relatively less variability, did not significantly relate to subsequent-session PCL-IV scores. Competence significantly interacted with alliance, such that sessions high in both competence and alliance predicted especially lower subsequent-session PCL-IV scores. A strong therapeutic alliance may have a synergistic, salutary effect with the competent delivery of CPT.     

Outcomes From the Transdiagnostic Sleep and Circadian Intervention (TranS-C) for Midlife and Older Adults With Serious Mental Illness and Sleep and Circadian Dysfunction

The present study tested outcomes of the Transdiagnostic Sleep and Circadian Intervention (TranS-C) among midlife and older adults with serious mental illness (SMI). Further, we tested predictors—credibility, expectancy, usefulness, and utilization—that may affect TranS-C outcomes. Midlife and older participants from a community setting (>49 years, 62.3% female, 37.7% African American or Black) with sleep and circadian problems and SMI were randomized to receive TranS-C plus usual care (TranS-C+UC, n = 27) or usual care followed by delayed treatment with TranS-C (UC-DT, n = 26). Immediate and delayed TranS-C data were combined to increase power (combined n = 52). Outcomes were assessed at pretreatment, posttreatment, and 6-month follow-up. Credibility and expectancy were assessed during the second session. Usefulness and utilization of TranS-C skills were assessed at posttreatment and 6-month follow-up. TranS-C+UC, relative to UC-DT, was associated with improvements in depression symptoms, sleep disturbance, overall sleep health, and select sleep/wake outcomes, though not all improvements were sustained at 6-month follow-up. Lower usefulness of TranS-C skills predicted more severe sleep disturbance at posttreatment and daytime sleep-related impairment at posttreatment and 6-month follow-up. Lower utilization predicted more severe psychiatric symptoms at posttreatment, sleep disturbance at posttreatment and 6-month follow-up, and overall impairment and daytime sleep-related impairment at 6-month follow-up. Higher credibility and expectancy predicted greater usefulness of TranS-C skills at posttreatment and 6-month follow-up and greater utilization at 6-month follow-up. Together, findings highlight benefits of TranS-C for midlife and older adults with SMI. However, boosting credibility, expectancy, utilization, and usefulness may meaningfully improve TranS-C outcomes.     

Reducing Academic Procrastination Through a Group Treatment Program: A Pilot Study

The present study assessed a short-term group treatment program using cognitive interventions focused on students’ procrastination. A structured 90-min session program was used with 10 students (5 female, 5 male; M _age = 21.8, SD = 3.2) across 5 weeks. In the first and last session of the program participants completed a two reliable and valid procrastination scales, and then 8 weeks later in the follow up sessions filled out the same questionnaires. During the group sessions, participants identified their irrational thoughts as well as cognitive distortions associated with their procrastination tendencies. Results of a non-parametric Friedman Test revealed a significant decrease in participants’ academic procrastination score and general procrastination scores from the pre-test to follow-up test suggesting that the program was deemed to be successful.     

A Feasibility Study of Behavioral Activation for Major Depressive Disorder in a Community Mental Health Setting

Behavioral activation (BA) is a well-supported treatment approach, but little research has been conducted on the effectiveness of this treatment within publicly funded community mental health settings. We examined the feasibility of conducting a randomized trial examining the effectiveness of nine sessions of BA as a treatment for major depressive disorder (MDD) in a community mental health clinic (CMHC) setting. Following adaptation of a BA manual and training of BA therapists, 80 patients seeking treatment at a CMHC were randomized, with a 3:1 randomization rate of BA to nine sessions of treatment as usual (TAU). Feasibility assessments indicated that only one eligible patient refused randomization and, of patients who attended at least one session, the median number of sessions was six for the BA group and eight for the TAU group. Of three postbaseline monthly assessments, 71.3% (171/240) were successfully obtained. On average, patients in the BA condition completed homework assignments 83.9% of the time. Treatment fidelity ratings indicated that substantially more BA techniques were delivered in the BA group compared to the TAU group (d = 2.11). Measures of BA mechanisms improved significantly over time and these changes were significantly associated with change in depressive symptoms. These results indicate that it is feasible to conduct a randomized study of BA for MDD in a CMHC setting. In addition, the study reconfirmed the potential importance of theory-relevant BA mechanism variables. Following these findings, further investigation into the effectiveness of BA in this setting is needed.     

Converging on quality: Examining multiple measures of teaching effectiveness

The present study explores the convergent and predictive validity for several widely used measures of teaching quality from the Measures of Effective Teaching Project (Bill and Melinda Gates Foundation, 2009-2011). Specifically, the Classroom Assessment Scoring System (CLASS; Pianta, Hamre, & Mintz, 2012), the Framework for Teaching (FFT; Danielson Group, 2013), and the Tripod Student Perceptions Scale (Tripod; Ferguson, 2008) were examined. Correlations among measures were assessed by developmental level and content area (elementary mathematics N = 70; elementary English language arts N = 101; middle school mathematics N = 291, middle school English language arts N = 280). Both average scores and score variability (i.e., coefficient of variation) for the CLASS, FFT, and Tripod were used to predict value-added models (VAM), a high-stakes measure of students' academic growth. For elementary mathematics and ELA, findings indicated the CLASS and FFT exhibited moderate convergent validity while divergent validity was found between the Tripod and the CLASS and FFT. Across content areas in middle school grades, the CLASS, FFT, and Tripod exhibited moderate to high-moderate convergent validity. Average student and observer scores were positively related to VAM scores, whereas variability in scores demonstrated negative relations to VAM scores. Implications of findings for teacher evaluation and professional development are discussed.     

Community Implementation of MI-Enhanced Behavior Therapy for Adolescent ADHD: Linking Fidelity to Effectiveness

Evidence-based behavior therapy for adolescent ADHD faces implementation challenges in real-world settings. The purpose of this trial was to investigate the relationship between implementation fidelity and outcomes among adolescents receiving services in the active treatment arm (N = 114; Motivational Interviewing [MI]-enhanced parent-teen behavior therapy) of a community-based randomized trial of adolescent ADHD treatment. Participants received therapy from community clinicians (N = 44) at four agencies in a large, ethnically diverse metropolitan setting. Therapists provided self-report of session-by-session adherence to content fidelity checklists and audio recordings of sample sessions that were coded for MI integrity. Parents provided report of ADHD symptoms and family impairment at baseline, posttreatment, and follow-up, while academic records were obtained directly from the local school district. Results indicated that content fidelity significantly waned across the 10 manualized sessions (d = -1.23); these trends were steepest when therapy was delivered outside the office-setting and parent attendance was low. Community therapist self-report of content fidelity predicted significantly greater improvements in academic impairment from baseline to follow-up. MI delivery quality was not associated with improved outcomes; contrary to hypotheses, lower MI relational scores predicted significantly greater improvements in family impairment over time. Findings indicate that community-based outcomes for evidence-based ADHD treatment are enhanced when treatment is implemented with fidelity. Future work should revise community-based implementation strategies for adolescent ADHD treatment to prevent declines in fidelity over time, thereby improving outcomes.     

Psychometric properties of the Conners-3 and Conners Early Childhood Indexes in a Spanish school population

Ba#ckground/Obje#ctive: To examine the psychometric properties of the Conners 3 ADHD Index (Conners 3 AI) and the Conners Early Children Global Index (Conners ECGI) parents’ form (PF) and teachers’ form (TF) in Spanish schoolers. Method: Two-phase cross-sectional study. In the first phase, information was gathered from teachers (n = 1,796) and parents (n = 882) of 4-5 and 10-11 year-old children. In the second phase (n = 196), children at risk of ADHD and controls were individually assessed. Results: The results confirmed the two-factor structure of the Conners 3 ADHD Index, which contains hyperactive-impulsive and inattentive symptoms, and the two-factor structure of the Conners ECGI PF, consisting of emotional lability and restless-impulsive symptoms. In contrast with the original version, the Conners ECGI TF presented an additional inattentive factor. Moderate-to-high rates of evidence of convergent validity with Child Behavior Checklist and Kiddie-Schedule for Affective Disorders & Schizophrenia, and evidence of external validity (academic achievement) were found. Scores were significantly higher in boys than in girls, for both indexes. Raw scores corresponding to clinical T-scores were higher than the original version. Conclusions: The Conners indexes may be considered reliable and valid instruments for detecting ADHD symptoms in Spanish populations.     

Validity of the SF-12 in a Canadian Old Order Mennonite Community

To assess the validity of the Physical and Mental Component Summary scores (PCS-12 and MCS-12) of the SF-12 Health Survey (SF-12) in an Old Order Mennonite (OOM) community in Ontario, Canada. Most SF-12 validation studies have focused on general populations or clinical groups. This paper adds to the SF-12 literature by validating the instrument in a minority population. Sixty percent of the adult OOM population (n?=?1,171) completed a survey which had the SF-12 embedded within it. The survey also included questions on health determinants and the prevalence of chronic conditions. Factor analysis was used to confirm the two-factor structure of the SF-12. Item-scale correlations were calculated to assess convergent and discriminant validity. PCS-12 and MCS-12 variability by known subgroups were also explored. Factor analysis confirmed the two-factor structure and hypothesized loadings on the latent physical and mental health factors. Item-scale correlations demonstrated satisfactory convergent and discriminant validity. SF-12 summary scores distinguished well, and in the expected manner, between groups of respondents for gender, age, income adequacy, marital status, self-reported health measures, and other health determinants such as coping, trust, social interaction, and spirituality. PCS-12 and MCS-12 scores were lower in those with various chronic conditions compared to those without.The SF-12 appears to be a valid instrument for measuring health status in this minority population. Future SF-12 studies in OOMs and other populations may benefit from using Version 2 of the SF-12, where the dichotomous questions have been replaced by questions offering respondents more choice.     

A pragmatic approach to measuring adherence in treatment delivery in psychotherapy

ABSTRACT

Measuring therapists’ adherence to treatment manuals is recommended for evaluating treatment integrity, yet ways to do this are poorly defined, time consuming, and costly. The aims of the study were to develop a Therapy Component Checklist (TCC) to measure adherence to manualised CBT; to test its application in research and clinical practice; to determine its validity; and consider its cost benefits. We conducted a randomised trial in 230 people with cancer evaluating effectiveness of CBT for depression. In this, therapists delivered manualised treatment. Experts agreed on key components of therapy and therapists were asked to record these after therapy sessions by ticking a TCC. Inter-rater reliability was tested using an independent rater. Therapists delivered 543 CBT sessions. TCCs were completed in 293, of which 39 were assessed by the independent rater. Self-reported TCC data suggested close adherence to the manual. Prevalence-adjusted and bias-adjusted kappa scores suggested substantial agreement, (>0.60) in 38 out of 46 items. Self-rating of adherence saved around £96 per rating. In conclusion the TCC provides a quick and cost effective way of evaluating the components of therapy delivered. This approach could be applied to other psychological treatments and may help with linking therapeutic interventions with outcome.     

The Anxiety Depression Distress Inventory–27 (ADDI–27): New Evidence of Factor Structure,Item-Level Measurement Invariance,and Validity

Three studies examining the factor structure and psychometric properties of the Anxiety Depression Distress Inventory–27 (ADDI–27) extended the initial instrument development studies for this recently introduced inventory. The ADDI–27 is an empirically derived short form of the Mood and Anxiety Questionaire–90 (MASQ–90) comprising three scales: Positive Affect, Somatic Anxiety, and General Distress. The main objectives of Study 1 (N = 700) were to examine the factor structure of the ADDI–27 and its measurement invariance across gender at the item level. The objective of Study 2 (N = 538) was to examine evidence for the convergent and discriminant validity of scores on the ADDI–27. The objective of Study 3 (N = 240) was to assess further evidence for the nomological network and convergent and discriminant validity of the ADDI–27 scores. Results of exploratory structural equation modeling yielded strong support for a 3-factor model, with approximate fit indexes meeting or exceeding the conventional cutoffs. With p ≤ .001 as the criterion for detecting noninvariance, results of measurement invariance analysis suggested that all of the ADDI–27 items were invariant across gender. Results of multivariate validity analyses across 2 studies provided support for the convergent and discriminant validity of scores on the ADDI–27 scales.     

Can a Single Measure Estimate Protocol Adherence for Two Psychosocial Treatments for Youth Anxiety Delivered in Community Mental Health Settings?

Treatment adherence measurement can be time and resource-intensive in clinical trials, so the ability to measure protocol adherence for two distinct treatment programs with a single measure may benefit the field. The present study sought to determine if the Therapy Process Observational Coding System – Revised Strategies Scale (TPOCS-RS) could assess protocol adherence to two youth treatment programs. Treatment sessions (N = 796) from 55 youth (M age = 9.89 years, SD = 1.71; range 7–15 years; 55.0% White; 46.0% female) with primary anxiety problems treatment by 39 clinicians (M age = 40.54 years, SD = 9.56; 50.0% White; 80.0% female) were independently scored by coders using observational treatment adherence and alliance measures. The youth received one of three treatments: (a) Standard (i.e., cognitive-behavioral treatment program), (b) Modular (i.e., a program with cognitive-behavioral and parent training components), or (c) Usual Care. Consultants filled out a self-report measure of protocol adherence within the Standard and Modular conditions. Interrater reliability, ICC(2,2) for the various items for the full sample ranged from .17 to .92 (M ICC = .67; SD = .17). Scores from a TPOCS-RS subscale that mapped onto the specific content of the treatment protocols used in the Standard and Modular conditions evidenced convergent validity with the consultant-report adherence measure and discriminant validity with the alliance measure. The model-specific TPOCS-RS subscales also discriminated between the Standard and Modular treatments and Usual Care. This study provides initial evidence that (a) the TPOCS-RS has utility in estimating protocol adherence in different treatment programs and (b) support the score validity of the self-report consultation records.     

Validation of the AMBIANCE-brief: An observational screening instrument for disrupted caregiving

Resulting from a community-identified need for a well-validated indicator of caregiving difficulties for use in practice settings, a brief form of the Atypical Maternal Behavior Instrument for Assessment and Classification System (AMBIANCE) was developed for use as a screening instrument. Prior to its dissemination, this study aimed to assess the feasibility, reliability, and validity of the AMBIANCE-Brief. Adolescent mother–infant dyads (N = 69) participated in the Strange Situation Procedure, as well as play sessions with and without toys. Maternal disrupted caregiving was coded from the play sessions using the AMBIANCE and AMBIANCE-Brief. The AMBIANCE-Brief demonstrated convergent validity with the AMBIANCE in the play session with toys (r = .65, p < .001) and without toys (r = .61, p < .001). Concurrent validity of the AMBIANCE-Brief was also demonstrated in relation to infant attachment disorganization in the play session with toys (r = .36, p < .05) and without toys (r = .32, p < .01). These findings suggest a shorter protocol for assessing disrupted caregiving may be feasible and valid for use in community settings. Future studies are in progress to train community practitioners in the use of the AMBIANCE-Brief and to evaluate their reliability.     

When “reliability” fails,must a measure be discarded?—The case of Kinesthetic Aftereffect

Critics of Kinesthetic Aftereffect (KAE) recommend abandoning it as a personality measure largely because of poor test-retest reliability. Although no test can be valid if lacking true reliability, to discard a measure because of poor retest reliability is an oversimplification of validation procedures. This pitfall is exemplified here by a reexamination of KAE. KAE scores involve measures before (pretest) and after (test) aftereffect induction. Internal analysis of a KAE study showed: Differential bias is present; its locus is the second session pretest; its form makes second-session pretest scores functionally more similar to first- and second-session test scores and functionally more dissimilar to first-session pretest scores. Given this second session bias, the retest correlation tells us nothing about the true reliability of a one-session KAE score. However, if a measure possesses external validity, it must to some degree show true reliability. Based upon a literature review of one-session KAE validity studies, we conclude that one-session KAE scores are valid and hence show true reliability. KAE remains a promising personality measure.     

Training and Supervising Lay Providers in Kenya: Strategies and Mixed-Methods Outcomes☆☆☆

ObjectiveTraining lay providers to deliver mental health interventions is both effective and cost-effective. However, more research is needed to document training and supervision procedures and to collect lay providers’ feedback.MethodsThis study documents training and supervision from a randomized controlled trial of the Shamiri intervention, a four-session, school-based intervention that significantly reduced symptoms of anxiety and depression in Kenyan adolescents. We delivered a 10-hour training to 13 lay providers, M (SD)_age = 21.00 (1.95), %_female = 61.54. We also hosted 30-minute supervision meetings twice weekly. Training and supervision were delivered primarily by undergraduates. Independent raters coded session recordings for fidelity and quality of services, and we collected quantitative and qualitative feedback from lay providers.ResultsReliability and mean ratings for all six of our fidelity and quality measures (delivering required content, adhering to specified details, thoroughness, skillfulness, clarity, and purity) were very good to excellent. Lay provider quantitative ratings of training were also overwhelmingly positive, with an overall satisfaction rating of 6.46/7.00. We identified central qualitative themes in lay provider comments: Generally, comments about training style, content, and personal interactions were overwhelmingly positive, and many lay providers reported personal growth. Comments about timing and location of training were mixed.ConclusionsThis study provides preliminary evidence that a very brief training delivered primarily by undergraduates can teach high school-graduate lay providers to deliver effective mental health interventions. Additionally, we discuss lessons learned and implications for future research, including the importance of considering local context when planning and of continuously collecting and addressing lay provider feedback.     

Development of the Generic Multifaceted Automaticity Scale (GMAS) and preliminary validation for physical activity

ObjectivesThis article presents the validation of a Generic Multifaceted Automaticity Scale (GMAS) assessing the automatic properties of habitual behaviours.DesignA quantitative approach was adopted within various adult samples in order to confirm the internal and external validity of the GMAS pertaining to Physical Activity (PA).MethodStudy 1 investigated the content validity of a series of items among experts (N = 13) and respondents (N = 26). Study 2 examined the scale's construct validity for PA (N = 293). Study 3 tested the GMAS external validity (N = 161). Study 4 evaluated the internal consistency and predictive validity for the GMAS applied to transportation modes (N = 167). Study 5 used a 1-week prospective design and included Theory of Planned Behaviour (TPB; Ajzen, 2012) variables in order to test the predictive validity of the GMAS for active transportation (N = 125).ResultsStudy 1 supported the fact that the 9 items primarily reflected one facet of automaticity. Study 2 validated the hierarchical structure of the scale. In Study 3, convergent validity was confirmed regarding PA through significant correlations with the Self-Report Behavioural Automaticity Index (SRBAI; Gardner et al., 2012) and predictive validity was supported by significant correlations with self-report PA behaviour. Study 4 confirmed its internal consistency and predictive validity. Study 5 demonstrated that the scores derived from the GMAS significantly predicted active transportation behaviour, above and beyond TPB constructs.DiscussionThe GMAS appears as a valid instrument for research on everyday PA behaviours.     

Brief Interventions to Reduce Ecstasy Use: A Multi-Site Randomized Controlled Trial

Studies examining the ability of motivational enhancement therapy (MET) to augment education provision among ecstasy users have produced mixed results and none have examined whether treatment fidelity was related to ecstasy use outcomes. The primary objectives of this multi-site, parallel, two-group randomized controlled trial were to determine if a single-session of MET could instill greater commitment to change and reduce ecstasy use and related problems more so than an education-only intervention and whether MET sessions delivered with higher treatment fidelity are associated with better outcomes. The secondary objective was to assess participants’ satisfaction with their assigned interventions. Participants (N = 174; M_age = 23.62) at two Australian universities were allocated randomly to receive a 15-minute educational session on ecstasy use (n = 85) or a 50-minute session of MET that included an educational component (n = 89). Primary outcomes were assessed at baseline, and then at 4-, 16-, and 24-weeks postbaseline, while the secondary outcome measure was assessed 4-weeks postbaseline by researchers blind to treatment allocation. Overall, the treatment fidelity was acceptable to good in the MET condition. There were no statistical differences at follow-up between the groups on the primary outcomes of ecstasy use, ecstasy-related problems, and commitment to change. Both intervention groups reported a 50% reduction in their ecstasy use and a 20% reduction in the severity of their ecstasy-related problems at the 24-week follow up. Commitment to change slightly improved for both groups (9%–17%). Despite the lack of between-group statistical differences on primary outcomes, participants who received a single session of MET were slightly more satisfied with their intervention than those who received education only. MI fidelity was not associated with ecstasy use outcomes. Given these findings, future research should focus on examining mechanisms of change. Such work may suggest new methods for enhancing outcomes.Australia and New Zealand Clinical Trial Registry: ACTRN12611000136909