Client-level predictors of adherence to MST in community service settings

This study examined the association of youth and family characteristics with therapist fidelity to an evidence-based treatment provided in real world practice settings. Participants were 233 families that reported on the 66 therapists organized into 16 teams in nine organizations providing multisystemic therapy (MST). Therapist adherence ratings were lower for youths referred for both criminal offenses and substance abuse than for youths referred either for substance abuse or status offenses, and was negatively associated with pretreatment arrests and school suspensions. Adherence ratings were positively associated with educational disadvantage and caregiver-therapist ethnic match and marginally positively associated with economic disadvantage. The findings suggest directions for future research on the implementation of evidence-based treatments in community settings.     

Satisfaction with the Health Care Provider and Regimen Adherence in Minority Youth with Type 1 Diabetes

To assess whether satisfaction with the health-care provider is related to regimen adherence among primarily minority youth with type 1 diabetes. Youth with type 1 diabetes (n = 169; M age = 13.88; 52 % female; 70 % Hispanic) and their parents completed questionnaires that assessed their own satisfaction with the health-care provider and youths’ adherence to diabetes self-care behaviors. Higher youth and parent patient-provider relationship satisfaction was associated with higher regimen adherence. Gender affected the relationship between satisfaction and regimen adherence, such that for girls, greater satisfaction was associated with better adherence; this was not the case for boys. Patient satisfaction with the health care provider is important for regimen adherence among primarily minority youth with type 1 diabetes, particularly for girls. Future research might focus on improving youths’ relationships with their health care providers as a potential pathway to improve regimen adherence.     

Examining the Relation Between the Therapeutic Alliance, Treatment Adherence, and Outcome of Cognitive Behavioral Therapy for Children With Anxiety Disorders

Little is known about the contribution of technical and relational factors to child outcomes in cognitive behavioral therapy (CBT) for children with anxiety disorders. This study investigated the association between treatment adherence, the child-therapist alliance, and child clinical outcomes in manual-guided individual- and group-based CBT for youths diagnosed with anxiety disorders. Trained observers rated tapes of therapy sessions for treatment adherence and child-therapist alliance in a sample of 52 children (aged 8 to 12) with anxiety disorders. Self-reported child anxiety was assessed at pre-, mid-, and posttreatment; parent-reported child internalizing symptoms was assessed at pre- and posttreatment. The results showed high levels of treatment adherence and child-therapist alliance in both CBT programs. Neither treatment adherence nor child-therapist alliance predicted traditional measurements of child outcomes in the present study, but a relation between alliance and outcome was found using a more precise estimation of the true pre-post differences. Implications of these findings for expanding our understanding of how treatment processes relate to child outcome in CBT for children with anxiety disorders are discussed.     

Use of Multisystemic Therapy to Improve Regimen Adherence Among Adolescents with Type 1 Diabetes in Poor Metabolic Control: A Pilot Investigation

The purpose of the current study was to conduct a pilot investigation to determine the effectiveness of Multisystemic Therapy (MST) for improving regimen adherence and metabolic control among adolescents with poorly controlled Type 1 diabetes. Thirty-one adolescents were randomly assigned to either MST or a control condition. MST treatment lasted approximately six months. Data were collected at study entry and at a six-month posttest. Twenty-five adolescents completed the study. Adolescents who received MST had significantly improved adherence to blood glucose testing and metabolic control from study entry to the six-month posttest, whereas controls did not. Adolescents receiving MST also had a decreased number of inpatient admissions at the six-month posttest. Improvements in metabolic control were related to improvements in parent report of adolescent adherence. Results suggest that MST holds promise as an intervention for improving adherence behavior and health outcomes among adolescents in poor metabolic control.     

Community Implementation of MI-Enhanced Behavior Therapy for Adolescent ADHD: Linking Fidelity to Effectiveness

Evidence-based behavior therapy for adolescent ADHD faces implementation challenges in real-world settings. The purpose of this trial was to investigate the relationship between implementation fidelity and outcomes among adolescents receiving services in the active treatment arm (N = 114; Motivational Interviewing [MI]-enhanced parent-teen behavior therapy) of a community-based randomized trial of adolescent ADHD treatment. Participants received therapy from community clinicians (N = 44) at four agencies in a large, ethnically diverse metropolitan setting. Therapists provided self-report of session-by-session adherence to content fidelity checklists and audio recordings of sample sessions that were coded for MI integrity. Parents provided report of ADHD symptoms and family impairment at baseline, posttreatment, and follow-up, while academic records were obtained directly from the local school district. Results indicated that content fidelity significantly waned across the 10 manualized sessions (d = -1.23); these trends were steepest when therapy was delivered outside the office-setting and parent attendance was low. Community therapist self-report of content fidelity predicted significantly greater improvements in academic impairment from baseline to follow-up. MI delivery quality was not associated with improved outcomes; contrary to hypotheses, lower MI relational scores predicted significantly greater improvements in family impairment over time. Findings indicate that community-based outcomes for evidence-based ADHD treatment are enhanced when treatment is implemented with fidelity. Future work should revise community-based implementation strategies for adolescent ADHD treatment to prevent declines in fidelity over time, thereby improving outcomes.     

Consistency of adherence across regimen demands

The extent to which adherence to one demand of the diabetic treatment regimen is related to adherence to other regimen demands was explored in a sample of 227 diabetic patients. Adherence to weight control, urine/blood testing, medication taking, symptom reporting, and safety demands was assessed using a variety of methods: (a) patients' report in relation to physician's criteria, (b) patients' report in relation to their own understanding of those criteria, (c) significant others' reports, (d) nurses' ratings, and (e) physicians' ratings. Based on attribution theory, it was proposed that informed others would view patients as more consistent than patients themselves did. Separate intercorrelation matrices were created for each method. The correlations, however, were uniformly low (most rs less than .25) and mean correlations did not differ significantly between matrices. The relative independence of adherence to different demands of the diabetic regimen has important implications for the conceptualization and measurement of treatment adherence.     

Illness perceptions and self efficacy beliefs in adolescents and young adults with insulin dependent diabetes mellitus

Abstract

The study examined the role of illness perceptions and self-efficacy in diabetic regimen adherence and metabolic control among young patients with Insulin Dependent Diabetes Mellitus (IDDM). Sixty-four outpatients with Insulin Dependent Diabetes completed measures of illness perceptions, generalised and diabetes specific self-efficacy and a self-report measure of adherence. Metabolic control (HbAlc) was also assessed. Control, identity and consequences components of illness perceptions were significantly correlated with self-efficacy expectancies. Control beliefs were consistently associated with self-reported adherence across all treatment aspects and accounted for 39% of the predicted variance in total adherence. The associations of the other psychological predictors examined, varied depending on the regimen area. Multiple regression analysis showed that 30.8% of the variance in HbAlc assays was explained by patients' diabetes specific self-efficacy, consequences and identity. Our findings suggest that patients' beliefs are useful predictors of physiological and behavioural outcomes in diabetes self-management and should thus be the focus of routine clinical assessments and future interventions.     

Differences in inter-rater reliability and accuracy for a treatment adherence scale

Inter-rater reliability and accuracy are measures of rater performance. Inter-rater reliability is frequently used as a substitute for accuracy despite conceptual differences and literature suggesting important differences between them. The aims of this study were to compare inter-rater reliability and accuracy among a group of raters, using a treatment adherence scale, and to assess for factors affecting the reliability of these ratings. Paired undergraduate raters assessed therapist behavior by viewing videotapes of 4 therapists' cognitive behavioral therapy sessions. Ratings were compared with expert-generated criterion ratings and between raters using intraclass correlation (2,1). Inter-rater reliability was marginally higher than accuracy (p = 0.09). The specific therapist significantly affected inter-rater reliability and accuracy. The frequency and intensity of the therapists' ratable behaviors of criterion ratings correlated only with rater accuracy. Consensus ratings were more accurate than individual ratings, but composite ratings were not more accurate than consensus ratings. In conclusion, accuracy cannot be assumed to exceed inter-rater reliability or vice versa, and both are influenced by multiple factors. In this study, the subject of the ratings (i.e. the therapist and the intensity and frequency of rated behaviors) was shown to influence inter-rater reliability and accuracy. The additional resources needed for a composite rating, a rating based on the average score of paired raters, may be justified by improved accuracy over individual ratings. The additional time required to arrive at a consensus rating, a rating generated following discussion between 2 raters, may not be warranted. Further research is needed to determine whether these findings hold true with other raters and treatment adherence scales.     

Clinicians' fidelity to a manual-based family treatment as a predictor of the one-year course of bipolar disorder

This study assessed whether therapist adherence to the family focused treatment model for patients with bipolar disorder and their relatives was associated with patient outcomes at one year after treatment entry. A total of 78 videotaped sessions of FFT consisting of 26 families with a member with bipolar disorder (3 sessions/family) were rated on fidelity using the Therapist Competence/Adherence Scale (TCAS; see Endnote 1, p. 130). Patients' outcomes (relapse status) were assessed using the Brief Psychiatric Rating Scale (BPRS) and selected items from the Schedule of Affective Disorders and the Schizophrenia-Change (SADS-C) scale (measured at 3-month intervals for 12 months). Contrary to expectations, therapist fidelity was not related to overall outcome as assessed by the BPRS and the SADS-C. Among patients who did relapse, higher levels of cooperation among therapists predicted a later date for relapse than did lower levels of cooperation. Surprisingly, and in opposition to the study's hypotheses, patients who were hospitalized because of relapses had therapists who were rated as more competent in their ability to conduct the problem-solving module of FFT. Study implications are discussed.     

Differences in Inter‐Rater Reliability and Accuracy for a Treatment Adherence Scale

Inter‐rater reliability and accuracy are measures of rater performance. Inter‐rater reliability is frequently used as a substitute for accuracy despite conceptual differences and literature suggesting important differences between them. The aims of this study were to compare inter‐rater reliability and accuracy among a group of raters, using a treatment adherence scale, and to assess for factors affecting the reliability of these ratings. Paired undergraduate raters assessed therapist behavior by viewing videotapes of 4 therapists' cognitive behavioral therapy sessions. Ratings were compared with expert‐generated criterion ratings and between raters using intraclass correlation (2,1). Inter‐rater reliability was marginally higher than accuracy (p = 0.09). The specific therapist significantly affected inter‐rater reliability and accuracy. The frequency and intensity of the therapists' ratable behaviors of criterion ratings correlated only with rater accuracy. Consensus ratings were more accurate than individual ratings, but composite ratings were not more accurate than consensus ratings. In conclusion, accuracy cannot be assumed to exceed inter‐rater reliability or vice versa, and both are influenced by multiple factors. In this study, the subject of the ratings (i.e. the therapist and the intensity and frequency of rated behaviors) was shown to influence inter‐rater reliability and accuracy. The additional resources needed for a composite rating, a rating based on the average score of paired raters, may be justified by improved accuracy over individual ratings. The additional time required to arrive at a consensus rating, a rating generated following discussion between 2 raters, may not be warranted. Further research is needed to determine whether these findings hold true with other raters and treatment adherence scales.     

Adherence to Wraparound Principles and Association with Outcomes

Maintaining fidelity to the principles of the Wraparound process in serving children with emotional and behavioral disorders is a high priority. However, the assumption that greater adherence to the model will yield superior outcomes has not been tested. The current study investigated associations between adherence to Wraparound principles, as assessed by the Wraparound Fidelity Index, second version (WFI), and child and family outcomes in one federally funded system-of-care site. Results demonstrated that higher fidelity was associated with better behavioral, functioning, restrictiveness of living, and satisfaction outcomes. No associations were found for several additional outcomes making interpretation difficult. Our study provides initial support for the hypothesis that maintaining fidelity to the philosophical principles of Wraparound is important to achieving outcomes. The study also provides support for the construct validity of the WFI as a service process measure.     

Therapist Self-Efficacy in Delivering Cognitive Processing Therapy in a Randomized Controlled Implementation Trial

Efforts to improve the implementation of evidence-based treatments (EBT) have recently made important strides. One such example is understanding the vital role that weekly consultation plays as therapists learn to deliver an EBT. Because mechanism-based research can further support EBT implementation, the present study sought to examine the potential relationship between therapist self-efficacy in relation to treatment fidelity and outcomes.We examined therapist self-efficacy ratings from 80 therapists working with 188 patients. These data were collected as part of a randomized controlled implementation trial testing cognitive processing therapy (CPT). Across post-workshop training conditions, we ran multilevel models to assess (1) changes in therapist self-efficacy, (2) therapist self-efficacy in relation to treatment fidelity, and (3) therapist-self-efficacy in relation to patient PTSD symptom outcomes.We found that therapist self-efficacy significantly improved over the course of 6 months of CPT training. Baseline therapist self-efficacy was differentially associated with client outcomes based on post-workshop training condition. Specifically, therapists with low self-efficacy that did not receive post-workshop consultation tended to have poorer outcomes than therapists with low self-efficacy that received consultation. In the present sample, therapist self-efficacy was not related to treatment fidelity.As this was the first study to examine therapist self-efficacy in the implementation of an evidence-based treatment, our findings suggest that self-efficacy may be an important implementation factor in treatment outcomes and worthy of ongoing research.     

Evaluating Therapist Competency and Adherence to Behavioral Family Management with Bipolar Patients

The present study assessed fidelity to the behavioral family management (BFM) model for treating bipolar disorder patients and their families. The BFM Therapist Competency/Adherence Scale (BFM-TCAS) was developed to evaluate clinicians' competency and adherence to BFM, as outlined by Miklowitz' (1989) BFM Manual for use with bipolar patients. Therapist competency and treatment adherence was also evaluated with regard to two family characteristics: overall level of family difficulty and family expressed emotion (EE) status. The BFM-TCAS was used to code 78 videotaped sessions of 26 families with a bipolar member, selected from a larger treatment study of bipolar disorder patients. The findings suggest that, overall, clinicians adhered closely to the BFM manual. Specific areas in which there was high competency and treatment adherence were (a) skill in conveying factual information about bipolar illness, (b) establishment of a therapeutic environment, and (c) ability to take command of therapy sessions. The one area in which there was less compotency and relatively weak adherence to the manual was the use of between-session homework assignments to assist families in mastering the BFM exercises. Results of this study also suggest that, for the most part, therapist competency and adherence ratings were not related to overall level of difficulty or to family EE status.     

Associations of LGBTQ+ Identities With Acceptability and Efficacy of Online Single-Session Youth Mental Health Interventions

Barriers such as stigma, financial costs, and provider shortages prevent large portions of youth with depression and related difficulties from accessing treatment; lesbian, gay, bisexual, transgender, queer/questioning sexual orientation, or other non-heterosexual identity (LGBTQ+) youth are burdened with additional barriers related to minority stress. Single-session interventions (SSIs) have been found to benefit youth and help reduce depression symptoms, and since many SSIs are brief, cost-free, and accessible online, they may circumvent several access barriers. However, prior to recommending non-community-tailored SSIs as a useful resource for minoritized youths, we first assessed whether LGBTQ+ youth respond as positively to SSIs as do cisgender heterosexual youth. In a subsample of youths recruited via online advertisements from September 2019 to August 2020 (N = 258, 81.4% female-assigned sex at birth, 60.5% LGBTQ+, 47.3% youth of color), we investigated whether changes in hopelessness, agency, and self-hate from before to after completing online self-directed SSIs differed as a function of LGBTQ+ identity. We also quantitatively and qualitatively compared intervention acceptability ratings and feedback across LGBTQ+ and cisgender heterosexual youths. Analyses revealed no significant differences between cisgender LGBQ+, trans and gender diverse, and cisgender heterosexual youths for any intervention outcomes. Likewise, no group differences emerged in intervention acceptability ratings or written program feedback. Self-selection bias and underrepresentation of certain populations, such as American Indian and Alaskan Native youths, may limit generalizability of results. Results suggest that online mental health SSIs are equally acceptable and useful to LGBTQ+ and cisgender heterosexual youth alike, even prior to culturally specific tailoring.     

A Cognitive Behavioral Adherence Intervention for Adolescents with Type 1 Diabetes

This study examined the impact of a cognitive behavioral intervention for nonadherent adolescents with type 1 diabetes. Six youths having problems following the diabetes regimen received training in cognitive restructuring and problem solving during individual sessions. A multiple baseline design across participants was used. Treatment effectiveness was assessed through 24-hr recall adherence interviews with adolescents and frequency of testing data was downloaded from glucose meters. Data was also collected for diabetes-specific stress. Five youths displayed improvement on at least one self-care behavior. Furthermore, the results suggest that the cognitive behavioral intervention was effective in diminishing diabetes-related stress in two participants. Cognitive behavioral interventions show promise for increasing self-care behaviors among nonadherent youths with type 1 diabetes. However, individual youths varied in their response to treatment. Further research is needed in developing procedures to better meet the needs of youths, improve youth participation, and enhance treatment effectiveness.     

Multisystemic therapy: monitoring treatment fidelity

The challenges of specifying a complex and individualized treatment model and measuring fidelity thereto are described, using multisystemic therapy (MST) as an example. Relations between therapist adherence to MST principles and instrumental and ultimate outcome variables are examined, as are relations between clinical supervision and therapist adherence. The findings provide modest support for the associations between MST adherence measures and instrumental and ultimate outcomes. Results also show that adherence can be altered when clinical supervision and adherence monitoring procedures are fortified. The modest associations between adherence measures and youth outcomes argue for further refinement and validation of the MST adherence measure, especially in light of the well-established effectiveness of MST with challenging clinical populations and the increasing dissemination of MST programs.     

The transportability of multisystemic therapy to Sweden: short-term results from a randomized trial of conduct-disordered youths

This randomized clinical trial assessed the effectiveness of multisystemic therapy (MST) for 156 youths who met the diagnostic criteria for conduct disorder. Sweden's 3 largest cities and 1 small town served as the recruiting area for the study. A mixed factorial design was used, with random allocation between MST and treatment as usual groups. Assessments were conducted at intake and 7 months after referral. With an intention-to-treat approach, results from multiagent and multimethod assessment batteries showed a general decrease in psychiatric problems and antisocial behaviors among participants across treatments. There were no significant differences in treatment effects between the 2 groups. The lack of treatment effect did not appear to be caused by site differences or variations in program maturity. MST treatment fidelity was lower than that of other studies, although not clearly related to treatment outcomes in this study. The results are discussed in terms of differences between Sweden and the United States. One difference is the way in which young offenders are processed (a child welfare approach vs. a juvenile justice system approach). Sociodemographic differences (e.g., rates of poverty, crime, and substance abuse) between the 2 countries may also have moderating effects on the rates of rehabilitation among young offenders. (PsycINFO Database Record (c) 2008 APA, all rights reserved).     

Treatment Fidelity of a Randomized Controlled Trial for Suicidal Risk

Treatment fidelity is a crucial consideration within randomized controlled trials (RCTs). The present study relies on data from a feasibility RCT conducted with 62 treatment-seeking suicidal college students. Issues of experimental fidelity were germane in this investigation because the same clinicians provided both the experimental (the Collaborative Assessment and Management of Suicidality—CAMS) and the control (treatment as usual—TAU) care. The first aim of the current study was to determine adherence to the CAMS model within the experimental (CAMS) and control (TAU) treatment conditions. A second exploratory aim was included to examine how treatment fidelity impacted treatment outcomes (i.e., depression, suicidal ideation, hopelessness, and potential treatment moderators). The CAMS Rating Scale (CRS.3-R) was used to determine treatment adherence to the CAMS model and to ensure between-group fidelity within the trial. The CRS.3-R was completed throughout the course of care based on reviews of a selected number of video recordings of both CAMS and TAU sessions to measure treatment fidelity. Mean CRS.3-R scores revealed differences across treatment conditions such that clinicians were successfully able to provide each treatment separately without contamination. Further, higher CRS.3-R scores in CAMS sessions resulted in decreased hopelessness over the treatment period. Higher CRS.3-R scores in TAU sessions resulted in an increased likelihood of suicidal ideation and less reduction in hopelessness over the treatment period. Overall, clinicians can serve as their own controls in a RCT and levels of adherence to the CAMS model have different effects on suicidal ideation and hopelessness.

     

The health belief model and adolescents with insulin-dependent diabetes mellitus.

We tested the predictive utility of the health belief model (HBM) for adherence with a complex, ongoing medical regimen in the context of a chronically ill youthful population (56 adolescent outpatients with insulin-dependent diabetes mellitus; mean age = 14 years). A three-construct model of health beliefs was tested: Threat (perceived susceptibility combined with severity), Benefits-Costs, and Cues to seek treatment. Multiple indicators of compliance were used, and metabolic control was measured by glycosylated hemoglobin. The Benefits-Costs and Cues constructs were related to compliance in the theoretically expected positive direction. Threat interacted with Benefits-Costs in the prediction of compliance and with Cues in the prediction of metabolic control. The greatest compliance was achieved with low perceived Threat and high perceived Benefits-Costs. Poor metabolic control was associated with high Threat and Cues. As age increased, adherence to the exercise, injection, and frequency components of the regimen decreased.