Effects of workshop trainings on evidence-based practice knowledge and attitudes among youth community mental health providers

Enhancing the public health impact of evidence-based practices (EBPs) in usual care settings is a key priority of the National Institute of Mental Health. Longitudinal data from community mental health providers (N = 268) participating in a series of state-sponsored workshops in modular approaches to EBPs for youth are presented. EBP workshop attendance for youth anxiety resulted in increased knowledge for EBPs for anxiety (and not other conditions) and EBP workshop attendance for youth disruptive behaviors resulted in increased knowledge for EBPs for disruptive behaviors (and not other conditions). Providers' tendencies toward incorrectly classifying non-EBP therapies as evidence-based increased over time, suggesting that providers over-generalize the EBP label as a result of attending these types of workshops. Regarding EBP attitudes, most measures of attitudes improved when providers attended a workshop. Additionally, an overly inclusive view of what constitutes an EBP at intake was related to significant decreases in openness to trying EBPs over time, whereas more positive attitudes at intake was related to achieving a more refined view of what constitutes an EBP over the course of attending trainings. Study limitations and implications for implementation of EBPs in usual care settings are discussed.     

A theory‐driven investigation of prospective applicants' intentions to submit video résumés

As a quickly growing trend among job seekers, video résumés represent an area where practice has outpaced research. This study investigated whether the theory of planned behavior (TpB) can be used to understand future job seekers (n = 154) video résumé submission intentions and behaviors. Results supported the TpB model. Attitudes, subjective norms, and perceived behavioral control predicted intentions, which in turn predicted video résumé creation behaviors. Compared with perceived behavioral control, attitudes and subjective norms were more important predictors. As one of the first empirical studies on video résumés, this research breaks important new ground. It also extends what is known about the TpB because it is the first study to use a relative importance analysis to statistically compare the influence of the theory's antecedent constructs.     

The Moderating Effects of Attitudes on Nurses' Intentions to Report Impaired Practice

Nurses compose the largest segment of employees in the U.S. health care industry. Nurses whose professional functioning is impaired because of substance abuse represent a threat to the health and safety of patients, other health care staff, and themselves. Attitudes toward substance use have been studied in relation to nurses' intentions (decisions) to report impaired colleagues. Whether, and to what extent, these attitudes may interact with the characteristics of the "offense" to influence intentions to report impaired practice is unknown. In this article we analyze intentions to report a variety of impaired nursing practice scenarios, obtained using a policy-capturing method, to determine the extent to which attitudes held by the "reporter" influence intentions by moderating the effects of the offense characteristics. Intention data from a sample of 120 nurses were modeled using hierarchical techniques to test the moderating hypothesis. Evidence for the moderating effects of attitudes is discussed.     

Attitudes Toward Adoption of Evidence-Based Practices: A comparison of Autism Early Intervention Providers and Children's Mental Health Providers

Across the country, states are reporting increases in the number of children with autistic spectrum disorders (ASD) served each year in the early intervention system. Research examining factors impacting the successful dissemination and implementation of evidence-based practice (EBPs) into service systems for these children is limited. Preliminary information indicates that adoption of EBPs is variable. Provider attitudes toward the adoption of EBPs may be one factor that limits or facilitates implementation of efficacious treatments and these attitudes vary by organizational context and provider individual differences. The current study examines cross-context differences in provider attitudes toward EBPs by comparing the attitudes of 71 education-based early intervention providers working with children with ASD to the attitudes of 238 mental health providers in the public mental health system. This provides the first examination of ASD early intervention provider attitudes toward EBP. Results indicated that early intervention providers reported significantly more favorable attitudes toward adopting EBPs than did mental health providers. Early intervention providers with extended experience in the field perceived less divergence between their current practice and EBPs. Implications are discussed.     

Updating the Textbook: A Novel Approach to Training Graduate Students in Evidence-Based Youth Practices

Despite the ever-improving base of evidence-based practices (EBPs) for the treatment of childhood disorders, a gap between EBP research and their use in community settings continues to exist. An exciting opportunity to close this gap exists in the form of graduate student training; however, at present, several roadblocks exist. In this paper, we review the current state of graduate training in delivering EBPs and obstacles involved in training future community clinicians (i.e., graduate students) in EBPs. Next, we describe in detail our initiative to develop a curriculum that addresses these challenges. This innovative course empowered graduate students to receive training in the delivery of youth EBPs in community settings through reviews of the research literature, active learning techniques (e.g., discussions of case conceptualizations, role-playing case studies), and a written, publication-quality review of EBPs. Finally, we offer recommendations for other educators of mental health professionals (e.g., psychologists, social workers, counselors) to improve upon this curriculum in their training of graduate students in the theory and application of EBPs for treating childhood disorders.     

Development and evaluation of the evidence‐based practice classroom observation measure (EBP‐COM)

Due to the increased emphasis on evidence‐based practices (EBPs) in recent education initiatives, classroom observers need an objective way to measure teacher use of EBPs. Although some measures for this purpose exist, these measures are limited by their reliance on self‐report. Therefore, we created a direct observation tool titled the Evidence‐Based Practice Classroom Observation Measure (EBP‐COM) for observers to assess the use of EBPs by teachers of students with autism spectrum disorder (ASD). We evaluated reliability and validity of the EBP‐COM, as well as whether the assessment tool could detect change in teacher behavior. A measurement refinement process involving six raters collecting 65 data points revealed the EPB‐COM to have sound psychometric properties. With this tool, researchers can conduct comprehensive and objective assessments of teacher EBP use.     

Negative Beliefs as a Moderator of the Intention–Behavior Relationship: Decisions to Use Performance-Enhancing Substances

The theory of reasoned action framework was used to examine performance-enhancing substance use among a sample of college athletes in a prospective longitudinal design. Results indicate that attitudes and subjective norms predicted intention to use the substances, and these intentions predicted actual substance use 6 weeks later. A statistically significant interaction emerged between negative beliefs and intentions predicting behavior such that as negative beliefs grew increasingly negative, the intention–behavior relationship became stronger. Practical and theoretical implications of the influence of negative information on the intention–behavior relationship are discussed.     

Impact Challenges in Community Science-with-Practice: Lessons from PROSPER on Transformative Practitioner-Scientist Partnerships and Prevention Infrastructure Development

At present, evidence-based programs (EBPs) to reduce youth violence are failing to translate into widespread community practice, despite their potential for impact on this pervasive public health problem. In this paper we address two types of challenges in the achievement of such impact, drawing upon lessons from the implementation of a partnership model called PROSPER. First, we address five key challenges in the achievement of community-level impact through effective community planning and action: readiness and mobilization of community teams; maintaining EBP implementation quality; sustaining community teams and EBPs; demonstrating community-level impact; and continuous, proactive technical assistance. Second, we consider grand challenges in the large-scale translation of EBPs: (1) building, linking and expanding existing infrastructures to support effective EBP delivery systems, and (2) organizing networks of practitioner-scientist partnerships-networks designed to integrate diffusion of EBPs with research that examines effective strategies to do so. The PROSPER partnership model is an evidence-based delivery system for community-based prevention and has evolved through two decades of NIH-funded research, assisted by land grant universities' Cooperative Extension Systems. Findings and lessons of relevance to each of the challenges are summarized. In this context, we outline how practitioner-scientist partnerships can serve to transform EBP delivery systems, particularly in conjunction with supportive federal policy.     

Relationships between self-determination theory and theory of planned behavior applied to physical activity and exercise behavior in chronic pain

This study examined the relationships between self-determination theory (SDT) and theory of planned behavior (TpB) applied to physical activity and exercise behavior (PA&E) in people with chronic pain. Two hundred and eleven adults with chronic musculoskeletal pain (28 males and 183 females, age range 18 to 82 years, mean age 43 years) were recruited from online support groups and clinic networks in the United States. Participants completed SDT measures relevant to PA&E on perceived autonomy support, autonomy, competence, and relatedness, as well as TpB measures relevant to PA&E on intention, attitudes, subjective norms, and perceived behavioral control. Correlational techniques and canonical correlation analysis were performed to examine the relationships and variance within and between theoretical dimensions. Overall, the SDT set accounted for 37% of the TpB variance and the TpB set accounted for 32% of the SDT set variance. The results indicate there are statistical similarities and differences between concepts in SDT and TpB models for PA&E. Using both empirical guidance and clinical expertise, researchers and practitioners should attempt to select and integrate non-redundant and complementary components from SDT, TpB, and other related health behavior theories.     

Initiation of evidence-based psychotherapies in Veterans with posttraumatic stress disorder

The Department of Veterans Affairs (VA) requires that all VA hospitals and clinics provide access to evidence-based psychotherapies (EBPs). Despite these widespread dissemination efforts, only a minority of Veterans receive EBP services. Reasons for these low rates of EBP utilization are largely unknown. This study examined the characteristics of Veterans with posttraumatic stress disorder (PTSD) who did (Initiation group) and did not (No-Initiation group) initiate a VA-approved EBP after participating in an information session. Veterans chose their preferred treatment from a menu of EBPs. Results demonstrated that Veterans in the No-Initiation group had longer periods of time between their referral and first EBP visit. Among Veterans in the Initiation group, the majority (68%) initiated a trauma-focused EBP as their first or second treatment, suggesting that providing a range of treatment options did not negatively impact their willingness to engage in PTSD treatment. Results are discussed in terms of VA initiatives to improve access to and initiation of mental health care for Veterans.     

Evidence-based practice implementation and staff emotional exhaustion in children's services

Understanding the implementation of evidence-based practice (EBP) in community service settings is critical for the successful translation of research to practice. However, we have limited research evidence about the impact of EBP implementation on the mental health and social service workforce. In a previous study we demonstrated reduced staff turnover where an EBP was implemented with fidelity monitoring in the form of supportive ongoing supervision and consultation. Other research has shown that staff burnout and emotional exhaustion in particular is associated with poor quality of care and increased staff turnover intentions and turnover. Current research, however, has focused less on the effects that EBP implementation may have on staff emotional exhaustion. The present study investigates the association of EBP implementation and fidelity monitoring with staff emotional exhaustion in a statewide EBP implementation study. The 21 case-management teams in this study were randomized in a 2 (EBP vs. services as usual [SAU]) by 2 (monitoring vs. no monitoring) design. The EBP in this study was SafeCare^®, a home-based intervention that aims to reduce child neglect in at-risk families. SafeCare was developed from a behavior analysis approach and is based in cognitive behavioral principles. In keeping with our previous research, we hypothesized that providers implementing SafeCare with monitoring would have the lowest levels of emotional exhaustion and those receiving additional monitoring not in the context of EBP implementation would have higher emotional exhaustion relative to the other groups. Results supported our hypotheses in that we found lower emotional exhaustion for staff implementing the EBP but higher emotional exhaustion for staff receiving only fidelity monitoring and providing SAU. Together, these results suggest a potential staff and organizational benefit to EBP implementation and we discuss implications of the findings relative to EBPs and to fidelity monitoring.     

Parental and family risk factors for substance use in inner-city African-American children and adolescents

The purpose of this study was to develop and test a multidimensional model of parental and family influences on risk for substance use in inner-city African-American primary grade children and their adolescent siblings. The risk factors investigated were conceptually grouped into three broad domains of family influences and the respective indices computed: parental risk attributes, family risk attributes, and parenting styles. Parenting styles were captured as indicators of a latent construct, poor parenting. In study 1, we hypothesized that the parental and family risk variables would be mediated through parenting styles to predict intentions to use drugs, actual drug use, positive drug attitudes, and negative drug attitudes in a sample of 455 inner-city African-American families and their primary-grade children. In study 2, the substance use risk model was tested on a sample of 59 adolescent sibilings to determine whether the pattern of parental and family factors that contributed to early high-risk attitudes and behaviors in children would predict drug attitudes and behaviors in teen siblings. The results confirmed our expectations that parental and family risks were important predictors of childrens' negative drug attitudes and intentions to use drugs in the future and that positive parental and family characteristics would protect against future risk by enhancing negative drug attitudes. Also, substance use attitudes and behaviors in the teen siblings were predicted primarily by family risk characteristics. The family risk index also predicted frequency of use of hard drugs, but only when mediated through poor parenting. The implications of these results for future research are discussed.     

Relating a Social Influence Model to the Role of Acculturation in Substance Use Among Latino Adolescents1

This study examined determinants of substance use derived from the theory of planned behavior as influenced by acculturation. Latino adolescents (n= 448) completed measures of attitudes, subjective norms, perceived behavioral control, intentions toward substance use, and 2 acculturation components. The degree to which Latino adolescents were exposed to as well as use Spanish was unrelated to determinants of future substance use, whereas the degree to which they interact with non-Latino peers exerted a protective effect regarding future substance use. However, both acculturation components influenced the extent social influence determinants predicted future substance use. Intervention strategies may need to consider acculturation in order to effectively direct resources toward those psychosocial determinants of substance use of greatest relevance to Latino populations.     

Testing a Theory of Implementation Leadership and Climate Across Autism Evidence-Based Interventions of Varying Complexity

Prominent theories within the field of implementation science contend that organizational leaders can improve providers’ fidelity to evidence-based practices (EBPs) by using focused implementation leadership behaviors that create an organizational climate for EBP implementation. However, this work has been criticized for overreliance on nonspecific, self-report fidelity measures and poor articulation of the boundary conditions that may attenuate leadership and climate’s influence. This study tests the predictions of EBP implementation leadership and climate theory on observed fidelity to three school-based EBPs for autism that vary in complexity: pivotal response training (PRT), discrete trial training (DTT), and visual schedules (VS). Educators in kindergarten to third-grade autism support classrooms in 65 schools assessed their principals’ EBP implementation leadership and school EBP implementation climate prior to the school year. Mid-school year, trained observers rated educator fidelity to all three interventions. Expert raters confirmed PRT was significantly more complex than DTT or VS using the Intervention Complexity Assessment Tool for Systematic Reviews. Linear regression analyses at the school level indicated principals’ increased frequency of EBP implementation leadership predicted a higher school EBP implementation climate, which in turn predicted higher educator fidelity to PRT—however, there was no evidence of a relationship between implementation climate and fidelity to DTT or VS. Comparing principals whose EBP implementation leadership was ±1 SD from the mean, there was a significant indirect association of EBP implementation leadership with PRT fidelity through EBP implementation climate (d = 0.49, 95% CI [0.04, 0.93]). Strategies that target EBP implementation leadership and climate may support fidelity to complex behavioral interventions.     

Condom use among high-risk adolescents: testing the influence of alcohol use on the relationship of cognitive correlates of behavior.

The goal of this study was the exploration of distal effects of alcohol use on condom use. Criminally involved adolescents completed an initial measure of attitudes, beliefs, and prior behavior. Of the 300 who completed the initial measurement, 267 (89%) completed a behavioral assessment 6 months later. Analyses validated a theoretical model of condom use intentions and indicated that intentions and attitudes measured at baseline were significant predictors of condom use behavior 6 months later. Neither alcohol use nor alcohol problems moderated relationships among model variables or the influence of intentions and attitudes on behavior. The findings do not support a distal role for alcohol use in altering the cognitive correlates of condom use intentions and behavior among high-risk adolescents.     

A sociocultural stress, appraisal, and coping model of subjective burden and family attitudes toward patients with schizophrenia

A sociocultural stress, appraisal, and coping model was developed to understand relatives' burden of care and negative affective attitudes toward patients with schizophrenia. Ninety-two African American and 79 White patients and a significant other (80% mothers) completed 2 10-min family problem-solving discussions. In addition, the Kreisman Rejection Scale and a global self-report rating of family burden were administered to relatives, and a self-report rating of substance use was administered to patients. Results indicated that subjective burden of care and patients' odd and unusual thinking during the family discussion each independently predicted relatives' attitudes toward patients, suggesting that negative attitudes are based in part on both patients' symptoms and perceived burden of care. African American relatives' perceived burden was also predicted by patients' substance abuse. Finally, White family members were significantly more likely than African Americans to feel burdened by and have rejecting attitudes toward their schizophrenic relative suggesting that cultural factors play an important role in determining both perceived burden and relatives' attitudes toward patients.     

Impact of substance abuse and child maltreatment training on service utilization in a rural setting

Substance abuse and child maltreatment have been recognized as co-morbid problems encountered in families presenting in the child protective services (CPS) system. Nonetheless, utilization rates of substance abuse treatment services have generally lagged well behind what the research would suggest are prevalence rates for substance abuse disorders in this population, suggesting problems in recognition and referral practices among CPS workers. In response to this, 25 training programs were funded by the National Center on Child Abuse and Neglect. This study reports data from one program. Trainees indicated a high level of satisfaction and demonstrated significant knowledge gains. More importantly, utilization of substance abuse services increased significantly across time in a multi-county region receiving training relative to a comparison region receiving none. The gain was limited, suggesting that while increased knowledge may translate into increased service utilization, additional barriers to accessing needed services must also be addressed.     

Predicting Intentions of Romantic Partner Abuse with the Theory of Planned Behavior

From the theory of planned behavior, attitudes, subjective norms, and perceived behavioral control were identified as predictors of intentions for verbal, physical, and sexual abuse toward romantic partners. Relationships among the three predictors across the three types of abuse were examined with responses from undergraduates involved in romantic relationships. The theory of planned behavior accounted for substantial variance associated with intentions to abuse romantic partners. Moreover, the components of the theory of planned behavior were differentially predictive of the three forms of abuse, which also varied by sex. A recommendation is that interventions should target different components of the theory of planned behavior depending on the type of abuse they are attempting to prevent.