An exploratory investigation of teachers' intervention planning and perceived implementation barriers

Increasingly teachers are the primary implementer responsible for providing evidence-based interventions to students. However, there is little knowledge regarding the extent to which teachers plan for intervention implementation, receive implementation support, or identify and address implementation barriers. This study explores survey data from over 1200 preschool through grade 12 teachers from 46 public school districts in a Northeastern state. Results indicate that teachers spend significant time engaging in intervention-related behavior and may be a primary source responsible for selecting student interventions. However, the current extent to which they plan for implementation and present levels of implementation support are inadequate to produce high levels of sustained intervention implementation. In addition, almost 60% of implementation barriers reported related to aspects of the intervention itself. Findings from this study provide guidance for future research and preliminary recommendations for ameliorating implementation barriers and proactively supporting treatment integrity in schools.     

Breaks are Better: A Tier II Social Behavior Intervention

Multi-tiered systems of social behavioral support in schools provide varying levels of intervention matched to student need. Tier I (primary or universal) systems are for all students and are designed to promote pro-social behavior. Tier III (tertiary or intensive) supports are for students who engage in serious challenging behavior that has not responded to other efforts. In between Tier I and Tier III are Tier II (secondary or targeted interventions), for students at risk for developing more serious problematic behavior. The purpose of this study was to evaluate Breaks are Better, a Tier II intervention designed for students who engage in problem behavior maintained by avoidance of instructional activities. Breaks are Better builds on an evidence-based Tier II intervention, Check-in/Check-out, but includes key components to enhance its effectiveness for students who avoid instruction. Working with three typically developing elementary school students, we documented changes in problem behavior during academic instruction following the implementation of Breaks are Better. Further, students and teachers rated the intervention as both feasible and valuable.     

Ethical and legal issues associated with using response-to-intervention to assess learning disabilities

The Individuals with Disabilities Education Improvement Act of 2004 allows schools to use a child's response to research-based intervention (RTI) as a part of procedures to identify students with learning disabilities. This paper considers whether RTI-based assessment models meet ethical and legal standards for acceptable assessment practices. Based on a review of available research, it was concluded that RTI-based assessment practices, when carefully crafted and implemented, have the potential to be multifaceted, fair, valid, and useful. Threats to acceptable RTI-based assessment practices include: the lack of research-based interventions appropriate for diverse academic domains, ethnic groups, grades K-12, and students with limited English proficiency; uncertainty regarding how to determine when nonresponse to intervention warrants formal referral for evaluation of special education eligibility; difficulty translating scientifically sound RTI practices to the local school level; and inadequate staff training and poor treatment fidelity. Suggested directions for future research are included.     

Implementation trial of a cognitive behavioural therapy programme for reducing student stress in the final year of secondary school

The final year of secondary school has been shown to be associated with heightened student stress. Psychological interventions have been shown to be effective in reducing and preventing distress in students during this school period, although the widespread adoption of these interventions into school settings is limited. There have been recent calls for research to examine the implementation success of evidence-based programmes when used by schools in school settings. The present study aimed to evaluate the implementation success of an evidence-based cognitive-behavioural therapy programme (Study without Stress) using the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. At one Australian high school, all tutor group teachers were trained by the school counsellor to deliver the programme in standard school classes to students in the lead up to their final year of secondary school. Students (n = 80) and teachers (n = 11) reported on programme success against the RE-AIM framework at pre-intervention, post-intervention, and three-month follow-up. The findings indicated that SWOS was implemented successfully by the school. SWOS was associated with maintaining student stress levels at normal levels over time, as well as reducing the severity of stress for initially highly distressed students. The findings provide evidence from implementation science that SWOS can be adapted and delivered effectively by school staff to manage stress in final year secondary school students.     

Testing a Theory of Implementation Leadership and Climate Across Autism Evidence-Based Interventions of Varying Complexity

Prominent theories within the field of implementation science contend that organizational leaders can improve providers’ fidelity to evidence-based practices (EBPs) by using focused implementation leadership behaviors that create an organizational climate for EBP implementation. However, this work has been criticized for overreliance on nonspecific, self-report fidelity measures and poor articulation of the boundary conditions that may attenuate leadership and climate’s influence. This study tests the predictions of EBP implementation leadership and climate theory on observed fidelity to three school-based EBPs for autism that vary in complexity: pivotal response training (PRT), discrete trial training (DTT), and visual schedules (VS). Educators in kindergarten to third-grade autism support classrooms in 65 schools assessed their principals’ EBP implementation leadership and school EBP implementation climate prior to the school year. Mid-school year, trained observers rated educator fidelity to all three interventions. Expert raters confirmed PRT was significantly more complex than DTT or VS using the Intervention Complexity Assessment Tool for Systematic Reviews. Linear regression analyses at the school level indicated principals’ increased frequency of EBP implementation leadership predicted a higher school EBP implementation climate, which in turn predicted higher educator fidelity to PRT—however, there was no evidence of a relationship between implementation climate and fidelity to DTT or VS. Comparing principals whose EBP implementation leadership was ±1 SD from the mean, there was a significant indirect association of EBP implementation leadership with PRT fidelity through EBP implementation climate (d = 0.49, 95% CI [0.04, 0.93]). Strategies that target EBP implementation leadership and climate may support fidelity to complex behavioral interventions.     

Using the Performance Diagnostic Checklist to evaluate and promote paraeducators' treatment fidelity

Paraeducators, who increasingly serve as implementers for students in special education, can struggle with intervention fidelity. Special educators, often responsible for providing paraeducators with support, receive limited supervision training. From organizational behavior management, the Performance Diagnostic Checklist-Human Services (PDC-HS) is a checklist to detect reasons for poor workplace performance and identify aligned support. Utilizing a multiple baseline design, this study evaluated the impact of PDC-HS indicated implementation support on the intervention fidelity of five paraeducators implementing six behavior intervention plans for students receiving special education services. The PDC-HS indicated that all paraeducators would benefit from behavior skills training and visuals of the plans, in addition to other specific supports for individual paraeducators (e.g., prompts, feedback). These implementation supports were effective in improving intervention fidelity for four paraeducators, whereas one paraeducator (across two students) did not respond to these supports. Changes in student outcomes (i.e., academic engagement, disruptive behavior) were inconsistent, suggesting that the behavior intervention plans may have needed to be revised. Usability data suggested that the PDC-HS and indicated supports were generally acceptable, but revisions may be warranted. The implications of this study for school-based implementation support research are discussed.     

Evaluation of Interactive Computerized Training to Teach Paraprofessionals to Implement Errorless Discrete Trial Instruction

Efficient and effective training strategies for paraprofessionals in special education settings face many challenges. Interactive computerized training (ICT)—a self-paced program that incorporates audio narration, video models, interactive activities, and competency checks—is one potential solution. ICT has been successful in training college students and special education teachers to implement discrete trial instruction (DTI), but its effectiveness to train paraprofessionals is unknown. Using a multiple-baseline design, we evaluated the feasibility of ICT, to train six paraprofessionals to implement DTI with an errorless learning procedure. Following ICT, the fidelity of implementation of DTI increased for all participants when implemented with a student in their classroom; however, competency varied. We added additional training components that progressed from low to more intensive feedback delivered remotely in attempt to increase fidelity to 90% or higher implementation. We also evaluated generalization to novel instructional programs and maintenance of instruction in the absence of feedback.     

Do organizational conditions influence teacher implementation of effective classroom management practices: Findings from a randomized trial

Although there is a growing evidence base about effective classroom management practices, teacher implementation of these practices varies due to a number of factors. A school's organizational health is one aspect of the broader social environment that has been hypothesized to influence implementation of interventions. Yet, empirical evidence is limited on whether organizational contexts can influence teacher implementation of effective interventions and subsequently, classroom environments and student outcomes. In the present study, teachers in an urban school district were randomly assigned to receive training in the Incredible Years Teacher Classroom Management program (IY TCM), a classroom management intervention. We examined how teacher perceptions of their school environment moderated intervention effects for previously established treatment outcomes – implementation of effective classroom methods, students' social behaviors, emotional regulation, and social competence. Results showed that treatment effects on teacher implementation and student outcomes were moderated by teachers' sense of affiliation to their school. Specifically, main effects on implementation of effective classroom management strategies were only observed among teachers whose perceptions of initial teacher affiliation was low or average; whereas main effects on student outcomes were only found for teachers with initial high levels of affiliation.     

Interventions for Children With Autism Spectrum Disorders in Inclusive School Settings

Students with ASD present unique challenges to school systems. Despite these challenges, federal laws require that schools implement research-based practices in the least restrictive environment (LRE). The LRE is often deemed to be the general education classroom and the primary intervention agent is often the classroom teacher. Ensuring students with ASD receive effective intervention in these least restrictive and inclusive school settings will depend, in part, on the extent to which teachers and school personnel are prepared to implement research-based interventions. The purpose of this article is to provide a summary of research-based interventions for students with ASD. Our focus in this summary is on interventions that can be implemented in inclusive school settings by teachers and classroom support personnel. We first provide a general overview of interventions designed to reduce challenging behavior, teach communication skills, and improve social relationships. This is followed by a discussion of the obstacles to intervention implementation that may be present in school settings. Finally, we conclude by offering a list of intervention guidelines.     

The Effectiveness of Cultural Adjustment and Trauma Services (CATS): Generating Practice-Based Evidence on a Comprehensive, School-Based Mental Health Intervention for Immigrant Youth

A collaborative study of Cultural Adjustment and Trauma Services (CATS), a comprehensive, school-based mental health program for traumatized immigrant children and adolescents, was conducted to generate practice-based evidence on the service delivery model across two school districts. Program effectiveness was assessed by testing whether client functioning and PTSD symptoms improved as a result of 7 separate service elements. An array of clinical services including CBT, supportive therapy, and coordinating services were provided to all students, and an evidence-based intervention for trauma, TF-CBT, was implemented with a subset of students. Greater quantities of CBT and supportive therapy increased functioning, while greater quantities of coordinating services decreased symptoms of PTSD. TF-CBT services were associated with both improved functioning and PTSD symptoms, although TF-CBT was implemented with fidelity to the overall comprehensive service model rather than the structured intervention model. Results suggest the comprehensive school-based model was effective, though different service components affected different student outcomes. Implications of these findings for immigrant mental health interventions and implementing structured evidence-based practices into community mental health programs are discussed. Suggestions are made for future research on existing mental health practices with immigrants.     

Supporting teacher use of interventions: effects of response dependent performance feedback on teacher implementation of a math intervention

This study examined general education teachers’ implementation of a peer tutoring intervention for five elementary students referred for consultation and intervention due to academic concerns. Treatment integrity was assessed via permanent products produced by the intervention. Following verbal instructions, intervention implementation by four teachers was consistently low or exhibited a downward trend whereas one teacher’s moderate implementation co-occurred with student gains. When classroom training was conducted with four teachers exhibiting low integrity, all teachers improved implementation. After accurately implementing the intervention for three training sessions with classroom training, response dependent performance feedback was provided when teachers independently used the intervention below 100% integrity, as determined by review of permanent products. With response dependent performance feedback, three of the four teachers implemented the intervention at levels above the verbal training performance, whereas implementation for one teacher increased following discussion of an upcoming school team meeting. Student math scores improved during intervention.     

Preventing Classroom Discipline Problems

This paper focuses on the effective schools and schooling literature as a basis for promoting student success and preventing classroom misbehavior and discipline problems. By facilitating such success, it is suggested that many discipline problems can be avoided and that school staffs will be able to focus even more of their attention to quality, effective education and instruction. System-wide, school building, classroom, teacher, and student-specific practices are all discussed as they relate to effective schools and schooling and to the prevention of student discipline problems. The conclusion notes that successful prevention programs save time, money, and effort, but that they must be systematically planned to meet the needs of the students, school district, and community alike.     

Issues and Strategies for Studying Latino Student Dropout at the Local Level

Latino student dropout is a national concern that must also be addressed strategically in local communities. Although national studies are important for pointing out areas of concern, local studies can provide more specific information for local policy development and implementation. This paper presents an example of local community-initiated needs assessment that addresses issues of Latino access to education. Focus groups and interviews were held with Latino students, parents, and community leaders as well as teachers and administrators. Issues and strategies of the needs assessment process are presented, which include involving key stakeholders, engaging community members as research partners, and engaging school personnel. General findings are presented and linked to accomplishments of the needs assessment process, such as increasing community awareness of issues and building commitment to implement strategies identified to reduce Latino student dropout.     

An investigation of high school social studies teachers' understandings of vocabulary teaching and learning

This qualitative study focused on high school social studies teachers' understandings of and perspectives about vocabulary acquisition and instruction. The research questions were the following: (1) What do high school social studies teachers understand about vocabulary instruction? and (2) How do high school social studies teachers support vocabulary learning? Face-to-face interviews were conducted with 25 high school social studies teachers. Findings indicate that external factors shaped instructional decision-making for teaching vocabulary, teachers' belief systems guided instructional choices, and the diverse needs of students called for differentiated instruction not only for English language learners but also for all students given the unique nature of the language of social studies.     

Expectations and high school change: Teacher-researcher collaboration to prevent school failure

Describes the multilevel outcomes of a collaborative preventive intervention for ninth-graders at risk for school failure using qualitative and quasi-experimental methods. Teachers, administrators, and researchers implemented innovative practices communicating positive expectations for low-achieving adolescents in their transition to high school. Changes were made in the practices of curriculum, grouping, evaluation, motivation, student responsibility, and relationships (in the classroom, with parents, and in the school). Both implementation and evaluation evolved as a function of collaboration. Change was promising but not uniform. Project teachers became more positive about students and colleagues, expanded their roles, and changed school tracking policies. The 158 project students, in contrast to the 154 comparison students showed improved grades and disciplinary referrals post-intervention and increased retention in school 1 year later, but their absences rose and improved performance was not maintained. The implications of this analysis for school-based interventions and its evaluation are discussed.     

Evaluation of a Trauma-Informed School Intervention with Girls in a Residential Facility School: Student Perceptions of School Environment

In response to the high nationwide prevalence of psychological trauma among court-involved youth who have been exposed to abuse and neglect and the associated far-reaching adverse consequences, there are calls to develop a trauma-informed workforce across the various systems (child welfare, juvenile justice, mental health, and education) designed to serve this population. We describe a pilot test of a modified version of the Heart of Teaching and Learning (HTL) curriculum, an intervention designed to increase trauma-informed practices in education settings. This program was implemented in a public charter school that exclusively serves court-involved youth placed in residential treatment. The intervention was associated with decreases in trauma symptoms experienced by youth. Because student perceptions of teachers were high both before and after implementation of the curriculum, no statistically significant changes were observed. The article concludes with a discussion of the ways in which the curriculum can be used to help prepare a national education workforce capable of implementing trauma-informed evidence-based practices in school settings.     

Classwide Teacher Implementation of Self-Regulated Strategy Development for Writing with Students with E/BD in a Residential Facility

One promising intervention to support the writing skills of students with and at risk for emotional and behavioral disorders is self-regulated strategy development (SRSD). The purpose of this study was to extend this line of inquiry to a residential setting with teachers serving as interventionists and determine the effects of the SRSD using the STOP and DARE mnemonic for persuasive writing on the writing performance (Correct Word Sequences, Essay Elements, and Essay Quality), and academic engagement of secondary students. In addition, this study extended this line of inquiry by looking at implementation of the intervention only 2 days per week, a lower treatment intensity than previous research has used to find statistically significant gains in writing. Results of a piecewise hierarchical linear model suggest statistically significant gains were made over the course of the intervention in writing and academic engagement when compared to baseline. In addition, student variables such as writing achievement, externalizing/internalizing behavior patterns, age, and attendance predicted writing and engagement. Results of generalization, fidelity, and social validity also are reported.     

The role of the school psychologist in the inclusive education of school-age children with autism spectrum disorders

Two independent trends are impacting school psychologists with regard to their involvement in the education of students with autism spectrum disorders (ASDs): increasing prevalence estimates of ASDs and an emphasis on the inclusion of students with special needs in regular education classrooms. In light of these trends and growing awareness of the need for evidence-based practices in the field, school psychologists can expect to be involved in the educational programming of students with ASDs and should be knowledgeable about empirically supported strategies relevant to inclusive education of these children. The purpose of this review is to familiarize school psychologists with currently available intervention techniques by describing each strategy and outlining the degree of empirical support for each. Strategies for managing disruptive behaviors, promoting learning, and facilitating social integration are reviewed.     

Training preservice general education teachers in response to intervention: A survey of teacher educators throughout the United States

Response to intervention (RTI) is an evidence-based approach to educational service delivery that is being increasingly adopted by schools across the country. To effectively implement RTI models, teachers require specialized training. Little is currently known, however, about the extent to which this training is being provided at the preservice level. The purpose of this survey study was to learn more about RTI-related training provided to preservice general educators in undergraduate elementary education programs. Respondents included 95 program directors of accredited college/university teacher education programs across the United States. Participants reported providing varying levels of didactic and applied training related to each of the six core components of RTI (i.e., multitiered service delivery, universal screening, progress monitoring, data-based decision making, evidence-based interventions, and fidelity of implementation). Although most teacher educators were familiar with the overall concept of RTI, over a third of respondents were not familiar with the core component of fidelity of implementation, and reported providing limited training opportunities in this area. Respondents also indicated whether preservice teachers in their programs receive training related to specific progress monitoring tools and evidence-based interventions. Implications for school psychologists, who frequently collaborate with teachers to implement RTI models, are discussed.