Promoting Science-based Approaches to Teen Pregnancy Prevention: Proactively Engaging the Three Systems of the Interactive Systems Framework

In the field of teen pregnancy prevention many efficacious prevention programs are available but adoption of these programs is slow at the community level. In this article, we present a multi-site, capacity-building effort called the Promoting Science-based Approaches to Teen Pregnancy Prevention project (PSBA) as a case example of a proactive application of the Interactive System Framework (ISF) for dissemination and implementation. The ISF is a multi-system model leading to dissemination and implementation of science-based prevention programming through the work of three interactive systems: The "Prevention Delivery," "Prevention Support," and "Prevention Synthesis & Translation" Systems. This article describes the proactive use of the ISF to conceptualize and bolster the PSBA program's goal of assisting local prevention partners in the use of science-based approaches (SBA) to prevent teen pregnancy. PSBA uses all three systems of the ISF to facilitate practice improvements and offers valuable research opportunities to investigate factors related to dissemination and implementation processes across these systems. Describing our application of this framework highlights the feasibility of actively using the ISF to build prevention infrastructure and to guide large-scale prevention promotion strategies in the area of teen pregnancy prevention. The program's ongoing evaluation is presented as an example of early efforts to develop an evidence base around the ISF. Research implications are discussed.     

Establishing and Evaluating the Key Functions of an Interactive Systems Framework Using an Assets-Getting to Outcomes Intervention

Community practitioners can face difficulty in achieving outcomes demonstrated by prevention science. Building a community practitioner's prevention capacity—the knowledge and skills needed to conduct critical prevention practices—could improve the quality of prevention and its outcomes. The purpose of this article is to: (1) describe how an intervention called Assets‐Getting To Outcomes (AGTO) was used to establish the key functions of the ISF and present early lessons learned from that intervention's first 6 months and (2) examine whether there is an empirical relationship between practitioner capacity at the individual level and the performance of prevention at the program level—a relationship predicted by the ISF but untested. The article describes an operationalization of the ISF in the context of a five‐year randomized controlled efficacy trial that combines two complementary models designed to build capacity: Getting To Outcomes (GTO) and Developmental Assets. The trial compares programs and individual practitioners from six community‐based coalitions using AGTO with programs and practitioners from six similar coalitions that are not. In this article, we primarily focus on what the ISF calls innovation specific capacity and discuss how the combined AGTO innovation structures and uses feedback about its capacity‐building activities, which can serve as a model for implementing the ISF. Focus group discussions used to gather lessons learned from the first 6 months of the AGTO intervention suggest that while the ISF may have been conceptualized as three distinct systems, in practice they are less distinct. Findings from the baseline wave of data collection of individual capacity and program performance suggest that practitioner capacity predicts, in part, performance of prevention programs. Empirically linking practitioner capacity and performance of prevention provides empirical support for both the ISF and AGTO. Special Issue: Advances in Bridging Research and Practice Using the Interactive System Framework for Dissemination and Implementation; Guest Editors: Abraham Wandersman, Paul Flaspohler, Catherine A. Lesesne, Richard Puddy; Action Editor: Emilie Phillips Smith     

Using a Training-of-Trainers Approach and Proactive Technical Assistance to Bring Evidence Based Programs to Scale: An Operationalization of the Interactive Systems Framework’s Support System

Bringing evidence based programs to scale was a major initial impetus for the development of the Interactive Systems Framework for Dissemination and Implementation (ISF). The ISF demonstrates the importance of the Support System in facilitating the uptake of innovations in the community (the Delivery System). Two strategies that members of the Support System commonly use are training‐of‐trainers (TOT) models and technical assistance (TA). In this article, we focus on the role of the Support System in bringing evidence‐based programs (EBPs) to scale in the Delivery System using a case example, with special attention on two strategies employed by Support Systems—training‐of‐trainers (TOT) and proactive technical assistance. We then report on findings from a case example from the Promoting Science Based Approaches to Teen Pregnancy Prevention project that furthers our conceptualization of these strategies and the evidence base for them. We also report on the limitations in the literature regarding research on TOTs and proactive TA and provide suggestions for future research on TOTs and proactive TA that will enhance the science and practice of support in the ISF. Special Issue: Advances in Bridging Research and Practice Using the Interactive System Framework for Dissemination and Implementation; Guest Editors: Abraham Wandersman, Paul Flaspohler, Catherine A. Lesesne, Richard Puddy; Action Editor: Emilie Phillips Smith     

The Getting To Outcomes Demonstration and Evaluation: An Illustration of the Prevention Support System

Communities are increasingly being required by state and federal funders to achieve outcomes and be accountable, yet are often not provided the guidance or the tools needed to successfully meet this challenge. To improve the likelihood of achieving positive outcomes, the Getting To Outcomes (GTO) intervention (manual, training, technical assistance) is designed to provide the necessary guidance and tools, tailored to community needs, in order to build individual capacity and program performance. GTO is an example of a Prevention Support System intervention, which as conceptualized by the Interactive Systems Framework, plays a key role in bridging the gap between prevention science (Prevention Synthesis and Translation System) and prevention practice (Prevention Delivery System). We evaluated the impact of GTO on individual capacity and program performance using survey- and interview-based methods. We tracked the implementation of GTO and gathered user feedback about its utility and acceptability. The evaluation of GTO suggests that it can build individual capacity and program performance and as such demonstrates that the Prevention Support System can successfully fulfill its intended role. Lessons learned from the implementation of GTO relevant to illuminating the framework are discussed.     

New Directions in Capacity Building: Incorporating Cultural Competence into the Interactive Systems Framework

The UMBC Psychology Department's Center for Community Collaboration (CCC) provides training and support for capacity building to promote substance abuse and mental health treatment as well as adherence improvement in community agencies funded through the Ryan White Act serving persons living with HIV/AIDS. This article describes an approach to dissemination of Evidence Based Practices (EBPs) for these services that uses the Interactive Systems Framework (ISF) and incorporates a collaborative process involving trainer cultural competence, along with a comprehensive assessment of organizational needs, culture, and climate that culminates in tailored training and ongoing collaboration. This article provides: (1) an overview of the CCC's expanded ISF for the effective dissemination of two EBPs—motivational interviewing and the stages of change perspective; (2) an examination of the role of trainer cultural competence within the ISF framework, particularly attending to organizational culture and climate; and (3) case examples to demonstrate this approach for both general and innovation‐specific capacity building in two community based organizations. Special Issue: Advances in Bridging Research and Practice Using the Interactive System Framework for Dissemination and Implementation; Guest Editors: Abraham Wandersman, Paul Flaspohler, Catherine A. Lesesne, Richard Puddy; Action Editor: Emilie Phillips Smith     

Developing a Prevention Synthesis and Translation System to Promote Science‐Based Approaches to Teen Pregnancy,HIV and STI Prevention

The Interactive Systems Framework for Dissemination and Implementation (ISF) is a multi‐system framework that can guide research‐to‐practice efforts by building and supporting the work of three interacting systems: the Prevention Delivery, Support, and Synthesis and Translation Systems. The Synthesis and Translation system is vital to bridging science and practice, yet how to develop it and train support system partners to use it is under‐researched. This article bridges this gap by offering a case example of the planning, development, and use of a synthesis and translation product called Promoting Science‐based Approaches to Teen Pregnancy Prevention using Getting To Outcomes. The case presented documents the process used for developing the synthesis and translation product, reports on efforts to engage the Prevention Support system to use the product, and how we approached building interaction between the Synthesis and Translation System and the Support System partners. Practice‐oriented evaluation data are also presented. Implications for practice, policy and research are discussed. Special Issue: Advances in Bridging Research and Practice Using the Interactive System Framework for Dissemination and Implementation; Guest Editors: Abraham Wandersman, Paul Flaspohler, Catherine A. Lesesne, Richard Puddy; Action Editor: Emilie Phillips Smith     

Moving Knowledge into Action: Developing the Rapid Synthesis and Translation Process Within the Interactive Systems Framework

The Interactive Systems Framework (ISF) for Dissemination and Implementation presents an overall framework for translating knowledge into action. Each of its three systems requires further clarification and explanation to truly understand how to conduct this work. This article describes the development and initial application of the Rapid Synthesis and Translation Process (RSTP) using the exchange model of knowledge transfer in the context of one of the ISF systems: the Prevention Synthesis and Translation System (see [special issue “introduction” article] for a translation of the Wandersman et al. (Am J Community Psychol 41:3–4, 2008) article using the RSTP). This six‐step process, which was developed by and for the Division of Violence Prevention at the Centers for Disease Control and Prevention in collaboration with partners, serves as an example of how a federal agency can expedite the transfer of research knowledge to practitioners to prevent violence. While the RSTP itself represents one of the possible functions in the Prevention Synthesis and Translation System, the resulting products affect both prevention support and prevention delivery as well. Examples of how practitioner and researcher feedback were incorporated into the Rapid Synthesis and Translation Process are discussed. Special Issue: Advances in Bridging Research and Practice Using the Interactive System Framework for Dissemination and Implementation; Guest Editors: Abraham Wandersman, Paul Flaspohler, Catherine A. Lesesne, Richard Puddy; Action Editor: Emilie Phillips Smith     

The Role of a State‐Level Prevention Support System in Promoting High‐Quality Implementation and Sustainability of Evidence‐Based Programs

Although numerous evidence‐based programs (EBPs) have been proven effective in research trials and are being widely promoted through federal, state, and philanthropic dollars, few have been “scaled up” in a manner likely to have a measurable impact on today's critical social problems. The Interactive Systems Framework for Dissemination and Implementation (ISF) explicates three systems that are critical in addressing the barriers that prevent these programs from having their intended public health impact. In this article we describe the relevance of these systems in a real‐world context with a specific focus on the Prevention Support System (PSS). We expand on the ISF model by presenting funders and policy‐makers as active and engaged stakeholders, and demonstrate how a state‐level PSS has used empirical evidence to inform general and program‐specific capacity‐building and support interactions among researchers, funders, and practitioners in Pennsylvania. By embracing this expanded ISF framework as a conceptual model for the wide‐scale dissemination and support of EBPs, and recognizing the need for a distinct state‐level PSS, Pennsylvania has created an infrastructure to effectively address the primary barriers to moving from lists of EBPs to achieving population‐level public health improvement. Special Issue: Advances in Bridging Research and Practice Using the Interactive System Framework for Dissemination and Implementation; Guest Editors: Abraham Wandersman, Paul Flaspohler, Catherine A. Lesesne, Richard Puddy; Action Editor: Emilie Phillips Smith     

The Interactive Systems Framework Applied to the Strategic Prevention Framework: The Rhode Island Experience

The Interactive Systems Framework for Dissemination and Implementation (ISF) was introduced as a heuristic systems level model to help bridge the gap between research and practice (Wandersman et al., in Am J Commun Psychol 41:171–181, 2008). This model describes three interacting systems with distinct functions that (1) distill knowledge to develop innovations; (2) provide supportive training and technical assistance for dissemination to; (3) a prevention delivery system responsible for implementation in the field. The Strategic Prevention Framework (SPF) is a major prevention innovation launched by the Center for Substance Abuse Prevention (CSAP) of the Substance Abuse and Mental Health Services Administration (SAMHSA). The SPF offers a structured, sequential, data‐driven approach that explicitly targets environmental conditions in the community and aims for change in substance use and problems at the population level. This paper describes how the ISF was applied to the challenges of implementing the SPF in 14 Rhode Island communities, with a focus on the development of a new Training and Technical Assistance Resources Center to support SPF efforts. More specifically, we (1) describe each of the three ISF interacting systems as they evolved in Rhode Island; (2) articulate the lines of communication between the three systems; and (3) examine selected evaluation data to understand relationships between training and technical assistance and SPF implementation and outcomes. Special Issue: Advances in Bridging Research and Practice Using the Interactive System Framework for Dissemination and Implementation; Guest Editors: Abraham Wandersman, Paul Flaspohler, Catherine A. Lesesne, Richard Puddy; Action Editor: Emilie Phillips Smith     

The Diffusion of Youth-Led Participatory Research in Urban Schools: The Role of the Prevention Support System in Implementation and Sustainability

This article discusses the dissemination of a process of youth-led participatory research in urban secondary schools within the Interactive Systems Framework for Dissemination and Implementation (ISF) developed in collaboration with the CDC and its university partners (Wandersman et al. American Journal of Community Psychology, 41(3-4) 2008). The focus here is on the development of the Prevention Support System with respect to general and innovation-specific capacity building. The specific process under study involves youth-led needs assessment and research to inform the planning of prevention programs and policies to address students' health and developmental needs. The article first briefly describes the youth-led research process, its potential benefits, and a case example in two urban secondary schools. It then describes challenges and responses in providing support for the diffusion of this model in 6 secondary schools. The settings are urban public schools with a majority of students of color from diverse ethnic groups: Asian-American, Latino, and African-American. This project constitutes a collaborative partnership with a university school of public health and community-based organizations (CBOs) to build capacity for long-term, sustainable implementation of this innovative process within the local school system. The perspectives of the university-based researcher and the CBO partners on the development and effectiveness of the Prevention Support System are presented.     

A Comparison of the Interactive Systems Framework (ISF) for Dissemination and Implementation and the CDC Division of HIV/AIDS Prevention’s Research-to-Practice Model for Behavioral Interventions

Translating evidence-based HIV/STD prevention interventions and research findings into applicable HIV prevention practice has become an important challenge for the fields of community psychology and public health due to evidence-based interventions and evidence-based practice being given higher priority and endorsement by federal, state, and local health department funders. The Interactive Systems Framework (ISF) for Dissemination and Implementation and the Division of HIV/AIDS Prevention (DHAP) Research-to-Practice model both address this challenge. The DHAP model and the ISF are each presented with a brief history and an introduction of their features from synthesis of research findings through translation into intervention materials to implementation by prevention providers. This paper describes why the ISF and the DHAP model were developed and the similarities and differences between them. Specific examples of the use of the models to translate research to practice and the subsequent implications for support of each model are provided. The paper concludes that the ISF and the DHAP model are truly complementary with some unique differences, while both contribute substantially to addressing the gap between identifying effective programs and ensuring their widespread adoption in the field.     

The Prevention Delivery System: Organizational Context and Use of Comprehensive Programming Frameworks

The purpose of this exploratory study is to investigate organizational‐level mechanisms in the Prevention Delivery System (PDS) and their influence on implementing comprehensive programming frameworks (e.g., Communities that Care‐CtC) as the innovation. The PDS is part of the Interactive Systems Framework for Dissemination and Implementation (ISF) and describes key characteristics of innovation implementation and dissemination. The study addresses two research questions: (1) What types of organizational characteristics are related to successful use of each of the programming processes (i.e., planning, implementation, evaluation, and sustainability) that are part of comprehensive programming frameworks?; and (2) What are the similarities and differences in the organizational patterns correlated with use of each of the programming processes? Surveys, interview data, and other documents designed to assess organizational characteristics and extent of use of a comprehensive programming framework over time, were collected from 8 Community boards and 23 provider agencies. These organizations were responsible for planning and delivering substance abuse prevention services as part of a statewide initiative in Ohio. Data were analyzed using Spearman rho (and rank‐biserial) correlations, with an emphasis on effect sizes. Results indicated that leadership, shared vision, process advocates, and technical assistance were common correlates of use across programming processes. However, the role played by these organizational variables differed for each programming process, pointing to complex interactions of the organizational infrastructure with other variables (i.e., characteristics of the innovation itself and external macro‐level factors). This exploratory study provides preliminary data on the organizational‐level mechanisms of the PDS and the complexity of their relationships with the other Systems in the Interactive Systems Framework.     

Navigating the Road Ahead: Public Health Challenges and the Interactive Systems Framework for Dissemination and Implementation

Public health is currently faced with an array of critical challenges and disconnects. Research and evaluation have identified a number of evidence‐based strategies for effecting behavior change at individual, group, organizational, and environmental levels, all of which hold promise for leading to substantial reductions in morbidity and mortality, and increased quality of life. Unfortunately, there is huge variability across the public health system in awareness of the value of using evidence to inform decision making, let alone in capacity to locate, assess, compare, select, justify, adapt, implement, and evaluate evidence‐based strategies, or to participate in building the evidence base for practice‐based innovations. As a result, many communities may not be benefitting from research‐tested and practice‐based strategies that could help them to meet their public health goals more efficiently and effectively. CDC's Interactive Systems Framework for Dissemination and Implementation (ISF), released in 2008, was designed to help close this gap between research and practice. This commentary identifies the ways in which the ISF framework is useful in addressing the research practice gap; revisits the elements of the framework that have continued to guide research and practice in fruitful ways; and highlights areas that need further development to meet current public health challenges. Special Issue: Advances in Bridging Research and Practice Using the Interactive System Framework for Dissemination and Implementation; Guest Editors: Abraham Wandersman, Paul Flaspohler, Catherine A. Lesesne, Richard Puddy; Action Editor: Emilie Phillips Smith     

Blending Theory with Practice: Implementing Kindergarten Transition Using the Interactive Systems Framework

The Interactive Systems Framework (ISF; Wandersman et al. in Am J Commu Psychol 41(3–4):171–181, 2008) was used to implement a kindergarten transition demonstration project collaboratively developed by elementary and early education providers, community‐based family and housing services, parents, and a University intermediary and technical assistance group. First person accounts from stakeholders at all levels provide a complementary and broad perspective on the project's implementation. The practice model blended existing research on kindergarten transition and parent involvement with feedback from stakeholders to create a community‐specific program designed to help all children make a smooth entry into kindergarten. During implementation, evidence‐based approaches needed to be adjusted to fit the specific needs of each community. Using the ISF as a guide, next steps and lessons learned include increasing leadership through a district‐wide plan that is still flexible within each school community, increasing information and supports to individual schools, and improving data collection for continuous program improvement. Special Issue: Advances in Bridging Research and Practice Using the Interactive System Framework for Dissemination and Implementation; Guest Editors: Abraham Wandersman, Paul Flaspohler, Catherine A. Lesesne, Richard Puddy; Action Editor: Emilie Phillips Smith     

Applying the Interactive Systems Framework to the Dissemination and Adoption of National and State Recommendations for Hypertension

The Centers for Disease Control and Prevention (CDC), Division for Heart Disease and Stroke Prevention (DHDSP), commissioned an Institute of Medicine (IOM) report to identify the highest priority action areas for CDC, state health departments, and other public health partners in their efforts to reduce and control hypertension. To assess the dissemination and adoption of the IOM report recommendations, DHDSP developed an evaluation based on the Interactive Systems Framework for Dissemination and Implementation (ISF). The evaluation incorporates data collection at critical points across 3 years. In this article, we focus on the ISF systems to describe the role of funded state partners and their relationship with CDC in implementing public health recommendations. We describe baseline results for three data collection activities: (1) key informant interviews, (2) a Web‐based survey, and (3) content analysis of state workplans to determine the degree of alignment with IOM recommendations. For example, currently 30 % of surveyed programs are implementing most (or all) of the recommendations in the IOM report, however 76 % intend to change hypertension program priorities based on the recommendations of the IOM report. Qualitative data suggest that there are several facilitators and barriers in implementing public health policy recommendations. DHDSP will use these baseline results to provide additional technical assistance and support to state health departments in their efforts to implement the IOM report's recommendations. Special Issue: Advances in Bridging Research and Practice Using the Interactive System Framework for Dissemination and Implementation; Guest Editors: Abraham Wandersman, Paul Flaspohler, Catherine A. Lesesne, Richard Puddy; Action Editor: Emilie Phillips Smith     

Bridging Science and Practice in Violence Prevention: Addressing Ten Key Challenges

This article illustrates ideas for bridging science and practice generated during the Division of Violence Prevention's (DVP) dissemination/implementation planning process. The difficulty of moving what is known about what works into broader use is near universal, and this planning process pushed us to look beyond the common explanations (e.g., providers were resistant/unwilling to change practice) and think about the multiple layers and systems involved. As part of this planning process, the Interactive Systems Framework for Dissemination and Implementation (ISF) was developed and then applied to the fields of child maltreatment and youth violence prevention. Challenges for each of the three systems in the ISF are discussed as well as and action and research ideas to address the challenges. Also described are actions taken by DVP in response to the planning process to illustrate how a funder can use the ISF to bridge science and practice.     

Building Capacity of State Adolescent Pregnancy Prevention Coalitions to Implement Science-Based Approaches

A central question in adolescent reproductive health circles is how to effectively disseminate research to practitioners in a way that supports them in using the most scientifically sound and effective programming. In 2002, the Division of Reproductive Health at the Centers for Disease Control and Prevention (CDC) tackled this question by funding three national-level and five state-level organizations focused on adolescent pregnancy prevention to promote the use of science-based programs and approaches. Healthy Teen Network (HTN) and Education, Training and Research Associates (ETR), two national organizations, have partnered under this CDC funding to implement an effective model for capacity building. This paper provides an overview of the approaches used by HTN and ETR in capacity building using a seven-step process. We describe how we modified the Interactive Systems Framework for Dissemination and Implementation (ISF) for science-based innovations to apply to capacity-building for adolescent reproductive health (ARH) programs, and how we developed relevant, sustainable training and technical support. We conclude by reviewing some of the results of this training, and discuss the future work that will likely continue to advance the science behind effective dissemination of ARH research to practice.     

Using the Interactive Systems Framework in Understanding the Relation Between General Program Capacity and Implementation in Afterschool Settings

The present study uses the Interactive Systems Framework (ISF) to understand how general capacity influences the implementation of prevention programs in afterschool settings. Eight afterschool sites received the Good Behavior Game (GBG) intervention, a program designed to foster supportive behavioral management and positive youth behavior. In line with the Prevention Support System component of ISF, the intervention afterschool staff were trained and received weekly on-site support from coaches in implementing the GBG. It was found that GBG implementation scores were greatest in afterschool programs that rated high on both organizational- and community-levels of general capacity; high scores on only one level of general capacity resulted in lower implementation scores. Thus, afterschool sites that were more organized, maintained adequate facilities, and developed strong linkages to individuals or organizations in the community scored highest in implementation fidelity and quality. This study highlights the importance of considering interactions among multiple levels of general capacity in efforts to promote evidence-based practices in afterschool settings. Caution should be taken in generalizing findings due to the small sample in this study.     

Toward an Evidence-Based System for Innovation Support for Implementing Innovations with Quality: Tools,Training, Technical Assistance,and Quality Assurance/Quality Improvement

An individual or organization that sets out to implement an innovation (e.g., a new technology, program, or policy) generally requires support. In the Interactive Systems Framework for Dissemination and Implementation, a Support System should work with Delivery Systems (national, state and/or local entities such as health and human service organizations, community-based organizations, schools) to enhance their capacity for quality implementation of innovations. The literature on the Support ystem has been under-researched and under-developed. This article begins to conceptualize theory, research, and action for an evidence-based system for innovation support (EBSIS). EBSIS describes key priorities for strengthening the science and practice of support. The major goal of EBSIS is to enhance the research and practice of support in order to build capacity in the Delivery System for implementing innovations with quality, and thereby, help the Delivery System achieve outcomes. EBSIS is guided by a logic model that includes four key support components: tools, training, technical assistance, and quality assurance/quality improvement. EBSIS uses the Getting To Outcomes approach to accountability to aid the identification and synthesis of concepts, tools, and evidence for support. We conclude with some discussion of the current status of EBSIS and possible next steps, including the development of collaborative researcher-practitioner-funder-consumer partnerships to accelerate accumulation of knowledge on the Support System.