Psychometric characteristics of a multidimensional measure to assess impairment: The Child and Adolescent Functional Assessment Scale

The Child and Adolescent Functional Assessment Scale (CAFAS) is a multidimensional measure of degree of impairment in functioning. Interrater reliability data are presented for lay raters, graduate students, and frontline staff. Reliability was high for the total score and behaviorally-oriented scales. Construct, concurrent, and discriminant validity were assessed with the sample of children and adolescents evaluated at the Fort Bragg Demonstration Evaluation Project. Youth and their caregivers were evaluated via interview and selfcompleted instruments at four time points. Significant correlations were found between the CAFAS and other related constructs. Concurrent validity was demonstrated by logistic regression analyses examining the relationship between CAFAS ratings and problematic behaviors endorsed on measures completed by parents, teachers, or the youth. Youth with higher CAFAS total scores were much more likely to have poor social relationships, difficulties in school, and problems with the law. Discriminant validity was assessed with a repeated measures analysis of variance with intensity of care at intake and time as factors. Youth who were inpatients or in residential treatment centers at intake had higher CAFAS scores than those who were outpatients. These findings provide strong evidence for the reliability and validity of the CAFAS.     

A Longitudinal Analysis of Family Empowerment and Client Outcomes

We examined the relationship between family empowerment, parent satisfaction, and mental health outcome across time. Based on the Vanderbilt Family Empowerment Project Model, increased empowerment should lead to positive changes in client outcomes. Data consisted of the Family Empowerment Scale (FES), which was used to assess the caregiver's perception of empowerment, Child and Adolescent Functional Assessment Scale (CAFAS), which measures the degree of disruption in the youth's current functioning, Client Satisfaction Questionnaire (CSQ), and demographic information gathered from families receiving services from a county mental health service system at intake and discharge. The results showed that the CAFAS and CSQ were related to empowerment at intake and discharge. Results also indicated significant increases in the knowledge subscale of the FES and the CAFAS and moderate increases in the advocacy subscale of the FES and the CSQ. We discuss the implications of these findings for systems of care, such as stronger parent-professional relationships.     

The Child and Adolescent Functional Assessment Scale (CAFAS): Review and Current Status

Measures of impairment in psychological and behavioral functioning have a long history in the field of children's mental health, and appear particularly useful in eligibility determination, treatment planning, and outcome evaluation of services for children and adolescents with serious emotional disturbance (SED). One recently developed multidimensional measure of functional impairment—the Child and Adolescent Functional Assessment Scale (CAFAS; K. Hodges, 1989, 1997)—has enjoyed widespread use nationwide. It has been adopted as a tool for making treatment eligibility decisions and documenting outcomes on a statewide level in more than 20 states and on a local level in dozens of research and demonstration projects. In this paper, the technical merits of the CAFAS are closely examined, with the conclusion that empirical evidence is lacking to support its valid use in making the types of treatment decisions for which it is currently being employed across the nation. Furthermore, there appears to be little concern among mental health researchers, practitioners, administrators, and state legislators about these apparent limitations of the CAFAS. The potential benefits of establishing objective and valid level-of-need criteria, using the CAFAS are numerous and the interest in doing so is clear; however, the psychometric limitations of the scale identified in this review need to be addressed before its full potential can be realized.     

Referring patients to counsellors in primary care: Qualitative investigation of general practitioners’ perceptions

Despite growing evidence of the effectiveness of counselling in primary care, questions arise concerning the role of general practitioners in the referral process. This involves both liaison with counsellors and the management of people who do not wish to see counsellors. Respondents (n=23) in this qualitative study of general practitioners’ perceptions were clear about which patients should be referred to counsellors, based on guidelines. Additionally, these doctors perceived their role and skills as negotiating with their patients about referral to a counsellor, and managing patients who are either waiting to see a counsellor or who prefer not to see a counsellor. These doctors feel inadequately trained in managing this latter group, whose outcome they perceive as unclear. Despite this, respondents accept a role in ongoing support for their patients with consequent training issues for doctors and opportunities for liaison and mentoring by counsellors.     

In-school in-service training for tutors

The deficiencies of existing patterns of external in-service training for teachers are examined. Possible approaches to internal training are described, with particular reference to a training course run for 57 staff concerned with pastoral care and social education in one school.     

The Unmet Educational Agenda in Integrated Care

One of the reasons integrated care has not become a dominant service delivery model is the unmet training agenda. This article argues that the typical mental health professional is not trained to adequately address the challenges of integrated care. To insure competency both a macro and clinical training agenda are needed. At the macro-level, mental health professionals need to understand healthcare economics and basic business principles as any integrated care service delivery system is embedded and driven by economic forces. Integrated care practitioners also need some basic business skills to understand these forces and to create and manage a financially viable system, given the future flux of the system. Traditional mental health professionals also do not have the clinical skills to implement integrated care. Integrated care is not simply placing a traditionally trained mental health professional and letting them practice specialty mental health in a medical setting. Thus, the special skills needed in integrated care are enumerated and discussed. Finally, a new degree program is described as it is time given the huge need and advantages of integrated care to develop specialty training in integrated care.     

Family-strengthening approaches for the prevention of youth problem behaviors

Effective parenting is the most powerful way to reduce adolescent problem behaviors. Dissemination of research-based family interventions has been slow, with most practitioners still implementing ineffective programs. This article reviews 2 federal studies that involved national searches for effective family interventions targeting pre-birth to adolescence: Preventing Substance Abuse Among Children and Adolescents: Family-Centered Approaches (Center for Substance Abuse Prevention, 1998) and Strengthening America's Families (R. Alvarado, K. L. Kumpfer, K. Kendall, S. Beesley, & C. Lee-Cavaness, 2000). Results identified 3 effective prevention approaches, 13 principles of effectiveness, and 35 programs. Recommendations include increased dissemination research on training and technical assistance systems, adoption with fidelity and quality, and gender-, age-, and culturally sensitive adaptations.     

日本新的社区保健医疗教育对我们的启示

从2004年开始,日本一改36年来的医师法,对大学本科毕业并获得医师资格的青年医生实行2年的临床必修制度,其中重要内容之一是:加强初级卫生保健的继续教育。在我国已开展十年的临床医生早期规范化培训以来,对初级卫生保健方面的培训尚处于薄弱状态。有必要借鉴日本的新作法,结合中国的实际情况,切实有效地开展此方面的培训工作。     

Assessing the effectiveness of conflict management training in a health sector organization: evidence from subjective and objective indicators

This study assessed the effectiveness of an intervention for handling interpersonal conflicts at work. In contrast to the mainstream approach in the health care industry, which focuses on developing formal systems of conflict resolution, our intervention consisted of enhancing health care workers’ conflict management skills through training. A pre- and post-test nonequivalent comparison group design was used (intervention group = 258 workers; comparison group = 243 workers). Participants perceived that the training was successful in reducing the number and intensity of conflicts with co-workers, patients, and patients’ relatives. Moreover, organizational indicators calculated on the basis of data obtained from human resources (HR) records show that the intervention was effective, insofar as the number of requests for third-party interventions to mediate conflicts at work, the number of patients’ complaints, and the level of absenteeism all decreased for trained workers, whereas workers from the comparison group exhibited no corresponding changes over time. In the light of these results, this article discusses the design of conflict management measures which could help improve both employees’ well-being and organizational productivity.     

Validity of Treatment Target Progress Ratings as Indicators of Youth Improvement

We examined whether clinical progress ratings on the Monthly Treatment and Progress Summary form (MTPS), an idiographic treatment progress measure, were meaningfully related to changes measured by two separate standardized instruments; the Child and Adolescent Functional Assessment Scale (CAFAS) and the Child and Adolescent Level of Care Utilization System (CALOCUS). Validity coefficients were examined at intake and three-, six-, and nine-month follow-up periods. Samples were selected for each measure and follow-up period from the population of youth receiving services through the Hawaii Child and Adolescent Mental Health Division’s (CAMHD) system of care. Significant youth improvement was evident on all three measures across all follow-up intervals. The type of changes measured by the MTPS and CAFAS were more alike over longer follow-up intervals than changes measured by the CALOCUS. The MTPS captures distinct aspects of client change that overlaps somewhat with CAFAS and CALOCUS measures. The MTPS is a brief client-tailored measure that seems to provide valid, sensitive, and nonredundant client specific treatment outcome information that can be collected on a frequent basis within a complex system of care.     

Use of the CAFAS to Evaluate Outcome for Youths with Severe Emotional Disturbance Served by Public Mental Health

Outcomes are reported for youths with serious emotional disturbance receiving customary services from community mental health service providers who receive state mental health funds. Various outcome indicators for the Child and Adolescent Functional Assessment Scale (CAFAS) are described, as well as a procedure for categorizing youths into client types based on the CAFAS subscale scores. The youth's intake assessment was compared to the last CAFAS evaluation that the youth received. A statistically significant reduction in mean CAFAS total score was observed for the entire sample and for each client type. In addition, the mean number of subscales on which the youth was rated as severely impaired significantly decreased for the total sample and for each client type. The proportion of youths who experienced a clinically meaningful improvement in functioning was 58.6%. For the subset of youths who were rated as severely impaired on one or more subscales at intake, 53.1% left services without any severe impairments. The pattern of outcome results differed for subgroups based on type and extent of impairment. Implications of these findings and suggestions for using outcome monitoring to improve services in the public mental health sector are discussed.     

The Interactive Systems Framework Applied to the Strategic Prevention Framework: The Rhode Island Experience

The Interactive Systems Framework for Dissemination and Implementation (ISF) was introduced as a heuristic systems level model to help bridge the gap between research and practice (Wandersman et al., in Am J Commun Psychol 41:171–181, 2008). This model describes three interacting systems with distinct functions that (1) distill knowledge to develop innovations; (2) provide supportive training and technical assistance for dissemination to; (3) a prevention delivery system responsible for implementation in the field. The Strategic Prevention Framework (SPF) is a major prevention innovation launched by the Center for Substance Abuse Prevention (CSAP) of the Substance Abuse and Mental Health Services Administration (SAMHSA). The SPF offers a structured, sequential, data‐driven approach that explicitly targets environmental conditions in the community and aims for change in substance use and problems at the population level. This paper describes how the ISF was applied to the challenges of implementing the SPF in 14 Rhode Island communities, with a focus on the development of a new Training and Technical Assistance Resources Center to support SPF efforts. More specifically, we (1) describe each of the three ISF interacting systems as they evolved in Rhode Island; (2) articulate the lines of communication between the three systems; and (3) examine selected evaluation data to understand relationships between training and technical assistance and SPF implementation and outcomes. Special Issue: Advances in Bridging Research and Practice Using the Interactive System Framework for Dissemination and Implementation; Guest Editors: Abraham Wandersman, Paul Flaspohler, Catherine A. Lesesne, Richard Puddy; Action Editor: Emilie Phillips Smith     

Attitudes toward suicide prevention in front-line health staff

A questionnaire assessing attitudes toward suicide prevention was constructed and shown to have satisfactory reliability and internal consistency. The determinants and distribution of these attitudes were investigated in four groups of health professionals who are in contact with suicidal patients: general practitioners, accident and emergency nurses, psychiatrists in training, and community psychiatric nurses. Attitudes toward suicide prevention were shown to differ significantly between professional groups. More positive attitudes were associated with mental health professionals, working in the community, and previous training in suicide risk assessment. Negative attitudes should be assessed and targeted in training designed to improve the management of suicide risk.     

The reliability of eyetracking to assess attentional bias to threatening words in healthy individuals

Eyetracking is commonly used to investigate attentional bias. Although some studies have investigated the internal consistency of eyetracking, data are scarce on the test–retest reliability and agreement of eyetracking to investigate attentional bias. This study reports the test–retest reliability, measurement error, and internal consistency of 12 commonly used outcome measures thought to reflect the different components of attentional bias: overall attention, early attention, and late attention. Healthy participants completed a preferential-looking eyetracking task that involved the presentation of threatening (sensory words, general threat words, and affective words) and nonthreatening words. We used intraclass correlation coefficients (ICCs) to measure test–retest reliability (ICC > .70 indicates adequate reliability). The ICCs(2, 1) ranged from –.31 to .71. Reliability varied according to the outcome measure and threat word category. Sensory words had a lower mean ICC (.08) than either affective words (.32) or general threat words (.29). A longer exposure time was associated with higher test–retest reliability. All of the outcome measures, except second-run dwell time, demonstrated low measurement error (<6%). Most of the outcome measures reported high internal consistency (α > .93). Recommendations are discussed for improving the reliability of eyetracking tasks in future research.     

Bridging the Gap Between Prevention Research and Practice: The Interactive Systems Framework for Dissemination and Implementation

If we keep on doing what we have been doing, we are going to keep on getting what we have been getting. Concerns about the gap between science and practice are longstanding. There is a need for new approaches to supplement the existing approaches of research to practice models and the evolving community-centered models for bridging this gap. In this article, we present the Interactive Systems Framework for Dissemination and Implementation (ISF) that uses aspects of research to practice models and of community-centered models. The framework presents three systems: the Prevention Synthesis and Translation System (which distills information about innovations and translates it into user-friendly formats); the Prevention Support System (which provides training, technical assistance or other support to users in the field); and the Prevention Delivery System (which implements innovations in the world of practice). The framework is intended to be used by different types of stakeholders (e.g., funders, practitioners, researchers) who can use it to see prevention not only through the lens of their own needs and perspectives, but also as a way to better understand the needs of other stakeholders and systems. It provides a heuristic for understanding the needs, barriers, and resources of the different systems, as well as a structure for summarizing existing research and for illuminating priority areas for new research and action. The findings and conclusions in this report are those of the authors and do not necessarily represent the views of the Centers for Disease Control and Prevention.     

Measuring Treatment Outcome for Children with Serious Emotional Disturbances: Discriminant Validity and Clinical Significance of the Child and Adolescent Functioning Assessment Scale

We investigated the use of a popular measure, the Children and Adolescent Functional Assessment Scale (CAFAS), in treatment outcome research. The sample included 70 children who had been discharged from an elementary therapeutic classroom (Intensive Mental Health Program). Significant relationships were found between decreases in CAFAS scores and optimal educational placement, contributing to evidence of the scale’s discriminant validity. Clinically significant change in CAFAS scores was also investigated, with a 30 point change in score most accurately discriminating between placements after discharge. Further investigations of real world outcomes versus changes in score on this measure are warranted.     

Demographic, Clinical, and Functional Characteristics of Youth Enrolled in Six California Systems of Care

We describe the demographic, functional, and clinical status of children served across six California counties implementing a longstanding integrated system of care approach called the California System of Care Model. The children enrolled in the care systems are an ethnically diverse group of predominantly pre-adolescent and adolescent males. The level of functional impairment and degree of symptomatology is high. Seventy to 80% of the youth were in the clinical or borderline clinical ranges as measured by the Child Behavior Checklist. Scores on the Child and Adolescent Functional Assessment Scale, provided by the treating clinician, indicated that up to 94% of the youth were in the moderate to severe levels of impairment. Children and adolescents rated themselves on the Youth Self Report as having lower levels of impairment than did parents. Caregivers and youth ratings emphasized externalizing rather than internalizing problems. Clinician ratings as captured by the CAFAS and the clinical diagnoses, presented a mix between internalizing and externalizing diagnoses and functional impairment areas. The six counties are serving children who have levels of impairment, similar to, or higher than, youth enrolled in other systems of care nationwide.     

Memory for time of training modulates performance on a place conditioning task in marmosets

In rodents, the expression of a reward-conditioned place preference (CPP) is regulated in a circadian pattern such that the preference is exhibited strongly at the circadian time of prior training but not at other circadian times. Because each animal is trained only at a single circadian phase, the concept of time as a context cue is derived from a rhythmic internal state rather than learned explicitly from the external cues. We now report that the same “time memory” is expressed following context conditioning in the common marmoset (Callithrix jacchus). Animals were trained at a specific time to discriminate between an unpaired context and a context paired with food reward. Marmosets were then tested for preference at circadian times that were either the same or different from the training time. Preference was expressed only when training and testing times matched. The results show that time of day learning can be generalized to this new world primate implying that a similar circadian mechanism might regulate craving for reward in diverse mammals including human beings.     

Self-regulatory Behaviors and Approaches to Learning of Arts Students: A Comparison Between Professional Training and English Learning

This study investigated the self-regulatory behaviors of arts students, namely memory strategy, goal-setting, self-evaluation, seeking assistance, environmental structuring, learning responsibility, and planning and organizing. We also explored approaches to learning, including deep approach (DA) and surface approach (SA), in a comparison between students’ professional training and English learning. The participants consisted of 344 arts majors. The Academic Self-Regulation Questionnaire and the Revised Learning Process Questionnaire were adopted to examine students’ self-regulatory behaviors and their approaches to learning. The results show that a positive and significant correlation was found in students’ self-regulatory behaviors between professional training and English learning. The results indicated that increases in using self-regulatory behaviors in professional training were associated with increases in applying self-regulatory behaviors in learning English. Seeking assistance, self-evaluation, and planning and organizing were significant predictors for learning English. In addition, arts students used the deep approach more often than the surface approach in both their professional training and English learning. A positive correlation was found in DA, whereas a negative correlation was shown in SA between students’ self-regulatory behaviors and their approaches to learning. Students with high self-regulation adopted a deep approach, and they applied the surface approach less in professional training and English learning. In addition, a SEM model confirmed that DA had a positive influence; however, SA had a negative influence on self-regulatory behaviors.