Therapists’ and clients’ perceptions of routine outcome measurement in the NHS: A qualitative study

Primary objective: This is the first qualitative study that elicited the perceptions of both psychological therapists and their clients in the use of Clinical Outcomes in Routine Evaluation with computer software (CORE‐Net), where instant visual feedback for session tracking was given on a computer screen in the therapy room at each therapy session. The study also examined how therapists viewed its potential value in supervision and provides suggestions for improving training. Research design: The study adopted a convenience sample of four therapists in a primary care counselling setting (PCC – General Practitioner referrals) who were experienced in using CORE‐Net, and five therapists in an NHS employee/occupational support counselling service (OH) who had just begun to use CORE‐Net for session tracking with 10 of their clients. Method: A qualitative methodology was used and interview data were collected from the therapists via focus groups; the clients were interviewed individually face to face. All data was analysed inductively. Findings: The study identified six overarching themes: (i) therapists were initially anxious and resistant; (ii) therapists adapt ‘creatively’; (iii) outcome measures help the client/therapist relationship; (iv) clients perceive visual measures as helpful; (v) CORE scores inform supervision; and (vi) proper and ongoing training/support of therapists is necessary. The main limitations are comparability of data and the generalisabilty of results. Conclusions: The implementation of routine outcome measurement (ROM) is a challenge but can be made easier with proper training and supervision. Clients appear happier than their therapists when routine outcome measurement is used.     

The experiences of therapists using a new client‐centred psychometric instrument,PSYCHLOPS (Psychological Outcome Profiles)

PSYCHLOPS (‘Psychological Outcome Profiles’) is a newly developed client‐generated psychometric instrument which can be used as an outcome measure. Uniquely, it asks clients to state their own problems, in their own words. As part of its validation, we used it alongside an existing measure, CORE‐OM (‘Clinical Outcomes Routine Evaluation – Outcome Measure’). Based on a qualitative methodology, we report here on the first‐hand experiences of four therapists using both instruments. The key themes that emerged from therapists’ responses were feasibility, validity and usefulness. Both questionnaires were perceived as complementing each other, the qualitative information from PSYCHLOPS balancing the quantitative information from CORE‐OM and that both could contribute to the therapist‐client interaction. The key features of PSYCHLOPS are likely to prove attractive to therapists and should increase acceptance and uptake of outcome measures.     

‘Learning from research’: Therapist perspectives on the benefits and challenges of participating in a longitudinal,systematic case‐study

Objectives: In psychotherapy research we have often neglected to examine the impact of research procedures on therapy process and outcome. Such information is extremely important in helping us evaluate the validity of our findings, increase relevance of research for practice, and choose appropriate methods for future projects. The aim of this paper is to share the experience of six person‐centered therapists, who participated in a longitudinal, systematic study, and present their reflections about the impact of research on therapy process, therapeutic engagement and professional development. Methods: The findings have emerged from semi‐structured interviews that took place after the first, sixth (middle) and last therapy session. In total 18 interviews were conducted. These data were part of a much larger research protocol that included a number of outcome and process measures. Results & Conclusions: The analysis of therapist narratives revealed important benefits for those participating in systematic case study research. The use of Brief Structured Recall methods and qualitative interviewing was an important factor in promoting therapist reflexivity and professional development. The importance of a strong research alliance and the active involvement of the client in the research process is discussed.     

‘I never talked about,ever’: A comprehensive process analysis of a significant client disclosure event in therapy

Aims: The present study was intended to examine how a particular client disclosure came about and what made it important to the client. Method: A client‐identified significant therapy event involving disclosure of childhood abuse was analysed using Comprehensive Process Analysis (CPA), a qualitative interpretive method for examining the process, effects and context of significant events in therapy. Results: The analysis identified therapist invitation and client universalisation as the key elements of the disclosure event. The context analysis showed how the event linked to the client's symbolisation of her fear earlier in the session and in the previous session. The client gained insight into how the earlier abuse had affected her life, linking it to the victimisation that was her primary reason for seeking therapy, and to her relationship with her mother. The therapist facilitated the event by following up the client's hints, trusting the strength of the alliance, and staying close to the client's frame of reference. Conclusion: The findings suggest that the initial significance of an invited disclosure event may diminish for a client over the course of therapy.     

Coming to an end: A case study of an ambiguous process of ending psychotherapy

Aim: When the duration of therapy is not preset and the outcome is a matter for negotiation, the decision to end psychotherapy will be an experiential concern for the two participants. This case study draws attention to how ambiguities may be settled in a process where ending is initiated by the therapist and resisted by the client. Method and analysis: The actual case was strategically selected as exceptional owing to a combination of circumstances. The client and the therapist had developed a ‘good enough’ alliance (WAI) and reached a ‘good enough’ outcome (OQ‐45), and still the client felt she was far from finished. A close inspection of interactional data in sessions together with both clients' and therapists' reflections in post‐therapy interviews elicited information about both substantial content and structural aspects of this complicated process of ending. Findings and discussion: The discrepancy between therapist and client was not addressed, but rather postponed and revisited again later. Structural elements like preparations for a break for vacations and reducing the frequency of sessions were used to test experiential qualities, such as how the client managed life without therapy. Carefully preserving a ‘good enough’ emotional bond through the negotiations seemed important to both parties. Significantly, the client's autonomy was interpreted as the final proof of improvement and the client came to a point where she could affirm that she had got better only by accepting that treatment was coming to an end.     

Resistance and outcome expectations in cognitive‐behavioural therapy for generalised anxiety disorder

Greater client resistance has been consistently found to be negatively associated with outcome in psychotherapy. However, the pathways through which resistance impacts such outcomes are underexplored. Given that client outcome expectation (OE) has been identified as an important common factor in psychotherapy, the goals of the present study were to examine: (a) the impact of resistance on subsequent client and therapist OE (COE & TOE, respectively); and (b) whether COE and/or TOE mediate the relationship between resistance and outcome. These relationships were tested among 44 clients with severe generalised anxiety disorder treated with cognitive‐behavioural therapy in the context of a randomised controlled trial (Westra, Constantino, & Antony, 2016). Resistance was measured at a mid‐treatment session, and COE and TOE were assessed at baseline and immediately after the resistance session. Treatment outcome was measured via client‐rated worry severity at post‐treatment. As predicted, higher resistance was associated with lower subsequent COE and TOE; B = ?.73, p < .001 and B = ?.46, p < .001, respectively. In turn, lower post‐resistance COE predicted higher post‐treatment worry (B = ?.5, p < .001), indicating mediation. In contrast, TOE did not mediate the relationship between resistance and outcome (B = ?.02, p = .876). These results suggest that resistance can be demoralising to both clients and therapists. However, only lower client morale may be detrimental to therapy outcome. This study contributes to understanding outcome pathways through two common therapy processes.     

Quantitative and qualitative analysis of a set of goal attainment forms in primary care mental health services

Aims: The aim of this paper is to present an attempt to collate the results of the client‐completed Goal Attainment Form (GAF) and to explore the usefulness of analysing the data in this way. The GAF is used primarily to add qualitative idiosyncratic data to the quantitative data collected by the CORE‐OM (Clinical Outcomes for Routine Evaluation Outcome Measure) questionnaire. Method: A sample of 477 completed GAF were used during short‐term therapy through primary care mental health services to investigate potential correlations in various different aspects between the GAF and the CORE outcome measure (CORE‐OM). The themes from these forms were qualitatively analysed to compare how clients describe their experience of therapy with clinical perspectives. Results: The results reveal several significant correlations. Themes used by clients to describe their problems and benefits of therapy were different from clinicians' perspectives. Discussion and recommendations: Several suggestions and recommendations are offered regarding evaluation, therapy and primary care short‐term therapy services.     

Counselling young people: Counsellors' perspectives on ‘what works’ – An exploratory study

Aim: Counsellors who work with young people in a range of contexts know that they are not engaging with ‘mini‐adults’. The issues young people bring to counselling are often complex, challenging and wide‐ranging, as adolescents are experiencing times of turbulence and change in their physical, emotional, social and psychological development. This paper focuses on a research project undertaken with five counsellors who work with young people, and asks the question: ‘What works?’ Method: The research project is an in‐depth qualitative study into the counsellor's experience of counselling young people, using a narrative approach. Findings: Four key shared themes emerged: the significance of ‘safety’ in the relationship; building the therapeutic alliance; flexibility and integration relating to theoretical orientation; and the use of creativity. Outcomes: This paper offers counsellors the opportunity to reflect on ‘what works’ and consider the professional knowledge, which underpins their own counselling practice with young people.     

We have travelled a long distance and sorted out the mess in the drawers: Metaphors for moving towards the end in psychotherapy

Aim: To explore the process of ending in psychotherapy, in particular how clients and therapists draw on their notions of client improvements and prepare for the upcoming end. Data: The data comes from an intensive process‐outcome study at the University of Oslo, Norway. The study includes audio‐recording from all sessions and separate post‐therapy interviews with clients and therapists. Twelve psychotherapy dyads were selected because they had reached a ‘good enough’ ending. Therapy duration ranged from 7–43 months. The number of sessions ranged from 10–67. Method and analysis: A hermeneutical‐phenomenological approach analysed and combined the observational and reflexive data. The analysis was carried out using a method for systematic text condensation and through reflexive dialogues with the material and between the researchers. Findings and discussion: The language of improvement towards the end of treatment seemed packed with metaphors conveying growth in both affective and relational management. Metaphors based on travel (how they have moved); cleaning (how they have cleaned up and sorted out things); sensing (how the clients have grown stronger, got their heads above water and see things differently); and the clients’ feeling of having received something (gifts or tools) are widely used. Such metaphors are created in the interaction with a mutual sensitivity to their capacity to confirm and regulate affect towards the end. In this sense, the metaphors celebrate accomplishments in a way that exceeds therapy, and the client can keep them to use afterwards.     

Reconsidering the ‘heresy’ of using treatment manuals

Some argue that the medical model and the experimental design that underlies the use of treatment manuals to prove the efficacy of a psychotherapeutic treatment clashes with the theoretical basis of family therapy. From the point of view of the empirically supported treatments (ESTs) movement, treatment manuals are the operationalization of the independent variable in a clinical trial; the therapist is only part of the procedure and the therapeutic relationship is a confounding variable. Applying that logic to the practice of family therapy might be considered a heresy. This article argues that paradoxically, this heresy has a lot to offer the practice of family therapy. Research is the best way to answer questions like ‘how does family therapy work?’ ‘What makes ‘good therapy’ good?’ ‘Do therapists do what they say they do'? This article recommends an alternative framework for integrating ESTs into practice by proposing empirically informed guides to practice which, being less formulaic, encourage process‐outcome research, are coherent with the systemic model and do not constrain the therapist's creativity. Such guidelines allow therapists to use manuals flexibly so that they deepen the understanding of the process of therapy. We encourage you to listen to the JFT Editor, Mark Rivett, as he interviews the author on Manuals in the Practice and Research of Family Therapy. Available at http://onlinelibrary.wiley.com/journal/10.1111/(ISSN)1467‐6427/homepage/jft_podcast_series.htm .     

A client‐generated psychometric instrument: The development of ‘PSYCHLOPS’

PSYCHLOPS (Psychological Outcome Profiles) is a recently developed, client‐generated, psychometric instrument that can be used as an outcome measure. Based on a similar instrument developed primarily for use in physical illnesses (MYMOP — ‘Measure Your Medical Outcome Profile’), it seeks the client's perspective on their psychological distress. It asks them to describe and then score the problem that troubles them the most at the start of counselling. We describe the development of PSYCHLOPS, including the involvement of the Plain English Campaign and two national mental health organisations: the mental health charity and support group, Depression Alliance (DA) and Primary Care Mental Health Education (PRIMHE). We review the literature and suggest that PSYCHLOPS, by focusing on the problems of greatest priority to the client, might prove a sensitive measure of improvement after counselling.     

Qualitative meta-analysis of insight events in psychotherapy

Purpose: This study reports on a qualitative meta-analysis examining the phenomenon of insight into psychotherapy. Method: Studies (n?=?7, covering 15 insight events of 15 clients) were selected that examined significant events in psychotherapy leading to insight using session recordings and Interpersonal Process Recall interviews with clients and therapists. A conceptual organization of the data using a matrix grid consisting of three domains according to data origin (client process, therapist process, and their interaction) and three domains according to events’ sequence (context, event and key intervention, and impact) was established. Results: Key processes were identified that lead to insight events in psychotherapy. Two distinct types of events according to their main impacts as reported by the clients were identified: Painful/Poignant Insight where clients realized something that was painful, often evoking feelings of sadness or undifferentiated upset containing sadness and hurt; and Self-Asserting/Empowering Insight that led to an impact characterized by a sense of self-assertion and empowerment on the client’s part. A reasonably good alliance and vulnerability on the client’s part represent the context for insight events as does the client’s quest for self-understanding. The therapists’ key interventions in the event leading to poignant/painful insight contain either empathic reflection or collaborative interpretation. In empowerment/self-assertive insight events the therapists offer supportive, validating reframing promoting positive experience. In both types of events the therapist and the client work on consolidating insight. In some events, therapists emphasized cognitive or problem solution focused impacts, while clients emphasized emotional impacts. Some events contained emotional avoidance on the part of the client or therapist thus not realizing the full potential of the event.     

Dialogical journal writing as ‘self‐therapy’: ‘I matter’

Aim: This case study of one woman's (Jane's) experience of dialogical journal writing presents a way of finding a ‘compassionate image’ for self‐therapy. Various theoretical analyses are indicated with Mindfulness‐based conceptualisations at the forefront. Methodology: Based on three recorded interviews, the narrative inquiry took place over a year. Methodologically, this paper is also one contribution to an ongoing debate about different research approaches in therapeutic writing research. Participants: This study took place in Aotearoa New Zealand, where both Jane and I are migrants. Discussion: This account draws on a report of self‐directed writing for well‐being, seen as an alternative to counselling or medication for depression and anxiety. It focuses on how a particular style of writing evolved and how the motivation to write continues.     

Inviting passage to new discourse: ‘Alive moments’ and their spiritual significance

Some social constructionists assert that therapeutic change occurs when clients' meanings for problems and solutions shift from those found in resource‐impoverished discourses to those affording resourceful and preferred possibilities. Referred to as ‘positioning theory’, our research examined this assertion by inviting clients and therapists to speak of a significant, but ambiguous, experience in unfamiliar discourse: spiritual discourse. Clients were asked to review videotapes of their sessions, selecting moments that felt most ‘alive’ to them for discussions with the researcher, including inquiries as to whether ‘alive’ moments held any spiritual significance. The outcomes are portrayed as a ‘poetic collaboration’ between the researcher, clients and therapists — while clients' and therapists' reported experiences for changes in discourse and meaning are highlighted. Implications regarding sensitivities required when co‐constructing meanings for ambiguous but significant experiences in therapy are discussed. Possibilities for more research examining poetic practices and processes in therapy are also considered in terms of positioning theory.     

Understanding ‘Unlikely (20% Likelihood)’ or ‘20% Likelihood (Unlikely)’ Outcomes: The Robustness of the Extremity Effect

Calls to communicate uncertainty using mixed, verbal‐numerical formats (‘unlikely [0–33%]’) have stemmed from research comparing mixed with solely verbal communications. Research using the new ‘which outcome’ approach to investigate understanding of verbal probability expressions suggests, however, that mixed formats might convey disadvantages compared with purely numerical communications. When asked to indicate an outcome that is ‘unlikely’, participants have been shown to often indicate outcomes with a value exceeding the maximum value shown, equivalent to a 0% probability —an ‘extremity effect’. Recognising the potential consequences of communication recipients expecting an ‘unlikely’ event to never occur, we extend the ‘which outcome’ work across four experiments, using verbal, numerical, and verbal‐numerical communication formats, as well as a previously unconsidered numerical‐verbal format. We examine how robust the effect is in the context of consequential outcomes and over non‐normal distributions. We also investigate whether participants are aware of the inconsistency in their responses from a traditional ‘how likely’ and ‘which outcome’ task. We replicate and extend previous findings, with preference for extreme outcomes (including above maximum values) observed in both verbal and verbal‐numerical formats. Our results suggest caution in blanket usage of recently recommended verbal‐numerical formats for the communication of uncertainty. Copyright © 2018 John Wiley & Sons, Ltd.     

‘MusiMath’ and ‘Academic Music’ – Two music‐based intervention programs for fractions learning in fourth grade students

Music and mathematics require abstract thinking and using symbolic notations. Controversy exists regarding transfer from musical training to math achievements. The current study examined the effect of two integrated intervention programs representing holistic versus acoustic approaches, on fraction knowledge. Three classes of fourth graders attended 12 lessons on fractions: One class attended the ‘MusiMath’ holistic program (n = 30) focusing on rhythm within the melody. Another class attended the ‘Academic Music’ acoustic program (Courey et al., Educ Stud Math 81:251, 2012) (n = 25) which uses rhythm only. The third class received regular fraction lessons (comparison group, n = 22). Students in both music programs learned to write musical notes and perform rhythmic patterns through clapping and drumming as part of their fraction lessons. They worked toward adding musical notes to produce a number (fraction), and created addition/subtraction problems with musical notes. The music programs used a 4/4 time signature with whole, half, quarter and eighth notes. In the math lessons, the students learned the analogy between musical durations and fractions, but also practiced fractions other than . Music and math were assessed before, immediately following, and 3‐ and 6‐months post‐intervention. Pre‐ to post‐intervention analyses indicated that only the ‘MusiMath’ group showed greater transfer to intervention‐trained and untrained fractions than the comparison group. The ‘Academic Music’ group showed a trend on trained fractions. Although both music groups outperformed the comparison group 3‐ and 6‐months post‐intervention on trained fractions, only the ‘MusiMath’ group demonstrated greater gains in untrained fractions. Gains were more evident in trained than in untrained fractions. A video abstract of this article can be viewed at https://youtu.be/uJ_KWWDO624     

The manifestation of transference during early psychotherapy sessions: Exploring an alternate data source for therapist narratives in transference research

Introduction: Previous transference studies have compared in‐session client narratives about significant others to in‐session client narratives about the therapist, limiting data to the information that clients are willing to share with the therapist. Method: The first three sessions of 30 therapies with high‐functioning individuals were examined using the Core Conflictual Relationship Theme (CCRT) method. Client narratives about others were drawn from the psychotherapy sessions and client narratives about the therapist were drawn from a Participant Critical Event (PCE) interview conducted after the third session of therapy. Results: Factor analyses of the CCRT components indicated several relational patterns: a complementary pattern of relating characterised by a devaluation of the therapist and idealisation of others; a concordant relational transfer where clients feel bad with both the therapist and others; and as clients experience control issues with significant others, they wish to adopt a submissive stance toward the therapist. The results suggest that the source of therapist narratives may influence the results of transference research.     

Revisiting a meta-analysis of helpful aspects of therapy in a community counselling service

This small scale mixed methods study examines helpful events in a community counselling setting, categorising impacts of events according to Timulak’s [(2007). Identifying core categories of client-identified impact of helpful events in psychotherapy: A qualitative meta-analysis. Psychotherapy Research, 17, 305–314] meta-synthesis of significant events research. Comparisons were made between the types of impacts reported as helpful by clients receiving cognitive behavioural therapy (CBT) or relational integrative counselling. Seventy-five clients identified 291 significant events on 216 Helpful Aspects of Therapy (HAT) forms. The findings broadly reflect all nine impacts identified by Timulak (2007). The study also suggests that a potential new category, ‘voicing’ may exist. Differences between the types of impacts reported as helpful by clients in CBT and integrative therapy showed a higher percentage of CBT clients reporting ‘behavioural change/problem solution’, ‘reassurance’ and ‘client involvement’ as helpful. Differences in other categories were not statistically significant.