Qualitatively driven mixed‐methods approaches to counselling and psychotherapy research

Many researchers and clinicians take an ‘either, or’ position regarding factors responsible for change when conducting research. Qualitatively driven mixed methods privilege the qualitative approach and offer the opportunity to generate multi‐dimensional material, permitting a more holistic insight into experiences that can be understood from a combination of epistemological and ontological stances. A qualitatively driven mixed‐methods approach apply a ‘both, and’ position when exploring the elements that produce change or that are under investigation, which can be of particular value to counselling and psychotherapy research. There are various ways of engaging with qualitatively driven mixed methods. Some designs include both qualitative and quantitative components, where the former is the core element. The secondary component may also be qualitative, known as a multimethod design. Yet, other designs mix different qualitative approaches, through the application of different qualitative analyses to the same data (pluralistic qualitative research). This paper discusses the application and value of qualitatively driven mixed methods in counselling and psychotherapy research through the presentation of two research case studies; one which mixes both qualitative and quantitative components to investigate the experiences of pain alleviation following a CBT pain management programme; and one which applies a pluralistic approach to a counselling psychology doctorate exploring the experiences and meanings attached to self‐harming. Through illustration and discussion of the case studies’ mixed‐methods approaches, this paper demonstrates that qualitatively driven mixed methods produce a more enhanced and holistic understanding into phenomena, and therefore a more balanced perspective to counselling and psychotherapy research.     

Therapeutic outcomes in the Welsh Government's school‐based counselling strategy: An evaluation

Aims: The purpose of this study was to evaluate the outcomes of school‐based counselling, as delivered in the Welsh Government's School‐based Counselling Strategy, for reducing psychological distress in young people aged 11–18. Method: The study used a quantitative cohort design, comparing levels of distress on either the Young Person's CORE (YP‐CORE) or the Strengths and Difficulties Questionnaire (SDQ) from baseline to endpoint. Data were available on 3613 episodes of counselling, across 42 datasets. Meta‐analytical procedures were used to identify the mean effect size and predictors of outcomes. Results: Within each dataset, counselling was associated with significant reductions in psychological distress, with a mean effect size (d) of 0.93(95% CI = 0.89–0.97) using a fixed effects model and 1.09 (95% CI = 0.97–1.22) using a random effects model. Datasets using the YP‐CORE had larger effect sizes than those using the SDQ, and datasets with more complete response rates had lower outcomes than those with poorer response rates. Conclusion: The results confirm that school‐based counselling, as delivered in the UK, is associated with significant reductions in psychological distress, comparable to adult counselling and psychotherapy services.     

Motivation as a predictor of outcomes in school‐based humanistic counselling

Background: Recent years have seen a growth in the provision of counselling within UK secondary schools, and research indicates that it is associated with significant reductions in psychological distress. However, little is known about the moderators and mediators of positive therapeutic benefit. In the field of adult mental health, motivation has been found to be one of the strongest predictors of therapeutic outcomes, and it was hypothesised that this may also be a predictor of outcomes for young people in school‐based counselling services. Aims: To assess the relationship between young people's motivation for counselling and its effectiveness within a secondary school setting. Sample: Eighty‐one young people (12–17 years old) who attended school‐based humanistic counselling services in Scotland. Method: Clients completed a measure of motivation for counselling at the commencement of their therapeutic work and a measure of psychological wellbeing at the commencement and termination of counselling. Results: Motivation for counselling was not found to be significantly related to outcomes. Discussion: The results indicate that the association between motivation and outcomes may be weaker in young people as compared with adults. However, a number of design factors may also account for the non‐significant findings: insufficient participants, marginal reliability of the motivation measure and social desirability effects.     

A comparison of blocked and mixed‐trial methods for teaching auditory–visual discriminations

Behavior analysts typically teach conditional discriminations in a mixed‐trial format but may switch to a blocked‐trial format for learners displaying limited acquisition. No known research has shown that mixed‐trial methods are more effective or efficient than blocked‐trial methods for teaching discriminations, so it is not clear why this format has been adopted as the “first‐line” intervention. We compared blocked and mixed‐trial formats for teaching novel auditory–visual discriminations to three adults with intellectual and developmental disabilities (IDD). Results show blocked‐trial methods resulted in faster skill acquisition in all cases, suggesting this format may be a preferable starting point for instruction.     

Therapists’ and clients’ perceptions of routine outcome measurement in the NHS: A qualitative study

Primary objective: This is the first qualitative study that elicited the perceptions of both psychological therapists and their clients in the use of Clinical Outcomes in Routine Evaluation with computer software (CORE‐Net), where instant visual feedback for session tracking was given on a computer screen in the therapy room at each therapy session. The study also examined how therapists viewed its potential value in supervision and provides suggestions for improving training. Research design: The study adopted a convenience sample of four therapists in a primary care counselling setting (PCC – General Practitioner referrals) who were experienced in using CORE‐Net, and five therapists in an NHS employee/occupational support counselling service (OH) who had just begun to use CORE‐Net for session tracking with 10 of their clients. Method: A qualitative methodology was used and interview data were collected from the therapists via focus groups; the clients were interviewed individually face to face. All data was analysed inductively. Findings: The study identified six overarching themes: (i) therapists were initially anxious and resistant; (ii) therapists adapt ‘creatively’; (iii) outcome measures help the client/therapist relationship; (iv) clients perceive visual measures as helpful; (v) CORE scores inform supervision; and (vi) proper and ongoing training/support of therapists is necessary. The main limitations are comparability of data and the generalisabilty of results. Conclusions: The implementation of routine outcome measurement (ROM) is a challenge but can be made easier with proper training and supervision. Clients appear happier than their therapists when routine outcome measurement is used.     

A mixed methods research study on the video‐based counselling method Marte Meo

Marte Meo is a video‐based counselling method founded by Maria Aarts in the Netherlands and now in worldwide use (Aarts, Aarts Production, 2008). Marte Meo has been adopted and put into practice by a large and diverse network of trained and certified counsellors across the world. It was invented, developed and spread by a vanguard of practising counsellors who have adapted it to a variety of contexts. This is a classic example of research and theory emerging from and following practice; we first need to synthesise the lessons the practitioners and families have learned. We need to better understand how it is implemented; how it is viewed by its practitioners and recipients; and the extent to which variability in implementation may be an asset or a drawback in the continuing evolution of the programme, and in any eventual attempt to document its effects. Therefore, the present article aimed to address this important and hitherto unexplored research topic of the Marte Meo method in counselling and to describe the current state of use of Marte Meo. How is Marte Meo used and applied in a counselling and therapeutic context? Who uses Marte Meo in professional practice? Which function and which meaning does Marte Meo have in general practice and especially in counselling and therapy? What are typical concerns, goals or areas of application? We report on an ongoing mixed methods research project which began in 2015. This paper focuses on the research methods. We will explain why an integrated exploratory sequential design (Cresswell, 2017) is best suited to our purposes. The exploratory sequential design of the Marte Meo project has five phases: as the first phase, we conducted a systematic literature review, analysing the status of existing research. The staged qualitative research consisted of designing, conducting and analysing semi‐structured interviews with parents and Marte Meo counsellors (phase 2), and then using that analysis to inform the design, the conduct and the analysis of videotaped observations of everyday situations in day‐care centres to examine the process and effects of Marte Meo interaction elements on children (phase 3). Combining these qualitative analyses then became the basis for the development of an online questionnaire that could enable us to collect quantitative data on the current use of Marte Meo in practice by experts (phase 4). This builds into the fifth phase in the final interpretation. One of the key findings of the qualitative parts is that Marte Meo is perceived as advantageous. The experts reported more joy and success in their work. In particular, in the pedagogical context, the daily, resource‐oriented ‘Marte Meo view’, which was sharpened by the training, seems to be essential, as it enables an awareness of the needs of the interaction partners and the beneficial interaction elements. Moreover, for some interviewees the use of Marte Meo does not seem to be limited to professional practice, but is expressed in a general humanistic attitude towards interpersonal relationships of all kinds. The quantitative survey has confirmed and supplemented these results. On the other hand, we found that Marte Meo is most often used in addition to the systemic approach. A later article will focus more on the findings. This article will conclude with a discussion of the advantages and disadvantages of the research design—concerning this special research project and concerning counselling research in general.     

The role of self‐image as a predictor of psychotherapy outcome

The present study examined the relationship between self‐image and outcome in psychotherapy. Patients (n = 170) received treatment‐as‐usual at a university clinic, and met diagnostic criteria for mostly anxiety and depression related disorders. Self‐image was measured with the Structural Analysis of Social Behavior (SASB‐I) introject pre and post‐treatment. Using multiple regression analyses, higher levels of Self‐ignore and Self‐blame pre‐treatment predicted a poorer treatment outcome in terms of symptoms (SCL‐90‐R) and interpersonal problems (IIP‐64), respectively. Increase in Self‐love and decrease in Self‐blame (pre to post) predicted reduced symptoms at post‐treatment, whereas decrease in Self‐attack and Self‐control, as well as increase in Self‐affirm, predicted reduced interpersonal problems. The results suggest that self‐image improvement may be important in order to achieve a good outcome in psychotherapy.     

Client perspectives: The therapeutic challenge of domestic violence counselling – a pilot study

Aims: This qualitative pilot study explored the perceptions of four female domestic violence clients regarding counselling they had concluded in order to identify a preliminary client‐preferred domestic violence counselling approach. Method: Semi‐structured interviews asking about significant events during counselling were held. An adapted grounded theory and narrative methodology was used. Results from the analysis were reviewed with two of the participants. Participants were offered additional counselling support if required after the research interview. Results/Findings: Domestic violence clients found starting counselling particularly difficult after years of keeping the abuse to themselves. Participants actively withheld and managed information for several sessions and needed to know they had time to explore their experiences. The counsellor being consistent and non‐judgemental, and understanding domestic violence and its effects was helpful. Having a clear ending was appreciated by the participants. Discussion: The initial development of the therapeutic relationship benefited from active discussion of how domestic violence could affect behaviour and emotions. Good early therapeutic relationships showed elements of the three main psychological schools. Participants benefited from a pro‐active discussion of endings. A key limitation of this research is the small sample size. Implications for practice: The research suggests that counsellors would benefit from knowledge and skills from different psychological schools and specific training in domestic violence. Allowing flexibility on the number of sessions available to clients may be helpful. Conclusions: Further work is required to explore these preliminary findings. However, early indications suggest that domestic abuse clients may benefit from non‐time‐limited specialist counselling services.     

Mental health help‐seeking and refugee adolescents: Qualitative findings from a mixed‐methods investigation

There is general agreement in Australia and other Western resettlement countries that many refugee adolescents with social, behavioural, and mental health problems are not accessing mental health care. There is, however, a paucity of research on refugee adolescent mental health service utilisation and help‐seeking. Most research to date has centred on adolescents in the general population, and even then is still very limited. This paper presents the findings of 13 focus groups held with 85 refugee adolescents aged 13–17 years from Afghanistan, Bosnia, Iran, Iraq, Liberia, Serbia, and Sudan. The study was part of a wider investigation of mental health service utilisation by refugee parents of children aged 4–17 years, and by adolescents aged 13–17 years. With respect to adolescents, the focus group findings indicate that most are very reluctant to venture beyond their close friendship networks for help with their psychosocial problems due to a range of individual, cultural, and service‐related barriers. Implications for mental health policymakers, service planners, and service providers are discussed.     

Life space mapping: Preliminary results from the development of a new method for investigating counselling outcomes

Counselling outcomes are often measured in terms of standardised questionnaires. Though efficient for large numbers of participants, this method cannot capture the unique and subtle ‘shifts’ that clients often report when qualitative methods are utilised. Further, such questionnaires usually focus on the individual, missing the wider social implications of therapy. This paper presents the preliminary findings from a study that utilises the client's own perceptions of changes in their “Life Space” to establish the significance of their change process. These results are compared and contrasted with a standard outcome questionnaire and the participant's experiences of using the two methods are explored.     

One of the troubles with outcome measures: Lost in translation

This paper presents the concerns of a client diagnosed with autism spectrum disorder about completing outcome measures. He was asked to complete CORE‐10 each time he attended a therapy session with the first author. This paper takes an epistemological position of co‐production, and written in response to the client's concerns, but this is limited by the client's wish and capacity to be involved in the writing up of this article. Implications of his experiences are drawn out for both clients with this diagnosis and more generally for all clients. Recommendations are made to recognise the limitations of measures and how to use outcome measures with more validity.     

The impact of psychological distress and university counselling on academic outcomes: Analysis of a routine practice-based dataset

Whole university approaches to student mental health and well-being increasingly involve university counselling and mental health services (UCMHSs) as key stakeholders in higher education and the fulfilment of good academic outcomes. However, previous research using routine outcome measures has focussed on psychological distress only. Research is needed to demonstrate the value of university counselling on academic outcomes. This study aimed at profiling the psychological distress of a student sample according to the Clinical Outcomes in Routine Evaluation—Outcome Measure (CORE-OM); measuring the change in perceived impact of problems on academic outcomes, and measuring the perceived impact of counselling on academic outcomes. Students from two UK university counselling services completed the CORE-OM and the Counselling Impact on Academic Outcomes (CIAO) questionnaire as part of routine practice. After counselling, 67.4% (n = 323) of students with planned endings to counselling showed at least reliable improvement on the CORE-OM. Significant reductions in the perceived impact of problems on all academic outcomes were also found. On average, 83% (n = 398) of students found counselling helpful for academic outcomes to at least a limited extent. University counselling was found to reduce psychological distress and the impact of problems on academic outcomes. Psychometric examination of the CIAO tool is warranted to strengthen its use. The need for robust data across UCMHSs is demonstrated by both the strengths and limitations of this study.     

Using a cross‐contextual qualitative diary design to explore client experiences of psychotherapy

Qualitative research in counselling and psychotherapy has largely been based on interviews carried out with clients and therapists. However, other approaches to qualitative data collection are possible. The present paper uses a diary design to explore the connection between what goes on in therapy sessions, and client activities and experiences in other contexts. Clients and counsellors kept diaries about significant aspects of therapy sessions, while clients also kept diaries about new and different experiences in other contexts in their lives. Ethical and practical issues involved in the use of diaries are discussed, and the methods that were employed to analyse diary‐based data are described. The types of findings that the study generated are presented, along with discussion of their implications for research into client experiences of therapy.     

School‐based humanistic counselling for psychological distress in young people: A practice research network to address the attrition problem

Aims: School‐based humanistic counselling (SBHC) is a common psychological intervention for young people, particularly in the UK. However, studies have tended to suffer from high attrition rates, such that effects may have been over‐estimated. This paper describes a low budget ‘star topology’ practice research network (PRN) outcome evaluation of SBHC in a sample where attrition rates were minimised. Design: A practice‐based longitudinal study in a small PRN compared levels of psychological distress at first and last session from session‐by‐session data. Multilevel regression modelling was used to identify predictors of outcomes. Methods: Eight counsellors working across 11 schools agreed to use session‐by‐session self‐rating on the Young Person's CORE (YP‐CORE) yielding data from 256 young people aged 11 to 17. Predictors of outcomes were analysed using multilevel regression analysis. Results: Mean levels of distress on the YP‐CORE reduced from 18.29 (SD = 7.32) at baseline to 9.10 (SD = 6.19) at endpoint, giving a baseline to endpoint effect size of 1.26 (95% CI = 1.06–1.46). Lower levels of psychological distress at endpoint were associated with male clients, younger age groups, greater rates of attendance at counselling, and bereavement as a presenting problem. Conclusions: This ‘star topology’ PRN focused on a single study and demonstrated that such a system can provide relatively low cost, high quality data. The data showed that SBHC is associated with large reductions in psychological distress, and that this cannot be attributed to the high attrition rates of previous datasets.