The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT)

The cognitive reflection test (CRT) is a short measure of a person's ability to resist intuitive response tendencies and to produce a normatively correct response, which is based on effortful reasoning. Although the CRT is a very popular measure, its psychometric properties have not been extensively investigated. A major limitation of the CRT is the difficulty of the items, which can lead to floor effects in populations other than highly educated adults. The present study aimed at investigating the psychometric properties of the CRT applying item response theory analyses (a two‐parameter logistic model) and at developing a new version of the scale (the CRT‐long), which is appropriate for participants with both lower and higher levels of cognitive reflection. The results demonstrated the good psychometric properties of the original, as well as the new scale. The validity of the new scale was also assessed by measuring correlations with various indicators of intelligence, numeracy, reasoning and decision‐making skills, and thinking dispositions. Moreover, we present evidence for the suitability of the new scale to be used with developmental samples. Finally, by comparing the performance of adolescents and young adults on the CRT and CRT‐long, we report the first investigation into the development of cognitive reflection. Copyright © 2015 John Wiley & Sons, Ltd.     

Families Leaving Family Therapy After One or Two Sessions: A Multiple Descriptive Case Study

A multiple case study design was used to discover something of the experiences of families, therapists, and members of the reflecting team of the first and or second session of family therapy in an attempt to answer questions regarding why families drop out after only one or two sessions. It was found that the families attending these sessions found them to be ineffective in assisting them to re-author the stories of their lives. There many reasons for this being the case.     

Reviews

Rottschaefer, William A. The Biology and Psychology of Moral Agency
Mccutcheon, Russell T. Manufacturing Religion: The Discourse on Sui Generis Religion and the Politics of Nostalgia
Drengson, Alan The Practice of Technology: Exploring Technology,Ecophilosophy, and Spiritual Disciplines for Vital Links
Burrell, David B. and Mcginn, Bernard (eds.) God and Creation: An Ecumenical Symposium     

Inside it was orange squash concentrate: trainees’ experiences of reflective practice groups within clinical psychology training

Despite many clinical psychology training programmes utilising reflective practice groups (RPGs) to develop reflective practice (RP) skills, there remains little research examining how trainees experience these groups. This study uses interpretative phenomenological analysis (IPA) to explore the experiences of eight qualified clinical psychologists who attended RPGs on one United Kingdom (UK) clinical psychology training programme. A purposive sample was recruited for single, semi-structured interviews. Five superordinate themes were identified: ‘The process: there were so many layers’; ‘The impact: an ongoing process’; ‘Commitment: I hated it, but I still went’; ‘The facilitator: a presence who was not always present’; and ‘Getting through it: finding ways to cope’. The findings illustrate the varied and complex experiences of the participants. Whilst the experience was often difficult, the participants were committed to attending and sought out ways to navigate it. The results are conceptualised in terms of existing psychological theory and literature. A critique of the research and suggestions for future studies are offered, including exploring the views of group facilitators and comparing how groups are utilised within different training programmes. Recommendations are made on the development of future RPGs, which include consideration of the facilitation style and the groups’ frequency and size.     

Transactions in doing design-based research for designing curriculum: a self-study

Design-based research (DBR) is an emerging methodology in teacher education research that researchers claim has strong potential in systematically designing and using instructional strategies and tools to develop, enact, and sustain effective learning environments. Studies have been conducted employing this methodology, but very little research has been made on the process of engaging in DBR for designing curriculum. Through a self-study, I found that using DBR as a model for creating curriculum draws from personal meaning-making, where I tapped on my own education, background, and experiences in literacy instruction to create curriculum. The other dimensions to the DBR process were more intangible and thus harder to negotiate. These included the political aspects, where decision-making was needed regarding course components. Keeping positive relationships with stakeholders was another challenging dimension in order to achieve a collectively meaningful curriculum. Finally, dispositions on literacy instruction also implied tension on the process since dispositions are not necessarily aligned with some DBR principles.     

The ‘thinking aloud’ process: a way forward in social work supervision

Within current neoliberal discourses, critical reflection provides opportunity for innovation in social work practice. This article describes a thinking aloud process used with supervisor–supervisee dyads in community-based child welfare social work to assist critical reflection via the use of open-ended questioning and inquiry. The strength of thinking aloud permitted a deeper appreciation of how the supervision session is utilised to reflect on practice and provided a learning tool within supervision. The feedback from the dyads concurred that thinking aloud assisted in stimulating reflection, developing solutions to the key issues discussed, and was transformative in recognising areas for future development. The process of thinking aloud supports the opportunity and space for the supervisor and supervisee to articulate meaning, critically develop insight, reconstruct, and transport this into future practice. Thinking aloud offers an example of how knowledge can be co-constructed by practitioners within practice and critical reflection captured within qualitative research approaches.     

Exploring the depths of the rainforest: a metaphor for teaching critical reflection

Many social welfare and social work students struggle to demonstrate competence in the complex process of critical reflection through to the stage of transformed thinking and action. Examples of how students learn critical reflection as an interpretive experience are scarce. This paper presents, as a case study, the process one of the authors experienced while critically reflecting on teaching critical reflection. The paper explores how this approach unlocked disturbing insights into how personally held values, views and knowledge influenced her performance relating to teaching critical reflection. Experiencing what she asks of her students raised questions regarding the duty of care that social welfare and social work educators have to ensure their students engage in critical, and transformative, self-discovery in safe and supportive ways. We propose that in the early stages of social welfare and social work degrees, rather than assessing students’ critical reflection of an event, educators examine students’ capacity to learn critical reflection in a different way. Drawing on critical hermeneutics, and a theory of visual thinking, the paper outlines the cognitive map of a process of critical reflection on teaching critical reflection. We present this as a metaphor of walking through a rainforest.     

Validation of a reflective thinking instrument for third-year undergraduate nursing students participating in high-fidelity simulation

Background: nursing students are required to think reflectively in both real and simulated clinical practice. Although the Reflective Thinking instrument is reliable in its measurement of reflective thinking, its validity is unknown. Method: confirmatory factor analysis was undertaken in an iterative manner within a non-equivalent control-group study to measure nursing students’ reflective thinking and satisfaction with high-fidelity simulation. The validity and reliability of the Reflective Thinking instrument was tested. Results: the resulting instrument consisted of 15 items across four factors. The final model was plausible as it demonstrated ‘goodness of fit’; however, it had neither convergent or discriminatory validity, nor reliability. Internal consistency was fair to reasonable for the four subscales. Conclusion: the testing of the Reflective Thinking instrument using confirmatory factor analysis is a vital initial step in the modification of this instrument. Further development using exploratory factor analysis will enhance the instrument’s relevance within high-fidelity simulation.     

Using video-supported reflection in peer groups to increase instructional effectiveness

This article reports upon the findings of research that explored change in teachers’ reflective thought and practice on a core set of complex teaching practices after the teachers participated in video-supported reflection model. Five 4th–7th grade teachers participated in the model that paired video-supported collaborative reflection with a research-based observation instrument, Classroom Assessment Scoring System (CLASS). Classroom observation data was collected by video and scored to determine change in teaching practice. All video-supported collaborative dialogue sessions between peers were videotaped and transcribed. Findings point to the developmental process necessary when learning to critically reflect upon and enact complex instructional practices that are not already prominent in practice. Individual development of practice progressed as the collaborative dialogue group expanded their capacity for describing, understanding, and evaluating practice based upon a new schema of effective practice, intentionally enacting change resulting in significant increases in teacher performance.     

Portraying reflection: the contents of student teachers’ reflection on personal practical theories and practicum experience*

This research focused on personal practical theories of Finnish student teachers, on how they argued for them and what they contained, and the data were analysed using Korthagen’s ‘onion’ model of reflection (e.g. 2004). The framework of this research consists of reflection and personal practical theories (PPTs). Personal practical theories are viewed as important for a teacher’s identity: they guide the teacher’s work, action, and reactions before, during, and after a teaching event. Reflecting on teaching, then again, has been one of the most significant issues and focus of numerous studies for several decades. This is a case study of six elementary school student teachers, who had constructed their PPTs before the practicum. We examined their reflections using the onion model of reflection, according to which a person reflects on different levels. The data were collected by interviewing the student teachers after their final practicum. The results show that most of their reflection focused on Environment and Behaviour, so it was located mostly in the outer layers of the onion model. The categorization of the reflection also showed that Competence was the smallest category.