Data Collection in a Flat World: The Strengths and Weaknesses of Mechanical Turk Samples

Mechanical Turk (MTurk), an online labor system run by Amazon.com, provides quick, easy, and inexpensive access to online research participants. As use of MTurk has grown, so have questions from behavioral researchers about its participants, reliability, and low compensation. In this article, we review recent research about MTurk and compare MTurk participants with community and student samples on a set of personality dimensions and classic decision‐making biases. Across two studies, we find many similarities between MTurk participants and traditional samples, but we also find important differences. For instance, MTurk participants are less likely to pay attention to experimental materials, reducing statistical power. They are more likely to use the Internet to find answers, even with no incentive for correct responses. MTurk participants have attitudes about money that are different from a community sample's attitudes but similar to students' attitudes. Finally, MTurk participants are less extraverted and have lower self‐esteem than other participants, presenting challenges for some research domains. Despite these differences, MTurk participants produce reliable results consistent with standard decision‐making biases: they are present biased, risk‐averse for gains, risk‐seeking for losses, show delay/expedite asymmetries, and show the certainty effect—with almost no significant differences in effect sizes from other samples. We conclude that MTurk offers a highly valuable opportunity for data collection and recommend that researchers using MTurk (1) include screening questions that gauge attention and language comprehension; (2) avoid questions with factual answers; and (3) consider how individual differences in financial and social domains may influence results. Copyright © 2012 John Wiley & Sons, Ltd.     

Frustration and disappointment

The paper describes research on children’s responses to failures of gratification. Although this has always been an important area of consideration in psychoanalytic thinking, arguments are put forward for the child’s actual feelings of disappointment being significant in ways that have yet to be fully realised theoretically and clinically within Kleinian object relations. Since Freud first used the term ‘frustration’, it has been applied in psychoanalysis as a means by which to describe in an undifferentiated way all those responses to failures of gratification that have an aggressive content. It will be argued that, in a context of the historical shift in thinking from drive to relational models, there is now perhaps scope to posit the existence instead of two discrete object relational positions towards such failures of aim – that frustrated responses can be differentiated in important structural and developmental ways from disappointed ones, by suggesting that the former are schizoid, whilst the latter are depressive in quality. To try and begin to test the hypothesis that there might be an object relational distinction between feelings of frustration and feelings of disappointment, selected process notes from two training cases became the subject of a combined piece of clinical and theoretical research. I will outline how this research was undertaken and present the findings that arose from the clinical part of it. With the use of a content analysis, a method for gathering interesting quantitative data about the children’s various responses to the failures of gratification was arrived at.     

‘And when you were a child?’: how therapists working with parents alongside individual child psychotherapy bring the past into their work

When a child is offered psychotherapy, it is common that regular meetings will be offered to the parents. However, there are debates in the literature about the degree to which such parent work should include a focus on the parents’ own childhood experiences. This study aimed to examine the way that those offering parent work as part of a study evaluating the treatment of adolescent depression dealt with this issue in their work with parents, both in the study and in routine clinical practice. Design: five therapists were interviewed on the subject of working with parents’ childhood experiences within parent work parallel to child psychotherapy. Data were analysed qualitatively, using Interpretative Phenomenological Analysis. Findings: participants described the need to consider the different parameters of this work to individual adult therapy; in addition, participants felt that it was necessary to negotiate permission to work on the parents’ childhood experiences. They also spoke of making use of insight into the repetition of the parents’ history, the analysis of parental projections and offering containment within the relationship; this varies from the ‘transference work’ of individual therapy and a different style of interpretation was described. Conclusions: there is a need to give more attention to the neglected field of working with parents alongside individual child psychotherapy, especially at a time when such work is under threat within many public services. There are particular technical issues related to work with parents’ own childhood histories that are different to how one might work in individual therapy with a parent.     

Digital Animation as a Method to Disseminate Research Findings to the Community Using a Community-Based Participatory Approach

Community-based participatory research (CBPR) has garnered increasing interest over the previous two decades as researchers have tackled increasingly complex health problems. In academia, professional presentations and articles are major ways that research is disseminated. However, dissemination of research findings to the people and communities who participated in the research is many times forgotten. In addition, little scholarly literature is focused on creative dissemination of research findings to the community using CBPR methods. We seek to fill this gap in the literature by providing an exemplar of research dissemination and partnership strategies that were used to complete this project. In this paper, we present a novel approach to the dissemination of research findings to our targeted communities through digital animation. We also provide the foundational thinking and specific steps that were taken to select this specific dissemination product development and distribution strategy.     

To be in touch

This study examined the constellation of interaction structures – repetitive patterns of interactions between patient and therapist over the course of treatment – that emerged in the psychodynamic therapy (PDT) of a child diagnosed with borderline personality disorder and treated by two doctoral student therapists. Identification of these interaction structures can inform therapists of what might be expected from patients with particular symptom or behaviour patterns and how interactions change over time. This study also examined each session’s adherence to three session prototypes: PDT, cognitive-behavioural therapy (CBT) and reflective functioning (RF) process. The Child Psychotherapy Q-Set (CPQ) is a 100-item instrument that assesses the processes within a single psychotherapy session. Items reflect a wide range of therapist attitudes and behaviours, patient attitudes and behaviours and interactions between therapist and patient. Experts used the CPQ to define PDT, CBT and RF process session prototypes. The results suggested that four distinct interaction structures could be identified and that their constellations differed between the two therapists and also differed over time within each treatment. Therapists were more structured and accommodating early on in their treatments and more interpretive later. Prototypical PDT process was more prominent in the sessions than RF process, which in turn was more prominent than CBT process. Unique therapeutic processes are at work in every dyad, despite holding the patient and theoretical orientation constant. An effective treatment in one dyad might not work in another due to therapist-specific and dyad-specific effects.     

Creating a ‘psychological nest’ for vulnerable infants and children: an interview with Annette Mendelsohn

This is an edited version of a recent interview with Annette Mendelsohn, Child and Adolescent Psychotherapist at the Royal Free Hospital, London, UK. It aims to make available in published form Mendelsohn's thinking and approach in relation to her work with traumatised children in a hospital setting. Mendelsohn also discusses her work in a neonatal intensive care setting and the way in which approaches to psychosocial care in the hospital setting have changed over the course of her professional life.     

“Bounded” Empowerment: Analyzing Tensions in the Practice of Youth-Led Participatory Research in Urban Public Schools

This multi-method study examines tensions in the practice of youth-led participatory research (YPAR) in urban high schools among 15 semester-cohorts. Student participants in the present study were 77 ethnically diverse youth from four high schools in a major metropolitan school district. Data were gathered using systematic classroom observations, interviews with teachers and students involved in the projects, and participant observation. The two most commonly-constrained phases of the YPAR project were issue selection and action steps. A central tension in the issue selection phase for projects enacted across multiple semester cohorts was the tension between original inquiry and “traction:” Sticking with the same topic enabled sustained building of strategic alliances and expertise for making change, but limited the incoming cohort’s power to define the problem to be addressed. In further analyses, we identified processes that promoted student power despite continuity-related constraints—teachers’ framing and buy-in strategies, “micro-power” compensation, and alignment of students’ interests with the prior cohort—as well as constraints in other phases of the projects. This study’s findings regarding the promotion of youth power in the face of constraints advance the integration of theory and practice in youth-led research and have implications for participatory research more broadly.     

Illness perceptions and distress in women at increased risk of breast cancer

Variation in the levels of distress in women at increased risk of breast cancer has been reported, yet there is limited understanding of the factors that are associated with heightened distress in this population. This study took a theoretical approach using Leventhal's Self Regulatory Model (SRM) to understand variation in distress levels. The study examined the associations between perceptions of breast cancer and distress in women at increased risk of breast cancer, and a comparison sample with no experience of the disease in their social environment. Questionnaire data from 117 women at increased risk of breast cancer and 100 comparison women were analysed. Women at increased risk of breast cancer showed comparable levels of general distress but significantly higher levels of cancer specific distress than the comparison group. There were few differences in illness perceptions between the samples, although a number of cognitive perceptions of breast cancer were related to both general and cancer specific distress in the increased risk sample, but not in the comparison sample. The results suggest that the SRM provides a useful framework to explore the psychological response to genetic risk. Further research is required in this population to examine illness perceptions in more detail, validate quantitative measures of illness perceptions, and examine interactions between risk perception and the SRM constructs.     

Enhancing recovery rates: Lessons from year one of IAPT

BackgroundThe English Improving Access to Psychological Therapies (IAPT) initiative aims to make evidence-based psychological therapies for depression and anxiety disorder more widely available in the National Health Service (NHS). 32 IAPT services based on a stepped care model were established in the first year of the programme. We report on the reliable recovery rates achieved by patients treated in the services and identify predictors of recovery at patient level, service level, and as a function of compliance with National Institute of Health and Care Excellence (NICE) Treatment Guidelines.MethodData from 19,395 patients who were clinical cases at intake, attended at least two sessions, had at least two outcomes scores and had completed their treatment during the period were analysed. Outcome was assessed with the patient health questionnaire depression scale (PHQ-9) and the anxiety scale (GAD-7).ResultsData completeness was high for a routine cohort study. Over 91% of treated patients had paired (pre-post) outcome scores. Overall, 40.3% of patients were reliably recovered at post-treatment, 63.7% showed reliable improvement and 6.6% showed reliable deterioration. Most patients received treatments that were recommended by NICE. When a treatment not recommended by NICE was provided, recovery rates were reduced. Service characteristics that predicted higher reliable recovery rates were: high average number of therapy sessions; higher step-up rates among individuals who started with low intensity treatment; larger services; and a larger proportion of experienced staff.ConclusionsCompliance with the IAPT clinical model is associated with enhanced rates of reliable recovery.     

Development and Initial Validation of a General Psychological Well-being Scale (GPWS) in an African Context

This study aimed to develop and validate the General Psychological Well-being Scale (GPWS) in an African sample, based on the empirical overlap between hedonic and eudaimonic facets of well-being as found in previous research. The quantitative cross-sectional study was conducted in three phases: secondary data analysis (n = 2005), pilot study (n = 296) and main study (n = 459). The pilot and main study included the GPWS as well as other psychological well-being measures for criterion-related validity. The pilot study yielded satisfactory psychometric properties. The main study yielded a high, reliable Cronbach alpha of.89 and evidence of construct validity. The GPWS appears to be a unidimensional scale suitable for research use with Setswana-speaking people.