Data Collection in a Flat World: The Strengths and Weaknesses of Mechanical Turk Samples

Mechanical Turk (MTurk), an online labor system run by Amazon.com, provides quick, easy, and inexpensive access to online research participants. As use of MTurk has grown, so have questions from behavioral researchers about its participants, reliability, and low compensation. In this article, we review recent research about MTurk and compare MTurk participants with community and student samples on a set of personality dimensions and classic decision‐making biases. Across two studies, we find many similarities between MTurk participants and traditional samples, but we also find important differences. For instance, MTurk participants are less likely to pay attention to experimental materials, reducing statistical power. They are more likely to use the Internet to find answers, even with no incentive for correct responses. MTurk participants have attitudes about money that are different from a community sample's attitudes but similar to students' attitudes. Finally, MTurk participants are less extraverted and have lower self‐esteem than other participants, presenting challenges for some research domains. Despite these differences, MTurk participants produce reliable results consistent with standard decision‐making biases: they are present biased, risk‐averse for gains, risk‐seeking for losses, show delay/expedite asymmetries, and show the certainty effect—with almost no significant differences in effect sizes from other samples. We conclude that MTurk offers a highly valuable opportunity for data collection and recommend that researchers using MTurk (1) include screening questions that gauge attention and language comprehension; (2) avoid questions with factual answers; and (3) consider how individual differences in financial and social domains may influence results. Copyright © 2012 John Wiley & Sons, Ltd.     

Rates of Subthreshold PTSD Among U.S. Military Veterans and Service Members: A Literature Review

The current study’s goal was to provide a comprehensive review of current subthreshold posttraumatic stress disorder (PTSD) rates among U.S. military veterans and service members. PubMed, PsycInfo, ProQuest, Web of Knowledge, Google Scholar, and any relevant articles’ reference lists identified studies of subthreshold PTSD in the U.S. military. Search terms included PTSD in combination with partial, subthreshold or sub-threshold, subsyndromal or sub-syndromal, subclinical or sub-clinical, and military or veteran. Sixteen articles met criteria for review. Current subthreshold PTSD rates ranged from 2.3% to 22.3%, with a weighted mean rate of 7.6%. Definitional variation within and across the “below threshold” terms produced some variability in rates reported. Few studies consistently reported on impairment and comorbidity in the subthreshold PTSD population. Variability of current subthreshold PTSD rates may be due to methodological issues such as sampling methods, sample sizes, and how below threshold PTSD was assessed and defined. Based on our findings, we provide a number of recommendations that can be used to inform future research of subthreshold PTSD among U.S. military veterans and service members. These recommendations include having a standardized term and definition, determining how to more properly assess subthreshold PTSD symptomatology, clarifying subthreshold PTSD diagnostic stability, and identifying appropriate sampling methods.     

An examination of premarital sexual behavior among college students in hong kong

Abstract

This study examined the determinants of Hong Kong Chinese college students' intentions to engage in premarital sexual behavior. Fishbein and Ajzen's (1975) theory of reasoned action (TOFA) and Ajzen's (1985) perceived behavioral control were used as the theoretical framework for our investigation. Two hundred and thirty eight students completed a questionnaire designed to measure constructs of the two theories. Results from the regression analysis: (a) support the applicability of TORA in predicting these students' intentions to engage in premarital sex; (b) suggest that while attitudes toward engaging in premarital sex were more important in predicting male students' intentions, subjective norms were more important for female students; (c) reveal that the additional prediction contributed by the behavioral control components was relatively weak. Other findings were basically consistent with premarital sex research conducted in Western societies. Given the fact that promoting abstinence is one way to stop the transmission of the AIDS virus, both the theoretical and applied implications of our results for health intervention are discussed.     

The job demand-control(-support) model and physical health outcomes: A review of the strain and buffer hypotheses

Abstract

This review of the Job Demand-Control (JDC) model and the expanded Job Demand-Control-Support (JDCS) model and employees' physical health, focuses on the two prevalent views on these models. According to their view on the models researchers study different hypotheses: (a) the (iso)strain hypothesis, stating that the highest level of ill health is expected when the job is characterized by high demand and low control (and low social sup port), ot (b) the buffer hypothesis, predicting that control (and social support) can buffer the potential negative effects of high demands on physical health. It is argued that these hypotheses reflect theoretical distinct models, and that the practical implications associated with these models differ.

The review of 51 studies on the JDC(S) model reveals that the “strain” hypothesis predominates in studies of all-cause mortality, cardiovascular disease (CVD) related and specific non-CVD related health outcomes. In contrast, the “buffer” hypothesis is most prevalent in research on self-reported (psycho)somatic complaints. For the strain hypothesis as well as the buffer hypothesis the results are equivocal. Working in a high (iso)strain job appears to be associated with an elevated risk for cardiovascular disease and negative pregnancy outcomes, and increased (psycho)somatic complaints. Conclusions on other physical outcomes seem premature, considering the limited number of studies. The buffer hypothesis is supported in the few studies on CVD endpoints and in some studies on (psycho)somatic complaints.

A comparison of the validity of the two hypotheses is problematic, because they are mostly applied to a different set of outcomes. Furthermore, the analyses employed in the testing of the two hypotheses are of a different nature (non-linear versus linear).

The main recommendation for future research is to examine the validity of the strain and the buffer hypothesis concurrently, and to further explore the nature of the relationships.     

Being and feeling liked by others: How social inclusion impacts health

This study examined the effects of perceived and actual social inclusion on health across and within individuals from a network perspective. During the first semester, 75 freshmen students provided bi-weekly ratings on their perceived social inclusion and health. To capture actual social inclusion, each student nominated liked and disliked fellow students. Perceived social inclusion mediated the effect of actual social inclusion on health. Specifically, students with more ‘likes’ perceived more social inclusion and those with higher perceived inclusion reported a better health status (between-person effect). In addition, at time points, when students received more ‘likes’ they also perceived more social inclusion. They reported better health at times when they felt more included (within-person effect). Thus, the perception of social inclusion is rooted in reality and actual social inclusion has an impact on health when passing the filter of perception.     

Psychological intervention with couples coping with breast cancer: A systematic review

Objective: Information about psychological intervention with couples coping with breast cancer is not well-disseminated. This can be explained, at least in part, by the absence of knowledge about the efficacy of this kind of intervention. The aim of the present systematic review is to identify and describe psychological interventions for couples coping with breast cancer and evaluate their efficacy.

Design: Studies identified by a searching multiple literature databases related to health and psychology between 1975 and 2013. Rigorous inclusion and exclusion criteria were utilised.

Results: Of 129 abstracts, 13 were extracted for further analysis and a final ten studies were deemed eligible for inclusion. Data were extracted from each study regarding study sample characteristics, design, results and methodological limitations. The results obtained were mixed in regard to efficacy, although the overwhelming majority of studies (eight studies) found benefits for both women and their partners in some dimensions, such as quality of life, psychological distress, relationship functioning and physical symptoms associated with cancer.

Conclusion: Psychological interventions for couples coping with breast cancer appear to be effective for both women and their partners. However, further studies are needed to evaluate the efficacy of couple-based interventions and, to identify for whom and how they are more effective.     

A survey of smoking status and cancer risk perceptions among participants attending a hospital-based head and neck screening program

Abstract

Screening for head and neck cancer is underutilized. Given that lack of knowledge of the risk factors may partially account for screening underutilization. we surveyed subjective risk and knowledge of risk factors for head and neck cancer among 124 individuals who attended a free. hospital-based head and neck cancer screening. Few participants were current smokers. Most attendees perceived their risk as similar to others of their age and sex. Personal health habits comprised almost all of the risk-decreasing factors, yet less than half of the risk-increasing factors. generated. Personal habits were less frequently endorsed than factors such as pollution and heredity. Those who mentioned a risk behavior, or a family cancer history, reported higher subjective risk. Those who mentioned a personal health habit reported lower subjective risk. Results highlight needed efforts to increase screening among high-risk individuals through targeted education messages.     

Impact of genetic testing on causal models of heart disease and arthritis: An analogue study

Abstract

An analogue study investigated the impact of genetic testing on perceptions of disease. Using a 2 × 2 design, participants (n = 212) imagined receiving the information that they were at increased risk for either heart disease or arthritis. The type of risk information was either genetic or unspecified. Presentation of genetic risk information resulted in the condition being perceived as less preventable. Causal models of disease where investigated using principal components analysis. When hem disease was the stimulus condition, attributions to genes and chance were positively associated following unspecified risk information, and negatively associated following genetic risk information. When arthritis was the stimulus condition, presentation of genetic risk information was associated with attributions to genes becoming separated from the other attributions. One explanation for this is that providing genetic risk information may decrease perceptions of a sense of randomness or uncertainty in disease causation. The extent to which these effects occur in clinical populations. and their behavioural consequences. needs to be established.     

Behavior Rating Inventory of Executive Function – Preschool Version (BRIEF-P): Test Review and Clinical Guidelines for Use

The Behavior Rating Inventory of Executive Function-Preschool Version (BRIEF-P) is a standardized questionnaire that measures executive functioning in preschoolers. This test review provides an overview of the BRIEF-P, including scale structure, administration, norms, score interpretation, current reliability and validity evidence, and provides general guidelines for clinical use.     

A comparison of two online cognitive‐behavioural interventions for symptoms of depression in a student population: The role of therapist responsiveness

Objectives: The study aimed to compare the efficacy of eight weekly sessions of a self‐administered online CBT treatment (cCBT; n=51) to a therapist‐assisted email CBT treatment (eCBT; n=50) in University students. Design: The design was a randomised parallel group trial. The study randomised participants with symptoms of depression to one of two available treatments. Method: Participants were offered eight weekly sessions of either cCBT or eCBT. Participants completed the Beck Depression Inventory‐II (BDI‐II) and the Clinical Outcomes in Routine Evaluation – Outcome Measure (CORE‐OM) at pre‐and post‐treatment, at weeks 16 and 32 follow‐up. The Working Alliance Inventory‐Short Form (WAI‐SR) was completed at weeks 2, 4, and 6. Results: For both groups, pre‐post within group effect sizes reported were large for the BDI‐II and the CORE‐OM and these were maintained at follow‐up. Perceptions of working alliance were similar in each group, but Bond was significantly stronger for the eCBT condition. WAI scores correlated more positively with the outcome on BDI‐II for those in the eCBT condition than the cCBT condition, but not significantly. Conclusion: There were no significant differences between the two online treatments, both reduced depressive symptoms and improved general functioning. Similarly, at post‐treatment and follow‐up, clinical improvement and recovery was demonstrated for both groups equally. The study demonstrates the possibility for cCBT in a university setting that may contribute to addressing the shortcomings in meeting increasing demands that mental health services presently face.