Enhancing the Validity of Self-Reported Alcohol and Marijuana Consumption Using a Bogus Pipeline Procedure: A Meta-Analytic Review

Two separate meta-analyses were conducted to test whether the use of self-report measures within the bogus pipeline (BPL) paradigm yields more valid responses than the use of self-report measures alone for assessing alcohol and marijuana consumption. Weighted mean effect sizes (ds) of 0.01 and -0.12 were obtained for studies using alcohol and marijuana self-reports, respectively. Chi-square tests based on Ns of 1,892 for the alcohol sample and 1,425 for the marijuana sample indicated homogeneity of effect sizes for both databases. Explanations for why a BPL procedure does not improve the validity of self-reported alcohol and marijuana consumption are provided. In addition, alternative methods that may enhance the validity of alcohol and marijuana self-reports are discussed.     

Examining Social Desirability in Measures of Religion and Spirituality Using the Bogus Pipeline

A primary concern in the psychology of religion is the distinct possibility that responses to empirical assessments of individuals’ degree and type of religiosity and spirituality are exaggerated owing to social desirability bias. In spite of increased secularization in American culture and a growing distrust of organized religion, religious involvement, personal religiosity, and spirituality are still viewed as highly desirable characteristics. This study estimates the extent of social desirability biases that affect self-reports of religion and spirituality by utilizing a bogus pipeline procedure. In this procedure, participants are convinced that experimenters can detect disingenuous responses to individual items on questionnaires through the use of physiological measures, although no physiological data are actually collected. If the self-reports of participants in the bogus pipeline condition indicate greater religiosity or spirituality than those in the control condition, self-report bias is indicated. The bogus pipeline procedure has been used in other areas of study to increase veracity of self-reports when social desirability effects are present (such as reporting sexual behaviors or prejudice). The results indicate that social desirability biases influence multiple constructs including religious orientations, religious coping, and daily spiritual experiences. Implications for future research relying on self-reports of religion and spirituality are discussed.     

Ethical Considerations in Social Psychological Research: Is the Bogus Pipeline a Special Case?

The ethics of using deception in research are discussed, and Aguinis and Handelsman's (1997) arguments that research using the bogus pipeline (BPL), in particular, is unethical are reviewed and critiqued. Stances that view any deception research as unethical may be reasonable, and lead to the conclusion that BPL research is unethical. However, if the position taken is that deception research may be ethically acceptable, then there is no basis for concluding that BPL research is intrinsically unethical. The same considerations that are taken into account when deciding whether any deception in research is ethical apply to decisions about the ethical appropriateness of using the BPL.     

Associations Among Smoking,Anhedonia, and Reward Learning in Depression

Depression and cigarette smoking co-occur at high rates. However, the etiological mechanisms that contribute to this relationship remain unclear. Anhedonia and associated impairments in reward learning are key features of depression, which also have been linked to the onset and maintenance of cigarette smoking. However, few studies have investigated differences in anhedonia and reward learning among depressed smokers and depressed nonsmokers. The goal of this study was to examine putative differences in anhedonia and reward learning in depressed smokers (n = 36) and depressed nonsmokers (n = 44). To this end, participants completed self-report measures of anhedonia and behavioral activation (BAS reward responsiveness scores) and as well as a probabilistic reward task rooted in signal detection theory, which measures reward learning (Pizzagalli, Jahn, & O'Shea, 2005). When considering self-report measures, depressed smokers reported higher trait anhedonia and reduced BAS reward responsiveness scores compared to depressed nonsmokers. In contrast to self-report measures, nicotine-satiated depressed smokers demonstrated greater acquisition of reward-based learning compared to depressed nonsmokers as indexed by the probabilistic reward task. Findings may point to a potential mechanism underlying the frequent co-occurrence of smoking and depression. These results highlight the importance of continued investigation of the role of anhedonia and reward system functioning in the co-occurrence of depression and nicotine abuse. Results also may support the use of treatments targeting reward learning (e.g., behavioral activation) to enhance smoking cessation among individuals with depression.     

The unique ethical challenges of the bogus pipeline methodology: let the data speak

Sigall (1997) asserted that the bogus pipeline (BPL) methodology is not a uniquely deceptive technique and, therefore, does not pose unique ethical challenges for social psychology researchers. We argue that empirical research is needed to clarify the controversial issue of the ethics of using the BPL. Results of such a research program will provide guidance for researchers as well as institutional review boards regarding conditions under which the use of the BPL may or may not be ethically justified.     

Ethical issues in the use of the bogus pipeline

This article addresses the ethics of utilizing the bogus pipeline (BPL) procedure in social psychological research. A debate is presented between 2 positions: One challenges the use of the BPL based on ethical principles, and the other confronts these challenges. The debate addresses the void in previous BPL literature regarding concerns about the ethics of using this technique, and raises awareness about potential ethical dilemmas faced by BPL users. The BPL is discussed from utilitarian and deontological ethical perspectives.     

Limited evidence of individual differences in holistic processing in different versions of the part-whole paradigm

The part-whole paradigm was one of the first measures of holistic processing and it has been used to address several topics in face recognition, including its development, other-race effects, and more recently, whether holistic processing is correlated with face recognition ability. However the task was not designed to measure individual differences and it has produced measurements with low reliability. We created a new holistic processing test designed to measure individual differences based on the part-whole paradigm, the Vanderbilt Part Whole Test (VPWT). Measurements in the part and whole conditions were reliable, but, surprisingly, there was no evidence for reliable individual differences in the part-whole index (how well a person can take advantage of a face part presented within a whole face context compared to the part presented without a whole face) because part and whole conditions were strongly correlated. The same result was obtained in a version of the original part-whole task that was modified to increase its reliability. Controlling for object recognition ability, we found that variance in the whole condition does not predict any additional variance in face recognition over what is already predicted by performance in the part condition.     

Self-esteem differences in the effects of hypocrisy induction on behavioral intentions in the health domain

Two studies investigated whether individuals with varying levels of self-esteem respond differently in the hypocrisy paradigm. In the first study, all participants were regular smokers. Those in the hypocrisy condition delivered a speech in front of a camera on the dangers of smoking. The principal dependent measure was the intention to stop smoking. In the second study, participants in the hypocrisy condition wrote a public (personally identifiable) passage about the importance of a healthy lifestyle. The principal dependent measure was the intention to improve one's health behaviors. In both studies, self-esteem scores were positively related to intentions to change behavior in the hypocrisy condition but not in a control condition. The implications of these findings for conceptions of self-esteem and for dissonance theory are discussed.     

Apples and oranges? Comparing indirect measures of alcohol-related cognition predicting alcohol use in at-risk adolescents.

Recently, there has been increased interest in the role of implicit cognitive processes in the development of addictive behaviors. In this study, the authors compared 3 indirect measures of alcohol-related cognitions in the prospective prediction of alcohol use in at-risk adolescents. Implicit alcohol-related cognitions were assessed in 88 Dutch at-risk adolescents ranging in age from 14 to 20 years (51 males, 37 females) by means of varieties of word association tasks, Implicit Association Tests, and Extrinsic Affective Simon Tasks adapted for alcohol use. Alcohol use and alcohol-related problems were measured with self-report questionnaires at baseline and after 1 month. Results showed that the indirect measures predicted unique variance in prospective alcohol use after controlling for the direct measure of alcohol-related cognitions and background variables. The results indicate that the word association tasks were the best indirect measure of alcohol-related cognitions. These indirect measures appear to assess cognitive motivational processes that affect behavior in ways not reflected by direct measures of alcohol-related cognitions.     

Self-report of ADHD symptoms in college students and repetition effects

The research in this article focuses on the relation between self-report of attention deficit disorder (ADD) symptoms and performance on a two-alternative forced-choice task that measures repetition effects. The ADD/Hyperactive Adolescent Self-Report Scale--Short Form is administered to college students after they completed the repetition effects task. Performance to familiar and novel stimuli can be measured using this paradigm. The results indicate that participants in the good and poor attention groups do not differ in their responses to repeated stimuli. However, participants who self-report poor attention are faster to respond to novel stimuli compared with participants who self-report good attention. This brief questionnaire appears to capture individual differences in attention and may be useful in attention research.     

Measurement issues associated with conditional reasoning tests: An examination of faking

Conditional reasoning (CR) is a new item format that measures personality by indirectly assessing reliance upon the cognitive biases associated with specific traits (James et al., 2005). Previous research suggests that, relative to self-report measures, responses on CR-based measures are more difficult to distort (LeBreton, Barksdale, Robin, & James, 2007). The issue of response distortion in the context of CR-based measures was evaluated in two studies. Study 1 (within-subjects) and Study 2 (between-subjects) both investigated whether responses on a CR-based test of addiction could be faked when indirect assessment was upheld. Results of both studies indicated that, unlike a self-report measure of a similar construct, the CR-based measure was unaffected by response distortion.     

Self-Report,Peer-Report,and Teacher-Report Measures of Childhood Depression: An Analysis by Item

We explored the low correlation among different types of childhood depression measures at the item level. The items from the Children's Depression Inventory (CDI), Peer Nomination Inventory of Depression (PNID), and the Child Behavior Checklist-Teacher Report Form (CBCL-T) were combined, and both first- and second-order factor analyses were conducted. Results indicate that self-report, peer-report, and teacher-report assessments of depression measure generally uncorrelated constructs. Second-order analysis suggests that depression as a global construct is being measured to some degree by items from all three instruments. Canonical analysis was employed to identify items that best predicted CDI, PNID, and CBL-T summary scores simultaneously. Also, the relationship between specific items with similar content was investigated. Results from these analyses generally supported a conclusion that the three types of measures yield scores that are primarily independent and that the use of summary scores is not masking stronger relationships within measures. These findings have implications for clinical practice and construct elaboration.     

Self-report, peer-report, and teacher-report measures of childhood depression: an analysis by item.

We explored the low correlation among different types of childhood depression measures at the item level. The items from the Children's Depression Inventory (CDI), Peer Nomination Inventory of Depression (PNID), and the Child Behavior Checklist-Teacher Report Form (CBCL-T) were combined, and both first- and second-order factor analyses were conducted. Results indicate that self-report, peer-report, and teacher-report assessments of depression measure generally uncorrelated constructs. Second-order analysis suggests that depression as a global construct is being measured to some degree by items from all three instruments. Canonical analysis was employed to identify items that best predicted CDI, PNID, and CBL-T summary scores simultaneously. Also, the relationship between specific items with similar content was investigated. Results from these analyses generally supported a conclusion that the three types of measures yield scores that are primarily independent and that the use of summary scores is not masking stronger relationships within measures. These findings have implications for clinical practice and construct elaboration.     

The assessment of adolescent self-esteem: A comparison of methods1

The present series of studies explores the relationship between two conceptions of self-esteem: the self as experienced by the individual and the self as presented to others. Traditional measures of self-esteem are employed, and two new methods of assessing self-esteem in adolescents are introduced: an observational measure of self-esteem behavior (presented self) and a repeated self-report measure (experienced self). The presented self (observed behavior and peer ratings) and the experienced self (Rosenberg, Lerner, and a new method, paging devices) measures were consistent within themselves in assessing self-esteem. The presented self and the experienced self were not, however, significantly related to each other. We propose a moderator variable (“defensiveness”) to explain these discrepancies, and suggest that the observation of adolescent behavior provides a more accurate assessment of self-esteem than self-report measures.     

The assessment of emotional clarity via response times to emotion items: shedding light on the response process and its relation to emotion regulation strategies

Researchers have begun to use response times (RTs) to emotion items as an indirect measure of emotional clarity. Our first aim was to scrutinise the properties of this RT measure in more detail than previously. To be able to provide recommendations as to whether (and how) emotional intensity – as a possible confound – should be controlled for, we investigated the specific form of the relation between emotional intensity and RTs to emotion items. In particular, we assumed an inverted U-shaped relation at the item level. Moreover, we analysed the RT measure’s convergent validity with respect to individuals’ confidence in their emotion ratings. As a second aim, we compared the predictive validity of emotional clarity measures (RT measure, self-report) with respect to daily emotion regulation. The results of three experience sampling studies showed that the association between emotional intensity and RT followed an inverted U shape. RT was in part related to confidence. Emotional clarity measures were unrelated to reappraisal. There was some evidence that lower emotional clarity was related to a greater use of suppression. The findings highlight that emotional intensity and squared emotional intensity should be controlled for when using the RT measure of emotional clarity in future research.     

Evaluation of a behavioral measure of risk taking: the Balloon Analogue Risk Task (BART)

The present study (N = 86) sought to evaluate a laboratory-based behavioral measure of risk taking (the Balloon Analogue Risk Task; BART) and to test associations between this measure and self-report measures of risk-related constructs as well as self-reported real-world risk behaviors. The BART evidenced sound experimental properties, and riskiness on the BART was correlated with scores on measures of sensation seeking, impulsivity, and deficiencies in behavioral constraint. Also, riskiness on the BART was correlated with the self-reported occurrence of addictive, health, and safety risk behaviors, with the task accounting for variance in these behaviors beyond that accounted for by demographics and self-report measures of risk-related constructs. These results indicate that the BART may be a useful tool in the assessment of risk taking.     

Priming honesty reduces subjective bias in self-report measures of mind wandering

Using self-report as a measure of conscious experience has been a point of contention in mind wandering research. Whereas prior work has focused on the introspective component of self-report validity, the current research introduces an honesty prime task to the current paradigm in order to assess the role of goal states and social factors on self-report accuracy. Findings provide evidence for an inflated report of mind wandering frequency arising from demand characteristics, intensified by the divergent properties of the subjective and behavioural measures and the general deficit in meta-awareness of off task episodes.     

On the relationship between explicit and implicit self-concept of extraversion and neuroticism

Indirect methods such as the implicit association test (IAT) could complement traditional self-report questionnaires of personality traits. However, it is unclear whether IAT scores and self-report scores of nominally the same personality trait measure the same construct or overlapping but distinct constructs. To investigate how IAT and self-report personality scores relate to each other, we conducted a web-based data collection where participants completed self-report personality questionnaires (n = 432) and IATs for extraversion (n = 393) and neuroticism (n = 385). We found that extraversion self-report and IAT scores were more strongly correlated with each other than corresponding neuroticism scores. Overall, our findings suggest that although extraversion and neuroticism self-report and implicit measures are related, they do measure distinct constructs.