Method-specific variance in the implicit association test

The Implicit Association Test (IAT; A. G. Greenwald, D. E. McGhee, & J. L. K. Schwartz, 1998) can be used to assess interindividual differences in the strength of associative links between representational structures such as attitude objects and evaluations. Four experiments are reported that explore the extent of method-specific variance in the IAT. The most important findings are that conventionally scored IAT effects contain reliable interindividual differences that are method specific but independent of the measures' content, and that IAT effects can be obtained in the absence of a preexisting association between the response categories. Several techniques to decrease the impact of method-specific variance are evaluated. The best results were obtained with the D measures recently proposed by A. G. Greenwald, B. A. Nosek, and M. R. Banaji (2003).     

Temporal stability of the implicit association test-anxiety

The Implicit Association Test-Anxiety (IAT-Anxiety; Egloff & Schmukle, 2002) provides an indirect assessment of anxiety by measuring associations of self (vs. other) with anxiety-related (vs. calmness-related) words. In 3 studies (using 3 independent samples), we examined the temporal stability of the IAT-Anxiety. In Study 1, 65 participants responded twice to the IAT-Anxiety with a time lag of 1 week. The test-retest correlation was .58. In Study 2 (N = 39), we extended the time interval between test and retest to 1 month and this yielded a stability coefficient of .62. In Study 3 (N = 36), we examined the long-term stability (time lag: 1 year) of the IAT-Anxiety and this showed a correlation of .47. We discuss implications of these results for the assessment of personality dispositions with the IAT.     

Predictive validity of an Implicit Association Test for assessing anxiety

The Implicit Association Test (IAT) was adapted to measure anxiety by assessing associations of self (vs. other) with anxiety-related (vs. calmness-related) words. Study 1 showed that the IAT-Anxiety exhibited good internal consistency and adequate stability. Study 2 revealed that the IAT-Anxiety was unaffected by a faking instruction. Study 3 examined the predictive validity of implicit and explicit measures and showed that the IAT-Anxiety was related to changes in experimenter-rated anxiety and performance decrements after failure. Study 4 found that several behavioral indicators of anxiety during a stressful speech were predicted by the IAT. Taken together, these studies show that the IAT-Anxiety is a reliable measure that is able to predict criterion variables above questionnaire measures of anxiety and social desirability.     

Examining the dynamics of the implicit and the explicit self-concept in social anxiety: changes in the Implicit Association Test-Anxiety and the Social Phobia Anxiety Inventory following treatment

In this study, we analyzed changes in the strength of self-anxiety associations--as measured by the Implicit Association Test-Anxiety (IAT-Anxiety; Egloff & Schmukle, 2002) and the Social Phobia Anxiety Inventory (SPAI; Turner, Beidel, Dancu, & Stanley, 1989)--following treatment of social anxiety. We assessed socially anxious participants (N = 24) prior to and following a group-based treatment; and we assessed healthy controls (N = 24) at matched time points. Results showed (a) higher implicit and explicit anxiety in socially anxious participants (as compared to controls) prior to treatment and (b) reductions in IAT-Anxiety and SPAI scores of socially anxious participants following treatment. We discuss implications of these results for clinical applications of the IAT.     

Does the Implicit Association Test for assessing anxiety measure trait and state variance?

The stability of the Implicit Association Test for assessing anxiety (IAT‐Anxiety) is lower than its internal consistency, indicating that the IAT‐Anxiety measures both stable and occasion‐specific variance. This suggests that the IAT‐Anxiety may be not only a valid measure of trait anxiety but also one of state anxiety. To test this assumption, two studies were conducted in which state anxiety was experimentally induced by a public speaking task. However, both studies showed that the IAT‐Anxiety score did not change when a state of anxiety was induced. Thus, it seems that occasion‐specific factors other than variations in state anxiety lead to occasion‐specific variance in the IAT‐Anxiety score. Implications for the indirect assessment of personality dispositions with the IAT are discussed. Copyright © 2004 John Wiley & Sons, Ltd.     

Employing automatic approach and avoidance tendencies for the assessment of implicit personality self-concept: The implicit association procedure (IAP)

A new chronometric procedure, the Implicit Association Procedure (IAP), was adapted to assess the implicit personality self-concept of shyness. A sample of 300 participants completed a shyness-inducing role play and, before or after the role play, a shyness IAP, a shyness Implicit Association Test (IAT), and direct self-ratings. The experimental group was instructed to fake nonshyness. The control group did not receive this instruction. IAT and IAP were unaffected by position effects, and were less susceptible to faking than direct self-ratings with regard to mean levels and correlates. Under faking, correlations between direct and indirect measures decreased, and direct but not indirect measures showed higher correlations with social desirability and lower correlations with observed shyness. Despite many similarities, the true correlation between IAT and IAP was estimated only .61, indicating high method-specific variance in both procedures. The findings suggest that indirect measures are more robust against faking than traditional self-ratings but do not yet meet psychometric criteria for practical assessment purposes.     

Convergent,Discriminant, and Incremental Validity of the Pictorial Attitude Implicit Association Test and the Picture Story Exercise as Measures of the Implicit Power Motive

The Pictorial Attitude Implicit Association Test (PA‐IAT) has recently been proposed as new measure of implicit motives. We report a study that provides the first evidence for the convergent validity of the PA‐IAT by showing that the PA‐IAT correlates significantly with a standard measure of implicit motives [i.e. the Picture Story Exercise (PSE)]. Discriminant validity of the PA‐IAT was verified in the sense that the PA‐IAT shared virtually no common variance with explicit motive measures. Our analyses revealed that the PA‐IAT and PSE can best be conceived as related but distinct measures. We further showed that the PA‐IAT had incremental validity in predicting performance on a memory recall task over and above the PSE. In general, our results confirm that the PA‐IAT is a valid measure of implicit motives and can serve as valid alternative to the PSE. Copyright © 2012 John Wiley & Sons, Ltd.     

Performance costs when emotion tunes inappropriate cognitive abilities: implications for mental resources and behavior

Emotion tunes cognition, such that approach-motivated positive states promote verbal cognition, whereas withdrawal-motivated negative states promote spatial cognition (Gray, 2001). The current research examined whether self-control resources become depleted and influence subsequent behavior when emotion tunes an inappropriate cognitive tendency. In 2 experiments, either an approach-motivated positive state or a withdrawal-motivated negative state was induced, and then participants completed a verbal or a spatial working memory task creating conditions of emotion-cognition alignment (e.g., approach/verbal) or misalignment (e.g., approach/spatial). A control condition was also included. To examine behavioral costs due to depleted self-control resources, participants completed either a Stroop task (Stroop, 1935; Experiment 1) or a Black/White implicit association test (IAT; Greenwald, McGhee, & Schwartz, 1998; Experiment 2). Participants in the misalignment conditions performed worse on the Stroop task, and they were worse at controlling their implicit attitude biases on the IAT. Thus, when emotion tunes inappropriate cognitive tendencies for one's current environment, self-control resources become depleted, impairing behavioral control.     

A comparative investigation of seven indirect attitude measures

We compared the psychometric qualities of seven indirect attitude measures across three attitude domains (race, politics, and self-esteem) with a large sample (N?=?23,413). We compared the measures on internal consistency, sensitivity to known effects, relationships with indirect and direct measures of the same topic, the reliability and validity of single-category attitude measurement, their ability to detect meaningful variance among people with nonextreme attitudes, and their robustness to the exclusion of misbehaving or well-behaving participants. All seven indirect measures correlated with each other and with direct measures of the same topic. These relations were always weak for self-esteem, moderate for race, and strong for politics. This pattern suggests that some of the sources of variation in the reliability and predictive validity of the indirect measures is a function of the concepts rather than the methods. The Implicit Association Test (IAT) and Brief IAT (BIAT) showed the best overall psychometric quality, followed by the Go–No-Go association task, Single-Target IAT (ST-IAT), Affective Misattribution Procedure (AMP), Sorting Paired Features task, and Evaluative Priming. The AMP showed a steep decline in its psychometric qualities when people with extreme attitude scores were removed. Single-category attitude scores computed for the IAT and BIAT showed good relationships with other attitude measures but no evidence of discriminant validity between paired categories. The other measures, especially the AMP and ST-IAT, showed better evidence for discriminant validity. These results inform us on the validity of the measures as attitude assessments, but do not speak to the implicitness of the measured constructs.     

Drinking without thinking: an implicit measure of alcohol motivation predicts failure to control alcohol use

Addiction is characterized by dyscontrol - substance use despite intentions to restrain. Using a sample of at-risk drinkers, the present study examined whether an implicit measure of alcohol motivation (the Implicit Association Test [IAT]; Greenwald, A.G., McGhee, D.E., & Schwartz, J.L.K. (1998). Measuring individual differences in implicit cognition: the Implicit Association Test. Journal of Personality and Social Psychology, 74, 1464-1480) would predict dyscontrol of alcohol use. Participants completed an IAT and, to elicit motivation to restrain alcohol use, were instructed that greater consumption in a taste test would impair performance on a later task for which they could win a prize. All participants viewed aversive slides and then completed a thought-listing task. Participants either exerted self-control by suppressing negative affect and thoughts regarding the slides or did not exert self-control. Post-manipulation, the groups did not differ in mood, urge to drink or motivation to restrain consumption. During the subsequent taste test, participants whose self-control resources were depleted consumed more alcohol than did those in the control group. Additionally, the IAT, but not an explicit measure of alcohol motivation, more strongly predicted alcohol use when self-control resources were depleted. The results indicate that the IAT may have utility in predicting dyscontrolled alcohol use.     

Assessing individual differences in achievement motivation with the Implicit Association Test

The authors examined the validity of an Implicit Association Test (Greenwald, McGhee, & Schwartz, 1998) for assessing individual differences in achievement tendencies. Eighty-eight students completed an IAT and explicit self-ratings of achievement orientation, and were then administered a mental concentration test that they performed either in the presence or in the absence of achievement-related feedback. Implicit and explicit measures of achievement orientation were uncorrelated. Under feedback, the IAT uniquely predicted students’ test performance but failed to predict their self-reported task enjoyment. Conversely, explicit self-ratings were unrelated to test performance but uniquely related to subjective accounts of task enjoyment. Without feedback, individual differences in both performance and enjoyment were independent of differences in either of the two achievement orientation measures.     

Does substance use affect reliabilities of the Implicit Association Test?

The authors examined whether use of alcohol or marijuana affected reliability of the Implicit Association Test (IAT; A. G. Greenwald, D. E. McGhee, & J. L. K. Schwartz, 1998). Consistent with research indicating the possibility that marijuana use depletes cognitive resources, the authors found worse reliabilities for participants who recently used marijuana than for those who had not. Recent alcohol users and nonusers demonstrated similar IAT reliability. Subsequent analyses indicated that reliability differences between marijuana users and nonusers were most pronounced when participants began with incongruous tasks and then switched to congruous tasks. Results were consistent with work on the residual costs of task switching that indicates that effortful tasks promote interference with tasks that follow. The authors discussed results in terms of IAT scoring procedures and the prevalence of use of alcohol and marijuana on university campuses.     

Two bases of the compatibility effect in the Implicit Association Test (IAT)

Four experiments are reported, investigating the mechanisms underlying the compatibility effect in the Implicit Association Test (IAT; Greenwald, McGhee, & Schwartz, 1998). All experiments involved two IATs: flower IAT, in which the target categories were flowers and insects, and number IAT, involving even and odd numbers as target categories. In Experiment 1, using the standard IAT procedure, the two IATs produced equal IAT effects, despite large differences in rated valence contrast between flowers and insects and between even and odd numbers. Experiment 2 used a procedure developed by Klauer and Mierke (2005) and produced results consistent with the view that valence plays a role in the flower IAT but not in the number IAT. Experiments 3 and 4 used manipulations similar to those developed by Rothermund and Wentura (2004) and showed that these manipulations affected the flower IAT and number IAT differently. The results provide converging evidence that the two types of IAT effects-one based on valence and one based on familiarity-are empirically dissociable.Experiments 1and 2 reported in this paper were conducted as an honours project by Marie Peek-O'Leary under the supervision of Sachiko Kinoshita. Parts of this paper were presented at the 44th Annual Meeting of the Psychonomic Society held in Vancouver, Canada, in November, 2003.     

Implicit attitudes towards romantic partners predict well‐being in stressful life conditions: Evidence from the antenatal maternity ward

An idiographic variant of the Implicit Association Test (IAT; Greenwald, McGhee, & Schwartz, 1998 ) was used to investigate how implicit attitudes towards romantic partners are related to explicit attitudes, relationship‐related variables such as adult attachment and relationship satisfaction, and psychological well‐being as a potential outcome of relationship quality. The validity of the Partner‐IAT was investigated using a known group approach that contrasted abused women currently living in a refuge (N = 22), women who had recently fallen in love (N = 19), women who were currently hospitalized due to pregnancy complications (N = 48), and a control group of female students (N = 52). Across the whole sample, the Partner‐IAT showed satisfactory internal consistency (α  =  .83). As expected, the analysis of group differences revealed that abused women living in a refuge showed more negative implicit and explicit attitudes toward (ex‐)partners than women belonging to the other three groups. Women in love showed the most positive partner attitudes, but the difference to the control group reached significance only for explicit but not implicit attitudes. Implicit attitudes toward partners correlated significantly with explicit attitudes, secure attachment, and psychological well‐being. To investigate whether implicit and explicit partner attitudes can predict important relationship outcomes, psychological well‐being was regressed on both variables in group‐wise hierarchical multiple regression analyses. Explicit partner attitudes were significantly related to psychological well‐being in student controls and hospitalized pregnant women. However, only in hospitalized pregnant women did implicit attitudes account for variance in well‐being over and above explicit attitudes. This pattern of results is compatible with the notion that positive implicit representations of the romantic partner can function as a genuine coping resource that effectively buffers against major stressful life circumstances.     

Underlying processes in the implicit association test: dissociating salience from associations

The authors investigated whether effects of the Implicit Association Test (IAT) are influenced by salience asymmetries, independent of associations. Two series of experiments analyzed unique effects of salience by using nonassociated, neutral categories that differed in salience. In a 3rd series, salience asymmetries were manipulated experimentally while holding associations between categories constant. In a 4th series, valent associations of the target categories were manipulated experimentally while holding salience asymmetries constant. Throughout, IAT effects were found to depend on salience asymmetries. Additionally, salience asymmetries between categories were assessed directly with a visual search task to provide an independent criterion of salience asymmetries. Salience asymmetries corresponded to IAT effects and also accounted for common variance in IAT effects and explicit measures of attitudes or the self-concept.     

Assessing anxiety with extrinsic Simon tasks

This article introduces two new indirect measures of anxiety that are based on the Extrinsic Affective Simon Task (EAST; De Houwer, 2003). The EAST differs from the more established Implicit Association Test (IAT; Greenwald, McGhee, & Schwartz, 1998) in that participants' responses to different trials within one block of trials are compared rather than performance between two different blocks of trials. Two studies led to the following results: (a) Both extrinsic Simon tasks for assessing anxiety showed only moderate internal consistencies, (b) one of the two tasks showed at least some convergent validity with an IAT for assessing anxiety, and (c) both tasks were dissociated from self-reported anxiety. Implications for future adaptations of the EAST for the indirect assessment of personality dimensions are discussed.     

A paper-format group performance test for measuring the implicit association of target concepts

We developed a paper test utilizing a mechanism for measuring implicit association similar to that used in the Implicit Association Test (IAT; Greenwald, McGhee, & Schwartz, 1998). The target concepts were buried among positive and negative words on a piece of paper. Examinees marked the targets as "bad" or "good" in one task and conversely in the other, along with the evaluative words. Instead of reaction times, we counted the number of words marked in 20 sec for each task. This procedure allowed group administration. We calculated the implicit measure using the difference in the average number of words marked in the task pairs. The results of a test administered to 82 undergraduates with three different targets showed significant correlations (rs = .26-.35) with the results of IAT administered to the same participants. It also showed significant reliability (rs = .56-.71). We discuss the practical usability of the test with application studies conducted in various areas.     

Delineating potential mechanisms of implicit alcohol cognitions: drinking restraint, negative affect, and their relationship with approach alcohol associations

Problem drinkers may use alcohol to avoid negative mood states and may develop implicit cognitive associations between negative emotional states and reinforcing properties of drinking. It is paradoxical that attempts to control drinking, such as among those high in drinking restraint, may inadvertently increase desire to drink and subsequent alcohol consumption, and this may be exaggerated under times of emotional distress when urges to drink are high. We examined whether individuals who are high on drinking restraint would demonstrate stronger alcohol-related thoughts elicited by stimuli that represent the desire to use alcohol, in response to stronger versus weaker negative mood arousal. Seventy hazardous drinkers completed measurements of drinking restraint, alcohol consumption, and consequences of use. After being randomized to view negative or positive pictures sets, participants completed an Implicit Association Task (IAT) to test differences in the strength of the association between desire to approach or avoid alcohol or water cues, and then a measurement of subjective craving following the IAT. Regression analyses showed that trait restriction not temptation was positively related to IAT scores, after controlling for relevant covariates and explained 7% of the total variance. Trait temptation not IAT predicted subjective craving. Negative affect was unrelated to IAT scores, singly or in conjunction with measures of drinking restraint, contrary to predictions. In sum, implicit alcohol cognitions are related to attempts to restrict drinking not temptation to drink and are less strongly influenced by mood state.     

Mere acceptance produces apparent attitude in the Implicit Association Test

Two experiments examined mere acceptance effects in the Implicit Association Test (IAT). They tested whether accepting a stimulus as conforming to a rule produces responding consistent with positive attitude in the IAT. In Experiment 1, accepted stimuli were more easily categorized with pleasant personality characteristics than rejected stimuli; they were preferred according to the logic of the IAT. Accepted word stimuli were also responded to faster overall, suggesting that it was easier to make the accept than the reject response. In Experiment 2, numerical stimuli that conformed to a rule showed the same IAT preference effect over non-confirming stimuli, even when the rule conforming stimuli were more difficult to categorize. Three sources of this apparent preference for rule-conforming stimuli are considered: (1) the semantic relatedness of the concepts “accept” and “pleasant” on the one hand, and “reject” and “unpleasant” on the other; (2) that rejected non-category members are more salient (‘pop-out’) and thus are more easily categorized with the more salient unpleasant personality characteristics; or (3) that accepting rule-conforming stimuli is experienced as a pleasant event. Regardless of the mechanism underlying the mere acceptance effect, the IAT can produce apparent preferences for stimuli towards which participants have no positive attitude.     

Do features of stimuli influence IAT effects?

The Implicit Association Test (Greenwald, McGhee, & Schwartz, 1998) is a categorization task intended to measure the strength of associations between concepts. The present research investigated the influence of individual stimuli on IAT effects. Exploring implicit attitudes of East and West Germans, we systematically manipulated relatedness of target stimuli to the attribute dimension and, simultaneously, relatedness of attribute stimuli to the target dimension. Two experiments demonstrate the influence of stimulus associations as one source that drives IAT effects. Depending on the strength and the direction of these cross-category associations, the result was either stronger IAT effects or a decline of IAT effects. Implications for theoretical models as well as for the interpretation of IAT effects are discussed.