Understanding and using the implicit association test: V. measuring semantic aspects of trait self‐concepts

Implicit Association Tests (IATs) often reveal strong associations of self with positive rather than negative attributes. This poses a problem in using the IAT to measure associations involving traits with either positive or negative evaluative content. In two studies, we employed non‐bipolar but evaluatively balanced Big Five traits as attribute contrasts and explored correlations of IATs with positive (e.g. sociable vs. conscientious) or negative (e.g. reserved vs. chaotic) attributes. Results showed (a) satisfactory internal consistencies for all IATs, (b) explicit–explicit and implicit–implicit correlations that were moderate to high and comparable in strength after both were corrected for attenuation and (c) better model fit for latent variable models that linked the implicit and explicit measures to distinct latent factors rather to the same factor. Together, the results suggest that IATs can validly assess the semantic aspect of trait self‐concepts and that implicit and explicit self‐representations are, although correlated, also distinct constructs. Copyright © 2008 John Wiley & Sons, Ltd.     

A derived transfer of functions and the implicit association test

Participants were trained in a series of interrelated conditional discriminations that aimed to establish four 4-member equivalence classes (i.e., A1-B1-C1-D1, A2-B2-C2-D2, A3-B3-C3-D3, A4-B4-C4-D4). During this training, the four A stimuli (i.e., A1, A2, A3, and A4) were compounded with pictures containing positive or negative evaluative functions (A1/A2 negative & A3/A4 positive). The transfer of evaluative functions to directly and indirectly related members of the equivalence classes (i.e., B, C, and D stimuli) was measured using an Implicit Association Test (IAT). During consistent test blocks, participants were required to press the same response key for target words that were related to those A stimuli that possessed similar evaluative functions (A1/A2-left key & A3/A4-right key). During inconsistent test blocks, target words that were related to those A stimuli with different evaluative functions were assigned to the same response key (A1/A4-left key & A2/A3-right key). Results showed that all 8 participants, who passed a matching-to-sample equivalence test following the IAT, responded more rapidly on consistent relative to inconsistent test blocks. This typical IAT effect was not observed for those participants who did not pass the equivalence test. The results suggest that the IAT effect may arise from formally untested derived relations, and supports the argument that such relations could provide a valid behavioral model of semantic categories in natural language.     

A public versus private administration of the implicit association test

This research includes two experiments that examined (a) whether the assessment situation in which individuals complete an implicit measure of bias alters their responses and (b) whether the hypothesized effect of the assessment situation on implicitly assessed bias reflects socially desirable responding. Participants in Experiment 1 (N = 151) completed an IAT measuring bias toward homosexuality in either a public or a private assessment situation. Consistent with studies of explicitly assessed attitudes, implicitly assessed bias toward homosexuality was significantly lower when assessed in a public versus a private assessment situation. Participants in Experiment 2 (N = 102) completed an IAT measuring bias toward homosexuality in a public assessment situation under a bogus pipeline or no‐bogus pipeline condition. Results indicated that participants' implicitly assessed bias did not significantly differ across these conditions. The authors discuss these findings in terms of possible automatic processes affecting the malleability of implicitly assessed attitudes. Copyright © 2006 John Wiley & Sons, Ltd.     

Method-specific variance in the implicit association test

The Implicit Association Test (IAT; A. G. Greenwald, D. E. McGhee, & J. L. K. Schwartz, 1998) can be used to assess interindividual differences in the strength of associative links between representational structures such as attitude objects and evaluations. Four experiments are reported that explore the extent of method-specific variance in the IAT. The most important findings are that conventionally scored IAT effects contain reliable interindividual differences that are method specific but independent of the measures' content, and that IAT effects can be obtained in the absence of a preexisting association between the response categories. Several techniques to decrease the impact of method-specific variance are evaluated. The best results were obtained with the D measures recently proposed by A. G. Greenwald, B. A. Nosek, and M. R. Banaji (2003).     

Decoding the implicit association test: Implications for criterion prediction

The implicit association test (IAT) is believed to measure implicit evaluations by assessing reaction times on two cognitive tasks, often termed “compatible” and “incompatible” tasks. A common rationale for studying the IAT is that it might improve our prediction and understanding of meaningful psychological criteria. To date, however, no clear psychometric theory has been advanced for this measure. We examine the theory, methods and analytic strategies surrounding the IAT in the context of criterion prediction to determine measurement and causal models a researcher embraces (knowingly or unknowingly) by using the test. Our analyses reveal that the IAT revolves around interpretation of two distinct relative constructs, one at the conceptual level and one at the observed level. We show that interest in relative implicit evaluations at the conceptual level imposes a causal model that is restrictive in form. We then examine measurement models of the IAT and show how computing a difference score at the observed level may lack empirical justification. These issues are highlighted in a study replicating an effect established in the literature (Study 1). We then introduce a new variant of the IAT and use it to evaluate the reasonableness of traditional IAT methods (Study 2).     

Measuring implicit attitudes of 4-year-olds: the preschool implicit association test

The Preschool Implicit Association Test (PSIAT) is an adaptation of an established social cognition measure (IAT) for use with preschool children. Two studies with 4-year-olds found that the PSIAT was effective in evaluating (a) attitudes toward commonly liked objects (flowers = good) and (b) gender attitudes (girl = good or boy = good). The gender attitude PSIAT was positively correlated with corresponding explicit attitude measures and also children’s actual sex. The new implicit and explicit measures of gender attitudes demonstrated discriminant validity; each predicted variance in children’s gendered play activities beyond that predicted by the other. Discussion describes potential uses of the PSIAT to investigate development of societally significant attitudes and stereotypes at younger ages than are achievable with currently available methods.     

Using the implicit association test across cultures: A case of implicit self-esteem in Japan and Canada

Previous research has suggested that implicit self-esteem might be universally positive. In the present study implicit self-esteem, as measured by the implicit association test (IAT), was found to be positive in both Japanese and Canadian participants. However, contrary to prior research, Japanese participants were found to have significantly lower implicit self-esteem than Canadians. Japanese participants also had lower scores on an exploratory measure of collective implicit self-esteem. In general, the results of the present study point to the complexities in the study of implicit self-esteem across cultures. Inconsistencies between the present and previous research might reflect divergent methodologies used in the IAT. The applicability of the IAT in a cross-cultural setting is discussed.     

Using the implicit association test to measure age differences in implicit social cognitions

Two studies investigated the use of the Implicit Association Test (IAT; A. G. Greenwald, D. E. McGhee, & J. L. K. Schwartz, 1998) to study age differences in implicit social cognitions. Study I collected IAT (implicit) and explicit (self-report) measures of age attitudes, age identity, and self-esteem from young, young-old, and old-old participants. Study 2 collected IAT and explicit measures of attitudes toward flowers versus insects from young and old participants. Results show that the IAT provided theoretically meaningful insights into age differences in social cognitions that the explicit measures did not, supporting the value of the IAT in aging research. Results also illustrate that age-related slowing must be considered in analysis and interpretation of IAT measures.     

The single category implicit association test as a measure of implicit social cognition

The Single Category Implicit Association Test (SC-IAT) is a modification of the Implicit Association Test that measures the strength of evaluative associations with a single attitude object. Across 3 different attitude domains--soda brand preferences, self-esteem, and racial attitudes--the authors found evidence that the SC-IAT is internally consistent and makes unique contributions in the ability to understand implicit social cognition. In a 4th study, the authors investigated the susceptibility of the SC-IAT to faking or self-presentational concerns. Once participants with high error rates were removed, no significant self-presentation effect was observed. These results provide initial evidence for the reliability and validity of the SC-IAT as an individual difference measure of implicit social cognition.     

Using the implicit association test to measure self-esteem and self-concept

Experiment 1 used the Implicit Association Test (IAT; A. G. Greenwald, D. E. McGhee, & J. L. K. Schwartz, 1998) to measure self-esteem by assessing automatic associations of self with positive or negative valence. Confirmatory factor analysis (CFA) showed that two IAT measures defined a factor that was distinct from, but weakly correlated with, a factor defined by standard explicit (self-report) measures of self-esteem. Experiment 2 tested known-groups validity of two IAT gender self-concept measures. Compared with well-established explicit measures, the IAT measures revealed triple the difference in measured masculinity-femininity between men and women. Again, CFA revealed construct divergence between implicit and explicit measures. Experiment 3 assessed the self-esteem IAT's validity in predicting cognitive reactions to success and failure. High implicit self-esteem was associated in the predicted fashion with buffering against adverse effects of failure on two of four measures.     

A meta-analysis on the correlation between the implicit association test and explicit self-report measures

Theoretically, low correlations between implicit and explicit measures can be due to (a) motivational biases in explicit self reports, (b) lack of introspective access to implicitly assessed representations, (c) factors influencing the retrieval of information from memory, (d) method-related characteristics of the two measures, or (e) complete independence of the underlying constructs. The present study addressed these questions from a meta-analytic perspective, investigating the correlation between the Implicit Association Test (IAT) and explicit self-report measures. Based on a sample of 126 studies, the mean effect size was .24, with approximately half of the variability across correlations attributable to moderator variables. Correlations systematically increased as a function of (a) increasing spontaneity of self-reports and (b) increasing conceptual correspondence between measures. These results suggest that implicit and explicit measures are generally related but that higher order inferences and lack of conceptual correspondence can reduce the influence of automatic associations on explicit self-reports.     

Bridging the gap between explicit and implicit measurement of personality: The questionnaire-based implicit association test

This study presents the questionnaire-based implicit association test (qIAT), a method that resembles the assessment procedures of self-report scales and allows an implicit assessment of constructs measured by such instruments. The qIAT measures the speed of association between ordinary questionnaires’ items (i.e., short statements rather than single words) and true versus false self-related sentences. Participants completed self-report measures of all Big-Five domains and the qIAT that measured extraversion. The qIAT implicit extraversion score showed good levels of internal consistency and it correlated with explicit extraversion but not with other explicit scales, thus supporting the convergent and discriminant validity of this measure. It also predicted a criterion behavior, and this prediction was incremental to self-report assessment of the same set of items. The qIAT opens the door for the indirect assessment of numerous psychological phenomena measured by existing self-report scales.     

Manipulating the role of cognitive control while taking the implicit association test

The Implicit Association Test (IAT) is one of the most widely used methods for measuring attitudes in the behavioral and social sciences. Recent studies have found that individual differences in cognitive control correlate with IAT scores. However, these studies did not collect independent measures of attitude, which makes it difficult to isolate the construct of attitude separate from cognitive control. Furthermore, no study has examined whether the role of cognitive control can be manipulated, which is necessary to establish a causal link between cognitive control and IAT performance. By collecting independent measures of attitude (explicit attitude ratings and the Affect Misattribution Procedure: AMP), Experiment 1 factored out the role of attitude for two different IATs and still found a relationship between IAT scores and cognitive control (Stroop and stop-signal). Experiments 2 and 3 manipulated the role of cognitive control through instructions and feedback regarding the race IAT's measurement goal. These manipulations increased average IAT scores (i.e., stronger preference for whites), increased the relationship with cognitive control (Stroop), and decreased the relationship with attitude (AMP). These results demonstrate that cognitive control influences IAT performance rather than merely correlating with IAT performance.     

Measuring self-esteem using the implicit association test: the role of the other

In two experiments, the use of a self-other Implicit Association Test (IAT) as a measure of implicit self-esteem was examined. In Study 1, participants completed two self-other IATs: one in which the other was unspecified and one in which the other was specified to be a close friend. Esteem-IAT scores were significantly higher for the unspecified other-IAT (d = .82), indicating that the content of the other has a considerable influence on the over-all esteem-IAT scores. Study 2 provided a conceptual replication of these results and provided some initial evidence that the valence of an unspecified other is negative. Across both studies, the nature of the mental representation of the self, as measured by an esteem-IAT, changed as a function of the mental representation of the other. The crucial role of the other-associations in the esteem-IAT calls into question its use and interpretation as a measure of self-esteem.     

Reactions to the implicit association test as an educational tool: A mixed methods study

We examined reactions to the Race Implicit Association Test (IAT), which has been widely used but rarely examined as an educational tool to raise awareness about racial bias. College students $(N=172)$ were assigned to read that the IAT reflected either personal beliefs or both personal and extrapersonal factors (single vs. multiple explanation conditions). They then completed the IAT and quantitative measures of affect, attitudes, and belief in bias. A subset of participants $(n=32)$ also wrote reaction papers, which were used to develop qualitative themes to more fully describe reactions to the IAT. Quantitative results revealed that participants with a stronger implicit preference for European Americans more strongly believed in implicit bias in the multiple (vs. single) explanation condition. Mixed methods analyses using data transformation and typology development indicated that participants whose qualitative IAT responses were more negative were subsequently more likely to help an African American.     

A threat in the computer: the race implicit association test as a stereotype threat experience

Three experiments test whether the threat of appearing racist leads White participants to perform worse on the race Implicit Association Test (IAT) and whether self-affirmation can protect from this threat. Experiments 1 and 2 suggest that White participants show a stereotype threat effect when completing the race IAT, leading to stronger pro-White scores when the test is believed to be diagnostic of racism. This effect increases for domain-identified (highly motivated to control prejudice) participants (Experiment 2). In Experiment 3, self-affirmation inoculates participants against stereotype threat while taking the race IAT. These findings have methodological implications for use of the race IAT and theoretical implications concerning the malleability of automatic prejudice and the potential interpersonal effects of the fear of appearing racist.     

Underlying processes in the implicit association test: dissociating salience from associations

The authors investigated whether effects of the Implicit Association Test (IAT) are influenced by salience asymmetries, independent of associations. Two series of experiments analyzed unique effects of salience by using nonassociated, neutral categories that differed in salience. In a 3rd series, salience asymmetries were manipulated experimentally while holding associations between categories constant. In a 4th series, valent associations of the target categories were manipulated experimentally while holding salience asymmetries constant. Throughout, IAT effects were found to depend on salience asymmetries. Additionally, salience asymmetries between categories were assessed directly with a visual search task to provide an independent criterion of salience asymmetries. Salience asymmetries corresponded to IAT effects and also accounted for common variance in IAT effects and explicit measures of attitudes or the self-concept.     

The implicit association test as a general measure of similarity.

The Implicit Association Test (IAT) is widely used as a measure of semantic similarity (i.e., associations in semantic memory). The results of previous research and of a new study show that IAT effects can, however, also be based on other types of similarity between stimuli. We therefore put forward the hypothesis that the IAT provides a general measure of similarity. Given that similarity is highly dynamic and context-dependent, our view that the IAT measures similarity is compatible with existing evidence showing that IAT effects are highly malleable. We provide further evidence for this in a new study in which the outcome of an IAT depended on whether the perceptual or functional characteristics of the stimuli were made salient.     

The association between psychological distance and construal level: evidence from an implicit association test

According to construal level theory (N. Liberman, Y. Trope, & E. Stephan, in press; Y. Trope & N. Liberman, 2003), people use a more abstract, high construal level when judging, perceiving, and predicting more psychologically distal targets, and they judge more abstract targets as being more psychologically distal. The present research demonstrated that associations between more distance and higher level of construal also exist on a pure conceptual level. Eight experiments used the Implicit Association Test (IAT; A. G. Greenwald, D. E. McGhee, & J. L. K. Schwartz, 1998) to demonstrate an association between words related to construal level (low vs. high) and words related to four dimensions of distance (proximal vs. distal): temporal distance, spatial distance, social distance, and hypotheticality. In addition to demonstrating an association between level of construal and psychological distance, these findings also corroborate the assumption that all 4 dimensions of psychological distance are related to level of construal in a similar way and support the notion that they all are forms of psychological distance.     

Forming implicit and explicit attitudes toward individuals: social group association cues

The authors explored how social group cues (e.g., obesity, physical attractiveness) strongly associated with valence affect the formation of attitudes toward individuals. Although explicit attitude formation has been examined in much past research (e.g., S. T. Fiske & S. L. Neuberg, 1990), in the current work, the authors considered how implicit as well as explicit attitudes toward individuals are influenced by these cues. On the basis of a systems of evaluation perspective (e.g., R. J. Rydell & A. R. McConnell, 2006; R. J. Rydell, A. R. McConnell, D. M. Mackie, & L. M. Strain, 2006), the authors anticipated and found that social group cues had a strong impact on implicit attitude formation in all cases and on explicit attitude formation when behavioral information about the target was ambiguous. These findings obtained for cues related to obesity (Experiments 1 and 4) and physical attractiveness (Experiment 2). In Experiment 3, parallel findings were observed for race, and participants holding greater implicit racial prejudice against African Americans formed more negative implicit attitudes toward a novel African American target person than did participants with less implicit racial prejudice. Implications for research on attitudes, impression formation, and stigma are discussed.