Is the implicit association test immune to faking?

One of the main advantages of measures of automatic cognition is supposed to be that they are less susceptible to faking than explicit tests. It is an empirical question, however, to what degree these measures can be faked, and the response might well differ for different measures. We tested whether the Implicit Association Test (IAT, Greenwald, McGhee, & Schwartz, 1998) cannot be faked as easily as explicit measures of the same constructs. We chose the Big-Five dimensions conscientiousness and extraversion as the constructs of interest. The results show, indeed, that the IAT is much less susceptible to faking than questionnaire measures are, even if no selective faking of single dimensions of the questionnaire occurred. However, given limited experience, scores on the IAT, too, are susceptible to faking.     

What does the implicit association test measure? A test of the convergent and discriminant validity of prejudice-related IATs

Drawing on recent criticism of the Implicit Association Test (IAT), the present study tested the convergent and discriminant validity of two prejudice-related IATs to corresponding explicit prejudice measures in a German student sample (N = 61). Confirming convergent validity, (a) an IAT designed to assess negative associations related to Turkish people was significantly related to the explicit endorsement of prejudiced beliefs about Turkish people, and (b) an IAT designed to assess negative associations related to East Asians was significantly related to explicit prejudice against East Asians. Moreover, confirming discriminant validity, (c) the Asian IAT was unrelated to the explicit endorsement of prejudiced beliefs about Turkish people, and (d) the Turkish IAT was unrelated to explicit prejudice against Asian people. These results further corroborate the assumption that the IAT is a valid method to assess the strength of evaluative associations in the domain of prejudice and stereotypes.     

Does the cognitive reflection test measure cognitive reflection? A mathematical modeling approach

We used a mathematical modeling approach, based on a sample of 2,019 participants, to better understand what the cognitive reflection test (CRT; Frederick In Journal of Economic Perspectives, 19, 25–42, 2005) measures. This test, which is typically completed in less than 10 min, contains three problems and aims to measure the ability or disposition to resist reporting the response that first comes to mind. However, since the test contains three mathematically based problems, it is possible that the test only measures mathematical abilities, and not cognitive reflection. We found that the models that included an inhibition parameter (i.e., the probability of inhibiting an intuitive response), as well as a mathematical parameter (i.e., the probability of using an adequate mathematical procedure), fitted the data better than a model that only included a mathematical parameter. We also found that the inhibition parameter in males is best explained by both rational thinking ability and the disposition toward actively open-minded thinking, whereas in females this parameter was better explained by rational thinking only. With these findings, this study contributes to the understanding of the processes involved in solving the CRT, and will be particularly useful for researchers who are considering using this test in their research.     

Measuring Big-Five personality dimensions with the implicit association test – Implicit personality traits or self-esteem?

We examined whether the implicit association test (IAT) could serve as an implicit measure of the dimensions of the Five-Factor Model of Personality. In the first study (N = 84) IAT-effects of the Big-Five (Extraversion, Agreeableness, Conscientiousness, Neuroticism and Openness) were found and the IAT showed good internal consistencies and convergent validity with an explicit Big-Five questionnaire (NEO-FFI-30). In a second study (N = 50), conducted to determine the overlap of the personality-IATs with implicit self-esteem, the Extraversion and the Neuroticism-IAT were shown to correlate with a self-esteem-IAT only moderately.     

Measuring Big-Five personality dimensions with the implicit association test – Implicit personality traits or self-esteem?

We examined whether the implicit association test (IAT) could serve as an implicit measure of the dimensions of the Five-Factor Model of Personality. In the first study (N = 84) IAT-effects of the Big-Five (Extraversion, Agreeableness, Conscientiousness, Neuroticism and Openness) were found and the IAT showed good internal consistencies and convergent validity with an explicit Big-Five questionnaire (NEO-FFI-30). In a second study (N = 50), conducted to determine the overlap of the personality-IATs with implicit self-esteem, the Extraversion and the Neuroticism-IAT were shown to correlate with a self-esteem-IAT only moderately.     

Is the attribution of cultural differences to minorities an expression of racial prejudice?

The social psychological literature considers two main perspectives on the study of perceived cultural differences between majorities and minorities: one proposes that perception of cultural differences is an antecedent of prejudice and another states that the attribution of cultural differences to minorities is already a hidden expression of racial prejudice. This paper offers further support to this latter perspective. One hundred and ninety-four participants answered a questionnaire measuring (1) general racist belief; (2) cultural differences attributed to Black people (hetero-ethnicization); (3) the asymmetric attribution of secondary and primary emotions to the in-group and to Black people (infra-humanization); (4) the asymmetric attribution of natural and cultural traits to in-group members and to Black people (ontologization); and (5) negative evaluation of this social category. The general racist belief scale was not anchored in a specific group and measured the belief in the inferiority of certain social groups or peoples based on biological or cultural factors. Relationships between the scales were analysed through a set of Structural Equation Models. According to the predictions, results showed that the attribution of cultural differences is a dimension of prejudice. Results also showed that attribution of cultural differences, negative evaluation of Black people, ontologization, and infra-humanization were different dimensions of a common latent factor that can be identified as racial prejudice; and that prejudice was predicted by general racist belief. Results are discussed in the light of the study of the impact of perceived cultural differences on intergroup relations and in the light of the "new racism" approaches.     

Does the courage measure really measure courage? A theoretical and empirical evaluation

Courage has seen an explosion of research in all branches of psychology, and the most popular measure is Norton and Weiss’s the courage measure (CM). Despite widespread use, limited investigations into its psychometric properties and validity have been performed. To ensure the strength of findings drawn from the scale, the current study performs a theoretical, psychometric, and empirical analysis of the CM. The results demonstrate that the CM has theoretical concerns stemming from the operational definition of courage used during its creation, and may not actually measure courage. Also, the CM was shown to consist of two dimensions separated by regular and reverse coding. Next, the scale demonstrated slight concerns with method effects, and its construct validity was analyzed. Together, the results demonstrate that the CM would benefit from the removal of reverse coded items, and may actually gage persistence despite fear rather than courage.     

Stalking the perfect measure of implicit self-esteem: the blind men and the elephant revisited?

Recent interest in the implicit self-esteem construct has led to the creation and use of several new assessment tools whose psychometric properties have not been fully explored. In this article, the authors investigated the reliability and validity of seven implicit self-esteem measures. The different implicit measures did not correlate with each other, and they correlated only weakly with measures of explicit self-esteem. Only some of the implicit measures demonstrated good test-retest reliabilities, and overall, the implicit measures were limited in their ability to predict our criterion variables. Finally, there was some evidence that implicit self-esteem measures are sensitive to context. The implications of these findings for the future of implicit self-esteem research are discussed.     

Does survival processing enhance implicit memory?

Recent research has shown that human memory may have evolved to remember information that has been processed for the purpose of survival, more so than information that has been processed for other purposes, such as home-moving. We investigated this survival-processing advantage using both explicit and implicit memory tests. In Experiment 1, participants rated words in one of three scenarios: survival, pleasantness, and moving, followed by a timed stem-cued recall/stem-cued completion task. Items were completed more quickly in the survival scenario, as compared with the other two for the explicit task, but no differences were found across conditions in the implicit task. In Experiment 2, the implicit task was changed to concreteness judgments to encourage more conceptual processing. Again, the survival-processing advantage occurred in the explicit task (speeded item recognition), but not in the implicit task. These results suggest that a survival-processing advantage may benefit participants’ memory performance only during explicit retrieval.     

Does the Illness Behavior Questionnaire measure abnormal illness behavior?

Abnormal illness behavior (AIB) has been proposed as a construct measuring the inappropriate or maladaptive modes of responding to one's state of health, and the Illness Behavior Questionnaire (BQ; Pilowsky, 1975) was designed to measure this construct. Previous studies using small samples have failed to agree on the factor structure of this questionnaire. The present paper examines the factor structure of the Illness Behavior Questionnaire and critically evaluates the interpretation of its dimensions as well as the construct of AIB. A factor analysis of responses from 1,061 health care and nonhealth care seeking subjects yielded six interpretable factors which substantially replicated Pilowsky's previous results. Six scales were calculated and correlated with several personality measures. The results indicated that the Illness Behavior Questionnaire is saturated with neuroticism, a dimension known to be related to excessive medical complaints. But excessive medical complaints cannot be equated with hypochondriasis or AIB in the absence of objective medical information. In the absence of evidence for the discriminant validity of the IBQ, its use as a diagnostic device is unwarranted. Treating elevated IBQ scores as indicators of abnormal illness behavior without corroborating medical information may be more misleading than accepting patients' symptom reports at face value.     

Relations between implicit measures of prejudice:what are we measuring?

Some recent findings suggest that different implicit measures of prejudice assess the same underlying construct, but other work suggests that they may not. In this experiment, White participants completed a version of a priming measure of racial attitudes that either encouraged categorization of the face primes in terms of race or did not encourage such categorization, and then completed the Implicit Association Test. Correspondence between the two measures was found only when categorization by race was required on the priming measure. Moreover, participants appeared more prejudiced when they were led to construe individuals in terms of race than when they were not so encouraged. The discussion focuses on the potential for dissociations between evaluations of a category and evaluations of members of the category.     

Traditional prejudice and justice judgments: Does bias suppression moderate the relationship?

This research investigated how the relationship between prejudice and intergroup inequalities with justice judgments is modulated by individual differences in self-regulation of bias through suppression. The first study conducted among 170 White British adolescents revealed that the link between racism and intergroup inequality in justice judgments was moderated by bias suppression. Prejudice, bias suppression, and blatant as well as subtle justice judgments were assessed in a second study carried out with 103 Canadian White adolescents. Bias suppression moderated the link between racist beliefs toward Aboriginals and intergroup inequality in punitive rulings. Racism translated into intergroup inequality in the potential for rehabilitation, irrespective of the level of bias suppression. The role of bias suppression is discussed.     

Does the radial arm maze necessarily test spatial memory?

Since its design 25 years ago (Olton & Samuelson, 1976), the eight-arm radial maze has become very popular and is now widely used to assess spatial memory in rodents. Two versions of the full-baited maze protocol are present in the literature: with or without confinement between the visit of each arm. The confinement was introduced by Olton himself as early as 1977 (Olton, Collison, & Werz, 1977) to eliminate stereotypic behaviors that he had previously observed. It is widely regarded that the confinement prevents rodents from developing these response patterns, and as such it is considered an improved procedure to test spatial memory. Surprisingly, to the best of our knowledge, no study has been especially designed to demonstrate the efficacy of the confinement in blocking the stereotypic behaviors of the animals. The present study compares the strategies of rats trained with or without a confinement procedure. The results show that, after nine days of training, rats submitted to a 5- or a 10-s confinement reach the same level of performance as rats without confinement. The confinement totally prevents stereotypic behaviors like clockwise serial searching strategies which are often observed without confinement. Even a 0-s confinement is sufficient to prevent clockwise strategies, but rats seem to develop other stratagems which do not imply spatial memory. Furthermore, rats previously trained without confinement are unable to perform the task when confinement is introduced on a test day. In contrast, rats previously trained with confinement perform the task correctly when the confinement is no longer present. Thus, without confinement, good levels of performance can be achieved without precise spatial representations.     

Does the German version of the Exercise Dependence Scale measure exercise dependence?

ObjectiveTo examine the concordance of a questionnaire-based categorization as ‘at-risk for exercise dependence’ and an interview-based diagnosis of exercise dependence.DesignOne hundred thirty four subjects answered the German version of the Exercise Dependence Scale-21 (EDS-G). They were also assessed with a structured clinical interview for exercise dependence.MethodThe congruence between the questionnaire-based categorizations of ‘at-risk for exercise dependence’ and the diagnosis of exercise dependence based on the interview was examined using κ-coefficients.ResultThe agreement between questionnaire-based and interview-based diagnoses was fair to moderate with more false positive categorization based on the EDS-G.ConclusionAssuming that a structured clinical interview allows a more accurate diagnostic categorization, the EDS-G might overestimate the prevalence of exercise dependence.     

Does the revised multiple affect adjective checklist hostility subscale measure hostility?

In an attempt to clarify the nature of the construct measured by the Hostility subscale of Zuckerman and Lubin's [(1985): Educational and Industrial Testing Service] revised Multiple Affective Adjective Checklist (MAACL‐R), 104 undergraduates completed the MAACL‐R and the Aggression Questionnaire [Buss AH, Perry M. 1992. J Pers Soc Psychol 63:452–459]. Scores on the MAACL‐R Hostility subscale were found to be related to the Aggression Questionnaire subscales of Physical and Verbal Aggressiveness but not its Hostility subscale. It is concluded that although the MAACL‐R reflects some aspect(s) of aggressiveness, it may not be the best instrument for the measurement of hostility. Aggr. Behav. 25:179–184, 1999. © 1999 Wiley‐Liss, Inc.     

Does the Beck Anxiety Inventory measure anything beyond panic attack symptoms?

The Beck Anxiety Inventory (BAI) has become a popular measure in anxiety assessment and the BAI does not overlap in content with measures of depression. There is also some factor analytic evidence to support this distinction. However, an inspection of the BAI's content indicates that many of its items resemble, or are identical to, the symptoms of panic attacks listed in the DSM-IV. Further empirical support for this suspicion is provided from the results of a factor analysis of the BAI items and the individual DSM-IV panic symptoms contained in the Panic Attack Questionnaire, using data from a sample of 157 panic disorder patients. A three-factor model (dizziness related, catastrophic cognitions/fear, cardiorespiratory distress) emerged that replicated a three-factor model of panic symptoms identified in earlier work with another panic disorder sample. All but one of the BAI items loaded highly on the three panic symptom clusters and no separate BAI factor was obtained. The BAI appears to be confounded with, or actually measures, panic attacks rather than anxiety in general. Several implications of this finding are discussed.     

Sex differences in the association of math achievement with visual-spatial and verbal working memory: Does the type of math test matter?

Previous research on sex differences in mathematical achievement shows mixed findings, which have been argued to depend on types of math tests used and the type of solution strategies (i.e., verbal versus visual-spatial) these tests evoke. The current study evaluated sex differences in (a) performance (development) on two types of math tests in primary schools and (b) the predictive value of verbal and visual-spatial working memory on math achievement. Children (N = 3175) from grades 2 through five participated. Visual-spatial and verbal working memory were assessed using online computerized tasks. Math performance was assessed five times during two school years using a speeded arithmetic test (math fluency) and a word problem test (math problem solving). Results from Multilevel Multigroup Latent Growth Modeling, showed that sex differences in level and growth of math performance were mixed and very small. Sex differences in the predictive value of verbal and visual-spatial working memory for math performance suggested that boys seemed to rely more on verbal strategies than girls. Explanations focus on cognitive and emotional factors and how these may interact to possibly amplify sex differences as children grow older.