An assessment of the fakeability of self-report and implicit personality measures

Researchers are focusing on developing implicit measures of personality to address concerns related to the faking of self-report measures. The present study examined the validity and fakeability of Implicit Association Test (IAT) measures of personality self-concept in a repeated-measures design (N = 33). People’s predictions about how they represented themselves on the measures were also assessed. Results indicated that participants were able fake self-report measures when instructed to do so and that they could accurately predict how they represented themselves on these measures. Participants were also able to fake an IAT measure of Extraversion, but were unable to fake an IAT measure of Conscientiousness or predict how they represented themselves on either IAT measure.     

Do Applicants Fake Their Personality Questionnaire Responses and How Successful are Their Attempts? A Case of Military Pilot Cadet Selection

This paper presents the results of three interrelated studies investigating the occurrence of response distortion on personality questionnaires within selection and the success of applicants in faking situations. In Study 1, comparison of the Big Five personality scores obtained from applicants in a military pilot cadet selection procedure with participants responding honestly, faking good, and faking an ideal candidate revealed that applicants responded more desirable than participants responding honestly but less desirable than respondents under fake instructions. The occurrence of faking within the military pilot selection process was replicated in Study 2 using the Eysenck Personality Questionnaire and another comparison group. Finally, in Study 3, comparison of personality profiles obtained in selection and ‘fake job’ situations with experts' estimates indicated that participants were partially successful in faking the desirable profile.     

内隐联想测验“内隐性”的可控性研究

在许多社会科学研究中,社会称许性会对研究的效度产生不良影响。研究者希望能得到被试的真实态度和反应,从而极力避免这种社会称许性偏见。内隐测量工具的一个主要目的是让研究者能够获得未加任何粉饰的态度测量结果从而消除和避免自我表现和社会称许性。本文通过四个实验考察了内隐联想测验的可掩饰性、掩饰的持久性、掩饰的条件化和IAT经验的迁移性,结果显示：（1）被试可以通过一定的反应策略来掩饰其真实的内隐态度,从而使所测得的个体内隐态度和群体内隐态度失真,典型的反应策略是均衡相容和不相容任务的反应速度;（2）内隐联想测验的可掩饰性需以先前的IAT经验为基础,且IAT经验无需属于相同的测验范畴,对IAT原理的掌握将有助于被试成功地实施掩饰;（3）内隐联想测验的可掩饰性具有一定的时效性,先前的IAT经验越久远,则成功掩饰的可能性越低;总之,内隐联想测验并不能彻底避免社会称许性。     

Does perceived ability to deceive = ability to deceive? Predictive validity of the perceived ability to deceive (PATD) scale

This research investigated whether the perceived ability to deceive (PATD) scale predicts ability to deceive in a vocational testing context. Using a quasi-experimental design, participants (N = 85 student and community members) completed the PATD scale and a personality measure under standard instructions before being asked to fake the personality measure as if they were applying for a job in the police force. Based on extant research, successful faking was operationalised as elevated scores on conscientiousness and extraversion and reduced scores on neuroticism. Analysis via independent t-test did not support the hypothesis that PATD predicts faking success. Future research should consider the relationship between PATD and intention to fake, as well as extend examination of PATD to other deception-related contexts.     

Novel attitudes can be faked on the Implicit Association Test

We asked participants to imagine that a researcher would provide them with positive or negative information about fictitious social groups. Half of the participants were asked to act in such a way that they would conform to the expectations of the researcher. The other participants were asked to behave in the manner opposite to what the researcher expected. Participants then completed an IAT designed to measure the newly formed attitudes toward the fictitious social groups. The direction of the IAT effect depended on the faking instructions. The results call for caution when using the IAT to study the development of implicit attitudes.     

Faking revisited: Exerting strategic control over performance on the Implicit Relational Assessment Procedure

Across four studies, we demonstrate that effects obtained from the Implicit Relational Assessment Procedure, like those obtained from other indirect procedures, are not impervious to strategic manipulation. In experiment 1, we found that merely informing participants to “fake” their performance without providing a concrete strategy to do so did not eliminate, reverse, or in any way alter the obtained outcomes. However, when those same instructions orientated attention toward the core parameters of the task, participants spontaneously derived a strategy that allowed them to eliminate their effects (experiment 2). When the participants were provided with a viable response strategy, they successfully reversed the direction of their overall Implicit Relational Assessment Procedure effect (experiment 3). By refining the nature of those instructions, we managed to target and alter individual trial‐type effects in isolation with some success (experiment 4).     

Special Abilities Assessment in Children

The faking-detection validity and incremental validity of response latencies to Minnesota Multiphasic Personality inventory (MMPI) items was investigated using an analog research design. One hundred undergraduates were assigned at random to five groups: each group received different faking instructions (standard, fake good, fake bad, fake good with incentive, fake bad with incentive). All subjects completed a computer-administered version of the MMPI. Content-determined response deviance scores and latencies of responses to Subtle and Obvious scale items were determined for each subject. The principal findings suggest that response latencies may have greater faking good detection ability than responses deviance scores, and that response latencies have statistically significant incremental validity for both the detection of faking good and faking bad, when latencies are used with response deviance scores obtained from Subtle and Obvious scales.     

Employing automatic approach and avoidance tendencies for the assessment of implicit personality self-concept: The implicit association procedure (IAP)

A new chronometric procedure, the Implicit Association Procedure (IAP), was adapted to assess the implicit personality self-concept of shyness. A sample of 300 participants completed a shyness-inducing role play and, before or after the role play, a shyness IAP, a shyness Implicit Association Test (IAT), and direct self-ratings. The experimental group was instructed to fake nonshyness. The control group did not receive this instruction. IAT and IAP were unaffected by position effects, and were less susceptible to faking than direct self-ratings with regard to mean levels and correlates. Under faking, correlations between direct and indirect measures decreased, and direct but not indirect measures showed higher correlations with social desirability and lower correlations with observed shyness. Despite many similarities, the true correlation between IAT and IAP was estimated only .61, indicating high method-specific variance in both procedures. The findings suggest that indirect measures are more robust against faking than traditional self-ratings but do not yet meet psychometric criteria for practical assessment purposes.     

Intentional faking of the single category Implicit Association Test and the Implicit Association Test

The Implicit Association Test (IAT) provides a relative measure of implicit association strengths between target and attribute categories. In contrast, the Single Category Implicit Association Test (SC-IAT) measures association strength with a single attribute category. This can be advantageous if a complementary category--as used in the IAT--cannot be composed or is undesired. If the SC-IAT is to be a meaningful supplement to the IAT, it should meet the same requirements. In an online experiment with a large and heterogeneous sample, the fakability of both implicit measures was investigated when measuring anxiety. Both measures were fakable through specific instruction (e.g., "Slow down your reactions") but unfakable through nonspecific faking instruction even though nonspecific instruction was given immediately before the critical blocks (e.g., "Alter your reaction times"). When comparing the methodological quality of both implicit measures, the SC-IAT had lower internal consistency than the IAT. Moreover, with specific faking instructions, the SC-IAT was possible to fake to a larger extent than the IAT.     

Detecting Fake-Good and Fake-Bad MMPI-2 Profiles

This study examined the extent to which the validity scales of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) could identify subjects who were faking bad or faking good and differentiate between psychiatric patients and normal subjects who were faking bad. Subjects were 106 undergraduate college students and 50 psychiatric patients. Results indicate that the mean profiles and optimal cutoff scores resembled those previously reported for the original MMPI. Accurate identification of persons who were faking bad or faking good was achieved. It was possible to differentiate between the psychiatric patients and normal persons who were faking bad, but different cutoff scores were needed to differentiate between normals taking the test under standard instructions and those instructed to fake bad. Optimal cutoff scores were suggested.     

Filler items and social desirability in Rotter's locus of control scale

Three experiments were conducted to determine whether the use of filler items in Rotter's I-E scale fulfills its stated objective of obscuring the purpose of the scale. Subjects were undergraduate psychology students. Experiment 1 compared the effects of filler items and sex of subject on 145 subjects I-E scores. Experiment 2 examined effects of filler items and sex on I-E responses of 210 subjects under standard and fake good instructions. Experiment 3 examined subjects' ability to discern the purpose of the I-E scale, with and without the filler items. Filler items did not affect I-E score, impede subjects from faking good, or obscure knowledge of the purpose of the I-E scale. Sex differences occurred in faking good, knowledge and certainty of correctness of knowledge.     

Detecting fake-good and fake-bad MMPI-2 profiles

This study examined the extent to which the validity scales of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) could identify subjects who were faking bad or faking good and differentiate between psychiatric patients and normal subjects who were faking bad. Subjects were 106 undergraduate college students and 50 psychiatric patients. Results indicate that the mean profiles and optimal cutoff scores resembled those previously reported for the original MMPI. Accurate identification of persons who were faking bad or faking good was achieved. It was possible to differentiate between the psychiatric patients and normal persons who were faking bad, but different cutoff scores were needed to differentiate between normals taking the test under standard instructions and those instructed to fake bad. Optimal cutoff scores were suggested.     

The single category implicit association test as a measure of implicit social cognition

The Single Category Implicit Association Test (SC-IAT) is a modification of the Implicit Association Test that measures the strength of evaluative associations with a single attitude object. Across 3 different attitude domains--soda brand preferences, self-esteem, and racial attitudes--the authors found evidence that the SC-IAT is internally consistent and makes unique contributions in the ability to understand implicit social cognition. In a 4th study, the authors investigated the susceptibility of the SC-IAT to faking or self-presentational concerns. Once participants with high error rates were removed, no significant self-presentation effect was observed. These results provide initial evidence for the reliability and validity of the SC-IAT as an individual difference measure of implicit social cognition.     

Potential Effects of Faking on the NEO-PI-R: Willingness and Ability to Fake Changes Who Gets Hired in Simulated Selection Decisions

The impact of response distortion (faking) on selection decisions was investigated. Participants (N = 224) completed the NEO-PI-R under instructions to “make the most favorable impression” and/or “answer honestly.” Those instructed to fake were often over-represented at the top of the score distributions as instructions to fake resulted in higher scores both between and within groups in a test–retest situation. There was significantly lower correspondence between participants’ honest scores and their faked scores as well as multiple instances where participants with unfavorable honest scores subsequently produced the most favorable scores when faking. Response distortion may remain a serious threat to the use of personality test scores in selection.

THE SUSCEPTIBILITY OF OVERT AND COVERT INTEGRITY TESTS TO COACHING AND FAKING

Abstract— Although previous research has indicated that faking can affect integrity test scores, the effects of coaching on integrity test scores have never been examined We conducted a between-subjects experiment to assess the effects of coaching and faking instructions on an overt and a covert integrity test Coaching provided simple rules to follow when answering test items and instructions on how to avoid elevated validity scale scores There were five instruction conditions "just take,""fake good,""coach overt,""coach covert," and coach both All subjects completed both overt and covert tests and a measure of intelligence Results provided strong evidence for the coachability of the overt integrity test, over and above the much smaller elevation in the faking condition The covert test apparently could be neither coached nor faked successfully Scores on both integrity tests tended to be positively correlated with intelligence in the coaching and faking conditions We discuss the generalizability of these results to other samples and other integrity tests, and the relevance of the coachability of integrity tests to the ongoing debate concerning the prediction of counterproductive behavior     

Fakeability and correlates of the perception and preference inventory

This paper reports three studies designed to look at the usefulness of the Perception and Preference Inventory (PAPI). The first study looked at the fakeability of the PAPI by asking one group to fake good, another to fake bad, and a third group to respond honestly. Just over hald of the items yielded significant differences between the three groups, with most differences being between the fake bad and control group. In the second study the PAPI was correlated with the Eysenck Personality Questionnaire. Extraversion-Introversion and to a lesser extent neuroticism was correlated with PAPI subscores, particularly the dimensions of work direction and work style. Five of the seven subscale scores from the PAPI were correlated with extraversion. In the third study the PAPI was correlated with the Baddeley Reasoning Test, which is itself correlated with many intelligence tests. There were very few significant correlations. Implications for the measurement of personality and individual differences in occupational and industrial settings are considered.     

Using the implicit association test across cultures: A case of implicit self-esteem in Japan and Canada

Previous research has suggested that implicit self-esteem might be universally positive. In the present study implicit self-esteem, as measured by the implicit association test (IAT), was found to be positive in both Japanese and Canadian participants. However, contrary to prior research, Japanese participants were found to have significantly lower implicit self-esteem than Canadians. Japanese participants also had lower scores on an exploratory measure of collective implicit self-esteem. In general, the results of the present study point to the complexities in the study of implicit self-esteem across cultures. Inconsistencies between the present and previous research might reflect divergent methodologies used in the IAT. The applicability of the IAT in a cross-cultural setting is discussed.     

Effects of Response Instructions on Faking a Situational Judgment Test

A situational judgment test (SJT) and a Big 5 personality test were administered to 203 participants under instructions to respond honestly and to fake good using a within‐subjects design. Participants indicated both the best and worst response (i.e., Knowledge) and the most likely and least likely response (i.e., Behavioral Tendency) to each situation. Faking effect size for the SJT Behavioral Tendency response format was (d=.34) when participants responded first under honest instructions and (d=.15) when they responded first under faking instructions. Those for the Big 5 dimensions ranged from d=.26 to d=1.0. For the Knowledge response format results were inconsistent. Honest condition Knowledge SJT scores were more highly correlated with cognitive ability (r=.56) than were Behavioral Tendency SJT scores (r=.38). Implications for researchers and practitioners are discussed.     

The detection of feigned uncoached and coached posttraumatic stress disorder with the MMPI-2 in a sample of workplace accident victims

In this study research participants completed the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) under standard instructions and then were asked to fake posttraumatic stress disorder (PTSD) when completing the MMPI-2 for a 2nd time in 1 of 4 conditions with different instructions on how to fake PTSD: (a) uncoached, (b) coached about PTSD symptom information, (c) coached about MMPI-2 validity scales, or (d) coached about both symptoms and validity scales. These MMPI-2 protocols were then compared with protocols of claimants with workplace accident-related PTSD. Participants given information about the validity scales were the most successful in avoiding detection as faking. The family of F scales (i.e., F, FB, FP), particularly FP, produced consistently high rates of positive and negative predictive power.     

Assessing underreporting response bias on the MMPI-2

The authors assess the replicability of the two-factor model of underreporting response style. They then examine the relative performance of scales measuring these styles in analog (ARD) and differential prevalence group (DPG) designs. Principal components analysis produced a two-factor structure corresponding to self-deceptive (SD) and impression management (IM) response styles. The IM factor scale and related individual validity scales were elevated among research participants instructed to fake good on the MMPI-2 as compared with participants who completed the MMPI-2 under standard instructions (ARD) and among individuals evaluated in real-life assessment contexts where underreporting is expected (DPG). Participants in DPG samples produced significantly higher SD factor and related individual scale scores than did the ARD participants instructed to fake good. These findings confirm that the MMPI-2 validity scales measure two types of underreporting styles and that these styles may operate differently in ARD versus DPG designs.