A review and critique of honesty test research

This paper reviews and critiques research pertaining to the three most commonly used honesty tests. Honesty tests, sometimes called integrity tests, purportedly predict theft by employees. Secondary analyses were performed to remove the effect of faking good from validity coefficients with various self-report criteria, and to supplement other analyses. The honesty tests were found to have: (a) virtually no foundation in personality or attitude theory, (b) a corrected average correlation of 0.08 with objective indices of theft (95′/0 confidence interval: 0.03 < r < 0.14), (c) a Taylor-Russell utility of approximately 1% above base rate of success, and (d) a false positive rate of 0.44 if only nontrivial thefts are considered. The honesty tests reviewed are of such marginal validity (less than 1% of the criterion variance accounted for) that their continued use in preemployment settings is seriously questioned. The comparability of these review results with those of other reviewers is discussed along with the social and legal implications of honesty testing.     

DRM范式下心境一致性错误记忆的认知机制

本研究以自编情绪DRM词表为实验材料, 用音乐诱发正常大学生被试正性、负性和中性心境, 探讨在被试处于某种心境下时是否产生心境一致性错误记忆现象、预警能否减少心境一致性错误记忆的发生。结果表明, 正性关键诱饵在正性心境下的错误再认率显著高于中性和负性心境, 负性关键诱饵在负性心境下的错误再认率显著高于中性和正性心境, 说明正常被试也会产生心境一致性错误记忆; 预警和无预警条件下被试对关键诱饵和心境一致性关键诱饵的错误再认率无显著差异, 说明外显的预警提示并不能消除部分由无意识产生的错误记忆和心境一致性错误记忆。研究结果支持记忆的扩散激活理论和情感的联想网络理论。     

The test validation summary

Common rates employed in classificatory testing are the true positive rate (TPR), false positive rate (FPR), positive predictive power (PPP), and negative predictive power (NPP). FPR and TPR are estimated from research samples representing populations to be distinguished by classificatory testing. PPP and NPP are used by clinicians to classify test takers into populations. PPP and NPP depend on the base rate (BR) of population members in the clinician's sample. The authors introduce the test validation summary (TVS) as a means to report within a single graph the FPR and TPR and the ranges of PPP and NPP across all potential sample BRs for any chosen cut score. The authors investigate how the TVS has other applications, including the estimation of local BR for the condition of interest and the estimation of standard errors for FPR and TPR when estimated across multiple independent validation studies of the classificatory test.     

Assessing the Effectiveness of Integrity Tests: A Review

Integrity tests, and other methods of assessing "honesty," are widely used in pre-employment screening, as most employers want to minimize dishonest and counterproductive behavior among their employees. This review applies a structured framework to the research literature to assess the general effectiveness of integrity tests. The framework employed evaluates integrity tests in terms of their scope, accuracy (reliability), relevance (validity), fairness, acceptability, and practicality. Such a framework based on these six aspects allows for an objective and systematic analysis of the qualities of integrity tests, as well as a structure for the evaluation of other methods of assessing honesty and integrity. For both narrow, overt measures of integrity and broader personality-based measures, research has shown favorable evidence of reliability, validity, fairness, and practicality. Even though in terms of acceptability research has indicated that integrity tests are viewed neither positively nor negatively, there is still considerable debate surrounding the issues of false positive rates and labeling. Comparisons with other methods of assessing honesty and integrity are also reviewed.     

Integrity and Honesty Testing: What Do We Know? How Do We Use It?

This selective review of integrity and honesty testing addresses two primary questions: ‘What do we know about honesty testing?’ and ‘How do we use what we know?’ Up-to-date information about test reliability, validity, and construct definition from recent reviews of the research literature in the USA is presented and interpreted. Relationships to other selection devices and personality measures are discussed, as well as how integrity tests fit into a multiple assessment selection system.     

A factor-adjusted multiple testing procedure for ERP data analysis

Event-related potentials (ERPs) are now widely collected in psychological research to determine the time courses of mental events. When event-related potentials from treatment conditions are compared, often there is no a priori information on when or how long the differences should occur. Testing simultaneously for differences over the entire set of time points creates a serious multiple comparison problem in which the probability of false positive errors must be controlled, while maintaining reasonable power for correct detection. In this work, we extend the factor-adjusted multiple testing procedure developed by Friguet, Kloareg, and Causeur (Journal of the American Statistical Association, 104, 1406-1415, 2009) to manage the multiplicity problem in ERP data analysis and compare its performance with that of the Benjamini and Hochberg (Journal of the Royal Statistical Society B, 57, 289-300, 1995) false discovery rate procedure, using simulations. The proposed procedure outperformed the latter in detecting more truly significant time points, in addition to reducing the variability of the false discovery rate, suggesting that corrections for mass multiple testings of ERPs can be much improved by modeling the strong local temporal dependencies.     

False feedback and beliefs influence name recall in younger and older adults

Feedback is an important self-regulatory process that affects task effort and subsequent performance. Benefits of positive feedback for list recall have been explored in research on goals and feedback, but the effect of negative feedback on memory has rarely been studied. The current research extends knowledge of memory and feedback effects by investigating face–name association memory and by examining the potential mediation of feedback effects, in younger and older adults, through self-evaluative beliefs. Beliefs were assessed before and after name recognition and name recall testing. Repeated presentation of false positive feedback was compared to false negative feedback and a no feedback condition. Results showed that memory self-efficacy declined over time for participants in the negative and no feedback conditions but was sustained for those receiving positive feedback. Furthermore, participants who received negative feedback felt older after testing than before testing. For name recall, the positive feedback group outperformed the negative feedback and no feedback groups combined, with no age interactions. The observed feedback-related effects on memory were fully mediated by changes in memory self-efficacy. These findings advance our understanding of how beliefs are related to feedback in memory and inform future studies examining the importance of self-regulation in memory.     

Making the case for objective performance metrics in newborn screening by tandem mass spectrometry

The expansion of newborn screening programs to include multiplex testing by tandem mass spectrometry requires understanding and close monitoring of performance metrics. This is not done consistently because of lack of defined targets, and interlaboratory comparison is almost nonexistent. Between July 2004 and April 2006 (N=176,185 cases), the overall performance metrics of the Minnesota program, limited to MS/MS testing, were as follows: detection rate 1:1,816, positive predictive value 37% (54% in 2006 till date), and false positive rate 0.09%. The repeat rate and the proportion of cases with abnormal findings actually been reported are new metrics proposed here as an objective mean to express the overall noise in a program, where noise is defined as the total number of abnormal results obtained using a given set of cut-off values. On the basis of our experience, we propose the following targets as evidence of adequate analytical and postanalytical performance: detection rate 1:3,000 or higher, positive predictive value>20%, and false positive rate<0.3%.     

The role of causal models in multiple judgments under uncertainty

Two studies examined a novel prediction of the causal Bayes net approach to judgments under uncertainty, namely that causal knowledge affects the interpretation of statistical evidence obtained over multiple observations. Participants estimated the conditional probability of an uncertain event (breast cancer) given information about the base rate, hit rate (probability of a positive mammogram given cancer) and false positive rate (probability of a positive mammogram in the absence of cancer). Conditional probability estimates were made after observing one or two positive mammograms. Participants exhibited a causal stability effect: there was a smaller increase in estimates of the probability of cancer over multiple positive mammograms when a causal explanation of false positives was provided. This was the case when the judgments were made by different participants (Experiment 1) or by the same participants (Experiment 2). These results show that identical patterns of observed events can lead to different estimates of event probability depending on beliefs about the generative causes of the observations.     

The illusion of the positive: The impact of natural and induced mood on older adults' false recall

ABSTRACT Recent research suggests that affective and motivational processes can influence age differences in memory. In the current study, we examine the impact of both natural and induced mood state on age differences in false recall. Older and younger adults performed a version of the Deese-Roediger-McDermott (DRM; Roediger & McDermott, 1995 , Journal of Experimental Psychology: Learning, Memory, and Cognition, 21, 803) false memory paradigm in either their natural mood state or after a positive or negative mood induction. Results indicated that, after accounting for age differences in basic cognitive function, age-related differences in positive mood during the testing session were related to increased false recall in older adults. Inducing older adults into a positive mood also exacerbated age differences in false memory. In contrast, veridical recall did not appear to be systematically influenced by mood. Together, these results suggest that positive mood states can impact older adults' information processing and potentially increase underlying cognitive age differences.     

Mood and positive testing in social interaction

Why, how and when does mood influence positive testing, that is, the selection of matching questions, when people actively search for information about others they meet? In four experiments, we demonstrated that happy mood increased positive testing compared to sad mood. Experiment 1 showed that happy participants were more strongly motivated to get along and smooth the interaction to come than sad ones. In addition, evidence was provided by a mediation analysis that happy mood increased the preference for positive testing because of such an improved motivation to get along. Furthermore, Experiment 2 showed that happy participants' preference for positive testing vanished when cognitive resources were limited. The preference for positive testing appeared under happy mood only when the context made salient the goal to get along (Experiments 3 and 4). Together, these results suggest that positive testing in a social‐hypothesis testing paradigm may have social values. Copyright © 2009 John Wiley & Sons, Ltd.     

Pre-employment honesty testing: Fakability,reactions of test takers,and company image

Two common employer concerns about pre-employment honesty testing were addressed: fakability and the test taker's reaction to such tests. Students, 84% with work experience in industries where honesty tests are common, took an honesty test under one of three instructional sets: respond honestly, fake good, and respond as if applying for a job. While subjects instructed to fake good could easily do so, the scores of subjects responding as job applicants more closely resembled those of subjects instructed to respond honestly. Strong negative reactions to honesty tests were not found; rather, most subjects felt that such tests were appropriate. The use of pre-employment honesty tests was not found to have a large impact on test taker perceptions of employers using such tests.     

The positive and negative consequences of multiple-choice testing

Multiple-choice tests are commonly used in educational settings but with unknown effects on students' knowledge. The authors examined the consequences of taking a multiple-choice test on a later general knowledge test in which students were warned not to guess. A large positive testing effect was obtained: Prior testing of facts aided final cued-recall performance. However, prior testing also had negative consequences. Prior reading of a greater number of multiple-choice lures decreased the positive testing effect and increased production of multiple-choice lures as incorrect answers on the final test. Multiple-choice testing may inadvertently lead to the creation of false knowledge.     

The fundamental attribution error in detecting deception: the boy-who-cried-wolf effect

Most people are unable to detect accurately when others are lying. Many explanations for this inability have been suggested but the cognitive heuristics involved in lie detection have received little attention. The present study offers evidence from two experiments, based on two different groups of observers, judging two different kinds of lies, presented in two different testing situations, that the fundamental attribution error significantly undermines the ability to detect honesty and deception accurately. Trait judgments of trustworthiness were highly correlated with state judgments of truthfulness, leading, as predicted, to positive correlations with honest detection accuracy and negative correlations with deception detection accuracy. More accurate lie detectors were significantly more likely than less accurate lie detectors to separate state and trait judgments of honesty. The effect of other biases, such as the halo effect and the truthfulness bias, also are examined. Implications for future research and practice are discussed.     

Derived false memories using a respondent‐type (ReT) procedure

The present investigation used a respondent‐type (ReT) training procedure to generate derived false memories. A one‐to‐many ReT training procedure was implemented in order to establish two stimulus equivalence classes, each consisting of one shape and 24 random words (i.e., Class 1 and Class 2). A partial test for stimulus equivalence with a subset of stimuli from each class followed. Failing an equivalence test resulted in additional ReT training and equivalence testing on new subsets of stimuli. After passing an equivalence test, participants were presented with 12 study‐list words from Class 1 for memorization, followed by a distraction task. Finally, free recall and recognition tests for the study‐list words were implemented. False recall and false recognition were more frequent for nonstudied Class 1 words than for nonstudied Class 2 words. These derived false‐memory effects were more pronounced among those participants exhibiting more training and testing cycles and higher accuracy on stimulus equivalence tests. Furthermore, false recall and false remembering of nonstudied Class 1 words were more frequent for words that had been equivalence‐tested than for words that had not been equivalence‐tested. These results show how responses to contiguous stimuli could produce derived false memories and also highlight the role played by the equivalence test in increasing their emergence.     

The effects of 'non-directive' questioning on an anticipated decision whether to undergo predictive testing for heart disease: an experimental study

This study investigates how individuals can be helped to make decisions about predictive genetic testing. Participants (n = 120) rated how likely they would be to opt for predictive testing for heart disease if it were available, and other variables such as anxiety about heart disease. They received information on predictive testing for heart disease and ratings were repeated. Participants were then randomly allocated to one of three groups and focused on the personal relevance of positive issues or negative issues which had been mentioned as part of the standardised information previously given. The third group focused on issues irrelevant to testing for heart disease. The form of questioning used in this focusing manipulation was intended to model the processes involved in non-directive questioning. Results showed a significant increase in likelihood of testing in the positive group, and a significant decrease in the negative group. There was also a significant decrease in rated anxiety about heart disease and perceived severity of an increased susceptibility to heart disease of the negative group relative to the positive and control groups. The results may have implications for the ways in which pre-test counselling is carried out.     

Test-induced priming of false memories

Of interest was whether prior testing of related words primes false memories in the Deese/Roediger-McDermott (DRM) paradigm. After studying lists of related words, subjects made old-new judgments about zero, three, or six related items before being tested on critical nonpresented lures. When the recognition test was self-paced, prior testing of list items led to faster false recognition judgments, but did not increase the rate of false alarms to lures from studied lists. Critically, this pattern changed when decision making at test was speeded. When forced to respond quickly—presumably precluding the use of monitoring processes—clear test-induced priming effects were observed in the rate of false memories. The results are consistent with an activation-monitoring explanation of false memories and support that retrieving veridical memories can be a source of memory error.     

Beyond the big five as predictors of dispositions toward ridicule and being laughed at: The HEXACO model and the dark triad

We aimed to extend research on dispositions toward ridicule and being laughed at by testing the localization of the fear of (gelotophobia) and the joy in (gelotophilia) being laughed at, and the joy in laughing at others (katagelasticism) in the HEXACO model and the Dark Triad traits (both have not been examined so far). Study 1 (HEXACO model: N = 216) showed that gelotophobia was related to low extraversion, high emotionality, and low honesty‐humility; gelotophilia to high extraversion and high openness to experience; and katagelasticism to low agreeableness and low honesty‐humility. These results were similar to prior findings based on the Five‐Factor model, and supported the notion that the honesty‐humility trait contributes to the prediction of individual differences in gelotophobia and katagelasticism. Study 2 (Dark Triad: N = 204) showed that gelotophobia was related to high Machiavellianism and low narcissism; gelotophilia to high narcissism; and katagelasticism to high psychopathy and high Machiavellianism. These data helped to clarify our findings on the honesty‐humility trait, showing that gelotophobes and katagelasticists differ in their socially aversive characteristics. Overall, this research provides empirical evidence that dark (but subclinical) traits can be seen as relevant personality predictors of how people deal with laughter and ridicule.     

When children are witnesses: The effects of context,age and gender on adults' perceptions of cognitive ability and honesty

The goals of the present study were to examine how context impacts perceptions of children, and the extent to which context interacts with a child's age and gender to alter adults perceptions of children. Specifically, we examine how perceptions of honesty (i.e. knowing the difference between truth and lie, being trusted by adults, being reliable, and honest) and cognitive ability (i.e. having a good memory for events and being able to attend and concentrate) are the same or different in the context of a child sexual abuse case (CSA) than when no context is provided. First, the results revealed few significant findings with regard to either juror or child gender. The analyses did reveal several context effects, with attention, trusted, reliable and honesty each producing higher ratings, and therefore better perceived memories, in the CSA condition than the no context condition. Also, ratings of all the dependent variables varied by age and 4 out of the 5 higher order interactions involved child age. Importantly, we found that ratings of honesty and cognitive abilities were not linear with age but, typically, ratings increased with age but then leveled out or started decreasing after 8 years‐of‐age. Copyright © 2010 John Wiley & Sons, Ltd.     

The Effects of Salesperson Compensation on Perceptions of Salesperson Honesty1

A reputation for honesty and trustworthiness is important to success in sales. In this article, we report 2 experiments examining the effects on perceived salesperson honesty of information about how the salesperson is compensated (commissions vs. straight salary). In both experiments, commissioned salesmen were perceived as less honest than were noncommissioned salesmen, but compensation method had no effect on the perceived honesty of saleswomen. The discussion of these findings focuses on their implications for sales management.