Qualitative variations in personality inventories: subjective understandings of items in a personality inventory

Most studies using personality inventories do not take individual, subjective understandings of the items into account. The present study is one of the few to have investigated the quality of individuals’ psychological processes when making the Likert-like responses often used in psychological inventories. Respondents were asked to elaborate verbally on their Likert item responses to the 10-item short version of the Big Five Inventory. A common assumption about personality inventories is that there is a relatively homogenous understanding of the items and, in particular, the rating scales across respondents. However, our results suggest that the same item responses to a given item can reflect a variety of qualities across individuals’ understandings. At the same time, similar understandings and ways of relating to an item can lead to different item responses. Such findings have substantial implications for quantitative personality studies as well as quantitative survey or questionnaire studies, in general.     

Modeling Asymmetry in the Time–Distance Relation of Ordinal Personality Items

In analyzing responses and response times to personality questionnaire items, models have been proposed which include the so-called “inverted-U effect.” These models predict that response times to personality test items decrease as the latent trait value of a given person gets closer to the attractiveness of an item. Initial studies into these models have focused on dichotomous personality items, and more recently, models for Likert-type scale items have been proposed. In all these models, it is assumed that the inverted-U effect is symmetrical around 0, while, as will be explained in this article, there are substantive and statistical reasons to study this assumption. Therefore, in this article, a general inverted-U model is proposed which accommodates two sources of asymmetry between the response times and the attractiveness of the items. The viability of this model is demonstrated in a simulation study, and the model is applied to the responses and response times of the Temperament and Character Inventory–Revised, covering a broad range of personality dimensions.     

Developmental Patterns of Eyewitness Responses to Repeated and Increasingly Suggestive Questions

Kindergarten, Grade 2, Grade 4, and adult subjects viewed a brief video of two children arguing about the use of a bicycle. One week later subjects were asked for their free recall of the events in the video followed by sets of hierarchically arranged, increasingly suggestive questions that suggested a correct (positive-leading), an incorrect (misleading), or no specific (unbiased-leading) answer, with the final level of questioning for each item being a three-alternative multiple-choice question. Correct free recall varied with age, with the kindergarten and Grade 2 children generally following the lead of the first-level questions more so than the older subjects. Older children were as accurate as adults in responding to questions about the central items, but not so for noncentral items. Developmental differences were found in responses to repeated suggestive questioning, with kindergarten children following misleading questions and changing answers more often than older subjects. On the final, multiple-choice questions, kindergarten children were able to provide the correct answer as often as they had to the initial questions, despite intervening errors. Findings are discussed in terms of the type of questions presented, the repetition factors, and the opportunities for subjects changing their answers in response to subsequent questions about the same item.     

Subjective confidence in one's answers: the consensuality principle

In answering general-information questions, a within-person confidence-accuracy (C-A) correlation is typically observed, suggesting that people can monitor the correctness of their knowledge. However, because the correct answer is generally the consensual answer--the one endorsed by most participants--confidence judgment may actually monitor the consensuality of the answer rather than its correctness. Indeed, the C-A correlation was positive for items with a consensually correct answer but negative for items with a consensually wrong answer. Results suggest that the consensuality-confidence correlation may be mediated by 2 internal mnemonic cues that are correlated with consensuality: Consensual answers are reached faster and are selected more consistently by the same person on different occasions than nonconsensual answers. The results argue against a direct-access view of confidence judgments and suggest that such judgments will be accurate only as long as people's responses are by and large correct across the sampled items, thus stressing the criticality of a representative design.     

Do personality scale items function differently in people with high and low IQ?

Intelligence differences might contribute to true differences in personality traits. It is also possible that intelligence might contribute to differences in understanding and interpreting personality items. Previous studies have not distinguished clearly between these possibilities. Before it can be accepted that scale score differences actually reflect personality differences, personality items should show measurement invariance. The authors used item response theory to test measurement invariance in the five-factor model scales of the International Personality Item Pool (IPIP) and NEO-Five-Factor Inventory (NEO-FFI) across two groups of participants from the Lothian Birth Cohort 1936 with relatively low and high cognitive abilities. Each group consisted of 320 individuals, with equal numbers of men and women. The mean IQ difference of the groups was 21 points. It was found that the IPIP and NEO-FFI items were measurement invariant across all five scales, making it possible to conclude that any differences in IPIP and NEO-FFI scores between people with low and high cognitive abilities reflected personality trait differences.     

Self-informant Agreement for Personality and Evaluative Person Descriptors: Comparing Methods for Creating Informant Measures

Little attention typically is paid to the way self-report measures are translated for use in self-informant agreement studies. We studied two possible methods for creating informant measures: (a) the traditional method in which self-report items were translated from the first- to the third-person and (b) an alternative meta-perceptual method in which informants were directed to rate their perception of the targets' self-perception. We hypothesized that the latter method would yield stronger self-informant agreement for evaluative personality dimensions measured by indirect item markers. We studied these methods in a sample of 303 undergraduate friendship dyads. Results revealed mean-level differences between methods, similar self-informant agreement across methods, stronger agreement for Big Five dimensions than for evaluative dimensions, and incremental validity for meta-perceptual informant rating methods. Limited power reduced the interpretability of several sparse acquaintanceship effects. We conclude that traditional informant methods are appropriate for most personality traits, but meta-perceptual methods may be more appropriate when personality questionnaire items reflect indirect indicators of the trait being measured, which is particularly likely for evaluative traits.     

Differences between traits: properties associated with interjudge agreement

The present study concerns the relation between properties of personality traits and the agreement with which they are applied to real individuals. Subjects rated the 100 personality items of the California Q-Set on nine subjective dimensions, six of which loaded highly on a first principal component. This factor was interpreted as reflecting each trait's "easy visibility" to an outside observer. Actual interjudge agreement in applying each trait to real individuals was assessed in two ways: Self-other agreement was assessed in two independent samples, and interpeer agreement was assessed in three samples. Impressive and stable agreement was found for most Q items. The traits that were applied to individuals with the greatest interjudge agreement were the same ones that seemed most easily visible and tended to be positively relevant to extraversion and negatively relevant to neuroticism (identified through a factor analysis by McCrae, Costa, & Busch, 1986). The results suggest that traits defining extraversion are revealed relatively directly in social behavior and, therefore, are easy to judge, that traits defining neuroticism are less visible and, so, are judged less accurately, and that lay perceivers of personality are generally sensitive to this difference between traits.     

On initial item selection in cognitive diagnostic computerized adaptive testing

There has recently been much interest in computerized adaptive testing (CAT) for cognitive diagnosis. While there exist various item selection criteria and different asymptotically optimal designs, these are mostly constructed based on the asymptotic theory assuming the test length goes to infinity. In practice, with limited test lengths, the desired asymptotic optimality may not always apply, and there are few studies in the literature concerning the optimal design of finite items. Related questions, such as how many items we need in order to be able to identify the attribute pattern of an examinee and what types of initial items provide the optimal classification results, are still open. This paper aims to answer these questions by providing non‐asymptotic theory of the optimal selection of initial items in cognitive diagnostic CAT. In particular, for the optimal design, we provide necessary and sufficient conditions for the Q ‐matrix structure of the initial items. The theoretical development is suitable for a general family of cognitive diagnostic models. The results not only provide a guideline for the design of optimal item selection procedures, but also may be applied to guide item bank construction.     

A subset selection technique for scoring items on a multiple choice test

On a multiple-choice test in which each item hask alternative responses, the test taker is permitted to choose any subset which he believes contains the one correct answer. A scoring system is devised that depends on the size of the subset and on whether or not the correct answer is eliminated. The mean and variance of the score per item are obtained. Methods are derived for determining the total number of items that should be included on the test so that the average score on all items can be regarded as a good measure of the subject's knowledge. Efficiency comparisons between conventional and the subset selection scoring procedures are made. The analogous problem ofr > 1 correct answers for each item (withr fixed and known) is also considered.The authors are grateful to M. Aitkin, C. Coombs, F. Lord, and the reviewers for their comments and suggestions.     

Examining Faking on Personality Inventories Using Unfolding Item Response Theory Models

A concern about personality inventories in diagnostic and decision-making contexts is that individuals will fake. Although there is extensive research on faking, little research has focused on how perceptions of personality items change when individuals are faking or responding honestly. This research demonstrates how the delta parameter from the generalized graded unfolding item response theory model can be used to examine how individuals’ perceptions about personality items might change when responding honestly or when faking. The results indicate that perceptions changed from honest to faking conditions for several neuroticism items. The direction of the change varied, indicating that faking can operate to increase or decrease scores within a personality factor.     

I Remember When You Taught Me That! Preschool Children's Memories of Realistic Learning Episodes

This study examined whether preschool children are able to identify the source of new knowledge that they acquired in a stimulating, interactive learning context. Sixty 4‐ to 5‐year‐old children participated in two staged learning events. Several days later, children were asked questions that assessed their knowledge of factual information presented during the events. Children indicated whether they knew the answer to each question and whether they remembered the moment they learned it (i.e. had an episodic memory of the learning event), and then recalled event details. A majority of preschoolers were able to accurately identify how they had learned at least some factual information, but this ability was not consistent across children and test items. Recall of event‐specific details was positively correlated with correct answers to factual questions. The results indicate that when preschool children are asked to reflect on past learning experiences that occurred in complex and realistic contexts, their source monitoring abilities are evident but not yet fully developed. Copyright © 2013 John Wiley & Sons, Ltd.     

非言语五因素人格问卷(FF-NPQ):一种半投射式人格测验评介

非言语五因素人格问卷(FF-NPQ)由Paunonen等人于2001年开发,用于测查人格五因素。它是一种半投射式人格测验,由60幅黑白图片组成,被试用7点李克特量表评价图中中心人物的行为。FF-NPQ多用于跨文化研究,也可用于文盲、老人或有语言、阅读障碍人群的人格研究。多个国家研究表明,FF-NPQ的内部一致性信度、与多个言语式五因素人格问卷的会聚效度及对行为的预测效度,均达到了心理测量学要求。在中国,该测验尚未使用,建议引进并根据使用情况修订。     

项目表述效应的统计控制：以中文版生活定向测验为例

本研究以中文版生活定向测验（LOT-R）为例,使用CTCM和CTCU方法进行建模,旨在探讨中文表述的量表中是否存在项目表述效应以及影响项目表述效应的特质因素。采用中文版生活定向测验等量表组成的问卷对334名大学生进行测试。结果表明,中文版LOT-R存在项目表述效应,是一种反向题的项目表述效应,也可称为语言标签效应;在分离了反向题项目表述效应后,发现中文版LOT-R只存在乐观因子,而不再有悲观因子。这表明乐观-悲观同属于一种人格特质,而非两种不同的人格特质;反向题项目表述效应是一种结构性误差,会导致量表结构的扭曲。研究还发现担心错误和父母期望与反向题项目表述效应存在显著的负相关,表明越是担心错误或父母期望水平越高的被试,他们对反向题的项目表述效应（语言标签效应）越小。社会赞许性对反向题项目表述效应没有影响。     

Use of item ratings to examine personality test item cognitive response processes

This research examines the processes respondents use to answer personality test items. A total of 158 true/false items from four scales of the Personality Research Form and the California Psychological Inventory were used as stimuli. University students (N = 120) responded to each item and indicated one of nine strategies used in deciding on a response. Obtained response strategy ratings for items were reliable and their frequencies corresponded closely to previous findings with other items. Subsequently, the associations between item response strategy frequencies and item-total correlations were computed. Congruent with previous research, better items avoided behaviours or experiences and evoked responding based on traits and on referring to the statements of others. The associations between item response strategies and other indices of item quality are discussed and implications regarding scale development are offered.     

Valorisation professionnelle des biais attributifs commis par des candidats à un emploi confrontés aux potentialités d’inférences du Gros Cinq

It is of use, in recruiting situation, to characterize the applicants for a job by five dimensions known as personality dimensions. So one frequently uses the psychotechnical tests in which the given answers systematically conduce to assignments, and more precisely to internal assignment, even if they could be often the consequence of external causal factors. Our actual questions are, on the one hand about the possible valorization of these internal inferences, and on the other hand, more extensively, about the possible valorization of the attributive activity. Operationally, we asked to professionals of the recruitment to indicate, facing the items of a big five questionnaire exposing different conducts, the assignments that they should wait from a good (versus a bad) applicant for a job, knowing that missed the information permitting to do rationally any assignment. We observe, on the one hand that the valorization of the internal assignment is not systematic and that it depends notably on the proposed item valence, but especially that some assignments are valorized whereas our questionnaire made any attribution rationally impossible.     

The process of responding to personality items: Inconsistent responses to repeated presentation of identical items

A promising approach to understanding the processes involved when subjects respond to personality items is provided by the investigation of the causes of inconsistent responses when subjects answer the same item on two occasions. Among these causes are the properties of the item. Previous item research focused almost exclusively on properties which are not highly specific to the item, such as endorsement rate (ER) and social desirability scale value (SDSV). Although past studies found that items with ‘extreme’ SDSVs and/or ERs elicit fewer inconsistencies, these studies ignored more item-specific properties such as item content and item ambiguity. The present study demonstrates that contrary results regarding consistency may be obtained when more item-specific properties are taken into consideration. These results are interpreted as evidence that certain kinds of item content can increase the indecision and conflict that characterize some subjects' response processes.     

Computerized adaptive personality assessment: an illustration with the Absorption scale

This article introduces the theory behind and applications of adaptive personality assessment based on the item response theory. Two adaptive testing strategies were compared: (a) fixed test length and (b) clinical decision. Real-data simulations, based on the item responses from 1,000 subjects who had previously taken the 34-item Absorption scale (Tellegen, 1982) by means of paper-and-pencil format, were used to illustrate these strategies. Results suggest that computerized adaptive personality assessment works impressively well. With the fixed-test-length strategy, a 50% savings in administered items was achieved with little loss of measurement precision. In the clinical-decision testing strategy, individuals who were extreme on the Absorption trait were identified with perfect accuracy using, on average, 25% of the available items. The implications of these results for personality research and assessment are discussed.     

When confidence in a choice is independent of which choice is made

For forced-choice two-alternative general-information questions, confidence in the correctness of the answer differed reliably for different questions, regardless of which answer was chosen. Results suggested that this choice-independent confidence is mediated by the domain familiarity of the question and by its tendency to bring to mind either few or many thoughts and considerations. Ratings of the questions on familiarity and accessibility yielded strong correlations with participants’ confidence in whichever of two answers they had chosen, and with estimates of the percentage of participants who were likely to have chosen either of the answers in a previous experiment. The results were interpreted in terms of confirmation bias: Because items differ in the extent to which they bring to mind few or many pertinent thoughts, selective focusing on supportive evidence should yield a positive correlation between mean confidence in one answer and mean confidence in the alternative answer, as if there is no competition between them.     

The emerging self: the convergence of mind,personality and thinking styles

This paper aims to integrate research and theorizing about problem solving, self and personality into a comprehensive theory. With this purpose, the paper attempts to answer three questions: how do humans become aware of themselves and how do the products of self-awareness interrelate to produce an integrated self-system, which includes the domains of cognition and personality? How do persons know and influence each other? How do these processes change with development? The answers given to these questions by self, personality and cognitive developmental psychology are critically examined. It is concluded that an overarching model would have to assume a multilevel and multidimensional architecture. This would involve three main levels: the first includes general-purpose processes and functions, such as processing efficiency and working memory, which define current cognitive potentials; the second includes several domain-specific systems directed to different aspects of the environment; the third includes self-oriented processes that register, represent and regulate processes at the other two levels. Each person’s self-concepts result from the application of the third level on the other two and they differentially reflect their condition. Personality reflects the interaction between these self-concepts and dispositions to act in particular ways. Because humans share this architecture they can negotiate and affect each other’s self- and reflected representations. Thus, the formation of mind, self and personality results from a continuous flow of interactions between the levels and domains of mind within and across persons. The article summarizes a series of studies lending support to this general model.     

Item placement on a personality measure: effects on faking behavior and test measurement properties

Although personality tests are widely used to select applicants for a variety of jobs, there is concern that such measures are fakable. One procedure used to minimize faking has been to disguise the true intent of personality tests by randomizing items such that items measuring similar constructs are dispersed throughout the test. In this study, we examined if item placement does influence the fakability and psychometric properties of a personality measure. Study participants responded to 1 of 2 formats (random vs. grouped items) of a personality test honestly and also under instructions to fake or to behave like an applicant. Results indicate that the grouped item placement format was more fakable for the Neuroticism and Conscientiousness scales. The test with items randomly placed fit the data better within the honest and applicant conditions. These findings demonstrate that the issue of item placement should be seriously considered before administering personality measures because different item presentations may affect the incidence of faking and the psychometric properties of the measure.