The Barnum effect in a computerized Rorschach interpretation system

Twelve psychiatric outpatients were administered the Rorschach test, and results were interpreted using the Exner (1983, 1986) Report for the Comprehensive System computer-based test interpretation (CBTI) program. Four psychiatrists made accuracy ratings for both real and bogus reports for each of their patients. Data were analyzed using two-way analyses of covariance (ANCOVAs), where report type was a repeated main effect, psychiatrist was a random main effect, and the number of statements in the report was the covariate. Results indicated that this CBTI provided only 5% discriminating power for any one patient, with 60% of the interpretive statements merely describing typical characteristics of the outpatient population. No significant psychiatrist, interaction, or covariate effects were encountered.     

How satisfied are you with your job? Estimating the reliability of scores on a single‐item job satisfaction measure

Estimating the reliability of scores on single‐item measures can be difficult because commonly used internal consistency estimates of reliability cannot be calculated. When longitudinal data is available, statistical models can be used to decompose the variability in the latent variable at each wave into trait versus state variance. Then, reliability can be estimated as a ratio of the sum of the trait variance that is captured in repeated assessments over the total variance. The current study used latent trait‐state‐error models on a nine‐year longitudinal data (N = 5,003) to estimate the test–retest reliability of scores on a single‐item measure of job satisfaction. Results showed that job satisfaction scores were somewhat unreliable (r_xx = .49–.59) and amenable to change.     

Relationships between personality, attitudes and dietary behaviour in a group of Scottish adolescents

Dietary behaviours, dietary attitudes, dietary knowledge and personality were surveyed in a group of 451 Scottish schoolchildren aged 11–15 years. A factor analysis of the behaviour items gave a three-factor structure with factors designated Healthy Eating, Unhealthy Eating and Health Habits. A general healthy vs. unhealthy eating factor was also extracted. A factor analysis of the attitude statements gave factors designated Pickiness, Neophobia and Food Interest. Dietary knowledge was found to be positively correlated with Healthy Eating score and negatively correlated with Unhealthy Eating score. The personality trait of Psychoticism was positively correlated with Unhealthy Eating score and negatively correlated with dietary knowledge, whilst Neuroticism was significantly negatively correlated with Healthy Eating and Health Habits and significantly positively correlated with Pickiness and Neophobia. Gender and socio-economic status differences in behaviour and attitude factor scores are also reported.     

项目表述效应对人格测验信度和效标效度的影响——以核心自我评价量表(CSES)为例

项目表述效应是指由项目表述方式的差异引起的与测量内容无关的系统变异,项目表述效应模型的统计本质是一种双因子模型。本研究以核心自我评价量表(CSES)为例,探讨项目表述效应对人格测验信效度的影响。采用核心自我评价量表、生活满意度量表和积极情感消极情感量表对340名“蚁族”进行测查。结果表明,CSES在核心自我评价特质以外,还存在一个反向题项目表述效应因子;忽视项目表述效应对CSES的同质性信度和效标关联效度有重要影响：高估CSES的同质性信度,低估核心自我评价与生活满意度、积极情感的正相关,高估核心自我评价与消极情感的负相关。     

Prediction of differences in Rorschach protocols from the Personality Assessment System

The Personality Assessment System (PAS) is derived from certain subtest scores on any Wechsler test by rather simple calculations. It purports to measure, among other personality attributes, developmental changes in the Internalized-Externalized (I-E) dimension of personality, which is akin to the Introversion-Extroversion construct reflected by some Rorschach measures. PAS scores from a tightly defined sample of normal adults were contrasted with Experience Balance (EB) and Body-image (B) scores derived from Rorschach protocols by "blind" scorers. Significant relations were found between EB ratios produced via the Exner and Klopfer scoring systems and the primitive (early childhood) I-E scores from the PAS. The B scores produced by the Body Image scoring system were related to the basic (adolescent) I-E PAS scores. Although significant, the PAS-Rorschach correlations were relatively poor, in part because it was difficult to define the center of the internalization-externalization continuum in terms of the Rorschach protocols. It is, nevertheless, provocative that traditional scorings of the Rorschach responses of adults assess differences not only in this personality trait, but also in its development, as determined from scaled scores on Wechsler subtests.     

Item Variances and Median Splits: Some Discouraging and Disquieting Findings

ABSTRACT In his response to our article, Baumeister argued that in real data, the confound between interitem variance and trait extremity is small (typically in the range of 0 and –.2), and that the danger of artifact associated with the application of median splits to interitem variance is not as serious as our first simulation study would lead one to believe. When we examined a large body of actual personality data, employing personality scales of average reliability and relatively large samples, we found that the average magnitude of the confound was –.15. However, we also found that even a confound as small as –.03 could be associated with significant differential range restriction of the trait scores within subsamples produced by the median split (MS) technique. We note that several factors, not just the magnitude of the interitem variance/trait extremity confound, must be considered when assessing the danger of artifact associated with the MS technique. We again conclude that researchers should use the moderated multiple regression (MMR) technique in preference to the MS technique when testing for moderating effects in personality research.     

Predicting Stereotype Threat,Test Anxiety,and Cognitive Ability Test Performance: An Examination of Three Models

As the classroom and workplace, among other contexts, become more diverse in their population characteristics, the need to be aware of specific factors impacting testing outcome issues correspondingly increases. The focus in this study, among other purposes, was to identify possible interactions between examinee's individual-difference characteristics (e.g., personality) and characteristics of the testing environment on test anxiety reactions and cognitive ability test performance. This study assessed reactions and performance in 4 different testing conditions through a path-analytic testing of 3 well-established theoretical models of stress appraisal and coping (i.e., cognitive appraisal, personality trait, and transactional). The transactional model, incorporating both personality and testing condition factors, was best in predicting the variance associated with the cognitive ability test scores, the 3 test anxiety score indexes (i.e., social derogation, physical tenseness, and cognitive obstruction), and the stereotype threat scores. With personality traits, for example, agreeableness was a relatively strong and consistent predictor of all study measures. Regarding testing condition factors, only the manipulation of stereotype threat level (low or high) produced some significant accounting of variance. Higher perceived stereotype threat levels were generally associated with heightened stereotype threat belief perceptions, lower cognitive ability test scores, and, interestingly, reduced feelings of cognitive obstruction in test anxiety.     

The interclinician reliability of Rorschach interpretation in four data sets

To examine agreement on Rorschach Comprehensive System (CS; Exner, 2004) interpretations, 55 patient protocols were interpreted by 3 to 8 clinicians across 4 data sets on a representative set of 29 characteristics. Substantial reliability was observed across data sets, although a problematic design produced lower results in one. Unexpectedly, a Q-sort task had slightly lower reliability than a simple rating task. As expected, scales that summarized judgments had higher agreement than judgments to individual interpretive statements, and some clinicians produced more generalizable inferences than others. Interpretations for all clinicians were more strongly associated with patients' psychometric true scores (aggregated judgment M range = .82 to .92) than with the judgments of other clinicians (range = .76 to .89). Compared to meta-analyses of interrater reliability in psychology and medicine, the findings indicate these clinicians could reliably interpret Rorschach CS data.     

Individual differences in preschool children: temperament or personality?

Individual differences among adults have generally been conceptualized in terms of personality theory and traits. In contrast, individual differences among very young children (birth to kindergarten) have generally been conceptualized in terms of temperament theory and traits. The present study compares and contrasts measures of temperament and personality in a sample of preschool children. Temperament traits were assessed with a well‐established measure (the Rothbart CBQ), and a new preschool rating instrument was used to assess personality traits from the five‐factor framework (M5‐PS). Indeed, a key purpose of this study was to further the development of the M5‐PS. Data were gathered on 122 preschool children who were rated by their teachers. Significant correlations were found between the temperament trait Surgency and the personality trait Extraversion, between the temperament trait Negative Affect and the personality trait Neuroticism, and between the temperament trait Effortful Control and the personality trait Conscientiousness. The overall pattern of correlational data suggests that individual differences in preschool children can be adequately described using the five‐factor theory, and that this framework may effectively subsume traditional theories of temperament. Preliminary support for the reliability and validity of the M5‐PS is offered. Copyright © 2010 John Wiley & Sons, Ltd.     

Separate personality traits from states to predict depression

Results have been inconsistent regarding the ability of personality measures to predict future depression severity levels, leading some researchers to question the validity of personality assessment, especially when patients are acutely depressed. Using a combination of regression and factor analytic techniques, we separated the variance of personality measures into stable trait and variable state-affect components. Findings supported the hypotheses that depression severity measured at different time points would correlate with both stable trait and concurrent state-affect components in personality measures, whereas change in depression severity would correlate with state changes but not with stable trait scores. Thus, personality assessments tap both state affect and trait variance, with the state-affect variance masking the trait variance when patients are depressed.     

Are All Kids Alike? The Magnitude of Individual Differences in Personality Characteristics Tends to Increase from Early Childhood to Early Adolescence

Do individual differences in personality traits become more or less pronounced over childhood and adolescence? The present research examined age differences in the variance of a range of personality traits, using parent reports of two large samples of children from predominantly the USA and Russia, respectively. Results indicate (i) that individual differences in most traits tend to increase with age from early childhood into early adolescence and then plateau, (ii) that this general pattern of greater personality variance at older childhood age is consistent across the two countries, and (iii) that this pattern is not an artefact of age differences in means or floor/ceiling effects. These findings are consistent with several (noncontradictory) developmental mechanisms, including youths' expanding behavioural capacities and person–environment transactions (corresponsive principle). However, these mechanisms may predominantly characterize periods before adolescence, or they may be offset by countervailing processes, such as socialization pressure towards a mature personality profile, in late adolescence and adulthood. Finally, the findings also suggest that interpreting age trajectories in mean trait scores as pertaining to age differences in a typical person may sometimes be misleading. Investigating variance should become an integral part of studying personality development. Copyright © 2017 European Association of Personality Psychology     

DAPP-BQ: factor structure and relations to personality disorder symptoms in a non-clinical sample

We assessed the factor structure of the DAPP-BQ (Livesley & Jackson, in press), as well as the relations between DAPP-BQ higher- and lower-order personality trait scores and DSM-IV (APA, 2000) personality disorder symptoms in a sample of approximately 300 nonclinical young adults. The four-factor structure of the DAPP-BQ was replicated, and DAPP-BQ higher-order and lower-order scores were related to personality disorder symptoms in predictable ways. Finally, regression analyses revealed that specific DAPP-BQ traits accounted for variance in individual personality disorder scores above and beyond comorbid personality disorder symptoms.     

Personality, intelligence and proof-reading

Two studies sought to determine personality and cognitive ability correlates of proof-reading. In both studies candidates were given 5 min to identify up to 55 errors in a 920 word, two page document. In Study 1, which tested 240 school children, fluid intelligence (as measured by the Baddeley Reasoning Test) was the highest correlate of proof-reading (r = .30). Eleven percent of the variance in total attempted scores was accounted for by intelligence, Introversion and low Conscientiousness. In the second study 70 undergraduates completed the same proof-reading test along with two intelligence tests (Baddeley Reasoning Test; Wonderlic Personnel Test) and a more robust personality measure (NEO-FFI). Proof-reading was correlated with both intelligence tests (Baddeley r = .45; Wonderlic r = .40). More of the variance was accounted for in the total attempted-score of errors than for a correct errors-detected score. When the two intelligence and five personality trait scores were regressed on to the proof-reading test score over a quarter of the variance (Adj R² = .28) was accounted for, but only the Baddeley test was a significant predictor (Beta = .39).     

Using reliability generalization methods to explore measurement error: an illustration using the MMPI-2 PSY-5 scales

Reliability generalization (RG) is a meta-analytic technique that allows for the systematic examination of variation in score reliability for different samples of test takers; this procedure is based on the recognition that reliability is not a stable property of a test but is sample dependent. As a demonstration of an RG analysis, I obtained 63 reliability coefficients for each of the MMPI-2 (Butcher et al., 2001) Personality Psychopathology 5 (Harkness, McNulty, & Ben-Porath, 1995) scales. The overall variability of alpha coefficients supports the argument that reliability is sample dependent and underscores the need for researchers to calculate reliability estimates based on their research samples rather than simply citing published alpha coefficients as evidence of score reliability. I observed statistically significant mean reliability differences for scores across the 5 scales, with the highest level of reliability observed for scores on the measure of Negative Emotionality and the lowest levels of reliability observed for scores on the measures of Aggression and Disconstraint. There was no evidence that the sex-composition of a sample was systematically related to score reliability, and there were no statistically significant differences in reliability between scores obtained with the English version of the test and those obtained with translated forms. However, reliability was consistently lower for scores on some scales when the data were obtained in nonclinical settings as opposed to clinical ones. Sample size was not significantly correlated with reliability estimates. RG methods have the potential for deepening the level of understanding about the role of reliability in the evaluation and use of personality tests.     

The Team Personality–Team Performance Relationship Revisited: The Impact of Criterion Choice,Pattern of Workflow,and Method of Aggregation

Using meta-analytic evidence, this study tested trait- and task-based theoretical approaches to team personality management, using both team behaviors and team outcomes as criteria. Trait theories state that maximization of the team trait is harmful for Extroversion (complementary team fit) but beneficial for Conscientiousness, Agreeableness, and Emotional Stability (supplementary fit). Task-based theories state that tasks with few work exchanges are best reflected by mean trait scores, whereas tasks with frequent work exchanges are best represented by other types of scores (e.g., minimum score). Correlations between different aggregations of team personality and team performance were coded, as well as the study criterion choice and the pattern of workflow (as moderators). Partial support for both trait and task theories were found. Team Conscientiousness and Agreeableness provided supplementary fit primarily with team behaviors, but there was mixed evidence that Extroversion provided complementary fit. Furthermore, minimum and variance measures of the team trait related to team performance in tasks with frequent work exchanges, but not in tasks with few work exchanges. Results suggest several limitations with existing measurement methods, which are discussed.     

Changes in women's assertiveness in response to status and roles: a cross-temporal meta-analysis, 1931-1993

Across two meta-analyses, American women's assertiveness rose and fell with their social status from 1931 to 1993. College women and high school girls' self-reports on assertiveness and dominance scales increased from 1931 to 1945, decreased from 1946 to 1967, and increased from 1968 to 1993, explaining about 14% of the variance in the trait. Women's scores have increased enough that many recent samples show no sex differences in assertiveness. Correlations with social indicators (e.g., women's educational attainment, women's median age at first marriage) confirm that women's assertiveness varies with their status and roles. Social change is thus internalized in the form of a personality trait. Men's scores do not demonstrate a significant birth cohort effect overall. The results suggest that the changing sociocultural environment for women affected their personalities, most likely beginning in childhood.     

The Conceptual Complexity of Presidents Carter and Clinton: An Automated Content Analysis of Temporal Stability and Source Bias

Previous work on the measurement of leaders' foreign policy orientations by Margaret G. Hermann argues that spontaneous utterances should provide more useful indications of stable personality characteristics than prepared statements. This paper reconsiders this question for Presidents Jimmy Carter and Bill Clinton through an automated coding system. A large number of spontaneous utterances and prepared statements by these presidents were compared in an effort to determine the stability of their conceptual complexity across source types and over time. The findings support the ability of Hermann's conceptual complexity measurement to capture robust differences between individuals; however, scores derived from spontaneous comments varied significantly from those derived from prepared remarks. In addition, the trait appears to be stable for some subjects (Carter) but not for others (Clinton).     

Estimating one's own personality and intelligence scores

One hundred and eighty‐seven university students completed the full NEO‐PI‐R assessing the five super‐traits and 30 primary traits, and the Wonderlic Personnel Test of general intelligence. Two months later (before receiving feedback on their psychometric scores), they estimated their own scores on these variables. Results at the super‐factor level indicated that participants could significantly predict/estimate their own Neuroticism, Extraversion, and Conscientiousness scores. The correlation between estimated and psychometrically measured IQ was r=.30, showing that participants could, to some extent, accurately estimate their intelligence. In addition, there were a number of significant correlations between estimated intelligence and psychometrically assessed personality (particularly Neuroticism, Agreeableness and Extraversion). Disagreeable people tended to award themselves higher self‐estimated intelligence scores. Similarly, stable people tended to award themselves higher estimates of intelligence (even when other variables were controlled). Regressing both estimated and psychometric IQ scores onto estimated and psychometric personality scores indicated that the strongest significant effect was the relationship between trait scores and self‐estimated intelligence.     

Is personality stable in adolescence? Disentangling time-invariant and time-varying factors of personality in a trait–state–occasion model

This study applied trait–state–occasion (TSO) modelling to investigate the extent to which inter-individual differences in personality were accounted for by time-invariant and time-varying factors during adolescence. The participants were 753 high school students, and only 661 students were followed for 4 years. The mean age in the first year was 15.23 years and 52.8% were females. The results showed that the full TSO model had the best representation of adolescent personality, and the means of the proportions of variance explained by trait factors for the Big Five ranged between 56% and 83%, suggesting that inter-individual differences in personality are mainly accounted for by stable trait variance over the course of adolescence. Furthermore, the five dimensions of personality differed not only in the amounts of trait variance but also in the stability of time-varying factors. These findings have significant implications for personality research.     

Validity of the sex-role egalitarianism scale: Discriminating egalitarianism from feminism

To explore and to clarify the discriminant validity of the sex role egalitarianism construct, the Sex-Role Egalitarianism Scale (SRES) was administered in conjunction with the Attitudes Toward Women Scale (AWS) and eight personality trait measures to 108 individuals. Results indicated a hypothesized curvilinear relationship between scores on the SRES and the AWS. When personality traits were individually regressed on SRES and AWS, SRES scores uniquely accounted for variance in achievement locus of control, and AWS scores uniquely accounted for variance in need for autonomy and need for succorance. Findings were supportive of the viability of sex role egalitarianism as an attitudinal dimension having meaning beyond that of a traditional — feminist dimension.