Social desirability of subtle and blatant prejudice scales

The present paper analyzes the relation between the measurement of subtle and blatant prejudice proposed by Pettigrew and Meertens in 1995 and the tendency to give socially desirable responses. It also tests whether items that measure subtle prejudice are judged as more socially desirable than those that measure blatant prejudice. Data were obtained from two groups, one of 497 Italian high school students and one of 77 university students. In the first case, the analysis concerns the relation between the prejudice scores and scores on a shortened form of Marlowe and Crowne's Social Desirability Scale. In the second case, we analyzed the social desirability judgments expressed on single items of the Petrigrew and Meertens scales. Analyses indicate that (1) neither Subtle nor Blatant Prejudice scores correlate with the tendency to give socially desirable responses and (2) when the items of the two prejudice scales are placed in order on the social desirability continuum, with very few exceptions the Blatant Prejudice items are situated at the not socially acceptable pole and Subtle Prejudice items at the socially acceptable pole.     

Assessing MMPI Constructs Through the Measurement of Response Latencies

Responses to the Minnesota Multiphasic Personality Inventory (MMPI) were assessed with respect to their relevance to schema theory. The relation between scores on self-reported personality dimensions and the speed of processing test items associated with each dimension was examined. With previously derived factor analytic content scales, negative correlations were obtained between scale scores and mean latencies for endorsing relevant items, and positive correlations were found between scale scores and mean latencies for rejecting relevant items. A similar analysis completed on the traditional clinical scales revealed no such pattern. Results were interpreted as supporting the conceptualization of item responding as a content-based, schema-relevant process.     

Assessing MMPI constructs through the measurement of response latencies

Responses to the Minnesota Multiphasic Personality Inventory (MMPI) were assessed with respect to their relevance to schema theory. The relation between scores on self-reported personality dimensions and the speed of processing test items associated with each dimension was examined. With previously derived factor analytic content scales, negative correlations were obtained between scale scores and mean latencies for endorsing relevant items, and positive correlations were found between scale scores and mean latencies for rejecting relevant items. A similar analysis completed on the traditional clinical scales revealed no such pattern. Results were interpreted as supporting the conceptualization of item responding as a content-based, schema-relevant process.     

Patterns of extreme responses to items in self-esteem scales: Does conceptualisation and item content matter?

Self-esteem (SE) scales are particularly susceptible for various response-sets. Systematic response alterations, often mirroring self-presentational item characteristics, can be triggered differentially depending on the content of items in a scale. The present study examined extreme responding to items in the global SE scale (Rosenberg, 1965) and the basic SE scale (Forsman & Johnson, 1996). The results showed that global SE scores were determined to a higher extent by extreme responses, in particular rejecting negative item content, than basic self-esteem scores. The implications of self-presentation contra self-esteem for an asymmetry in response patterns between the two scales are discussed.     

Qualitative variations in personality inventories: subjective understandings of items in a personality inventory

Most studies using personality inventories do not take individual, subjective understandings of the items into account. The present study is one of the few to have investigated the quality of individuals’ psychological processes when making the Likert-like responses often used in psychological inventories. Respondents were asked to elaborate verbally on their Likert item responses to the 10-item short version of the Big Five Inventory. A common assumption about personality inventories is that there is a relatively homogenous understanding of the items and, in particular, the rating scales across respondents. However, our results suggest that the same item responses to a given item can reflect a variety of qualities across individuals’ understandings. At the same time, similar understandings and ways of relating to an item can lead to different item responses. Such findings have substantial implications for quantitative personality studies as well as quantitative survey or questionnaire studies, in general.     

Socially desirable responding and its elusive effects on the validity of personality assessments

Past studies of socially desirable self-reports on the items of personality measures have found inconsistent effects of the response bias on the measures' predictive validities, with some studies reporting small effects and other studies reporting large effects. Using Monte Carlo methods, we evaluated various models of socially desirable responding by systematically adding predetermined amounts of the bias to the simulated personality trait scores of hypothetical test respondents before computing test-criterion validity correlations. Our study generally supported previous findings that have reported relatively minor decrements in criterion prediction, even with personality scores that were massively infused with desirability bias. Furthermore, the response bias failed to reveal itself as a statistical moderator of test validity or as a suppressor of validity. Large differences between some respondents' obtained test scores and their true trait scores, however, meant that the personality measure's construct validity would be severely compromised and, more specifically, that estimates of those individuals' criterion performance would be grossly in error. Our discussion focuses on reasons for the discrepant results reported in the literature pertaining to the effect of socially desirable responding on criterion validity. More important, we explain why the lack of effects of desirability bias on the usual indicators of validity, moderation, and suppression should not be surprising.     

Differential responding to positive and negative items: the case of a negative item in a questionnaire for course and faculty evaluation

Previous factor-analytic studies of self-rating scales have yielded a factor on which negatively worded items loaded separately. The present study investigated the existence for such a factor in a questionnaire for course and teacher evaluation which included one negative item. The questionnaire was administered in 1,095 university classes. Two factors emerged, an exclusively positive-item factor and another factor on which the single negative item and one positive item loaded. It was suggested that both items of Factor 2 were ambiguous and may identify tendencies such as acquiescence, random responding, and response sets.     

Detecting random responders with infrequency scales using an error-balancing threshold

Infrequency scales are becoming a popular mode of data screening, due to their availability and ease of implementation. Recent research has indicated that the interpretation and functioning of infrequency items may not be as straightforward as had previously been thought (Curran & Hauser, 2015), yet there are no empirically based guidelines for implementing cutoffs using these items. In the present study, we compared two methods of detecting random responding with infrequency items: a zero-tolerance threshold versus a threshold that balances classification error rates. The results showed that a traditional zero-tolerance approach, on average, screens data that are less indicative of careless responding than those screened by the error-balancing approach. Thus, the de facto standard of applying a “zero-tolerance” approach when screening participants with infrequency scales may be too stringent, so that meaningful responses may also be removed from analyses. Recommendations and future directions are discussed.     

Not too little, but not too much: The perceived desirability of responses to personality items

Paradigms typically employed to investigate socially desirable responding in personality assessment implicitly assume linear relationships exist between trait level and desirability but recent research has called this assumption into question. In this study, participants rated the desirability of a hypothetical applicant to one of four jobs on the basis of which five-point Likert-type scale option he/she selected when responding to personality items. Results generally indicated that the most extreme option, on the desirable side of the response scale, was rated as most desirable, but perceived desirability asymptotes with the penultimate option. The middle (neutral) option, however, was consistently regarded as being much less desirable. The occupational context also significantly moderated the patterns of desirability ratings for many items.     

Development and evaluation of an inventory to assess adult stutterers'' communication attitudes

The purpose of this study was to develop and evaluate a procedure to assess adult stutterers' communication attitudes. To this end, the investigation was divided into two phases. In Phase I, an assessment inventory based on a tripartite attitudinal model was developed and administered to 107 adult stutterers. Reliability and validity of these procedures were examined, and the inventory was refined. In Phase II, reliability and validity of the attitude assessment procedures were reassessed, and the attitudes of 26 stutterers and 56 nonstutterers were examined. Assessment procedures involved a self-report inventory, which obtained ratings of items in 13 situational subscales representing different speaking situations. These situations were rated using four response scales reflecting behavioral, affective, and cognitive aspects of attitude. Situational responding, response scale scores, and response scale interrelationships are examined. Findings are discussed in terms of the potential value of the inventory and future investigations.     

Testing the Relationship Between Parents’ and Their Children’s Subjective Well-Being

Casas et al. (J Happiness Stud 9(2):197–205, 2008) found no significant relationship between paired answers given by parents and their 12–16-year-old children (N?=?266) for a single-item scale on overall life satisfaction (OLS). However, a significant, but low (.19) parent–child relationship did appear for the PWI multi-item scale. Overall, children reported higher subjective well being than parents. In this article, we present the results obtained from confirmatory factor analysis (CFA), using more scales and a bigger sample (N?=?1,250) of paired parents and children. The study uses three multiple-item scales: the PWI, the SWLS and the BMSLSS, and six single-item scales: the OLS, two items from Russell’s scale on core affects, one on overall happiness, Fordyce’s happiness item and the optional item of the BMSLSS on overall life satisfaction. Separate CFA for each of the 3 multi-item scales showed good fit statistics. In order to check comparability between parents and children, we tested equal loading and intercept constraints. The models with restricted loadings fit only for the PWI and BMSLSS, but none of the models with restricted intercepts fit. Therefore, it was only possible to estimate two factor correlations for parents and their children, both very low (.16 for the PWI, .18 for BMSLSS), and it was not possible to compare factor means. When correlating scores from the 6 single-item scales for parents and children, they were all found to be significant but very low. As regards items from the multiple-item scales for parents and children many correlations are positive and significant, although very low, but others are non significant. The means of some items were substantially higher for children than for parents. For some items, differences were minor, non-significant or even reversed. All of the results suggest that parents’ well-being is very weakly related to their own children’s well-being, in spite of socialization, common material welfare and genetic influences. However, one outstanding result is that in our Catalan sample, parents’ well-being seems to have a greater influence on their female child’s well-being than on their male child’s.     

Using reliability generalization methods to explore measurement error: an illustration using the MMPI-2 PSY-5 scales

Reliability generalization (RG) is a meta-analytic technique that allows for the systematic examination of variation in score reliability for different samples of test takers; this procedure is based on the recognition that reliability is not a stable property of a test but is sample dependent. As a demonstration of an RG analysis, I obtained 63 reliability coefficients for each of the MMPI-2 (Butcher et al., 2001) Personality Psychopathology 5 (Harkness, McNulty, & Ben-Porath, 1995) scales. The overall variability of alpha coefficients supports the argument that reliability is sample dependent and underscores the need for researchers to calculate reliability estimates based on their research samples rather than simply citing published alpha coefficients as evidence of score reliability. I observed statistically significant mean reliability differences for scores across the 5 scales, with the highest level of reliability observed for scores on the measure of Negative Emotionality and the lowest levels of reliability observed for scores on the measures of Aggression and Disconstraint. There was no evidence that the sex-composition of a sample was systematically related to score reliability, and there were no statistically significant differences in reliability between scores obtained with the English version of the test and those obtained with translated forms. However, reliability was consistently lower for scores on some scales when the data were obtained in nonclinical settings as opposed to clinical ones. Sample size was not significantly correlated with reliability estimates. RG methods have the potential for deepening the level of understanding about the role of reliability in the evaluation and use of personality tests.     

Development and Validation of the Sexist Attitudes Toward Women Stale (SATWS)

Although sexism is now defined as a major social problem, there have been very few empirical studies investigating its correlates and determinants. One primary reason for this is that there are no published sexism scales, and hence it is difficult to assess individual differences in sexism. This article describes the development and validation of a 40-item Sexist Attitudes Toward Women Scale (SATWS). On rational-intuitive grounds, it is hypothesized that sexism toward women has seven components and, accordingly, items were written to reflect these. It is suggested that scales measuring only one of these components (e.g., sex-role stereotype scales and women's liberation movement scales) lack content validity as measures of sexism. On empirical grounds it is argued that the SATW scale also has stronger construct validity as a measure of sexism toward women than other such scales. The SATW scale has high internal consistency reliability for both college students and nonstudent adults and the SATW scale scores are independent of social desirability scores. Relationships to age, sex, and education are presented.     

THE EFFECTS OF REQUIRED ELABORATION OF ANSWERS TO BIODATA QUESTIONS

The impact of a request that examinees elaborate on their answers to a subset of items in a biodata instrument was evaluated. Four forms of a test in which different subsets of items are elaborated were randomly administered to 4 groups of examinees taking a pilot form of a selection instrument for a civil service position. Results indicated significantly lower scores on items for which elaborations were requested than the items for which no elaborations were requested. Lower scores were also observed for nonelaborated items when these items were embedded among those that were elaborated, and lower scores were found when the elaborated items were presented only in the first half of the test. Although the results suggest that requiring elaborated answers may reduce scores on biodata items, several practical and theoretical questions should be investigated to determine the utility of this approach as a method of reducing socially desirable responding.     

MMPI-2 L + K and L + K - F indexes of underreporting: normative and desirable responding

Norms based on the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) normative sample are provided for the L + K and L + K - F indexes of underreporting and defensiveness. Index scores produced by consistently desirable responding, which was guided by desirability ratings of the MMPI-2 items, also are provided and compared with scores produced by underreporting in other studies. The indexes correlate highly with other measures of underreporting in both normative and clinical samples. The L and K scales assess different types of underreporting and should be interpreted separately as well as in combination. The L scale can be elevated by undesirable responding or random responding in addition to desirable responding.     

MMPI and nightmare reports in women addicted to alcohol and other drugs

In a sample of 78 female alcohol and drug addicts, 24.4% marked True the Item 31 ("I have nightmares every few nights") of the MMPI. The proportion is significantly higher than in normative MMPI data of normal US Midwest women published by Coligan: only 8.2% of the latter marked the item True. The female alcohol and drug addicts who marked the item True differed from those responding with False by higher scores on Schizophrenia, Psychasthenia, Paranoia, Anxiety, Depression, Psychopathic Deviate, and Social Introversion scales and by lower scores on Ego Strength scale. Nightmare sufferers consistently scored in a more pathological direction.     

Self-report measurement of type A behavior: toward refinement and improved prediction

Self-report measures of Type A personality receive wide research usage despite mounting evidence that they are poor predictors of coronary heart disease. It was proposed that the limited prediction results in part from the failure to restrict measurement to only those Type A characteristics that are demonstrably related to excessive stress. The first study in this article reports a factor analysis of all items on the Jenkins Activity Survey (JAS), the most popular Type A questionnaire, along with 25 stress symptoms. Self-ratings were obtained from both male and female college students. Only one stress-related factor emerged including 12 JAS items out of 44. These were relevant to (a) hard-driving and competitive, (b) time-urgent, and (c) hostile/irritated characteristics. Study 2 reports correlations of +.50 and +.43 between the stress-relevant JAS items and stress for new samples of female and male college students. Study 3 considers the broader personality correlates of scores on the stress-relevant Type A items and reports markedly different patterns for male and female college students. Predicted correlations were found on new samples between these personality correlates, considered as scales, and stress-relevant Type A scores and stress.     

Capuchin monkeys (Cebus apella) succeed in a test of quantity conservation

Nonhuman animals demonstrate a number of impressive quantitative skills such as counting sets of items, comparing sets on the basis of the number of items or amount of material, and even responding to simple arithmetic manipulations. In this experiment, capuchin monkeys were presented with a computerized task designed to assess conservation of discrete quantity. Monkeys first were trained to select from two horizontal arrays of stimuli the one with the larger number of items. On some trials, after a correct selection there was no feedback but instead an additional manipulation of one of those arrays. In some cases, this manipulation involved moving items closer together or farther apart to change the physical arrangement of the array but not the quantity of items in the array. In other cases, additional items were added to the initially smaller array so that it became quantitatively larger. Monkeys then made a second selection from the two arrays of items. Previous research had shown that rhesus monkeys (Macaca mulatta) succeeded with this task. However, there was no condition in that study in which items were added to the smaller array without increasing its quantity to a point where it became the new larger array. This new condition was added in the present experiment. Capuchin monkeys were sensitive to all of these manipulations, changing their selections when the manipulations changed which array contained the larger number of items but not when the manipulations changed the physical arrangement of items or increased the quantity in one array without also reversing which of the two arrays had more items. Therefore, capuchin monkeys responded on the basis of the quantity of items, and they were not distracted by non-quantitative manipulations of the arrays. The data indicate that capuchins are sensitive to simply arithmetic manipulations that involve addition of items to arrays and also that they can conserve quantity.     

Incremental validity of the frame-of-reference effect in personality scale scores: a replication and extension

Context-specific personality items provide respondents with a common frame of reference unlike more traditional, noncontextual personality items. The common frame of reference standardizes item interpretation and has been shown to reduce measurement error while increasing validity in comparison to noncontextual items (M. J. Schmit, A. M. Ryan. S. L. Stierwalt. & S. L. Powell, 1995). Although the frame-of-reference effect on personality scales scores has been well investigated (e.g., M. J. Schmit et al., 1995), the ability of this innovation to obtain incremental validity above and beyond the well-established, noncontextual personality scale scores has yet to be examined. The current study replicates and extends work by M. J. Schmit et al. (1995) to determine the incremental validity of the frame-of-reference effect. The results indicate that context-specific personality items do indeed obtain incremental validity above and beyond both noncontextual items and cognitive ability, and in spite of socially desirable responding induced by applicant instructions. The implications of these findings for personnel selection are discussed.     

Criterion-related validity of sex-restrictive and unisex interest scales: A comparison

This report describes two studies comparing the criterion-related validity of sex-balanced (“unisex”) interest inventory scales, i.e., scales designed such that the distributions of scores are similar for males and females, and traditional, sex-restrictive scales. Approximately 1600 college-bound high school seniors (Study 1) and 2000 college seniors (Study 2) completed both the ACT Interest Inventory (ACT-IV) and the new Unisex Edition of the ACT-IV (UNIACT), which contains sex-balanced items. In both studies, each participant was placed in one of six criterion groups based on the correspondence of expressed occupational choice (Study 1) and actual college major (Study 2) to Holland types. Comparable levels of criterion-related validity were obtained with the unisex scales, sex-restrictive scales, and with sex-balanced scores obtained by the traditional procedure of using same-sex norms. Study results and the results of previous research indicate that (a) psychometrically sound interest inventories can be constructed with sex-balanced items, and (b) counselors may use inventories which provide sex-balanced score reports without sacrificing validity.