项目表述效应的统计控制：以中文版生活定向测验为例

本研究以中文版生活定向测验（LOT-R）为例,使用CTCM和CTCU方法进行建模,旨在探讨中文表述的量表中是否存在项目表述效应以及影响项目表述效应的特质因素。采用中文版生活定向测验等量表组成的问卷对334名大学生进行测试。结果表明,中文版LOT-R存在项目表述效应,是一种反向题的项目表述效应,也可称为语言标签效应;在分离了反向题项目表述效应后,发现中文版LOT-R只存在乐观因子,而不再有悲观因子。这表明乐观-悲观同属于一种人格特质,而非两种不同的人格特质;反向题项目表述效应是一种结构性误差,会导致量表结构的扭曲。研究还发现担心错误和父母期望与反向题项目表述效应存在显著的负相关,表明越是担心错误或父母期望水平越高的被试,他们对反向题的项目表述效应（语言标签效应）越小。社会赞许性对反向题项目表述效应没有影响。     

Method effects due to social desirability as a parsimonious explanation of the deviation from unidimensionality in LOT-R scores

Dispositional optimism measured by the Life Orientation Test (Revised; LOT-R, Scheier et al., 1994) was originally proposed as a unidimensional construct pertaining to individual differences in positive outcome expectancies. However, factor analytic research has suggested two separate “optimism” and “pessimism” factors associated with positively and negatively worded items respectively. Using confirmatory factor analysis with data from N = 658 students it is shown that a general optimism model with method effects of the positively worded items fits even better than the “optimism–pessimism” model in terms of the AIC statistic, which accounts for both model parsimony and model fit. Furthermore, an attempt is made to explain the method effects by social desirability: impression management, one of two components of socially desirable responding, correlates significantly with the method factor whereas the other component, self-deceptive enhancement, is related to the general optimism factor. Thus it is shown that the deviation from unidimensionality of observed scores does not imply deviation from unidimensionality of optimism when method effects are incorporated in the model.     

项目表述效应对人格测验信度和效标效度的影响——以核心自我评价量表(CSES)为例

项目表述效应是指由项目表述方式的差异引起的与测量内容无关的系统变异,项目表述效应模型的统计本质是一种双因子模型。本研究以核心自我评价量表(CSES)为例,探讨项目表述效应对人格测验信效度的影响。采用核心自我评价量表、生活满意度量表和积极情感消极情感量表对340名“蚁族”进行测查。结果表明,CSES在核心自我评价特质以外,还存在一个反向题项目表述效应因子;忽视项目表述效应对CSES的同质性信度和效标关联效度有重要影响：高估CSES的同质性信度,低估核心自我评价与生活满意度、积极情感的正相关,高估核心自我评价与消极情感的负相关。     

The role of optimism in patients with tinnitus and in patients with hearing impairment

Abstract

Optimism was investigated in a sample of audiology clinic patients, consisting of one group of tinnitus sufferers (N = 30) and one group of hearing impaired subjects not experiencing tinnitus (N = 44). Optimism was measured by the Life Orientation Test (LOT). In the tinnitus group the LOT correlated significantly with measures of tinnitus related distress and in the hearing impaired group with measures of disability and emotional reactions due to the hearing impairment. Cronbach's alphas for the measures used were generally high. Principal components analysis of the LOT confirmed earlier findings by showing two separate factors; one with the positively worded LOT items reflecting the presence of optimism and one with the negatively worded LOT items reflecting the presence of pessimism. The results indicate that dispositional optimism is an usable concept in research with audiological samples, and that optimism is related with tinnitus distress and experienced disability and emotional reactions due to hearing impairment. Further research should investigate the possible role of personality factors in tinnitus and hearing impairment.     

人格测验中题目正反向陈述的效应

研究中将EPQ和NEO-FFI中的一半题目进行语义反转（肯定陈述的改为否定陈述,否定陈述的改为肯定陈述）,而另一半的题目陈述方向不变,形成的量表用于初测。重测时则把初测问卷中的题目全部进行语义反转。测试后得到363名大学生的正反EPQ和412名大学生的正反NEO-FFI数据。对比发现两套量表在使用正向题时信度略高,而使用反向陈述题目时效度略好;验证性因素分析发现正反向题能测量同一特质。正向题可能更易受反应偏差影响     

Cross-cultural investigation of the Questionnaire of Smoking Urges in American and Spanish smokers

This study evaluated the factor structure of the Questionnaire of Smoking Urges (QSU) across American and Spanish smokers. Using confirmatory factor analyses, the fits of one-, two-, and four-factor models of smoking craving in American and Spanish data sets were compared. The two-factor model provided the best fit in both samples. However, negatively worded items confounded the interpretation of the two-factor structure in both the American and Spanish data. The first factor had positively and negatively worded items, whereas the second had only positively worded items. The two-factor structure was reexamined, removing either the positively or the negatively worded items. Using only positively worded items resulted in a loss of fit, whereas using only negatively worded items improved model fit substantially. Thus, the results supported the generalization of smoking craving across Spanish and American smokers and suggested that negatively worded items play a larger role in the two-factor structure of the QSU than originally thought.     

The Two-Factor Solution to Allen and Meyer’s (1990) Affective Commitment Scale: Effects of Negatively Worded Items

Purpose

Affective organizational commitment is a construct important to both practitioners and researchers; thus, construct-valid measurement is needed. Allen and Meyer’s (J Occup Psychol 63:1–18, 1990) Affective Commitment Scale is a popular measure of affective organizational commitment. Although conceptualized as unidimensional, a two-factor solution sometimes emerges. Whether the two factors are substantive, reflecting AC-love and AC-joy constructs, or methodological, reflecting positively and negatively worded items, is unclear. This issue is examined in five studies.

Design/Methodology/Approach

In a new approach, conditions designed to produce cognitive fatigue are manipulated. Support for the method factor interpretation would be provided if the two-factor solution emerges only when participants are fatigued and negatively worded items are present. Cross-sample analyses are also conducted.

Findings

Analyses indicated that the two-factor solution fit the data well only when (a) participants were cognitively fatigued and (b) negatively worded items were present. This finding extended to both students and employees, and it held regardless of which items were negatively worded or whether negatively worded items were emphasized.

Implications

Results suggest that the second factor is likely methodological and seems to result from careless responding or fatigue on negatively worded items. It is suggested that users modify the items to be positively worded or administer the scale when respondents have sufficient cognitive resources to respond.

Originality/Value

This study was the first to use experimental methodology to test whether the two-factor solution is methodological or substantive. Results provide guidance for improving the scale’s construct validity in research and in practical applications.     

The ubiquity of common method variance: The case of the Big Five

The factor structures of the International Personality Item Pool (IPIP) and NEO-FFI Big Five questionnaires were examined via confirmatory factor analyses. Analyses of IPIP data for five samples and NEO data for one sample showed that a CFA model with three method bias factors, one influencing all items, one influencing negatively worded items, and one influencing positively worded items fit the data significantly better than models without method factors or models with only one method factor . With the method factors estimated, our results indicated that the Big Five dimensions may be more nearly orthogonal than previously demonstrated. Implications of the presence of method variance in Big Five scales are discussed.     

A Psychometric Evaluation of the Chinese Version of the Students’ Life Satisfaction Scale

The present study reported the initial validation of an abbreviated version of the Students' Life Satisfaction Scale- Chinese version (SLSS-Chinese) in two samples of Chinese middle school students. Initial analyses based on the original 7-item scale suggested that the two reverse-worded items functioned differently compared to other items. The plausible reasons behind this finding were discussed based on extant literature on mixed worded scales and cross-cultural research on life satisfaction scales. Then we compared the validity of three formats of the SLSS-Chinese: the 7-item (full scale), the 5-item (positively worded items only), and the 2-item (reverseworded items only) scales, respectively. Convergent evidence suggested that the two reverse-worded items hampered the scale's internal consistency, dimensionality, and validity. Also, the 5-item scale demonstrated good psychometric properties, and was clearly superior compared to the 7-item scale. These findings provide a solid foundation for applying the 5-item SLSS-Chinese in measuring Chinese adolescents' life satisfaction.     

The measurement of self-esteem among Korean Americans: a cross-ethnic study

Studies have indicated that Asians' self-esteem is generally lower than other ethnic groups'. The authors hypothesized that an item response bias would result in lower self-esteem scores for Asians. Specifically, it was hypothesized that positively worded items would be rated lower by Korean Americans but that there would be no difference on negatively worded items across ethnic groups. The hypothesis was tested using 214 individuals diagnosed with schizophrenia who were Korean American, Caucasian, African American, or Latino. Results supported the hypothesis. Korean Americans had significantly lower self-esteem scores than the other 3 groups on all positively worded items but were no different from the other groups on negatively worded items. Additional analyses showed modest support for the cross-cultural construct equivalence of this measure of self-esteem.     

Exploring the validity of scores from the Rosenberg Self-Esteem Scale (RSES) in Burundi: A multi-strategy approach

The present study aimed to validate the Rosenberg Self-Esteem Scale (RSES) in Burundi, through a multi-strategy approach used in cross-cultural studies. Respondents were 906 health workers (men = 56%; caregivers 60%). They responded to a bilingual version of RSES. We utilised Confirmatory Factorial Analysis (CFA) with structural equation modelling and a back translation test to explore the structure of the RSES and the reliability of scores from the scale. Data from an independent sample were analysed for the reliability of scores assessment. CFA results suggested that the global RSES factor was likely contaminated by a method-effect; mainly associated with negatively worded items. Internal consistencies and a back-translation test demonstrated that the negatively worded items were unsuitable in this context. The independent sample study confirmed poor reliability and internal consistency of scores for both alternative language versions of the RSES. Our data suggested that an overall cultural effect, rather than a merely specific language effect, may undermine the cross-cultural transportability of the Western scale.     

An examination of the wording effect in the Rosenberg Self-Esteem Scale among culturally Chinese people

Previous psychometric studies of the Rosenberg Self-Esteem Scale (RSES; 1965) have shown that items with positive and negative words tend to form 2 factors instead of a single factor for global self-esteem. Recent studies using confirmatory factor analysis have indicated that there is an additional method effect behind negatively worded items. However, researchers conducted these studies using Western participants. Because J. L. Farh and B. S. Cheng (1997) suggested that culturally Chinese people tend to exhibit a modesty bias in self-evaluation, especially on positively worded items, researchers may infer that a wording effect of positively worded items would be evident for culturally Chinese people. The author examined the wording effect in the RSES for culturally Chinese people by comparing different confirmatory factor models. The author analyzed data from 2 independent samples of students at the National Taiwan University (ns = 393, 441) and a national sample of juniors recruited from 140 universities and colleges in Taiwan in 2004 (n = 28,862). Results showed that in addition to a global factor for self-esteem, method effects of positively and negatively worded items should also be specified for a model fitting culturally Chinese people.     

Global Self-Esteem as a Correlate of Work-Related Attitudes: A Question of Dimensionality

We examined the dimensionality of one of the most frequently used measures of global self-esteem, the Rosenberg Self-Esteem Scale (RSE; Rosenberg, 1965). Although the RSE is assumed to be unidimensional, Kaplan and Pokorny (1969) provided evidence that the scale taps two independent constructs: self-derogation versus defensive assertion of self-worth, in our study a confirmatory factor analysis was conducted which supported the superiority of the Kaplan and Pokorny two-factor model over a one-factor model but indicated that their model provided a poor fit to the data. Consequently, an exploratory factor analysis was conducted which revealed two dimensions, one mostly defined by negatively worded items (self-derogation) and the second by positively worded items (self-enhancement). Although the correlations obtained were generally quite small, relations with work-related attitudes shown for the negative factor were in the opposite direction and somewhat larger than those shown for the positive factor. Thus, additional support was provided for a two-dimensional conceptualization of the scales.     

How you ask matters: An experimental investigation of the influence of mood on memory self-perceptions and their relationship with objective memory

Stronger relationships often emerge between mood and memory self-efficacy (MSE) than between MSE and memory abilities. We examined how social desirability, mood congruency and framing influence the mood–MSE relationship. Social desirability correlated with all self-report measures, and covarying social desirability diminished the mood-MSE relationship while enhancing the relationship between MSE and objective memory. Participants rated their memory more harshly on positively than neutrally or negatively worded MSE items. Current mood state did not affect MSE overall or when items were worded positively or neutrally. However, on negatively worded items, participants in a negative mood exhibited lower MSE than participants in a positive mood. Thus, both MSE and the mood–MSE relationship depended upon question wording. These results indicate that controlling social desirability and item framing on MSE questionnaires may reduce their confounding influence on memory self-perceptions and the influence of mood on self-reported abilities, allowing subjective memory to more accurately reflect objective memory in healthy and clinical populations.     

Factorial Structure of the French Version of the Rosenberg Self-Esteem Scale Among the Elderly

Ten different confirmatory factor analysis models, including ones with correlated traits correlated methods, correlated traits correlated uniqueness, and correlated traits uncorrelated methods, were proposed to examine the factorial structure of the French version of the Rosenberg Self-Esteem Scale (Rosenberg, 1965). In line with previous studies (Tomas & Oliver, 1999; Wang, Siegal, Falck, & Carlson, 2001), our results support the existence of a single global self-esteem factor underlying responses to the scale, in spite of the fact that method effects appear to be associated more with negatively worded items than with positively worded ones.     

Mind your words: positive and negative items create method effects on the Five Facet Mindfulness Questionnaire

Mindfulness, a construct that entails moment-to-moment effort to be aware of present experiences and positive attitudinal features, has become integrated into the sciences. The Five Facet Mindfulness Questionnaire (FFMQ), one popular measure of mindfulness, exhibits different responses to positively and negatively worded items in nonmeditating groups. The current study employed confirmatory factor analysis with a large undergraduate sample to examine the validity of a hierarchical mindfulness model and whether response patterns related to item wording arose from method effects. Results indicated that a correlated facets model better explained the data and that negative and positive wording constituted substantive method effects. This study suggests that the FFMQ measures components that may relate to, but do not seem to directly reflect, a latent variable of mindfulness. The authors recommend against the use of an FFMQ total score, favoring individual scale scores, and further examination of method effects in mindfulness scales.     

Method Effects: The Problem With Negatively Versus Positively Keyed Items

Using confirmatory factor analyses, we examined method effects on Rosenberg's Self-Esteem Scale (RSES; Rosenberg, 1965) in a sample of older European adults. Nine hundred forty nine community-dwelling adults 60 years of age or older from 5 European countries completed the RSES as well as measures of depression and life satisfaction. The 2 models that had an acceptable fit with the data included method effects. The method effects were associated with both positively and negatively worded items. Method effects models were invariant across gender and age, but not across countries. Both depression and life satisfaction predicted method effects. Individuals with higher depression scores and lower life satisfaction scores were more likely to endorse negatively phrased items.     

Acquiescent responding in partially balanced multidimensional scales

We propose a method for controlling acquiescent response in which acquiescence response variance is isolated in an independent factor. This kind of procedure is available for perfectly balanced scales (i.e. half of the items are worded in the opposite direction to the other half with respect to a general trait). However, few questionnaires are designed so that exactly half of the items are worded in this way. If this is not the case, the available methods are useless. We propose to adapt the rotation method of Lorenzo‐Seva and Rodríguez‐Fornells to handle partially balanced scales (i.e. only a few items in the scale are worded in the opposite direction). The most important characteristic of our method is that it removes the variance due to acquiescent response from all the items in the questionnaire (i.e. the balanced subset of items, but also the unbalanced subsets of items). The usefulness of the method is illustrated in a numerical example.     

Differential item functioning on the Five Facet Mindfulness Questionnaire is minimal in demographically matched meditators and nonmeditators

A recent study of the Five Facet Mindfulness Questionnaire reported high levels of differential item functioning (DIF) for 18 of its 39 items in meditating and nonmeditating samples that were not demographically matched. In particular, meditators were more likely to endorse positively worded items whereas nonmeditators were more likely to deny negatively worded (reverse-scored) items. The present study replicated these analyses in demographically matched samples of meditators and nonmeditators (n = 115 each) and found that evidence for DIF was minimal. There was little or no evidence for differential relationships between positively and negatively worded items for meditators and nonmeditators. Findings suggest that DIF based on items' scoring direction is not problematic when the Five Facet Mindfulness Questionnaire is used to compare demographically similar meditators and nonmeditators.     

Method effects: the problem with negatively versus positively keyed items

Using confirmatory factor analyses, we examined method effects on Rosenberg's Self-Esteem Scale (RSES; Rosenberg, 1965) in a sample of older European adults. Nine hundred forty nine community-dwelling adults 60 years of age or older from 5 European countries completed the RSES as well as measures of depression and life satisfaction. The 2 models that had an acceptable fit with the data included method effects. The method effects were associated with both positively and negatively worded items. Method effects models were invariant across gender and age, but not across countries. Both depression and life satisfaction predicted method effects. Individuals with higher depression scores and lower life satisfaction scores were more likely to endorse negatively phrased items.