Differentiating conscientious from indiscriminate responders in existing NEO-Five Factor Inventory-3 data

The mean Inter-Item Standard Deviation (M-ISD; i.e., the mean of several single-scale ISDs) is a post-hoc validity index that statistically differentiates conscientious responders (CRs) from indiscriminate responders (IRs) in psychological questionnaire data. We compared the M-ISD’s effectiveness against four other post-hoc indexes and an embeddable validity scale in three sets of NEO-Five-Factor Inventory-3 data. Results showed the M-ISD has superior classification ability over all other post-hoc indexes and even outperformed the embeddable validity scale. The average classification accuracy of the M-ISD and embeddable scale was 97% and 93%, respectively, whereas only one of the four remaining post-hoc indexes exceeded our classification accuracy criterion of 80%. These findings suggest researchers can use the M-ISD to differentiate valid from invalid data.     

Careless Responding to Reverse-Worded Items: Implications for Confirmatory Factor Analysis

Many self-report measures include some items worded in the direction opposite to that of other items. These so-called reverse-worded (RW) items can reduce the reliability and validity of a scale, and frequently form a separate method factor that does not appear to be substantively meaningful. One possible explanation for factors defined by RW items is respondent carelessness. The purpose of the present study was to evaluate whether relatively few careless responders to RW items can influence confirmatory-factor-analysis model fit enough that researchers would likely reject a one-factor model for a unidimensional scale. Results based on simulations indicated that if at least about 10% of participants respond to RW items carelessly, researchers are likely to reject a one-factor model for a unidimensional scale.     

Comparison of classical and modern methods for measuring and correcting for acquiescence

Likert-type self-report scales are frequently used in large-scale educational assessment of social-emotional skills. Self-report scales rely on the assumption that their items elicit information only about the trait they are supposed to measure. However, different response biases may threaten this assumption. Specifically, in children, the response style of acquiescence is an important source of systematic error. Balanced scales, including an equal number of positively and negatively keyed items, have been proposed as a solution to control for acquiescence, but the reasons why this design feature worked from the perspective of modern psychometric models have been underexplored. Three methods for controlling for acquiescence are compared: classical method by partialling out the mean; an item response theory method to measure differential person functioning (DPF); and multidimensional item response theory (MIRT) with random intercept. Comparative analyses are conducted on simulated ratings and on self-ratings provided by 40,649 students (aged 11–18) on a fully balanced 30-item scale assessing conscientious self-management. Acquiescence bias was explained as DPF and it was demonstrated that: the acquiescence index is highly related to DPF; balanced scales produce scores controlled for DPF; and MIRT factor scores are highly related to scores controlled for DPF and the random intercept is highly related to DPF.     

Special Abilities Assessment in Children

The faking-detection validity and incremental validity of response latencies to Minnesota Multiphasic Personality inventory (MMPI) items was investigated using an analog research design. One hundred undergraduates were assigned at random to five groups: each group received different faking instructions (standard, fake good, fake bad, fake good with incentive, fake bad with incentive). All subjects completed a computer-administered version of the MMPI. Content-determined response deviance scores and latencies of responses to Subtle and Obvious scale items were determined for each subject. The principal findings suggest that response latencies may have greater faking good detection ability than responses deviance scores, and that response latencies have statistically significant incremental validity for both the detection of faking good and faking bad, when latencies are used with response deviance scores obtained from Subtle and Obvious scales.     

随机截距因子分析模型在控制条目表述效应中的应用

本研究用中文修订版罗森博格自尊量表(RSES-R)考察随机截距因子分析模型在控制条目表述效应时的表现。用RSES-R和过分宣称问卷组成的量表调查621名中学生。结果表明,随机截距模型在建模时,拟合指数良好、因子方差与负荷合理,自尊因子分与RSES-R总分有极高相关,表明该模型能有效分离RSES-R得分的特质与表述效应。分离的表述效应因子分与受测者的自我提升水平具有显著但较弱的相关,表明表述效应与自受测者的社会赞许性有共同的成分。     

Refinement of the MMPI-2 F(p) scale is not necessary: a response to Gass and Luis

Gass and Luis (2001) reported that four MMPI-2 Lie scale items contained on the F(p) scale do not measure symptom exaggeration but measure defensiveness. They hold that elimination of the four Lie scale items improves the utility of the F(p) scale in the identification of exaggeration in VA samples. To directly address the assertion that removal of the L scale items from the F(p) scale enhances the predictive validity of F(p), data derived from a previously published study where 74 psychiatric inpatients were asked to retake the MMPI-2 and either feign psychopathology or respond in an honest manner were reanalyzed. The intact F(p) scale demonstrated a stronger correlation with group membership, increased incremental validity, and superior classification rates compared with the F(p) scale without the 4 Lie scale items. Consequently, the F(p) refinement recommended by Gass and Luis is unnecessary.     

情绪感染问卷的中国化修订与信效度检验

该研究旨在编制情绪感染问卷并探讨问卷的信度与效度,问卷以Doherty编制的《情绪感染问卷》(the emotional contagion scale)作为蓝本,删除了不适合东方文化的项目,增加了符合中国人的情绪情境和展现情绪方式的项目,经过预测修订后,最终问卷包含5个维度25个项目,正式施测共回收747份有效问卷,并对数据进行了信效度检验。结果表明,探索性因素分析KMO为0.802,总问卷的标准化的Cronbach’sα系数为0.852,项目分析表明项目的鉴别指数D值在0.340~0.479之间,验证性因素分析具有较好的模型拟合度,问卷的重测信度与效标关联效度均达到显著水平。情绪感染问卷的信效度均达到了测量学的要求。     

Effectiveness of the Hamilton Anxiety Rating Scale with Older Generalized Anxiety Disorder Patients

To expand the collection of instruments available for assessment of anxiety in the elderly, this report examined the original and revised Hamilton anxiety scales in a sample of 50 older adults diagnosed with Generalized Anxiety Disorder (GAD) and 93 normal community participants (ages 55–82). Although the revised anxiety scale had better discriminant validity (lower correlation with the revised Hamilton depression scale) than the original anxiety and depression scales, a considerable amount of shared variance still existed (41% shared variance, GAD sample alone; 17% control sample alone; 74% shared variance, both samples combined). Near-perfect group classification was possible using 7 items from the original anxiety scale and 10 items from the revised anxiety scale. Results are discussed in light of their implications for use of the Hamilton anxiety rating scale with older anxiety-disordered patients.     

The Generalizability and Construct Validity of the Modern Sexism Scale: Some Cautionary Notes

Our purposes are to explore the generalizability of the Modern Sexism Scale [J. T. Swim et al. (1995) “Sexual and Racism: Old-Fashioned and Modern Prejudices,” Journal of Personality and Social Psychology, Vol. 68, pp. 199–214] beyond mostly white, traditionally aged undergraduates and to extend analyses of its construct validity. Fourteen African American and 32 white women firefighters nationwide, having previously completed an extensive mail survey, were followed up with the Modern Sexism Scale. A four-factor solution, low inter-item correlations, and a low coefficient alpha argue against combining the 8-items of the scale. Racial differences on one item and in response variances as well as correlations with age, years of service, and education caution against handily overgeneralizing scale usage beyond students. Coherent patterns of interrelationships among Modern Sexism items and other personality, attitudinal, work experiential, and gender identity scales suggest strong convergent validity.     

A response Consistency statistic for the millon clinical multiaxial inventory (MCMI)

Response style in objective psychological testing is an important issue in the reliability and validity of tests as well as in the interpretation of test results. The MCMI provides two response-style indices, the validity scale and the weight factor. The present work presents an additional statistic to assess random response in subjects. The Consistency Coefficient is the correlation between the subjects' endorsement of even and odd items across the 20 MCMI scales. The distributions of 500 patient and 500 randomly generated profiles were compared. Good separation between these distributions was found. The subject data were extremely negatively skewed, whereas the randomly generated data were normally distributed. Data are presented that display positive and negative predictive values, as well as sensitivity and specificity across ranges of prevalence and cut score. These data facilitate the identification of subjects who respond to the MCMI in a random manner so that their scores can be interpreted accordingly.     

Examination of the Hamilton Scales in Assessment of Anxious Older Adults: A Replication and Extension

This study examined the original and reconstructed Hamilton scales in the assessment of anxiety and depression in a sample of older adults diagnosed with GAD (n = 82). Internal consistency of all scales appeared adequate. Results indicated improved construct validity with the reconstructed scales, which demonstrated reduced shared variance. However, construct validity examined through intercorrelations of the Hamilton scales with self-report measures of anxiety and depression was generally poor. Discriminant function analysis indicated that the reconstructed scales might have some clinical utility in differentiation of patients with and without coexistent depressive diagnosis (67% correct classification). In addition, two items from the Hamilton rating scale for depression (Work and Activities; Hopelessness) correctly classified patients with and without depression at a similar level as the Hamilton scale total scores (64–65% correct classification). These results suggest that the Work and Activities, and Hopelessness items may provide clinicians with useful screening questions for depression in anxious older adults.     

基于等级反应模型的规则空间方法

本研究基于Tatsuoka的规则空间方法, 对理想反应模式与异常反应指标进行了扩展, 推导了多级评分项目下规则空间方法的算法公式。在4种属性层级结构(发散型、收敛型、线型与无结构型)×4种“失误”作答概率(2%、5%、10%与15%)测验情境下, 以属性模式判准率、被试属性判准率、敏感性与特异性为指标, 检验了多级评分项目下规则空间方法的分类准确性。结果表明：(1) 基于多级评分项目构建的异常反应指标, 能有效地对被试进行分类与解释, 且0-1评分项目下异常反应指标及其性质都是多级评分下的特例; (2) 随着“失误”作答概率的增加, 4种属性层级结构的分类准确性都会降低; (3) 线型和收敛型的分类准确性明显好于发散型与无结构型; (4) 纯规则点的分布对规则空间方法的分类准确性有显著影响。     

An Item Factor Analysis of the Revised Barrett-Lennard Relationship Inventory

The revised version of the Barrett-Lennard Relationship Inventory with an added advice-giving scale was given to 240 female and 95 male students, who completed it in terms of their current closest personal relationship. The correlations between the 80 items were factor-analysed using a principal-factor solution to determine whether the items represented the five postulated factors of advice-giving, empathy, congruence, and level of and unconditionally of regard. Eighteen factors were extracted and rotated by the Varimax method. The first five factors extracted accounted for 36.3% of the variance and reflected the five postulated factors, thus partially supporting the factorial validity of this questionnaire.     

Identification of random responding on the MMPI-A

Although substantial research literature on the effects of random responding on the MMPI-2 exists, there is very limited data available on this issue with the MMPI-A. The purpose of this study was to evaluate the utility of selected MMPI-A validity scales in detecting differences in response patterns between protocols produced by 354 adolescents assessed in clinical settings and a group of 354 randomly produced MMPI-A protocols. Results indicate that MMPI-A validity and basic clinical scales differ significantly between random and clinical groups and that MMPI-A validity Scales F, F1, F2, and VRIN appear to be most useful in correctly identifying protocols from actual clinical participants versus randomly generated response patterns. Findings are discussed in terms of the dramatic effects of the sample base rate for random responding on overall classification accuracy results. Furthermore, it was noted that the optimal cutting scores for MMPI-A Scales F, F1, F2, and VRIN were largely consistent with interpretive recommendations found in the test manual (Butcher et al., 1992) when the relative frequency of random response protocols to clinical protocols was evaluated at a ratio of 1:10. Finally, future recommendations for evaluation of the F1-F2 difference score and the TRIN scale are offered in terms of the most relevant research designs to evaluate these measures.     

ESTABLISHING GENERATIVE YES/NO RESPONSES IN DEVELOPMENTALLY DISABLED CHILDREN

We evaluated the effects of two procedures for teaching four developmentally disabled children to respond yes/no appropriately. During baseline, tutoring was conducted in which five known items were individually presented with the question, “Is this a_____?”, followed either by access to requested items or by remedial prompting contingent on responding. When tutoring did not improve performance, instruction was embedded in the regular classroom activities. In this condition, items requested by students were either presented or withheld on the basis of their response to the question, “Do you want ______?”. Increases in correa responding were confirmed by a multiple-baseline design across all four students and were maintained with the introduction of new items. However, generalization to “Is this a_____?” questions did not occur in the tutoring setting until specifically programmed. Subsequently, students also demonstrated appropriate yes/no responding to questions involving actions, possession, and spatial relations.     

Comparison of embedded and isolated administrations of the California Psychological Inventory's Socialization subscale

Alternate administration methods were tested for the Socialization (So) subscale of the California Psychological Inventory (CPI; H. G. Gough, 1994; H. G. Gough & P. Bradley, 1996) in 437 young adult men. One method administered the 46 CPI-So items in isolation from the CPI, whereas the 2nd method administered the 46 items embedded in the CPI. External validity measures of antisociality were also administered over the 2 sessions. Isolated administration produced somewhat higher internal consistency and significantly better concurrent validity and demonstrated construct validity as a measure of antisociality. Additional factor analytic studies of the CPI-So and CPI revealed that the 2 CPI-So versions had different factorial structures and that the embedded CPI-So subscale did not retain factorial integrity or an appreciable amount of reliable and uniquely interpretable variance.     

The processing of inter-item relations as a moderating factor of retrieval-induced forgetting

We investigated influences of item generation and emotional valence on retrieval-induced forgetting. Drawing on postulates of the three-factor theory of generation effects, generation tasks differentially affecting the processing of inter-item relations were applied. Whereas retrieval-induced forgetting of freely generated items was moderated by the emotional valence as well as retrieval-induced forgetting of read items, even though in the reverse direction (Experiment 1), fragment completion eliminated the moderation of retrieval-induced forgetting by emotional valence (Experiment 2). The results corroborate the assumption that the processing of inter-item relations is crucial for the immunization against retrieval-induced forgetting. Moreover, differential processing of inter-item relations may clarify the mixed results on moderating factors of retrieval-induced forgetting that have been reported.     

Development of the Spence Children’s Anxiety Scale - Short Version (SCAS-S)

The literature provides several examples of anxiety symptoms questionnaires for children. However, these questionnaires generally contain many items, and might not be ideal for screening in large populations, or repeated testing in clinical settings. The Spence Children’s Anxiety Scale (SCAS) is an extensively used and evaluated 44-item questionnaire developed to assess anxiety symptoms in children, and provides a sound base for the development of an abbreviated anxiety symptoms questionnaire. Although methodological standards have been presented in how to develop abbreviated questionnaires, previous studies have often suffered from several limitations regarding validating procedures. Guided by these methodological standards, the current study aimed at developing an abbreviated version of the SCAS, while retaining the content, convergent, and divergent validity of the original scale. A school-based sample (n?=?750) was used to reduce the number of items, and an independent school-based sample (n?=?371) together with a clinical sample (n?=?93), were used to validate the abbreviated scale. The abbreviated version of the SCAS contained 19 items, it showed a clear factor structure as evaluated in the independent sample, and it performed as good as the original questionnaire regarding classification accuracy, convergent, and divergent validity. In our view, the abbreviated version is a very good alternative to the original scale especially for younger children, in initial screening, or in order to reduce response burden.     

Changing the P300 brain computer interface.

Brain-computer interfaces (BCIs) are now feasible for use as an alternative control option for those with severe motor impairments. The P300 component of the evoked potential has proven useful as a control signal. Individuals do not need to be trained to produce the signal, and it is fairly stable and has a large evoked potential. Even with recent signal classification advances, on-line experiments with P300-based BCIs remain far from perfect. We present two potential methods for improving control accuracy. Experimental results in an evoked potential BCI, used to control items in a virtual apartment, show a reduced response exists when items are accidentally controlled. The presence of a P300-like signal in response to goal items means that it can be used for automatic error correction. Preliminary results from an interface experiment using three different button configurations for a yes/no BCI task show that the configuration of buttons may affect on-line signal classification. These results will be discussed in light of the special considerations needed when working with an amyotrophic lateral sclerosis (ALS) patient.     

基于可达阵的一种Q矩阵标定方法

Q矩阵标定是实施认知诊断评估的前提,已有Q矩阵修正方法并不太适合测验中已知属性向量的题目数较少的情形。根据拓展Q矩阵理论中可达阵R列与简化Q阵列存在布尔“或”关系,在一定认知假设下,率先提出可达阵R与简化Q阵的潜在反应列存在布尔“与”关系,并由此提出基于可达阵的Q矩阵标定方法。研究显示：在已知一个可达阵下,当可达阵项目的猜测或失误参数在.20以下且待标定项目的项目参数约在.30以下时,新方法所得Q矩阵元素返真率基本在.90以上,并且真实Q矩阵与估计Q矩阵下被试分类准确率差异很小;对于含5个属性的独立结构,新方法要求的随机样本的样本量较小;实证研究也印证了模拟研究的结论。新方法只需专家标定少量题目的Q矩阵,即已经标定的Q矩阵对应属性层级结构的可达阵。