Rater Agreement on IQ and Achievement Tests: Effect on Evaluations of Learning Disabilities

Protocols from 110 evaluations utilizing the Wechsler Intelligence Scale for Children-Third Edition (WISC-III) and the Woodcock/Johnson Tests of Achievement-Revised (W/J-R) were scored by two different raters to determine (a) whether subtests with more difficult levels of scoring yield lower interrater correlation coefficients, (b) whether scoring errors on subtests affect broad score estimates, (c) the effect of expertise of rater on scoring errors, and (d) whether scoring errors affect a learning disability determination based on IQ/achievement discrepancy. Scoring errors were found on almost 25% of Comprehension and Vocabulary subtests; however, the effect of these scoring errors was minimal. About 42% of Writing Samples subtests had scoring errors, resulting in a mean change of 1.75 points on the Broad Written Language Cluster subtest. On the WISC-III, but not the W/J-R, there were significantly more errors made by inexperienced testers. Scoring errors resulted in two cases in which learning disability determination would be changed. Overall, the study corroborates previous findings of strong interrater reliability on most subtests of common IQ and achievement tests and indicates that novice scorers are not likely to make scoring mistakes that will significantly impact an IQ/achievement discrepancy-based documentation of learning disability.     

青少年心理韧性量表（HKRA）的修订

心理韧性研究起源于20世纪70年代,而国内的相关研究还刚刚处于起步阶段,为有利于国内心理韧性研究的开展,选定青少年心理韧性量表(HKRA)进行中文版修订。以初中二年级学生884人(男生468人,女生416人)为被试,采用探索性因子分析法,共提取11个因子,其中外部保护因子7个,心理韧性特质因子4个,各个题目在相应因子上的载荷在0.34-0.88之间,各个因子的同质性信度在0.62-0.84之间,累积方差解释率为55.77%。结果表明,量表符合测量学的信度和效度要求,可以作为测量心理韧性的工具在国内使用。     

坚韧人格量表的编制

通过开放式问卷调查、专家访谈及参考国外同类问卷,结合中国社会文化特点,编制了坚韧人格量表。经过两次施测,对数据分别进行探索性因素分析及验证性因素分析,最终确定坚韧人格量表包含四个维度,共27个项目。数据分析表明,坚韧人格量表具有良好的信度和效度,可以作为人格坚韧性的测量工具。     

A validation and short form of the Basic Character Inventory

The Basic Character Inventory (BCI) contains 136 items, 17 lower-order personality factors and three higher-order personality factors derived from psychoanalytic theory: Oral, Obsessive Compulsion, and Hysteria. Previous research that investigated the BCI's psychometric properties examined small, special populations and did not use modern statistical methods to validate the BCI. The present study validates the BCI via confirmatory factor analyses using a large sample of 6,285 Norwegian nursing and teaching students. Reliability, convergent validity, and divergent validity of the BCI were also assessed. Results indicated general support for the original BCI factor structure in a reduced form of the BCI that possesses strong reliability and validity, and is suitable for use in time-limited measurement settings.     

Procedural justice effects on self-esteem under certainty versus uncertainty emotions

Building upon the idea that procedural justice effects are more pronounced when uncertainty is high, we proposed that recall of an uncertainty-eliciting emotion (fear) will render people more responsive to variations in procedural justice than will recall of a certainty-eliciting emotion (disgust). Results from Study 1, (n = 79 undergraduate students) confirmed that a fair procedure (voice condition) enhanced self-esteem relative to an unfair procedure (no voice condition) to a greater extent when people recalled fear than when they recalled disgust. Results from Study 2 (n = 147 undergraduate students) also showed that a fair, relative to an unfair, procedure enhanced self-esteem more strongly when recalling the emotion of fear rather than disgust, but only when these emotions were recalled from a self-immersed than a self-distanced perspective. These findings confirm that discrete emotions that orient people to interpret situations in uncertain versus certain ways are important antecedents of procedural justice effects.     

影响学生体育学习情境兴趣的主因素研究

本研究以上海市中学生为研究对象,修订了中文版体育情境兴趣量表的信效度资料,构建了体育情境兴趣的模型结构,通过对被试学习过程中情境兴趣的测试与分析,揭示了影响学生体育学习情境兴趣的主因素及其相关关系。研究结果表明： 中文版体育情境兴趣量表具有良好的信度和效度,能较好地解释总体变量;相关与回归分析表明：即时愉悦感是激发体育学习情境兴趣的主要因素,而体育学习内容本身过高的新颖性和挑战性不利于情境兴趣的激发。     

中国人人格量表的信度与效度

在初步确定中国人人格量表（Qingnian Zhongguo Personality Scale, QZPS）的基础上,通过对5000多被试的施测,确定了QZPS的项目构成及信度和效度。研究中对QZPS的项目重新进行探索性因素分析,确认了中国人人格的七因素结构,根据对每一个大因素的因素分析和项目鉴别度分析,确定了QZPS各个因素的项目构成和内部一致性系数,共180个项目。通过自-他评定的相关、自评与标尺评定的相关、以及对特殊群体分数分布的分析验证了QZPS的效度。研究结果确认QZPS有良好的信度和效度,可以应用于人格的理论和应用领域。     

梅尔美术判断测验在中国应用的信、效度检验

目的:修订梅尔美术判断测验(Meier Art Judgment Test)并对其信度、效度进行检验。方法:通过对来自6所大学、中专共2270人施测梅尔美术判断测验,采用CTT区分度和IRT的模型拟合检验、区分度筛选项目,以霍兰德艺术分测验、学生艺术创作水平自评与艺术过往经历分量表为效标,以及采用效标组法(美术与非美术专业)检验效标关联效度。结果:保留的61题都拟合IRT的2参数logistic模型,量表得分与各效标得分相关显著,美术与非美术专业学生得分存在显著差异; 但测验信息量分析表明,对高能力被试的测量误差相对较大。结论:修订的量表能测量个体的美术判断能力; 今后改进方向应该是增加更难的试题。     

积极情感消极情感量表（PANAS）的修订

以情感二维结构理论为基础,对Watson等（1988）编制的积极情感消极情感量表（PANAS）进行了修订。收集了几种主要的情感环丛模型中积极情感和消极情感项目后,用专家评定法剔除了不属于情绪描述词的项目,并用问卷法考察了这些情感体验的典型性,试测后确定了积极情感和消极情感项目各9项构成最终量表。最后用自评、同伴评价和认知测量法对量表的心理测量学属性进行了较为全面的分析。结果表明,修订后的PANAS中各项目具有良好的区分度,是情感幸福感有效和可靠的测量工具。     

A Measure for the Reliability of a Rating Scale Based on Longitudinal Clinical Trial Data

A new measure for reliability of a rating scale is introduced, based on the classical definition of reliability, as the ratio of the true score variance and the total variance. Clinical trial data can be employed to estimate the reliability of the scale in use, whenever repeated measurements are taken. The reliability is estimated from the covariance parameters obtained from a linear mixed model. The method provides a single number to express the reliability of the scale, but allows for the study of the reliability’s time evolution. The method is illustrated using a case study in schizophrenia. The authors are grateful to J&J PRD for kind permission to use their data. We gratefully acknowledge support from the Belgian IUAP/PAI network “Statistical Techniques and Modeling for Complex Substantive Questions with Complex Data.”