Brief assessment of schizotypy: Developing short forms of the Wisconsin Schizotypy Scales

The Wisconsin Schizotypy Scales—the Perceptual Aberration, Magical Ideation, Physical Anhedonia, and Revised Social Anhedonia Scales—have been used extensively since their development in the 1970s and 1980s. Based on psychometric analyses using item response theory, the present work presents 15-item short forms of each scale. In addition to being briefer, the short forms omit items with high differential item functioning. Based on data from a sample of young adults (n = 1144), the short forms have strong internal consistency, and they mirror effects found for the longer scales. They thus appear to be a good option for researchers interested in the brief assessment of schizotypic traits. The items are listed in an Appendix A.     

标准参照测验及其等级线信度的概化理论分析

在测量工作中,误用经典测验理论方法估计标准参照性测验的整体信度和等级线决策信度的情况非常突出。如,无论测量设计是交叉的还是嵌套的,也无论测验结果是做常模参照性解释,还是做标准参照性解释,测验工作者往往只报告克龙巴赫α系数或经典测验理论中的其它少数几个信度指标,而误把整体信度作为等级线信度的现象则更加普遍,这是十分不妥的。本文借用概化理论中的可靠性指数Φ和Φ(λ)公式,分别针对交叉设计和嵌套设计,就标准参照性测验的整体信度和等级分数线决策信度的估计问题进行了探讨。用数据演示的方法比较了交叉设计与嵌套设计在估计标准参照性测验整体信度方面的差异,展示了等级决策分数线决策信度的估计方法。     

Brief assessment of schizotypy: Developing short forms of the Wisconsin Schizotypy Scales

The Wisconsin Schizotypy Scales—the Perceptual Aberration, Magical Ideation, Physical Anhedonia, and Revised Social Anhedonia Scales—have been used extensively since their development in the 1970s and 1980s. Based on psychometric analyses using item response theory, the present work presents 15-item short forms of each scale. In addition to being briefer, the short forms omit items with high differential item functioning. Based on data from a sample of young adults (n = 1144), the short forms have strong internal consistency, and they mirror effects found for the longer scales. They thus appear to be a good option for researchers interested in the brief assessment of schizotypic traits. The items are listed in an Appendix A.     

Psychometric Properties of the Wisconsin Schizotypy Scales in an Undergraduate Sample: Classical Test Theory,Item Response Theory,and Differential Item Functioning

The Wisconsin Schizotypy Scales are widely used for assessing schizotypy in nonclinical and clinical samples. However, they were developed using classical test theory (CTT) and have not had their psychometric properties examined with more sophisticated measurement models. The present study employed item response theory (IRT) as well as traditional CTT to examine psychometric properties of four of the schizotypy scales on the item and scale level, using a large sample of undergraduate students (n = 6,137). In addition, we investigated differential item functioning (DIF) for sex and ethnicity. The analyses revealed many strengths of the four scales, but some items had low discrimination values and many items had high DIF. The results offer useful guidance for applied users and for future development of these scales.     

Factor structure and measurement invariance of the Wisconsin Schizotypy scales across gender and age

The Wisconsin Schizotypy Scales are among the most widely used instruments for the assessment of psychosis proneness. The main goal of the present work was to study the dimensional structure underlying the Revised Physical Anhedonia Scale (RPhA), the Revised Social Anhedonia Scale (RSAS), the Magical Ideation Scale (MIS) and the Perceptual Aberration Scale (PAS). It was also explored whether the dimensions underlying these scales were invariant across gender and age. The sample was made up of 710 university students with a mean age of 19.8 years (SD = 1.9). The results showed that the dimensional structure of the Wisconsin scales was similar to that found in previous studies, displaying a Positive dimension and a Negative dimension, the Social Anhedonia Scale being related to both dimensions. Moreover, the factor structure of the schizotypy scales was found to be invariant across participants' gender and age.     

概化理论在绩效评估中的应用

概化理论借助其理论上的优势在很大程度上克服了基于经典测量理论绩效评估存在的缺陷。它可以对绩效评估中的信度进行更全面的估计,更好地预测和控制误差,并且概化理论的独特视角和方法还为360度绩效评估的效度求取提供了理论支持。     

Evaluating the Equal-Interval Hypothesis with Test Score Scales

The axioms of additive conjoint measurement provide a means of testing the hypothesis that testing data can be placed onto a scale with equal-interval properties. However, the axioms are difficult to verify given that item responses may be subject to measurement error. A Bayesian method exists for imposing order restrictions from additive conjoint measurement while estimating the probability of a correct response. In this study an improved version of that methodology is evaluated via simulation. The approach is then applied to data from a reading assessment intentionally designed to support an equal-interval scaling.     

Generalizability and Dependability of a Multi-Item Direct Behavior Rating Scale in a Kindergarten Classroom Setting

Accurate and rapid identification of students displaying behavioral problems requires instrumentation that is user friendly and reliable. The purpose of the study was to evaluate a multi-item direct behavior rating scale called the Direct Behavior Rating-Multiple Item Scale (DBR–MIS) for disruptive behavior to determine the number of administrations necessary to achieve a dependable result. In addition, a study was conducted to determine to what degree the DBR-MIS correlated with a brief rating scale of attention deficit hyperactivity disorder behaviors. Participants were Kindergarten students (n = 18) who were observed and rated over nine 5-min observation periods by 2 raters with minimal training. Results indicated that the DBR-MIS provided reliable estimates of disruptive behavior by the seventh or eighth rating occasion. Correlations between the DBR-MIS and the attention deficit hyperactivity disorder rating scale were weak to moderate. Overall, the DBR-MIS for disruptive behavior efficiently achieved dependable results when screening groups of Kindergarten students in a public school setting.     

"青少年学生生活满意度量表"的概化理论研究

概化理论是用统计调整技术分析测量误差的一种测量理论,它侧重于从宏观方面讨论实测时的测量条件与结论推广应用范围之间的关系来探讨测量的外部效度问题。本文用概化理论对青少年学生生活满意度量表(CASLSS)进行了研究,得到以下研究结果:(1)对于生活满意度的维度数目,就我国青少年学生而言取6到8个维度较为合适,当对CASLSS取2个维度时,CASLSS只适合作常模参照性解释,而不适合作标准参照性解释;(2)CASLSS的各分量表和总量表的信度较高,且它不仅可以作常模参照性解释,还适合作标准参照性解释;(3)CASLSS的环境满意度因子相对其它五个因子而言,量表特性稍差,是今后改进该量表的主要方向。CASLSS无论是各个因子还是总量表均具有非常优良的量表特性,值得在实际的工作和研究中加以推广应用。     

Reliability and sources of validity evidence of the Oviedo Schizotypy Assessment Questionnaire-Abbreviated (ESQUIZO-Q-A)

The main goal of this research was to examine the reliability and different sources of validity evidence of the Oviedo Schizotypy Assessment Questionnaire-Abbreviated (ESQUIZO-Q-A) in nonclinical adolescents. The final sample was made up of 1,455 participants, 705 males (48.5%), with a mean age of 15.92 years (SD = 1.18). The internal consistency of the subscales ranged from .62 to .75. The analysis of its internal structure yielded a three-dimensional solution based on the dimensions: Reality Distortion, Anhedonia, and Interpersonal Disorganization. Likewise, the goodness-of-fit indices derived from the Confirmatory Factor Analysis for the hypothesized three-factor model were adequate. The three dimensions of the ESQUIZO-Q-A were significantly correlated with the subscales of the Strengths and Difficulties Questionnaire. The ESQUIZO-Q is a brief and simple self-report with adequate psychometric properties for the assessment of schizotypal traits in nonclinical adolescent populations. Future research should continue to explore the metric quality of the ESQUIZO-Q-A (e.g., sensitivity and specificity) and incorporate the new advances in psychological and educational assessment such as Computerized Adaptive Testing.     

Compiling Measurement Invariant Short Scales in Cross-Cultural Personality Assessment Using Ant Colony Optimization

Examining the influence of culture on personality and its unbiased assessment is the main subject of cross-cultural personality research. Recent large-scale studies exploring personality differences across cultures share substantial methodological and psychometric shortcomings that render it difficult to differentiate between method and trait variance. One prominent example is the implicit assumption of cross-cultural measurement invariance in personality questionnaires. In the rare instances where measurement invariance across cultures was tested, scalar measurement invariance—which is required for unbiased mean-level comparisons of personality traits—did not hold. In this article, we present an item sampling procedure, ant colony optimization, which can be used to select item sets that satisfy multiple psychometric requirements including model fit, reliability, and measurement invariance. We constructed short scales of the IPIP-NEO-300 for a group of countries that are culturally similar (USA, Australia, Canada, and UK) as well as a group of countries with distinct cultures (USA, India, Singapore, and Sweden). In addition to examining factor mean differences across countries, we provide recommendations for cross-cultural research in general. From a methodological perspective, we demonstrate ant colony optimization's versatility and flexibility as an item sampling procedure to derive measurement invariant scales for cross-cultural research. © 2020 The Authors. European Journal of Personality published by John Wiley & Sons Ltd on behalf of European Association of Personality Psychology     

迷宫与动物行为研究

在动物心理学的实验研究中,迷宫是很常用的一种仪器。文章介绍了迷宫的发展历史、类型以及应用的研究领域,并讨论了未来迷宫方法的进一步改进及其广泛的应用前景。     

评价中心结构效度的多元概化理论分析研究

评价中心技术是现代人事测评的一种主要形式,主要通过多种模拟任务来测评高级管理人才。然而,少有研究能证明它具有理想的结构效度。该研究运用多质多法分析了某金融企业一次真实的评价中心测评项目,发现测评的结构效度并不理想。接着,通过多元概化理论的分析,探讨了结构效度不理想的原因,并指出了评价中心任务与所测维度之间的关系,以及对各维度的测量信度。最后,根据分析结果,探讨了优化评价中心结构效度和提升整体测量信度的途径。     

青少年学习倦怠量表的多元概化分析

运用多元概化理论考察青少年学习倦怠量表（ASBI）的测量学属性。结果发现,ASBI各因子以及全量表的概化系数和可靠性指数均达到较好水平,既可用于常模参照测验,也可用于标准参照测验;各因子的分量比例还不尽完善,低成就感对全域总分的贡献略低于在全量表中的分值比重,对相对误差方差贡献最大的是低成就感,学业疏离对绝对误差方差的贡献最大;今后ASBI的修订工作,可考虑对学业疏离和低成就感因子条目质量的改进,同时适当增加身心耗竭因子的条目数以提高其测量信度。     

Don't Take Out This Appendix! Generalizability of the Global Assessment of Relational Functioning Scale

This study investigated the generalizability of the Global Assessment of Relational Functioning (GARF) Scale. Found in an appendix of the Diagnostic and Statistical Manual of Mental Disorders under "Criteria Sets for Axes Provided for Future Study," the GARF Scale provides a global rating of a relational unit (family or couple). Thirty-two raters assigned GARF ratings to five relational units. Generalizability analyses indicate extremely high dependability of GARF scores across raters. Higher generalizability coefficients were found for raters who had formal education in family systems theory. Overall, these results are an encouraging step towards adopting the GARF for widespread use.     

领悟社会支持量表的多元概化分析

目的:拟用多元概化理论考察领悟社会支持量表在高中生群体中应用的测量学性能。方法:以p×i随机测量模式的概化设计,针对1500名在校高中生进行领悟社会支持调查。结果:三个因子的相关程度较高(0.65以上);整体量表的概化系数和可靠性指数均达到了0.9以上,而各因子在0.77以上。结论:整体量表及各因子在高中生群体中应用的信效度较高,可用作常模和标准参照测验;量表在各因子的分值比和项目数上,设计较合理和完善。     

Beyond the Score: Clinical Evaluation Through Formal Psychological Assessment

Questionnaires generate numerical scores, but endorsing different sets of items could produce the same score despite reflecting qualitatively different configurations of clinical features. Formal psychological assessment (FPA) attempts to overcome this by identifying the clinical features entailed by observed response patterns. This study illustrates an application of FPA to the cleaning subscale of a questionnaire assessing obsessive–compulsive symptoms and DSM–IV–TR diagnostic criteria for obsessive–compulsive disorder. A deterministic model of the items–criteria relationships was constructed by mapping each item to each diagnostic criterion. The resulting model was tested on a large community sample (N = 4,412). Results indicate that the theoretical model has adequate fit; item error rates and probabilities for each of the criteria are examined. Clinically relevant examples of the items–criteria relationships are discussed. Possible applications of FPA to personality assessment are also discussed, including long multidimensional questionnaires and questionnaires that use subtle item content.     

7种嫉妒评估量表的信度与效度研究

研究西方7种嫉妒评估量表在中国使用的信度与效度。结果发现,7种嫉妒评估量表具有较高的分半信度和内部一致性信度;内容效度和效标关联效度能够满足中国被试者的使用要求;但各量表内容重复性较大,适用范围限于爱情及关系嫉妒,并不适合评估其他嫉妒类型。     

用概化理论分析胜任特征核检表评价的影响因素

构建15种概化理论分析模型,探讨胜任特征核检表评价的主要影响因素.研究数据为小学校长胜任特征核检表评价数据.研究通过比较不同模型的概化系数变化量,发现评价者所属组别和评价者所属地域为主要影响因素,根据所得主要影响因素之间的关系,提出用于评价数据的最佳概化理论分析模型.概化模型分析所得结果基本符合实际评价情况,说明用概化理论分析评价的影响因素具有可操作性.     

Using Generalizability Theory to Disattenuate Correlation Coefficients for Multiple Sources of Measurement Error

Over the years, research in the social sciences has been dominated by reporting of reliability coefficients that fail to account for key sources of measurement error. Use of these coefficients, in turn, to correct for measurement error can hinder scientific progress by misrepresenting true relationships among the underlying constructs being investigated. In the research reported here, we addressed these issues using generalizability theory (G-theory) in both traditional and new ways to account for the three key sources of measurement error (random-response, specific-factor, and transient) that affect scores from objectively scored measures. Results from 20 widely used measures of personality, self-concept, and socially desirable responding showed that conventional indices consistently misrepresented reliability and relationships among psychological constructs by failing to account for key sources of measurement error and correlated transient errors within occasions. The results further revealed that G-theory served as an effective framework for remedying these problems. We discuss possible extensions in future research and provide code from the computer package R in an online supplement to enable readers to apply the procedures we demonstrate to their own research.