A Psychometric Analysis of the Child Behavior Checklist DSM-Oriented Scales

The Child Behavior Checklist for Ages 6–18 (CBCL/6-18) possesses newly developed DSM-Oriented Scales, constructed through expert clinical judgment to match selected categories for behavioral/emotional problems as described in the DSM-IV. The present investigation examined the basic psychometric properties for all six DSM-Oriented Scales (i.e., Affective, Anxiety, Somatic, Attention-Deficit/Hyperactivity, Oppositional, and Conduct Scales) in a large clinical sample of children and adolescents (N = 673). Findings from the present study provide strong evidence for the reliability, as well as convergent and discriminative validity, of these scales. It appears that the DSM-Oriented Scales may provide accurate supplementary information that may be considered when formulating clinical diagnoses.

How to find what's in a name: Scrutinizing the optimality of five scoring algorithms for the name‐letter task

Although the name‐letter task (NLT) has become an increasingly popular technique to measure implicit self‐esteem (ISE), researchers have relied on different algorithms to compute NLT scores and the psychometric properties of these differently computed scores have never been thoroughly investigated. Based on 18 independent samples, including 2690 participants, the current research examined the optimality of five scoring algorithms based on the following criteria: reliability; variability in reliability estimates across samples; types of systematic error variance controlled for; systematic production of outliers and shape of the distribution of scores. Overall, an ipsatized version of the original algorithm exhibited the most optimal psychometric properties, which is recommended for future research using the NLT. Copyright © 2009 John Wiley & Sons, Ltd.     

Coefficients Alpha,Beta, Omega,and the glb: Comments on Sijtsma

There are three fundamental problems in Sijtsma (Psychometrika, 2008): (1) contrary to the name, the glb is not the greatest lower bound of reliability but rather is systematically less than ω _t (McDonald, Test theory: A unified treatment, Erlbaum, Hillsdale, 1999), (2) we agree with Sijtsma that when considering how well a test measures one concept, α is not appropriate, but recommend ω _t rather than the glb, and (3) the end user needs procedures that are readily available in open source software.     

On the Use,the Misuse,and the Very Limited Usefulness of Cronbach’s Alpha

This discussion paper argues that both the use of Cronbach’s alpha as a reliability estimate and as a measure of internal consistency suffer from major problems. First, alpha always has a value, which cannot be equal to the test score’s reliability given the interitem covariance matrix and the usual assumptions about measurement error. Second, in practice, alpha is used more often as a measure of the test’s internal consistency than as an estimate of reliability. However, it can be shown easily that alpha is unrelated to the internal structure of the test. It is further discussed that statistics based on a single test administration do not convey much information about the accuracy of individuals’ test performance. The paper ends with a list of conclusions about the usefulness of alpha.     

近乎完美量表修订版（APS-R）的中文修订

对近乎完美量表修订版（APS-R）进行中文修订,并考察其信度和效度。1174名大学生参加正式测试,321名学生7周后参加了复测。结果显示,量表的内部一致性信度、分半信度和重测信度比较理想;探索性因素分析和验证性因素分析均支持APS-R的高标准、差异和秩序的理论建构;高标准分量表与自尊、自我效能感、正性情绪呈正相关,差异分量表与抑郁、特质焦虑、状态焦虑和负性情绪呈正相关。APS-R中文修订版具有较高的信效度,可以作为国内完美主义研究、心理咨询和治疗工作的一个有效工具。     

从多元概化理论看高考综合能力测试的改进

通过多元概化理论的研究发现,高考综合能力测试（2001,广东）的总体信度达到了可以接受的水平（0.784）。但测验中各部分对总方差的贡献程度与预定的赋分比例有较大差距。其中,地理和政治的贡献度偏低,化学和历史的贡献度偏高。这表明有（历史和化学）偏科特点的考生得到了较高的综合分数。又经决策(D)研究发现,增加地理部分的题量会反常地降低测验的总体信度,这说明有不少高分考生答错或主动放弃了地理科题目。因此,如何有效控制各部分的实际贡献程度、避免负面导向是当前高考综合能力测试亟待解决的问题。     

7种嫉妒评估量表的信度与效度研究

研究西方7种嫉妒评估量表在中国使用的信度与效度。结果发现,7种嫉妒评估量表具有较高的分半信度和内部一致性信度;内容效度和效标关联效度能够满足中国被试者的使用要求;但各量表内容重复性较大,适用范围限于爱情及关系嫉妒,并不适合评估其他嫉妒类型。     

Between-measure consistency in social-skills assessment

The purpose of the present study was to assess the between-measure consistency of general and specific social-skills assessment strategies. Nineteen mentally retarded adults were assessed using both common and newly devised measures of social skills: (1) specific (molecular) behavior ratings from role-play assessments, (2) general (molar) ratings based on the role plays, staff (3) molar and (4) molecular predictions of client social skills use in the described role-play situations, (5) peer sociometric ratings, and molecular in vivoobservations conducted in (6) cafeteria and (7) party settings. For all molecular measures, the subjects were assessed on eye contact, response relevance, response latency, voice volume, and appropriate affect, which allowed for direct comparisons to be made between each of these assessment modalities. In addition, the role-play assessment was conducted under two distinct conditions to determine whether role-play performance varied between standard and reinforced administrations; however, multivariate analyses (MANOVA) revealed no differences between the two assessments. Correlations between the molar and the molecular measures suggested a substantial overlap between the measures, with staff ratings having the highest consistency with the other measures. Furthermore, MANOVAs calculated between role-play ratings and those of staff revealed little difference between the two. The limitations on and practical significance of these findings are discussed.     

Reliability and validity of the Multiple Affect Adjective Check List - Revised

A recent factor analysis of the Multiple Affect Adjective Check List (MAACL) changed the Anxiety, Depression, and Hostility scales from bipolar to unipolar scales and added two new scales: Positive Affect and Sensation Seeking. Internal reliability of the MAACL-R scales, computed for normal and patient samples, was adequate for state and trait forms except for Sensation Seeking. Test-retest reliability in college students was higher for the trait form with retest intervals of from 2 to 8 weeks than for the state form with retest intervals of from 2 to 5 days. The pattern of correlations among self-, peer, and counselor ratings and the MAACL-R scales for normal and patient samples indicates improved discriminant validity and equally good convergent validity as the old scales. The use of standard scores that are indexed to the number of items checked reduced scale intercorrelations by controlling the acquiescence set.The financial support of the Weldon Springs Endowment Fund, University of Missouri at Kansas City, toward the completion of this research project is gratefully acknowledged.     

Measuring grief: A short version of the perinatal grief scale

Despite a considerable number of studies, there are two major drawbacks in the literature on grief and bereavement. One is a lack of adequate and generally agreed upon measures for assessing grief. The second is a lack of ability to predict from existing measures the likelihood of what has been termed chronic or pathological grief reactions. This paper reports the results of the development of a bereavement measure for the study of perinatal loss which attempts to address these gaps. The measure is specific to a pregnancy-related loss, although it has the potential for adaptation to use for other types of loss. Analysis of responses from 138 women has resulted in the reduction of the original measure from 104 to a more manageable and almost equally comprehensive and reliable 33 items. In addition, a factor analysis has produced three factors, two of which indicate the possibility for longer-term and more severe grief reactions. Because of its sound psychometric qualities and interesting factor structure, the measure shows promise of being useful for both research and clinical purposes.This research was funded by National Institute of Child Health and Human Development Grant R01 H18431-04, with additional assistance from the Center for Social Research at Lehigh University. Dr. Potvin is supported by the Quebec Health Research Fund.