Curriculum-based measurement of oral reading: Passage equivalence and probe-set development

Curriculum-based measurement of reading (CBM-R) is used to estimate oral reading fluency. Unlike many traditional published tests, CBM-R materials are often comprised of 20 to 30 alternate forms/passages. Historically, CBM-R assessment materials were sampled from curricular materials. Recent research has documented the potentially deleterious effects of poorly controlled alternate forms on CBM-R outcomes. The purpose of this study was to examine alternate procedures for the selection of passages that comprise CBM-R passage-sets. The study examined four procedures for the evaluation and selection of passages, including random sampling, Spache readability formula, mean level of performance evaluation, and Euclidean Distance evaluation. The latter two procedures relied on field testing and evaluation of student performance. Each of eighty-eight students in second- and third-grade were administered 50 CBM-R passages. Generalizability and dependability studies were used to examine students' performance on these passages and evaluate CBM-R passage selection procedures. Results provide support for the use of field testing methods (i.e., calculating performance means and Euclidean Distances) for passage selection. Implications are discussed for future research and practice.     

Reliability of the Child and Adolescent Needs and Strengths-Mental Health (CANS-MH) Scale

We examined the interrater reliability of the Child and Adolescent Needs and Strengths-Mental Health (CANS-MH) scale among researchers and between researchers and clinicians. All children presenting to a treatment facility for either protective or mental health needs were eligible to be included in the study. As part of standard assessment procedure, all children entering the facility were described by caseworkers using the CANS-MH. A random sample of 60 cases was selected and researchers made retrospective assessments using the CANS-MH based on chart review. Results of the interrater reliability support previous findings that the CANS-MH is a reliable measure of clinical and psychosocial needs and strengths. Results also suggest that ratings on the CANS-MH based on medical record abstraction by researchers relate to ratings performed by clinical staff, demonstrating the clinical and research utility of the CANS-MH. The CANS-MH can be used reliably to assess the type and severity of problem presentation, risk behaviors, functioning, care intensity and organization, caregiver capacity and strengths among children with protective and mental health needs. In addition, items of the CANS-MH appear to be reliable supporting the use of these items individually. Findings are relevant to the ongoing delivery of clinical services, monitoring of quality assurance, and outcomes.     

The reliability and construct validity of scores on the Japanese version of an academic self‐concept scale for a sample of college students1

Abstract: This study investigated the internal consistency, reliability, and construct validity of scores on the Japanese version of the Dimensions of Self‐Concept (DOSC) academic self‐concept scale for a sample of 177 students at a small Japanese private college. Confirmatory factor analyses showed promising support for the construct validity of scores on the six factor subscales (Level of Aspiration, Anxiety, Academic Interest and Satisfaction, Leadership and Initiative, Identification versus Alienation, and Stress), representing the six hypothesized constructs of academic self‐concept. Internal consistency reliability of scores on the six subscales ranged from 0.82 to 0.87.     

Intentional Faith: An Alternative View of Faith Development

Faith was defined as the search for an integrating center of value and meaning that is cognitional in nature, developmental in process, and transcendental in its dimensions. An original psychometric measure was constructed and tested in two samples in a midwestern metropolitan area. The life span sample of Catholics (N = 509) ranged in ages 18–84, median age 49. Respondents were 40% male, 60% female. The sample of college students (N = 303) had a mode age of 19, but was ethnically and religiously diverse. The results indicated that the covariance structure of the scale was equivalent for the two samples. The scale clearly measures 4 independent aspects of faith: Self and Moral development, God and Death, Ritual, and Authority. Reliability was established for four developmental Ways of Faith, based on Bernard Lonergan's intentionality analysis: Common Sense Faith, Thoughtful Faith, Responsible Faith, and Transcendent Faith. The data suggested that faith development may be best conceived as a continuous reworking of one's faith, rather than a sequence of acquisition and abandonment of beliefs. A mixed pattern of modest gender, age, and attachment effects was found for the Ways of Faith. A measure of self-church identification was found to be a consistent correlate of faith development.     

What sources contribute to variance in observer ratings? Using generalizability theory to assess construct validity of psychological measures

Cronbach and Meehl (Psychol. Bull. 1955; 52:281–302) stated that the key question to be addressed when assessing construct validity is ‘What sources contribute to variance in test performance?’ We illustrate the utility of generalizability theory (GT) as a conceptual framework that encourages psychological researchers to address this question and as a flexible set of analytic tools that can provide answers to inform both substantive theory and measurement practice. To illustrate these capabilities, we analyze observer ratings of 27 caregiver–child dyads, focusing on the importance of situational (contextual) factors as sources of variance in observer ratings of caregiver–child behaviors. Cross‐situational consistency was relatively low for the categories of behavior analyzed, indicating that dyads vary greatly in their interactional patterns from one situation to the next, so that it is difficult to predict behavioral frequencies in one context from behaviors observed in a different context. Our findings suggest that single‐situation behavioral measures may have limited generalizability, either to behavior in other contexts or as measures of global interaction tendencies. We discuss the implications of these findings for research and measurement design in developmental psychology. Copyright © 2008 John Wiley & Sons, Ltd.     

A statistical model for discriminating between subliminal and near-liminal performance

The concept of a psychophysical threshold is foundational in perceptual psychology. In practice, thresholds are operationalized as stimulus values that lead to a fairly high level of performance such as .75 or .707 in two-choice tasks. These operationalizations are not useful for assessing subliminality—the state in which a stimulus is so weak that performance is at chance. We present a hierarchical Bayesian model of performance that incorporates a threshold that divides subliminal from near-liminal performance. The model provides a convenient means to measure at-chance thresholds and therefore is useful for testing theories of subliminal priming. The hierarchical nature of the model is critical for efficient analysis as strength is pooled across people and stimulus values. A comparison to Rasch psychometric models is provided.     

ON EXPLICATING THE CONCEPT THE POWER OF AN ARITHMETICAL THEORY

In this paper I discuss possible ways of measuring the power of arithmetical theories, and the possiblity of making an explication in Carnap’s sense of this concept. Chaitin formulates several suggestions how to construct measures, and these suggestions are reviewed together with some new and old critical arguments. I also briefly review a measure I have designed together with some shortcomings of this measure. The conclusion of the paper is that it is not possible to formulate an explication of the concept.     

纵向Rasch模型在大学新生适应性追踪研究中的应用

对1952名大学新生进行适应性调查,其中285人接受了2次以上的追踪调查,所得的多级评分重复测量数据采用纵向Rasch模型进行统计分析。研究应用SAS的GLIMMIX过程对多层Rasch模型参数估计作了新的尝试。结果表明：（1）新生在第一学年内,学习和情绪适应总体呈上升趋势,人际适应呈下降趋势;（2）不同个体入学时的适应状况差异显著,但是随时间变化的趋势、快慢相同;（3）学习适应分量表的项目稳定性较好,而人际、情绪适应的部分项目难度存在时间效应。研究结果对新生辅导具有启示意义     

计算机人格适应性测验的初始值估计研究

一般来说,对于计算机人格适应性测验（CAPT）,由于对被试每种人格特质的施测项目数比较少,初始值估计方法的好坏直接影响着被试人格特质水平估计的准确性。该研究提出利用被试特质水平与其人格特质自我评定信息的回归模型来获取被试人格特质水平的初始值。模拟数据的研究结果表明：新方法获得的初始值确实能够更准确的估计被试的特质水平。     

公共服务动机测量的发展与展望

公共服务动机理论是西方管理心理学领域的一个新兴流派,其概念的正式提出仅有20年历史。文章简要回顾了公共服务动机测量研究的发展历程,总结了测量工具信度和效度及其跨文化验证研究中出现的问题,对理论构念和模型建构中进行了反思,并总结了测量工具的几种不同修订。最后指出,公共服务动机测量在中国的发展,至少有三个方面的发展空间：1）多动机同时测量;2）内隐测量;3）测量的本土化。