The Child and Adolescent Functional Assessment Scale (CAFAS): Review and Current Status

Measures of impairment in psychological and behavioral functioning have a long history in the field of children's mental health, and appear particularly useful in eligibility determination, treatment planning, and outcome evaluation of services for children and adolescents with serious emotional disturbance (SED). One recently developed multidimensional measure of functional impairment—the Child and Adolescent Functional Assessment Scale (CAFAS; K. Hodges, 1989, 1997)—has enjoyed widespread use nationwide. It has been adopted as a tool for making treatment eligibility decisions and documenting outcomes on a statewide level in more than 20 states and on a local level in dozens of research and demonstration projects. In this paper, the technical merits of the CAFAS are closely examined, with the conclusion that empirical evidence is lacking to support its valid use in making the types of treatment decisions for which it is currently being employed across the nation. Furthermore, there appears to be little concern among mental health researchers, practitioners, administrators, and state legislators about these apparent limitations of the CAFAS. The potential benefits of establishing objective and valid level-of-need criteria, using the CAFAS are numerous and the interest in doing so is clear; however, the psychometric limitations of the scale identified in this review need to be addressed before its full potential can be realized.     

Toward the Scientific Study of Polytheism: Beyond Forced‐Choice Measures of Religious Belief

This article argues that zero‐sum, forced‐choice approaches to measuring religious belief do not work well outside of the Abrahamic world. Positive‐sum approaches to measuring religious beliefs (in the plural) are better suited to the study of polytheistic societies. Using results from a nationally representative survey conducted in 2011 Taiwan, we demonstrate that in a polytheistic society like Taiwan, religious belief is not zero sum. We also contrast our results with those of the Taiwan Social Change Survey (TSCS), and seek to show that our positive‐sum approach to measuring religious beliefs can help us better understand the disparate causes and consequences of different religious beliefs in polytheistic societies. The challenge of Christocentrism in quantitative studies of religion is also discussed.     

COMPUTER‐ASSISTED MEASUREMENT OF WOUND SIZE ASSOCIATED WITH SELF‐INJURIOUS BEHAVIOR

We evaluated an inexpensive, efficient, and noninvasive technique for measuring tissue damage produced by self‐injurious behavior (SIB). The technique involved computerized measurement of wound surface area (WSA) based on digital photographs. In Study 1, we compared photographic measurement to a more commonly used procedure, transparency measurement, in estimating WSA of 20 wound models. Results showed that both methods were reliable and that there was a high degree of correspondence between the 2 sets of measures. In Study 2, we compared photographic WSA measures to direct‐observation measures in documenting changes over time in the SIB exhibited by a woman with Prader‐Willi syndrome. Results showed that increases and decreases in observed SIB during baseline and treatment conditions corresponded with changes in WSA measures, indicating that the computer‐assisted photographic technique may be useful as a corroborative measure or as a primary measure when direct observation of SIB is not feasible.     

OBSERVER TRAINING REVISITED: A COMPARISON OF IN VIVO AND VIDEO INSTRUCTION

We compared the effects of 2 observer‐training procedures. In vivo training involved practice during actual treatment sessions. Video training involved practice while watching progressively more complex simulations. Fifty‐nine undergraduate students entered 1 of the 2 training conditions sequentially according to an ABABAB design. Results showed that the 2 training methods produced almost identical scores on a posttraining observational test; however, the video method required fewer training sessions to complete.     

Measurement invariance and age-related differences of trait anger across the adult lifespan

The present study examined measurement invariance of trait anger with respect to age. In addition, age-related differences in latent variables (factor variances, factor covariances, and factor means) were investigated. A sample of 1216 participants, divided into six age groups, ranging from under 30 to over 70 years, was tested using the angry temperament and angry reaction scales from the State-Trait Anger Expression Inventory (STAXI; Spielberger, 1988). Results show that strong measurement invariance held across the six age groups. For both angry temperament and angry reaction, factor variances tended to decrease into middle age and then increase again into old age. Factor correlations decreased into old age, implying a differentiation of trait anger. Finally, regarding factor means, older adults showed less anger than younger adults, suggesting higher levels of self-regulation or less exposure to anger-provoking contexts in later life.     

Getting precise and pragmatic about the assessment of bullying: the development of the California Bullying Victimization Scale

Accurate assessment of bullying is essential to intervention planning and evaluation. Limitations to many currently available self-report measures of bullying victimization include a lack of psychometric information, use of the emotionally laden term "bullying" in definition-first approaches to self-report surveys, and not assessing all components of the definition of bullying (chronicity, intentionality, and imbalance of power) in behavioral-based self-report methods. To address these limitations, we developed the California Bullying Victimization Scale (CBVS), which is a self-report scale that measures the three-part definition of bullying without the use of the term bully. We examined test-retest reliability and the concurrent and predictive validity of the CBVS across students in Grades 5-12 in four central California schools. Concurrent validity was assessed by comparing the CBVS with a common, definition-based bullying victimization measure. Predictive validity was examined through the co-administration of measures of psychological well-being. Analysis by grade and gender are included. Results support the test-retest reliability of the CBVS over a 2-week period. The CBVS was significantly, positively correlated with another bullying assessment and was related in expected directions to measures of well-being. Implications for differentiating peer victimization and bullying victimization via self-report measures are discussed.     

A critical review of relationship quality measures: Is a fresh start needed? An agenda to move forward

Social relationships in and around work are a fundamental building block of organizational life. According to a number of relationship theories, the quality of those relationships is a critical aspect of their influence on a variety of employee and organizational outcomes. Relationship quality is, therefore, one of the most commonly studied constructs in management research. Our paper critically reviews the landscape of relationship quality measures used in management studies, identifying critical issues with how the construct has been conceptualized and measured. To help advance research on the subject and improve measurement, we identify and evaluate 21 relationship quality measures that have been developed for, or used in, management research. Overall, we find that the instruments used to measure relationship quality in management research have significant limitations associated with their conceptualizations and operationalizations. Many of these limitations stem from the fact that most of the measures used to assess the construct were not originally designed to measure relationship quality, which impedes research clarity and implications. We offer a future research agenda and several recommendations for the advancement of management research on relationship quality.     

Examiner error in curriculum-based measurement of oral reading

Although curriculum based measures of oral reading (CBM-R) have strong technical adequacy, there is still a reason to believe that student performance may be influenced by factors of the testing situation, such as errors examiners make in administering and scoring the test. This study examined the construct-irrelevant variance introduced by examiners using a cross-classified multilevel model. We sought to determine the extent of variance in student CBM-R scores attributable to examiners and, if present, the extent to which it was moderated by students' grade level and English learner (EL) status. Fit indices indicated that a cross-classified random effects model (CCREM) best fits the data with measures nested within students, students nested within schools, and examiners crossing schools. Intraclass correlations of the CCREM revealed that roughly 16% of the variance in student CBM-R scores was associated between examiners. The remaining variance was associated with the measurement level, 3.59%; between students, 75.23%; and between schools, 5.21%. Results were moderated by grade level but not by EL status. The discussion addresses the implications of this error for low-stakes and high-stakes decisions about students, teacher evaluation systems, and hypothesis testing in reading intervention research.