A rasch model for continuous ratings

A unidimensional latent trait model for continuous ratings is developed. This model is an extension of Andrich's rating formulation which assumes that the response process at latent thresholds is governed by the dichotomous Rasch model. Item characteristic functions and information functions are used to illustrate that the model takes ceiling and floor effects into account. Both the dichotomous Rasch model and a linear model with normally distributed error can be derived as limiting cases. The separability of the structural and incidental parameters is demonstrated and a procedure for estimating the parameters is outlined.     

Effects of the use of percentage agreement on behavioral observation reliabilities: A reassessment

The percentage agreement index has been and continues to be a popular measure of interobserver reliability in applied behavior analysis and child development, as well as in other fields in which behavioral observation techniques are used. An algebraic method and a linear programming method were used to assess chance-corrected reliabilities for a sample of past observations in which the percentage agreement index was used. The results indicated that, had kappa been used instead of percentage agreement, between one-fourth and three-fourth of the reported observations could be judged as unreliable against a lenient criterion and between one-half and three-fourths could be judged as unreliable against a more stringent criterion. It is suggested that the continued use of the percentage agreement index has seriously undermined the reliabilities of past observations and can no longer be justified in future studies.     

How many fidgets in a pretty much: A critique of behavior rating scales for identifying students with ADHD

The school psychologist's role and responsibilities for meeting the needs of students with Attention-Deficit Hyperactivity Disorder (ADHD) have been expanding in recent years. Students with this disorder present refractory problems that may involve the school psychologist in the assessment and diagnosis of ADHD. Rating scales commonly are used, sometimes in conjunction with other techniques, for assessing and diagnosing ADHD. They often are presented as an objective way to quantify the severity of a child's behavior in comparison with a normative standard. Because rating scales have become such an integral component in the identification of children with ADHD, school psychologists should understand the limitations associated with this methodology. In this article we first describe behavior rating scales and difficulties in the use of cutoff scores to identify students as ADHD. Second, we describe how problems with interobserver agreement hamper the validity of rating scales and the subsequent conclusions that can be drawn about students' behavior. Finally, we present recommendations for obtaining more reliable and valid information from rating scales.     

Parent vs. Self-Report: Contributions Toward Diagnosis of Adolescent Psychopathology

Assessment of psychopathology in adolescents can be complicated due to uncertainties about who should be considered the primary informant. While a multimethod, multiinformant approach to assessment allows for a thorough assessment, it can also result in contradictory findings. The purpose of this study was to use a sample of 121 adolescents to investigate issues of parent-adolescent agreement on behavior rating scales and a structured diagnostic interview. Additionally, this study evaluated whether adolescent report offers unique information to the assessment beyond the parent's report. The sample included both normal controls and adolescents who met criteria for diagnosis of an Internalizing or Externalizing disorder based on the DSM-IV criteria. Agreement between parents and adolescents on the Diagnostic Interview for Children and Adolescents—Revised (DICA-R) was low for ADHD (39.4%) and Externalizing Disorders (41.1%) and moderate for Internalizing Disorders (56.6%). A significant difference was found between the number of ADHD symptoms reported, with parents reporting more symptoms (M = 9.42) than adolescents (M = 8.34). Regression analysis indicated that the adolescent completed Youth Self-report (YSR) contributed unique information beyond the parent completed measures in predicting both the adolescent and the parent interviews for Internalizing Disorders. This finding emphasizes the need to continue to collect self-report information, especially when assessing Internalizing disorders, which inherently contain symptoms indicating high-risk behaviors such as suicide ideation.     

Preference ratings of images representing archetypal themes: an empirical study of the concept of archetypes

Archetype Theory is consistent with the full range of empirical psychological research, yet has not itself been empirically studied. As part of a project to integrate psychological theory, especially psychotherapeutic theory, with empirical research, I asked 151 subjects to rate their preferences for images representing archetypal themes and factor analysed their responses. The results are consistent with the hypothesis that archetypal themes determine affective responses in adults. Archetype theory may prove itself to be useful in operationalizing a number of contemporary psychological theories.     

A New Self-Report Scale for Assessment of Adolescent Psychopathology: Factor Structure, Reliability, Validity, and Diagnostic Sensitivity

This paper describes four studies on self-reported problems in 2,243 adolescent males and females, 12 to 17 years of age. In Study 1, principal-axis factoring of 102 items covering 11 problem domains revealed six factors comprising 49.5% of the variance. Study 2 used confirmatory factor analysis of a 64-item reduced set on a new sample of 408 adolescents. Goodness-of-fit indicators suggested that the six-factor model had excellent fit to the data. Study 3 used data from the 2,157 adolescents used in the first two studies. Coefficient alphas ranged from .83 to .92. Median test-retest reliability for the six factors was .86. There was a consistent structure of the correlation matrix across age and gender. Study 4 was a study of criterion validity, using an additional sample of 86 children with attention-deficit hyperactivity disorder (ADHD). Sensitivity and specificity were high, with an overall diagnostic efficiency of 83%. This new self-report scale, the Conners/Wells Adolescent Self-Report of Symptoms (CASS), may provide a useful component of a multimodal assessment of adolescent psychopathology.     

Measurement of depression: Comparison between self-reports and clinical assessments of depressed outpatients

Agreement among several depression scales was investigated as regard the relative influences of administration mode (self-rating or clinical rating) and scale content. The Beck Depression Inventory (BDI), the Self-Rating Depression Scale (SDS), the Hamilton Rating Scale for Depression (HRSD), and three corresponding scales with identical structure and content but the alternative administration mode were administered to 47 outpatients with diagnoses of DSM-III major depression disorders. Correlations between the total scores and the degrees of association between corresponding items of different scales were calculated. The results suggest that differences in content contribute more to inter-scale discrepancy than differences in administration mode. The implications for the evaluation of outpatients with major depression are discussed.     

Artifact in pain ratings,its implications for test-retest reliability,and correction by a new scaling procedure

The conventionally employed procedure for rating ischemic pain was found to produce a degree of response bias associated with the ceiling points of the scale used. A new approach permitting open-ended ratings followed by transformation of these ratings into a common decile scale provided far greater test-retest reliability. This was explained largely in terms of the attenuation of rating artifact. The new procedure also gave rise to consistently linear functions for ischemic pain. Implications are raised for the measurement of pain as well as other psychological continua.     

Parent Ratings of Attention-Deficit/Hyperactivity Disorder Symptoms: Factor Structure and Normative Data

Changes in the diagnostic criteria for attention-deficit/hyperactivity disorder (ADHD) have necessitated the creation of new measures for clinical assessment. The factor structure of a parent rating scale containing the 18 symptoms of ADHD was examined in this study. Factor analyses and assessment of differences in ADHD ratings across sex, age, and ethnic group were conducted using a sample of 4666 participants ranging in age from 4 to 20 years old who attended kindergarten through 12th grade in 22 school districts across the United States. Two factors (Inattention and Hyperactivity–Impulsivity) were derived and normative data for a nationally representative sample are presented. A higher frequency of ADHD symptoms was found for boys, younger children, and African-American participants. Potential uses of this scale in clinical practice and research are discussed.     

青年学生自我价值感量表的编制

自我价值感是一个多维度、多层次的心理结构,按其抽象程度的不同可分为总体自我价值感、一般自我价值感和特殊自我价值感．其中一般和特殊自我价值感又可区分为社会取向和个人取向两种类型。按照此种概念性架构并对重庆市598名大学生的测试后所作的因素分析,编制了具有较高信度和效度的自我价值量表。