A Study of Reliability Across Multiple Raters When Using the NAEP and MDFS Rubrics to Measure Oral Reading Fluency

Becoming a fluent reader has been established as important to reading comprehension. Prosody (expression) is an indicator of fluent reading that is linked to improved comprehension in students across elementary, middle, and secondary grades. Fluent reading is most often evaluated by classroom teachers through the use of a rubric, with the most common being the Multi-Dimensional Fluency Scale (MDFS) and the National Assessment of Educational Progress (NAEP) scale. This investigation uses a generalizability study (G-study) and a decision study (G-study) to determine reliability and efficiency of the two rubrics across five raters and two rating occasions in 177 first- through third-grade students. The results revealed the MDFS and NAEP to be parallel instruments with variance attributable to raters ranging from nearly 0 to 2.2%. Generalizability coefficients ranging from 0.91 to 0.94, indicating high reliability were found for both instruments. Recommendations for administration efficiency of each rubric are provided and instructional implications are discussed.     

Applying statistics to the gatekeeping of expert evidence: Introducing the Structured Statistical Judgement (SSJ)

Daubert required judges to base their decisions about the admissibility of expert witness testimony in large part on the reliability and validity of empirical observations. Because judges have a wide array of duties and may not be equipped to understand the complexities of statistical analysis, some jurists have recommended that court‐appointed experts assist judges in their gatekeeping function. To assist such experts in scrutinizing empirical papers, we propose a Structured Statistical Judgement (SSJ) that takes advantage of advances in the various statistical methods – such as effect sizes that adjust for error – which have allowed researchers to report increasingly more reliable and valid observations. We also include supplementary materials that court‐appointed experts can use both as a codebook to operationalize the SSJ and as a quick reference that will aid consultation with judges. An initial application of the SSJ examined all 93 empirical articles published in Psychology, Public Policy, and Law and Law and Human Behavior in 2015 and resulted in excellent interrater reliability (π = 0.83; π = 0.95; π = 0.97), at the same time it indicated that a majority of the articles fail to include the comprehensive and transparent statistical analysis that would be most useful to courts.     

Efficacy of Pharmacological Interventions in Targeting Decision-Making Impairments across Substance and Behavioral Addictions

Neuropsychology Review - Decision-making impairments reflect tendencies towards risky or unwise choices as manifested by presence of psychiatric symptoms or cognitive impairment (e.g....     

Systematically reviewing remote e-workers’ well-being at work: a multidimensional approach

The practice of remote e-working, which involves work conducted at anyplace, anytime, using technology, is on the increase. The aim of this systematic literature review is to gain a deeper understanding of the association between remote e-working, within knowledge workers, and the five dimensions of well-being at work: affective, cognitive, social, professional, and psychosomatic. Sixty-three studies employing quantitative, qualitative and mixed-method designs have been included in the review. Findings indicate that we know more about remote e-workers’ affective state and their social and professional life than we know about their cognitive functioning and psychosomatic conditions. Whilst the research indicates a positive focus there are some negative aspects of this way of working which are highlighted within this review; such as social and professional isolation, and perceived threats in professional advancement. This review may be of great importance for academics, to continue the theoretical advancement of research into remote e-working, and practitioners, to implement and manage remote e-working attitudes and policies more effectively.     

Men who molest their sexually immature daughters: is a special explanation required?

Child molesters who target their own children have been described as low risk and not pedophilic. Men who had molested a daughter or stepdaughter (n = 82) were compared to 102 molesters whose only female victims were extrafamilial. Men who offended against their own daughters had less deviant sexual age preferences and were less likely to commit new violent and sexual offenses. However, the father-daughter molesters exhibited an average absolute phallometric preference for prepubertal children and had a violent recidivism rate of 22% in a follow-up of less than 5 years. Actuarial risk assessment instruments (the Violence Risk Appraisal Guide and the Sex Offender Risk Appraisal Guide; V. L. Quinsey, G. T. Harris, M. E. Rice, and C. A. Cormier, 1998) worked as well for intrafamilial child molesters as for other sex offenders.     

The effect of fast speech rate on stuttering frequency during delayed auditory feedback

Delayed auditory feedback (DAF) has been documented to improve fluency in those who stutter. The increased fluency has been attributed to the slowed speech rate induced by DAF, but recent experiments have suggested that increasing the speech rate may also decrease stuttering under DAF. This investigation described the effect of combining a fast speech rate and DAF on the fluency of four people who stutter. Fluency of the two mildly dysfluent subjects was the same for both no DAF and DAF conditions at normal and at fast oral reading rates. In contrast, the two severely dysfluent subjects improved in fluency from the no DAF to the DAF conditions. They were found to be dysfluent at both normal and fast oral reading rates without DAF. The results of the study point to the need for further research on the relationship between speech rate and stuttering frequency under conditions of DAF and no DAF. EDUCATIONAL OBJECTIVES: Readers will learn about and be able to describe how the frequency of stuttering is affected by: (1) speech rates; (2) DAF; and (3) how stuttering severity influences such effects.     

Identifying persistently antisocial offenders using the Hare Psychopathy Checklist and DSM antisocial personality disorder criteria

Early starting, lifetime criminal persistence has been called sociopathy, antisocial personality disorder, and psychopathy. There is, however, disagreement about its core features and which measure is best for identifying such individuals. In the 1st of 2 studies of male offenders (n = 74), we found a large association between scores on the Psychopathy Checklist-Revised (PCL-R; R. D. Hare, 1991) and the Diagnostic and Statistical Manual of Mental Disorders (4th ed. [DSM-IV]; American Psychiatric Association, 1994) antisocial personality disorder criteria scored as a scale. The second study (n = 684) replicated this finding and found that, as previously shown for PCL-R scores, a discrete class (or taxon) also underlies scores on items reflecting antisocial personality disorder. The high association among these sets of items and their similarity in predicting violence suggested that the same natural class underlies each. Results indicated that life-course-persistent antisociality can be assessed well by measures of psychopathy and antisocial personality disorder.     

A brief actuarial assessment for the prediction of wife assault recidivism: the Ontario domestic assault risk assessment

An actuarial assessment to predict male-to-female marital violence was constructed from a pool of potential predictors in a sample of 589 offenders identified in police records and followed up for an average of almost 5 years. Archival information in several domains (offender characteristics, domestic violence history, nondomestic criminal history, relationship characteristics, victim characteristics, index offense) and recidivism were subjected to setwise and stepwise logistic regression. The resulting 13-item scale, the Ontario Domestic Assault Risk Assessment (ODARA), showed a large effect size in predicting new assaults against legal or common-law wives or ex-wives (Cohen's d = 1.1, relative operating characteristic area =.77) and was associated with number and severity of new assaults and time until recidivism. Cross-validation and comparisons with other instruments are also reported.     

Acculturation and peritraumatic dissociation in young adult Latino survivors of community violence

This study examined the relationship between acculturation and peritraumatic dissociation in a sample of 304 physically injured Latino survivors of community violence. Item response theory analyses were conducted to document the measurement equivalence of English- and Spanish-language versions of a scale measuring peritraumatic dissociation. After establishing equivalence, structural equation modeling was used to determine the impact of acculturation on peritraumatic dissociation after controlling for other relevant covariates, including assault characteristics, intoxication before the assault, and trauma exposure history. Acculturation emerged as a significant and negative predictor of dissociation, so that high levels of acculturation were associated with low levels of peritraumatic dissociation. These findings offer a counterinstance to the emerging consensus that retention of Latin American cultural traditions serves to promote mental health.     

Coping, Conflictual Social Interactions, Social Support, and Mood Among HIV-Infected Persons

This study considers the interrelationships among coping, conflictual social interactions, and social support, as well as their combined associations with positive and negative mood. Research has shown that each of these variables affects adjustment to stressful circumstances. Few studies, however, examine this full set of variables simultaneously. One hundred forty HIV-infected persons completed a questionnaire containing measures of coping, social support, conflictual social interactions, and positive and negative mood. Factor analyses showed that perceived social support and conflictual social interactions formed separate factors and were not strongly related. Compared to perceived social support, social conflict was more strongly related to coping behaviors, especially to social isolation, anger, and wishful thinking. Conflictual social interactions were more strongly related to negative mood than was perceived social support. Coping by withdrawing socially was significantly related to less positive and greater negative mood. The findings point to the importance of simultaneously considering coping, supportive relationships, and conflictual relationships in studies of adjustment to chronic illness. In particular, a dynamic may occur in which conflictual social interactions and social isolation aggravate each other and result in escalating psychological distress.