Examiner error in curriculum-based measurement of oral reading

Although curriculum based measures of oral reading (CBM-R) have strong technical adequacy, there is still a reason to believe that student performance may be influenced by factors of the testing situation, such as errors examiners make in administering and scoring the test. This study examined the construct-irrelevant variance introduced by examiners using a cross-classified multilevel model. We sought to determine the extent of variance in student CBM-R scores attributable to examiners and, if present, the extent to which it was moderated by students' grade level and English learner (EL) status. Fit indices indicated that a cross-classified random effects model (CCREM) best fits the data with measures nested within students, students nested within schools, and examiners crossing schools. Intraclass correlations of the CCREM revealed that roughly 16% of the variance in student CBM-R scores was associated between examiners. The remaining variance was associated with the measurement level, 3.59%; between students, 75.23%; and between schools, 5.21%. Results were moderated by grade level but not by EL status. The discussion addresses the implications of this error for low-stakes and high-stakes decisions about students, teacher evaluation systems, and hypothesis testing in reading intervention research.     

International Adaptations of the Millon Clinical Multiaxial Inventory: Construct Validity and Clinical Applications

This article examines the influence of the Millon Clinical Multiaxial Inventory (MCMI) as a clinical and research instrument beyond the borders of the United States. The MCMI's theoretical and empirical grounding, its alignment with the Diagnostic and Statistical Manual of Mental Disorders (DSM), and scales that can be interpreted both categorically and dimensionally, are the primary features that make the test attractive. We begin with studies that evaluated the construct equivalence of the different language adaptations. Data from the most widely researched non English-language forms (Danish, Dutch, and Spanish) show excellent comparability with Millon's original. Nevertheless, significant problems were noted in efforts to create clinical groups that would allow for equivalence of diagnostic accuracy when using the cutoff scores. Although dimensional aspects of the scale scores were not affected by this, the adapted measures might show attenuated diagnostic accuracy compared with Millon's original. Next, we present MCMI studies conducted in clinical settings to document where the adapted tests have made their greatest impact in the international literature. A wide variety of clinical applications demonstrated broad utility, and given the high number of issues addressed, we think Millon's influence will certainly stand the test of time in different domains and settings.     

Ambivalence About Interpersonal Problems and Traits Predicts Cross‐Situational Variability of Social Behavior

Multiple theoretical perspectives suggest that maladjusted personality is characterized by not only distress, but also opposing or “ambivalent” self‐perceptions and behavioral lability across social interactions. However, the degree to which ambivalence about oneself predicts cross‐situational variability in social behavior has not been examined empirically. Using the interpersonal circumplex (IPC) as a nomological framework, the present study investigated the extent to which endorsing opposing or “ambivalent” tendencies on IPC measures predicted variability in social behavior across a range of hypothetical interpersonal scenarios (Part 1; N = 288) and naturalistic social interactions (Part 2; N = 192). Ambivalent responding for interpersonal problems and traits was associated with measures of distress, maladaptive interpersonal tendencies, and greater variability of social behavior across both hypothetical and daily social interactions, though more consistently for interpersonal problems. More conservative tests suggested that ambivalence predicted some indexes of behavioral variability even when accounting for mean levels and squared means of social behaviors, vector length, gender, and depressive symptoms. Results suggest that processes theorized as typifying personality disorder may apply more broadly to personality maladjustment occurring outside of clinical samples.     

Amygdala or hippocampus inactivation after retrieval induces temporary memory deficit

The hypothesis that memory is stored through a single stage of consolidation that results in a stable and lasting long-term memory has been challenged by the proposition that reactivation of a memory induces reconsolidation of the memory. The reconsolidation hypothesis is supported by evidence that, under some conditions, post-retrieval treatments affecting amygdala and hippocampus functioning impair subsequent retention performance. We now report that repeated retention testing attenuates the performance impairment induced by post-retrieval reversible inactivation of the amygdala and hippocampus of rats induced by tetrodotoxin. These findings challenge the reconsolidation hypothesis and suggest that the post-retrieval retention performance impairment is best explained as due to temporary retrieval failure.     

Applying Multiple Knowledge Structures in Creative Thought: Effects on Idea Generation and Problem-Solving

Prior studies have indicated that multiple knowledge structures, schema, associations, and cases, are involved in creative thought. Few studies, however, have examined how these different knowledge structures operate together in idea generation and creative problem-solving. Accordingly, in the present study 247 undergraduates were asked to generate ideas relevant to a social innovation problem and then provide a potential solution to the problem. A training manipulation was used to encourage application of schematic, associational, or case-based knowledge either alone or in combination. It was found that prompting use of a single knowledge structure, specifically schema or associational knowledge, resulted in the production of more high quality ideas. However, prompting use of multiple knowledge structures, specifically combining either schema or associations with cases, resulted in the production of higher quality and more original problem-solutions. The implications of these findings for understanding the role of different knowledge structures in creative thought are discussed.     

In search of average growth: Describing within-year oral reading fluency growth across Grades 1–8

Measures of oral reading fluency (ORF) are perhaps the most often used assessment to monitor student progress as part of a response to intervention (RTI) model. Rates of growth in research and aim lines in practice are used to characterize student growth; in either case, growth is generally defined as linear, increasing at a constant rate. Recent research suggests ORF growth follows a nonlinear trajectory, but limitations related to the datasets used in such studies, composed of only three testing occasions, curtails their ability to examine the true functional form of ORF growth. The purpose of this study was to model within-year ORF growth using up to eight testing occasions for 1448 students in Grades 1 to 8 to assess (a) the average growth trajectory for within-year ORF growth, (b) whether students vary significantly in within-year ORF growth, and (c) the extent to which findings are consistent across grades. Results demonstrated that for Grades 1 to 7, a quadratic growth model fit better than either linear or cubic growth models, and for Grade 8, there was no substantial, stable growth. Findings suggest that the expectation for linear growth currently used in practice may be unrealistic.     

The Relationship Between Childhood Trauma,Combat Exposure,and Posttraumatic Stress Disorder in Male Veterans

The current study investigated the effects of combat exposure, childhood trauma, and depression on posttraumatic stress disorder (PTSD) severity. Participants were 299 male veterans from the Korean War, World War II, Vietnam, and the first Gulf War who were being screened for admission to the PTSD unit. Participants were assessed with the Clinician-Administered PTSD Scale (CAPS), Combat Exposure Scale (CES), Hamilton Depression Rating Scale (HAMD), Childhood Trauma Questionnaire (CTQ), and Mississippi Scale for PTSD (MPTSD). Results of multiple regression analyses indicated that, as expected, combat exposure and depression were significant predictors of PTSD severity. When examined with combat exposure, childhood trauma has a complex relationship to PTSD severity. Examination of the interaction between the CES and CTQ suggests that when levels of combat are low and childhood trauma levels are high, the CTQ is related to higher levels of PTSD severity on the CAPS, regardless of depression. Treatment implications are discussed.     

The role of verbal and nonverbal memory in the Family Pictures Subtest: Data from children with specific language impairment

This study examined the contribution of verbal and visual memory to performance on the Family Pictures subtest of the Children’s Memory Scale. This subtest purports to assess declarative memory functioning in the visual/nonverbal domain. A total of 115 nine-year-old children participated in this study. Fifty-eight had specific language impairment (SLI), whilst the remaining 57 were typically developing (TD), with no history of language difficulties. Results showed that the children with SLI, who had intact declarative memory for visual but not verbal information, obtained significantly lower scores on the Family Pictures subtest when compared to the TD group. Regression analyses revealed that across the entire sample, individual differences on the Family Pictures subtest was best predicted by a measure of verbal working memory. These results question whether the Family Pictures subtest can be considered a measure of visual memory in pediatric populations. These results have implications for the interpretation of scores on this subtest regarding the nature of the types of neurocognitive difficulties children may exhibit.