Evaluating The Effectiveness of a State-Mandated Benchmark Reading Assessment: mCLASS Reading 3D (Text Reading and Comprehension)

We examined which of two instruments (Text Reading and Comprehension inventory [TRC] or a traditional informal reading inventory [IRI]) provides the more valid assessment of a primary-grade student's reading instructional level. The TRC is currently the required, benchmark reading assessment for students in grades K–3 in the state of North Carolina. The TRC and IRI were administered to 196 students in grades 1–3. Results showed that the TRC, when compared to the IRI, (a) underestimated students’ reading instructional level, and (b) took three times as long to administer. Suggestions for improving the instrument are offered.     

Revisiting the simple view of reading

Background Reading component models such as the Simple View of Reading (SVR; Gough & Tunmer, 1986 ; Hoover & Gough, 1990 ) provide a concise framework for describing the processes and skills involved when readers comprehend texts. According to the Independent Review of the Teaching of Early Reading ( Rose, 2006 ) strong evidence for the SVR comes from Factor Analysis of datasets on different measures of reading showing dissociation between decoding skills and comprehension. To the best of our knowledge, only two such published studies exist to date. Of these, only one of is in English and this explores children between the age of 7 and 10 years. Aims To explore the SVR in English‐speaking children aged 4 and 6 using Factor Analysis. Samples 116 4 ‐year‐olds and 116 6 ‐year‐olds in the US; 103 6 ‐year‐olds in Canada. Methods All children were administered a battery of decoding and comprehension related measures. Results Factor Analysis of the diverse measures undertaken independently by two research teams in different countries demonstrated that listening comprehension and decoding measures loaded as distinct factors in both samples of young English‐speaking children. Conclusions The present findings provide important support for the generality and validity of the SVR framework as a model of reading.     

Can reading accuracy and comprehension be separated in the Neale Analysis of Reading Ability?

Background: The Neale Analysis of Reading Ability (NARA) (Neale, 1997) is widely used in education and research. It provides measures of reading accuracy (decoding) and comprehension, which are frequently interpreted separately. Aims: Three studies were conducted to investigate the degree to which the NARA measures could be separated. Samples: British 7‐ and 8‐year‐olds participated in Study 1 (N=114) and Study 2 (N=212). In Study 3, 16 skilled and less‐skilled comprehenders were identified from the Study 2 sample. Methods: Study 1: By investigating their contribution to silent reading comprehension, the independence of NARA decoding and comprehension scores was determined. Study 2: Decoding groups matched for listening comprehension were compared on the NARA comprehension measure, and population performance was compared across listening comprehension and NARA reading comprehension. Study 3: Comprehension groups were compared on ability to answer open‐ended and forcedchoice questions. Results: Firstly, NARA comprehension performance depended on decoding, to the extent that children with high listening comprehension ability but low decoding ability attained low NARA comprehension scores. Secondly, 32% of children who attained low NARA comprehension scores exhibited high listening comprehension. Thirdly, comprehension groups differed when assessed with open‐ended questions but not when assessed with forced‐choice questions. Conclusions: The NARA can underestimate the comprehension ability of children with weak decoding skills and children who have some difficulty with open‐ended questions. The decoding and comprehension measures of the NARA cannot be separated. These findings have important implications for the interpretation of the measures provided by the NARA, in education and research.     

Adolescent reading skill and engagement with digital and traditional literacies as predictors of reading comprehension

This study investigates the concurrent predictors of adolescent reading comprehension (literal, inferential) for fiction and non‐fiction texts. Predictors were examined from the cognitive (word identification, reading fluency), psychological (gender), and ecological (print exposure) domains. Print exposure to traditional and digital texts was surveyed using a diary method of reading habits. A cross‐sectional sample of 312 students in early (11–13 years) or middle adolescence (14–15 years) participated from a range of SES backgrounds. Word identification emerged as a strong predictor of reading comprehension across adolescence and text genres. Gender effects favouring female students were evident for reading frequency but not for reading skill itself. Reading habits also differed, and comprehension advantages were observed among females for fiction and males for non‐fiction. Age effects emerged for reading frequency, which was lower in middle adolescence. Although more time was spent on digital than on traditional texts, traditional extended text reading was the only reading habit to predict inference‐making in comprehension and to distinguish skilled from less skilled comprehenders. The theoretical and educational implications of these results are discussed.     

HOW ELEMENTARY STUDENTS REFERRED FOR COMPENSATORY READING INSTRUCTION PERFORM ON SCHOOL‐BASED MEASURES OF WORD RECOGNITION,FLUENCY, AND COMPREHENSION

Abstract

The purpose of the present study was to examine how elementary students referred for compensatory remedial reading services performed on several key reading process variables: total word recognition errors while reading brief passages, significant or meaning‐changing errors, comprehension, and reading rate. In order to maximize ecological validity, the students were assessed by the school‐based reading specialist/teacher using assessment materials normally used in diagnostic evaluations of students referred for compensatory reading instruction. Although performance across all variables was below instructional levels for students’ assigned grades, both word recognition variables and comprehension approached instructional levels. Reading rate alone was consistently and significantly below several previously identified standards of performance. We feel that poor performance in rate may be an indicator of fluency problems (including automaticity in word recognition and text phrasing). Suggestions for instruction to overcome difficulties in fluency were presented.     

Prosody instruction intervention as a means to improved reading comprehension

The relationship between prosody and comprehension, previously demonstrated in K–12 students, was examined in university students enrolled in first‐year writing classes. Students completed the Gray Oral Reading Test‐5 both before and after an expressive reading intervention (ER) or no oral reading instruction (NI). Throughout the semester, the ER students marked an excerpt of text for prosodic signals and read it aloud with a partner. Training and practice in expressive reading led to a significant improvement in the normed Oral Reading Index score. Specifically, ER participants demonstrated improved accuracy, fluency, and reading comprehension in comparison with NI participants. The significant relationship between accuracy and comprehension in the ER condition suggests that expressive reading instruction strengthened student ability to read words accurately and, in turn, comprehend the material better than students in the NI condition. Expressive reading practices are recommended to engage students more deeply with the text.     

Rapid Word Recognition as a Measure of Word-Level Automaticity and its Relation to Other Measures of Reading

The present study investigated the relationship between rapid recognition of individual words (Word Recognition Test) and two measures of contextual reading: (1) grade-level Passage Reading Test (IRI passage) and (2) performance on standardized STAR Reading Test. To estabilish if time of presentation on the word recognition test was a factor in predicting contextual reading performance, four computerized presentation times were used: 300 msec, 650 msec, 1000 msec, adn 2000 msec. Regression analyses revealed that, for both third- and fourth-grade students, there was evidence that presentation times of less than 1 second better approximated performance on the two contextual reading measures.     

Rethinking Middle School Reading Instruction: A Basic Literacy Activity

Reading fluency has been identified as a key component in effective literacy instruction (National Reading Panel, 2000). Instruction in reading fluency has been shown to lead to improvements in reading achievement. Reading fluency instruction is most commonly associated with guided repeated oral reading instruction. In the present retrospective study we examine the effects of a computer-based silent reading fluency instructional system called Reading Plus (Taylor Associates, Winooski, Vermount, USA) on the reading comprehension and overall reading achievement of a large corpus of students in an urban school setting. Findings indicate that the program resulted in positive, substantial, and significant improvements in reading comprehension and overall reading achievement on a criterion referenced reading test for Grades 5, 6, 7, 8, and 9 and on a norm-referenced test of reading achievement for Grades 4, 5, 6, 7, 8 and 10. Moreover, mean gains made by students in the Reading Plus intervention were greater than mean gains for all students at the state and district level. The findings were generally positive for all subpopulations studied, including special education and regular education students. Qualitative reports from teachers who participated in the study were also supportive of the program. Implications for the study are explored for particular subgroups of students and for the role of fluency instruction with struggling adolescent readers.     

Examining the validity of self‐reports on scales measuring students' strategic processing

Background. Self‐report inventories trying to measure strategic processing at a global level have been much used in both basic and applied research. However, the validity of global strategy scores is open to question because such inventories assess strategy perceptions outside the context of specific task performance. Aims. The primary aim was to examine the criterion‐related and construct validity of the global strategy data obtained with the Cross‐Curricular Competencies (CCC) scale. Additionally, we wanted to compare the validity of these data with the validity of data obtained with a task‐specific self‐report inventory focusing on the same types of strategies. Sample. The sample included 269 10th‐grade students from 12 different junior high schools. Methods. Global strategy use as assessed with the CCC was compared with task‐specific strategy use reported in three different reading situations. Moreover, relationships between scores on the CCC and scores on measures of text comprehension were examined and compared with relationships between scores on the task‐specific strategy measure and the same comprehension measures. Results. The comparison between the CCC strategy scores and the task‐specific strategy scores suggested only modest criterion‐related validity for the data obtained with the global strategy inventory. The CCC strategy scores were also not related to the text comprehension measures, indicating poor construct validity. In contrast, the task‐specific strategy scores were positively related to the comprehension measures, indicating good construct validity. Conclusion. Attempts to measure strategic processing at a global level seem to have limited validity and utility.     

Assessment matters: Issues in the measurement of reading comprehension

Background. The Neale Analysis of Reading Ability (NARA; Neale, 1997 ) is a widely used assessment of reading comprehension and word reading accuracy. Spooner, Baddeley, and Gathercole (2004) questioned the suitability of the NARA for identifying children with specific reading comprehension deficits. Aims and methods. An evaluation of the NARA measurement of word reading and reading comprehension level was undertaken in relation to models of reading ability. Appropriate control measures were considered. The strengths and weaknesses of different forms of reading comprehension were also evaluated. Results. Previous research into reading comprehension difficulties using the NARA has adopted satisfactory control measures in relation to word reading ability. There are limitations associated with all the considered forms of reading comprehension assessment. Conclusions. If administered and interpreted appropriately, the NARA is an effective instrument for researchers and practitioners who need to assess both word reading accuracy and reading comprehension and to identify children with a dissociation between these two aspects of reading.     

Working memory, text comprehension, and propositional reasoning: a new Semantic Anaphora WM test

The aim of this study was to present a new working memory test following the line of work started by García-Madruga et al. (2007) and to examine its relation to reading comprehension and propositional reasoning measures. In that study we designed a new working memory span test--based on Daneman & Carpenter's (1980) Reading Span Test (RST)--in which the processing task called for an inferential decision--to resolve a pronominal anaphora based on Morpho-Syntactic cues and had people recall the result of this inference. In the current study, besides the RST and the Morpho-Syntactic Anaphora test, we presented a new Semantic Anaphora measure. In order to check the validity of this new Working Memory (WM) task, we used the same reasoning task used in the previous study as well as a new reading comprehension test. The results show the tight relationship amongst working memory, reading comprehension and reasoning, and confirm the validity of the new WM measure.     

Evaluating reading and metacognitive deficits in children and adolescents with attention deficit hyperactivity disorder

The reading achievement of children and adolescents with Attention Deficit Hyperactivity Disorder (ADHD) has scarcely been explored in research conducted in the Spanish language and when it has, the results have been contradictory. The focus of the present research is to analyze participants' reading competency and metacognitive strategies as they carry out reading comprehension tasks. The sample was comprised of 187 Argentine schoolchildren aged 9 to 13 years old. 94 constituted the control group and the clinical group consisted of 93 schoolchildren diagnosed with ADHD. The metacognitive assessment was made up of two metacognitive tests, the Reading Awareness Scale (ESCOLA; acronym in Spanish) and a Spanish adaptation of Metacognitive Awareness of Reading Strategies Inventory (MARSI), and one test of reading comprehension, the Evaluation of Reading Processes for Secondary Education Students (PROLEC-SE; acronym in Spanish). Students with ADHD had lower achievement on tests o reading comprehension compared to the control group. Nevertheless, our results suggest their difficulties did not stem from readin comprehension problems, but rather from alterations in their Executive Functions, because when subjects' reading comprehensio was equalized, students with ADHD still exhibited a lower level of Metacognition, particularly when it came to planning.     

Invariance on a reading comprehension test in European Portuguese: A differential item functioning analysis between students from rural and urban areas

The aim of this study was to determine whether the items from a reading comprehension test in European Portuguese function differently across students from rural and urban areas, which biases the test validity and the equity in assessment. The sample was composed of 653 students from second, third and fourth grades. The presence of differential item functioning (DIF) was analysed using logistic regression and the Mantel–Haenszel procedure. Although 17 items were flagged with DIF, only five items showed non-negligible DIF in all effect-size measures. The evidence of invariance across students with rural or urban backgrounds for most of the items supports the validity of the test though the five identified items should be further investigated.     

Investigating Treatment Fidelity and Social Validity of a Peer-Mediated Postsecondary Reading Intervention

Reading opens many doors and students who do not comprehend well face serious barriers as they enter postsecondary academic institutions. Young people should be able to read and write when they graduate from high school. Such skills allow people to continue their education as well as increase their odds that they can earn an adequate salary. The percentage of 12th graders reading below grade level has remained remarkably stable over the years. A large number of students entering colleges and universities are unable to derive meaning from print at age-expected levels. The purpose of this study was to examine the treatment fidelity and social validity of a systematic and explicitly structured peer-mediated reading comprehension intervention on the reading performance of underprepared postsecondary students. Seven peer mentors and sixteen first-time college students participated in the study. Results indicated the peer-implemented reading program was implemented with high levels of treatment fidelity and social validity while also yielding statistically significant comprehension gains.     

Effects of a Peer-Delivered Corrective Reading Program

The effects of a peer-delivered Corrective Reading program (CRP) (Engelmann, Hanner, & Johnson, 1989) with repeated reading on the reading performance of at-risk high school students were examined. High school peer instructors and students in need of reading remediation were randomly assigned to dyads or triads. Peer instructors presented the CRP, conducted repeated reading trials, and took rate and accuracy measures. Pre to post test data were collected on vocabulary and comprehension subtests of the Gates–MacGinitie Reading Tests, oral reading fluency (words read per minute) and accuracy, number of repeated readings on initial and final lessons, and lessons completed. Results indicated that students' performance on the standardized reading assessment increased as did their oral reading fluency. In general, the number of repeated readings decreased from the initial lesson to the final lesson. Implications for further research are discussed.     

Effects of verbal working memory and cumulative linguistic knowledge on reading comprehension1

Abstract: In the present study, the effects of verbal working memory (VWM) and cumulative linguistic knowledge (CLK) on reading comprehension were investigated using an individual difference approach. We examined whether VWM and CLK are distinct verbal factors and whether each has independent influences on reading comprehension. VWM was tested using the Japanese Reading Span Test (RST). CLK was assessed using information, vocabulary, and similarity subtests of the Wechsler Adult Intelligence Scale‐Revised (WAIS‐R), as well as with the Hyakurakan kanji reading test. The differences between VWM and CLK were examined using correlation analyses between reading comprehension scores, and digit forward and backward span scores. The results showed that VWM and CLK were independent of each other, and that VWM and CLK independently contributed to reading comprehension. The obtained correlations also showed that CLK was independent of any type of short‐term memory, and that the VWM measured using the RST had little correlation with digit span.     

Tape‐assisted reciprocal teaching: Cognitive bootstrapping for poor decoders

Background: Students who have limited skills in decoding and comprehension and who lack motivation to read present difficulties for practitioners. Difficulties may be compounded when these students lack access to age‐appropriate and interesting text and have lost the notion of reading as a process of obtaining meaning from print. Aims: This research examined the effects of a modified reciprocal teaching intervention for readers with poor decoding skills and poor comprehension. Tapeassisted reciprocal teaching was used to help students with poor decoding skills develop cognitive and metacognitive strategies and improve their comprehension of high interest expository texts. Methods: Two single‐subject research design studies involving four groups of students were conducted. Study I involved one experimental group and Study II was a multiple baseline design involving three experimental groups. Sample: Each experimental group comprised a heterogeneous mix of six students, three with poor decoding skills and three with adequate decoding skills, all of whom showed poor comprehension. Results: As a result of the tape‐assisted reciprocal teaching, the poor decoders demonstrated improved application of cognitive and metacognitive strategies and improved comprehension. These improvements were shown on both researcherdeveloped and standardised tests as well as on maintenance and transfer measures. The students with adequate decoding skills also showed improvements in comprehension. Conclusions: The success of the intervention for poor decoders suggests that tape assisted reciprocal teaching may be seen as a form of ‘cognitive bootstrapping’ to enable poor readers to escape the cycle of reading failure and engage more meaningfully in the process of reading.     

Relating Motivation to Read and Emergent Reading Skills: A Measurement Validation Study

Two studies examined the construct validity of emergent readers' motivation measures. Both studies directly assessed reading skills. Motivation was measured via self-report inventories, including existing and new items derived from the Preschool Reading Attitudes Survey (PRAS), the Motivated Reading Questionnaire (MRQ), and the Motivated Reading Profile (MRP). Parent and teacher measures of emergent readers' motivation were also administered. Study 1 findings indicated significant correlations within readers' self ratings and between teachers' and parents' ratings of children's motivation, but little consistency between these ratings and children's self-ratings. Study 2 replicated many Study 1 findings and indicated stability in children's motivation measures.     

PASSAGE INDEPENDENCY AND QUESTION CHARACTERISTICS: AN ANALYSIS OF THREE INFORMAL READING INVENTORIES

ABSTRACT

Three informal reading inventories were examined to identify passage independent test questions, questions which could be answered correctly without reading the corresponding passages. Fourth grade students of good and poor reading ability were administered the test questions orally without access to the passages. The percentage of questions answered correctly was calculated for each test. An analysis of variance procedure revealed that the Classroom Reading Inventory was the most passage independent followed by the Analytical Reading Inventory and Ginn 720 inventory respectively. However the two reader groups did not differ significantly in their performance across the three tests. An analysis of children's responses to the questions revealed that three question categories in particular tended to be passage independent in nature. These categories were: a) general information b) vocabulary meaning and c) affective. The investigation also examined the literal and inferential characteristics of the test questions. Suggestions were made for evaluating the validity of reading comprehension questions     

THE VALIDITY OF THE POTENTIAL LEVEL VIA LISTENING COMPREHENSION: A CAUTIONARY NOTE

Historical background and relevant research were examined to determine whether the commonly recommended procedure of determining the reading potential level via listening comprehension is valid in the primary grades. No support was found for the unstated assumptions necessary for this procedure's validity. And three major studies conclusively revealed that use of this procedure to identify children for remedial instruction would drastically over‐refer and would include vast numbers of primary grade children progressing normally in learning to read. Based on this evidence, it was concluded that listening comprehension definitely not be used to determine the reading potential level in grades 1‐3.