The measurement of reading comprehension: How not to trade construct validity for predictive power

This paper proposes a way to measure and understand individual differences in reading comprehension. The measure is based on the theory that individual differences in reading skill reflect differences in the processing capacity of working memory. The measure of processing capacity, called the reading span test, requires subjects to read aloud increasingly longer sets of sentences and to recall the final word of each sentence in the set. Reading span, the number of final words recalled, varies from two to five for university students. According to the proposed theory, poor readers devote so much capacity to processing the sentences, that they have less residual capacity for storing and producing the final words. The ability to keep information accessible in working memory is particularly crucial for the processes that integrate each ne word with previously read information. And, indeed, reading span is highly correlated with integration processes such as computing pronominal reference, monitoring and revising comprehension errors, and making inferences. The theoretical and predictive value of the reading span measure can be contrasted with the relatively limited value of existing atheoretical and theoretical measures of reading comprehension.     

Working memory, text comprehension, and propositional reasoning: a new Semantic Anaphora WM test

The aim of this study was to present a new working memory test following the line of work started by García-Madruga et al. (2007) and to examine its relation to reading comprehension and propositional reasoning measures. In that study we designed a new working memory span test--based on Daneman & Carpenter's (1980) Reading Span Test (RST)--in which the processing task called for an inferential decision--to resolve a pronominal anaphora based on Morpho-Syntactic cues and had people recall the result of this inference. In the current study, besides the RST and the Morpho-Syntactic Anaphora test, we presented a new Semantic Anaphora measure. In order to check the validity of this new Working Memory (WM) task, we used the same reasoning task used in the previous study as well as a new reading comprehension test. The results show the tight relationship amongst working memory, reading comprehension and reasoning, and confirm the validity of the new WM measure.     

信息加工效率与阅读的关系研究

对23名大学生进行知觉广度、记忆广度和阅读理解的多项测验,探求知觉、记忆加工效率与不同语言阅读成绩和阅读眼动特性之间的关系。结果发现：低水平的视觉符号方向信号知觉广度与阅读不存在明显的关系,从眼跳幅度指标上反映出右侧知觉广度大的被试对第二语言加工难度更为敏感。短时记忆和工作记忆能力对阅读的影响主要反映在眼跳幅度方面,与单个注视点获取的信息量有关,但与课文理解水平的关系不明显。短时记忆能力强的被试在眼跳幅度上以及第二语言言语工作记忆弱的被试在注视时间上均出现语言差异效应。     

Updating in working memory: a comparison of good and poor comprehenders

In this research, we examined the relation between reading comprehension and success in a working memory updating task. We tested the hypotheses that poor comprehenders' deficiencies are associated with a specific difficulty in the working memory updating process, particularly in controlling for information that is no longer relevant. In the first experiment, groups of poor and good comprehenders, ages 8-11 years, were administered a working memory updating task. In the second experiment a year later, a subgroup of participants involved in the first experiment was tested with a different updating task. In both experiments, poor comprehenders had less accurate recall performance and made more intrusion errors than did good comprehenders. Moreover, distinguishing intrusion errors on the basis of their permanence in memory, we found that poor comprehenders were more likely to intrude items that were maintained longer in memory than were good comprehenders. This type of error predicted reading comprehension abilities better than did working memory recall. This suggests that the relation between reading comprehension and working memory is mediated by the ability to control for irrelevant information.     

Working memory, intelligence and reading ability in children

The dimensions of working memory in children and the relationships between working memory capacity, reasoning and reading ability were investigated. Simple and complex span tests were administered to 280 grade four, five and six elementary school children. Simple span tests were hypothesized to measure the capacity to temporary store information in working memory. Complex span tests were thought to reflect the simultaneous storage and processing of information. In addition, tests for reasoning, reading comprehension and reading speed were administered. Confirmatory factor analyses showed that the various tests for working memory formed one factor, which was interpreted as temporal storage capacity. The analyses revealed also that working memory and reasoning both were related to reading comprehension, but that these constructs differed in their relations to reading speed.     

Aging,memory load,and resource allocation during reading

To test the notion that aging brings an inability to self-initiate processing, the authors investigated the effects of memory load on online sentence understanding. Younger and older adults read a series of short passages with or without a simultaneous updating task, which would be expected to deplete resources by consuming memory capacity. Regression analyses of word-by-word reading times onto text variables within each condition were used to decompose reading times into resources allocated to the array of word-level and textbase-level processes needed for comprehension. Among neither the young nor the old were word-level processes disrupted by a simultaneous memory load. However, older readers showed relatively greater levels of resource allocation to conceptual integration than the younger adults when under load, regardless of working-memory span or task priority. These results suggest that the ability to self-initiate the allocation of processing resources during reading is preserved among older readers.     

Aging and situation model processing

Over the past several years, a number of studies have been done that assess processing at the level of the situation model in relation to issues of aging (Morrow, Leirer, & Altieri, 1992; Radvansky, Copeland, Berish, & Dijkstra, 2003; Radvansky, Copeland, & Zwaan, 2003; Stine-Morrow, Gagne, Morrow, & DeWall, 2004; Stine-Morrow, Morrow, & Leno, 2002). In contrast to age-related declines that have been demonstrated at surface form and textbase levels of processing, no such declines have been found in the creation and updating of situation models (Radvansky, 1999). This review focuses on the relevant factors in cognitive aging and situation model processing and places them within the larger frameworks of language processing, working memory capacity, and aging.     

Walking through doorways causes forgetting: recall

The aim of the current study was to explore how the location updating effect is affected when people are tested using recall rather than recognition, which is what has been done in prior work. Differences in the memory processes involved with these two tasks lead to predictions for two different patterns of data. In Experiment 1, memory was tested by having participants recall the single object they were carrying or had just put down, whereas in Experiment 2, people sometimes needed to recall both objects. It was found that, unlike recognition test performance, a similar location updating effect was found for both Associated (what was currently being carried) and Dissociated (what was recently set down) objects. Moreover, when both objects were correctly recalled, there was a bias to remember them in the order that they were encountered. Finally, if only one object was correctly recalled, it was the Associated object that was currently being carried. Overall, these results are consistent with the Event Horizon Model of event cognition.     

Cognition and aided speech recognition in noise: Specific role for cognitive factors following nine-week experience with adjusted compression settings in hearing aids

The working memory model for Ease of Language Understanding (ELU) proposes that language understanding under taxing conditions is related to explicit cognitive capacity. We refer to this as the mismatch hypothesis, since phonological representations based on the processing of speech under established conditions may not be accessed so readily when input conditions change and a match becomes problematic. Then, cognitive capacity requirements may differ from those used for processing speech hitherto. In the present study, we tested this hypothesis by investigating the relationship between aided speech recognition in noise and cognitive capacity in experienced hearing aid users when there was either a match or mismatch between processed speech input and established phonological representations. The settings in the existing digital hearing aids of the participants were adjusted to one of two different compression settings which processed the speech signal in qualitatively different ways ("fast" or "slow"). Testing took place after a 9-week period of experience with the new setting. Speech recognition was tested under different noise conditions and with match or mismatch (i.e. alternative compression setting) manipulations of the input signal. Individual cognitive capacity was measured using a reading span test and a letter monitoring test. Reading span, a reliable measure of explicit cognitive capacity, predicted speech recognition performance under mismatch conditions when processed input was incongruent with recently established phonological representations, due to the specific hearing aid setting. Cognitive measures were not main predictors of performance under match conditions. These findings are in line with the ELU model.     

Data-driven and conceptually driven processes in partial-word identification and recognition

Three experiments examined priming in partial-word identification (Warrington & Weiskrantz, 1968) and its relation to recognition memory. The results showed that changes in modality of presentation between study and test reduced performance on both identification and recognition. In contrast, changes in elaborative processing enhanced recognition but had no effect on identification. Furthermore, when explicit memory instructions were given, identification was changed to a cued recall test and was consequently affected by elaborative processing. We also found that the time course of forgetting in priming was different from that in recognition; priming in identification did not change over a 24-hr interval, whereas recognition declined rapidly during this interval. Overall, these results suggest that identification relies primarily on data-driven processing, whereas recognition can rely on both data-driven and conceptually driven processing.     

Walking through doorways causes forgetting: environmental integration

Memory for objects declines when people move from one location to another (the location updating effect). However, it is unclear whether this is attributable to event model updating or to task demands. The focus here was on the degree of integration for probed-for information with the experienced environment. In prior research, the probes were verbal labels of visual objects. Experiment 1 assessed whether this was a consequence of an item-probe mismatch, as with transfer-appropriate processing. Visual probes were used to better coordinate what was seen with the nature of the memory probe. In Experiment 2, people received additional word pairs to remember, which were less well integrated with the environment, to assess whether the probed-for information needed to be well integrated. The results showed location updating effects in both cases. These data are consistent with an event cognition view that mental updating of a dynamic event disrupts memory.     

Visual working memory represents a fixed number of items regardless of complexity

Does visual working memory represent a fixed number of objects, or is capacity reduced as object complexity increases? We measured accuracy in detecting changes between sample and test displays and found that capacity estimates dropped as complexity increased. However, these apparent capacity reductions were strongly correlated with increases in sample-test similarity (r= .97), raising the possibility that change detection was limited by errors in comparing the sample and test, rather than by the number of items that were maintained in working memory. Accordingly, when sample-test similarity was low, capacity estimates for even the most complex objects were equivalent to the estimate for the simplest objects (r= .88), suggesting that visual working memory represents a fixed number of items regardless of complexity. Finally, a correlational analysis suggested a two-factor model of working memory ability, in which the number and resolution of representations in working memory correspond to distinct dimensions of memory ability.     

Can reading ability be measured with tests of memory and processing speed?

The author investigated the possibility of estimating reading ability using tests of memory and processing speed that have significantly reduced reading requirements. Four hundred three air force trainees were given tests of their working memory and long-term memory processes, as well as a standardized reading test. A multiple correlation of .79 indicated that global reading ability is substantially correlated with memory processes. Additional analyses indicated that word knowledge and comprehension, the two major components of reading ability, were both explained by the same set of memory process factors, namely, long-term memory processes, semantic memory retrieval speed, and working memory capacity. These results, which are consistent with the view that memory ability underlies reading ability, support the endeavor of measuring reading ability with memory and processing speed tasks.     

Working memory as a predictor of verbal fluency

This study investigated whether working memory capacity could account for individual differences in verbal fluency. Working memory was assessed by the speaking span test (Daneman & Green, 1986) that taxes the processing and storage functions of working memory during sentence production. Verbal fluency was assessed by (1) a speech generation task in which subjects made a speech about a picture; (2) an oral reading task in which subjects read aloud a prose passage; and (3) a Baars, Motley, and MacKay (1975) task for eliciting oral slips of the tongue (e.g.,wet gun forget one). Speking span was significantly correlated with performance on all three tasks; individuals with small speaking spans were less fluent and more prone to making speech errors. Whereas speaking span was related to individual differences in verbal fluency on the speech and reading tasks, reading span, a measure included to assess working memory capacity during sentence comprehension, was only significantly related to individual differences in verbal fluency on the reading task. The methodology proved useful for revealing whether a particular kind of oral reading error reflected a reading failure or an articulatory failure.This research was supported by a grant from the Natural Sciences and Engineering Research Council of Canada.     

Recall of words heard in noise

The aim of the study was to explore if recall of words and recognition of sentences orally presented was affected by a background noise. A further aim was to investigate the role of working memory capacity in performance in these conditions. Thirty‐two subjects performed a word recall and a sentence recognition test. They repeated each word to ensure that they had heard them. A reading span test measured their working memory capacity. Performance on the word recall task was impaired by the background noise. A high reading span score was associated with a smaller noise effect, especially on recall of the last part of the word list. Copyright © 2007 John Wiley & Sons, Ltd.