Fact learning: How information accuracy,delay, and repeated testing change retention and retrieval experience

Previous classroom studies have shown that the phenomenology of studied facts changes over time. However, pedagogical needs preclude both the study of errors and the separation of the effects that delay and repeated testing have on retention and retrieval experience. We addressed these issues together in an experiment where participants read stories containing correct and misleading information and provided Remember, Just Know, and Familiar judgements on immediate and delayed general knowledge tests. After 2 days, information learned from the stories shifted from Remembered to Just Known, but repeated testing attenuated this shift. Interestingly, similar patterns of retrieval and phenomenology were observed for correct and misleading information with one important difference—the shift over time to Just Knowing was significantly greater for correct than for misleading information. Together, these findings show the roles of information accuracy, delay, and testing in determining both retention and the subjective experience of retrieval.     

The dark side of testing memory: repeated retrieval can enhance eyewitness suggestibility

Eyewitnesses typically recount their experiences many times before trial. Such repeated retrieval can enhance memory retention of the witnessed event. However, recent studies (e.g., Chan, Thomas, & Bulevich, 2009) have found that initial retrieval can exacerbate eyewitness suggestibility to later misleading information--a finding termed retrieval-enhanced suggestibility (RES). Here we examined the influence of multiple retrieval attempts on eyewitness suggestibility to subsequent misinformation. In four experiments, we systematically varied the number of initial tests taken (between zero and six), the delay between initial testing and misinformation exposure (~30 min or 1 week), and whether initial testing was manipulated between- or within-subjects. University undergraduate students were used as participants. Overall, we found that eyewitness suggestibility increased as the number of initial tests increased, but this RES effect was qualified by the delay and by whether initial testing occurred in a within- or between-subjects manner. Specifically, the within-subjects RES effect was smaller than the between-subjects RES effect, possibly because of the influence of retrieval-induced forgetting/facilitation (Chan, 2009) when initial testing was manipulated within subjects. Moreover, consistent with the testing effect literature (Roediger & Karpicke, 2006), the benefits of repeated testing on later memory were stronger after a 1-week delay than after a 30-min delay, thus reducing the negative impact of RES in long-term situations. These findings suggest that conditions that are likely to occur in criminal investigations can either increase (repeated testing) or reduce (delay) the influence of RES, thus further demonstrating the complex relationship between eyewitness memory and repeated retrieval.     

学习方式的变革:提取促进学习

提取练习效应是指在学习与最终测验之间,等长时间的提取练习与重复学习相比,前者更能促进长时记忆的保持,也称为测试效应。大量研究表明提取测试是一种高效的学习策略,师生却对此认识不足,认为测试只是检测学习效果的评估工具,并不能改变或促进学习。本文主要从提取练习促进学习的认知神经加工机制、提取练习在实践应用中的特点、提高提取练习效应的方法及其在教学实践中的局限四方面梳理了相关研究,为提取练习广泛应用于教学实践提供支持,同时也为师生正确高效利用这一策略提供了参考,使学生获得更高效和持久的学习。     

The origin of the interaction between learning method and delay in the testing effect: The roles of processing and conceptual retrieval organization

Recent research has demonstrated a relationship between retrieval organization and the efficacy of prior repeated retrieval on delayed tests. The present study asked why repeated study engenders higher recall at a short delay despite lower retrieval organization but produces a decline at a long delay, and why repeated retrieval engenders lower recall at a short delay despite higher retrieval organization but produces stable recall over time. This relationship was examined through the inclusion of two successive recall tests—one immediately after learning method and one a week later. Results replicated the interaction in recall between learning method and delay characterizing the testing effect and, critically, revealed the qualitative differences inherent in the retrieval organization of each method. Specifically, stable recall in repeated retrieval was accompanied by strong and sustained conceptual organization, whereas organization for repeated study was tenuous and weakened across tests. These differences quantitatively were assessed through the use of five targeted analyses: specifically, the examination of cumulative recall curves, the accumulation of organization across time (a curve akin to cumulative recall), item gains and losses across time, changes in the size of categories across time, and the fate of specific clusters of recalled items across time. These differences are discussed within the context of differential processes occurring during learning method.     

Expanding retrieval practice promotes short-term retention, but equally spaced retrieval enhances long-term retention

Expanding retrieval practice (T. K. Landauer & R. A. Bjork, 1978) is regarded as a superior technique for promoting long-term retention relative to equally spaced retrieval practice. In Experiments 1 and 2, the authors found that expanding retrieval practice of vocabulary word pairs produced short-term benefits 10 min after learning, conceptually replicating Landauer and Bjork's results. However, equally spaced retrieval produced superior retention 2 days later. This pattern occurred both with and without feedback after test trials. In Experiment 3, the 1st test occurred immediately or after a brief delay, and repeated tests were expanding or equally spaced. Delaying the first test improved long-term retention, regardless of how the repeated tests were spaced. The important factor for promoting long-term retention is delaying initial retrieval to make it more difficult, as is done in equally spaced retrieval but not in expanding retrieval. Expanding the interval between repeated tests had little effect on long-term retention in 3 experiments.     

Visual imagery in autobiographical memory: The role of repeated retrieval in shifting perspective

Recent memories are generally recalled from a first-person perspective whereas older memories are often recalled from a third-person perspective. We investigated how repeated retrieval affects the availability of visual information, and whether it could explain the observed shift in perspective with time. In Experiment 1, participants performed mini-events and nominated memories of recent autobiographical events in response to cue words. Next, they described their memory for each event and rated its phenomenological characteristics. Over the following three weeks, they repeatedly retrieved half of the mini-event and cue-word memories. No instructions were given about how to retrieve the memories. In Experiment 2, participants were asked to adopt either a first- or third-person perspective during retrieval. One month later, participants retrieved all of the memories and again provided phenomenology ratings. When first-person visual details from the event were repeatedly retrieved, this information was retained better and the shift in perspective was slowed.     

Confidence–accuracy resolution in the misinformation paradigm is influenced by the availability of source cues

After witnessing an event, people often report having seen details that were merely suggested to them. Evidence is mixed regarding how well participants can use confidence judgments to discriminate between their correct and misled memory reports. We tested the prediction that the confidence–accuracy relationship for misled details depends upon the availability of source cues at retrieval. In Experiment 1, participants (N = 77) viewed a videotaped staged crime before reading a misleading narrative. After seven minutes or one week, the participants completed a cued recall test for the details of the original event. Prior to completing the test, all participants were warned that the narrative contained misleading details to encourage source monitoring. The results showed that the strength of the confidence–accuracy relationship declined significantly over the delay. We interpret our results in the source monitoring framework. After an extended delay, fewer diagnostic source details were available to participants, increasing reliance on retrieval fluency as a basis for memory and metamemory decisions. We tested this interpretation in a second experiment, in which participants (N = 42) completed a source monitoring test instead of a cued recall test. We observed a large effect of retention interval on source monitoring, and no significant effect on item memory. This research emphasizes the importance of securing eyewitness statements as soon as possible after an event, when witnesses are most able to discriminate between information that was personally seen and information obtained from secondary sources.     

Memory strength affects reporting of misinformation

A model of long-term retention was used to examine whether and how the strength of original information (differences in learning and testing time) and the strength of misleading information (differences in timing and frequency) influence 3- to 5-year-olds' memory for an event. In three experiments, preschoolers viewed a slide presentation depicting an event, some of them were asked misleading questions, and memory for event details was tested. There was little evidence of memory impairment, but exposure to misleading information encouraged reporting of this information. Differences in learning influenced reporting in that children exposed to the event once reported more misled details than those who saw the event multiple times. Furthermore, preschoolers who saw the event once were just as susceptible to misleading information whether exposed to misinformation once or three times; however, preschoolers who had seen the event multiple times were susceptible only to repeated presentations of misinformation. Given that the reporting of misinformation is determined by the degree of integrity of both the original and misleading information, it is important to control for differences in trace strength for both types of information in future research.     

Inferring facts from fiction: reading correct and incorrect information affects memory for related information

People can acquire both true and false knowledge about the world from fictional stories. The present study explored whether the benefits and costs of learning about the world from fictional stories extend beyond memory for directly stated pieces of information. Of interest was whether readers would use correct and incorrect story references to make deductive inferences about related information in the story, and then integrate those inferences into their knowledge bases. Participants read stories containing correct, neutral, and misleading references to facts about the world; each reference could be combined with another reference that occurred in a later sentence to make a deductive inference. Later they answered general knowledge questions that tested for these deductive inferences. The results showed that participants generated and retained the deductive inferences regardless of whether the inferences were consistent or inconsistent with world knowledge, and irrespective of whether the references were placed consecutively in the text or separated by many sentences. Readers learn more than what is directly stated in stories; they use references to the real world to make both correct and incorrect inferences that are integrated into their knowledge bases.     

SKOOL versus ZOOL: Effects of orthographic and phonological long-term memory on nonword immediate serial recall

People can acquire both true and false knowledge about the world from fictional stories. The present study explored whether the benefits and costs of learning about the world from fictional stories extend beyond memory for directly stated pieces of information. Of interest was whether readers would use correct and incorrect story references to make deductive inferences about related information in the story, and then integrate those inferences into their knowledge bases. Participants read stories containing correct, neutral, and misleading references to facts about the world; each reference could be combined with another reference that occurred in a later sentence to make a deductive inference. Later they answered general knowledge questions that tested for these deductive inferences. The results showed that participants generated and retained the deductive inferences regardless of whether the inferences were consistent or inconsistent with world knowledge, and irrespective of whether the references were placed consecutively in the text or separated by many sentences. Readers learn more than what is directly stated in stories; they use references to the real world to make both correct and incorrect inferences that are integrated into their knowledge bases.     

Testing the limits of testing effects using completion tests

Recent work on testing effects has shown that retrieval practice can facilitate memory even for complex prose materials (Roediger & Karpicke, 2006a, 2006b). In three experiments the current study explores the effectiveness of retrieval practice on fill-in-the-blank (FITB) tests requiring the recall of specific words or phrases from a text. Final tests included both repeated items that were directly taken from initial tests, and related items. In Experiment 1, with a 2-day delay between initial and final tests, FITB testing benefited performance only on repeated items. In Experiment 2 a 7-day delay between testing sessions led to more robust effects on repeated items. However, once again no benefits were seen for related items. In Experiment 3 the scope of retrieval was varied by comparing FITB tests to paragraph recall tests requiring retrieval of all sentences following a topic sentence. Only the more open-ended recall practice demonstrated improvements in transfer to novel questions. The results suggest that scope or type of processing required during retrieval practice is likely a critical factor in whether testing will have specific or robust benefits.     

Testing the limits of testing effects using completion tests

Recent work on testing effects has shown that retrieval practice can facilitate memory even for complex prose materials (Roediger & Karpicke, 2006a, 2006b). In three experiments the current study explores the effectiveness of retrieval practice on fill-in-the-blank (FITB) tests requiring the recall of specific words or phrases from a text. Final tests included both repeated items that were directly taken from initial tests, and related items. In Experiment 1, with a 2-day delay between initial and final tests, FITB testing benefited performance only on repeated items. In Experiment 2 a 7-day delay between testing sessions led to more robust effects on repeated items. However, once again no benefits were seen for related items. In Experiment 3 the scope of retrieval was varied by comparing FITB tests to paragraph recall tests requiring retrieval of all sentences following a topic sentence. Only the more open-ended recall practice demonstrated improvements in transfer to novel questions. The results suggest that scope or type of processing required during retrieval practice is likely a critical factor in whether testing will have specific or robust benefits.     

Do testing effects change over time? Insights from immediate and delayed retrieval speed

Retrieving information from memory improves recall accuracy more than continued studying, but this testing effect often only becomes visible over time. In contrast, the present study documents testing effects on recall speed both immediately after practice and after a delay. A total of 40 participants learned the translation of 100 Swahili words and then further restudied the words with translations or retrieved the translations from memory during testing. As in previous experiments, recall accuracy was higher for restudied words than for tested words immediately after practice, but higher for tested words after 7 days. Response times for correct answers, however, showed a different result: Learners were faster to recall tested words than restudied words both immediately after practice and after 7 days. These results are interpreted in light of recent suggestions that testing selectively strengthens cue–response associations. An additional outcome was that testing effects on recall accuracy were related to perceived retrieval success during practice. When several practice retrievals were successful, testing effects on recall accuracy were already significant immediately after practice. Together with the reaction time data, this supports recent models that attribute changes in testing effects over time to limited item retrievability during practice.     

Remembering the forgotten? Reminiscence, hypermnesia and memory for order

Three experiments established that repeated testing affects item and order retention differently: Hypermnesia was found with repeated free recall tests, whereas net performance declined significantly across successive free reconstruction of order tests. Overall order performance declined over tests under a variety of encoding conditions (pictures, words, and relational and item-specific processing) and retrieval conditions (intentional and incidental learning). Although net performance dropped across tests, participants did show reliable order recovery (reminiscence) between tests. The implications of these data for general theories of hypermnesia and order are discussed.     

All of the above: When multiple correct response options enhance the testing effect

Previous research has shown that multiple choice tests often improve memory retention. However, the presence of incorrect lures often attenuates this memory benefit. The current research examined the effects of “all of the above” (AOTA) options. When such options are correct, no incorrect lures are present. In the first three experiments, a correct AOTA option on an initial test led to a larger memory benefit than no test and standard multiple choice test conditions. The benefits of a correct AOTA option occurred even without feedback on the initial test; for both 5-minute and 48-hour retention delays; and for both cued recall and multiple choice final test formats. In the final experiment, an AOTA question led to better memory retention than did a control condition that had identical timing and exposure to response options. However, the benefits relative to this control condition were similar regardless of the type of multiple choice test (AOTA or not). Results suggest that retrieval contributes to multiple choice testing effects. However, the extra testing effect from a correct AOTA option, rather than being due to more retrieval, might be due simply to more exposure to correct information.     

Strengthening concept learning by repeated testing

The aim of this study was to examine whether repeated testing with feedback benefits learning compared to rereading of introductory psychology key‐concepts in an educational context. The testing effect was examined immediately after practice, after 18 days, and at a five‐week delay in a sample of undergraduate students (n = 83). The results revealed that repeated testing with feedback significantly enhanced learning compared to rereading at all delays, demonstrating that repeated retrieval enhances retention compared to repeated encoding in the short‐ and the long‐term. In addition, the effect of repeated testing was beneficial for students irrespectively of working memory capacity. It is argued that teaching methods involving repeated retrieval are important to consider by the educational system.     

Time and again: effects of repetition and retention interval on 2 year olds' event recall

How and what very young children remember is a central question for understanding the course of memory development. In this research, we examined the effects of two factors on 2-year-old children's ability to recall novel events: repetition of the experience and time since experience. Twenty 24-month-old and twenty 28-month-old children participated in unusual laboratory play events. Half of the children returned after a 2-week delay and again after a 3-month delay (repeated experience condition); the remaining children returned only after 3 months (single experience condition). Memory was assessed by asking children to reenact the events. Recall was generally accurate, and there were no significant effects of age. All children recalled more information about the activities associated with the event than about the objects. Surprisingly, children in the repeated experience condition recalled as much about the events at the 3-month retention interval as at the 2-week retention interval. Further, children in this condition recalled more information at the 3-month retention interval than children in the single experience condition, suggesting that reexperiencing an event may guard against long-term forgetting.     

Scaffolding feedback to maximize long-term error correction

Scaffolded feedback was tested against three other feedback presentation methods (standard corrective feedback, minimal feedback, and answer-until-correct multiple-choice feedback) over both short- and long-term retention intervals in order to assess which method would produce the most robust gains in error correction. Scaffolded feedback was a method designed to take advantage of the benefits of retrieval practice by providing incremental hints until the correct answer could be self-generated. In Experiments 1 and 3, on an immediate test, final memory for the correct answer was lowest for questions given minimal feedback, moderate for the answer-until-correct condition, and equally high in the scaffolded feedback condition and the standard feedback condition. However, tests of the maintenance of the corrections over a 30-min delay (Experiment 2) and over a 1-day delay (Experiment 3) demonstrated that scaffolded feedback gave rise to the best memory for the correct answers at a delay.     

The influence of learning methods on collaboration: prior repeated retrieval enhances retrieval organization, abolishes collaborative inhibition, and promotes post-collaborative memory

Research on collaborative memory has unveiled the counterintuitive yet robust phenomenon that collaboration impairs group recall. A candidate explanation for this collaborative inhibition effect is the disruption of people's idiosyncratic retrieval strategies during collaboration, and it is hypothesized that employing methods that improve one's organization protects against retrieval disruption. Here it is investigated how one's learning method during the study phase--defined as either repeatedly studying or repeatedly retrieving information--influences retrieval organization and what effects this has on collaborative recall and post-collaborative individual recall. Results show that repeated retrieval consistently eliminated collaborative inhibition. This enabled participants to gain the most from re-exposure to materials recalled by their partners that they themselves did not recall and led to improvements in their individual memory following collaboration. This repeated retrieval advantage stemmed from the preferential manner in which this learning method strengthened retrieval organization. Findings are also discussed that reveal a relationship between retrieval organization and the interaction observed between learning method and short versus long delay seen in the testing effect literature. Finally, results show that the elusive benefits of cross-cuing during collaboration may be best detected with a longer study-test delay. Together, these findings illuminate when and how collaboration can enhance memory.     

Context change and retention interval can have additive, rather than interactive, effects after taste aversion extinction

Spontaneous forgetting is often attributed to retrieval failure caused by natural changes in the background context that occur over time. However, some investigators have argued that the context-change account of forgetting is paradoxical, because context-change effects themselves decrease over time. To resolve the paradox, we have suggested that organisms may merely forget the physical context as the temporal context in which it is embedded changes; this explanation accepts a fundamental similarity between time and physical context. The present experiment tested an implication of this analysis by examining the interaction between retention interval and context change in rats after a taste aversion was conditioned and then extinguished. Importantly, subjects tested at the longer (24-day) retention interval received reminder exposure to the physical contexts before testing. Under these conditions, retention interval and context change both caused relapse of the extinguished aversion (spontaneous recovery and renewal, respectively), and the strongest overall relapse was observed when the two treatments were combined. Such additivity (rather than interactivity) is consistent with a context-change account of forgetting and sets the stage for resolution of the context-forgetting paradox.