Generalizing test-enhanced learning from the laboratory to the classroom

Test-enhanced learning refers to the fact that taking an initial test on studied material enhances its later retention relative to simply studying the material and then taking a final test. Most research on the testing effect has been done with materials such as word lists, and the general finding has been that the benefits of testing are greater when the initial test is a recall (production) test rather than a recognition test. We briefly summarize three experiments that extend these results to educationally relevant materials, namely brief articles, lectures, and materials in a college course. All three experiments demonstrated a robust testing effect and also revealed that an initial short-answer test produced greater gains on a final test than did an initial multiple-choice test. Furthermore, one experiment revealed a positive effect of immediate feedback given with the initial test. The educational implications are that production tests (short answer or essay) and feedback soon after learning increase learning and retention. In addition, frequent testing probably has the indirect positive effects of keeping students motivated and leading them to space out periods of study.     

Paradoxical effects of testing: Repeated retrieval attempts enhance the likelihood of later accurate and false recall

The testing effect is the finding that taking an initial test enhances the likelihood of later recall. The present report examines the extent to which this benefit of testing comes with a cost: an enhanced likelihood of erroneously recalling incorrect information. Subjects were given short lists of semantic associates (e.g., hill, valley, climb); each list converged upon a related nonpresented word (e.g., mountain). After presentation of some lists, the subjects received no initial test; after others, one initial free recall test; and after others, three successive free recall tests. The probabilities of final free recall (and the probability of reporting vivid recollection of the moment of encoding) of both studied and related, nonstudied words (e.g., mountain) were highest when three initial tests had been taken, intermediate following one initial test, and lowest when no initial test had occurred. The beneficial effects of testing carry the cost of increases in erroneous memory for related information.     

The testing effect in free recall is associated with enhanced organizational processes

In two experiments with categorized lists, we asked whether the testing effect in free recall is related to enhancements in organizational processing. During a first phase in Experiment 1, subjects studied one list over eight consecutive trials, they studied another list six times while taking two interspersed recall tests, and they learned a third list in four alternating study and test trials. On a test 2 days later, recall was directly related to the number of tests and inversely related to the number of study trials. In addition, increased testing enhanced both the number of categories accessed and the number of items recalled from within those categories. One measure of organization also increased with the number of tests. In a second experiment, different groups of subjects studied a list either once or twice before a final criterial test, or they studied the list once and took an initial recall test before the final test. Prior testing again enhanced recall, relative to studying on the final test a day later, and also improved category clustering. The results suggest that the benefit of testing in free recall learning arises because testing creates retrieval schemas that guide recall.     

Retrieval-induced facilitation: initially nontested material can benefit from prior testing of related material

Classroom exams can assess students' knowledge of only a subset of the material taught in a course. What are the implications of this approach for long-term retention? Three experiments (N = 210) examined how taking an initial test affects later memory for prose materials not initially tested. Experiment 1 shows that testing enhanced recall 24 hr later for the initially nontested material. This facilitation was not seen for participants given additional study opportunities without initial testing. Experiment 2 extends this facilitative effect to a within-subjects design. Experiment 3 demonstrates that this facilitation can be modulated by conscious strategies. These results have implications for educational practice and the theoretical developments of the testing effect, associative memory, and retrieval inhibition.     

When does testing enhance retention? A distribution-based interpretation of retrieval as a memory modifier

Tests, as learning events, can enhance subsequent recall more than do additional study opportunities, even without feedback. Such advantages of testing tend to appear, however, only at long retention intervals and/or when criterion tests stress recall, rather than recognition, processes. We propose that the interaction of the benefits of testing versus restudying with final-test delay and format reflects not only that successful retrievals are more powerful learning events than are re-presentations but also that the distribution of memory strengths across items is shifted differentially by testing and restudying. The benefits of initial testing over restudying, in this view, should increase as the delay or format of the final test makes that test more difficult. Final-test difficulty, not the similarity of initial-test and final-test conditions, should determine the benefits of testing. In Experiments 1 and 2 we indeed found that initial cued-recall testing enhanced subsequent recall more than did restudying when the final test was a difficult (free-recall) test but not when it was an easier (cued-recall) test that matched the initial test. The results of Experiment 3 supported a new prediction of the distribution framework: namely, that the final cued-recall test that did not show a benefit of testing in Experiment 1 should show such a benefit when that test was made more difficult by introducing retroactive interference. Overall, our results suggest that the differential consequences of initial testing versus restudying reflect, in part, differences in how items distributions are shifted by testing and studying.     

汉字的无线索回忆再认效应:重复学习和重复测验的作用

采用无线索回忆再认范式,对基于熟悉性的汉字语义特征再认进行了探索,考察了重复学习和重复测验对汉字语义特征的无线索回忆再认效应(RWCR效应)的影响。实验1采用即时测验,实验2采用延时测验,结果发现:(1)无论即时还是延时测验,汉字语义特征的再认均存在RWCR效应。(2)在即时测验时,重复学习对熟悉性有显著影响,重复测验对熟悉性没有影响;重复学习和重复测验均提高回想成绩,但二者无差异。(3)在延时测验时,重复学习组和重复测验组的熟悉性评分均下降,但前者下降快于后者;重复测验组回想的遗忘率较低,重复学习组回想的遗忘率较高。上述结果说明,汉字的语义特征存在稳定的RWCR效应,且重复学习主要影响熟悉性,重复测验主要影响回想。进一步证明了再认记忆的双加工理论。     

When additional multiple‐choice lures aid versus hinder later memory

Three experiments were conducted to investigate whether increasing the number of lures on a multiple‐choice test helps, hinders or has no effect on later memory. All three patterns have been reported in the literature. In Experiment 1, the stimuli were unrelated word lists, and increasing the number of lures on an initial multiple‐choice test led to better performance on later free recall and cued recall tasks. In contrast, in Experiments 2 and 3, stimuli were facts from prose materials, and increasing the number of multiple‐choice lures led to robust costs in cued recall and smaller costs in free recall. The results indicate that performance on the initial multiple‐choice test is a critical factor. When initial multiple‐choice performance was near ceiling, testing with additional lures led to superior performance on subsequent tests. However, at lower levels of multiple‐choice performance, testing with additional lures produced costs on later tests. Copyright © 2006 John Wiley & Sons, Ltd.     

The information that amnesic patients do not forget

The performance of three kinds of amnesic patients and control subjects was assessed using four methods for testing memory: free recall, recognition, cued recall, and word completion. Whereas amnesic patients were impaired on free recall, recognition, and cued recall, they were normal on word completion. Moreover, performance on the word-completion test declined at a normal rate reaching chance after about 120 min. The word-completion test resembled the cued-recall test in that the initial letters of previously presented words were given as cues. It differed from cued recall only in the instructions, which directed subjects away from the memory aspects of the test and asked them to complete each three-letter cue with the first word that came to mind. The present results offer an explanation of conflicting findings that have been obtained with amnesic patients on tests of the cued-recall type. The results are considered in terms of a process (activation or procedural learning), which is spared in amnesia and not dependent on the integrity of the damaged brain regions.     

The effects of initial testing on false recall and false recognition in the social contagion of memory paradigm

In three experiments, participants studied photographs of common household scenes. Following study, participants completed a category-cued recall test without feedback (Exps. 1 and 3), a category-cued recall test with feedback (Exp. 2), or a filler task (no-test condition). Participants then viewed recall tests from fictitious previous participants that contained erroneous items presented either one or four times, and then completed final recall and source recognition tests. The participants in all conditions reported incorrect items during final testing (a social contagion effect), and across experiments, initial testing had no impact on false recall of erroneous items. However, on the final source-monitoring recognition test, initial testing had a protective effect against false source recognition: Participants who were initially tested with and without feedback on category-cued initial tests attributed fewer incorrect items to the original event on the final source-monitoring recognition test than did participants who were not initially tested. These data demonstrate that initial testing may protect individuals’ memories from erroneous suggestions.     

The role of retrieval mode and retrieval orientation in retrieval practice: insights from comparing recognition memory testing formats and restudying

The effectiveness of retrieval practice for aiding long-term memory, referred to as the testing effect, has been widely demonstrated. However, the specific neurocognitive mechanisms underlying this phenomenon remain unclear. In the present study, we sought to explore the role of pre-retrieval processes at initial testing on later recognition performance by using event-related potentials (ERPs). Subjects studied two lists of words (Chinese characters) and then performed a recognition task or a source memory task, or restudied the word lists. At the end of the experiment, subjects received a final recognition test based on the remember–know paradigm. Behaviorally, initial testing (active retrieval) enhanced memory retention relative to restudying (passive retrieval). The retrieval mode at initial testing was indexed by more positive-going ERPs for unstudied items in the active-retrieval tasks than in passive retrieval from 300 to 900 ms. Follow-up analyses showed that the magnitude of the early ERP retrieval mode effect (300–500 ms) was predictive of the behavioral testing effect later on. In addition, the ERPs for correctly rejected new items during initial testing differed between the two active-retrieval tasks from 500 to 900 ms, and this ERP retrieval orientation effect predicted differential behavioral testing gains between the two active-retrieval conditions. Our findings confirm that initial testing promotes later retrieval relative to restudying, and they further suggest that adopting pre-retrieval processing in the forms of retrieval mode and retrieval orientation might contribute to these memory enhancements.     

Understanding and Removing the Effects of Performance Cues on Behavioral Ratings

Previous research has demonstrated that performance information (e.g., prior supervisor ratings) can bias behavioral ratings. However, research has not fully explored the effects of performance cues on raters' memory. In addition, no studies have attempted to eliminate this performance cue effect. This study addressed these deficiencies by collecting both free recall and recognition memory measures while testing an unstructured free recall intervention. Results indicate that performance cues do affect the recall of performance relevant behaviors from memory. Contrary to expectations, free recall did not prove to be an effective intervention. Implications of these findings for future attempts to remove the performance cue effect are discussed.     

Expectation of a final cumulative test enhances long-term retention

In the present study, subjects studied lists of words across four experimental conditions: whether (or not) subjects received initial testing for these lists and whether (or not) they were made aware of an upcoming final free-recall test. Initial testing enhanced final-test performance; however, subjects benefited more from initial testing when they also knew they would need to remember the information for a later test. The data suggest that holding an expectation of the final test encouraged the continued processing of study materials following an initial test, affecting the accessibility of these materials at the time of final recall. The results clearly illustrate how an expectation of a cumulative test might influence long-term retention, which may have important implications for educational practice.     

Individual differences in forced-choice recognition memory: Partitioning contributions of recollection and familiarity

In forced-choice recognition memory, two different testing formats are possible under conditions of high target–foil similarity: Each target can be presented alongside foils similar to itself (forced-choice corresponding; FCC), or alongside foils similar to other targets (forced-choice noncorresponding; FCNC). Recent behavioural and neuropsychological studies suggest that FCC performance can be supported by familiarity whereas FCNC performance is supported primarily by recollection. In this paper, we corroborate this finding from an individual differences perspective. A group of older adults were given a test of FCC and FCNC recognition for object pictures, as well as standardized tests of recall, recognition, and IQ. Recall measures were found to predict FCNC, but not FCC performance, consistent with a critical role for recollection in FCNC only. After the common influence of recall was removed, standardized tests of recognition predicted FCC, but not FCNC performance. This is consistent with a contribution of only familiarity in FCC. Simulations show that a two-process model, where familiarity and recollection make separate contributions to recognition, is 10 times more likely to give these results than a single-process model. This evidence highlights the importance of recognition memory test design when examining the involvement of recollection and familiarity.     

Reducing the Misinformation Effect Through Initial Testing: Take Two Tests and Recall Me in the Morning?

Initial retrieval of an event can reduce people's susceptibility to misinformation. We explored whether protective effects of initial testing could be obtained on final free recall and source‐monitoring tests. After studying six household scenes (e.g., a bathroom), participants attempted to recall items from the scenes zero, one, or two times. Immediately or after a 48‐hour delay, non‐presented items (e.g., soap and toothbrush) were exposed zero, one, or four times through a social contagion manipulation in which participants reviewed sets of recall tests ostensibly provided by other participants. A protective effect of testing emerged on a final free recall test following the delay and on a final source‐memory test regardless of delay. Taking two initial tests did not increase these protective effects. Determining whether initial testing will have protective (versus harmful) effects on memory has important practical implications for interviewing eyewitnesses. © 2015 The Authors. Applied Cognitive Psychology published by John Wiley & Sons, Ltd.     

Diminished testing benefits in young adults with attention-deficit hyperactivity disorder

Memory retrieval has been shown to enhance the long-term retention of tested material; however, recent research suggests that limiting attention during retrieval can decrease the benefits of testing memory. The present study examined whether testing benefits are reduced in young adults with attention-deficit hyperactivity disorder (ADHD). College students with and without ADHD read three short prose passages, each followed by a free recall test, a restudy period or a distractor task. Two days later participants recalled the passages. Although participants without ADHD did not show a significant benefit of testing over restudying, testing did produce recall benefits relative to not taking a test. These testing benefits were diminished in participants with ADHD, who did not show any advantage of testing over either restudying or no test. The absence of testing benefits in the ADHD group is likely due in part to decreased recall on the initial test. These findings have implications for improving educational practices among individuals with ADHD and also speak to the need to examine individual differences in the effectiveness of testing as a learning strategy.     

Hypnosis and interrogative suggestibility

An attempt was made to induce memory errors through the use of misleading questioning in hypnosis. Subjects heard a short newslike story and gave initial free recall for the story details, then 4 days later were given three free recall trials: prior to hypnosis, following hypnotic induction and suggestion for enhanced memory, and after hypnosis was terminated. During hypnosis subjects were also twice interrogated with either misleading or objective questions for the story details. Accurate memory increased over the three free recall trials for all subjects regardless of hypnotizability. In recognition testing, subjects given misleading questions during the interrogation gave fewer correct responses, had more errors-in-fact as well as forgetting, and showed an increase in yielding to interrogative suggestibility over trials than subjects given objective questions. All subjects subsequently confabulated more information on the final awake free recall trial as a result of errors introduced during hypnotic interrogation process. These results help to clarify the inherent dangers in relying on hypnosis to enhance memory.     

Transfer-appropriate processing in the testing effect

The testing effect is the finding that taking a review test enhances performance on a final test relative to restudying the material. The present experiment investigated transfer-appropriate processing in the testing effect using semantic and orthographic cues to evoke conceptual and data-driven processing, respectively. After a study phase, subjects either restudied the material or took a cued-recall test consisting of half semantic and half orthographic cues in which the correct response was given as feedback. A final, cued-recall test consisted of the identical cue, or a new cue that was of the same type or different type of cue (semantic/orthographic or orthographic/semantic) as that used for that target in the review test. Testing enhanced memory in all conditions. When the review cues and final-test cues were identical, final recall was higher for semantic than orthographic cues. Consistent with test-based transfer-appropriate processing, memory performance improved as the review and final cues became more similar. These results suggest that the testing effect could potentially be caused by the episodic retrieval processes in a final memory test overlapping more with the episodic retrieval processes in a review test than with the encoding operations performed during restudy.     

“P300” and memory: Individual differences in the von Restorff effect

Event-related brain potentials (ERPs) were elicited by words in a free recall paradigm that included a novel item. The P300 component of the ERP is elicited by novel, task-relevant events, and we tested the hypothesis that P300 is a manifestation of the cognitive processing invoked during “context updating.” If the degree to which current representations in working memory need revision is related to P300 amplitude, then the P300 elicited by a given item should be related to the ability to recall that item on a subsequent test. Forty lists were presented to 12 subjects in each of two sessions. The lists were 15 words long, and 1 word, in position 6 through 10, was “isolated” by changing its size. Most subjects recalled these isolated words more often than other words in the same positions (von Restorff effect), and these words also elicited larger P300s than other words. Analysis of variance on the component scores from a principal components analysis revealed that words recalled had a larger amplitude P300 (on initial presentation) than words not recalled. Striking individual differences emerged, and there were strong relationships between the von Restorff effect, overall recall performance, mnemonic strategies, and the association between components of the ERP and recall performance. The overall recall performance of subjects who reported simple (rote) mnemonic strategies was low, but they showed a high von Restorff effect. For these subjects the amplitude of the P300 elicited by words during initial presentation predicted later recall. In contrast, subjects who reported complex mnemonic strategies remembered a high percentage of words and did not show a von Restorff effect. For these subjects P300 did not predict later recall, although a later “slow wave” component of the ERP did. The initial response to isolated items was the same for all subjects (a large P300), and all subjects recognized the isolates faster than other words in a recognition test given at the end of each session. The subjects in whom P300 did not predict recall reported mnemonic strategies that involved organizing the material. These strategies continue long after the time period reflected by P300 (600 msec). Because they were so effective they may have overshadowed the relationship between P300 and recall, which is based on the initial encoding of an event. Our interpretations were further confirmed and clarified from data obtained in a final grand recall and in the recognition test.     

Selective attention meets spontaneous recognition memory: Evidence for effects at retrieval

Previous research on the effects of Divided Attention on recognition memory have shown consistent impairments during encoding but more variable effects at retrieval. The present study explored whether effects of Selective Attention at retrieval and subsequent testing were parallel to those of Divided Attention. Participants studied a list of pictures and then had a recognition memory test that included both full attention and selective attention (the to be responded to object was overlaid atop a blue outlined object) trials. All participants then completed a second recognition memory test. The results of 2 experiments suggest that subsequent tests consistently show impacts of the status of the ignored stimulus, and that having an initial test changes performance on a later test. The results are discussed in relation to effect of attention on memory more generally as well as spontaneous recognition memory research.     

Schema anticipation in recall: memory process or report strategy?

Summary This article reports an experimental investigation testing the hypothesis that recall reports are systematically biased by the recaller's knowledge about who is to receive the recall report, while that bias is absent from a recognition test. Subjects listened to one of two versions of a story recounting John's visit to the doctor. After the story was read, subjects were asked to recall the story either with standard-recall instructions or with instructions to recall for peers, for Martians, or for a contest. In a fifth condition, subjects performed a filler activity, viz., the recall of a personal experience. After the recall test subjects were administered a recognition test. Between the groups no systematic differences in memory performance were observed in the recognition test. Recall for peers appeared to be poorer than recall in the other conditions. Subjects in the recall for a contest condition scored higher than the subjects in the other groups. Not only did groups differ with respect to bias, but there were also systematic differences in the memory or discrimination scores. The findings are discussed within the framework of schema theory.