Generalizing test-enhanced learning from the laboratory to the classroom

Test-enhanced learning refers to the fact that taking an initial test on studied material enhances its later retention relative to simply studying the material and then taking a final test. Most research on the testing effect has been done with materials such as word lists, and the general finding has been that the benefits of testing are greater when the initial test is a recall (production) test rather than a recognition test. We briefly summarize three experiments that extend these results to educationally relevant materials, namely brief articles, lectures, and materials in a college course. All three experiments demonstrated a robust testing effect and also revealed that an initial short-answer test produced greater gains on a final test than did an initial multiple-choice test. Furthermore, one experiment revealed a positive effect of immediate feedback given with the initial test. The educational implications are that production tests (short answer or essay) and feedback soon after learning increase learning and retention. In addition, frequent testing probably has the indirect positive effects of keeping students motivated and leading them to space out periods of study.     

Study for now,but judge for later: Delayed judgments of learning promote long‐term retention

Larsson Sundqvist, M., Todorov, I., Kubik, V. & Jönsson, F.U. (2012) Study for now, but judge for later: Delayed judgments of learning promote long‐term retention. Scandinavian Journal of Psychology 53, 450–454. Delayed judgments of learning (JOL) are assumed to be based on covert retrieval attempts. A common finding is that testing memory during learning improves later retention (i.e., the testing effect), and even more so than an equivalent amount of study, but only after a longer retention interval. To test the assertion that also delayed JOLs improve memory, the participants either studied Swahili‐Swedish word pairs four times, or they both studied (two times) and performed delayed JOLs (two times) alternately. Final cued recall test were given after either five minutes or one week. Results showed a reliable learning‐group by retention‐interval interaction, with less forgetting in the group that alternated between studying and making JOLs. The results are discussed in relation to the self‐fulfilling prophecy account of Spellman and Bjork (1992) , and in terms of study advice, the results further underscore the importance of delaying JOLs when studying and evaluating one’s ongoing learning.     

Is expanding retrieval a superior method for learning text materials?

Expanding retrieval practice refers to the idea that gradually increasing the spacing interval between repeated tests ought to promote optimal long-term retention. Belief in the superiority of this technique is widespread, but empirical support is scarce. In addition, virtually all research on expanding retrieval has examined the learning of word pairs in paired-associate tasks. We report two experiments in which we examined the learning of text materials with expanding and equally spaced retrieval practice schedules. Subjects studied brief texts and recalled them in an initial learning phase. We manipulated the spacing of the repeated recall tests and examined final recall 1 week later. Overall we found that (1) repeated testing enhanced retention more than did taking a single test, (2) testing with feedback (restudying the passages) produced better retention than testing without feedback, but most importantly (3) there were no differences between expanding and equally spaced schedules of retrieval practice. Repeated retrieval enhanced long-term retention, but how the repeated tests were spaced did not matter.     

延时间隔和线索类型对遗忘学习判断的影响*

主要探讨不同延时间隔和线索类型对遗忘元认知判断的影响。采用传统的学习判断任务,让被试学习40对无意义配对词,并告知随后进行测试,当呈现第一个词时,被试能够回忆与之配对的后一个词。让被试预测当延迟不同时间（5分钟、1天和1周）进行测试时,他们能够记住（学习判断）或者遗忘（遗忘判断）后一词的可能性。最后,要求被试回忆所有词对。结果发现延时间隔对学习判断和遗忘判断有相似的影响;学习判断的等级和相对准确性均高于遗忘判断,说明人们对记住和遗忘的线索很敏感;相比于学习判断,人们监测自己遗忘能力的信心不足。研究结果表明人们能够利用延时间隔和线索类型来预测未来的测验成绩,对遗忘的监测能力低于对记住的监测。     

How crucial is the response format for the testing effect?

Combining study and test trials during learning is more beneficial for long-term retention than repeated study without testing (i.e., the testing effect). Less is known about the relative efficacy of different response formats during testing. We tested the hypothesis that overt testing (typing responses on a keyboard) during a practice phase benefits later memory more than covert testing (only pressing a button to indicate successful retrieval). In Experiment 1, three groups learned 40 word pairs either by repeatedly studying them, by studying and overtly testing them, or by studying and covertly testing them. In Experiment 2, only the two testing conditions were manipulated in a within-subjects design. In both experiments, participants received cued recall tests after a short (~19 min) and a long (1 week) retention interval. In Experiment 1, all groups performed equally well at the short retention interval. The overt testing group reliably outperformed the repeated study group after 1 week, whereas the covert testing group performed insignificantly different from both these groups. Hence, the testing effect was demonstrated for overt, but failed to show for covert testing. In Experiment 2, overtly tested items were better and more quickly retrieved than those covertly tested. Further, this does not seem to be due to any differences in retrieval effort during learning. To conclude, overt testing was more beneficial for later retention than covert testing, but the effect size was small. Possible explanations are discussed.     

Level of initial training moderates the effects of distributing practice over multiple days with expanding,contracting, and uniform schedules: Evidence for study-phase retrieval

Inconsistent results have been obtained in experiments comparing the effects on retention of expanding, contracting, and uniform practice schedules, in which the spacing between successive practice sessions progressively increases, progressively decreases, or remains constant, respectively. In the present study, we experimentally assessed an apparent trend in the literature for expanding schedules to be more advantageous than other schedules following a low level of training during the initial learning session, but not following a high level of initial training. College students studied pseudocword–word pairs in multiple practice sessions distributed over a 13-day period according to expanding, contracting, and uniform schedules. During their initial learning session, participants received either low-level training (two study trials) or high-level training (one study trial and then five rounds of practice testing with corrective feedback). All participants were treated identically in the subsequent practice sessions. A final cued-recall test after a two-week retention interval revealed an expanding-schedule superiority following low-level initial training but not following high-level initial training. These results are interpreted in terms of a study-phase-retrieval mechanism and help explain the mixed results obtained in the prior literature.     

A short-term testing effect in cross-language recognition

Taking a memory test after an initial study phase produces better long-term retention than restudying the items, a phenomenon known as the testing effect. We propose that this effect emerges because testing strengthens semantic features of items' memory traces, whereas restudying strengthens surface features of items' memory traces. This novel account predicts that a testing effect should be observed even after a short retention interval when a language switch occurs between the learning phase and the final test phase. We assessed this prediction with Dutch-English bilinguals who learned Dutch Deese-Roediger-McDermott word lists through restudying or through testing (retrieval practice). Five minutes after this learning phase, they took a recognition test in Dutch (within-language condition) or in English (across-language condition). We observed a testing effect in the across-language condition, but not in the within-language condition. These findings corroborate our novel account of the testing effect.     

The Effect of Retrieval Practice in Primary School Vocabulary Learning

The testing effect refers to the finding that retrieval practice leads to better long‐term retention than additional study of course material. In the present study, we examined whether this finding generalizes to primary school vocabulary learning. We also manipulated the word learning context. Children were introduced to 20 words by listening to a story in which novel words were embedded (story condition) or by listening to isolated words (word pairs condition). The children practised the meaning of 10 words by retrieval practice and 10 words by restudy. After 1 week, they completed a cued recall test and a multiple choice test. Words learned by retrieval practice were recalled better than words learned by additional study, but there was no difference in recognition. Furthermore, the children in the word pairs condition outperformed the children in the story condition. These results show that retrieval practice may improve vocabulary learning in children. Copyright © 2013 John Wiley & Sons, Ltd.     

Retrieval practice improves learning in children with diverse visual word recognition skills

ABSTRACT

A large body of research shows that performing tests is more beneficial for the retention of studied materials than restudying those materials, a phenomenon termed “testing-effect”. A contemporary debate on the testing effect literature concerns whether the benefits of tests are equivalent for individuals with different cognitive skills, as the capacity to decode written words, for example. In the current study, we approached this issue in two experiments by examining whether testing is equally beneficial for children with diverse visual word decoding skills. To achieve this goal, we recruited sixth and fourth grade children (experiments 1 and 2, respectively) and administered a reading aloud task to assess their visual word recognition skills, and administered a memory task about an encyclopedic text to promote the testing effect. Memory for the restudied/tested contents of the encyclopedic text were probed after a seven-day interval, and although children from both experiments showed robust testing effects, such effects were not associated with their visual word decoding skills. These findings suggest that children with diverse word decoding skills can be benefited by retrieval practice.     

The contributions of encoding,retention, and recall to the Hebb effect

The article reports an experiment testing whether the Hebb repetition effect—the gradual improvement of immediate serial recall when the same list is repeated several times—depends on overt recall of the repeated lists. Previous reports which suggest that recall is critical confound the recall manipulation with retention interval. The present experiment orthogonally varies retention interval (0 or 9 s) and whether the list is to be recalled after the retention interval. Hebb repetition learning is assessed in a final test phase. A repetition effect was obtained in all four experimental conditions; it was larger for recalled than non-recalled lists, whereas retention interval had no effect. The results show that encoding is sufficient to generate cumulative long-term learning, which is strengthened by recall. Rehearsal, if it takes place in the retention interval at all, does not have the same effect on long-term learning as overt recall.     

Testing enhances both encoding and retrieval for both tested and untested items

In forward testing effects, taking a test enhances memory for subsequently studied material. These effects have been observed for previously studied and tested items, a potentially item-specific testing effect, and newly studied untested items, a purely generalized testing effect. We directly compared item-specific and generalized forward testing effects using procedures to separate testing benefits due to encoding versus retrieval. Participants studied two lists of Swahili–English word pairs, with the second study list containing “new” pairs intermixed with the previously studied “old” pairs. Participants completed a review phase in which they took a cued-recall test on only the “old” pairs or restudied them. In Experiments 1a, 1b, and 2, the review phase was given either before or after the second study list. Testing benefited memory to the same degree for both “new” and “old” pairs, suggesting that there were no pair-specific benefits of testing. The larger benefit from testing when review was given before rather than after the second study list suggests that the memory enhancement was due to both testing-enhanced encoding and testing-enhanced retrieval. To better equate generalized testing effects for “new” and “old” pairs, Experiment 3 intermixed them in the review phase. A statistically significant pair-specific testing effect for “old” items was now observed. Overall, these results show that forward testing effects are due to both testing-enhanced encoding and retrieval effects and that direct, pair-specific forward testing benefits are considerably smaller than indirect, generalized forward testing benefits.     

Benefits of testing for nontested information: Retrieval-induced facilitation of episodically bound material

Testing is a powerful means to boost the retention of information. The extent to which the benefits of testing generalize to nontested information, however, is not clear. In three experiments, we found that completing cued-recall tests for a subset of studied materials enhanced retention for the specific information tested, as well as for associated, nontested information during later free-recall testing. In Experiment 1, this generalized benefit was revealed for lists of category–exemplar pairs. Experiment 2 extended the effect to unrelated words, suggesting that retrieval can enhance later free recall of nontested information that is bound solely through episodic context. In Experiment 3, we manipulated the format of the final test and found facilitation in free-recall, but not in cued-recall, testing. The results suggest that testing may facilitate later free recall in part by enhancing access to information that is present during a prior temporal or list context. More generally, these findings suggest that retrieval-induced facilitation extends to a broader range of conditions than has previously been suggested, and they further motivate the adoption of testing as a practical and effective learning tool.     

Recall and response time norms for English–Swahili word pairs and facts about Kenya

In the vast literature exploring learning, many studies have used paired-associate stimuli, despite the fact that real-world learning involves many different types of information. One of the most popular materials used in studies of learning has been a set of Swahili–English word pairs for which Nelson and Dunlosky (Memory 2; 325–335, 1994) published recall norms two decades ago. These norms involved use of the Swahili words as cues to facilitate recall of the English translation. It is unclear whether cueing in the opposite direction (from English to Swahili) would lead to symmetric recall performance. Bilingual research has suggested that translation in these two different directions involves asymmetric links that may differentially impact recall performance, depending on which language is used as the cue (Kroll & Stewart, Journal of Memory and Language 33; 149–174,1994). Moreover, the norms for these and many other learning stimuli have typically been gathered from college students. In the present study, we report recall accuracy and response time norms for Swahili words when they are cued by their English translations. We also report norms for a companion set of fact stimuli that may be used along with the Swahili–English word pairs to assess learning on a broader scale across different stimulus materials. Data were collected using Amazon’s Mechanical Turk to establish a sample that was diverse in both age and ethnicity. These different, but related, stimulus sets will be applicable to studies of learning, metacognition, and memory in diverse samples.     

Sex differences in elaborative strategies: a developmental analysis.

The present study examined sex differences in the use of elaboration in paired associate learning in adolescence and young adulthood. In Experiment 1, 48 eighth grade and 48 tenth grade students were asked to recall 24 word pairs, half of which were high frequency pairs, and half low frequency pairs. After recall, students reported the type of strategy used for each word pair (reading the pairs carefully, rehearsing the words, using imagery or constructing a verbal connection). Females used elaborative strategies more often, were more likely to recall elaborated pairs, and recalled more word pairs than males at both ages. These effects were observed in both high and low frequency word pairs. There was also a main effect of frequency, with elaboration more common with high frequency word pairs. In Experiment 2, college students performed the same paired-associates learning task, but with the added instruction to describe their elaborations in a sentence. At this age, there was a sex by materials interaction, with sex differences in strategy use only present with low frequency word pairs. These findings indicate that sex differences diminish under more favorable task conditions that encourage strategy use (high frequency word pairs) as males and females become more proficient strategy users, but remain under less favorable circumstances. An examination of the types of elaborations generated by college students indicated although males and females produced similar types of elaborations to the word pairs, sex differences in the recallability of low frequency words appeared with less interactive and more idiosyncratic elaborations.     

线索强度对提取练习效应的影响机制：来自ERP的证据

运用事件相关电位技术,探讨提取练习和精细加工在不同线索强度上的加工方式有何不同。结果显示：强线索词对下,二者的相继记忆效应未出现显著性的分离,出现500-700ms额叶、中央分布的模式;弱线索词对下,二者的相继记忆效应出现分离,提取条件500-700ms,700-1000ms观察到与晚期顶叶成分相似的相继记忆效应,精细加工下并没有。结果表明：提取强线索词时个体的加工方式与精细加工类似,提取弱线索词时与精细加工不同,支持情境背景理论。     

Does retrieval practice depend on semantic cues? Assessing the fuzzy trace account of the testing effect

Retrieval practice enhances long-term retention more than restudying; a phenomenon called the testing effect. The fuzzy trace explanation predicts that a testing effect will already emerge after a short interval when participants are solely provided with semantic cues in the final test. In the present study, we assessed this explanation by gradually reducing the surface features overlap between cues in the learning phase and the final recognition test. In all five experiments, participants in the control/word condition received as final test cues the same words as in the learning phase. The experimental final test cues consisted of scrambled words, words in a new context, scrambled words in a new context (Experiment 1), synonyms (Experiment 2), or images (Experiments 3, 4a, 4b). A short-term testing effect was only observed for the image final test cues. These results do not provide strong support for the fuzzy trace explanation of the testing effect.     

The effectiveness of test-enhanced learning depends on trait test anxiety and working-memory capacity

Despite being viewed as a better way to enhance learning than repeated study, it has not been clear whether repeated testing is equally effective for students with a wide range of cognitive abilities. The current study examined whether test-enhanced learning would be equally beneficial to participants with varied working-memory capacity (WMC) and trait test anxiety (TA). Chinese-English bilingual undergraduates in Hong Kong were recruited as participants. They acquired Swahili-English word pairs (half via repeated study and half via repeated testing) and performed a delayed cued-recall test for all pairs about one week after the acquisition phase. Their WMC and TA were estimated by Unsworth, Heitz, Schrock, and Engle's (2005) operation-span task and the Chinese version of Spielberger's (1980) Test Anxiety Inventory, respectively. We replicated the typical testing effect: Participants performed better for pairs in the repeated-testing condition than those in the repeated-study condition. Regression analyses showed that, (a) relative to other participants, those with lower WMC and higher TA made more intralist intrusion errors (i.e., recalling a wrong English translation to a Swahili word cue) during the acquisition phase, and (b) the testing effect was negatively correlated with TA for participants with lower WMC, but was not correlated with TA for participants with higher WMC. This demonstrates a boundary condition for the use of test-enhanced learning. Implications of these findings for theories of the testing effect (e.g., Pyc & Rawson's, 2010, mediator-effectiveness hypothesis) and their application in classroom settings are discussed. (PsycINFO Database Record (c) 2012 APA, all rights reserved).     

Consolidation of novel word learning in native English-speaking adults

Sleep has been shown to improve the retention of newly learned words. However, most methodologies have used artificial or foreign language stimuli, with learning limited to word/novel word or word/image pairs. Such stimuli differ from many word-learning scenarios in which definition strings are learned with novel words. Thus, we examined sleep's benefit on learning new words within a native language by using very low-frequency words. Participants learned 45 low-frequency English words and, at subsequent recall, attempted to recall the words when given the corresponding definitions. Participants either learned in the morning with recall in the evening (wake group), or learned in the evening with recall the following morning (sleep group). Performance change across the delay was significantly better in the sleep than the wake group. Additionally, the Levenshtein distance, a measure of correctness of the typed word compared with the target word, became significantly worse following wake, whereas sleep protected correctness of recall. Polysomnographic data from a subsample of participants suggested that rapid eye movement (REM) sleep may be particularly important for this benefit. These results lend further support for sleep's function on semantic learning even for word/definition pairs within a native language.     

线索强度对测试效应的调节:时间间隔上的差异

本研究采用不同线索强度(强/弱)的中文词对, 选取大学生被试126人, 考察了不同学习方式(重学/测试)在不同时间间隔(5分钟/2天)最终自由回忆测试成绩上的差异。结果发现:在强线索强度词对上, 学习方式主效应显著, 测试条件的回忆成绩在5分钟以及2天后均高于重学条件;而在弱线索强度词对上, 学习方式与间隔时间交互作用显著, 5分钟时重学条件与测试条件的记忆成绩差异不显著, 而2天后测试条件的记忆成绩却显著高于重学条件。结果表明词对的线索强度能够调节测试对不同时间间隔记忆保持的促进作用, 支持了精细提取假设。     

Odor-context effects in free recall after a short retention interval: A new methodology for controlling adaptation

The present study investigated context effects of incidental odors in free recall after a short retention interval (5 min). With a short retention interval, the results are not confounded by extraneous odors or encounters with the experimental odor and possible rehearsal during a long retention interval. A short study time condition (4 s per item), predicted not to be affected by adaptation to the odor, and a long study time condition (8 s per item) were used. Additionally, we introduced a new method for recovery from adaptation, where a dissimilar odor was briefly presented at the beginning of the retention interval, and we demonstrated the effectiveness of this technique. An incidental learning paradigm was used to prevent overshadowing from confounding the results. In three experiments, undergraduates (N = 200) incidentally studied words presented one-by-one and received a free recall test. Two pairs of odors and a third odor having different semantic-differential characteristics were selected from 14 familiar odors. One of the odors was presented during encoding, and during the test, the same odor (same-context condition) or the other odor within the pair (different-context condition) was presented. Without using a recovery-from-adaptation method, a significant odor-context effect appeared in the 4-s/item condition, but not in the 8-s/item condition. Using the recovery-from-adaptation method, context effects were found for both the 8- and the 4-s/item conditions. The size of the recovered odor-context effect did not change with study time. There were no serial position effects. Implications of the present findings are discussed.