Decomposing the interaction between retention interval and study/test practice: the role of retrievability

Even without feedback, test practice enhances delayed performance compared to study practice, but the size of the effect is variable across studies. We investigated the benefit of testing, separating initially retrievable items from initially nonretrievable items. In two experiments, an initial test determined item retrievability. Retrievable or nonretrievable items were subsequently presented for repeated study or test practice. Collapsing across items, in Experiment 1, we obtained the typical cross-over interaction between retention interval and practice type. For retrievable items, however, the cross-over interaction was quantitatively different, with a small study benefit for an immediate test and a larger testing benefit after a delay. For nonretrievable items, there was a large study benefit for an immediate test, but one week later there was no difference between the study and test practice conditions. In Experiment 2, initially nonretrievable items were given additional study followed by either an immediate test or even more additional study, and one week later performance did not differ between the two conditions. These results indicate that the effect size of study/test practice is due to the relative contribution of retrievable and nonretrievable items.     

Segregation accuracy in item‐method directed forgetting across multiple tests

Two experiments examined recall across tests following item‐method directed‐forgetting instructions and the varying of presentation duration of items at study. For both immediate testing (Experiment 1) and delayed testing (Experiment 2), accurate recall of remember instruction items (R‐items) exceeded the accurate recall of forget instruction items (F‐items). However, some F‐items from study were inaccurately recalled as R‐items and R‐items from study as F‐items. Inaccurate recall persisted across tests for both immediate and delayed recall and increased across tests for immediate recall. We view the R‐item advantage in accurate recall as consistent with the account they receive more rehearsal at study than do F‐items. We view inaccurate recall as reflecting the bias to report items retrieved on an immediate test lacking instructional tags as F‐items. On delayed tests, items retrieved lacking instructional tags are first assessed against a criterion point on a memory‐strength continuum and those with strength above the criterion reported as R‐items and those below the criterion as F‐items.     

Retrieval-induced facilitation: initially nontested material can benefit from prior testing of related material

Classroom exams can assess students' knowledge of only a subset of the material taught in a course. What are the implications of this approach for long-term retention? Three experiments (N = 210) examined how taking an initial test affects later memory for prose materials not initially tested. Experiment 1 shows that testing enhanced recall 24 hr later for the initially nontested material. This facilitation was not seen for participants given additional study opportunities without initial testing. Experiment 2 extends this facilitative effect to a within-subjects design. Experiment 3 demonstrates that this facilitation can be modulated by conscious strategies. These results have implications for educational practice and the theoretical developments of the testing effect, associative memory, and retrieval inhibition.     

How crucial is the response format for the testing effect?

Combining study and test trials during learning is more beneficial for long-term retention than repeated study without testing (i.e., the testing effect). Less is known about the relative efficacy of different response formats during testing. We tested the hypothesis that overt testing (typing responses on a keyboard) during a practice phase benefits later memory more than covert testing (only pressing a button to indicate successful retrieval). In Experiment 1, three groups learned 40 word pairs either by repeatedly studying them, by studying and overtly testing them, or by studying and covertly testing them. In Experiment 2, only the two testing conditions were manipulated in a within-subjects design. In both experiments, participants received cued recall tests after a short (~19 min) and a long (1 week) retention interval. In Experiment 1, all groups performed equally well at the short retention interval. The overt testing group reliably outperformed the repeated study group after 1 week, whereas the covert testing group performed insignificantly different from both these groups. Hence, the testing effect was demonstrated for overt, but failed to show for covert testing. In Experiment 2, overtly tested items were better and more quickly retrieved than those covertly tested. Further, this does not seem to be due to any differences in retrieval effort during learning. To conclude, overt testing was more beneficial for later retention than covert testing, but the effect size was small. Possible explanations are discussed.     

When does testing enhance retention? A distribution-based interpretation of retrieval as a memory modifier

Tests, as learning events, can enhance subsequent recall more than do additional study opportunities, even without feedback. Such advantages of testing tend to appear, however, only at long retention intervals and/or when criterion tests stress recall, rather than recognition, processes. We propose that the interaction of the benefits of testing versus restudying with final-test delay and format reflects not only that successful retrievals are more powerful learning events than are re-presentations but also that the distribution of memory strengths across items is shifted differentially by testing and restudying. The benefits of initial testing over restudying, in this view, should increase as the delay or format of the final test makes that test more difficult. Final-test difficulty, not the similarity of initial-test and final-test conditions, should determine the benefits of testing. In Experiments 1 and 2 we indeed found that initial cued-recall testing enhanced subsequent recall more than did restudying when the final test was a difficult (free-recall) test but not when it was an easier (cued-recall) test that matched the initial test. The results of Experiment 3 supported a new prediction of the distribution framework: namely, that the final cued-recall test that did not show a benefit of testing in Experiment 1 should show such a benefit when that test was made more difficult by introducing retroactive interference. Overall, our results suggest that the differential consequences of initial testing versus restudying reflect, in part, differences in how items distributions are shifted by testing and studying.     

Improving metacognitive accuracy: How failing to retrieve practice items reduces overconfidence

People often exhibit inaccurate metacognitive monitoring. For example, overconfidence occurs when people judge that they will remember more information on a future test then they actually do. The present experiments examined whether a small number of retrieval practice opportunities would improve participants’ metacognitive accuracy by reducing overconfidence. Participants studied Lithuanian–English paired associates and predicted their performance on an upcoming memory test. Then they attempted to retrieve one or more practice items (or none in the control condition) and made a second prediction. Experiment 1 showed that failing to retrieve a single practice item lead to improved subsequent performance predictions – participants became less overconfident. Experiment 2 directly manipulated retrieval failure and showed that again failure to retrieve a single practice item significantly improved subsequent predictions, relative to when participants successfully retrieved the practice item. Finally, Experiment 3 showed that additional retrieval practice opportunities reduced overconfidence and improved prediction accuracy.     

Effects of varying modality,surface features,and retention interval on priming in word-fragment completion

Subjects in Experiment i studied a list of words under varying presentation conditions (visual or auditory) and in two typographies within the visual condition (typed or hand printed) and then received a word-fragment completion test (e.g., —YS—E—Y formystery) in which the test cues also varied in typography. The main findings were that (1) priming occurred for all study items, relative to nonstudied items, but greater priming occurred for visual than for auditory presentation, and (2) performance in the visual conditions was better when typographies matched between study and test than when the typographies mismatched, but only for words studied in hand-printed form. These findings were generally replicated when the test was delayed 1 week, although priming declined across this retention interval (Experiment 2). In Experiment 3 subjects studied words that were either in focus or blurred and showed greater priming when test fragments were presented in the same manner as at study. Priming in the word-fragment completion task depends on matching surface characteristics of items between study and test and exemplifies the requirement of performing similar mental operations at study and test for maximizing performance (transfer-appropriate processing).     

Mnemonic benefits of retrieval practice at short retention intervals

The testing effect refers to the retention benefit conferred by prior retrieval of information from memory. Although the testing effect is a robust phenomenon, a common assumption is that reliable memory benefits only emerge after long retention intervals of days or weeks. The present study focused on potential test-induced retention benefits for brief retention intervals on the order of minutes and tens of seconds. Participants in four experiments studied lists of words. Some of the items were subjected to an initial cued recall test, and others were re-presented for additional study. Free recall tests were administered in each experiment following retention intervals ranging from 30 s to 8 min. When initial retrieval practice was successful (Experiments 1 through 3), or feedback compensated for unsuccessful retrieval (Experiment 4), significant testing effects emerged at all retention intervals. Results are discussed in the context of a bifurcated item-distribution model and highlight the importance of initial test performance and the type of analysis employed when examining testing effect data.     

The effects of overlearning and distributed practise on the retention of mathematics knowledge

In two experiments, 216 college students learned to solve one kind of mathematics problem before completing one of various practise schedules. In Experiment 1, students either massed 10 problems in a single session or distributed these 10 problems across two sessions separated by 1 week. The benefit of distributed practise was nil among students who were tested 1 week later but extremely large among students tested 4 weeks later. In Experiment 2, students completed three or nine practise problems in one session. The additional six problems constituted a strategy known as overlearning, but this extra effort had no effect on test scores 1 or 4 weeks later. Thus, long‐term retention was boosted by distributed practise and unaffected by overlearning. Unfortunately, most mathematics textbooks rely on a format that emphasises overlearning and minimises distributed practise. An easily adopted alternative format is advocated. Copyright © 2006 John Wiley & Sons, Ltd.     

Testing the limits of testing effects using completion tests

Recent work on testing effects has shown that retrieval practice can facilitate memory even for complex prose materials (Roediger & Karpicke, 2006a, 2006b). In three experiments the current study explores the effectiveness of retrieval practice on fill-in-the-blank (FITB) tests requiring the recall of specific words or phrases from a text. Final tests included both repeated items that were directly taken from initial tests, and related items. In Experiment 1, with a 2-day delay between initial and final tests, FITB testing benefited performance only on repeated items. In Experiment 2 a 7-day delay between testing sessions led to more robust effects on repeated items. However, once again no benefits were seen for related items. In Experiment 3 the scope of retrieval was varied by comparing FITB tests to paragraph recall tests requiring retrieval of all sentences following a topic sentence. Only the more open-ended recall practice demonstrated improvements in transfer to novel questions. The results suggest that scope or type of processing required during retrieval practice is likely a critical factor in whether testing will have specific or robust benefits.     

Explaining the persistence of false memories: a proposal based on associative activation and thematic extraction

This study aimed to analyse the effect of retention intervals on associative and thematic false memories. Two experiments, using two types of critical items that were either associatively or thematically related to studied material, were conducted. In both experiments, one group of participants performed a recognition test immediately after the presentation of lists, and another group performed the task one week later. In Experiment 1, the recognition test consisted of pairs of items with four response alternatives (both items had been presented, only the left item had been presented, only the right item had been presented or none of the items had been presented). Critical items were also manipulated so that they were either presented in or absent from the list. In Experiment 2, a standard recognition test that differed in the mode of presentation was used: self-paced or speeded response. Both experiments showed that associative critical items were more recognised than thematic critical items in the immediate condition. However, whereas associative critical items decayed after a one-week delay, thematic critical items were similarly recognised at both retention intervals. The findings of the present study suggest that each type of process – associative and thematic – behave differently over time.     

测试效应是过程依赖还是内容依赖?

测试效应是指复习时对所学习材料进行提取比重学能更好地促进记忆。本研究利用低关联度名词词对作为实验材料来探讨测试效应的作用机制是过程依赖还是内容依赖。实验1的目的是考察记忆时程对测试效应的影响。实验采用2（复习条件：测试、重学）×3（测验间隔：5分钟、2天、1周）混合设计探究测试效应产生的时程。实验结果：间隔5分钟和2天时,没有出现测试效应;间隔1周时出现了测试效应。可见1周是本实验条件下测试效应比较敏感的时程条件。实验2的目的是考察测试效应是过程依赖还是内容依赖。根据实验1的结果,选择1周时程,采用2（复习条件：测试、重学）×2（测验方式：A→B、A←B）被试间设计,探索测试效应的产生依赖于测试的过程还是内容。研究的基本假设：如果测试效应依赖于测试的内容,那么在测试方式为A→B与A←B两种条件下,其测试效应大小应有所不同;如果测试效应依赖于测试过程,那么测试方式为A→B与A←B条件下,测试效应的大小应该没有差异。结果发现：无论测试时是A→B还是A←B,其测试效应的大小没有区别。说明测试效应是有赖于复习时测试的过程。     

Influence of emotional facial expressions on 3-5-year-olds’ face recognition

Three experiments examined 3- and 5-year-olds’ recognition of faces in constant and varied emotional expressions. Children were asked to identify repeatedly presented target faces, distinguishing them from distractor faces, during an immediate recognition test and during delayed assessments after 10 min and one week. Emotional facial expression remained neutral (Experiment 1) or varied between immediate and delayed tests: from neutral to smile and anger (Experiment 2), from smile to neutral and anger (Experiment 3, condition 1), or from anger to neutral and smile (Experiment 3, condition 2). In all experiments, immediate face recognition was not influenced by emotional expression for either age group. Delayed face recognition was most accurate for faces in identical emotional expression. For 5-year-olds, delayed face recognition (with varied emotional expression) was not influenced by which emotional expression had been displayed during the immediate recognition test. Among 3-year-olds, accuracy decreased when facial expressions varied from neutral to smile and anger but was constant when facial expressions varied from anger or smile to neutral, smile or anger. Three-year-olds’ recognition was facilitated when faces initially displayed smile or anger expressions, but this was not the case for 5-year-olds. Results thus indicate a developmental progression in face identity recognition with varied emotional expressions between ages 3 and 5.     

The testing effect in free recall is associated with enhanced organizational processes

In two experiments with categorized lists, we asked whether the testing effect in free recall is related to enhancements in organizational processing. During a first phase in Experiment 1, subjects studied one list over eight consecutive trials, they studied another list six times while taking two interspersed recall tests, and they learned a third list in four alternating study and test trials. On a test 2 days later, recall was directly related to the number of tests and inversely related to the number of study trials. In addition, increased testing enhanced both the number of categories accessed and the number of items recalled from within those categories. One measure of organization also increased with the number of tests. In a second experiment, different groups of subjects studied a list either once or twice before a final criterial test, or they studied the list once and took an initial recall test before the final test. Prior testing again enhanced recall, relative to studying on the final test a day later, and also improved category clustering. The results suggest that the benefit of testing in free recall learning arises because testing creates retrieval schemas that guide recall.     

Is temporal spacing of tests helpful even when it inflates error rates?

The occurrence of errors is often thought to impede associative learning. This was tested in 2 studies, each of which involved 2 sessions. In Session 1, subjects learned foreign vocabulary (Experiment 1) or obscure English words (Experiment 2) and received 2 tests (each with corrective feedback) separated by a variable lag. Greater lags drastically reduced performance on the 2nd test. However, they dramatically improved performance in a Session-2 test given 1 day (Experiment 1) or 1 week later (Experiment 2). This pattern held even for items that elicited errors on the 1st test of Day 1. Evidently, the benefit of spacing overwhelms any possible harmful effect of producing errors. The results have clear and nonobvious implications for computer-aided instruction.     

Does response mode affect amount recalled or the magnitude of the testing effect?

The testing effect is the finding that retrieval practice can enhance recall on future tests. One unanswered question is whether first-test response mode (writing or speaking the answer) affects final-test performance (and whether final-test response mode itself matters). An additional unsettled issue is whether written and oral recall lead to differences in the amount recalled. In three experiments, we examined these issues: whether subjects can recall more via typing or speaking; whether typing or speaking answers on a first test can lead to better final-test performance (and whether an interaction occurs with final-test response mode) and whether any form of overt response leads to better final-test performance as compared to covert retrieval (thinking of the answer but not producing it). Subjects studied paired associates; took a first test by typing, speaking, or thinking about responses; and then took a second test in which the answers were either spoken or typed. The results revealed few differences between typing and speaking during recall, and no difference in the size of the testing effect on the second test. Furthermore, an initial covert retrieval yielded roughly the same benefit to future test performance as did overt retrieval. Thus, the testing effect was quite robust across these manipulations. The practical implication for learning is that covert retrieval provides as much benefit to later retention as does overt retrieval and that both can be effective study strategies.     

Does the nature of the experience influence suggestibility? A study of children's event memory

Two experiments examined the effects of event modality on children's memory and suggestibility. In Experiment 1, 3- and 5-year-old children directly participated in, observed, or listened to a narrative about an event. In an interview immediately after the event, free recall was followed by misleading or leading questions and, in turn, test recall questions. One week later children were reinterviewed. In Experiment 2, 4-year-old children either participated in or listened to a story about an event, either a single time or to a criterion level of learning. Misleading questions were presented either immediately or 1 week after learning, followed by test recall questions. Five-year-old children were more accurate than 3-year-olds and those participating were more accurate than those either observing or listening to a narrative. However, method of assessment, level of event learning, delay to testing, and variables relating to the misled items also influenced the magnitude of misinformation effects.     

Comparing and combining retrieval practice and the keyword mnemonic for foreign vocabulary learning

Experiment 1 compared the effectiveness of retrieval practice, the keyword mnemonic and rote rehearsal for learning foreign language vocabulary. Both mnemonic methods produced similar recall and were superior to rote rehearsal. In Experiment 2, participants learned German vocabulary using keywords, retrieval practice or their own method. Retrieval practice and keyword‐based recall were similar and superior to self‐directed study. In Experiment 3, participants studied using keywords, retrieval practice, a combination or an elaboration strategy. Criterion testing occurred immediately and after a week. For receptive learning, retrieval practice and keywords were equally beneficial but for productive learning, retrieval practice was more effective. Combining strategies produced mixed results with significant benefits only for receptive learning in the delayed test. Copyright © 2006 John Wiley & Sons, Ltd.     

The development of category-based induction: reexamining conclusions from the induction then recognition (ITR) paradigm

Three studies examined the development of category-based induction using an induction then recognition (ITR) procedure in which participants make category-based predictions about study items and are then given a surprise recognition test that requires discrimination between old and new category members. Exposure duration for study items was either self-paced (Experiment 1) or fixed for 5-year-olds and adults (Experiments 2a-b). Adults always showed a decrement in recognition performance following induction. Children showed the same decrement when exposure duration was equated across age groups. These results show that both young children and adults spontaneously access category-level information during induction. When study exposure time is self-paced, however, children may process additional, noncategorical aspects of study stimuli. (PsycINFO Database Record (c) 2008 APA, all rights reserved).     

Metacognitive control in self-regulated learning: Conditions affecting the choice of restudying versus retrieval practice

In two experiments, learners studied word pairs one or two times and took a final cued recall test. They studied each pair upon its initial presentation and decided whether they would restudy it later, take a practice test on it later (retrieval practice), or forego all further practice with the pair. Whether learners preferred restudying or testing depended upon conditions. Regardless of whether practice tests were followed by feedback, they chose to take practice tests relatively more often when items were easy and the lag or spacing interval between the first and second occurrence was short, whereas they chose to restudy relatively more when items were hard and the lag was long. That is, they preferred testing under conditions in which successful retrieval on the practice test was likely. In Experiment 2, we varied the number of points each item was worth if recalled on the final test. A high point value led to a marked increase in both the preference for testing when the lag was short and the preference for restudying when the lag was long. Results support the hypothesis that learners appreciate at some level that retrieval practice can be a more effective learning strategy than restudying. However, they appear to believe that successful retrieval is necessary to reap the benefits of retrieval practice. As a consequence, their tendency to choose testing is influenced by conditions (item difficulty and spacing interval) that affect the likelihood of successful practice-test retrieval.