Quizzing in Middle‐School Science: Successful Transfer Performance on Classroom Exams

We examined whether learning from quizzing arises from memorization of answers or fosters more complete understanding of the quizzed content. In middle‐school science classes, we spaced three multiple‐choice quizzes on content in a unit. In Experiment 1, the class exams included questions given on quizzes, transfer questions targeting the same content, and content that had not been quizzed (control content). The quizzing procedure was associated with significant learning benefits with large effect sizes and similar effect sizes for both transfer items and identical items. In Experiment 2, quiz questions focused on definitional information or application of the principle. Application questions increased exam performance for definitional‐type questions and for different application questions. Definition questions did not confer benefits for application questions. Test‐enhanced learning, in addition to other factors in the present quizzing protocol (repeated, spaced presentation of the content), may create deeper understanding that leads to certain types of transfer. Copyright © 2013 John Wiley & Sons, Ltd.     

The testing effect with authentic educational materials: A cautionary note

Despite considerable evidence that testing benefits subsequent retrieval of information, it remains uncertain whether this effect extends to topically related information with authentic classroom materials. In the current study we first profile the way in which quizzing is used in the classroom through a survey of introductory psychology instructors. The survey results indicate that, instructors frequently use related but different questions on quizzes and tests unlike many laboratory experiments that use identical questions. In two subsequent experiments, participants studied information from a college biology textbook, were quizzed twice, and given a final test. The items on the final test were either identical to or were related but different than the quiz items. Experiment 1 showed that testing produced the typical robust testing effect for repeated items, but there was no significant effect of testing for topically related items. In Experiment 2, participants could use their quizzes to guide restudy, and there was still no positive effect of testing for topically related information.     

Test-enhanced learning in the classroom: long-term improvements from quizzing

Three experiments examined whether quizzing promotes learning and retention of material from a social studies course with sixth grade students from a suburban middle school. The material used in the experiments was the course material students were to learn and some of the dependent measures were the actual tests on which students received grades. In within-subject designs, students received three low-stakes multiple-choice quizzes in Experiments 1 and 2 and performance on quizzed items was compared to that on items that were presented twice (Experiment 2) or items that were not presented on the initial quizzes (Experiments 1 and 2). We found that students' performance on both chapter exams and semester exams improved following quizzing relative to either not being quizzed or relative to the twice-presented items. In Experiment 3, students were given one multiple-choice quiz in class and encouraged to quiz themselves outside of class using a Web-based system. The assessment in this experiment was a short answer test in which students had to produce answers, but we also used multiple-choice tests. Once again, we found that quizzing of material produced a positive effect on chapter and semester exams. These results show the robustness of retrieval practice via testing as a learning mechanism in a classroom setting using the subject matter of the course and (in most cases) the tests on which students received grades as the dependent measures. Our results add to a growing body of evidence that retrieval practice in the classroom can boost academic performance.     

Multiple-choice testing as a desirable difficulty in the classroom

We examined whether the power of tests as learning events, frequently demonstrated in the laboratory, would also occur in a large undergraduate course. Our goals were to determine: if learning of information tested on multiple-choice quizzes administered across the course would be enhanced compared to non-tested control information; and what the effects of quizzing would be for the learning of information conceptually related to the tested information but not itself tested on the quizzes. Given that retrieval practice can have positive (testing effect) and negative consequences (retrieval-induced forgetting), our concern was that the learning and later retention of non-tested conceptually related information might be impaired by the multiple-choice quizzes. Importantly, learning benefits were found for both types of information on the final exam, indicating that quizzing within a course can enhance not only the learning of specifically tested information, but the learning of non-tested conceptually related information as well.     

Delayed,But Not Immediate,Feedback After Multiple-Choice Questions Increases Performance on a Subsequent Short-Answer,But Not Multiple-Choice,Exam: Evidence for the Dual-Process Theory of Memory

Three experiments, two performed in the laboratory and one embedded in a college psychology lecture course, investigated the effects of immediate versus delayed feedback following a multiple-choice exam on subsequent short answer and multiple-choice exams. Performance on the subsequent multiple-choice exam was not affected by the timing of the feedback on the prior exam; however, performance on the subsequent short answer exam was better following delayed than following immediate feedback. This was true regardless of the order in which immediate versus delayed feedback was given. Furthermore, delayed feedback only had a greater effect than immediate feedback on subsequent short answer performance following correct, confident responses on the prior exam. These results indicate that delayed feedback cues a student's prior response and increases subsequent recollection of that response. The practical implication is that delayed feedback is better than immediate feedback during academic testing.     

Assessing students' use of optional online lecture reviews

Online practice quizzes can be used to supplement instruction in the classroom. Such quizzes can engage retrieval practice, thereby improving learning and retention. However, despite their potential benefits, recent work suggests that students typically underutilize online practice quizzes. This article reports an observational classroom study, in which students were provided optional online reviews throughout the semester. The reviews could be accessed in test format, in which students were given multiple-choice questions and provided correct answer feedback, or in read format in which students were given the same questions and were shown the correct answers. Students who used the test format performed better on exams than students who used the read format or did not use the reviews. Nevertheless, the massive majority of the online reviews (approximately 88%) were not completed, highlighting the tendency for students to underutilize optional online reviews.     

Retrieval (Sometimes) Enhances Learning: Performance Pressure Reduces the Benefits of Retrieval Practice

Academic testing has received substantial support as a useful educational activity with robust retention benefits, given that tests can promote retrieval practice. However, testing can also instantiate performance‐related pressure and anxiety that may misappropriate the resources responsible for producing learning benefits. The current project examined the effects of performance pressure on retrieval practice. In two experiments, we instantiated performance pressure with either high‐stakes or low‐stakes quizzes, and assessed memory and comprehension of content on both quizzes and final tests. Quiz performance was equivalent under high‐stakes and low‐stakes conditions, demonstrating that learners adapted to high‐pressure quizzes. However, final test performance was better after low‐stakes versus high‐stakes quizzes, and only low‐stakes quizzes led to a performance advantage over a rereading control group. Participants additionally exhibited some sensitivity to the difficulty of retrieving under pressure. These data highlight the benefits of retrieval practice but indicate that they can be disrupted under pressure‐driven conditions. Copyright © 2014 John Wiley & Sons, Ltd.     

Conserving time in the classroom: the clicker technique

Any technique that conserves classroom instructional time without sacrificing the amount learned is of great educational value. This research compared a laboratory analogue of the clicker technique to analogues of other classroom pedagogical methods that all involve repeated testing during teaching. The clicker analogue mimics the classroom practice of dropping material that is understood by the majority of the class, as revealed by testing with clicker questions, from further lecture. A fact learning and retrieval paradigm was used, in which college students learned facts about unfamiliar countries. Compressing instruction time based on group-level performance produced as much learning as no compression and as compression based on individual-level performance. Results suggest that the clicker technique is an efficient and cost-effective method of conserving instructional time without loss of amount learned.     

Measuring and reducing college students' procrastination

We examined college students' procrastination when studying for weekly in-class quizzes. Two schedules of online practice quiz delivery were compared using a multiple baseline design. When online study material was made available noncontingently, students usually procrastinated. When access to additional study material was contingent on completing previous study material, studying was more evenly distributed. Overall, the mean gain in percentage correct scores on weekly in-class quizzes relative to pretests was greater during contingent access than during noncontingent access conditions.     

Using System-Wide Trust Theory to Make Predictions About Dependence on Four Diagnostic Aids

The purpose of this experiment was to determine whether performance on a subsequent exam was affected when two lessons were as similar as possible except that one was presented in class and the other was presented online. In a hybrid course, half of the lessons were presented in the classroom as narrated Power Point presentations and half of the lessons were presented online as narrated Power Point presentations. Online student–teacher interaction took place in a chatroom. Furthermore, for each question on the midterm or final examination, the students had answered a pre-lesson and post-lesson question, integrated with the appropriate lesson, which queried the same fact statement as the exam question. Students performed better on post-lesson questions asked in class than post-lesson questions asked online. They also performed better on exam questions on classroom lessons than exam questions on online lessons. The results support the conclusion that social interaction aids learning.     

Teaching Critical Thinking without (Much) Writing: Multiple‐Choice and Metacognition

In this essay, I explore an exam format that pairs multiple‐choice questions with required rationales. In a space adjacent to each multiple‐choice question, students explain why or how they arrived at the answer they selected. This exercise builds the critical thinking skill known as metacognition, thinking about thinking, into an exam that also engages students in the methods of the academic study of religion by asking them to compare familiar excerpts and images. As a form of assessment, the exam provides a record of students' knowledge and their thought processes, and as a learning strategy, it encourages students to examine the thought processes they use to understand religion(s) and its many manifestations.     

Metacognitive effects of initial question difficulty on subsequent memory performance

In two experiments, we examined whether relative retrieval fluency (the relative ease or difficulty of answering questions from memory) would be translated, via metacognitive monitoring and control processes, into an overt effect on the controlled behavior—that is, the decision whether to answer a question or abstain. Before answering a target set of multiple-choice general-knowledge questions (intermediate-difficulty questions in Exp. 1, deceptive questions in Exp. 2), the participants first answered either a set of difficult questions or a set of easy questions. For each question, they provided a forced-report answer, followed by a subjective assessment of the likelihood that their answer was correct (confidence) and by a free-report control decision—whether or not to report the answer for a potential monetary bonus (or penalty). The participants’ ability to answer the target questions (forced-report proportion correct) was unaffected by the initial question difficulty. However, a predicted metacognitive contrast effect was observed: When the target questions were preceded by a set of difficult rather than easy questions, the participants were more confident in their answers to the target questions, and hence were more likely to report them, thus increasing the quantity of freely reported correct information. The option of free report was more beneficial after initial question difficulty than after initial question ease, in terms of both the gain in accuracy (Exp. 2) and a smaller cost in quantity (Exps. 1 and 2). These results demonstrate that changes in subjective experience can influence metacognitive monitoring and control, thereby affecting free-report memory performance independently of forced-report performance.     

Duchenne Muscular Dystrophy: a Survey of Perspectives on Carrier Testing and Communication Within the Family

Carrier testing is widely available for multiple genetic conditions, and several professional organizations have created practice guidelines regarding appropriate clinical application and the testing of minors. Previous research has focused on carrier screening, predictive testing, and testing for X-linked conditions. However, family perspectives on carrier testing for X-linked lethal diseases have yet to be described. In this study, we explored communication within the family about carrier testing and the perspectives of mothers of sons with an X-linked lethal disease, Duchenne muscular dystrophy (DMD). Twenty-five mothers of sons with DMD participated in an anonymous online survey. Survey questions included multiple choice, Likert scale, and open ended, short answer questions. Analysis of the multiple choice and Likert scale questions revealed that most mothers preferred a gradual style of communication with their daughters regarding risk status. In addition, most participants reported having consulted with a genetic counselor and found it helpful. Comparisons between groups, analyzed using Fisher’s exact tests, found no differences in preferred style due to mother’s carrier status or having a daughter. Thematic analysis was conducted on responses to open ended questions. Themes identified included the impact of family implications, age and maturity, and a desire for autonomy regarding the decision to discuss and undergo carrier testing with at-risk daughters, particularly timing of these discussions. Implications for genetic counseling practice are discussed.     

Priming productive study strategies with preparatory quizzes in an engineering course

One approach to encourage productive study strategies is to incorporate preparatory quizzes (or pre‐quizzes) in which students are required to submit answers to questions before the underlying material is covered in class. In the present study, students took an introductory mechanical engineering class that either included pre‐quizzes (treatment group) or did not (control group). Students in the treatment group visited the online textbook more often and earlier in advance of deadlines, indicating better management of their study time—behaviors that have been shown to be productive study strategies. They also performed better in the course, indicating that techniques intended to prime productive study strategies can pay off. Finally, measures of productive learning strategies correlated with measures of course performance for both groups. These findings support the pretesting principle, which holds that students study more effectively and learn better when they take practice tests before a lesson.     

Computerized practice tests and effects on in-class exams

Twenty-eight introductory psychology college students volunteered to learn a technique that might help improve their in-class, multiple-choice exam performance. Two 12-question multiple-choice tests with detailed feedback were presented on a personal computer. There were two types of feedback.Separate feedback consisted of a brief statement indicating why a specific answer was either right or wrong.Combined feedback consisted of the four separate feedbacks combined into a single paragraph. Eighteen students from another introductory class, who did not get to participate in these practice tests, served as a control. A within-group comparison of the two feedback formats showed differences in degree of improvement dependent on the level of achievement by students on the first in-class exam. When compared with data from the control group, the results show significant improvement by the low-level participants on the second in-class exam (p<.01).     

A comparison of interteaching and lecture in the college classroom

Interteaching is a new method of classroom instruction that is based on behavioral principles but offers more flexibility than other behaviorally based methods. We examined the effectiveness of interteaching relative to a traditional form of classroom instruction-the lecture. In Study 1, participants in a graduate course in special education took short quizzes after alternating conditions of interteaching and lecture. Quiz scores following interteaching were higher than quiz scores following lecture, although both methods improved performance relative to pretest measures. In Study 2, we also alternated interteaching and lecture but counterbalanced the conditions across two sections of an undergraduate research methods class. After each unit of information, participants from both sections took the same test. Again, test scores following interteaching were higher than test scores following lecture. In addition, students correctly answered more interteaching-based questions than lecture-based questions on a cumulative final test. In both studies, the majority of students reported a preference for interteaching relative to traditional lecture. In sum, the results suggest that interteaching may be an effective alternative to traditional lecture-based methods of instruction.     

Item-by-Item Versus End-of-Test Feedback in a Computer-Based PSI Course

This study examined the effects of three different types of computer feedback on the following variables in a Personalized System of Instruction (PSI) course: unit quiz and final exam performance, the amount of time tutors and other teaching staff spent answering student questions, and students' preference for each type of feedback. The feedback conditions were the following: (a) end-of-test, (b) item-by-item with the option to skip questions during the test, and (c) item-by-item without the option to skip questions during the test. Students who received item-by-item feedback with the skip option performed the same as students who received end-of-test feedback on the unit quizzes and final exam. However, the teaching staff spent significantly less time answering questions when students received item-by-item feedback with the skip option than when they received end-of-test feedback. Finally, 65% of the students preferred item-by-item feedback with the skip option. The authors concluded that this type of item-by-item feedback decreases the workload on teaching staff in a PSI course without sacrificing performance, and students like it more than the other types of feedback.     

Using the regulation of accuracy to study performance when the correct answer is not known

We examined memory performance in multiple‐choice questions when correct answers were not always present. How do participants answer when they are aware that the correct alternative may not be present? To answer this question we allowed participants to decide on the number of alternatives in their final answer (the plurality option), and whether they wanted to report or withhold their answer (report option). We also studied the memory benefits when both the plurality and the report options were available. In two experiments participants watched a crime and then answered questions with five alternatives. Half of the questions were presented with the correct alternative and half were not. Participants selected one alternative and rated confidence, then selected three alternatives and again rated confidence, and finally indicated whether they preferred the answer with one or with three alternatives (plurality option). Lastly, they decided whether to report or withhold the answer (report option). Results showed that participants’ confidence in their selections was higher, that they chose more single answers, and that they preferred to report more often when the correct alternative was presented. We also attempted to classify a posteriori questions as either presented with or without the correct alternative from participants’ selection. Classification was better than chance, and encouraging, but the forensic application of the classification technique is still limited since there was a large percentage of responses that were incorrectly classified. Our results also showed that the memory benefits of both plurality and report options overlap.