Group versus individual reinforcement contingencies within the context of group study conditions

We investigated the effects of two teaching variables on students' Spanish vocabulary quiz performance: (a) group study and (b) individual versus group contingencies. In Experiment 1, we compared students' quiz scores under conditions in which students either studied independently and received no programmed reinforcement or studied in groups and received individual rewards for high scores. The results showed that, on average, the group-study individual-reward condition produced superior quiz scores. In Experiment 2, we compared individual (i.e., the superior condition in Experiment 1) and group contingencies within the context of the group study condition. On average across the class, group contingencies produced performance superior to individual contingencies. In both studies, however, benefits for the classes as a whole were mitigated by effects on individual students. These results extend the literature on the effects of group-based instructional activities and reinforcement contingencies. Educators who choose such procedures may encounter conflicting findings depending on whether they examine results at the group or individual level.     

Evaluating the use of preparation guides in interteaching versus a quiz alternative

Interteaching is a behavioral teaching method that has demonstrated efficacy in higher education. Of particular interest is the use of a preparation guide (a guided reading assignment), which is designed to promote engagement in the other areas of the interteaching process. The present study compared the use of a preparation guide completed before the start of class with that of a quiz administered at the start of the class. The quiz was hypothesized to serve as a functional alternative to the preparation guide. A total of 38 undergraduate students enrolled in an Introduction to Psychology course participated in this study. The primary dependent measure was student performance on tests following each condition. The analysis revealed no statistically significant difference between the conditions, F(1, 302) = 0.103, p = .748, though qualitative feedback revealed student preference for preparation guides. Future research is necessary to examine the effects of quizzing while addressing the limitations of this study.     

A comparison of two college classroom testing procedures: required remediation versus no remediation

Forty one subjects from a 10-week introductory course in Educational Psychology were randomly divided into two experimental groups. All students took weekly quizzes over content material. Members of one group received little or no academic credit if they performed at less than 90% on a weekly quiz, but could earn additional credit by taking a weekly remedial quiz. Members of the second group also took the initial weekly quizzes, but retained their raw scores and were not permitted to take the weekly remedial quizzes. Performance on a 100-item multiple-choice comprehensive final revealed a statistically significant and educationally important difference between the two groups, the required-remediation group scoring an average of one-half letter grade higher.     

The impact of teacher language on students’ mindsets and statistics performance

Studies have shown that performance feedback provided by teachers can communicate mindset messages to students and subsequently impact students’ performance. We sought to examine whether non-feedback related comments could also influence students’ mindsets and performance. We utilized a sample of undergraduate students enrolled in a research pool (n?=?106) and compared their mindset and quiz scores after receiving a statistics lesson under one of three conditions. In two conditions the instructor introduced the lesson making comments that communicated either a fixed or growth mindset. A third condition served as a control. Students receiving growth comments moved towards growth mindset beliefs more so than those who received fixed mindset comments and had higher quiz scores when compared to the control group. These results provide early evidence that even non-feedback related comments can influence students’ mindsets and performance. We discuss implications for teaching, teacher training and future research.     

A Comparison of Escalating Versus Fixed Reinforcement Schedules on Undergraduate Quiz Taking

Drug abstinence studies indicate that escalating reinforcement schedules maintain abstinence for longer periods than fixed reinforcement schedules. The current study evaluated whether escalating reinforcement schedules would maintain more quiz taking than fixed reinforcement schedules. During baseline and for the control group, bonus points were distributed on random days for attending class. Following baseline, students in the fixed reinforcement section received 5 bonus points for each quiz completed while students in the escalating reinforcement received 3 bonus points for the first quiz with an increase of 0 or 1 point for each consecutive quiz completed. Results indicated that the escalating reinforcement schedule maintained quiz taking significantly longer than the fixed reinforcement schedule. The control group took the fewest number of quizzes. Students with good attendance took significantly more quizzes under the escalating reinforcement schedule than students with good attendance exposed to the fixed reinforcement schedule or control condition. This study demonstrates a potential novel application for escalating reinforcement schedules. Results indicate that escalating reinforcement schedules may be successfully applied to academic settings, but more research is needed.     

A Comparison of Study Session Formats on Attendance and Quiz Performance in a College Course

We compared two formats for optional study sessions offered to students in a research methods course. Study sessions alternated between a game format (e.g., Behavioral Jeopardy) and a student-directed question and answer format, presented in counterbalanced order across different sections of the same course. The results of the alternating treatments design in Study 1 indicated that, despite improvements in quiz performance relative to baseline, there were no consistent differences between the two formats on attendance at the study sessions or on weekly quiz performance. Similar results were obtained in a systematic replication (Study 2) in which opportunities to respond to game questions were equated across study sessions.     

The Effect of Response Cards on Participation and Weekly Quiz Scores of University Students Enrolled in Introductory Psychology Courses

Increasing student participation in college classrooms is an overlooked yet socially valid endeavor. The present study attempted to increase student participation, accuracy of responding, and weekly quiz scores, by incorporating student response-cards. Measures of social validity were also addressed. One hundred twenty university students in two sections of an introductory course served as participants. An augmented incomplete ABA reversal design was used to compare the effects of review questions with and without response-cards. Results suggest that response cards can increase participation as well as measures of learning, in this case quiz scores. Also, students rated the intervention positively on a consumer satisfaction rating scale. In addition to improving rates of student participation and quiz scores, response-cards positively impacted both students and the instructor's subjective experience in the classroom.     

How Do Groups Work? Age Differences in Performance and the Social Outcomes of Peer Collaboration

Do children derive different benefits from group collaboration at different ages? In the present study, 183 children from two age groups (8.8  and 13.4 years) took part in a class quiz as members of a group, or individually. In some groups, cohesiveness was made salient by awarding prizes to the top performing groups. In other groups, prizes were awarded to the best performing individuals. Findings, both in terms of social outcomes and performance in the quiz, indicated that the 8‐year olds viewed the benefits of group membership in terms of the opportunities to receive information from other members. The 13‐year olds, in contrast, viewed group collaboration as a constructive process where success was connected with group cohesiveness.     

Test-enhanced learning in the classroom: long-term improvements from quizzing

Three experiments examined whether quizzing promotes learning and retention of material from a social studies course with sixth grade students from a suburban middle school. The material used in the experiments was the course material students were to learn and some of the dependent measures were the actual tests on which students received grades. In within-subject designs, students received three low-stakes multiple-choice quizzes in Experiments 1 and 2 and performance on quizzed items was compared to that on items that were presented twice (Experiment 2) or items that were not presented on the initial quizzes (Experiments 1 and 2). We found that students' performance on both chapter exams and semester exams improved following quizzing relative to either not being quizzed or relative to the twice-presented items. In Experiment 3, students were given one multiple-choice quiz in class and encouraged to quiz themselves outside of class using a Web-based system. The assessment in this experiment was a short answer test in which students had to produce answers, but we also used multiple-choice tests. Once again, we found that quizzing of material produced a positive effect on chapter and semester exams. These results show the robustness of retrieval practice via testing as a learning mechanism in a classroom setting using the subject matter of the course and (in most cases) the tests on which students received grades as the dependent measures. Our results add to a growing body of evidence that retrieval practice in the classroom can boost academic performance.     

SHORT- AND LONG-TERM EFFECTS OF CONTINGENCY MANAGED INSTRUCTION ON LOW,MEDIUM, AND HIGH GPA STUDENTS1

Undergraduate students had been assigned to a contingency managed course or a conventional lecture course (Du Nann and Fernald, Journal of Applied Behavior Analysis, 1976, 9 , 373–374). Two years later, some 35% (N = 86) of the original classes responded to a letter offering them $2.00 to participate in a study of their educational experiences. These students completed a multiple-choice test on material from the course, and answered questions about activities and attitudes that might have been affected by the experience in Introductory Psychology. In the contingency management course 2 yr past, students were tested each week on a chapter of textbook material with 10-item multiple-choice quizzes. The course employed a modified “Doomsday Contingency”, requiring each student to achieve 80% mastery on one of the four weekly quizzes or drop the course. Quizzes were given in small groups and scored individually, while the student stood near, by an undergraduate proctor assigned to that group. The proctor was asked to show interest in the students' quiz performances, help clear up difficult areas, and develop a friendly working relationship with each student. While many students passed the quiz on the first attempt, others were given individual tutoring, so that no one was in fact forced to drop the course. In addition to the weekly quiz assignment, students in the contingency managed group were asked to attend one lecture each week. While the contingency management course procedures had much in common with PSI (Keller, Journal of Applied Behavior Analysis, 1968, 1 , 79–89), several departures made them unique. First, self-pacing was curtailed because students were required to master one unit per week or drop the course. Second, proctors met with students in small groups, usually giving individual tutoring only to those students who did not pass the quiz on the first attempt. Finally, students were asked to attend one lecture per week. Students in the conventional lecture group were not asked to pass weekly quizzes, but instead attended three 50-min lectures each week. Two of these lectures followed the textbook material closely, while the third, which was also attended by students from the contingency management course, covered material only indirectly related to the text. This partition of lecture content allowed material to be similar across the two instructional groups. Although students in the lecture condition were told they could obtain copies of the quizzes, few of them did so. Course grades were determined by scores on two 45-item multiple-choice hourly exams, each covering half the semester material (each worth 25%), and by a 90-item final exam, which served as a measure of short-term retention. Before analyzing the follow-up data, several characteristics of the returning students were compared to determine the comparability of the sample from the two original classes. Most important, both attrition and the current mean GPAs of students from the two classes were very similar. These considerations, and others, suggested there was no systematic sampling bias to confound comparisons of student performance. A 2 (contingency management versus traditional lecture) by 3 (high, medium, and low GPA) analysis of variance was computed on the course final-exam scores and the follow-up measures. Instructional procedure and GPA interacted on the final exam such that low and medium GPA students performed significantly better under contingency management, but there was no significant effect of instructional procedure with high GPA students. On the 2-yr retention measures, students from the contingency management course performed significantly (p < 0.01) better on items drawn from quizzes used in their original course, and marginally better (p < 0.10) on items drawn from the final exams, but no interactions with GPA appeared. Furthermore, instructional method produced no significant main effects or interaction with how many students became majors or minors in psychology, how many psychology courses were later taken, how many books in psychology were reported to have been read, or on students' evaluation of the interest and importance of psychology.     

Effects of decisional control on state anxiety and achievement

This study examines the effects of decisional control on state anxiety and cognitive performance in a true-to-life evaluative situation. The analyses were based on the mathematics achievement and state anxiety scores of a sample of 74 eighth grade students randomly assigned to either a Decisional Choice or No Choice experimental condition. Students in the Decisional Choice Condition were given a short mathematics quiz consisting of 5 items of homogeneous difficulty level and instructed to respond to any 3 out of the 5 items. The No Choice condition was essentially the same, except that the students were given only the first three problems and instructed to answer all three. Upon completion of the quiz, students were asked to respond to the Hebrew version of Spielberger's State Anxiety Scale. The findings show that both male and female students tested under Decisional Choice conditions are less anxious and attain higher mathematics scores, on average, than those tested under No Choice conditions. The data support the notion that the provision of decisional choice in an evaluative situation enhances the examinee's perceived feeling of control over the source of the threat (i.e. the mathematics examination). This, in turn, allows more favorable psychological adjustments of one's ‘interior mileau’ to outside stimuli, thereby lowering state anxiety and concomitantly raising levels of test attainment.     

Increasing Active Student Responding in a University Applied Behavior Analysis Course: The Effect of Daily Assessment and Response Cards on End of Week Quiz Scores

The study compared the effects of daily assessment and response cards on average weekly quiz scores in an introduction to applied behavior analysis course. An alternating treatments design (Kazdin 1982, Single-case research designs. New York: Oxford University Press; Cooper et al. 2007, Applied behavior analysis. Upper Saddle River: Merrill/Prentice Hall) was used to analyze the effects of response cards and daily assessment on average weekly quiz scores. Differential treatment effects were found between the daily assessment and response card conditions. When compared to baseline, students’ consistently earned higher quiz scores on end of week quizzes in the daily assessment condition. Response cards produced mixed results. More substantial effects were revealed when analyzing individual student performance. In some cases, twice as many students earned 90% or better when either response cards or daily assessment were used compared to baseline. We discuss the implications of these results for other content areas and student demographics.     

Studying as fun and games: effects on college students' quiz performance

We examined college students' participation in a game activity for studying course material on their subsequent quiz performance. Game conditions were alternated with another activity counterbalanced across two groups of students in a multielement design. Overall, the mean percentage correct on quizzes was higher during the game condition than in the no-game condition.     

Highlights as an Early Predictor of Student Comprehension and Interests

When engaging with a textbook, students are inclined to highlight key content. Although students believe that highlighting and subsequent review of the highlights will further their educational goals, the psychological literature provides little evidence of benefits. Nonetheless, a student’s choice of text for highlighting may serve as a window into her mental state—her level of comprehension, grasp of the key ideas, reading goals, and so on. We explore this hypothesis via an experiment in which 400 participants read three sections from a college-level biology text, briefly reviewed the text, and then took a quiz on the material. During initial reading, participants were able to highlight words, phrases, and sentences, and these highlights were displayed along with the complete text during the subsequent review. Consistent with past research, the amount of highlighted material is unrelated to quiz performance. Nonetheless, highlighting patterns may allow us to infer reader comprehension and interests. Using multiple representations of the highlighting patterns, we built probabilistic models to predict quiz performance and matrix factorization models to predict what content would be highlighted in one passage from highlights in other passages. We find that quiz score prediction accuracy reliably improves with the inclusion of highlighting data (by about 1%–2%), both for held-out students and for held-out student questions (i.e., questions selected randomly for each student), but not for held-out questions. Furthermore, an individual’s highlighting pattern is informative of what she highlights elsewhere. Our long-term goal is to design digital textbooks that serve not only as conduits of information into the reader’s mind but also allow us to draw inferences about the reader at a point where interventions may increase the effectiveness of the material.     

The Power of Positive Recollections: Reducing Test Anxiety and Enhancing College Student Efficacy and Performance

This research sought to develop an intervention (targeting positive emotions and thoughts) as a mechanism for reducing test anxiety and raising confidence and performance in a sample of college students. Participants were randomly assigned to a positive thought task or a control task. Those in the positive‐thought condition, who were assigned to write about successful personal experiences, derived several benefits, when compared with control participants who wrote about their morning routines. Specifically, they experienced more positive affect and less negative affect, exhibited a more optimistic outlook, and reported less test anxiety. They were more likely to appraise the quiz confidently, perceiving it as a challenge rather than a threat. Perhaps most importantly, they exhibited superior performance on the quiz.     

On a so‐Called Solution to a Paradox

The mooronic solution to the surprise quiz paradox says students know there will be a surprise quiz one day this week but they lose this knowledge on the penultimate day. This is because ‘there will be a surprise quiz one day this week’ then becomes an instance of Moore's paradox. This view has surprising consequences. Furthermore, even though the surprise quiz announcement becomes an instance of Moore's paradox on the penultimate day, this does not prevent the students from knowing the quiz is coming. I conclude that the first stage of the paradoxical argument succeeds and the mooronic solution fails.     

AN EXPERIMENTAL COMPARISON OF A CONTINGENCY MANAGED COURSE WITH LARGE LECTURE METHOD1

Contingency management procedures resembling the Personalized System of Instruction (PSI) were compared with a conventional lecture method in teaching an introductory psychology course. The use of a within-subjects design in which half of the students experienced both teaching conditions made it possible to examine the reliability of test-score differences over time when subjects were balanced over conditions. In the contingency management course, material was broken down into 14 small units, each unit covering about 30 pages of text. Students were assigned to an undergraduate teaching assistant who was encouraged to develop a close working relationship with each of his/her 13 assigned students. Specifically, this meant that the assistant was to call each student by his/her first name, show an interest in the student's quiz performance, help the student understand difficult concepts, and discuss various topics of interest to the student. Each week, the teaching assistant administered up to four different 10-item multiple-choice quizzes over the week's chapter. A modified “Doomsday Contingency” required each student either to achieve a score of 80% on one of the four quizzes or drop the course. Most students passed the quiz during the first session of the week; those not passing were tutored on special areas of weakness. No student was actually forced to leave the course under the Doomsday Contingency. Although quizzes were administered on a group basis, they were scored individually while the student stood near by. In addition to the weekly quiz assignment, students under the contingency management procedures were asked to attend one lecture per week. The contingency management method departed from traditional PSI in that (1) self pacing was minimal, such that students were required to master one unit per week or drop the course, (2) teaching assistants met with students in small groups, and usually gave individual tutoring only to those students who did not pass the quiz on the first attempt, and (3) students were asked to attend one lecture per week. However, it was similar to PSI in that small units of subject matter were assigned and unit mastery was assessed through use of undergraduate assistants who delivered immediate feedback. Students in the conventional lecture group attended three 50-min lectures each week; two of these lectures followed textbook material closely, while the third, which was attended by all students, concerned material only indirectly related to the text. As a result, students in both conditions were exposed to essentially identical material. Students in the lecture condition could also obtain copies of the unit quizzes, although few did so. Course grades were determined by scores on two 45-item multiple-choice hourly exams, each covering half of the semester material (each worth 25%), and by a 90-item final exam over the entire course (worth 50%). These measures also served as the dependent variables. The experimental design employed a crossover technique in which one fourth of the students began with the contingency management method and then switched to lecture method at midsemester, while another fourth began with the lecture method and switched to contingency management. The other students stayed in the same condition throughout the semester, half under contingency management and half under the lecture method. On the last day of class, all students filled out an extensive questionnaire that assessed their opinions and attitudes about the teaching techniques. In addition to allowing for assessment of any progressive effects that the contingency management procedures might have had over time, the crossover design also permitted students to make meaningful comparisons of the two teaching methods, since half of the students experienced both methods in the same course. Although average test performance was only slightly higher under the contingency management condition, this difference occurred on each exam and was statistically reliable in each case. Further, the method did not interact with time, as it produced about a three-item advantage per half semester. On each of the three exams, teaching method accounted for between 5 and 8% of the total variance in test scores. Finally, attitude measures indicated that students experiencing half a semester of the contingency management procedures preferred them to the lecture technique, but that only those students with a full semester of contingency management rated the course significantly better than students in the full semester lecture course.     

NYBORG'S ANALYTICAL ROD-AND-FRAME SCORING SYSTEM: A COMPARATIVE STUDY IN ZIMBABWE*

Witkin's method of scoring the Rod-and-Frame Test (RFT), most generally used, has been criticized by Nyborg. On the basis of studies with Danish students he provided evidence that RFT performance is multi-determined, and devised a new scoring method to take this into account. The present study, conducted in Zimbabwe, replicated and extended Nyborg's work. The RFT scores of 80 subjects differing in ethnicity, sex and type of course were analyzed employing both Witkin's and Nyborg's methods. Our results confirm Nyborg's finding that factors other than frame dependence are involved in RFT performance, as indicated by differences in response patterns as a function of ethnic group, sex and type of course. It is suggested that Nyborg's scoring method is a valuable tool for the purpose of clarifying the nature and sources of cultural differences in RFT performance.