Item-by-Item Versus End-of-Test Feedback in a Computer-Based PSI Course

This study examined the effects of three different types of computer feedback on the following variables in a Personalized System of Instruction (PSI) course: unit quiz and final exam performance, the amount of time tutors and other teaching staff spent answering student questions, and students' preference for each type of feedback. The feedback conditions were the following: (a) end-of-test, (b) item-by-item with the option to skip questions during the test, and (c) item-by-item without the option to skip questions during the test. Students who received item-by-item feedback with the skip option performed the same as students who received end-of-test feedback on the unit quizzes and final exam. However, the teaching staff spent significantly less time answering questions when students received item-by-item feedback with the skip option than when they received end-of-test feedback. Finally, 65% of the students preferred item-by-item feedback with the skip option. The authors concluded that this type of item-by-item feedback decreases the workload on teaching staff in a PSI course without sacrificing performance, and students like it more than the other types of feedback.     

Feedback effects on sequential ordering in humans

Under various feedback conditions, 38 college undergraduates were asked to rearrange abstract graphic characters on a computer screen, placing them in arbitrarily designated “correct” sequences. Two sets of seven horizontally arrayed stimuli were used. In Experiment 1, subjects in Group 1 learned to arrange the first set under Selection Feedback in which a “+” appeared above each character after it was selected in the correct order and to arrange the second set under Order Feedback in which a correct response produced a copy of the character in its correct ordinal position at the top of the screen. For Group 2 the order of these conditions was reversed. In Experiment 2, for subjects in Group 3, correct responses produced neither of these types of feedback. Subjects in Group 4 received Order Feedback only until the first set was correctly ordered once. Order Feedback was more effective than Selection Feedback during initial acquisition of the first set but not during maintenance; no differences were found for the second set. Only 2 of 9 subjects successfully put the characters in correct sequential order under the No Feedback condition. When, in Experiment 2, Order Feedback was eliminated after the first correctly arranged sequence, the steady-state criteria were met more slowly than in Experiment 1.     

Putting evidence‐based claims to the test: A multi‐site classroom study of retrieval practice and spaced practice

Retrieval practice and spacing out studying help increase learning. Introductory Psychology students at nine colleges/universities took quizzes with more (RP+) or less (RP?) retrieval practice and more (SP+) or less (SP?) spacing between quizzes. We compared (N = 351) scores on class exams and on a standardized test. We also measured key student variables (e.g., depth of processing). GPA predicted a significant portion of variance in exam scores, R² = 0.05, F(1, 204) = 10.84, p = 0.001. We found a main effect for retrieval practice and a significant retrieval by spacing practice interaction, R² = 0.28, F(3, 201) = 27.38, p < 0.001. Students using SP+, as well as those with SP? and RP?, scored higher than students using SP? and RP+. In practice, closer attention needs to be paid to quiz and exam content overlap and the duration within which repetition is used.     

Learning From Peers’ Eye Movements in the Absence of Expert Guidance: A Proof of Concept Using Laboratory Stock Trading,Eye Tracking,and Machine Learning

Existing research shows that people can improve their decision skills by learning what experts paid attention to when faced with the same problem. However, in domains like financial education, effective instruction requires frequent, personalized feedback given at the point of decision, which makes it time‐consuming for experts to provide and thus, prohibitively costly. We address this by demonstrating an automated feedback mechanism that allows amateur decision‐makers to learn what information to attend to from one another, rather than from an expert. In the first experiment, eye movements of N = 100 subjects were recorded while they repeatedly performed a standard behavioral finance investment task. Consistent with previous studies, we found that a significant proportion of subjects were affected by decision bias. In the second experiment, a different group of N = 100 subjects faced the same task but, after each choice, they received individual, machine learning‐generated feedback on whether their pre‐decision eye movements resembled those made by Experiment 1 subjects prior to good decisions. As a result, Experiment 2 subjects learned to analyze information similarly to their successful peers, which in turn reduced their decision bias. Furthermore, subjects with low Cognitive Reflection Test scores gained more from the proposed form of process feedback than from standard behavioral feedback based on decision outcomes.     

Reflection as a strategy to enhance task performance after feedback

An unanswered question in employee development is how reflection can be used for improving performance in organizations. Drawing from research and theory on dual-process models, we develop and test a reflection strategy to stimulate deeper learning after feedback. Results of two studies (N = 640 and N = 488) showed that reflection combined with feedback enhanced performance improvement on a web-based work simulation better than feedback alone. Reflection without feedback did not lead to performance improvement. Further analyses indicated that the proposed reflection strategy was less effective for individuals low in learning goal orientation, low in need for cognition, and low in personal importance as they engaged less in reflection. Together, these findings provide a theoretical basis for the future study of reflection in organizations and suggest a practical and cost-effective strategy for facilitating employee development after feedback in organizations.     

Feedback influences children's reasoning about math equivalence: A meta-analytic review

ABSTRACT

Decades of research have focused on children's reasoning about math equivalence problems for both practical and theoretical insights. Not only are math equivalence problems foundational in arithmetic and algebra, they also represent a class of problems on which children's thinking is resistant to change. Feedback is one instructional tool that can serve as a key trigger of cognitive change. In this paper, we review all experimental studies (N = 8) on the effects of feedback on children's (ages 6–11) understanding of math equivalence. Meta-analytic results indicate that feedback has positive effects for low-knowledge learners and negative effects for high-knowledge learners, and these effects are stronger for procedural outcomes than conceptual outcomes. Findings highlight the variable influences of feedback on math equivalence understanding and suggest that models of thinking and reasoning need to consider learner characteristics, learning outcomes, and learning materials, as well as the dynamic interactions among them.     

反馈干预对绩效的影响研究

反馈干预是由外部动因提供的关于个体任务操作或过去行为的信息活动,它有反馈对象、反馈效价和反馈提供方式三个维度。研究结果表明反馈效价、反馈提供方式对绩效的影响具有主效应,且两者的之间交互作用对绩效也存在主效应。积极反馈效价、信息型提供方式有助于提高个体的绩效水平。     

Reduced-Frequency Concurrent and Terminal Feedback: A Test of the Guidance Hypothesis

In 2 experiments, the authors manipulated the frequency of concurrent feedback to discern the effects on learning. In each experiment, participants (N = 48, Experiment 1; N = 36, Experiment 2) attempted to reproduce a criterion force-production waveform (5 s in duration) presented on the computer monitor. Consistent with the guidance hypothesis, the results of Experiment 1 indicated very strong guiding effects of concurrent feedback and strong dependence on the feedback, as indicated by participants' extremely poor performance upon feedback withdrawal in retention. As predicted by the guidance hypothesis, dependence on the feedback was reduced as a result of reducing the frequency of the concurrent feedback. The results of Experiment 2 indicated that one can enhance learning by providing concurrent and terminal feedback on 1 trial, with no feedback on the subsequent trial. In that way, the strong guiding effects of concurrent feedback could be realized and the beneficial effects of terminal feedback could also be achieved.     

The Joint Multivariate Modeling of Multiple Mixed Response Sources: Relating Student Performances with Feedback Behavior

The present study concerns a Dutch computer-based assessment, which includes an assessment process about information literacy and a feedback process for students. The assessment is concerned with the measurement of skills in information literacy and the feedback process with item-based support to improve student learning. To analyze students’ feedback behavior (i.e. feedback use and attention time), test performance, and speed of working, a multivariate hierarchical latent variable model is proposed. The model can handle multivariate mixed responses from multiple sources related to different processes and comprehends multiple measurement components for responses and response times. A flexible within-subject latent variable structure is defined to explore multiple individual latent characteristics related to students’ test performance and feedback behavior. Main results of the computer-based assessment showed that feedback-information pages were less visited by well-performing students when they relate to easy items. Students’ attention paid to feedback was positively related to working speed but not to the propensity to use feedback.     

The Counselor Feedback Training Model: Teaching Counseling Students Feedback Skills

Giving and receiving feedback is an important counseling skill; therefore, it is crucial to focus on this skill within counselor training. This article presents the Counselor Feedback Training Model, a developmental approach designed to assist counselor educators in teaching counseling students how to give and receive feedback.     

The Effect of Type of Feedback in Multiple-Choice Testing on Long-Term Retention

We investigated how different types of feedback in multiple-choice testing influence long-term retention. Participants completed an initial multiple-choice test on general-knowledge questions. Then, they were randomly placed into one of the following four conditions: feedback displaying the original question and four alternative options including the correct answer (Feedback 1); feedback displaying the original question and the correct answer (Feedback 2); feedback displaying only the correct answer (Feedback 3); and no feedback (Control). On the final test two days later, participants in the feedback conditions showed improved retention—even participants who received Feedback 3 outperformed the control group, regardless of whether feedback followed correct or incorrect responses. There was no difference between the feedback conditions when feedback followed correct responses, but Feedback 1 was superior to Feedback 3 when feedback followed incorrect responses. The function of feedback in multiple-choice testing is to maintain correct responses and to correct erroneous responses.     

反馈效价影响家族相似性类别学习的ERPs研究

采用事件相关电位技术,以大学生为被试,运用被试间实验设计探讨反馈效价（积极反馈,消极反馈）对家族相似性类别学习的影响。研究结果表明,行为结果上相比积极反馈,消极反馈在推理测验中的成绩显著优于积极反馈。脑电结果上,P200,P300和FRN均与家族相似性类别学习中的反馈加工有关;家族相似性类别学习中,积极反馈与消极反馈存在不对称性。相比于无反馈的条件,P300对消极反馈更加的敏感,消极反馈诱发更大的波幅,而P300对于有无积极反馈并不敏感。说明消极反馈条件下,吸引学习者投入更多的注意资源进行认知加工。此外,相比无反馈条件下,消极反馈条件下FRN有更大的激活,说明了消极反馈对被试以后的行为起着更大的调节作用。总之,研究表明相比于积极反馈,消极反馈对家族相似性类别学习更加有效,错误驱动发挥较大作用。     

Effects of normative feedback on motor learning are dependent on the frequency of knowledge of results

Studies on normative feedback have shown superior motor learning outcomes for individuals who believe that they are performing better than others through increased self-efficacy. Nevertheless, the effects of normative feedback were never dissociated from the knowledge of results (KR) provided to the learners which potentially interacts with self-efficacy as well. Thus, we investigated whether the effects of normative feedback on motor learning, associated with self-efficacy, would be dependent on the amount of KR provided. Fifty-six participants were randomly assigned to four experimental groups in terms of KR frequency (100% and 33%) and normative feedback (positive and negative). In the acquisition phase, all groups received the average KR of their performance at the end of each block of trials (True feedback) and a fake KR based on their own performance (but said to be from a group of participants who practiced the same task) (False Feedback). The False Feedback indicated better or worse performance of the participant in comparison to the fake group, depending on their experimental group. Retention tests were performed immediately and after 24 h from the acquisition phase. To measure self-efficacy, a questionnaire on participant's efficacy was applied before the first block, after each block of trials and before the retention tests. The results revealed superiority of positive normative feedback and 100% KR frequency, compared to negative normative feedback and 100% KR frequency in the 24h retention test. No difference was found between the groups with a frequency of 33% of KR (positive and negative). All groups increased self-efficacy during practice, but there was no difference between groups at any stage of the study. We conclude that the effects of normative feedback on motor learning are dependent on the KR frequency. However, they were not associated with self-efficacy.     

Distributing mathematical practice of third and seventh graders: Applicability of the spacing effect in the classroom

We examined the effect of distributed practice on the mathematical performance of third and seventh graders (N = 213) in school. Students first received an introduction to a mathematical topic, derived from their curriculum. Thereafter, they practiced in one of two conditions. In the massed condition, they worked on three practice sets in 1 day. In the distributed condition, they worked on one practice set per day for 3 consecutive days. Bayesian analyses of the performance in two follow‐up tests 1 and 6 weeks after the last practice set revealed a positive effect of distributed practice as compared with massed practice in Grade 7. In Grade 3, a positive effect of distributed practice was supported by the data only in the test 1 week after the last practice set. The results suggest that distributed practice is a powerful learning tool for both elementary and secondary school students in the classroom.     

Measuring Attitudes Toward Acceptable and Unacceptable Parenting Practices

This study investigated the properties of a new rating instrument, the Parenting Questionnaire (PQ), designed to measure attitudes about acceptable and unacceptable parenting practices. In Study 1, subject matter experts representing culturally diverse psychologists, parents, and college students were consulted to identify 110 items receiving high endorsement. In Study 2, items were administered to 1,398 undergraduate students to examine their factor structure and the effects of ethnicity and gender differences on PQ factors. In Study 3, test–retest reliability (N = 92) and convergent validity (N = 142) of the PQ factors were examined. Exploratory factor analysis revealed three factors (total of 63 items) with high internal consistencies that accounted for a moderate amount of total variance (R ² = .38). The factors were Critical Feedback (26 items), Supportive Feedback (26 items), and Physical Discipline (11 items). Significant ethnicity and gender differences were found on the three PQ factors, as well as a significant interaction between ethnicity and gender on the Supportive Feedback factor. PQ factor scores demonstrated good temporal stability, internal consistency, and convergent validity. Overall findings suggest that the PQ is a reliable, stable, and valid measure of attitudes toward parenting with three distinct factors. Future research directions with parents are discussed.     

Strengthening concept learning by repeated testing

The aim of this study was to examine whether repeated testing with feedback benefits learning compared to rereading of introductory psychology key‐concepts in an educational context. The testing effect was examined immediately after practice, after 18 days, and at a five‐week delay in a sample of undergraduate students (n = 83). The results revealed that repeated testing with feedback significantly enhanced learning compared to rereading at all delays, demonstrating that repeated retrieval enhances retention compared to repeated encoding in the short‐ and the long‐term. In addition, the effect of repeated testing was beneficial for students irrespectively of working memory capacity. It is argued that teaching methods involving repeated retrieval are important to consider by the educational system.     

Mental contrasting facilitates academic performance in school children

Two brief intervention studies tested whether teaching students to mentally contrast a desired future with its present reality resulted in better academic performance than teaching students to only think about the desired future. German elementary school children (N = 49; Study 1) and US middle school children (N = 63; Study 2) from low-income neighborhoods who were taught mental contrasting achieved comparatively higher scores in learning foreign language vocabulary words after 2 weeks or 4 days, respectively. Results have implications for research on the self-regulation of commitment to solve assigned tasks in classroom settings, and for increasing academic performance in school children in low-income areas.     

Meta-analysis of the reduced relative feedback frequency effect on motor learning and performance

A fundamental motor learning principle conveyed in textbooks is that augmented terminal feedback frequency differentially affects motor learning and performance. The guidance hypothesis predicts that relative to a reduced frequency of feedback, providing learners with feedback following every practice trial enhances practice performance but degrades subsequent motor learning. This change in effectiveness for each relative feedback frequency is called a reversal effect, and because it is thought that practice variables can have distinct impacts on learning and performance, delayed retention tests are considered the gold standard in motor learning research. The objectives of this meta-analysis were to a) synthesize the available evidence regarding feedback frequency, performance, and motor learning to test whether there are significant changes in effectiveness from acquisition and immediate retention to delayed retention, b) evaluate potential moderators of these effects, and c) investigate the potential influence of publication bias on this literature. We screened 1662 articles found in PubMed and PsycINFO databases as well as with reference tracing and a targeted author search. A final sample of 61 eligible papers were included in the primary analysis (k = 75, N = 2228). Results revealed substantial heterogeneity but no significant moderators, high levels of uncertainty, and no significant effect of reduced feedback frequency at any time point. Further, multilevel analyses revealed no evidence of a significant change in effect from acquisition or immediate retention to delayed retention. Z-curve analysis suggested the included studies were severely underpowered. These results suggest that robust evidence regarding feedback frequency and motor learning is lacking.     

Effects of Auditory Feedback on Movement Time in a Fitts Task

The purpose of the present experiment was to investigate the role of auditory feedback and its impact on movement time in a standard Fitts task. Feedback was given at the moment of target acquisition. A 2-way analysis of variance found significant differences between feedback groups at all three indexes of difficulty (F(2, 40) = 156.02, p < .001). Results from a mixed-model multivariate analysis of variance for kinematic factors show significant differences in peak velocity and the location of peak velocity when comparing feedback groups. In general, the addition of auditory feedback decreased the task ID by .5.     

反馈在自我调节学习中的作用

反馈一直是学习研究领域中非常重要的主题之一。随着学习理论的发展,人们对反馈的研究逐渐深化与综合化。一方面从自我调节学习的过程模型出发,考察了反馈的不同因素对自我调节学习过程和结果的作用;另一方面以自我调节学习的社会认知理论为框架,探讨了情绪、学业成绩等个体因素以及目标定向、任务难度等情境因素对反馈作用的交互影响。未来研究需要进一步探讨内部反馈信息以及学习者元认知监控的调节作用,结合个体和情境因素揭示反馈对自我调节学习的整体动态过程的影响,并设计出促进学习和教学实践的反馈方案。