Assessing changes in performance and monitoring processes in individual and collaborative tests according to students' metacognitive skills

This study assessed students' test performances and metacognitive processes in real classroom settings. Psychology undergraduates were categorised according to their metacognitive skills (high vs. low) and had their test performances and monitoring processes in two different types of tests (multiple-choice and short-answer tests) compared in individual and collaborative test conditions. Students' test preparation practices, attributions, and regulatory processes during test-taking were also compared by using open-ended questions. In the collaborative tests, three types of metacognitive pairings were made (high/high vs. high/low vs. low/low). Results showed that: (1) in individual tests, high-metacognitive students presented better performance and higher confidence levels due to their more effective test preparation practices and regulatory skills; (2) Differences in performance and confidence levels due to metacognitive skills disappear when students take tests collaboratively; (3) Over time, collaborative testing had particular positive effects on the low/low metacognitive pairings. Results are discussed focusing on their educational implications.     

Using verification feedback to correct errors made on a multiple-choice test

A key educational challenge is how to correct students’ errors and misconceptions so that they do not persist. Simply labelling an answer as correct or incorrect on a short-answer test (verification feedback) does not improve performance on later tests; error correction requires receiving answer feedback. We explored the generality of this conclusion and whether the effectiveness of verification feedback depends on the type of test with which it is paired. We argue that, unlike for short-answer tests, learning whether one's multiple-choice selection is correct or incorrect should help participants narrow down the possible answers and identify specific lures as false. To test this proposition we asked participants to answer a series of general knowledge multiple-choice questions. They received no feedback, answer feedback, or verification feedback, and then took a short-answer test immediately and two days later. Verification feedback was just as effective as answer feedback for maintaining correct answers. Importantly, verification feedback allowed learners to correct more of their errors than did no feedback, although it was not as effective as answer feedback. Overall, verification feedback conveyed information to the learner, which has both practical and theoretical implications.     

Metamemory, memory performance, and causal attributions in gifted and average children

Fifth and seventh graders who had been teacher-selected as high- or average-achieving were tested on the Kognitiver F?higkeits Test, a standardized test of intellectual abilities for German children. Children who met preestablished criteria as gifted or average were then tested on measures of metacognitive knowledge, attributional beliefs, and performance on a sort recall task. Results indicated ability-related differences in metamemory and sort recall performances. Responses to the attributional questionnaires also varied systematically according to ability: gifted children were more likely to attribute their academic successes to high ability than were average children, who showed a stronger belief in the importance of effort in determining task outcomes. Causal modeling analyses illustrated the strength of metacognitive knowledge as a performance predictor on the memory task, especially for average children. Results are discussed in terms of the value of metacognitive theory in understanding individual performance differences.     

Using verification feedback to correct errors made on a multiple-choice test

A key educational challenge is how to correct students' errors and misconceptions so that they do not persist. Simply labelling an answer as correct or incorrect on a short-answer test (verification feedback) does not improve performance on later tests; error correction requires receiving answer feedback. We explored the generality of this conclusion and whether the effectiveness of verification feedback depends on the type of test with which it is paired. We argue that, unlike for short-answer tests, learning whether one's multiple-choice selection is correct or incorrect should help participants narrow down the possible answers and identify specific lures as false. To test this proposition we asked participants to answer a series of general knowledge multiple-choice questions. They received no feedback, answer feedback, or verification feedback, and then took a short-answer test immediately and two days later. Verification feedback was just as effective as answer feedback for maintaining correct answers. Importantly, verification feedback allowed learners to correct more of their errors than did no feedback, although it was not as effective as answer feedback. Overall, verification feedback conveyed information to the learner, which has both practical and theoretical implications.     

Relating Test-Taking Attitudes and Skills and Stereotype Threat Effects to the Racial Gap in Cognitive Ability Test Performance

This research extended past studies on race effects and stereotype threat (ST) effects outside the academic domain, as well as exploring the mediating role of test-related cognition, motivation, and emotionality in the Black-White cognitive ability test performance differences. One hundred seventy-two undergraduates took a simulated personnel selection test and responded to measures of attitudinal and test-taking skills prior to and after the test. Half of the participants were told that the test provided the hypothetical employer diagnostic information about their reasoning abilities and limitations; they were also asked to report their racial status prior to taking the test. Significant race differences favoring Whites were found for mathematical and logical performance, holding ability constant. A metacognitive strategy, regulation of cognition, partially mediated race effects on mathematical and verbal performance. Contrary to previous findings, no traditional significant ST effects were found; however, a 3-way interaction revealed that proficiency in test-taking strategies mitigated the Black-White mathematical score gap to a greater extent for those in the ST condition.     

Metacognition in Taiwan: students' calibration of comprehension and performance

Researchers have increasingly investigated the role played by metacognition in students' learning and performance. Metacognition is comprised of metacognitive knowledge and metacognitive experiences, and both components of metacognition are viewed as being important to learning and performance in academic settings. Metacognitive experiences involve, in part, students' awareness of progress on cognitive tasks. Such awareness is critical to learning, for students may fail to spend additional time reviewing or studying material if they believe they have understood the material adequately. In the present study we examined Taiwanese students' ability to assess their comprehension of passages following reading as well as their ability to predict the number of questions they would be able to answer about passage content. Following an actual test on the material, students were asked to assess how many questions they felt they answered correctly about a passage (postdiction). Students were able to predict comprehension and test performance at better than chance levels and were more accurate at postdiction than prediction. Students with better performance, as measured by comprehension test scores, were better at both prediction and postdiction of comprehension performance. However, students' self-assessments of general calibration ability did not relate to their test performance. The metacomprehension skills of Taiwanese students were quite similar to those previously found for western students, but also diverged in some respects.     

Improving the Performance of Failing Students by Overcoming Their Self-Serving Attributional Biases

The causal impact of attributions on academic performance was examined by changing low-scoring students' attributions regarding their poor performances. Initially, when students who were failing a college course identified the cause of the performance, they emphasized external, uncontrollable causes. Because these self-serving attributions could have perpetuated poor performance on subsequent examinations, students in the experimental condition were exposed to information that suggested that grades in college are caused by internal, controllable factors such as effort and motivation. As predicted, on subsequent tests and on the final examination, these students earned higher grades than control students who received no attributional information. These findings lend support to an attributional model of academic achievement and also suggest that educational interventions that shift attributions away from a self-serving pattern to a performance-facilitating pattern may improve academic outcomes.     

Confidence-judgment accuracy as a predictor of test performance

As part of the regular classroom testing procedure, undergraduate students in an introductory psychology course were asked to provide confidence judgments along with their answers to multiple-choice test items. The two objectives of the study were to determine the extent of students' confidence-judgment accuracy and the degree of relationship of this memory-monitoring ability to overall test performance. The results showed that even the students having the poorest test performance showed some confidence-judgment accuracy, and, more importantly, there was a strong positive relationship between confidence-judgment accuracy and test performance, r(43) = .49. Thus, students who know more also are better able to distinguish between known and unknown information.     

Retrospective and prospective metacognitive judgments in rhesus macaques (Macaca mulatta)

A growing body of research suggests that some non-human animals are capable of making accurate metacognitive judgments. In previous studies, non-human animals have made either retrospective or prospective judgments (about how they did on a test or how they will do on a test, respectively). These two types of judgments are dissociable in humans. The current study tested the abilities of two rhesus macaque monkeys to make both retrospective and prospective judgments about their performance on the same memory task. Both monkeys had been trained previously to make retrospective confidence judgments. Both monkeys successfully demonstrated transfer of retrospective metacognitive judgments to the new memory task. Furthermore, both monkeys transferred their retrospective judgments to the prospective task (one, immediately, and one, following the elimination of a response bias). This study is the first to demonstrate both retrospective and prospective monitoring abilities in the same monkeys and on the same task, suggesting a greater level of flexibility in animals’ metacognitive monitoring abilities than has been reported previously.     

The effects of mood and retrieval cues on semantic memory and metacognition

We investigated whether the previously established effect of mood on episodic memory generalizes to semantic memory and whether mood affects metacognitive judgments associated with the retrieval of semantic information. Sixty-eight participants were induced into a happy or sad mood by viewing and describing IAPS images. Following mood induction, participants saw a total of 200 general knowledge trivia items (50 open-ended and 50 multiple-choice after each of two mood inductions) and were asked to provide a metacognitive judgment about their knowledge for each item before providing a response. A sample trivia item is: Author – – To kill a mockingbird. Results indicate that mood affects the retrieval of semantic information, but only when the participant believes they possess the requested semantic information; furthermore, this effect depends upon the presence of retrieval cues. In addition, we found that mood does not affect the likelihood of different metacognitive judgments associated with the retrieval of semantic information, but that, in some cases, having retrieval cues increases accuracy of these metacognitive judgments. Our results suggest that semantic retrieval processes are minimally susceptible to the influence of affective state but does not preclude the possibility that affective state may influence encoding of semantic information.     

Metacognitive regulation of text learning: on screen versus on paper

Despite immense technological advances, learners still prefer studying text from printed hardcopy rather than from computer screens. Subjective and objective differences between on-screen and on-paper learning were examined in terms of a set of cognitive and metacognitive components, comprising a Metacognitive Learning Regulation Profile (MLRP) for each study media. Participants studied expository texts of 1000-1200 words in one of the two media and for each text they provided metacognitive prediction-of-performance judgments with respect to a subsequent multiple-choice test. Under fixed study time (Experiment 1), test performance did not differ between the two media, but when study time was self-regulated (Experiment 2) worse performance was observed on screen than on paper. The results suggest that the primary differences between the two study media are not cognitive but rather metacognitive--less accurate prediction of performance and more erratic study-time regulation on screen than on paper. More generally, this study highlights the contribution of metacognitive regulatory processes to learning and demonstrates the potential of the MLRP methodology for revealing the source of subjective and objective differences in study performance among study conditions.     

Investigating Two Approaches to Fostering Children's Comprehension of Literature

This instructional study investigated the effects of two approaches to fostering elementary students' comprehension of literature. Participants were 54 third-grade students in 2 classrooms in a linguistic and culturally diverse, urban elementary school. Students read two folktales, receiving a Scaffolded Reading Experience (SRE) unit with one folktale and a unit we termed a Response-Oriented approach with the other folktale in a counterbalanced fashion. Classes were observed throughout both units and students completed multiple-choice and short-answer tests after reading each story and receiving the unit instruction. Teachers were interviewed after presenting both units. Results on the multiple-choice tests showed that students scored significantly higher when receiving the SRE units and that teachers preferred the SRE unit lessons. However, there were no differences between the two approaches on the short-answer tests, and teachers noted that some of the activities in the Response-Oriented units were very useful. Our conclusions are that both the Response-Oriented units and the SRE units provided strong scaffolding for students' reading, that the two approaches should be thought of as complementary rather than as competing, and that there is a place for both of them in classrooms that seek to build both comprehension and appreciation of literature.     

Metacognitive monitoring and control processes involved in primary school children's test performance

Background Within the context of students' self‐regulated learning, the interplay between learners' individual characteristics and the context of testing have been emphasized for assessing learning outcomes. Aims The present study examined metacognitive monitoring and control processes in elementary schoolchildren's test taking behaviour and explored the impacts of these metacognitive skills for the accuracy and the quantity of test performance. Sample and methods A total of 133 participants from third and fifth grade did a cloze test about a previously learned science topic, gave confidence judgments for every answer, and were then allowed to cross‐out answers if they wished. Two different mock scoring schemes for test performance were compared with a control group. Results Results revealed well‐developed monitoring skills indicating that by the age of 9 children can reliably distinguish between correct and incorrect answers. As for control skills, 11‐ and 12‐year‐olds proved to be better able to improve their test performance by selectively withdrawing answers that would have been incorrect than the 9‐ to 10‐year‐olds. Conclusions The study offers evidence for the impact of metacognitive processes in students' learning outcomes and documents strategic behaviour during test taking, as well as developmental progression in the involved skills.     

Exploring the motivation jungle: predicting performance on a novel task by investigating constructs from different motivation perspectives in tandem

Different theoretical viewpoints on motivation make it hard to decide which model has the best potential to provide valid predictions on classroom performance. This study was designed to explore motivation constructs derived from different motivation perspectives that predict performance on a novel task best. Motivation constructs from self-determination theory, self-regulation theory, and achievement goal theory were investigated in tandem. Performance was measured by systematicity (i.e. how systematically students worked on a problem-solving task) and test score (i.e. score on a multiple-choice test). Hierarchical regression analyses on data from 259 secondary school students showed a quadratic relation between a performance avoidance orientation and both performance outcomes, indicating that extreme high and low performance avoidance resulted in the lowest performance. Furthermore, two three-way interaction effects were found. Intrinsic motivation seemed to play a key role in test score and systematicity performance, provided that effort regulation and metacognitive skills were both high. Results indicate that intrinsic motivation in itself is not enough to attain a good performance. Instead, a moderate score on performance avoidance, together with the ability to remain motivated and effectively regulate and control task behavior, is needed to attain a good performance. High time management skills also contributed to higher test score and systematicity performance and a low performance approach orientation contributed to higher systematicity performance. We concluded that self-regulatory skills should be trained in order to have intrinsically motivated students perform well on novel tasks in the classroom.     

Using working memory theory to investigate the construct validity of multiple-choice reading comprehension tests such as the SAT.

When taking multiple-choice tests of reading comprehension such as the Scholastic Assessment Test (SAT), test takers use a range of strategies that vary in the extent to which they emphasize reading the questions versus reading the passages. Researchers have challenged the construct validity of these tests because test takers can achieve better-than-chance performance even if they do not read the passages at all. By using an individual-differences approach that compares the relative power of working memory span to predict SAT performance for different test-taking strategies, the authors show that the SAT appears to be tapping reading comprehension processes as long as test takers engage in at least some reading of the passages themselves.     

Motivational determinants of reading comprehension: A comparison of French,Caucasian–American,and African–American adolescents

The relationships between adolescents' reading comprehension and their metacognitive knowledge and self-system beliefs were studied in three groups of subjects: French nationals, Caucasian Americans, and African Americans. Subjects were tested on measures of reading comprehension, metacognitive knowledge about reading processes, attributional beliefs, and academic self-concept. Correlation and regression analyses indicated cultural differences in the predictors of reading comprehension among the three groups. For French and Caucasian Americans, reading comprehension scores were related to metacognitive knowledge, academic self-concept, and attributions of success to ability. However, metacognition and motivational beliefs were mostly unrelated to comprehension performance for African Americans. Results are discussed in terms of verification of a model of motivational influences on performance, of cultural and ethnic group differences in beliefs, and the implications for generalizability of research results.     

Self‐regulated learning of basic arithmetic skills: A longitudinal study

Background. Several studies have examined young primary school children's use of strategies when solving simple addition and subtraction problems. Most of these studies have investigated students’ strategy use as if they were isolated processes. To date, we have little knowledge about how math strategies in young students are related to other important aspects in self‐regulated learning. Aim. The main purpose of this study was to examine relations between young primary school children's basic mathematical skills and their use of math strategies, their metacognitive competence and motivational beliefs, and to investigate how students with basic mathematics skills at various levels differ in respect to the different self‐regulation components. Sample. The participants were comprised of 27 Year 2 students, all from the same class. Method. The data were collected in three stages (autumn Year 2, spring Year 2, and autumn Year 3). The children's arithmetic skills were measured by age relevant tests, while strategy use, metacognitive competence, and motivational beliefs were assessed through individual interviews. The participants were divided into three performance groups; very good students, good students, and not‐so‐good students. Results. Analyses revealed that young primary school children at different levels of basic mathematics skill may differ in several important aspects of self‐regulated learning. Analyses revealed that a good performance in addition and subtraction was related not only to the children's use of advanced mathematics strategies, but also to domain‐specific metacognitive competence, ability attribution for success, effort attribution for failure, and high perceived self‐efficacy when using specific strategies. Conclusions. The results indicate that instructional efforts to facilitate self‐regulated learning of basic arithmetic skills should address cognitive, metacognitive, and motivational aspects of self‐regulation. This is particularly important for low‐performing students.     

智力和元认知技能在发现学习中的作用:任务复杂性的影响

采用自编的计算机模拟发现学习任务,以49名大学生为被试,探讨了在简单和复杂发现学习任务中,智力、元认知技能和学习成绩三者之间的关系。结果发现:在简单任务中,三者关系基本符合混合模型;进行过多的元认知活动,并不能提高学习效果。在复杂任务中,智力对学习成绩起主要预测作用。随着任务复杂性的增加,智力对学习的影响也随之变化,符合难度阈限理论的假设。任务复杂性不同时,智力、元认知技能和发现学习成绩之间的关系也不同,在一定程度上验证了难度阈限扩展理论。     

Attributional style,attributional retraining,and inoculation against motivational deficits

College students periodically experience many challenges in pursuit of their educational goals. Such experiences can have deleterious effects on subsequent motivation and performance when they are perceived as negative. Research shows that some students who experience negative events are buffered against motivational deficits, whereas others are motivationally at-risk. Several individual difference variables have been proposed to account for such diverse reactions. A longitudinal field study that involved three phases was conducted to extend this research. Phase I examined the motivational buffering effects of academic attributional style on students' performance, motivation, and emotions. Results indicated that attributional style related to students' performance, motivation, and emotions. Specifically, students who routinely made unstable and controllable attributions for negative academic events exhibited the greatest performance and motivation compared to students who typically made stable and uncontrollable attributions. Phases II and III were designed to examine the remedial benefits of attributional retraining for different attributional styles. Findings indicated that attributional retraining influenced motivation, emotions, and course grade. These results were qualified by the interaction between attributional style, attributional retraining, and time. Findings are discussed within Weiner's (1985, 1986) attribution theory. This research was based, in part, on the first author's dissertation submitted to the Department of Psychology and the Faculty of Graduate Studies of The University of Manitoba in partial fulfillment for the Degree of Doctor of Philosophy. This research was supported by a Social Sciences and Humanities Research Council of Canada (SSHRCC) doctoral fellowship, a University of Manitoba doctoral fellowship, and a SSHRCC postdoctoral fellowship to the first author. In addition, the research was also supported by a SSHRCC research grant (#410911296) to the second author. The authors gratefully acknowledge the helpful comments of Bernard Weiner, Harvey Keselman, John Adair, Rodney Clifton, and Robert Altemeyer. Also appreciated was the assistance of Verena Menec and the Higher Education Research group.     

4-5年级学生的空间表征与几何能力的相关性研究

本研究是“学生空间能力和几何能力关系”研究的一部分,以小学4、5年级学生为被试(共117人),以空问表征能力测验和几何能力测验为测验工具,初步探讨了学生空间表征与几何能力的关系。对数据结果的分析表明:①就总成绩而言,五年级学生的空间表在成绩明显高于四年级学生的成绩,但并不是空间表征的所有方面都存在着显著的年级差异;②就空间测验的总成绩而言,无论是四、五年级分别考察还是总起来考察,空间成绩与几何成绩之间的相关显著,但就各个分项而言,并不是空间测验的各项都与几何测验成绩有显著相关;学生的几何成绩在一定程度上可通过回归方程:Y_i=0.5736X_i+0.7635加以预测。