Younger and older adults weigh multiple cues in a similar manner to generate judgments of learning

One’s memory for past test performance (MPT) is a key piece of information individuals use when deciding how to restudy material. We used a multi-trial recognition memory task to examine adult age differences in the influence of MPT (measured by actual Trial 1 memory accuracy and subjective confidence judgments, CJs) along with Trial 1 judgments of learning (JOLs), objective and participant-estimated recognition fluencies, and Trial 2 study time on Trial 2 JOLs. We found evidence of simultaneous and independent influences of multiple objective and subjective (i.e., metacognitive) cues on Trial 2 JOLs, and these relationships were highly similar for younger and older adults. Individual differences in Trial 1 recognition accuracy and CJs on Trial 2 JOLs indicate that individuals may vary in the degree to which they rely on each MPT cue when assessing subsequent memory confidence. Aging appears to spare the ability to access multiple cues when making JOLs.     

Memory for Star Trek: the role of prior knowledge in recognition revisited

Prior studies have found robust knowledge effects on recall of text ideas but have seldom found comparable effects on recognition. This inconsistency was examined in light of recent research on the component processes that underlie recognition memory. Using the remember/know paradigm, the authors found that experts made more remember judgments than novices, but only in response to text ideas relevant to their domain of expertise. Using the process-dissociation procedure, the authors found knowledge effects on recollection estimates, but not on familiarity estimates. The authors contend that knowledge effects have been difficult to detect in recognition because knowledge primarily affects recollection, whereas familiarity gives rise to good performance even among novices.     

Deliberation Versus Intuition: Decomposing the Role of Expertise in Judgment and Decision Making

What produces better judgments: deliberating or relying on intuition? Past research is inconclusive. We focus on the role of expertise to increase understanding of the effects of judgment mode. We propose a framework in which expertise depends on a person's experience with and knowledge about a domain. Individuals who are relatively experienced but have modest knowledge about the subject matter (“intermediates”) are expected to suffer from deliberation and to benefit from a more intuitive approach, because they lack the formal knowledge to understand the reasons underlying their preferences. Individuals who are high (“experts”) or low (“novices”) on both experience and knowledge are expected to do well or poorly, respectively, regardless of decision mode. We tested these predictions in the domain of art. Experiments 1 and 2 showed that intermediates performed better when relying on intuition than after deliberation. Judgments of experts and novices were unaffected. In line with previous research relating processing style to judgment mode, Experiment 3 showed that the effect of processing style (global versus local) on judgment quality is similarly moderated by expertise. Copyright © 2012 John Wiley & Sons, Ltd.     

Overoptimism about future knowledge: Early arrogance?

Abstract

Three studies explored whether young children (5–7 years) have more optimistic views of their future knowledge than older children (8–12 years) and adults. In Study 1, younger children were more likely than older children and adults to expect greater knowledge in both young and mature protagonists. Both groups of children saw knowledge rising at a faster rate into adulthood than adult participants did. All ages judged moral knowledge as much easier to acquire than other types of knowledge, such as artifacts. In Study 2, all children saw their own future knowledge in especially optimistic terms in comparison to ratings by adults, and the older children exhibited a self-enhancement bias. Study 3 found an overall preference for the acquisition of positively valenced future knowledge, particularly for the 8- to 12-year olds and in the domain of morality, suggesting pragmatic underpinnings for these judgments.     

The memorizing effort heuristic in judgments of learning: A developmental perspective

Recent work on adult metacognition indicates that although metacognitive monitoring often guides control operations, sometimes it follows control operations and is based on the feedback from them. Consistent with this view, in self-paced learning, judgments of learning (JOLs) made at the end of each study trial decreased with the amount of time spent studying the item, suggesting that JOLs are based on the memorizing effort heuristic that easily learned items are more likely to be remembered. Study 1 extended investigation to primary school children. Whereas for third to sixth graders (9- to 12-year-olds) JOLs decreased with increasing study time (ST), no such relationship was found for first and second graders (7- and 8-year-olds). For both age groups, however, recall decreased with ST, supporting the validity of the memorizing effort heuristic. Self-reports (Study 2) disclosed the belief that recall should tend to increase with ST. The results bring to the fore the importance of mnemonic cues that shape metacognitive feelings even among primary school children. These cues lie in the very feedback that learners gain on-line from task performance rather than in metacognitive knowledge, and their use may also contribute to increased monitoring accuracy with age.     

Detecting deception in a bluffing body: The role of expertise

Studies of deception detection traditionally have focused on verbal communication. Nevertheless, people commonly deceive others through nonverbal cues. Previous research has shown that intentions can be inferred from the ways in which people move their bodies. Furthermore, motor expertise within a given domain has been shown to increase visual sensitivity to other people’s movements within that domain. Does expertise also enhance deception detection from bodily movement? In two psychophysical studies, experienced basketball players and novices attempted to distinguish deceptive intentions (fake passes) and veridical intentions (true passes) from an observed individual’s actions. Whereas experts and novices performed similarly with postural cues, only experts could detect deception from kinematics alone. These results demonstrate a link between action expertise and the detection of nonverbal deception.     

The vision heuristic: Judging music ensembles by sight alone

Team effectiveness and group performance are often defined by standards set by domain experts. Professional musicians consistently report that sound output is the most important standard for evaluating the quality of group performance in the domain of music. However, across six studies, visual information dominated rapid judgments of group performance. Participants (1062 experts and novices) were able to select the actual winners of live ensemble competitions and distinguish top-ranked orchestras from non-ranked orchestras based on 6-s silent video recordings yet were unable to do so from sound recordings or recordings with both video and sound. These findings suggest that judgments of group performance in the domain of music are driven at least in part by visual cues about group dynamics and leadership.     

Developmental trends in children's memory monitoring: Evidence from a judgment-of-learning task

Two experiments were conducted to explore young children's memory monitoring abilities on a judgment-of-learning (JOL) task. Recent research on adults' JOLs has shown that predictions about subsequent recall for items that have been recently studied have never been very accurate immediately after learning but have been very accurate when judgments were delayed. One of the major goals of the present studies was to investigate whether the delayed-JOL effect could be observed in children of different ages. A secondary goal of the study was to compare individual-item JOLs with aggregate JOLs based on all items of a given list. If young children possess basic monitoring skills, both their delayed JOLs and their aggregate judgments should be comparably realistic. Our two experiments confirmed this assumption for all age groups involved (kindergartners, second and fourth graders). That is, JOLs were much more accurate when given after a delay of about 2 min than immediately after study, and overconfidence was typically larger for item-by-item JOLs than for aggregate-item JOLs. In fact, the pattern of findings for the older school children was very similar to that found for adults. Overall, these findings support the position that developmental trends in children's procedural metamemory are not due to differences in basic monitoring skills but attributable to developmental changes concerning the interplay between monitoring and self-regulation activities.     

Influence of Expertise on the Intentional Transfer of Motor Skill

Intentional transfer of expert knowledge is an important issue in cognitive science and motor skills. How subjects deliberately transfer expertise in karate when learning a closely related motor skill (tai chi) was examined in this study. Subjects (N = 20) learned a videotaped sequence of self-defense movements, evaluated their learning, and then performed the sequence. Self-regulation of learning is believed to be central to effective transfer. The measures of self-regulation were accuracy of self-evaluation, video use, and approach to learning. Results showed that unlike novices, experts used self-regulation, learning strategies, and the video player in more complex ways in self-regulation. Experts, as compared with novices, demonstrated their greater knowledge through the higher quality of their performance and their better comprehension of movement meaning; but both groups recalled an equal number of moments, suggesting that both experts and novices transferred general knowledge about learning.     

Schematic knowledge changes what judgments of learning predict in a source memory task

Source monitoring can be influenced by information that is external to the study context, such as beliefs and general knowledge (Johnson, Hashtroudi, & Lindsay, 1993). We investigated the extent to which metamnemonic judgments predict memory for items and sources when schematic information about the sources is or is not provided at encoding. Participants made judgments of learning (JOLs) to statements presented by two speakers and were informed of the occupation of each speaker either before or after the encoding session. Replicating earlier work, prior knowledge decreased participants’ tendency to erroneously attribute statements to schematically consistent but episodically incorrect speakers. The origin of this effect can be understood by examining the relationship between JOLs and performance: JOLs were equally predictive of item and source memory in the absence of prior knowledge, but were exclusively predictive of source memory when participants knew of the relationship between speakers and statements during study. Background knowledge determines the information that people solicit in service of metamnemonic judgments, suggesting that these judgments reflect control processes during encoding that reduce schematic errors.     

Predicting memory performance under conditions of proactive interference: Immediate and delayed judgments of learning

Four experiments examined the monitoring accuracy of immediate and delayed judgments of learning (JOLs) under conditions of proactive interference (PI). PI was produced using paired-associate learning tasks that conformed to variations of classic A–B, A–D paradigms. Results revealed that the relative monitoring accuracy of interference items was better for delayed than for immediate JOLs. However, delayed JOLs were overconfident for interference items, but not for items devoid of interference. Intrusions retrieved prior to delayed JOLs produced inflated predictions of performance. These results show that delayed JOLs enhance monitoring accuracy in PI situations, except when intrusions are mistaken for target responses.     

Domain familiarity as a cue for judgments of learning

Students differ in how much they already know about topics within and across their courses. Few studies, however, have examined the relationship between participants’ levels of knowledge across topics (i.e., their “domain familiarity”) and their learning of information from those topics, their study choices related to those topics, and their subjective self-assessments of their learning about the topics. As such, in two studies we had participants (Study 1, college students; Study 2, Mturk workers) rank their domain familiarity for several to-be-studied domains (e.g., chemistry, history), rate their efficacy and interest in those domains, study and make judgments of learning (JOLs) for facts from each domain, and finally complete a short-answer test over those facts. Participants’ efficacy and interest ratings for the topics were linearly related to their topic rankings, as were their recall of and JOLs for facts from those domains. Although the JOLs were consistently overconfident, they were more overconfident for better-known than for lesser-known topics. Participants’ study times were not related to their topic rankings (Studies 1 and 2), but participants did use domain familiarity to strategically decide which domains to restudy before the test (Study 2). Participants typically chose to restudy their least-familiar topics, but chose to restudy their best-known topic under extremely limited restudy conditions. As a whole, the results suggest that participants effectively use their domain familiarity as a basis for their JOLs and restudy choices, but to some extent overuse this factor to assess their learning, and underuse it to guide initial study.     

Expertise in cognitive psychology: testing the hypothesis of long-term working memory in a study of soccer players

This experiment compared several theories of expertise and exceptional performances in cognitive psychology. One current conception assumes that experts in a specific domain have developed a long-term working memory, which accounts for the difference in memory performance between experts and novices. The principal characteristics of this memory are the speed with which processes of storage and retrieval function and the existence of retrieval structures that allow a temporary activation of the knowledge store in long-term memory. Other authors such as Vicente and Wang argue this notion does not account for memory performance that is not intrinsic to the domain of expertise. We attempt to clarify the two viewpoints and to focus on this debate by testing the hypothesis of long-term working memory using soccer as the domain of expertise and by comparing the cognitive performance of participants who have different expertise (novices, supporters, players, and coaches). 35 male participants were administered a new version of the Reading Span test to assess their long-term working memory according to two conditions. In the first condition (structured condition), the last word of each sentence was related to the soccer domain, and these words were related to each other in such a manner that they represented a part of the game. In the second condition (unstructured condition), the last word of each sentence was related to soccer but these words did not represent part of the game. Analysis showed that the sentence span increased as a function of expertise for the structured condition but not for the unstructured condition. The results were interpreted in the framework of the constraint attunement hypothesis proposed by Vicente in 1992 and the long-term working memory hypothesis proposed by Ericsson and Kintsch in 1995.     

延迟学习判断研究的发展与展望

延迟学习判断是学习判断的一种形式,是指在材料学习完以后间隔一段时间才发生的学习判断。在与即时学习判断的对比研究中发现,延迟学习判断具有较高的相对准确性,这种现象被称为延迟学习判断效应。研究者进行了大量的研究并提出了多种理论来解释这种延迟学习判断效应。随着研究的不断深入,延迟学习判断的研究从研究指标、研究方法甚至是研究的理论基础都在不断更新。延迟学习判断的研究进展,包括主要理论和相关实验,以及最新研究成果将被介绍。最后,文章梳理了延迟JOL的研究进程,并指出了未来的研究方向。     

People use the memory for past-test heuristic as an explicit cue for judgments of learning

When people estimate their memory for to-be-learned material over multiple study–test trials, they tend to base their judgments of learning (JOLs) on their test performance for those materials on the previous trial. Their use of this information—known as the memory for past-test (MPT) heuristic—is believed to be responsible for improvements in the relative accuracy (resolution) of people’s JOLs across learning trials. Although participants seem to use past-test information as a major basis for their JOLs, little is known about how learners translate this information into a judgment of learning. Toward this end, in two experiments, we examined whether participants factored past-test performance into their JOLs in either an explicit, theory-based way or an implicit way. To do so, we had one group of participants (learners) study paired associates, make JOLs, and take a test on two study–test trials. Other participants (observers) viewed learners’ protocols and made JOLs for the learners. Presumably, observers could only use theory-based information to make JOLs for the learners, which allowed us to estimate the contribution of explicit and implicit information to learners’ JOLs. Our analyses suggest that all participants factored simple past-test performance into their JOLs in an explicit, theory-based way but that this information made limited contributions to improvements in relative accuracy across trials. In contrast, learners also used other privileged, implicit information about their learning to inform their judgments (that observers had no access to) that allowed them to achieve further improvements in relative accuracy across trials.     

Metacognitive monitoring during criterion learning: When and why are judgments accurate?

Research on metacognitive judgment accuracy during retrieval practice has increased in recent years. However, prior work had not systematically evaluated item-level judgment accuracy and the underlying bases of judgment accuracy in a criterion-learning paradigm (in which items are practiced until correctly recalled during encoding). Understanding these relationships during criterion learning has important theoretical implications for self-regulated learning frameworks, and also has applied implications for student learning: If the factors that influence metacognitive judgments are not predictive of subsequent test performance, students may make poor decisions during self-regulated learning. In the present experiments, participants engaged in test–restudy practice until items were recalled correctly. Once a given item reached criterion, participants made an immediate or delayed judgment of learning (JOL) for the item. A final cued-recall test occurred 30 min later. We examined judgment accuracy (the relationship between JOLs and test performance) and the underlying bases of judgment accuracy by evaluating cue utilization (the relationship between cues and JOLs) and cue diagnosticity (the relationship between cues and test performance). Immediate JOLs were only modestly related to subsequent test performance, and further analyses revealed that the cues related to JOLs were only weakly predictive of test accuracy. However, delaying JOLs improved both the accuracy of the JOLs and the diagnosticity of the cues that influenced judgments.     

On the origin of intermediate effects in clinical case recall

In two experiments, the effects of level of medical expertise and study time on free recall of a clinical case were assessed. In Experiment 1, a nonmonotonic relationship between level of expertise and recall was found: Subjects of intermediate levels of expertise remembered more information from the case than both experts and novices. This “intermediate effect” disappeared, however,when study time was restricted. Analysis of post hoc acquired protocols of pathophysiological knowledge active during case processing suggested that this phenomenon could be attributed to the nature of the pathophysiological knowledge mobilized to comprehend the case. In Experiment 2, this assumption was directly tested by priming relevant pathophysiological knowledge for either a short or a longer period, before enabling subjects to study the case briefly. Free-recall data confirmed and extended the results of Experiment 1. Again, an intermediate effect was found; this time, however, it was generated experimentally. The findings were interpreted in terms of qualitative differences in the nature of the knowledge structures underlying performance between novices, advanced students, and medical experts: Experts use knowledge in an encapsulated mode while comprehending a case, whereas students use elaborated knowledge.     

线索提示对放射医学决策的影响：来自眼动的证据

为了探讨知识经验与他人的影响在放射科医生做决策时哪一因素的作用更大,本研究采用SMI250眼动记录仪,记录专家和新手放射科医生检测胸部X光片的眼睛注视过程。结果发现：（1）专家和新手在无线索提示下的漏报率多于有线索提示,专家在有无线索提示下的漏报率的差值小于新手。（2）专家在有线索提示下的隐蔽位置小结节的漏报率低于无线索提示,新手在有线索提示下的所有类型结节的漏报率均低于无线索提示。（3）专家和新手在有线索提示下的敏感性高于无线索提示。（4）有线索提示下,专家与新手的注视次数和总注视时间增多。这表明放射科医生做决策时,其知识经验与他人的影响共同起作用。他人影响对新手来说作用更大。