The sensitivity of judgment-of-learning resolution to past test performance,new learning,and forgetting

When people judge their learning of items across study–test trials, their accuracy in discriminating between learned and unlearned items improves on the second trial. We examined the source of this improvement by estimating the contribution of three factors—memory for past test performance (MPT), new learning, and forgetting—to accuracy on trial 2. In Experiment 1, during an initial trial, participants studied paired associates, made a judgment of learning (JOL) for each one, and were tested. During the second trial, we manipulated two variables: when the JOL was made (either immediately before or after studying an item) and whether participants were told the outcome of the initial recall attempt on trial 1. In Experiment 2, the same procedure was used with a 1-week retention interval between study and test on trial 2. In both experiments, JOL resolution was higher on trial 2 than on trial 1. Fine-grained analyses of JOL magnitude and decomposition of resolution supported several conclusions. First, MPT contributed the most to boosts in JOL magnitude and improvements in resolution across trials. Second, JOLs and subsequent resolution were sensitive to new learning and forgetting, but only when participants’ judgments were made after study. Thus, JOLs appear to integrate information from multiple factors, and these factors jointly contribute to JOL resolution.     

Framing effects on metacognitive monitoring and control

Three experiments explored the contribution of framing effects on metamemory judgments. In Experiment 1, participants studied word pairs. After each presentation, they made an immediate judgment of learning (JOL), framed in terms of either remembering or forgetting. In the remember frame, participants made judgments about how likely it was that they would remember each pair on the upcoming test. In the forget frame, participants made judgments about how likely it was that they would forget each pair. Confidence differed as a result of the frame. Forget frame JOLs, equated to the remember frame JOL scale by a 1-judgment conversion, were lower and demonstrated a smaller overconfidence bias than did remember frame JOLs. When judgments were made at a delay, framing effects did not occur. In Experiment 2, people chose to restudy more items when choices were made within a forget frame. In Experiment 3, people studied Spanish—English vocabulary pairs ranging in difficulty. The framing effect was replicated with judgments and choices. Moreover, forget frame participants included more easy and medium items to restudy. These results demonstrated the important consequences of framing effects on assessment and control of study.     

Influence of cue word perceptual information on metamemory accuracy in judgement of learning

Previous studies have suggested that perceptual information regarding to-be-remembered words in the study phase affects the accuracy of judgement of learning (JOL). However, few have investigated whether the perceptual information in the JOL phase influences JOL accuracy. This study examined the influence of cue word perceptual information in the JOL phase on immediate and delayed JOL accuracy through changes in cue word font size. In Experiment 1, large-cue word pairs had significantly higher mean JOL magnitude than small-cue word pairs in immediate JOLs and higher relative accuracy than small-cue pairs in delayed JOLs, but font size had no influence on recall performance. Experiment 2 increased the JOL time, and mean JOL magnitude did not reliably differ for large-cue compared with small-cue pairs in immediate JOLs. However, the influence on relative accuracy still existed in delayed JOLs. Experiment 3 increased the familiarity of small-cue words in the delayed JOL phase by adding a lexical decision task. The results indicated that cue word font size no longer affected relative accuracy in delayed JOLs. The three experiments in our study indicated that the perceptual information regarding cue words in the JOL phase affects immediate and delayed JOLs in different ways.     

小学高年级学生的学习判断绝对准确性及预见偏差

本研究以小学高年级学生为被试,选取高熟悉度的具体名词组成的联结词对为实验材料,考察不同判断模式下学习判断的准确性及预见偏差。研究发现:(1)小学高年级学生的学习判断绝对准确性存在年级差异。总体来看,小学六年级学生在即时判断和延迟判断模式下都具有较好的绝对准确性,而四年级和五年级学生在即时判断时出现显著的高估,而在延迟判断模式下具有较好的绝对准确性。具体分析正向词对和反向词对的准确性发现,在即时判断模式下,五、六年级学生的正向联结词对有较好的准确性,而四年级的正向联结词对出现高估;三个年级的学生的反向词对都出现高估。在延迟判断模式下,三个年级学生在正向词对和反向词对上都有较好的准确性。(2)小学五年级学生的学习判断开始出现预见偏差。(3)延迟判断能够提高小学高年级学生的学习判断准确性,减小甚至消除预见偏差。     

Congruity influences memory and judgments of learning during survival processing

A recent line of research has suggested that memory systems evolved to encode fitness-relevant information more effectively than other types of information—a phenomenon known as the “survival processing effect” (Nairne, Thompson, & Pandeirada Journal of Experimental Psychology: Learning, Memory, and Cognition 33:263–273, 2007). However, the basis for the effect has been debated. In addition, it is unknown whether or not individuals will adjust their judgments of learning (JOLs) to reflect the survival processing effect. In three experiments, participants rated 16 words for their relevance to a survival scenario and another 16 words for their relevance to a bank robbery scenario. In Experiment 1A (with no JOLs), the survival processing effect emerged; in Experiment 1B (with JOLs), no survival processing effect emerged, but JOLs were higher in the survival condition. In both cases, these findings were confounded by higher relevance ratings in the survival condition. In Experiment 2, relevance was manipulated within each list, and the survival processing effect was eliminated. Instead, both recall and JOL magnitude were related to level of congruity between the words and type of processing. Together, these results provide further evidence for the role of congruity in the survival processing effect and JOLs.     

Monitoring memory errors: the influence of the veracity of retrieved information on the accuracy of judgements of learning

The current study examined the degree to which predictions of memory performance made immediately or at a delay are sensitive to confidently held memory illusions. Participants studied unrelated pairs of words and made judgements of learning (JOLs) for each item, either immediately or after a delay. Half of the unrelated pairs (deceptive items; e.g., nurse-dollar) had a semantically related competitor (e.g., doctor) that was easily accessible when given a test cue (e.g., nurse-do_ _ _r) and half had no semantically related competitor (control items; e.g., subject-dollar). Following the study phase, participants were administered a cued recall test. Results from Experiment 1 showed that memory performance was less accurate for deceptive compared with control items. In addition, delaying judgement improved the relative accuracy of JOLs for control items but not for deceptive items. Subsequent experiments explored the degree to which the relative accuracy of delayed JOLs for deceptive items improved as a result of a warning to ensure that retrieved memories were accurate (Experiment 2) and corrective feedback regarding the veracity of information retrieved prior to making a JOL (Experiment 3). In all, these data suggest that delayed JOLs may be largely insensitive to memory errors unless participants are provided with feedback regarding memory accuracy.     

情绪确定性对学习判断的影响

为了揭示情绪的确定性维度对学习判断的影响,本研究通过使用即时学习判断范式的两个实验,分别探讨了高确定性情绪(愤怒、快乐)和低确定性情绪(恐惧、惊喜)的被试在学习判断中的表现。结果显示:(1)愤怒组和快乐组花费在项目学习上的时间显著少于恐惧组和惊喜组;(2)愤怒组的学习判断值显著高于恐惧组;(3)愤怒组的学习判断准确性显著低于恐惧组。从而证明了情绪的确定性维度与学习判断之间的因果关系。     

Memory and metamemory for inverted words: illusions of competency and desirable difficulties

Research regarding how people monitor their learning has shown that ease of processing strongly guides people’s judgments of learning (JOLs). However, the desirable difficulties concept (Bjork, 1994) suggests that studying information that is less fluent can result in greater learning. Currently, it is unclear whether people are aware of the potential benefits of desirable difficulties during learning. To address this, in Experiment 1, participants studied inverted and upright words and also made JOLs. While participants’ JOLs did not differ for inverted and upright words, recall was greater for inverted words. Experiment 2 used several study–test cycles in which participants could potentially learn about the beneficial effects of processing inverted words with task experience, and similar results were obtained. Thus, reading inverted words requires processing that enhances recall, but memory predictions do not differentiate between upright and inverted words. We interpret these results in terms of processing fluency, desirable difficulties, and theories of metacognitive monitoring.     

The effects of categorical relatedness on judgements of learning (JOLs)

On-line monitoring during study can be influenced by the relatedness shared between the cue and target of a paired associate. We examined the effects on people's judgements of learning (JOLs) of a different kind of relatedness, which occurs in a list organised into sets of categorically related words and unrelated words. In two experiments, participants studied a list of words organised into a series of sets of four categorically related words or four unrelated words. In Experiment 1, JOLs were made immediately after each word had been studied, and JOL magnitude was greater for related than unrelated words. In Experiment 2, JOLs were delayed after study and, as expected, they were substantially greater for related sets of words. Serial position effects (an increase in JOL magnitude across the words of a related set) were evident with immediate JOLs but not with delayed JOLs. The relatedness effect was not present early in the list for immediate JOLs but was present throughout the list for delayed JOLs. We conclude by discussing some preliminary explanations for these new phenomena.     

Illusions of competence and overestimation of associative memory for identical items: Evidence from judgments of learning

The relation between subjects’ predicted and actual memory performance is a central issue in the domain of metacognition. In the present study, we examined the influence of item similarity and associative strength on judgments of learning (JOLs) in a cued recall task. We hypothesized that encoding fluency would cause a foresight bias, so that subjects would overestimate recall of identical pairs (scale-scale), as compared with strong associates (weight-scale) or unrelated pairs (mask-scale). In Experiment 1, JOLs for identical word pairs were higher than those for related and unrelated pairs, but later recall of identical pairs was lower than recall of related pairs. In Experiment 2, the effect of encoding fluency (inferred from self-paced study time) was examined, and a similar pattern of results was obtained, with subjects spending the least amount of time studying identical pairs. We conclude that overconfidence for identical pairs reflects an assessment of item similarity when JOLs are made, despite associative strength being a better predictor of later retrieval.     

The effects of categorical relatedness on judgements of learning (JOLs)

On-line monitoring during study can be influenced by the relatedness shared between the cue and target of a paired associate. We examined the effects on people's judgements of learning (JOLs) of a different kind of relatedness, which occurs in a list organised into sets of categorically related words and unrelated words. In two experiments, participants studied a list of words organised into a series of sets of four categorically related words or four unrelated words. In Experiment 1, JOLs were made immediately after each word had been studied, and JOL magnitude was greater for related than unrelated words. In Experiment 2, JOLs were delayed after study and, as expected, they were substantially greater for related sets of words. Serial position effects (an increase in JOL magnitude across the words of a related set) were evident with immediate JOLs but not with delayed JOLs. The relatedness effect was not present early in the list for immediate JOLs but was present throughout the list for delayed JOLs. We conclude by discussing some preliminary explanations for these new phenomena.     

Monitoring memory errors: The influence of the veracity of retrieved information on the accuracy of judgements of learning

The current study examined the degree to which predictions of memory performance made immediately or at a delay are sensitive to confidently held memory illusions. Participants studied unrelated pairs of words and made judgements of learning (JOLs) for each item, either immediately or after a delay. Half of the unrelated pairs (deceptive items; e.g., nurse–dollar) had a semantically related competitor (e.g., doctor) that was easily accessible when given a test cue (e.g., nurse–do_ _ _r) and half had no semantically related competitor (control items; e.g., subject–dollar). Following the study phase, participants were administered a cued recall test. Results from Experiment 1 showed that memory performance was less accurate for deceptive compared with control items. In addition, delaying judgement improved the relative accuracy of JOLs for control items but not for deceptive items. Subsequent experiments explored the degree to which the relative accuracy of delayed JOLs for deceptive items improved as a result of a warning to ensure that retrieved memories were accurate (Experiment 2) and corrective feedback regarding the veracity of information retrieved prior to making a JOL (Experiment 3). In all, these data suggest that delayed JOLs may be largely insensitive to memory errors unless participants are provided with feedback regarding memory accuracy.     

Poor Little Ritz Boy David “Does” Hawaii or: Lucky Davy Salutes Lucky Lindy

In this article, David Bittner explodes the myth, restated in Brideshead Revisited (1945), that Polynesians are “happy and harmless.” He does so for the same reason that Evelyn Waugh does: “the grim invasion of trader, administrator, missionary, and tourist” has changed all that (p. 174). Touring Hawaii in July of ’09, Bittner was interested to discover some unusual bits of American heritage, but saddened to see how “civilization” and “Americanization” actually seem to have eroded the Hawaiian people’s rights to life, liberty, and the pursuit of happiness. Bittner’s dual religious heritage—Judaism by birth and upbringing and Catholicism by choice in mid-life—has given him the perspective to apply the lessons of Hawaiian history to his own personal issues, particularly forgiveness.     

加工流畅性和提取流畅性与学习不良儿童学习判断的关系

流畅性是个体做学习判断（Judgements of Learning, JOLs）时的重要线索,主要包括加工流畅性和提取流畅性。实验采用联想字对作为实验材料,把做JOLs的时间分为即刻JOLs (Immediate:I)（学习完一个项目立即判断）,短时延迟JOLs（Delay condition: D1）和长时延迟JOLs（D2）,考察不同JOLs时间条件下,流畅性线索对学习不良儿童和一般儿童的JOLs的不同预测模式。被试为普通小学五年级学习不良和一般儿童各20名,结果发现,一般儿童在I条件下主要利用加工流畅性,在D条件下主要利用提取流畅性做JOLs,而学习不良儿童无论在I还是D条件下均主要利用提取流畅性线索做JOLs。加工流畅性在I条件下效度较高,提取流畅性在D条件下效度较高     

Do memorability ratings affect study-time allocation?

This research addresses the relation between predicting future memory performance (judgment of learning, or JOL) and subsequent self-paced study-time allocation. The results of three experiments support the main hypotheses: (1) recall increases with increasing JOL, (2) restudy increases JOL accuracy, and (3) study time is related to JOL. This last relation depends on the length of initial presentation time of the items. When the initial exposure trials were short, the most restudy time was allocated to the items judged hard to recall, but when the initial exposure times were long, the most restudy time was allocated to the uncertain items. Items studied longer were recalled equally well (Experiments 1 and 3) or to a lesser extent (Experiment 2) than items studied for a shorter time. It is hypothesized that during study time, subjects refine their JOLs for the items initially less well discriminated.     

Study for now,but judge for later: Delayed judgments of learning promote long‐term retention

Larsson Sundqvist, M., Todorov, I., Kubik, V. & Jönsson, F.U. (2012) Study for now, but judge for later: Delayed judgments of learning promote long‐term retention. Scandinavian Journal of Psychology 53, 450–454. Delayed judgments of learning (JOL) are assumed to be based on covert retrieval attempts. A common finding is that testing memory during learning improves later retention (i.e., the testing effect), and even more so than an equivalent amount of study, but only after a longer retention interval. To test the assertion that also delayed JOLs improve memory, the participants either studied Swahili‐Swedish word pairs four times, or they both studied (two times) and performed delayed JOLs (two times) alternately. Final cued recall test were given after either five minutes or one week. Results showed a reliable learning‐group by retention‐interval interaction, with less forgetting in the group that alternated between studying and making JOLs. The results are discussed in relation to the self‐fulfilling prophecy account of Spellman and Bjork (1992) , and in terms of study advice, the results further underscore the importance of delaying JOLs when studying and evaluating one’s ongoing learning.     

学习和测验经验对学习判断中UWP效应的影响

针对重复学习判断中出现的练习伴随低估效应（UWP效应）,目前存在多种理论解释。本研究基于过去测验记忆假说,在学习阶段和测验阶段引入两种判断：学习判断准确性的判断和回溯性信心判断,通过两个实验考察学习经验和测验经验对UWP效应的影响。结果发现：在学习判断中学习判断准确性的判断和回溯性信心判断均消除了UWP效应,间接证明了学习和测验经验均影响到UWP效应的出现。     

Aging,Encoding Fluency,and Metacognitive Monitoring

ABSTRACT

Encoding fluency (how rapidly one generates a mediator for a new association) may be a cue used to judge one's own learning. To evaluate age differences in utilization of this cue, older and younger adults were instructed to use interactive imagery to study paired associates, pressing a button to indicate when an image had been formed for a given pair. A judgment of learning (JOL) was also made immediately after each pair had been studied. Hence, at least two cues pertaining to encoding fluency—whether an image had been formed (a diagnostic cue) and the latency of formation (a nondiagnostic one)—were available when making JOLs. Age equivalence was found in JOL accuracy, and JOLs for both age groups were positively related to imagery formation and were negatively related to the latency of image formation. Moreover, subjectively judged latency correlated higher with JOLs than actual (objective) latency, supporting the hypothesis that perceived fluency is a cue used in constructing JOLs.     

Timing accuracy of Web experiments: A case study using the WebExp software package

Although Internet-based experiments are gaining in popularity, most studies rely on directly evaluating participants’ responses rather than response times. In the present article, we present two experiments that demonstrate the feasibility of collecting response latency data over the World-Wide Web using WebExp—a software package designed to run psychological experiments over the Internet. Experiment 1 uses WebExp to collect measurements for known time intervals (generated using keyboard repetition). The resulting measurements are found to be accurate across platforms and load conditions. In Experiment 2, we use WebExp to replicate a lab-based self-paced reading study from the psycholinguistic literature. The data of the Web-based replication correlate significantly with those of the original study and show the same main effects and interactions. We conclude that WebExp can be used to obtain reliable response time data, at least for the self-paced reading paradigm.     

Chimpanzees’ use of conspecific cues in matching-to-sample tasks: public information use in a fully automated testing environment

Social animals have much to gain from observing and responding appropriately to the actions of their conspecific group members. This can in turn lead to the learning of novel behavior patterns (social learning) or to foraging, ranging, or social behavioral choices copied from fellow group members, which do not necessarily result in long-term learning, but at the time represent adaptive responses to environmental cues (public information use). In the current study, we developed a novel system for the study of public information use under fully automated conditions. We modified a classic single-subject laboratory paradigm—matching-to-sample (MTS)—and examined chimpanzees’ ability to interpret and utilize cues provided by the behavior of a conspecific to solve the task. In Experiment 1, two subjects took turns on an identity MTS task, with one subject (the model) performing the first half of the trial and the other subject (the observer) completing the trial using the model’s actions as discriminative cues. Both subjects performed above chance from the first session onwards. In Experiment 2, the subjects were tested on a symbolic version of the same MTS task, with one subject showing spontaneous transfer. Our study establishes a novel method for examining public information use within a highly controlled and automated setting.