The effects of categorical relatedness on judgements of learning (JOLs)

On-line monitoring during study can be influenced by the relatedness shared between the cue and target of a paired associate. We examined the effects on people's judgements of learning (JOLs) of a different kind of relatedness, which occurs in a list organised into sets of categorically related words and unrelated words. In two experiments, participants studied a list of words organised into a series of sets of four categorically related words or four unrelated words. In Experiment 1, JOLs were made immediately after each word had been studied, and JOL magnitude was greater for related than unrelated words. In Experiment 2, JOLs were delayed after study and, as expected, they were substantially greater for related sets of words. Serial position effects (an increase in JOL magnitude across the words of a related set) were evident with immediate JOLs but not with delayed JOLs. The relatedness effect was not present early in the list for immediate JOLs but was present throughout the list for delayed JOLs. We conclude by discussing some preliminary explanations for these new phenomena.     

Influence of cue word perceptual information on metamemory accuracy in judgement of learning

Previous studies have suggested that perceptual information regarding to-be-remembered words in the study phase affects the accuracy of judgement of learning (JOL). However, few have investigated whether the perceptual information in the JOL phase influences JOL accuracy. This study examined the influence of cue word perceptual information in the JOL phase on immediate and delayed JOL accuracy through changes in cue word font size. In Experiment 1, large-cue word pairs had significantly higher mean JOL magnitude than small-cue word pairs in immediate JOLs and higher relative accuracy than small-cue pairs in delayed JOLs, but font size had no influence on recall performance. Experiment 2 increased the JOL time, and mean JOL magnitude did not reliably differ for large-cue compared with small-cue pairs in immediate JOLs. However, the influence on relative accuracy still existed in delayed JOLs. Experiment 3 increased the familiarity of small-cue words in the delayed JOL phase by adding a lexical decision task. The results indicated that cue word font size no longer affected relative accuracy in delayed JOLs. The three experiments in our study indicated that the perceptual information regarding cue words in the JOL phase affects immediate and delayed JOLs in different ways.     

When people’s judgments of learning (JOLs) are extremely accurate at predicting subsequent recall: the “Displaced-JOL effect”

Judgments of learning (JOL) made after a delay more accurately predict subsequent recall than JOLs made immediately after learning. One explanation is that delayed JOLs involve retrieving information about the target item from secondary memory, whereas immediate JOLs involve retrieval from primary memory. One view of working memory claims that information in primary memory is displaced to secondary memory when attention is shifted to a secondary task. Thus, immediate JOLs might be as accurate as delayed JOLs if an intervening task displaces the target item from primary memory, requiring retrieval from secondary memory, prior to making the JOL. In four experiments, participants saw related word-pairs and made JOLs predicting later recall of the item. In Experiment 1, delayed JOLs were more accurate than JOLs made shortly after learning, regardless of whether a secondary task intervened between learning and JOL. In Experiments 2–4, the secondary task demands increased and JOLs made shortly after learning with an intervening task were just as accurate as delayed JOLs, and both were more accurate than immediate JOLs with no intervening task (Experiment 4). These results are consistent with a retrieval-based account of JOLs, and demonstrate that the “delayed-JOL effect” can be obtained without a long delay.     

Monitoring memory errors: the influence of the veracity of retrieved information on the accuracy of judgements of learning

The current study examined the degree to which predictions of memory performance made immediately or at a delay are sensitive to confidently held memory illusions. Participants studied unrelated pairs of words and made judgements of learning (JOLs) for each item, either immediately or after a delay. Half of the unrelated pairs (deceptive items; e.g., nurse-dollar) had a semantically related competitor (e.g., doctor) that was easily accessible when given a test cue (e.g., nurse-do_ _ _r) and half had no semantically related competitor (control items; e.g., subject-dollar). Following the study phase, participants were administered a cued recall test. Results from Experiment 1 showed that memory performance was less accurate for deceptive compared with control items. In addition, delaying judgement improved the relative accuracy of JOLs for control items but not for deceptive items. Subsequent experiments explored the degree to which the relative accuracy of delayed JOLs for deceptive items improved as a result of a warning to ensure that retrieved memories were accurate (Experiment 2) and corrective feedback regarding the veracity of information retrieved prior to making a JOL (Experiment 3). In all, these data suggest that delayed JOLs may be largely insensitive to memory errors unless participants are provided with feedback regarding memory accuracy.     

Learning style,judgements of learning,and learning of verbal and visual information

The concept of learning style is immensely popular despite the lack of evidence showing that learning style influences performance. This study tested the hypothesis that the popularity of learning style is maintained because it is associated with subjective aspects of learning, such as judgements of learning (JOLs). Preference for verbal and visual information was assessed using the revised Verbalizer‐Visualizer Questionnaire (VVQ). Then, participants studied a list of word pairs and a list of picture pairs, making JOLs (immediate, delayed, and global) while studying each list. Learning was tested by cued recall. The results showed that higher VVQ verbalizer scores were associated with higher immediate JOLs for words, and higher VVQ visualizer scores were associated with higher immediate JOLs for pictures. There was no association between VVQ scores and recall or JOL accuracy. As predicted, learning style was associated with subjective aspects of learning but not objective aspects of learning.     

Monitoring memory errors: The influence of the veracity of retrieved information on the accuracy of judgements of learning

The current study examined the degree to which predictions of memory performance made immediately or at a delay are sensitive to confidently held memory illusions. Participants studied unrelated pairs of words and made judgements of learning (JOLs) for each item, either immediately or after a delay. Half of the unrelated pairs (deceptive items; e.g., nurse–dollar) had a semantically related competitor (e.g., doctor) that was easily accessible when given a test cue (e.g., nurse–do_ _ _r) and half had no semantically related competitor (control items; e.g., subject–dollar). Following the study phase, participants were administered a cued recall test. Results from Experiment 1 showed that memory performance was less accurate for deceptive compared with control items. In addition, delaying judgement improved the relative accuracy of JOLs for control items but not for deceptive items. Subsequent experiments explored the degree to which the relative accuracy of delayed JOLs for deceptive items improved as a result of a warning to ensure that retrieved memories were accurate (Experiment 2) and corrective feedback regarding the veracity of information retrieved prior to making a JOL (Experiment 3). In all, these data suggest that delayed JOLs may be largely insensitive to memory errors unless participants are provided with feedback regarding memory accuracy.     

An investigation of students' knowledge of the delayed judgements of learning effect

Judgements of learning (JOL) of paired associates can be made immediately after learning or after a delay, while viewing the first word (cue) only or both words (cue–target) in a pair. Delayed cue-only judgements are more related to subsequent memory performance than delayed cue–target, immediate cue-only, or immediate cue–target judgements. In two experiments we tested students' knowledge of this delayed JOL effect and whether their knowledge increases as a function of task experience (Experiment 2). The majority of the participants did not choose the more effective judgement strategy and they did not systematically alter their behaviour as a function of task experience. Instead, a subset of the participants selected judgement strategies on the basis of a learning goal, that is, a strategy that let them restudy both words in a pair. In sum, most students appear to be unaware of the powerful influence of delayed cue-only JOLs on monitoring accuracy.     

Congruity influences memory and judgments of learning during survival processing

A recent line of research has suggested that memory systems evolved to encode fitness-relevant information more effectively than other types of information—a phenomenon known as the “survival processing effect” (Nairne, Thompson, & Pandeirada Journal of Experimental Psychology: Learning, Memory, and Cognition 33:263–273, 2007). However, the basis for the effect has been debated. In addition, it is unknown whether or not individuals will adjust their judgments of learning (JOLs) to reflect the survival processing effect. In three experiments, participants rated 16 words for their relevance to a survival scenario and another 16 words for their relevance to a bank robbery scenario. In Experiment 1A (with no JOLs), the survival processing effect emerged; in Experiment 1B (with JOLs), no survival processing effect emerged, but JOLs were higher in the survival condition. In both cases, these findings were confounded by higher relevance ratings in the survival condition. In Experiment 2, relevance was manipulated within each list, and the survival processing effect was eliminated. Instead, both recall and JOL magnitude were related to level of congruity between the words and type of processing. Together, these results provide further evidence for the role of congruity in the survival processing effect and JOLs.     

小学高年级学生的学习判断绝对准确性及预见偏差

本研究以小学高年级学生为被试,选取高熟悉度的具体名词组成的联结词对为实验材料,考察不同判断模式下学习判断的准确性及预见偏差。研究发现:(1)小学高年级学生的学习判断绝对准确性存在年级差异。总体来看,小学六年级学生在即时判断和延迟判断模式下都具有较好的绝对准确性,而四年级和五年级学生在即时判断时出现显著的高估,而在延迟判断模式下具有较好的绝对准确性。具体分析正向词对和反向词对的准确性发现,在即时判断模式下,五、六年级学生的正向联结词对有较好的准确性,而四年级的正向联结词对出现高估;三个年级的学生的反向词对都出现高估。在延迟判断模式下,三个年级学生在正向词对和反向词对上都有较好的准确性。(2)小学五年级学生的学习判断开始出现预见偏差。(3)延迟判断能够提高小学高年级学生的学习判断准确性,减小甚至消除预见偏差。     

Evidence that judgments of learning are causally related to study choice

Three experiments investigated whether study choice was directly related to judgments of learning (JOLs) by examining people’s choices in cases in which JOLs were dissociated from recall. In Experiment 1, items were given either three repetitions or one repetition on Trial 1. Items given three repetitions received one on Trial 2, and those given one repetition received three on Trial 2—equating performance at the end of Trial 2, but yielding different immediate Trial 2 JOLs. Study choice followed the “illusory” JOLs. A delayed JOL condition in Experiment 2 did not show this JOL bias and neither did study choice. Finally, using a paradigm (Koriat & Bjork, 2005) in which similar JOLs are given to forward and backward associative pairs, despite much worse performance on the backward pairs, study choice again followed the mistaken JOLs. We concluded that JOLs—what people believe they know—directly influence people’s study choices.     

Contributions of beliefs and processing fluency to the effect of relatedness on judgments of learning

Discovering how people judge their memories has been a major issue for metacognitive research for over 4 decades; many factors have been discovered that affect people’s judgments, but exactly how those effects are mediated is poorly understood. For instance, the effect of word pair relatedness on judgments of learning (JOLs) has been repeatedly demonstrated, yet the underlying basis of this substantial effect is currently unknown. Thus, in three experiments, we assessed the contribution of beliefs and processing fluency. In Experiment 1, participants studied related and unrelated word pairs and made either prestudy JOLs or immediate JOLs. Participants gave higher estimates for related than for unrelated pairs, suggesting that participants’ beliefs at least partially drive the relatedness effect on JOLs. Next, we evaluated the contribution of processing fluency to the relatedness effect either (1) by disrupting fluency by presenting half the pairs in an aLtErNaTiNg format (Experiment 2) or (2) by measuring how fluently participants processed pairs at study and statistically estimating the degree to which conceptual fluency mediated the effects of relatedness on JOLs (Experiment 3). Results from both experiments indicated that fluency contributes minimally to the relatedness effect. Taken together, these results indicate that people’s beliefs about how relatedness influences memory are responsible for mediating the relationship between relatedness and JOLs. In general, empirically establishing what mediates the effects of other factors on people’s judgments remains a major agenda for advancing theory of metacognitive monitoring.     

A model for stochastic drift in memory strength to account for judgments of learning

Previous research has shown that judgments of learning (JOLs) made immediately after encoding have a low correlation with actual cued-recall performance, whereas the correlation is high for delayed judgments. In this article, the authors propose a formal theory describing the stochastic drift of memory strength over the retention interval to account for the delayed-JOL effect. This is done by first decomposing the aggregated memory strength into exponential functions with slow and fast memory traces. The mean aggregated memory strength shows power-function forgetting curves. The drift of the memory strength is large for immediate JOLs (causing a low predictability) and weak for delayed JOLs (causing a high predictability). Consistent with empirical data, the model makes a novel prediction of JOL asymmetry, or that immediate weak JOLs are more predictive of future performance than are immediate strong JOLs. The JOL distributions for immediate and delayed JOLs are also accounted for.     

Processing similarity does not improve metamemory: evidence against transfer-appropriate monitoring

The transfer-appropriate monitoring (TAM) hypothesis of metamemory predicts that judgment of learning (JOL) accuracy should improve when conditions during JOLs closely match conditions of the memory test. The authors devised 5 types of delayed JOLs for paired associates and varied them along with the type of memory test (cued recall or recognition). If the TAM hypothesis is correct, JOL and test type should interact to influence metamemory. Contrary to TAM, metamemory accuracy did not improve when JOL and test conditions matched but instead tended to vary according to whether the answer was apparent at time of JOL. Memory test scores and JOL magnitude were both greater when the correct target was evident during JOLs. Overall, the results are largely consistent with a monitoring retrieval view of delayed JOLs and do not support TAM as a viable account of JOL accuracy.     

The influence of delaying judgments of learning on metacognitive accuracy: a meta-analytic review

Many studies have examined the accuracy of predictions of future memory performance solicited through judgments of learning (JOLs). Among the most robust findings in this literature is that delaying predictions serves to substantially increase the relative accuracy of JOLs compared with soliciting JOLs immediately after study, a finding termed the delayed JOL effect. The meta-analyses reported in the current study examined the predominant theoretical accounts as well as potential moderators of the delayed JOL effect. The first meta-analysis examined the relative accuracy of delayed compared with immediate JOLs across 4,554 participants (112 effect sizes) through gamma correlations between JOLs and memory accuracy. Those data showed that delaying JOLs leads to robust benefits to relative accuracy (g = 0.93). The second meta-analysis examined memory performance for delayed compared with immediate JOLs across 3,807 participants (98 effect sizes). Those data showed that delayed JOLs result in a modest but reliable benefit for memory performance relative to immediate JOLs (g = 0.08). Findings from these meta-analyses are well accommodated by theories suggesting that delayed JOL accuracy reflects access to more diagnostic information from long-term memory rather than being a by-product of a retrieval opportunity. However, these data also suggest that theories proposing that the delayed JOL effect results from a memorial benefit or the match between the cues available for JOLs and those available at test may also provide viable explanatory mechanisms necessary for a comprehensive account.     

Semantic priming effects for stimuli presented to the right and left visual fields

Studies that have addressed the possibility of hemispheric differences in semantic priming effects have yielded contradictory results. This paper reports the findings of two experiments intended to shed greater light on the issue of hemispheric differences in semantic priming. Experiment 1 used a hemiretinal paradigm and examined manual response latency and response accuracy to four types of word pairs; categorically related, syntactically related, unrelated, and pairs containing a nonword member. Experiment 2 examined the effects of unrecognized, disambiguating flank words on verbal responses to a centrally presented homograph. Experiment 1 yielded no significant visual field differences in magnitude of priming effects when response latency served as the dependent measure, although categorical relatedness facilitated response accuracy for left but not right visual field stimuli. In experiment 2, the disambiguating words had a significant effect on meaning interpretation of the homographs that was independent of visual field of presentation. Taken together, the results of these studies are interpreted as indicating that semantic aspects of linguistic input are automatically processed and can influence the content and latency of subsequent responses, whether presented to the left or right visual field.     

The sensitivity of judgment-of-learning resolution to past test performance,new learning,and forgetting

When people judge their learning of items across study–test trials, their accuracy in discriminating between learned and unlearned items improves on the second trial. We examined the source of this improvement by estimating the contribution of three factors—memory for past test performance (MPT), new learning, and forgetting—to accuracy on trial 2. In Experiment 1, during an initial trial, participants studied paired associates, made a judgment of learning (JOL) for each one, and were tested. During the second trial, we manipulated two variables: when the JOL was made (either immediately before or after studying an item) and whether participants were told the outcome of the initial recall attempt on trial 1. In Experiment 2, the same procedure was used with a 1-week retention interval between study and test on trial 2. In both experiments, JOL resolution was higher on trial 2 than on trial 1. Fine-grained analyses of JOL magnitude and decomposition of resolution supported several conclusions. First, MPT contributed the most to boosts in JOL magnitude and improvements in resolution across trials. Second, JOLs and subsequent resolution were sensitive to new learning and forgetting, but only when participants’ judgments were made after study. Thus, JOLs appear to integrate information from multiple factors, and these factors jointly contribute to JOL resolution.     

A fuzzy trace analysis of categorical inferences and instantial associations as a function of retention interval

Two experiments on children's inferences and associative memory provided a test of predictions from fuzzy-trace theory. Specifically, it was expected that gist-based false recognitions would increase with age and that false recognitions would be uncorrelated with verbatim memory. In Experiment 1, children in Grades 1 through 5 heard lists of category labels, clustered instances from categories, and individual instances. On an immediate test, children indicated whether or not they had previously heard a series of individually presented test words. This list consisted of old words, new words, or words that were categorically or semantically related to the studied word clusters. Children made more false recognition errors for instances than for categories. Verbatim memory and inferences were unrelated. In Experiment 2, the effect of a test delay on categorical inferences and associated instances was examined with children in Grades 1 to 6. With delay, false recognition of associated instances declined for children at all grade levels. In contrast, categorical inferences increased with delay for older children. Verbatim memory and inferences were uncorrelated under immediate and 1-day delay conditions, but there were some low but significant correlations across grades under the 7-day delay. The results of the two experiments are interpreted as supporting fuzzy-trace theory.     

情绪确定性对学习判断的影响

为了揭示情绪的确定性维度对学习判断的影响,本研究通过使用即时学习判断范式的两个实验,分别探讨了高确定性情绪(愤怒、快乐)和低确定性情绪(恐惧、惊喜)的被试在学习判断中的表现。结果显示:(1)愤怒组和快乐组花费在项目学习上的时间显著少于恐惧组和惊喜组;(2)愤怒组的学习判断值显著高于恐惧组;(3)愤怒组的学习判断准确性显著低于恐惧组。从而证明了情绪的确定性维度与学习判断之间的因果关系。     

Framing effects on metacognitive monitoring and control

Three experiments explored the contribution of framing effects on metamemory judgments. In Experiment 1, participants studied word pairs. After each presentation, they made an immediate judgment of learning (JOL), framed in terms of either remembering or forgetting. In the remember frame, participants made judgments about how likely it was that they would remember each pair on the upcoming test. In the forget frame, participants made judgments about how likely it was that they would forget each pair. Confidence differed as a result of the frame. Forget frame JOLs, equated to the remember frame JOL scale by a 1-judgment conversion, were lower and demonstrated a smaller overconfidence bias than did remember frame JOLs. When judgments were made at a delay, framing effects did not occur. In Experiment 2, people chose to restudy more items when choices were made within a forget frame. In Experiment 3, people studied Spanish—English vocabulary pairs ranging in difficulty. The framing effect was replicated with judgments and choices. Moreover, forget frame participants included more easy and medium items to restudy. These results demonstrated the important consequences of framing effects on assessment and control of study.     

Effects of Problem Solving after Worked Example Study on Primary School Children's Monitoring Accuracy

Research on expository text has shown that the accuracy of students' judgments of learning (JOLs) can be improved by instructional interventions that allow students to test their knowledge of the text. The present study extends this research, investigating whether allowing students to test the knowledge they acquired from studying a worked example by means of solving an identical problem, either immediately or delayed, would enhance JOL accuracy. Fifth grade children (i) gave an immediate JOL, (ii) a delayed JOL, (iii) solved a problem immediately and then gave a JOL, (iv) solved a problem immediately and gave a delayed JOL, or (v) solved a problem at a delay and then gave a JOL. Results show that problem solving after example study improved children's JOL accuracy (i.e., overestimation decreased). However, no differences in the accuracy of restudy indications were found. Results are discussed in relation to cue utilization when making JOLs. Copyright © 2014 John Wiley & Sons, Ltd.