More emotional facial expressions during episodic than during semantic autobiographical retrieval

There is a substantial body of research on the relationship between emotion and autobiographical memory. Using facial analysis software, our study addressed this relationship by investigating basic emotional facial expressions that may be detected during autobiographical recall. Participants were asked to retrieve 3 autobiographical memories, each of which was triggered by one of the following cue words: happy, sad, and city. The autobiographical recall was analyzed by a software for facial analysis that detects and classifies basic emotional expressions. Analyses showed that emotional cues triggered the corresponding basic facial expressions (i.e., happy facial expression for memories cued by happy). Furthermore, we dissociated episodic and semantic retrieval, observing more emotional facial expressions during episodic than during semantic retrieval, regardless of the emotional valence of cues. Our study provides insight into facial expressions that are associated with emotional autobiographical memory. It also highlights an ecological tool to reveal physiological changes that are associated with emotion and memory.     

Estimating the relative weights of visual and auditory tau versus heuristic-based cues for time-to-contact judgments in realistic,familiar scenes by older and younger adults

Estimating time to contact (TTC) involves multiple sensory systems, including vision and audition. Previous findings suggested that the ratio of an object’s instantaneous optical size/sound intensity to its instantaneous rate of change in optical size/sound intensity (τ) drives TTC judgments. Other evidence has shown that heuristic-based cues are used, including final optical size or final sound pressure level. Most previous studies have used decontextualized and unfamiliar stimuli (e.g., geometric shapes on a blank background). Here we evaluated TTC estimates by using a traffic scene with an approaching vehicle to evaluate the weights of visual and auditory TTC cues under more realistic conditions. Younger (18–39 years) and older (65+ years) participants made TTC estimates in three sensory conditions: visual-only, auditory-only, and audio–visual. Stimuli were presented within an immersive virtual-reality environment, and cue weights were calculated for both visual cues (e.g., visual τ, final optical size) and auditory cues (e.g., auditory τ, final sound pressure level). The results demonstrated the use of visual τ as well as heuristic cues in the visual-only condition. TTC estimates in the auditory-only condition, however, were primarily based on an auditory heuristic cue (final sound pressure level), rather than on auditory τ. In the audio–visual condition, the visual cues dominated overall, with the highest weight being assigned to visual τ by younger adults, and a more equal weighting of visual τ and heuristic cues in older adults. Overall, better characterizing the effects of combined sensory inputs, stimulus characteristics, and age on the cues used to estimate TTC will provide important insights into how these factors may affect everyday behavior.     

When and why do retrieval attempts enhance subsequent encoding?

Unsuccessful retrieval attempts can enhance subsequent encoding and learning. In three experiments, subjects either attempted to retrieve word pairs prior to studying them (e.g., attempting to recall tide–? before studying tide–beach) or did not attempt retrieval and retention of the studied targets was assessed on a subsequent cued recall test. Experiment 1 showed that attempting retrieval enhanced subsequent encoding and recall relative to not attempting retrieval when the word pairs were semantically related, but not when the pairs were unrelated. In Experiment 2, studying a different word pair prior to the correct pair (e.g., studying tide–wave prior to tide–beach) did not produce the same effect as attempting retrieval prior to studying. Constraining retrieval to a particular candidate word prior to study (e.g., recalling tide–wa__ before studying tide–beach) produced a negative effect on subsequent recall. Experiment 3 showed that attempting retrieval did not enhance encoding when a brief delay occurred between the retrieval attempt and the subsequent study trial. The results support the idea that a search set of candidates related to the retrieval cue is activated during retrieval and that this retrieval-specific activation can enhance subsequent encoding of those candidates.     

Does the isolation effect require attention?

An item that differs from the surrounding items is remembered better than an item that is consistent with its surroundings; this is known as the von Restorff effect or isolation effect (von Restorff, Psychologische Forschung, 18, 299–342, 1933). Theoretical explanations have proposed that the isolate is processed differently from control items, though some research has suggested that this processing might require more attention for semantic than for physical isolates. To test this possibility, in the present study we examined the isolation effects for physical isolates and semantic isolates under full and divided attention. Participants viewed lists of categorized words, with some lists containing either a physical or a semantic isolate, followed by immediate written free recall. Across three experiments, divided attention eliminated the semantic isolation effect but did not impact the physical isolation effect. Furthermore, semantic isolates were output earlier in recall than controls, whereas physical isolates were output more similarly to controls. These findings suggest that semantic isolation effects require attention during encoding, whereas physical isolation effects are relatively automatic.     

Does test-enhanced learning transfer for triple associates?

Test-enhanced learning and transfer for triple-associate word stimuli was assessed in three experiments. In each experiment, training and final-test trials involved the presentation of two words per triple associate (triplet), with the third word having to be retrieved. In agreement with the prior literature on different stimuli, training through testing with feedback yielded markedly better final-test performance than did restudy. However, in contrast to the positive transfer reported for paired associate stimuli, minimal or no positive transfer was observed, relative to a restudy control, from a trained cue combination (e.g., A, B, ?) to other cue combinations from the same triplet that required a different response (e.g., B, C, ?). That result also held when two unique cue combinations per triplet were tested during training, and for triplets with low and high average associative strengths. Supplementary analyses provided insight into the overall transfer effect: An incorrect response during training appears to yield positive transfer relative to restudy, whereas a correct response appears to yield no, or even negative, transfer. Cross-experiment analyses indicated that test-enhanced learning is not diminished when two or three cue combinations are presented during training. Thus, even though learning through testing is highly specific, testing on all possible stimulus–response combinations remains the most efficient strategy for the learning of triple associates.     

The Multilevel Modality-Switch Effect: What Happens When We See the Bees Buzzing and Hear the Diamonds Glistening

Previous studies demonstrated that the sequential verification of different sensory modality properties for concepts (e.g., BLENDER-loud; BANANA-yellow) brings about a processing cost, known as the modality-switch effect. We report an experiment designed to assess the influence of the mode of presentation (i.e., visual, aural) of stimuli on the modality-switch effect in a property verification and lexical decision priming paradigm. Participants were required to perform a property verification or a lexical decision task on a target sentence (e.g., “a BEE buzzes”, “a DIAMOND glistens”) presented either visually or aurally after having been presented with a prime sentence (e.g., “the LIGHT is flickering”, “the SOUND is echoing”) that could either share both, one or none of the target’s mode of presentation and content modality. Results show that the mode of presentation of stimuli affects the conceptual modality-switch effect. Furthermore, the depth of processing required by the task modulates the complex interplay of perceptual and semantic information. We conclude that the MSE is a task-related, multilevel effect which can occur on two different levels of information processing (i.e., perceptual and semantic).     

Temporal encoding strategies result in boosts to final free recall performance comparable to spatial ones

The method of loci is a highly effective mnemonic that recruits existing salient memory for spatial locations and uses the information as a scaffold for remembering a list of items (Yates, 1966). One possible account for the effectiveness of the spatial method of loci comes from the perspective that it utilizes evolutionarily preserved mechanisms for spatial navigation within the hippocampus (Maguire et al. in Proceedings of the National Academy of Sciences, 97(8), 4398–4403, 2000; O’Keefe & Nadel, 1978; Rodriguez et al. in Brain Research Bulletin, 57(3), 499–503, 2002). Recently, though, neurons representing temporal information have also been described within the hippocampus (Eichenbaum in Nature Reviews Neuroscience, 15(11), 732–744, 2014; Itskov, Curto, Pastalkova, & Buzsáki in The Journal of Neuroscience, 31(8), 2828–2834, 2011; MacDonald, Lepage, Eden, & Eichenbaum in Neuron, 71(4), 737–749, 2011; Mankin et al. in Proceedings of the National Academy of Sciences, 109(47), 19462–19467, 2012; Meck, Church, & Matell in Behavioral Neuroscience, 127(5), 642, 2013), challenging the primacy of spatial-based functions to hippocampal processing. Given the presence of both spatial and temporal coding mechanisms within the hippocampus, we predicted that primarily temporal encoding strategies might also enhance memory. In two different experiments, we asked participants to learn lists of unrelated nouns using the (spatial) method of loci (i.e., the layout of their home as the organizing feature) or using two novel temporal methods (i.e., autobiographical memories or using the steps to making a sandwich). Participants’ final free recall performance showed comparable boosts to the method of loci for both temporal encoding strategies, with all three scaffolding approaches demonstrating performance well above uninstructed free recall. Our findings suggest that primarily temporal representations can be used effectively to boost memory performance, comparable to spatial methods, with some caveats related to the relative ease with which participants appear to master the spatial versus temporal methods.     

The (un)reliability of item-level semantic priming effects

Many researchers have tried to predict semantic priming effects using a myriad of variables (e.g., prime–target associative strength or co-occurrence frequency). The idea is that relatedness varies across prime–target pairs, which should be reflected in the size of the priming effect (e.g., cat should prime dog more than animal does). However, it is only insightful to predict item-level priming effects if they can be measured reliably. Thus, in the present study we examined the split-half and test–retest reliabilities of item-level priming effects under conditions that should discourage the use of strategies. The resulting priming effects proved extremely unreliable, and reanalyses of three published priming datasets revealed similar cases of low reliability. These results imply that previous attempts to predict semantic priming were unlikely to be successful. However, one study with an unusually large sample size yielded more favorable reliability estimates, suggesting that big data, in terms of items and participants, should be the future for semantic priming research.     

Measuring discriminability when there are multiple sources of bias

Performance measures such as log d and d′?aim to measure stimulus discriminability independently of response bias in conditional discrimination tasks, including the yes/no signal-detection procedure. However, they assume only one dimension of bias (e.g., response color) and do not account for bias on additional dimensions (e.g., response side). Such bias reduces log d, thus violating the statistical independence of discriminability and bias measurements. We modified log d to account for side bias and reanalyzed previous side-biased data. With strong side bias, the modified log d differed enough from the standard log d to potentially alter the conclusions of an experiment. Simulations showed that the modified log d produces discriminability estimates that are more accurate and bias-independent than the standard log d calculation.     

An examination of social and psychological influences on academic learning: a focus on self-esteem,social relationships,and personal interest

The present study focused on an examination of both global and domain-specific self-esteems in secondary mathematics learning. The extent to which self-esteem, in general, would account and explain educational success through social relationships with teachers and peers, and personal interest in learning tasks is the main inquiry of this correlational investigation. Two hundred and eighty-three year 10 students (128 girls, 155 boys) were asked to respond to a number of Likert-scale inventories. Causal modeling procedures, aided by the statistical software MPlus 7.3, were used to analyze the data and to test the hypothesized model. A series of a posteriori analyses yielded a modified model for discussion, producing a number of key findings, namely: (a) the differential influences of both global (e.g., →relationship with teachers) and domain-specific (e.g., →relationship with peers) self-esteems, (b) the positive influences of social relation with teachers (e.g., →exam result) and interest in learning tasks (e.g., →end-of-school term grade), and (c) the mediating functioning of relationship with peers and interest in learning tasks. This evidence, overall, provides additional theoretical insights into the operational nature and trajectories of effective learning.     

Just one look: Direct gaze briefly disrupts visual working memory

Direct gaze is a salient social cue that affords rapid detection. A body of research suggests that direct gaze enhances performance on memory tasks (e.g., Hood, Macrae, Cole-Davies, & Dias, Developmental Science, 1, 67–71, 2003). Nonetheless, other studies highlight the disruptive effect direct gaze has on concurrent cognitive processes (e.g., Conty, Gimmig, Belletier, George, & Huguet, Cognition, 115(1), 133–139, 2010). This discrepancy raises questions about the effects direct gaze may have on concurrent memory tasks. We addressed this topic by employing a change detection paradigm, where participants retained information about the color of small sets of agents. Experiment 1 revealed that, despite the irrelevance of the agents’ eye gaze to the memory task at hand, participants were worse at detecting changes when the agents looked directly at them compared to when the agents looked away. Experiment 2 showed that the disruptive effect was relatively short-lived. Prolonged presentation of direct gaze led to recovery from the initial disruption, rather than a sustained disruption on change detection performance. The present study provides the first evidence that direct gaze impairs visual working memory with a rapidly-developing yet short-lived effect even when there is no need to attend to agents’ gaze.     

Linking somatic and symbolic representation in semantic memory: the dynamic multilevel reactivation framework

Biological plausibility is an essential constraint for any viable model of semantic memory. Yet, we have only the most rudimentary understanding of how the human brain conducts abstract symbolic transformations that underlie word and object meaning. Neuroscience has evolved a sophisticated arsenal of techniques for elucidating the architecture of conceptual representation. Nevertheless, theoretical convergence remains elusive. Here we describe several contrastive approaches to the organization of semantic knowledge, and in turn we offer our own perspective on two recurring questions in semantic memory research: (1) to what extent are conceptual representations mediated by sensorimotor knowledge (i.e., to what degree is semantic memory embodied)? (2) How might an embodied semantic system represent abstract concepts such as modularity, symbol, or proposition? To address these questions, we review the merits of sensorimotor (i.e., embodied) and amodal (i.e., disembodied) semantic theories and address the neurobiological constraints underlying each. We conclude that the shortcomings of both perspectives in their extreme forms necessitate a hybrid middle ground. We accordingly propose the Dynamic Multilevel Reactivation Framework—an integrative model predicated upon flexible interplay between sensorimotor and amodal symbolic representations mediated by multiple cortical hubs. We discuss applications of the dynamic multilevel reactivation framework to abstract and concrete concept representation and describe how a multidimensional conceptual topography based on emotion, sensation, and magnitude can successfully frame a semantic space containing meanings for both abstract and concrete words. The consideration of ‘abstract conceptual features’ does not diminish the role of logical and/or executive processing in activating, manipulating and using information stored in conceptual representations. Rather, it proposes that the materials upon which these processes operate necessarily combine pure sensorimotor information and higher-order cognitive dimensions involved in symbolic representation.     

Estimating the average need of semantic knowledge from distributional semantic models

Continuous bag of words (CBOW) and skip-gram are two recently developed models of lexical semantics (Mikolov, Chen, Corrado, & Dean, Advances in Neural Information Processing Systems, 26, 3111–3119, 2013). Each has been demonstrated to perform markedly better at capturing human judgments about semantic relatedness than competing models (e.g., latent semantic analysis; Landauer & Dumais, Psychological Review, 104(2), 1997 211; hyperspace analogue to language; Lund & Burgess, Behavior Research Methods, Instruments, & Computers, 28(2), 203–208, 1996). The new models were largely developed to address practical problems of meaning representation in natural language processing. Consequently, very little attention has been paid to the psychological implications of the performance of these models. We describe the relationship between the learning algorithms employed by these models and Anderson’s rational theory of memory (J. R. Anderson & Milson, Psychological Review, 96(4), 703, 1989) and argue that CBOW is learning word meanings according to Anderson’s concept of needs probability. We also demonstrate that CBOW can account for nearly all of the variation in lexical access measures typically attributable to word frequency and contextual diversity—two measures that are conceptually related to needs probability. These results suggest two conclusions: One, CBOW is a psychologically plausible model of lexical semantics. Two, word frequency and contextual diversity do not capture learning effects but rather memory retrieval effects.     

Recall is not necessary for verbal sequence learning

The question of whether overt recall of to-be-remembered material accelerates learning is important in a wide range of real-world learning settings. In the case of verbal sequence learning, previous research has proposed that recall either is necessary for verbal sequence learning (Cohen & Johansson Journal of Verbal Learning and Verbal Behavior, 6, 139–143, 1967; Cunningham, Healy, & Williams Journal of Experimental Psychology: Learning, Memory, and Cognition, 10, 575–597, 1984), or at least contributes significantly to it (Glass, Krejci, & Goldman Journal of Memory and Language, 28, 189–199, 1989; Oberauer & Meyer Memory, 17, 774–781, 2009). In contrast, here we show that the amount of previous spoken recall does not predict learning and is not necessary for it. We suggest that previous research may have underestimated participants’ learning by using suboptimal performance measures, or by using manual or written recall. However, we show that the amount of spoken recall predicted how much interference from other to-be-remembered sequences would be observed. In fact, spoken recall mediated most of the error learning observed in the task. Our data support the view that the learning of overlapping auditory–verbal sequences is driven by learning the phonological representations and not the articulatory motor responses. However, spoken recall seems to reinforce already learned representations, whether they are correct or incorrect, thus contributing to a participant identifying a specific stimulus as either “learned” or “new” during the presentation phase.     

Semantic alignment and number comparison

Are the quantity representations activated by Arabic digits influenced by semantic context? We developed a novel paradigm to examine semantic alignment effects (e.g., Bassok et al. in J Exp Psychol Learn Mem Cogn 34:343–352, 2008) in number comparison. A horizontal word pair (either less more or few many) appeared for 480 ms to prime either relative magnitude (less more) or quantity (few many). Then a horizontal pair of single digits that were either successors (near) or differed by at least four (far) appeared above the word pair. Participants indicated verbally whether or not the word and digit pairs were congruent with respect to left-to-right ascending or descending relative magnitude. The RT advantage for far number pairs compared to near pairs (the distance effect) was greater with magnitude primes (81 ms) than quantity primes (17 ms), demonstrating a semantic alignment effect. This effect disappeared in Experiment 2 in which participants received identical stimuli but named the larger of the two digits and were free to ignore the primes. Nonetheless, mean RT in Experiment 2 was faster with prime and target pairs both ascending or both descending, but only with quantity primes. This prime-dependent order-congruity effect suggests that semantic alignment with respect to numerical order affected number comparison in Experiment 2. The results thereby demonstrate that number comparison exhibits task-dependent semantic alignment effects and recruits distinct numerical representations as a function of semantic context (e.g., Cohen Kadosh and Walsh in Behav Brain Sci 32:313–373, 2009).     

SCEGRAM: An image database for semantic and syntactic inconsistencies in scenes

Our visual environment is not random, but follows compositional rules according to what objects are usually found where. Despite the growing interest in how such semantic and syntactic rules – a scene grammar – enable effective attentional guidance and object perception, no common image database containing highly-controlled object-scene modifications has been publically available. Such a database is essential in minimizing the risk that low-level features drive high-level effects of interest, which is being discussed as possible source of controversial study results. To generate the first database of this kind – SCEGRAM – we took photographs of 62 real-world indoor scenes in six consistency conditions that contain semantic and syntactic (both mild and extreme) violations as well as their combinations. Importantly, always two scenes were paired, so that an object was semantically consistent in one scene (e.g., ketchup in kitchen) and inconsistent in the other (e.g., ketchup in bathroom). Low-level salience did not differ between object-scene conditions and was generally moderate. Additionally, SCEGRAM contains consistency ratings for every object-scene condition, as well as object-absent scenes and object-only images. Finally, a cross-validation using eye-movements replicated previous results of longer dwell times for both semantic and syntactic inconsistencies compared to consistent controls. In sum, the SCEGRAM image database is the first to contain well-controlled semantic and syntactic object-scene inconsistencies that can be used in a broad range of cognitive paradigms (e.g., verbal and pictorial priming, change detection, object identification, etc.) including paradigms addressing developmental aspects of scene grammar. SCEGRAM can be retrieved for research purposes from http://www.scenegrammarlab.com/research/scegram-database/.     

Sustained conscious access to incidental memories in RSVP

In visual search of natural scenes, differentiation of briefly fixated but task-irrelevant distractor items from incidental memory is often comparable to explicit memorization. However, many characteristics of incidental memory remain unclear, including the capacity for its conscious retrieval. Here, we examined incidental memory for faces in either upright or inverted orientation using Rapid Serial Visual Presentation (RSVP). Subjects were instructed to detect a target face in a sequence of 8–15 faces cropped from natural scene photographs (Experiment 1). If the target face was identified within a brief time window, the subject proceeded to an incidental memory task. Here, subjects used incidental memory to discriminate between a probe face (a distractor in the RSVP stream) and a novel, foil face. In Experiment 2 we reduced scene-related semantic coherency by intermixing faces from multiple scenes and contrasted incidental memory with explicit memory, a condition where subjects actively memorized each face from the sequence without searching for a target. In both experiments, we measured objective performance (Type 1 AUC) and metacognitive accuracy (Type 2 AUC), revealing sustained and consciously accessible incidental memory for upright and inverted faces. In novel analyses of face categories, we examined whether accuracy or metacognitive judgments are affected by shared semantic features (i.e., similarity in gender, race, age). Similarity enhanced the accuracy of incidental memory discriminations but did not influence metacognition. We conclude that incidental memory is sustained and consciously accessible, is not reliant on scene contexts, and is not enhanced by explicit memorization.     

<Emphasis Type="Italic">Above</Emphasis>, <Emphasis Type="Italic">on</Emphasis>, or <Emphasis Type="Italic">shang</Emphasis> (上)? Language and spatial representations among English–Mandarin bilinguals

This study investigated if exposure to spatial language could affect spatial cognition in English-Mandarin bilinguals by focusing on contact/noncontact distinctions, an area that has been a source of contention in the language-and-thought literature. Sixty-three participants were first primed with sentences containing spatial terms (e.g., above, on) before performing a spatial decision task. Approximately half of the participants (n = 33) were primed in English; for the remaining participants (n = 30), primes comprising Mandarin spatial terms―which mark spatial distinctions differently than in English (e.g., shang in Mandarin signifies both above and on in English)―were employed instead. Our findings revealed that participants’ performance was influenced by spatial primes in the English experiment, thereby proffering evidence for thinking-for-speaking effects. However, these findings were not mirrored for the Mandarin experiment, confirming that the contact/noncontact specificity of spatial terms may have been instrumental in engendering the thinking-for-speaking effects observed in English.     

Changes Over Time in the Comprehension of <Emphasis Type="Italic">He</Emphasis> and <Emphasis Type="Italic">They</Emphasis> as Epicene Pronouns

An epicene pronoun is a gender-neutral singular pronoun used in sentences when the gender of the subject is unknown or unspecified. In English, he and they are commonly-used epicene pronouns. Until recently, he has been widely accepted as being grammatically correct. However, many have argued that he is sexist because it may bias people to think about males. Two experiments were performed using a lexical decision task in which participants reacted to gendered words (e.g., aunt and uncle) after reading sentences using he, they, or unrelated epicene pronouns. We conducted the experiments 15 years apart in order to explore whether change in pronoun usage and the social significance of pronouns would be associated with different priming effects. Both experiments demonstrated that pronouns influence the processing of gendered nouns. However, in Experiment 1 they facilitated the processing of feminine nouns whereas in Experiment 2, he slowed the processing of feminine nouns. We discuss these results with respect to language change and conclude that they is a more effective epicene.     

Use of the familiarity difference cue in inferential judgments

The familiarity difference cue has been regarded as a general cue for making inferential judgments (Honda, Abe, Matsuks, & Yamagishi in Memory and Cognition, 39(5), 851–863, 2011; Schwikert & Curran in Journal of Experimental Psychology: General, 143(6), 2341–2365, 2014). The current study tests a model of inference based on familiarity differences that encompasses the recognition heuristic (Goldstein & Gigerenzer, 1999, Goldstein & Gigerenzer in Psychological Review, 109(1), 75–90, 2002). In two studies, using a large pool of stimuli, participants rated their familiarity of cities and made choices on a typical city-size task. The data were fitted with the r-s model (Hilbig, Erdfelder, & Pohl in, Journal of Experimental Psychology: Learning Memory and Cognition, 37(4), 827–839, 2011), which was adapted to include familiarity differences. The results indicated that people used the familiarity difference cue because the participants ignored further knowledge in a substantial number of cases when the familiarity difference cue was available. An analysis of reaction-time data further indicated that the response times were shorter for heuristic judgments than for knowledge-only-based judgments. Furthermore, when knowledge was available, the response times were shorter when knowledge was congruent with a heuristic cue than when it was in conflict with it. Differences between the familiarity difference cue and the fluency heuristic (Schooler & Hertwig, 2005, Psychological Review, 112, 610–628) are discussed.