Learning from delayed feedback: neural responses in temporal credit assignment

When feedback follows a sequence of decisions, relationships between actions and outcomes can be difficult to learn. We used event-related potentials (ERPs) to understand how people overcome this temporal credit assignment problem. Participants performed a sequential decision task that required two decisions on each trial. The first decision led to an intermediate state that was predictive of the trial outcome, and the second decision was followed by positive or negative trial feedback. The feedback-related negativity (fERN), a component thought to reflect reward prediction error, followed negative feedback and negative intermediate states. This suggests that participants evaluated intermediate states in terms of expected future reward, and that these evaluations supported learning of earlier actions within sequences. We examine the predictions of several temporal-difference models to determine whether the behavioral and ERP results reflected a reinforcement-learning process.     

Learning and memory of factual content from narrative and expository text

Background. Research on the presentation of information in narrative versus expository text genres is inconclusive with respect to the question of which is more beneficial for student learning. Aims. We examine the effect of presenting factual content in either narrative or expository genres on student learning. We also consider relevant prior knowledge and working memory capacity (WMC) as potential mediating variables. Sample. Ninety university undergraduate students. Methods. Subjects studied circulatory system content embedded in either narrative or expository texts. Prior circulatory system knowledge, knowledge improvement (learning) and free recall were assessed. Results. Learning and recall did not differ as a function of text genre overall, but did interact with prior knowledge. Learning from the narrative and one expository text was optimal at intermediate levels of prior knowledge, with higher knowledge readers benefiting more from the expository text compared with the narrative text. Prior knowledge was positively related to recall for the expository texts, but unrelated for the narrative text. Subjects' WMC did not predict learning or recall. Conclusions. Results suggest that narrative and expository processing differ with respect to integration of text content with prior knowledge.     

Transport and use of common objects: Influence of weight on action planning

Internal knowledge and visual cues about object's weight play an important role in grasping and lifting objects. It has been shown that both visual cues and internal knowledge might influence movement kinematics and force production depending on action goal (use vs. transport). However, there is little evidence about weight's influence on action planning as reflected by initiation time. In the present study we investigated this issue. In Experiment 1, participants had to grasp light and heavy objects (without moving them) to either use or transport them. In Experiment 2 we asked another group of participants to actually use or transport the same objects. We observed that initiation times were faster for heavy objects than for light objects in both the transport and use tasks, but only in Experiment 2. Thus, weight influenced the planning of use and transport actions, only when the end-goal of the action was really achieved. These data are incompatible with the hypothesis that only use actions are supported by stored object's representations. They rather suggest that in some circumstances, depending of the end-goal of the action and the physical constraints the planning of both use and transport actions are based on stored object representation.     

Primacy of information about means selection over outcome selection in goal attribution by infants

It has been shown that, when observing an action, infants can rely on either outcome selection information (i.e., actions that express a choice between potential outcomes) or means selection information (i.e., actions that are causally efficient toward the outcome) in their goal attribution. However, no research has investigated the relationship between these two types of information when they are present simultaneously. In an experiment that addressed this question directly, we found that when outcome selection information could disambiguate the goal of the action (e.g., the action is directed toward one of two potential targets), but means selection information could not (i.e., the action is not efficiently adjusted to the situational constraints), 7- and 9-month-old infants did not attribute a goal to an observed action. This finding suggests that means selection information takes primacy over outcome selection information. The early presence of this bias sheds light on the nature of the notion of goal in action understanding.     

Perspective effects in repeated reading: An eye movement study

The present study examined the influence of perspective instructions on online processing of expository text during repeated reading. Sixty-two participants read either a high or a low prior knowledge (HPK vs. LPK) text twice from a given perspective while their eye movements were recorded. They switched perspective before a third reading. Reading perspective affected the first-pass reading and also increased sentence wrap-up processing time in the perspective-relevant sentences. Prior knowledge facilitated the recognition of the (ir)relevance of text information and resulted in relatively earlier perspective effects in the HPK versus LPK text. Repeated reading facilitated processing, as indicated by all eye movement measures. After the perspective switch, a repetition benefit was observed for the previously relevant text information, whereas a repetition cost was found for the previously irrelevant text information. These results indicate that reading perspective and prior knowledge have a significant influence on how readers allocate visual attention during reading.     

The Cognitive Effectiveness of Subtitle Processing

In an experimental study, we analyzed the cognitive processing of a subtitled film excerpt by adopting a methodological approach based on the integration of a variety of measures: eye-movement data, word recognition, and visual scene recognition. We tested the hypothesis that the processing of subtitled films is cognitively effective: It leads to a good understanding of film content without requiring a significant tradeoff between image processing and text processing. Following indications in the psycholinguistic literature, we also tested the hypothesis that two-line subtitles whose segmentation is syntactically incoherent can have a disruptive effect on information processing and recognition performance. The results highlighted the effectiveness of subtitle processing: Regardless of the quality of line segmentation, participants had a good understanding of the film content, they achieved good levels of performance in both word and scene recognition, and no tradeoff between text and image processing was detected. Eye-movement analyses enabled a further characterization of cognitive processing during subtitled film viewing. This article discusses the theoretical implications of the findings for both subtitling and multiple-source communication and highlights their methodological and applied implications.     

Knowledge is power? Outcome probability information impairs detection of deceptive intent

The benefits and costs of prior expectations that are (i.e., congruent) or are not in harmony (i.e., incongruent) with action outcomes appear to be balanced; however, researchers have yet to examine the influence on skilled detection of deception. In this study we investigated whether response bias resulting from probability information (a) is stronger for low-skilled than high-skilled participants, (b) is stronger for deceptive actions than genuine actions, and (c) impairs the discriminability of genuine and deceptive actions. High-skilled (n = 15) and low-skilled (n = 15) soccer players responded to life-sized projected video clips showing an oncoming opponent taking the ball to their left or right, with or without a deceptive ‘stepover’ action. Three probability conditions were used with respect to outcome direction: 50/50, 67/33, and 83/17. Participants responded by stepping on one of two corresponding pressure mats, as if attempting to intercept the player. Response accuracy for genuine and deceptive actions was used to generate measures of bias (c) and sensitivity (d’). The results confirmed stronger probability bias for deceptive actions than genuine ones, and for low-skilled than high-skilled participants. Congruence between high outcome probability and the direction of the fake significantly enhanced the effectiveness of the deceptive action. The study provides the first evidence that outcome probability information impairs skilled detection of deceptive intent.     

Relating action to abstract goals increases physical activity reported a week later

ObjectiveThe primary aim of the present study was to investigate whether construing action abstractly versus concretely increases physical activity over a one-week period.Design and methodAn experimental study was conducted in which participants were asked to commit to engaging in physical activity at least four times in the coming week. After making this commitment, participants were assigned randomly to think about the concrete procedures or the abstract purpose of their actions. Additionally, in an attempt to induce differences in level of goal conflict, participants were assigned randomly to receive a reminder of a different or consistent goal. The main outcome variable of interest was the number of minutes spent on physical activity over the following 7-day period.ResultsConsistent with the hypothesis, participants in the abstract condition reported engaging in significantly more minutes of physical activity than did those in the concrete condition. Level of goal conflict did not significantly impact physical activity. The effect of abstract versus concrete thinking on physical activity also was related to the processing of negative affect.ConclusionBy providing evidence that construing action abstractly impacts physical activity, the present investigation makes an important addition to research aiming to identify effective means of increasing physical activity.     

Influencing prior knowledge through a short reading impacts curiosity and learning

Curiosity predicts memory performance and it is influenced by prior knowledge. Reading a well-organized text can increase curiosity in a classroom setting, however it is not clear if reading a short text written in an encyclopedic style can increase curiosity and learning without explicit educational goals. We presented participants with a short text and examined if questions related to this reading could elicit higher curiosity ratings and better recall in a thematized version of the trivia task. In the first experiment, participants subjectively judged their prior knowledge of trivia questions. The curiosity of the participants was not influenced by the reading, but the memory effect of curiosity was amplified for the questions related to it. In the second experiment, we objectively verified whether the participants knew the answers. The curiosity ratings were higher for the questions related to the reading, but only the curiosity ratings influenced recall performance. These results show that prior knowledge induced by reading can have an effect on curiosity and learning, but it depends on how this knowledge is assessed by the learner.     

The effects of prior knowledge and text structure on comprehension processes during reading of scientific texts

The aim of the present study was to investigate the effects of prior knowledge and text structure on cognitive processes during comprehension of scientific texts. To investigate the processes online, we used a think-aloud methodology in Experiment 1 and a reading time methodology in Experiment 2. In both experiments, we obtained offline comprehension measures and measures of individual differences in working memory and need for cognition. Across the two experiments, the results indicated that readers adjust their processing as a function of the interaction between prior knowledge and text structure. In particular, adjustments in theactual processes that take place during reading were observed for readers who had erroneous prior knowledge,but only when they read a text that was structured to explicitly refute this prior knowledge. Furthermore, the results showed that readers' memory for the text was affected by differences in their prior knowledge, independently of text structure. These findings contribute to our understanding of the relation between different factorsthat are associated with comprehension of scientific texts and have implications for theories of comprehension and conceptual change.     

Cooperating If One's Goals Are Collective‐Based: Social Identification Effects in Social Dilemmas as a Function of Goal Transformation1

Prior studies of the effect of group identification on cooperation in social dilemmas have advanced 2 competing accounts: the goal‐transformation hypothesis, which holds that identification makes personal and collective goals interchangeable; and the goal‐amplification hypothesis, which states that identification induces positive expectations about others’ cooperative behavior. However, prior studies have neglected to assess the process measures necessary to pit the one account against the other. The present study showed that the effect of identification was moderated by participants’ social value orientation. Identification influenced proselfs’ cooperation more than prosocials’ cooperation. Mediational analyses further showed that the effect of our identification manipulation was mediated by participants’ sense of collective self, and not by their expectations.     

Dissociable neural systems for recognizing emotions

This study tested the hypothesis that the recognition of emotions would draw upon anatomically separable brain regions, depending on whether the stimuli were static or explicitly conveyed information regarding actions. We investigated the hypothesis in a rare subject with extensive bilateral brain lesions, patient B., by administering tasks that assessed recognition and naming of emotions from visual and verbal stimuli, some of which depicted actions and some of which did not. B. could not recognize any primary emotion other than happiness, when emotions were shown as static images or given as single verbal labels. By contrast, with the notable exception of disgust, he correctly recognized primary emotions from dynamic displays of facial expressions as well as from stories that described actions. Our findings are consistent with the idea that information about actions is processed in occipitoparietal and dorsal frontal cortices, all of which are intact in B.'s brain. Such information subsequently would be linked to knowledge about emotions that depends on structures mapping somatic states, many of which are also intact in B.'s brain. However, one of these somatosensory structures, the insula, is bilaterally damaged, perhaps accounting for B.'s uniformly impaired recognition of disgust (from both static and action stimuli). Other structures that are damaged in B.'s brain, including bilateral inferior and anterior temporal lobe and medial frontal cortices, appear to be critical for linking perception of static stimuli to recognition of emotions. Thus the retrieval of knowledge regarding emotions draws upon widely distributed and partly distinct sets of neural structures, depending on the attributes of the stimulus.     

Knowledge of text message abbreviations as a predictor of spelling ability

The relationships of self-reported text messaging frequency and knowledge of text message abbreviations with spelling ability were investigated. Two studies were conducted in which the college student participants provided self-reports of text messaging frequency, responded to a test of knowledge of text message abbreviations, and completed a standardized spelling test. In both studies, self-reported text messaging frequency was not predictive of scores on the spelling test. Knowledge of text message abbreviations was positively correlated with spelling scores. In the second study, spelling ability was positively correlated with processing time to identify abbreviations as real. The results were not consistent with the idea that better knowledge of text messaging is predictive of lower spelling ability. Instead, individuals with better knowledge of abbreviations tended to be better spellers.     

Reasoning about ‘irrational’ actions: When intentional movements cannot be explained,the movements themselves are seen as the goal

Infants and adults are thought to infer the goals of observed actions by calculating the actions’ efficiency as a means to particular external effects, like reaching an object or location. However, many intentional actions lack an external effect or external goal (e.g. dance). We show that for these actions, adults infer that the agents’ goal is to produce the movements themselves: Movements are seen as the intended outcome, not just a means to an end. We test what drives observers to infer such movement-based goals, hypothesizing that observers infer movement-based goals to explain actions that are clearly intentional, but are not an efficient means to any plausible external goal. In three experiments, we separately manipulate intentionality and efficiency, equating for movement trajectory, perceptual features, and external effects. We find that participants only infer movement-based goals when the actions are intentional and are not an efficient means to external goals. Thus, participants appear to infer that movements are the goal in order to explain otherwise mysterious intentional actions. These findings expand models of goal inference to account for intentional yet ‘irrational’ actions, and suggest a novel explanation for overimitation as emulation of movement-based goals.     

Information selectivity in decision making by younger and older adults

Past research has demonstrated that older adults are more likely than younger adults to exhibit information selectivity in decision making. Two alternative explanations have been proposed to account for this age difference. One explanation attributes the increase in information selectivity to older adults' reliance on prior knowledge, whereas the other explanation suggests that it reflects reduced information processing capacity. The aim of this research was to explore the latter explanation by controlling for experiential factors and varying the cognitive demands involved in decision making. Specifically, participants were faced with unfamiliar decision problems, and had to base their decisions on the available information in order to reach a desired goal. In Experiment 1 younger and older participants were required to play a game involving chance. The outcome payoff was varied between three conditions (approach, avoidance, and control). The results indicated that both the younger and the older participants based their decisions on payoff, though the older participants did so to a lesser extent. In Experiment 2 younger and older participants performed a similar decision task but with higher cognitive demands. Specifically, the decision‐making task included two dimensions of information, outcome probability and outcome payoff. The results showed that the younger participants based their decisions on probability and payoff whereas the older participants based their decisions on probability alone. In Experiment 3 younger and older participants made decisions in a sale context and received instructional cue to incorporate payoff information in their decisions. As before, the younger participants utilized probability and payoff, whereas the older participants based their decisions only on probability information. The findings are discussed in terms of age differences in information‐processing capacity, metacognition, motivation, and goal‐setting.     

Feeling the past: The absence of experimental evidence for anomalous retroactive influences on text processing

In two self-paced reading experiments, we investigated the hypothesis that information moves backward in time to influence prior behaviors (Bem Journal of Personality and Social Psychology 100:407?C425, 2011a). In two of Bem??s experiments, words were presented after target pictures in a pleasantness judgment task. In a condition in which the words were consistent with the emotional valence of the picture, reaction times to the pictures were significantly shorter , as compared with a condition in which the words were inconsistent with the emotional valence of the picture. Bem Journal of Personality and Social Psychology 100:407?C425, (2011a) interpreted these results as showing a ??retroactive priming?? effect resulting from precognition. To test the precognition hypothesis, we adapted a standard repetition priming paradigm from psycholinguistics. In the experiments, participants read a set of texts. In one condition, the participants read the same text twice. In other conditions, participants read two different texts. The precognition hypothesis predicts that readers who encounter the same text twice will experience reductions in processing load during their first encounter with the text. Hence, these readers' average reading times should be shorter than those of readers who encounter the target text only once. Our results indicated that readers processed the target text faster the second time they read it. Also, their reading times decreased as their experience with the self-paced reading procedure increased. However, participants read the target text equally quickly during their initial encounter with the text, whether or not the text was subsequently repeated. Thus, the experiments demonstrated normal repetition priming and practice effects but offered no evidence for retroactive influences on text processing.     

Goal specificity effects on hypothesis testing in problem solving

Previous research has found that having a nonspecific goal (NSG) leads to better problem solving and transfer than having a specific goal (SG). To distinguish between the various explanations of this effect requires direct evidence showing how a NSG affects a participant's behaviour. Therefore we collected verbal protocols from participants learning to control a linear system consisting of 3 outputs by manipulating 3 inputs. This system was simpler than the one we had used previously, so in Exp. 1 we generalized our earlier goal specificity findings to this system. In Exp. 2 protocol analysis confirmed our prediction (based on dual-space theories of problem solving) that NSG participants focused on hypothesis testing whereas SG participants focused on the goal. However, this difference only emerged over time. We also replicated the goal specificity effect on performance and showed that giving participants a hypothesis to test improved performance.     

Enactment supports unitisation of action components and enhances the contribution of familiarity to associative recognition

Memory for actions is usually better following subject-performed tasks (SPT) than verbal tasks (VT). We hypothesised that enactment unitises the components of actions such that familiarity can support associative recognition following SPT. To examine this hypothesis, participants studied verb–object pairs in a SPT or VT condition. During testing, they discriminated between intact, recombined and new items and made Remember/Know judgments; additionally, their EEGs were recorded. Associative recognition was better following SPT than VT. Early frontal event-related potentials (ERPs) were graded according to the item status following SPT, but no such effects were found after VT. Similarly, the late parietal ERPs were graded following SPT, whereas these effects were smaller and did not differ between intact and recombined items following VT. We conclude that enactment unitised the action and object so that familiarity could contribute to associative recognition and that recollection became sensitive to the amount of the matching associative information.     

Age,context, and spatial memory: A neuropsychological approach

Abstract

The hypothesis that a reduction in age differences in spatial location memory in the presence of distinctive cues reflects a decreased dependence on a hippocampally based memory system was tested in three experiments. In Experiments 1 and 2 the presence of distinctive cues did not reduce age differences in spatial location memory nor did these cues eliminate the significant relation between spatial location memory and a measure of hippocampal function. Distinctive cues did, however, place additional demands on processing resources and spatial visualization abilities. In Experiment 3 the relevance of prior knowledge was manipulated. With irrelevant prior knowledge there was a strong unique association between the hippocampal measure and outcome measure. With relevant prior knowledge there was no such association. the implications of these findings for understanding the role of the hippocampus in age-related decline in memory for locations are discussed.