A bilateral advantage for maintaining objects in visual short term memory

Research has shown that attentional pre-cues can subsequently influence the transfer of information into visual short term memory (VSTM) (Schmidt, B., Vogel, E., Woodman, G., & Luck, S. (2002). Voluntary and automatic attentional control of visual working memory. Perception & Psychophysics, 64(5), 754–763). However, studies also suggest that those effects are constrained by the hemifield alignment of the pre-cues (Holt, J. L., & Delvenne, J.-F. (2014). A bilateral advantage in controlling access to visual short-term memory. Experimental Psychology, 61(2), 127–133), revealing better recall when distributed across hemifields relative to within a single hemifield (otherwise known as a bilateral field advantage). By manipulating the duration of the retention interval in a colour change detection task (1 s, 3 s), we investigated whether selective pre-cues can also influence how information is later maintained in VSTM. The results revealed that the pre-cues influenced the maintenance of the colours in VSTM, promoting consistent performance across retention intervals (Experiments 1 & 4). However, those effects were only shown when the pre-cues were directed to stimuli displayed across hemifields relative to stimuli within a single hemifield. Importantly, the results were not replicated when participants were required to memorise colours (Experiment 2) or locations (Experiment 3) in the absence of spatial pre-cues. Those findings strongly suggest that attentional pre-cues have a strong influence on both the transfer of information in VSTM and its subsequent maintenance, allowing bilateral items to better survive decay.     

The role of eye movements in motor sequence learning

An experiment that utilized a 16-element movement sequence was designed to determine the impact of eye movements on sequence learning. The participants were randomly assigned to two experimental groups: a group that was permitted to use eye movements (FREE) and a second group (FIX) that was instructed to fixate on a marker during acquisition (ACQ). A retention test (RET) was designed to provide a measure of learning, and two transfer tests were designed to determine the extent to which eye movements influenced sequence learning. The results demonstrated that both groups decreased the response time to produce the sequence, but the participants in the FREE group performed the sequence more quickly than participants of the FIX group during the ACQ, RET and the two transfer tests. Furthermore, continuous visual control of response execution was reduced over the course of learning. The results of the transfer tests indicated that oculomotor information regarding the sequence can be stored in memory and enhances response production.     

Keeping the Result in Sight and Mind: General Cognitive Principles and Language‐Specific Influences in the Perception and Memory of Resultative Events

We study how people attend to and memorize endings of events that differ in the degree to which objects in them are affected by an action: Resultative events show objects that undergo a visually salient change in state during the course of the event (peeling a potato), and non‐resultative events involve objects that undergo no, or only partial state change (stirring in a pan). We investigate general cognitive principles, and potential language‐specific influences, in verbal and nonverbal event encoding and memory, across two experiments with Dutch and Estonian participants. Estonian marks a viewer's perspective on an event's result obligatorily via grammatical case on direct object nouns: Objects undergoing a partial/full change in state in an event are marked with partitive/accusative case, respectively. Therefore, we hypothesized increased saliency of object states and event results in Estonian speakers, as compared to speakers of Dutch. Findings show (a) a general cognitive principle of attending carefully to endings of resultative events, implying cognitive saliency of object states in event processing; (b) a language‐specific boost on attention and memory of event results under verbal task demands in Estonian speakers. Results are discussed in relation to theories of event cognition, linguistic relativity, and thinking for speaking.     

Cognitive Task Analysis for Implicit Knowledge About Visual Representations With Similarity Learning Methods

Visual representations are prevalent in STEM instruction. To benefit from visuals, students need representational competencies that enable them to see meaningful information. Most research has focused on explicit conceptual representational competencies, but implicit perceptual competencies might also allow students to efficiently see meaningful information in visuals. Most common methods to assess students’ representational competencies rely on verbal explanations or assume explicit attention. However, because perceptual competencies are implicit and not necessarily verbally accessible, these methods are ill‐equipped to assess them. We address these shortcomings with a method that draws on similarity learning, a machine learning technique that detects visual features that account for participants’ responses to triplet comparisons of visuals. In Experiment 1, 614 chemistry students judged the similarity of Lewis structures and in Experiment 2, 489 students judged the similarity of ball‐and‐stick models. Our results showed that our method can detect visual features that drive students’ perception and suggested that students’ conceptual knowledge about molecules informed perceptual competencies through top‐down processes. Furthermore, Experiment 2 tested whether we can improve the efficiency of the method with active sampling. Results showed that random sampling yielded higher accuracy than active sampling for small sample sizes. Together, the experiments provide the first method to assess students’ perceptual competencies implicitly, without requiring verbalization or assuming explicit visual attention. These findings have implications for the design of instructional interventions that help students acquire perceptual representational competencies.     

Degree of Language Experience Modulates Visual Attention to Visible Speech and Iconic Gestures During Clear and Degraded Speech Comprehension

Visual information conveyed by iconic hand gestures and visible speech can enhance speech comprehension under adverse listening conditions for both native and non‐native listeners. However, how a listener allocates visual attention to these articulators during speech comprehension is unknown. We used eye‐tracking to investigate whether and how native and highly proficient non‐native listeners of Dutch allocated overt eye gaze to visible speech and gestures during clear and degraded speech comprehension. Participants watched video clips of an actress uttering a clear or degraded (6‐band noise‐vocoded) action verb while performing a gesture or not, and were asked to indicate the word they heard in a cued‐recall task. Gestural enhancement was the largest (i.e., a relative reduction in reaction time cost) when speech was degraded for all listeners, but it was stronger for native listeners. Both native and non‐native listeners mostly gazed at the face during comprehension, but non‐native listeners gazed more often at gestures than native listeners. However, only native but not non‐native listeners' gaze allocation to gestures predicted gestural benefit during degraded speech comprehension. We conclude that non‐native listeners might gaze at gesture more as it might be more challenging for non‐native listeners to resolve the degraded auditory cues and couple those cues to phonological information that is conveyed by visible speech. This diminished phonological knowledge might hinder the use of semantic information that is conveyed by gestures for non‐native compared to native listeners. Our results demonstrate that the degree of language experience impacts overt visual attention to visual articulators, resulting in different visual benefits for native versus non‐native listeners.     

“Seeing Rain”: Integrating phenomenological and Bayesian predictive coding approaches to visual hallucinations and self-disturbances (Ichstörungen) in schizophrenia

We present a schizophrenia patient who reports “seeing rain” with attendant somatosensory features which separate him from his surroundings. Because visual/multimodal hallucinations are understudied in schizophrenia, we examine a case history to determine the role of these hallucinations in self-disturbances (Ichstörungen). Developed by the early Heidelberg School, self-disturbances comprise two components: 1. The self experiences its own automatic processing as alien to self in a split-off, “doubled-I.” 2. In “I-paralysis,” the disruption to automatic processing is now outside the self in omnipotent agents. Self-disturbances (as indicated by visual/multimodal hallucinations) involve impairment in the ability to predict moment-to-moment experiences in the ongoing perception-action cycle. The phenomenological approach to subjective experience of self-disturbances complements efforts to model psychosis using the computational framework of hierarchical predictive coding. We conclude that self-disturbances play an adaptive, compensatory role following the uncoupling of perception and action, and possibly, other low-level perceptual anomalies.     

Consciousness and working memory: Current trends and research perspectives

Working memory has long been thought to be closely related to consciousness. However, recent empirical studies show that unconscious content may be maintained within working memory and that complex cognitive computations may be performed on-line. This promotes research on the exact relationships between consciousness and working memory. Current evidence for working memory being a conscious as well as an unconscious process is reviewed. Consciousness is shown to be considered a subset of working memory by major current theories of working memory. Evidence for unconscious elements in working memory is shown to come from visual masking and attentional blink paradigms, and from the studies of implicit working memory. It is concluded that more research is needed to explicate the relationship between consciousness and working memory. Future research directions regarding the relationship between consciousness and working memory are discussed.     

Introspective access to implicit shifts of attention

Literature in metacognition has systematically rejected the possibility of introspective access to complex cognitive processes. This situation derives from the difficulty of experimentally manipulating cognitive processes while abiding by the two contradictory constraints. First, participants must not be aware of the experimental manipulation, otherwise they run the risk of incorporating their knowledge of the experimental manipulation in some rational elaboration. Second, we need an external, third person perspective evidence that the experimental manipulation did impact some relevant cognitive processes. Here, we study introspection during visual searches, and we try to overcome the above dilemma, by presenting a barely visible, “pre-conscious” cue just before the search array. We aim at influencing the attentional guidance of the search processes, while participants would not notice that fact. Results show that introspection of the complexity of a search process is driven in part by subjective access to its attentional guidance.     

Anisotropic tracking: evidence for automatic synergy formation in a bimanual task

Investigation of interlimb synergy has become synonymous with the study of coordination dynamics and is largely confined to periodic movement. Based on a computational approach this paper demonstrates a method of investigating the formation of a novel synergy in the context of stochastic, spatially asymmetric movements. Nine right-handed participants performed a two degrees of freedom (2D) "etch-a-sketch" tracking task where the right hand controlled the horizontal position of the response cursor on the display while the left hand controlled the vertical position. In a pre-practice 2D tracking task, measures of phase lag between the irregularly moving target and the response showed that participants controlled left and right hands independently, performance of the right hand being slightly superior to the left. Participants then undertook 4 h 16 min distributed practice of a one degree of freedom etch-a-sketch task where the target was constrained to move irregularly in only the 45 degrees direction on the display. To track such a target accurately participants had to make in-phase coupled stochastic movements of the hands. In a post-practice 2D task, measures of phase lag showed anisotropic improvement in performance, the amount of improvement depending on the direction of motion on the display. Improvement was greatest in the practised 45 degrees and least in the orthogonal 135 degrees direction. Best and worst performances were no longer in the directions associated with right and left hands independently, but in directions requiring coupled movements of the two hands. These data support the proposal that the nervous system can establish a model of novel coupling between the hands and thereby form a task-dependent bimanual synergy for controlling the stochastic coupled movements as an entity.     

Redundant food searches by capuchin monkeys (Cebus apella): a failure of metacognition?

This study investigated capuchin monkeys' understanding of their own visual search behavior as a means to gather information. Five monkeys were presented with three tubes that could be visually searched to determine the location of a bait. The bait's visibility was experimentally manipulated, and the monkeys' spontaneous visual searches before tube selection were analyzed. In Experiment 1, three monkeys selected the baited tube significantly above chance; however, the monkeys also searched transparent tubes. In Experiment 2, a bent tube in which food was never visible was introduced. When the bent tube was baited, the monkeys failed to deduce the bait location and responded randomly. They also continued to look into the bent tube despite not gaining any pertinent information from it. The capuchin monkeys' behavior contrasts with the efficient employment of visual search behavior reported in humans, apes and macaques. This difference is consistent with species-related variations in metacognitive abilities, although other explanations are also possible.