Estimating working memory capacity for lists of nonverbal sounds

Working memory (WM) capacity limit has been extensively studied in the domains of visual and verbal stimuli. Previous studies have suggested a fixed WM capacity of typically about three or four items, on the basis of the number of items in working memory reaching a plateau after several items as the set size increases. However, the fixed WM capacity estimate appears to rely on categorical information in the stimulus set (Olsson & Poom Proceedings of the National Academy of Sciences 102:8776-8780, 2005). We designed a series of experiments to investigate nonverbal auditory WM capacity and its dependence on categorical information. Experiments 1 and 2 used simple tones and revealed capacity limit of up to two tones following a 6-s retention interval. Importantly, performance was significantly higher at set sizes 2, 3, and 4 when the frequency difference between target and test tones was relatively large. In Experiment 3, we added categorical information to the simple tones, and the effect of tone change magnitude decreased. Maximal capacity for each individual was just over three sounds, in the range of typical visual procedures. We propose that two types of information, categorical and detailed acoustic information, are kept in WM and that categorical information is critical for high WM performance.     

Bindings in working memory: The role of object-based attention

Over the past decade, it has been debated whether retaining bindings in working memory (WM) requires more attention than retaining constituent features, focusing on domain-general attention and space-based attention. Recently, we proposed that retaining bindings in WM needs more object-based attention than retaining constituent features (Shen, Huang, & Gao, 2015, Journal of Experimental Psychology: Human Perception and Performance, doi: 10.1037/xhp0000018). However, only unitized visual bindings were examined; to establish the role of object-based attention in retaining bindings in WM, more emperical evidence is required. We tested 4 new bindings that had been suggested requiring no more attention than the constituent features in the WM maintenance phase: The two constituent features of binding were stored in different WM modules (cross-module binding, Experiment 1), from auditory and visual modalities (cross-modal binding, Experiment 2), or temporally (cross-time binding, Experiments 3) or spatially (cross-space binding, Experiments 4–6) separated. In the critical condition, we added a secondary object feature-report task during the delay interval of the change-detection task, such that the secondary task competed for object-based attention with the to-be-memorized stimuli. If more object-based attention is required for retaining bindings than for retaining constituent features, the secondary task should impair the binding performance to a larger degree relative to the performance of constituent features. Indeed, Experiments 1–6 consistently revealed a significantly larger impairment for bindings than for the constituent features, suggesting that object-based attention plays a pivotal role in retaining bindings in WM.     

Diagnosing and alleviating the impact of performance pressure on mathematical problem solving

High-pressure academic testing situations can lead people to perform below their actual ability levels by co-opting working memory (WM) resources needed for the task at hand (Beilock, 2008 Beilock, S. L. 2008. Math performance in stressful situations. Current Directions in Psychological Science, 17: 339–343. [Crossref], [Web of Science ®] , [Google Scholar]). In the current work we examine how performance pressure impacts WM and design an intervention to alleviate pressure's negative impact. Specifically, we explore the hypothesis that high-pressure situations trigger distracting thoughts and worries that rely heavily on verbal WM. Individuals performed verbally based and spatially based mathematics problems in a low-pressure or high-pressure testing situation. Results demonstrated that performance on problems that rely heavily on verbal WM resources was less accurate under high-pressure than under low-pressure tests. Performance on spatially based problems that do not rely heavily on verbal WM was not affected by pressure. Moreover, the more people reported worrying during test performance, the worse they performed on the verbally based (but not spatially based) maths problems. Asking some individuals to focus on the problem steps by talking aloud helped to keep pressure-induced worries at bay and eliminated pressure's negative impact on performance.     

Analogous selection processes in declarative and procedural working memory: N-2 list-repetition and task-repetition costs

Working memory (WM) holds and manipulates representations for ongoing cognition. Oberauer (Psychology of Learning and Motivation, 51, 45–100, 2009) distinguishes between two analogous WM sub-systems: a declarative WM which handles the objects of thought, and a procedural WM which handles the representations of (cognitive) actions. Here, we assessed whether analogous effects are observed when participants switch between memory sets (declarative representations) and when they switch between task sets (procedural representations). One mechanism assumed to facilitate switching in procedural WM is the inhibition of previously used, but currently irrelevant task sets, as indexed by n-2 task-repetition costs (Mayr & Keele, Journal of Experimental Psychology: General, 129(1), 4–26, 2000). In this study we tested for an analogous effect in declarative WM. We assessed the evidence for n-2 list-repetition costs across eight experiments in which participants switched between memory lists to perform speeded classifications, mental arithmetic, or a local recognition test. N-2 list-repetition costs were obtained consistently in conditions assumed to increase interference between memory lists, and when lists formed chunks in long-term memory. Further analyses across experiments revealed a substantial contribution of episodic memory to n-2 list-repetition costs, thereby questioning the interpretation of n-2 repetition costs as reflecting inhibition. We reanalyzed the data of eight task-switching experiments, and observed that episodic memory also contributes to n-2 task-repetition costs. Taken together, these results show analogous processing principles in declarative and procedural WM, and question the relevance of inhibitory processes for efficient switching between mental sets.     

The contributions of visual and central attention to visual working memory

We investigated the role of two kinds of attention—visual and central attention—for the maintenance of visual representations in working memory (WM). In Experiment 1 we directed attention to individual items in WM by presenting cues during the retention interval of a continuous delayed-estimation task, and instructing participants to think of the cued items. Attending to items improved recall commensurate with the frequency with which items were attended (0, 1, or 2 times). Experiments 1 and 3 further tested which kind of attention—visual or central—was involved in WM maintenance. We assessed the dual-task costs of two types of distractor tasks, one tapping sustained visual attention and one tapping central attention. Only the central attention task yielded substantial dual-task costs, implying that central attention substantially contributes to maintenance of visual information in WM. Experiment 2 confirmed that the visual-attention distractor task was demanding enough to disrupt performance in a task relying on visual attention. We combined the visual-attention and the central-attention distractor tasks with a multiple object tracking (MOT) task. Distracting visual attention, but not central attention, impaired MOT performance. Jointly, the three experiments provide a double dissociation between visual and central attention, and between visual WM and visual object tracking: Whereas tracking multiple targets across the visual filed depends on visual attention, visual WM depends mostly on central attention.     

Interference Control in Children with Attention Deficit/Hyperactivity Disorder

The view that Attention Deficit/Hyperactivity Disorder (ADHD) is associated with a diminished ability to control interfference is controversial and based exclusively on results of (verbal)-visual interference tasks, primarily the Stroop Color Word task. The present study compares medication-naïve children with ADHD (n?=?35 and n?=?51 in Experiments 1 and 2, respectively) with normal controls (n?=?26 and n?=?32, respectively) on two interference tasks to assess interference control in both the auditory and the visual modality: an Auditory Stroop task and a Simon task. Both groups showed reliable but equal degrees of interference on both tasks, suggesting that children with ADHD do not differ from normal controls in their ability to control interference in either modality.     

Working memory load and distraction: dissociable effects of visual maintenance and cognitive control

We establish a new dissociation between the roles of working memory (WM) cognitive control and visual maintenance in selective attention as measured by the efficiency of distractor rejection. The extent to which focused selective attention can prevent distraction has been shown to critically depend on the level and type of load involved in the task. High perceptual load that consumes perceptual capacity leads to reduced distractor processing, whereas high WM load that reduces WM ability to exert priority-based executive cognitive control over the task results in increased distractor processing (e.g., Lavie, Trends in Cognitive Sciences, 9(2), 75–82, 2005). WM also serves to maintain task-relevant visual representations, and such visual maintenance is known to recruit the same sensory cortices as those involved in perception (e.g., Pasternak & Greenlee, Nature Reviews Neuroscience, 6(2), 97–107, 2005). These findings led us to hypothesize that loading WM with visual maintenance would reduce visual capacity involved in perception, thus resulting in reduced distractor processing—similar to perceptual load and opposite to WM cognitive control load. Distractor processing was assessed in a response competition task, presented during the memory interval (or during encoding; Experiment 1a) of a WM task. Loading visual maintenance or encoding by increased set size for a memory sample of shapes, colors, and locations led to reduced distractor response competition effects. In contrast, loading WM cognitive control with verbal rehearsal of a random letter set led to increased distractor effects. These findings confirm load theory predictions and provide a novel functional distinction between the roles of WM maintenance and cognitive control in selective attention.     

Guidance of attention by information held in working memory

Information held in working memory (WM) can guide attention during visual search. The authors of recent studies have interpreted the effect of holding verbal labels in WM as guidance of visual attention by semantic information. In a series of experiments, we tested how attention is influenced by visual features versus category-level information about complex objects held in WM. Participants either memorized an object’s image or its category. While holding this information in memory, they searched for a target in a four-object search display. On exact-match trials, the memorized item reappeared as a distractor in the search display. On category-match trials, another exemplar of the memorized item appeared as a distractor. On neutral trials, none of the distractors were related to the memorized object. We found attentional guidance in visual search on both exact-match and category-match trials in Experiment 1, in which the exemplars were visually similar. When we controlled for visual similarity among the exemplars by using four possible exemplars (Exp. 2) or by using two exemplars rated as being visually dissimilar (Exp. 3), we found attentional guidance only on exact-match trials when participants memorized the object’s image. The same pattern of results held when the target was invariant (Exps. 2–3) and when the target was defined semantically and varied in visual features (Exp. 4). The findings of these experiments suggest that attentional guidance by WM requires active visual information.     

Do actions speak louder than words? Examining children’s ability to follow instructions

The ability to encode, retain, and implement instructions within working memory is central to many behaviours, including classroom activities which underpin learning. The three experiments presented here explored how action—planned, enacted, and observed—impacted 6- to 10-year-old’s ability to follow instructions. Experiment 1 (N = 81) found enacted recall was superior to verbal recall, but self-enactment at encoding had a negative effect on enacted recall and verbal recall. In contrast, observation of other-enactment (demonstration) at encoding facilitated both types of recall (Experiment 2a: N = 81). Further, reducing task demands through a reduced set of possible actions (Experiment 2b; N = 64) led to a positive effect of self-enactment at encoding for later recall (both verbal and enacted). Expecting to enact at recall may lead to the creation of an imaginal spatial-motoric plan at encoding that boosts later recall. However, children’s ability to use the additional spatial-motoric codes generated via self-enactment at encoding depends on the demands the task places on central executive resources. Demonstration at encoding appears to reduce executive demands and enable use of these additional forms of coding.     

习得性空间联结的迁移依赖于语义工作记忆

采用练习迁移范式与双任务范式相结合的设计来探讨练习所习得的空间联结在工作记忆中如何表征。被试先进行不一致空间的刺激—反应映射练习任务, 五分钟后, 随机迁移到单任务(Simon任务)或者双任务(Simon任务+语义工作记忆负荷任务或空间工作记忆负荷任务)。结果发现：不一致的练习能使单任务出现反转的Simon效应, 但语义工作记忆负荷会使反转的Simon效应消失, 而空间工作记忆负荷却对反转的Simon效应没有影响。实验结果表明练习产生的空间联结依赖于语义工作记忆。     

Close interpersonal proximity modulates visuomotor processing of object affordances in shared,social space

Research suggests that the human brain codes manipulable objects as possibilities for action, or affordances, particularly objects close to the body. Near-body space is not only a zone for body-environment interaction but also is socially relevant, as we are driven to preserve our near-body, personal space from others. The current, novel study investigated how close proximity of a stranger modulates visuomotor processing of object affordances in shared, social space. Participants performed a behavioural object recognition task both alone and with a human confederate. All object images were in participants’ reachable space but appeared relatively closer to the participant or the confederate. Results revealed when participants were alone, objects in both locations produced an affordance congruency effect but when the confederate was present, only objects nearer the participant elicited the effect. Findings suggest space is divided between strangers to preserve independent near-body space boundaries, and in turn this process influences motor coding for stimuli within that social space. To demonstrate that this visuomotor modulation represents a social phenomenon, rather than a general, attentional effect, two subsequent experiments employed nonhuman joint conditions. Neither a small, Japanese, waving cat statue (Experiment 2) nor a metronome (Experiment 3) modulated the affordance effect as in Experiment 1. These findings suggest a truly social explanation of the key interaction from Experiment 1. This study represents an important step toward understanding object affordance processing in real-world, social contexts and has implications broadly across fields of social action and cognition, and body space representation.     

Can the irrelevant speech effect turn into a stimulus suffix effect?

The irrelevant sound effect (ISE) and the stimulus suffix effect (SSE) are two qualitatively different phenomena, although in both paradigms irrelevant auditory material is played while a verbal serial recall task is being performed. Jones, Macken, and Nicholls (2004) Jones, D. M., Macken, W. J. and Nicholls, A. P. 2004. The phonological store of working memory: Is it phonological and is it a store?. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30: 656–674. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] have proposed the effect of irrelevant speech on auditory serial recall to switch from an ISE to an SSE mechanism, if the auditory-perceptive similarity of relevant and irrelevant material is maximized. The experiment reported here (n = 36) tested this hypothesis by exploring auditory serial recall performance both under irrelevant speech and under speech suffix conditions. These speech materials were spoken either by the same voice as the auditory items to be recalled or by a different voice. The experimental conditions were such that the likelihood of obtaining an SSE was maximized. The results, however, show that irrelevant speech—in contrast to speech suffixes—affects auditory serial recall independently of its perceptive similarity to the items to be recalled and thus in terms of an ISE mechanism that crucially extends to recency. The ISE thus cannot turn into an SSE.     

Estimating the executive demands of a one-back choice reaction time task by means of the selective interference paradigm

The present study proposes a new executive task, the one-back choice reaction time (RT) task, and implements the selective interference paradigm to estimate the executive demands of the processing components involved in this task. Based on the similarities between a one-back choice RT task and the n-back updating task, it was hypothesized that one-back delaying of a choice reaction involves executive control. In three experiments, framed within Baddeley's (1986) Baddeley, A. 1986. Working memory, Edited by: Baddeley, A. Oxford, , UK: Oxford University Press.  [Google Scholar] working-memory model, a one-back choice RT task, a choice RT task, articulatory suppression, and matrix tapping were performed concurrently with primary tasks involving verbal, visuospatial, and executive processing. The results demonstrate that one-back delaying of a choice reaction interferes with tasks requiring executive control, while the potential interference at the level of the verbal or visuospatial working memory slave systems remains minimal.     

Category width and expectancies: Risk conservatism or generalization?

To compare interpretations of category width as an equivalence range and as a risk-taking dimension, an experiment by Phares and Davis (1966) was replicated and extended to examine the effects of unexpected failure and success on expectations for subsequent task performance. High scoring subjects on Pettigrew's (1958) Category Width Scale showed less generalization of expectancy following success and greater generalization following unexpected failure. A measure of similarity between tasks failed to differentiate from narrow categorizers and suggests that broad categorizers may adopt more conservative expectancies following unexpected outcomes of any favorability.     

Recall is not necessary for verbal sequence learning

The question of whether overt recall of to-be-remembered material accelerates learning is important in a wide range of real-world learning settings. In the case of verbal sequence learning, previous research has proposed that recall either is necessary for verbal sequence learning (Cohen & Johansson Journal of Verbal Learning and Verbal Behavior, 6, 139–143, 1967; Cunningham, Healy, & Williams Journal of Experimental Psychology: Learning, Memory, and Cognition, 10, 575–597, 1984), or at least contributes significantly to it (Glass, Krejci, & Goldman Journal of Memory and Language, 28, 189–199, 1989; Oberauer & Meyer Memory, 17, 774–781, 2009). In contrast, here we show that the amount of previous spoken recall does not predict learning and is not necessary for it. We suggest that previous research may have underestimated participants’ learning by using suboptimal performance measures, or by using manual or written recall. However, we show that the amount of spoken recall predicted how much interference from other to-be-remembered sequences would be observed. In fact, spoken recall mediated most of the error learning observed in the task. Our data support the view that the learning of overlapping auditory–verbal sequences is driven by learning the phonological representations and not the articulatory motor responses. However, spoken recall seems to reinforce already learned representations, whether they are correct or incorrect, thus contributing to a participant identifying a specific stimulus as either “learned” or “new” during the presentation phase.     

Verbal and Nonverbal Anticipatory Mechanisms in Bilinguals

Empirical evidence collected so far has revealed that the bilingual advantage cannot be reduced to a single component of the executive functioning, and point to the need to understand the effects of bilingual experience on cognition as influencing a wider family of mental processes, including, but not limited to, cognitive control. The present study aims to explore a relatively underinvestigated domain of bilingual cognitive processes, namely anticipation, through a series of different paradigms tapping proactive and reactive mechanisms at different levels of cognitive complexity and linguistic components. The sample included 25 adult bilinguals (\(26.5\, \pm \,7.8\) years) and 25 monolinguals (\(26.4\, \pm \, 7\) years) matched for age, gender, and non-verbal IQ. Participants were administered two experimental tasks: Attentional Network Task (ANT), and auditory picture-word identification task. Compared to monolinguals, bilinguals showed overall faster reaction times and reduced conflict effect on both the ANT and the picture-word identification task. In addition, associations between performances in the nonverbal and the verbal tasks support the role of the nonverbal monitoring component on verbal anticipation. Results are discussed in light of a dynamic interaction between proactive and reactive mechanisms of cognitive control.     

Predicting eye-movement characteristics across multiple tasks from working memory and executive control

Individual differences in working memory (WM) and executive control are stable, related to cognitive task performance, and clinically predictive. Between-participant differences in eye movements are also highly reliable (Carter & Luke, Journal of Experimental Psychology: Human Perception and Performance, 2018; Henderson & Luke, Journal of Experimental Psychology: Human Perception and Performance, 40(4), 1390–1400, 2014). However, little is known about how higher order individual differences in cognition are related to these eye-movement characteristics. In the present study, healthy college-age participants performed several individual difference tasks to measure WM span and executive control. Participants also performed three eye-movement tasks: reading, visual search, and scene viewing. Across all tasks, higher WM scores were related to reduced skewness in fixation duration distributions. In reading, higher WM scores predicted longer saccades. In scene viewing, higher WM scores predicted longer fixations. Theoretical and clinical implications of these findings are discussed.     

Exploring temporal dissipation of attention settings in auditory task switching

Using a cued auditory task-switching variant of dichotic listening, we varied the response–cue interval (RCI) to examine temporal dissipation effects. On each trial, participants were presented with two different number words, one spoken by a female speaker and another by a male speaker (dichotic listening), that served as competing targets for a numerical judgment. The gender of the task-relevant speaker was indicated by a visual task cue prior to each trial. Experiment 1A used two different cues for each task (i.e., gender) and showed only small cue repetition benefits (same cue vs. alternate cue) but large auditory switch costs (alternate cue vs. task switch). A replication without immediate cue repetitions (Experiment 1B) showed very similar switch costs, suggesting that immediate cue repetitions play a negligible role for the size of auditory task switch costs. Moreover, switch costs were reduced when the (entirely task-irrelevant) location of the task-relevant speaker changed, relative to when it was unchanged, suggesting an episodic feature-binding component in our dichotic-listening task. Importantly, both experiments showed no effect of RCI on auditory switch costs. Because statistical power for this null effect was reasonably high across experiments (n?=?50), this finding suggests that auditory attention settings do not dissipate quickly over time.     

Dissociations between vision for perception and vision for action depend on the relative availability of egocentric and allocentric information

In three experiments, we scrutinized the dissociation between perception and action, as reflected by the contributions of egocentric and allocentric information. In Experiment 1, participants stood at the base of a large-scale one-tailed version of a Müller-Lyer illusion (with a hoop) and either threw a beanbag to the endpoint of the shaft or verbally estimated the egocentric distance to that location. The results confirmed an effect of the illusion on verbal estimates, but not on throwing, providing evidence for a dissociation between perception and action. In Experiment 2, participants observed a two-tailed version of the Müller-Lyer illusion from a distance of 1.5 m and performed the same tasks as in Experiment 1, yet neither the typical illusion effects nor a dissociation became apparent. Experiment 3 was a replication of Experiment 1, with the difference that participants stood at a distance of 1.5 m from the base of the one-tailed illusion. The results indicated an illusion effect on both the verbal estimate task and the throwing task; hence, there was no dissociation between perception and action. The presence (Exp. 1) and absence (Exp. 3) of a dissociation between perception and action may indicate that dissociations are a function of the relative availability of egocentric and allocentric information. When distance estimates are purely egocentric, dissociations between perception and action occur. However, when egocentric distance estimates have a (complementary) exocentric component, the use of allocentric information is promoted, and dissociations between perception and action are reduced or absent.     

The role of verbal memory in regressions during reading

During reading, participants generally move their eyes rightward on the line. A number of eye movements, called regressions, are made leftward, to words that have already been fixated. In the present study, we investigated the role of verbal memory during regressions. In Experiment 1, participants were asked to read sentences for comprehension. After reading, they were asked to make a regression to a target word presented auditorily. The results revealed that their regressions were guided by memory, as they differed from those of a control group who did not read the sentences. The role of verbal memory during regressions was then investigated by combining the reading task with articulatory suppression (Exps. 2 and 3). The results showed that articulatory suppression affected the size and the accuracy of the initial regression but had a minimal effect on corrective saccades. This suggests that verbal memory plays an important role in determining the location of the initial saccade during regressions.