Ensemble coding remains accurate under object and spatial visual working memory load

A number of studies have provided evidence that the visual system statistically summarizes large amounts of information that would exceed the limitations of attention and working memory (ensemble coding). However the necessity of working memory resources for ensemble coding has not yet been tested directly. In the current study, we used a dual task design to test the effect of object and spatial visual working memory load on size averaging accuracy. In Experiment 1, we tested participants’ accuracy in comparing the mean size of two sets under various levels of object visual working memory load. Although the accuracy of average size judgments depended on the difference in mean size between the two sets, we found no effect of working memory load. In Experiment 2, we tested the same average size judgment while participants were under spatial visual working memory load, again finding no effect of load on averaging accuracy. Overall our results reveal that ensemble coding can proceed unimpeded and highly accurately under both object and spatial visual working memory load, providing further evidence that ensemble coding reflects a basic perceptual process distinct from that of individual object processing.     

Large-scale ensemble averaging of ambulatory impedance cardiograms

Impedance cardiography has been used increasingly to measure human physiological responses to emotional and mentally engaging stimuli. The validity of large-scale ensemble averaging of ambulatory impedance cardiograms was evaluated for preejection period (PEP), interbeat interval, and dZ/dt_(min) amplitude. We tested whether the average of “classical” 60-sec ensemble averages across periods with fixed activity, posture, physical load, social situation, and location could be accurately estimated from a single large-scale ensemble average spanning these entire periods. Impedance and electrocardiograms were recorded for about 24-h from 21 subjects. Recordings were scored by seven raters, using both methods for each subject. Good agreement (average intraclass correlation coefficient was .91) between both ensemble averaging methods was found for all three cardiac function measures. The results indicate that for unambiguous ambulatory impedance cardiograms, large-scale ensemble averaging is valid, which makes measuring prolonged changes in cardiac sympathetic activity by measuring ambulatory PEP feasible even in large epidemiological samples.     

Electrophysiological evidence for greater attention to threat when cognitive control resources are depleted

In this study, we investigated the time course of attentional bias for threat-related (angry) facial expressions under conditions of high versus low cognitive (working memory) load. Event-related potential (ERP) and reaction time (RT) data were recorded while participants viewed pairs of faces (angry paired with neutral face) displayed for 500 ms and followed by a probe. Participants were required to respond to the probe while performing a concurrent task of holding in working memory a sequence of digits that were either in the same order (low memory load) or in a random mixed order (high memory load). The ERP results revealed that higher working memory load resulted in enhanced lateralized neural responses to threatening relative to neutral faces, consistent with greater initial orienting of attention to threatening faces (early N2pc: 180–252 ms) and enhanced maintenance of processing representations of threat (late N2pc, 252–320 ms; SPCN, 320–500 ms). The ERP indices showed significant positive relationships with each other, and also with the behavioral index of attentional bias to threat (reflected by faster RTs to probes replacing angry than neutral faces at 500 ms), although the latter index was not significantly influenced by memory load. Overall, the findings indicate that depletion of cognitive control resources, using a working memory manipulation, increases the capacity of task-irrelevant threat cues to capture and hold attention.     

Precision of working memory for speech sounds

Memory for speech sounds is a key component of models of verbal working memory (WM). But how good is verbal WM? Most investigations assess this using binary report measures to derive a fixed number of items that can be stored. However, recent findings in visual WM have challenged such “quantized” views by employing measures of recall precision with an analogue response scale. WM for speech sounds might rely on both continuous and categorical storage mechanisms. Using a novel speech matching paradigm, we measured WM recall precision for phonemes. Vowel qualities were sampled from a formant space continuum. A probe vowel had to be adjusted to match the vowel quality of a target on a continuous, analogue response scale. Crucially, this provided an index of the variability of a memory representation around its true value and thus allowed us to estimate how memories were distorted from the original sounds. Memory load affected the quality of speech sound recall in two ways. First, there was a gradual decline in recall precision with increasing number of items, consistent with the view that WM representations of speech sounds become noisier with an increase in the number of items held in memory, just as for vision. Based on multidimensional scaling (MDS), the level of noise appeared to be reflected in distortions of the formant space. Second, as memory load increased, there was evidence of greater clustering of participants' responses around particular vowels. A mixture model captured both continuous and categorical responses, demonstrating a shift from continuous to categorical memory with increasing WM load. This suggests that direct acoustic storage can be used for single items, but when more items must be stored, categorical representations must be used.     

Displacement of location in illusory line motion

Six experiments examined displacement in memory for the location of the line in illusory line motion (ILM; appearance or disappearance of a stationary cue is followed by appearance of a stationary line that is presented all at once, but the stationary line is perceived to “unfold” or “be drawn” from the end closest to the cue to the end most distant from the cue). If ILM was induced by having a single cue appear, then memory for the location of the line was displaced toward the cue, and displacement was larger if the line was closer to the cue. If ILM was induced by having one of two previously visible cues vanish, then memory for the location of the line was displaced away from the cue that vanished. In general, the magnitude of displacement increased and then decreased as retention interval increased from 50 to 250 ms and from 250 to 450 ms, respectively. Displacement of the line (a) is consistent with a combination of a spatial averaging of the locations of the cue and the line with a relatively weaker dynamic in the direction of illusory motion, (b) might be implemented in a spreading activation network similar to networks previously suggested to implement displacement resulting from implied or apparent motion, and (c) provides constraints and challenges for theories of ILM.     

Holistic and analytic processes in the comparison of letters

College students made “same-different” judgments about successively presented pairs of letters whose degree of difference, in terms of the number of line segments out of register, was systematically varied. Reaction time was found to decrease with increases in the degree of difference in “different” responses, as well as to depend on the number of line segments present in the second (probe) letter. “Same” responses were much faster than different responses and were unaffected by the number of segments in the probe letter. This pattern of results suggests analytic (component-by-component) processing of “different” letters and holistic processing of “same” letters. The results have important implications for studies of multi-letter comparisons, in which it is commonly assumed that letter comparisons are holistic in nature.     

What you say matters: Exploring visual–verbal interactions in visual working memory

The aim of this study was to explore whether the content of a simple concurrent verbal load task determines the extent of its interference on memory for coloured shapes. The task consisted of remembering four visual items while repeating aloud a pair of words that varied in terms of imageability and relatedness to the task set. At test, a cue appeared that was either the colour or the shape of one of the previously seen objects, with participants required to select the object's other feature from a visual array. During encoding and retention, there were four verbal load conditions: (a) a related, shape–colour pair (from outside the experimental set, i.e., “pink square”); (b) a pair of unrelated but visually imageable, concrete, words (i.e., “big elephant”); (c) a pair of unrelated and abstract words (i.e., “critical event”); and (d) no verbal load. Results showed differential effects of these verbal load conditions. In particular, imageable words (concrete and related conditions) interfered to a greater degree than abstract words. Possible implications for how visual working memory interacts with verbal memory and long-term memory are discussed.     

Two memories for geographical slant: Separation and interdependence of action and awareness

The present study extended previous findings of geographical slant perception, in which verbal judgments of the incline of hills were greatly overestimated but motoric (haptic) adjustments were much more accurate. In judging slant from memory following a brief or extended time delay, subjects’ verbal judgments were greater than those given when viewing hills. Motoric estimates differed depending on the length of the delay and place of response. With a short delay, motoric adjustments made in the proximity of the hill did not differ from those evoked during perception. When given a longer delay or when taken away from the hill, subjects’ motoric responses increased along with the increase in verbal reports. These results suggest two different memorial influences on action. With a short delay at the hill, memory for visual guidance is separate from the explicit memory informing the conscious response. With short or long delays away from the hill, short-term visual guidance memory no longer persists, and both motor and verbal responses are driven by an explicit representation. These results support recent research involving visual guidance from memory, where actions become influenced by conscious awareness, and provide evidence for communication between the “what” and “how” visual processing systems.     

Stimulus control of information processing in pigeon short-term memory

Six pigeons were trained initially on a delayed successive matching-to-sample task using red and green fields as sample and test stimuli. Following acquisition, each sample was followed either by a vertical line (“remember” cue), which indicated that sample memory would be tested, or by a horizontal line (“forget” cue), which indicated that sample memory would not be tested. During the experiments, sample memory on forget trials was tested occasionally. A series of five experiments revealed: (a) better retention on remember trials than on forget trials, (b) increased effectiveness of a forget cue when it followed closely sample offset, (c) more rapid forgetting over a retention interval ranging from 3 to 6 sec on forget trials than on remember trials, (d) a “cancellation” effect in which a remember cue which followed immediately the offset of a forget cue attenuated markedly the effectiveness of the forget cue, and (e) an “insulation” effect in which the effectiveness of a forget cue was reduced considerably when presented after a remember cue. It was concluded that pigeons actively process or rehearse the sample memory during the retention interval.     

Parallel averaging of size is possible but range-limited: A reply to Marchant,Simons, and De Fockert

In their recent paper, Marchant, Simons, and De Fockert (2013) claimed that the ability to average between multiple items of different sizes is limited by small samples of arbitrarily attended members of a set. This claim is based on a finding that observers are good at representing the average when an ensemble includes only two sizes distributed among all items (regular sets), but their performance gets worse when the number of sizes increases with the number of items (irregular sets). We argue that an important factor not considered by Marchant et al. (2013) is the range of size variation that was much bigger in their irregular sets. We manipulated this factor across our experiments and found almost the same efficiency of averaging for both regular and irregular sets when the range was stabilized. Moreover, highly regular sets consisting only of small and large items (two-peaks distributions) were averaged with greater error than sets with small, large, and intermediate items, suggesting a segmentation threshold determining whether all variable items are perceived as a single ensemble or distinct subsets. Our results demonstrate that averaging can actually be parallel but the visual system has some difficulties with it when some items differ too much from others.     

Active versus passive maintenance of visual nonverbal memory

Forgetting over the short term has challenged researchers for more than a century, largely because of the difficulty of controlling what goes on within the memory retention interval. But the “recent-negative-probe” procedure offers a valuable paradigm, by examining the influences of (presumably) unattended memoranda from prior trials. Here we used a recent-probe task to investigate forgetting for visual nonverbal short-term memory. The target stimuli (two visually presented abstract shapes) on a trial were followed after a retention interval by a probe, and participants indicated whether the probe matched one of the target items. Proactive interference, and hence memory for old trial probes, was observed, whereby participants were slowed in rejecting a nonmatching probe on the current trial that nevertheless matched a target item on the previous trial (a recent-negative probe). The attraction of the paradigm is that, by uncovering proactive influences of past-trial probe stimuli, it can be argued that active maintenance in memory of those probes is unlikely. In two experiments, we recorded such proactive interference of prior-trial items over a range of interstimulus (ISI) and intertrial (ITI) intervals (between 1 and 6 s, respectively). Consistent with a proposed two-process memory conception (the active–passive memory model, or APM), actively maintained memories on current trials decayed, but passively “maintained,” or unattended, visual memories of stimuli on past trials did not.     

Role of working memory load on selective attention to affectively valent information

Empirical evidence obtained with neutral stimuli has shown that selective attention relies on working memory functions as distractor processing occurs under conditions of high but not of low working memory load. We investigated whether these findings also hold for affectively valent distractors. In three experiments, participants completed the original Flanker task with famous people (Exps 1 and 2) and an affective Flanker task (Exp. 3) in which positive and negative words were presented superimposed onto happy, angry, and neutral faces under conditions of high or low working memory load. In line with past findings, results showed greater interference effects due to processing of distractors showing known people under high working memory load. In contrast interference effects due to processing of valent distractors occurred regardless of working memory load. The present findings are in contrast with those reported with neutral stimuli as they indicate that automatic evaluation of incoming affectively valent information occurs regardless of task priorities and of working memory load.     

Role of frontal cortex in attentional capture by singleton distractors

The role of frontal cortex in selective attention to visual distractors was examined in an attentional capture task in which participants searched for a unique shape in the presence or absence of an additional colour singleton distractor. The presence of the additional singleton was associated with slower behavioural responses to the shape target, and a greater neural signal in inferior frontal gyrus. To investigate the involvement of cognitive control functions of the frontal lobes in the capture of attention by the additional singletons, we measured the effect of the additional singleton in a context of either low or high working memory load. Whereas behavioural capture was unaffected by the level of load on working memory, greater activity associated with the presence of the additional singleton was observed in inferior frontal gyrus, but only under high load. This effect was greater in participants who experienced greater capture. We argue that the role of inferior frontal gyrus in selective attention is to detect potential sources of distraction.     

Detecting concealed information using feedback related event-related brain potentials

Employing an event-related potential (ERP)-based concealed information test (CIT), the present study investigated (1) the neurocognitive processes when people received feedbacks regarding their deceptive/truthful responses and (2) whether such feedback-related ERP activities can be used to detect concealed information above and beyond the recognition-related P300. During the CIT, participants were presented with rare, meaningful probes (their own names) embedded within a series of frequent yet meaningless irrelevants (others’ names). Participants were instructed to deny their recognition of the probes. Critically, following participants’ responses, they were provided with feedbacks regarding whether they succeeded or failed in the CIT. Replicating previous ERP-based CITs, we found a larger P300 elicited by probe compared to irrelevant. Regarding feedback-related ERPs, a temporospatial Principle Component Analyses found two ERP components that were not only sensitive to feedback manipulations but also can discriminate probe from irrelevant: an earlier, central-distributed positivity that was elicited by “success” feedbacks peaked around 219 ms; and a later, right central-distributed positivity that was also elicited by “success” feedbacks, peaked around 400 ms. Importantly, the feedback ERPs were not correlated with P300 that was elicited by probe/irrelevant, suggesting that these two ERPs reflect independent processes underlying memory concealment. These findings illustrate the feasibility and promise of using feedback-related ERPs to detect concealed memory and thus deception.     

The control of working memory resources in intentional forgetting: evidence from incidental probe word recognition

We combined an item-method directed forgetting paradigm with a secondary task requiring a response to discriminate the color of probe words presented 1400 ms, 1800 ms or 2600 ms following each study phase memory instruction. The speed to make the color discrimination was used to assess the cognitive demands associated with instantiating Remember (R) and Forget (F) instructions; incidental memory for probe words was used to assess whether instantiating an F instruction also affects items presented in close temporal proximity. Discrimination responses were slower following F than R instructions at the two longest intervals. Critically, at the 1800 ms interval, incidental probe word recognition was worse following F than R instructions, particularly when the study word was successfully forgotten (as opposed to unintentionally remembered). We suggest that intentional forgetting is an active cognitive process associated with establishing control over the contents of working memory.     

Attention is required for maintenance of feature binding in visual working memory

Working memory and attention are intimately connected. However, understanding the relationship between the two is challenging. Currently, there is an important controversy about whether objects in working memory are maintained automatically or require resources that are also deployed for visual or auditory attention. Here we investigated the effects of loading attention resources on precision of visual working memory, specifically on correct maintenance of feature-bound objects, using a dual-task paradigm. Participants were presented with a memory array and were asked to remember either direction of motion of random dot kinematograms of different colour, or orientation of coloured bars. During the maintenance period, they performed a secondary visual or auditory task, with varying levels of load. Following a retention period, they adjusted a coloured probe to match either the motion direction or orientation of stimuli with the same colour in the memory array. This allowed us to examine the effects of an attention-demanding task performed during maintenance on precision of recall on the concurrent working memory task. Systematic increase in attention load during maintenance resulted in a significant decrease in overall working memory performance. Changes in overall performance were specifically accompanied by an increase in feature misbinding errors: erroneous reporting of nontarget motion or orientation. Thus in trials where attention resources were taxed, participants were more likely to respond with nontarget values rather than simply making random responses. Our findings suggest that resources used during attention-demanding visual or auditory tasks also contribute to maintaining feature-bound representations in visual working memory—but not necessarily other aspects of working memory.     

Cognitive changes in conjunctive rule-based category learning: An ERP approach

When learning rule-based categories, sufficient cognitive resources are needed to test hypotheses, maintain the currently active rule in working memory, update rules after feedback, and to select a new rule if necessary. Prior research has demonstrated that conjunctive rules are more complex than unidimensional rules and place greater demands on executive functions like working memory. In our study, event-related potentials (ERPs) were recorded while participants performed a conjunctive rule-based category learning task with trial-by-trial feedback. In line with prior research, correct categorization responses resulted in a larger stimulus-locked late positive complex compared to incorrect responses, possibly indexing the updating of rule information in memory. Incorrect trials elicited a pronounced feedback-locked P300 elicited which suggested a disconnect between perception, and the rule-based strategy. We also examined the differential processing of stimuli that were able to be correctly classified by the suboptimal single-dimensional rule (“easy” stimuli) versus those that could only be correctly classified by the optimal, conjunctive rule (“difficult” stimuli). Among strong learners, a larger, late positive slow wave emerged for difficult compared with easy stimuli, suggesting differential processing of category items even though strong learners performed well on the conjunctive category set. Overall, the findings suggest that ERP combined with computational modelling can be used to better understand the cognitive processes involved in rule-based category learning.     

Illusions of familiarity caused by cohort activation

Subjects took part in an auditory lexical decision task followed by an auditory test of recognition memory for words presented in this task. Subjects categorized their recognition judgments as based on either recollection (“remember” responses) or familiarity (“know” responses). Distractor items in the recognition test included the base words from which the nonwords used in the lexical decision task were derived. Consistent with the findings of Wallace, Stewart, Sherman, and Mellor (1995), more false alarms were made to “late” base words (where the corresponding nonwords were created by changing a phoneme near the end of the word) than to “early” base words (corresponding nonwords were created by changing a phoneme at the beginning of the word). However, this effect was found in “know” responses but not in “remember” responses. The findings are attributed to enhanced fluency with which the base words are processed following their implicit activation at encoding.     

Remembered study mode: Support for the distinctiveness account of the production effect

The production effect is the finding that words spoken aloud at study are subsequently remembered better than are words read silently at study. According to the distinctiveness account, aloud words are remembered better because the act of speaking those words aloud is encoded and later recovery of this information can be used to infer that those words were studied. An alternative account (the strength-based account) is that memory strength is simply greater for words read aloud. To discriminate these two accounts, we investigated study mode judgements (i.e., “aloud”/”silent”/”new” ratings): The strength-based account predicts that “aloud” responses should positively correlate with memory strength, whereas the distinctiveness account predicts that accuracy of study mode judgements will be independent of memory strength. Across three experiments, where the strength of some silent words was increased by repetition, study mode was discriminable regardless of strength—even when the strength of aloud and repeated silent items was equivalent. Consistent with the distinctiveness account, we conclude that memory for “aloudness” is independent of memory strength and a likely candidate to explain the production effect.     

Improving time discrimination in children and adults in a temporal bisection task: The effects of feedback and no forced choice on decision and memory processes

In children aged 5 and 8 years old as well as in adults, Experiment 1 tested the effect of feedback on temporal performance using a bisection task. Experiment 2 added a no-forced-choice condition by giving the participants the possibility of responding “I don't know”. The results of Experiment 1 showed that providing feedback increased the bisection point value (point of subjective equality) in all age groups and increased sensitivity to time in the youngest children. The results of Experiment 2 showed that the proportion of “I don't know” responses peaked at the probe duration close to the arithmetic mean of the two anchor durations and decreased as the distance from this central value increased in both the adults and the 8-year-olds. In the 5-year-olds, the proportion of “I don't know” responses was lower and remained constant whatever the probe duration values. Unlike in the youngest children, giving the adults and the 8-year-olds the opportunity to respond “I don't know” increased their sensitivity to time. The modelling of our data suggests that providing feedback in a temporal bisection task affects both the memory and the decision processes. However, whereas the feedback-related effect had a similar effect on decision processes across the age groups, it had an opposite effect on memory processes in the 5-year-olds and the older participants, decreasing the variability of the memory representation of the anchor durations in the former while increasing it in the latter. Finally, in bisection, feedback only improved temporal performance when the memory for duration was imprecise as in the case of the children.