The representation of nonstructural information in visual memory: Evidence from image combination

Two experiments investigated the differential representation of the figure and ground of a picture in visual short-term and long-term memory. It is known (Hitch, Brandimonte, & Walker, 1995) that subjects find it more difficult to combine mental images of two separately presented pictures in order to identify a novel form when the two pictures are incongruent in color (i.e., when a black-on-white line drawing has to be combined with a white-on-black drawing). In the present experiments, thefigures were depicted in solid form to allow color congruity to be varied independently for figure and ground. Results showed a clear impairment in image combination when the to-be-combined figures were incongruent in color (black-on-gray and white-on-gray) but not when theirgrounds were incongruently colored (gray-on-black and gray-on-white). In this way, image combination was seen to be supported by a representation of the object depicted in the picture rather than by a literal representation of the picture itself (i.e., a pictorial code). In line with previous findings, the same representation was seen to support image combination based on short-term memory (Experiment 1) and long-term memory (Experiment 2), provided that in the latter case verbal recoding was precluded. When verbal recoding was allowed, image combination based on long-term memory was insensitive to color congruity, implying the involvement of a more abstract structural representation.     

Mental representation in visual/haptic crossmodal memory: evidence from interference effects

Two experiments used visual-, verbal-, and haptic-interference tasks during encoding (Experiment 1) and retrieval (Experiment 2) to examine mental representation of familiar and unfamiliar objects in visual/haptic crossmodal memory. Three competing theories are discussed, which variously suggest that these representations are: (a) visual; (b) dual-code—visual for unfamiliar objects but visual and verbal for familiar objects; or (c) amodal. The results suggest that representations of unfamiliar objects are primarily visual but that crossmodal memory for familiar objects may rely on a network of different representations. The pattern of verbal-interference effects suggests that verbal strategies facilitate encoding of unfamiliar objects regardless of modality, but only haptic recognition regardless of familiarity. The results raise further research questions about all three theoretical approaches.     

Mental representation in visual/haptic crossmodal memory: evidence from interference effects

Two experiments used visual-, verbal-, and haptic-interference tasks during encoding (Experiment 1) and retrieval (Experiment 2) to examine mental representation of familiar and unfamiliar objects in visual/haptic crossmodal memory. Three competing theories are discussed, which variously suggest that these representations are: (a) visual; (b) dual-code—visual for unfamiliar objects but visual and verbal for familiar objects; or (c) amodal. The results suggest that representations of unfamiliar objects are primarily visual but that crossmodal memory for familiar objects may rely on a network of different representations. The pattern of verbal-interference effects suggests that verbal strategies facilitate encoding of unfamiliar objects regardless of modality, but only haptic recognition regardless of familiarity. The results raise further research questions about all three theoretical approaches.     

Two types of serial dependence in visual working memory

Stimulus representations in working memory depend on memory traces of past stimuli both from previous trials and from the current trial. However, it is unclear whether the same or different mechanisms underlie this serial dependence across and within trials. We directly contrasted estimates of bias for pairs of immediately successive stimuli across and within trials. In each trial, participants memorized two consecutive motion direction stimuli (S1 and S2) and after a short delay were cued to report one of them. We found serial dependence across trials: The current S1 was attracted towards the preceding S2 when the latter had been cued for report. In contrast, within the same trial S2 was repulsed from S1. In addition, repulsion within a trial occurred for a broader range of motion direction differences between stimuli than attraction across trials. A second experiment in which 25% of trials did not require a response demonstrated that across‐trial attraction did not depend on whether the previous S2 actually had to be reported. Our findings provide evidence for two types of serial dependence operating across and within trials. They support the notion of different mechanisms integrating or segregating current from similar past memory contents depending on their task relevance.     

Representations in mental imagery and working memory: Evidence from different types of visual masks

Although few studies have systematically investigated the relationship between visual mental imagery and visual working memory, work on the effects of passive visual interference has generally demonstrated a dissociation between the two functions. In four experiments, we investigated a possible commonality between the two functions: We asked whether both rely on depictive representations. Participants judged the visual properties of letters using visual mental images or pictures of unfamiliar letters stored in short-term memory. Participants performed both tasks with two different types of interference: sequences of unstructured visual masks (consisting of randomly changing white and black dots) or sequences of structured visual masks (consisting of fragments of letters). The structured visual noise contained elements of depictive representations (i.e., shape fragments arrayed in space), and hence should interfere with stored depictive representations; the unstructured visual noise did not contain such elements, and thus should not interfere as much with such stored representations. Participants did in fact make more errors in both tasks with sequences of structured visual masks. Various controls converged in demonstrating that in both tasks participants used representations that depicted the shapes of the letters. These findings not only constrain theories of visual mental imagery and visual working memory, but also have direct implications for why some studies have failed to find that dynamic visual noise interferes with visual working memory.     

Two modality effects in verbal short-term memory: Evidence from sentence recall

This paper investigates the mechanisms underlying the standard modality effect (i.e., better recall performance for auditorily presented than for visually presented materials), and the modality congruency effect (i.e., better memory performance if the mode of recall and presentation are congruent rather than incongruent). We tested the assumption that the standard modality effect is restricted to the most recent word(s) of the sentences but occurs in both verbatim and gist recall (Experiments 1 and 2), whereas the modality congruency effect should be evident for the rest of the sentence when using verbatim recall (Experiment 3) but not when using gist recall (Experiment 4). All experiments used the Potter-Lombardi intrusion paradigm. When the target word was the most recent word of the sentence, a standard modality effect was found with both verbatim recall and gist recall. When the target word was included in the middle of the sentences, a modality congruency effect was found with verbatim recall but not with gist recall.     

Influence of short-term memory codes on visual image processing: evidence from image transformation tasks.

Three experiments showed that phonological recording of visual stimuli in short-term memory (STM) affects coding in long-term memory (LTM) and therefore performance on tasks involving generation and manipulation of visual images of the stimuli. An image transformation task was devised. It consists of mentally subtracting a part of an image to discover in the remainder another object. In Experiment 1, Ss were required to learn a set of easily nameable visual stimuli and then perform the subtraction task on images retrieved from LTM. Performance was significantly better when initial learning was accompanied by articulatory suppression (AS). Experiment 2 confirmed that AS had no effect when the task was performed on an image of a just-presented stimulus. In Experiment 3, the nameability of the stimuli was manipulated. The results replicated the effect of AS for items that were easy to name but showed no effect of AS for stimuli that were difficult to name.     

The types of stimuli loaded in memory can modulate its effects on visual search

The effects of memory load in visual search (VS) have shown a diversity of results from the absence through beneficial and detrimental effects of a concurrent memory load in VS performance. One of the hypotheses intended to explain the heterogeneity of results follows the idea proposed by certain models in the context of VS that the contents of working memory (WM) can modulate the attentional processes involved in VS (Desimone & Duncan, 1995; Duncan & Humphreys, 1989). In four experiments, we manipulated the similarity of information maintained in WM and those materials playing the role of target and distractors in the VS task. The results showed a beneficial effect in the first two experiments, where the materials in WM matched the target in VS. However, when they matched the distractors in the attentional task there is no effect in the slope of the search function. Present results strengthen those theories supporting that visual working memory is fractionated to allow for maintenance of items not essential to the attentional task (Downing & Dodds, 2004).     

Reward-priming impacts visual working memory maintenance: Evidence from human electrophysiology

Reward can benefit visual processing of reward-associated objects in a non-strategic way. Recent studies have suggested that such influence extends also to visual working memory (VWM) representations of reward-associated stimuli. However, it is not clear yet which mechanisms underlie the behavioural effects in VWM tasks: reward could directly impact on our ability to maintain representations in VWM or it could influence memory indirectly via priming of attentional selection. To distinguish between these alternatives we measured event-related potential indices of selective attention – the N2pc – and VWM maintenance – the CDA (contralateral delay activity) – while participants completed a VWM task. Results show that reward outcome in one trial caused similarly coloured targets to be strongly represented in VWM in subsequent trials, as expressed in a larger-amplitude CDA This was not preceded by a corresponding effect on attentional selection, in so far as our key manipulation had no impact on the N2pc. In a second experiment, we found that reward priming produced a behavioural benefit that emerged over time, suggesting that the representations of reward-associated items stored in VWM are more resistant to interference and decay. We conclude that when the task stresses VWM maintenance, it is at this representational level that reward will have impact.     

Effects of stimulus variability on perception and representation of spoken words in memory

A series of experiments was conducted to investigate the effects of stimulus variability on the memory representations for spoken words. A serial recall task was used to study the effects of changes in speaking rate, talker variability, and overall amplitude on the initial encoding, rehearsal, and recall of lists of spoken words. Interstimulus interval (ISI) was manipulated to determine the time course and nature of processing. The results indicated that at short ISIs, variations in both talker and speaking rate imposed a processing cost that was reflected in poorer serial recall for the primacy portion of word lists. At longer ISIs, however, variation in talker characteristics resulted in improved recall in initial list positions, whereas variation in speaking rate had no effect on recall performance. Amplitude variability had no effect on serial recall across all ISIs. Taken together, these results suggest that encoding of stimulus dimensions such as talker characteristics, speaking rate, and overall amplitude may be the result of distinct perceptual operations. The effects of these sources of stimulus variability in speech are discussed with regard to perceptual saliency, processing demands, and memory representation for spoken words.     

Two types of behavioral contrast in discrimination learning

Two groups of pigeons received daily discrimination training at two values on a line-tilt continuum. S+ (VI 1) and S- (EXT) intervals alternated, and a 30-sec criterion of no responding to S- was required before S+ returned. Rates of responding to S+ showed two separate contrast effects: at an intermediate stage of training a high peak rate appeared which declined, later in training, to a stable level still in excess of the VI baseline rate. The peak rate was correlated with the total number of responses to S-, while the final rate was not; suggesting that the peak rate and final rate may not be functions of the same variable. These results were compared with performance on a red-green discrimination where the two stages were not so clear. A line-tilt discrimination was repeated with fixed length S- intervals terminated by TO, and showed the same contrast magnitude in the final rate without any peak. The peak rate was interpreted as an effect of the ;punishment' contingency where responding to S- prolongs S- for 30 sec, while the final rate was taken to be analogous to previous demonstrations of contrast.     

The representation of objects and their attributes in memory: Evidence concerning memory for location

The general principle is advanced that different attributes of objects (e.g. shape and colour) are more readily associated when they are attributes of the same object than when they are attributes of different objects. Previous studies provide support for the principle, for they have shown that a shape is more readily associated with its own colour than, for example, with the colour of its background. In the present experiments, the principle was applied to the attributes of shape and location. In four experiments it was shown that a shape was more readily associated with its own location than with the location of another object. Differences in contiguity between the presentation of the shape and the location with which the shape was to be associated were controlled for, as were other factors. The results were interpreted as providing support for the general principle stated above. It was suggested that the general principle could be explained by supposing that memory is propositional in format.     

A sub-process view of working memory capacity: Evidence from effects of speech on prose memory

In this article we outline a “sub-process view” of working memory capacity (WMC). This view suggests that any relationship between WMC and another construct (e.g., reading comprehension) is actually a relationship with a specific part of the WMC construct. The parts, called sub-processes, are functionally distinct and can be measured by intrusion errors in WMC tasks. Since the sub-processes are functionally distinct, some sub-process may be related to a certain phenomenon, whereas another sub-process is related to other phenomena. In two experiments we show that a sub-process (measured by immediate/current-list intrusions) is related to the effects of speech on prose memory (semantic auditory distraction), whereas another sub-process (measured by delayed/prior-list intrusions), known for its contribution to reading comprehension, is not. In Experiment 2 we developed a new WMC task called “size-comparison span” and found that the relationship between WMC and semantic auditory distraction is actually a relationship with a sub-process measured by current-list intrusions in our new task.     

Combined effects of perceptual grouping cues on object representation: Evidence from motion-induced blindness

We investigated the combined effects of perceptual grouping cues (proximity and contour closure/proximity and orientation similarity) on object representation, using motion-induced blindness, a phenomenon in which salient visual stimuli perceptually disappear when surrounded by moving patterns. We presented as visual targets two stimuli in which a solid square was embedded in an outlined square. Participants reported whether the targets disappeared independently or simultaneously. The results showed that a relatively high proximity cue (with a 0.2-deg separation between the targets) modulated the perceptions of the independent or simultaneous disappearances of targets, regardless of other grouping cues. The contour closure cue modulated these disappearances in the 0.4- to 0.8-deg separations. Finally, the orientation similarity cue began to modulate these disappearances in the 0.6- to 0.8-deg separations. We suggest that the separation between the visual stimuli modulates the combined effects of perceptual grouping cues on complete object representation.     

Cued recall from image and sentence memory: a shift from episodic to identical elements representation

The applicability of the identical elements (IE) model of arithmetic fact retrieval (T. C. Rickard, A. F. Healy, & L. E. Bourne, 1994) to cued recall from episodic (image and sentence) memory was explored in 3 transfer experiments. In agreement with results from arithmetic, speedup following even minimal practice recalling a missing word from an episodically bound word triplet did not transfer positively to other cued recall items involving the same triplet. The shape of the learning curve further supported a shift from episode-based to IE-based recall, extending some models of skill learning to cued recall practice. In contrast with previous findings, these results indicate that a form of representation that is independent of the original episodic memory underlies cued-recall performance following minimal practice.     

Multiple states in visual working memory: Evidence from oculomotor capture by memory-matching distractors

Psychonomic Bulletin & Review - Visual working memory (VWM) representations interact with attentional guidance, but there is controversy over whether multiple VWM items simultaneously influence...     

Reconstructing the recent visual past: Hierarchical knowledge-based effects in visual working memory

This paper presents two experiments that examine the influence of multiple levels of knowledge on visual working memory (VWM). Experiment 1 focused on memory for faces. Faces were selected from continua that were constructed by morphing two face photographs in 100 steps; half of the continua morphed a famous face into an unfamiliar one, while the other half used two unfamiliar faces. Participants studied six sequentially presented faces each from a different continuum, and at test they had to locate one of these within its continuum. Experiment 2 examined immediate memory for object sizes. On each trial, six images were shown; these were either all vegetables or all random shapes. Immediately after each list, one item was presented again, in a new random size, and participants reproduced its studied size. Results suggested that two levels of knowledge influenced VWM. First, there was an overall central-tendency bias whereby items were remembered as being closer to the overall average or central tokens (averaged across items and trials) than they actually were. Second, when object knowledge was available for the to-be-remembered items (i.e., famous face or typical size of a vegetable) a further bias was introduced in responses. The results extend the findings of Hemmer and Steyvers (Psychonomic Bulletin & Review, 16, 80–87, 2009a) from episodic memory to VWM and contribute to the growing literature which illustrates the complexity and flexibility of the representations subtending VWM performance (e.g., Bae, Olkkonen, Allred, & Flombaum, Journal of Experimental Psychology: General, 144(4):744–63, 2015).