Guidance of attention by information held in working memory

Information held in working memory (WM) can guide attention during visual search. The authors of recent studies have interpreted the effect of holding verbal labels in WM as guidance of visual attention by semantic information. In a series of experiments, we tested how attention is influenced by visual features versus category-level information about complex objects held in WM. Participants either memorized an object’s image or its category. While holding this information in memory, they searched for a target in a four-object search display. On exact-match trials, the memorized item reappeared as a distractor in the search display. On category-match trials, another exemplar of the memorized item appeared as a distractor. On neutral trials, none of the distractors were related to the memorized object. We found attentional guidance in visual search on both exact-match and category-match trials in Experiment 1, in which the exemplars were visually similar. When we controlled for visual similarity among the exemplars by using four possible exemplars (Exp. 2) or by using two exemplars rated as being visually dissimilar (Exp. 3), we found attentional guidance only on exact-match trials when participants memorized the object’s image. The same pattern of results held when the target was invariant (Exps. 2–3) and when the target was defined semantically and varied in visual features (Exp. 4). The findings of these experiments suggest that attentional guidance by WM requires active visual information.     

An unforgettable apple: Memory and attention for forbidden objects

Are we humans drawn to the forbidden? From jumbo-sized soft drinks to illicit substances, the influence of prohibited ownership on subsequent demand has made this question a pressing one. We know that objects that we ourselves own have a heightened psychological saliency, relative to comparable objects that are owned by others, but do these kinds of effects extend from self-owned to “forbidden” objects? To address this question, we developed a modified version of the Turk shopping paradigm in which “purchased” items were assigned to various recipients. Participants sorted everyday objects labeled as “self-owned”, “other-owned,” and either “forbidden to oneself” (Experiment 1) or “forbidden to everyone” (Experiment 2). Subsequent surprise recognition memory tests revealed that forbidden objects with high (Experiment 1) but not with low (Experiment 2) self-relevance were recognized as well as were self-owned objects, and better than other-owned objects. In a third and final experiment, we used event-related potentials (ERPs) to determine whether self-owned and self-forbidden objects, which showed a common memory advantage, are in fact treated the same at a neurocognitive–affective level. We found that both object types were associated with enhanced cognitive analysis, relative to other-owned objects, as measured by the P300 ERP component. However, we also found that self-forbidden objects uniquely triggered an enhanced response preceding the P300, in an ERP component (the N2) that is sensitive to more rapid, affect-related processing. Our findings thus suggest that, whereas self-forbidden objects share a common cognitive signature with self-owned objects, they are unique in being identified more quickly at a neurocognitive level.     

Focused attention improves working memory: implications for flexible-resource and discrete-capacity models

Performance in working memory (WM) tasks depends on the capacity for storing objects and on the allocation of attention to these objects. Here, we explored how capacity models need to be augmented to account for the benefit of focusing attention on the target of recall. Participants encoded six colored disks (Experiment 1) or a set of one to eight colored disks (Experiment 2) and were cued to recall the color of a target on a color wheel. In the no-delay condition, the recall-cue was presented after a 1,000-ms retention interval, and participants could report the retrieved color immediately. In the delay condition, the recall-cue was presented at the same time as in the no-delay condition, but the opportunity to report the color was delayed. During this delay, participants could focus attention exclusively on the target. Responses deviated less from the target’s color in the delay than in the no-delay condition. Mixture modeling assigned this benefit to a reduction in guessing (Experiments 1 and 2) and transposition errors (Experiment 2). We tested several computational models implementing flexible or discrete capacity allocation, aiming to explain both the effect of set size, reflecting the limited capacity of WM, and the effect of delay, reflecting the role of attention to WM representations. Both models fit the data better when a spatially graded source of transposition error is added to its assumptions. The benefits of focusing attention could be explained by allocating to this object a higher proportion of the capacity to represent color.     

A motor similarity effect in object memory

In line with theories of embodied cognition (e.g., Versace et al. European Journal of Cognitive Psychology, 21, 522–560, 2009), several studies have suggested that the motor system used to interact with objects in our environment is involved in object recognition (e.g., Helbig, Graf, & Kiefer Experimental Brain Research, 174, 221-228, 2006). However, the role of the motor system in immediate memory for objects is more controversial. The objective of the present study was to investigate the role of the motor system in object memory by manipulating the similarity between the actions associated to series of objects to be retained in memory. In Experiment 1, we showed that lists of objects associated to dissimilar actions were better recalled than lists associated to similar actions. We then showed that this effect was abolished when participants were required to perform a concurrent motor suppression task (Experiment 2) and when the objects to be memorized were unmanipulable (Experiment 3). The motor similarity effect provides evidence for the role of motor affordances in object memory.     

Top-down constraint on recognition memory

Can recognition memory be constrained “at the front end,” such that people are more likely to retrieve information about studying a recognition-test probe from a specified target source than they are to retrieve such information about a probe from a nontarget source? We adapted a procedure developed by Jacoby, Shimizu, Daniels, and Rhodes (Psychonomic Bulletin & Review 12:852–857, 2005) to address this question. Experiment 1 yielded evidence of source-constrained retrieval, but that pattern was not significant in Experiments 2, 3, and 4 (nor in several unpublished pilot experiments). In Experiment 5, in which items from the two studied sources were perceptibly different, a pattern consistent with front-end constraint of recognition emerged, but this constraint was likely exercised via visual attention rather than memory. Experiment 6 replicated both the absence of a significant constrained-retrieval pattern when the sources did not differ perceptibly (as in Exps. 2, 3 and 4) and the presence of that pattern when they did differ perceptibly (as in Exp. 5). Our results suggest that people can easily constrain recognition when items from the to-be-recognized source differ perceptibly from items from other sources (presumably via visual attention), but that it is difficult to constrain retrieval solely on the basis of source memory.     

Animates are better remembered than inanimates: further evidence from word and picture stimuli

In three experiments, we showed that animate entities are remembered better than inanimate entities. Experiment 1 revealed better recall for words denoting animate than inanimate items. Experiment 2 replicated this finding with the use of pictures. In Experiment 3, we found better recognition for animate than for inanimate words. Importantly, we also found a higher recall rate of “remember” than of “know” responses for animates, whereas the recall rates were similar for the two types of responses for inanimate items. This finding suggests that animacy enhances not only the quantity but also the quality of memory traces, through the recall of contextual details of previous experiences (i.e., episodic memory). Finally, in Experiment 4, we tested whether the animacy effect was due to animate items being richer in terms of sensory features than inanimate items. The findings provide further evidence for the functionalist view of memory championed by Nairne and coworkers (Nairne, 2010; Nairne & Pandeirada, Cognitive Psychology, 61:1–22, 2010a, 2010b).     

The mental wormhole: Internal attention shifts without regard for distance

Attention operates perceptually on items in the environment, and internally on objects in visuospatial working memory. In the present study, we investigated whether spatial and temporal constraints affecting endogenous perceptual attention extend to internal attention. A retro-cue paradigm in which a cue is presented beyond the range of iconic memory and after stimulus encoding was used to manipulate shifts of internal attention. Participants?? memories were tested for colored circles (Experiments 1, 2, 3a, 4) or for novel shapes (Experiment 3b) and their locations within an array. In these experiments, the time to shift internal attention (Experiments 1 and 3) and the eccentricity of encoded objects (Experiments 2?C4) were manipulated. Our data showed that, unlike endogenous perceptual attention, internal shifts of attention are not modulated by stimulus eccentricity. Across several timing parameters and stimuli, we found that shifts of internal attention require a minimum quantal amount of time regardless of the object eccentricity at encoding. Our findings are consistent with the view that internal attention operates on objects whose spatial information is represented in relative terms. Although endogenous perceptual attention abides by the laws of space and time, internal attention can shift across spatial representations without regard for physical distance.     

The effects of interleaving versus blocking on foreign language pronunciation learning

Many studies have shown that students learn better when they are given repeated exposures to different concepts in a way that is shuffled or interleaved, rather than blocked (e.g., Rohrer Educational Psychology Review, 24, 355–367, 2012). The present study explored the effects of interleaving versus blocking on learning French pronunciations. Native English speakers learned several French words that conformed to specific pronunciation rules (e.g., the long “o” sound formed by the letter combination “eau,” as in bateau), and these rules were presented either in blocked fashion (bateau, carreau, fardeau . . . mouton, genou, verrou . . . tandis, verglas, admis) or in interleaved fashion (bateau, mouton, tandis, carreau, genou, verglas . . .). Blocking versus interleaving was manipulated within subjects (Experiments 1–3) or between subjects (Experiment 4), and participants’ pronunciation proficiency was later tested through multiple-choice tests (Experiments 1, 2, and 4) or a recall test (Experiment 3). In all experiments, blocking benefited the learning of pronunciations more than did interleaving, and this was true whether participants learned only 4 words per rule (Experiments 1–3) or 15 words per rule (Experiment 4). Theoretical implications of these findings are discussed.     

Impact of planned movement direction on judgments of visual locations

The present study examined if and how the direction of planned hand movements affects the perceived direction of visual stimuli. In three experiments participants prepared hand movements that deviated regarding direction (“Experiment 1” and “2”) or distance relative to a visual target position (“Experiment 3”). Before actual execution of the movement, the direction of the visual stimulus had to be estimated by means of a method of adjustment. The perception of stimulus direction was biased away from planned movement direction, such that with leftward movements stimuli appeared somewhat more rightward than with rightward movements. Control conditions revealed that this effect was neither a mere response bias, nor a result of processing or memorizing movement cues. Also, shifting the focus of attention toward a cued location in space was not sufficient to induce the perceptual bias observed under conditions of movement preparation (“Experiment 4”). These results confirm that characteristics of planned actions bias visual perception, with the direction of bias (contrast or assimilation) possibly depending on the type of the representations (categorical or metric) involved.     

Concept formation and categorization of complex,asymmetric, and impossible figures

Impossible figures are striking examples of inconsistencies between global and local perceptual structures, in which the overall spatial configuration of the depicted image does not yield a coherent three-dimensional object. In order to investigate whether structural “impossibility” is an important perceptual property of depicted objects, we used a category formation task in which subjects were asked to divide pictures of shapes into groups that seemed most natural to them. Category formation is usually unidimensional, such that sorting is dominated by a single perceptual property, so this task can serve as a measure of which dimensions are most salient. In Experiment 1, subjects received sets of 12 line drawings consisting of six possible and six impossible objects. Very few subjects grouped the figures by impossibility on the first try, and only half did so after multiple attempts at sorting. In Experiment 2, we investigated other global properties of figures: symmetry and complexity. Subjects readily sorted objects by complexity, but seldom by symmetry. In Experiment 3, subjects were asked to draw each of the figures before sorting them, which had only a minimal effect on categorization. Finally, in Experiment 4, subjects were explicitly instructed to divide the shapes by symmetry or impossibility. Performance on this task was perfect for symmetry, but not for impossibility. Although global properties of figures seem extremely important to our perception, the results suggest that some of these cues are not immediately obvious or salient for most observers.     

Infants’ discrimination of crossed and uncrossed horizontal disparity

In a series of preferential-looking experiments, infants 5 to 6 months of age were tested for their responsiveness to crossed and uncrossed horizontal disparity. In Experiments 1 and 2, infants were presented with dynamic random dot stereograms displaying a square target defined by either a 0.5° crossed or a 0.5° uncrossed horizontal disparity and a square control target defined by a 0.5° vertical disparity. In Experiment 3, infants were presented with the crossed and the uncrossed horizontal disparity targets used in Experiments 1 and 2. According to the results, the participants looked more often at the crossed (Experiment 1), as well as the uncrossed (Experiment 2), horizontal disparity targets than at the vertical disparity target. These results suggest that the infants were sensitive to both crossed and uncrossed horizontal disparity information. Moreover, the participants exhibited a natural visual preference for the crossed over the uncrossed horizontal disparity (Experiment 3). Since prior research established natural looking and reaching preferences for the (apparently) nearer of two objects, this finding is consistent with the hypothesis that the infants were able to extract the depth relations specified by crossed (near) and uncrossed (far) horizontal disparity.     

Saccade latency reveals episodic representation of object color

While previous studies suggest that identity, but not color, plays a role in episodic object representation, such studies have typically used tasks in which only identity is relevant, raising the possibility that the results reflect task demands, rather than the general principles that underlie object representation. In the present study, participants viewed a preview display containing one (Experiments 1 and 2) or two (Experiment 3) letters, then viewed a target display containing a single letter, in either the same or a different location. Participants executed an immediate saccade to fixate the target; saccade latency served as the dependent variable. In all experiments, saccade latencies were longer to fixate a target appearing in its previewed location, consistent with a bias to attend to new objects rather than to objects for which episodic representations are being maintained in visual working memory. The results of Experiment 3 further demonstrate, however, that changing target color eliminates these latency differences. The results suggest that color and identity are part of episodic representation even when not task relevant and that examining biases in saccade execution may be a useful approach to studying episodic representation.     

Estimating working memory capacity for lists of nonverbal sounds

Working memory (WM) capacity limit has been extensively studied in the domains of visual and verbal stimuli. Previous studies have suggested a fixed WM capacity of typically about three or four items, on the basis of the number of items in working memory reaching a plateau after several items as the set size increases. However, the fixed WM capacity estimate appears to rely on categorical information in the stimulus set (Olsson & Poom Proceedings of the National Academy of Sciences 102:8776-8780, 2005). We designed a series of experiments to investigate nonverbal auditory WM capacity and its dependence on categorical information. Experiments 1 and 2 used simple tones and revealed capacity limit of up to two tones following a 6-s retention interval. Importantly, performance was significantly higher at set sizes 2, 3, and 4 when the frequency difference between target and test tones was relatively large. In Experiment 3, we added categorical information to the simple tones, and the effect of tone change magnitude decreased. Maximal capacity for each individual was just over three sounds, in the range of typical visual procedures. We propose that two types of information, categorical and detailed acoustic information, are kept in WM and that categorical information is critical for high WM performance.     

The emergence of explicit knowledge from implicit learning

Substantial evidence has highlighted the ability of observers to incidentally extract statistical contingencies present in visual environments. This study examined whether the knowledge extracted regarding statistical contingencies is unconscious initially, even when it becomes fully accessible to conscious awareness after extensive training. Using a “typical” contextual cuing procedure adapted to real-world scenes, we first observed that, after extensive training in searching for a target within repeated scenes, knowledge about regularities was associated with conscious awareness (Experiment 1). However, both subjective and objective measures of consciousness revealed that in the early phase of training, learning of regular structures first takes place at an unconscious level (Experiments 2 and 3). These results are discussed in the light of the causal relationships between learning and consciousness.     

Coarse guidance by numerosity in visual search

In five experiments, we examined whether the number of items can guide visual focal attention. Observers searched for the target area with the largest (or smallest) number of dots (squares in Experiment 4 and “checkerboards” in Experiment 5) among distractor areas with a smaller (or larger) number of dots. Results of Experiments 1 and 2 show that search efficiency is determined by target to distractor dot ratios. In searches where target items contained more dots than did distractor items, ratios over 1.5:1 yielded efficient search. Searches for targets where target items contained fewer dots than distractor items were harder. Here, ratios needed to be lower than 1:2 to yield efficient search. When the areas of the dots and of the squares containing them were fixed, as they were in Experiments 1 and 2, dot density and total dot area increased as dot number increased. Experiment 3 removed the density and area cues by allowing dot size and total dot area to vary. This produced a marked decline in search performance. Efficient search now required ratios of above 3:1 or below 1:3. By using more realistic and isoluminant stimuli, Experiments 4 and 5 show that guidance by numerosity is fragile. As is found with other features that guide focal attention (e.g., color, orientation, size), the numerosity differences that are able to guide attention by bottom-up signals are much coarser than the differences that can be detected in attended stimuli.     

Time-compressed spoken word primes crossmodally enhance processing of semantically congruent visual targets

Findings from three experiments support the conclusion that auditory primes facilitate the processing of related targets. In Experiments 1 and 2, we employed a crossmodal Stroop color identification task with auditory color words (as primes) and visual color patches (as targets). Responses were faster for congruent priming, in comparison to neutral or incongruent priming. This effect also emerged for different levels of time compression of the auditory primes (to 30 % and 10 % of the original length; i.e., 120 and 40 ms) and turned out to be even more pronounced under high-perceptual-load conditions (Exps. 1 and 2). In Experiment 3, target-present or -absent decisions for brief target displays had to be made, thereby ruling out response-priming processes as a cause of the congruency effects. Nevertheless, target detection (d') was increased by congruent primes (30 % compression) in comparison to incongruent or neutral primes. Our results suggest semantic object-based auditory–visual interactions, which rapidly increase the denoted target object’s salience. This would apply, in particular, to complex visual scenes.     

The function of regressions in reading: Backward eye movements allow rereading

Standard text reading involves frequent eye movements that go against normal reading order. The function of these “regressions” is still largely unknown. The most obvious explanation is that regressions allow for the rereading of previously fixated words. Alternatively, physically returning the eyes to a word’s location could cue the reader’s memory for that word, effectively aiding the comprehension process via location priming (the “deictic pointer hypothesis”). In Experiment 1, regression frequency was reduced when readers knew that information was no longer available for rereading. In Experiment 2, readers listened to auditorily presented text while moving their eyes across visual placeholders on the screen. Here, rereading was impossible, but deictic pointers remained available, yet the readers did not make targeted regressions in this experiment. In Experiment 3, target words in normal sentences were changed after reading. Where the eyes later regressed to these words, participants generally remained unaware of the change, and their answers to comprehension questions indicated that the new meaning of the changed word was what determined their sentence representations. These results suggest that readers use regressions to reread words and not to cue their memory for previously read words.     

The visual system prioritizes locations near corners of surfaces (not just locations near a corner)

When a new visual object appears, attention is directed toward it. However, some locations along the outline of the new object may receive more resources, perhaps as a consequence of their relative importance in describing its shape. Evidence suggests that corners receive enhanced processing, relative to the straight edges of an outline (corner enhancement effect). Using a technique similar to that in an original study in which observers had to respond to a probe presented near a contour (Cole et al. in Journal of Experimental Psychology: Human Perception and Performance 27:1356–1368, 2001), we confirmed this effect. When figure–ground relations were manipulated using shaded surfaces (Exps. 1 and 2) and stereograms (Exps. 3 and 4), two novel aspects of the phenomenon emerged: We found no difference between corners perceived as being convex or concave, and we found that the enhancement was stronger when the probe was perceived as being a feature of the surface that the corner belonged to. Therefore, the enhancement is not based on spatial aspects of the regions in the image, but critically depends on figure–ground stratification, supporting the link between the prioritization of corners and the representation of surface layout.     

An electrophysiological study of the object-based correspondence effect: Is the effect triggered by an intended grasping action?

We examined Goslin, Dixon, Fischer, Cangelosi, and Ellis’s (Psychological Science 23:152–157, 2012) claim that the object-based correspondence effect (i.e., faster keypress responses when the orientation of an object’s graspable part corresponds with the response location than when it does not) is the result of object-based attention (vision–action binding). In Experiment 1, participants determined the category of a centrally located object (kitchen utensil vs. tool), as in Goslin et al.’s study. The handle orientation (left vs. right) did or did not correspond with the response location (left vs. right). We found no correspondence effect on the response times (RTs) for either category. The effect was also not evident in the P1 and N1 components of the event-related potentials, which are thought to reflect the allocation of early visual attention. This finding was replicated in Experiment 2 for centrally located objects, even when the object was presented 45 times (33 more times than in Exp. 1). Critically, the correspondence effects on RTs, P1s, and N1s emerged only when the object was presented peripherally, so that the object handle was clearly located to the left or right of fixation. Experiment 3 provided further evidence that the effect was observed only for the base-centered objects, in which the handle was clearly positioned to the left or right of center. These findings contradict those of Goslin et al. and provide no evidence that an intended grasping action modulates visual attention. Instead, the findings support the spatial-coding account of the object-based correspondence effect.     

Integration of visuospatial information encoded from different viewpoints

Two experiments investigated whether separate sets of objects viewed in the same environment but from different views were encoded as a single integrated representation or maintained as distinct representations. Participants viewed two circular layouts of objects that were placed around them in a round (Experiment 1) or a square (Experiment 2) room and were later tested on perspective-taking trials requiring retrieval of either one layout (within-layout trials) or both layouts (between-layout trials). Results from Experiment 1 indicated that participants did not integrate the two layouts into a single representation. Imagined perspective taking was more efficient on within- than on between-layout trials. Furthermore, performance for within-layout trials was best from the perspective that each layout was studied. Results from Experiment 2 indicated that the stable environmental reference frame provided by the square room caused many, but not all, participants to integrate all locations within a common representation. Participants who integrated performed equally well for within-layout and between-layout judgments and also represented both layouts using a common reference frame. Overall, these findings highlight the flexibility of organizing information in spatial memory.