Task-relevant perceptual features can define categories in visual memory too

Although Konkle, Brady, Alvarez, and Oliva (2010, Journal of Experimental Psychology: General, 139(3), 558) claim that visual long-term memory (VLTM) is organized on underlying conceptual, not perceptual, information, visual memory results from visual search tasks are not well explained by this theory. We hypothesized that when viewing an object, any task-relevant visual information is critical to the organizational structure of VLTM. In two experiments, we examined the organization of VLTM by measuring the amount of retroactive interference created by objects possessing different combinations of task-relevant features. Based on task instructions, only the conceptual category was task relevant or both the conceptual category and a perceptual object feature were task relevant. Findings indicated that when made task relevant, perceptual object feature information, along with conceptual category information, could affect memory organization for objects in VLTM. However, when perceptual object feature information was task irrelevant, it did not contribute to memory organization; instead, memory defaulted to being organized around conceptual category information. These findings support the theory that a task-defined organizational structure is created in VLTM based on the relevance of particular object features and information.     

无关长时记忆表征能否引导视觉注意选择?

与任务相关的长时记忆表征在引导视觉注意选择的过程中扮演着重要的角色,它可以使人们在熟悉的视觉情境中快速搜索目标刺激,并偏离干扰刺激。但当长时记忆表征与任务无关时,还能否引导视觉注意选择?目前还不清楚。实验1采用眼动追踪技术直接比较无关工作记忆表征与无关长时记忆表征在视觉搜索阶段对视觉注意的捕获效应,行为反应时与首次注视点百分率的结果都发现,当无关工作记忆表征在视觉搜索中再次出现时能引导视觉注意偏向到与之匹配的干扰刺激,但无关长时记忆表征并没有表现出类似的注意引导效应;实验2探讨记忆表征由工作记忆系统转移到长时记忆系统的过程中对视觉注意的引导效应,结果发现,随着记忆表征的转移,注意引导效应消失了,实验3排除工作记忆表征的干扰后,依然没有发现无关长时记忆表征对注意的引导效应。以上结果表明,无关长时记忆表征并不能像工作记忆表征一样引导视觉注意选择,工作记忆表征和长时记忆表征对视觉注意的引导属于两个不同的认知过程。     

Strategic and automatic effects of visual working memory on attention in visual search

Previous research indicates that visual attention can be automatically captured by sensory inputs that match the contents of visual working memory. However, Woodman and Luck (2007) showed that information in working memory can be used flexibly as a template for either selection or rejection according to task demands. We report two experiments that extend their work. Participants performed a visual search task while maintaining items in visual working memory. Memory items were presented for either a short or long exposure duration immediately prior to the search task. Memory was tested by a change-detection task immediately afterwards. On a random half of trials items in memory matched either one distractor in the search task (Experiment 1) or three (Experiment 2). The main result was that matching distractors speeded or slowed target detection depending on whether memory items were presented for a long or short duration. These effects were more in evidence with three matching distractors than one. We conclude that the influence of visual working memory on visual search is indeed flexible but is not solely a function of task demands. Our results suggest that attentional capture by perceptual inputs matching information in visual working memory involves a fast automatic process that can be overridden by a slower top-down process of attentional avoidance.     

The effect of spatial and nonspatial contextual information on visual object memory

Recent research has found visual object memory can be stored as part of a larger scene representation rather than independently of scene context. The present study examined how spatial and nonspatial contextual information modulate visual object memory. Two experiments tested participants’ visual memory by using a change detection task in which a target object's orientation was either the same as it appeared during initial viewing or changed. In addition, we examined the effect of spatial and nonspatial contextual manipulations on change detection performance. The results revealed that visual object representations can be maintained reliably after viewing arrays of objects. Moreover, change detection performance was significantly higher when either spatial or nonspatial contextual information remained the same in the test image. We concluded that while processing complex visual stimuli such as object arrays, visual object memory can be stored as part of a comprehensive scene representation, and both spatial and nonspatial contextual changes modulate visual memory retrieval and comparison.     

Learning in repeated visual search

Visual search (e.g., finding a specific object in an array of other objects) is performed most effectively when people are able to ignore distracting nontargets. In repeated search, however, incidental learning of object identities may facilitate performance. In three experiments, with over 1,100 participants, we examined the extent to which search could be facilitated by object memory and by memory for spatial layouts. Participants searched for new targets (real-world, nameable objects) embedded among repeated distractors. To make the task more challenging, some participants performed search for multiple targets, increasing demands on visual working memory (WM). Following search, memory for search distractors was assessed using a surprise two-alternative forced choice recognition memory test with semantically matched foils. Search performance was facilitated by distractor object learning and by spatial memory; it was most robust when object identity was consistently tied to spatial locations and weakest (or absent) when object identities were inconsistent across trials. Incidental memory for distractors was better among participants who searched under high WM load, relative to low WM load. These results were observed when visual search included exhaustive-search trials (Experiment 1) or when all trials were self-terminating (Experiment 2). In Experiment 3, stimulus exposure was equated across WM load groups by presenting objects in a single-object stream; recognition accuracy was similar to that in Experiments 1 and 2. Together, the results suggest that people incidentally generate memory for nontarget objects encountered during search and that such memory can facilitate search performance.     

The role of space and time in object-based visual search

Recently we have provided evidence that observers more readily select a target from a visual search display if the motion trajectory of the display object suggests that the observer has dealt with it before. Here we test the prediction that this object-based memory effect on search breaks down if the spatiotemporal trajectory is disrupted. Observers searched a display for a target shape among multiple distractors. The entire search display then passed behind an occluder and reemerged in either the same or a different configuration. Experiment 1 shows that the same-object benefit for selection disappears whenever a spatial disruption is involved, but that it may survive a brief temporal disruption. Experiment 2 shows that with sufficiently long gaps, a temporal disruption also destroys the same-object benefit for selective attention. Experiment 3 demonstrates that the same-object effect is even stronger when there only is a very small probability that the target can be found at the same location as before. This also made the task sensitive to brief temporal disruptions. We conclude that a coherent spatiotemporal history of a display object supports the selection of its relevant subregions.     

Incidental visual memory for targets and distractors in visual search

We explored incidental retention of visual details of encountered objects during search. Participants searched for conjunction targets in 32 arrays of 12 pictures of real-world objects and then performed a token discrimination task that examined their memory for visual details of the targets and distractors from the search task. The results indicate that even though participants had not been instructed to memorize the objects, the visual details of search targets and distractor objects related to the targets were retained after the search. Distractor objects unrelated to the search target were remembered more poorly. Eye-movement measures indicated that the objects that were remembered were looked at more frequently during search than those that were not remembered. These results provide support that detailed visual information is included incidentally in the visual representation of an object after the object is no longer in view.     

Perirhinal cortex resolves feature ambiguity in configural object recognition and perceptual oddity tasks

The perirhinal cortex (PRh) has a well-established role in object recognition memory. More recent studies suggest that PRh is also important for two-choice visual discrimination tasks. Specifically, it has been suggested that PRh contains conjunctive representations that help resolve feature ambiguity, which occurs when a task cannot easily be solved on the basis of features alone. However, no study has examined whether the ability of PRh to resolve configural feature ambiguity is related to its role in object recognition. Therefore, we examined whether bilateral excitotoxic lesions of PRh or PPRh (perirhinal plus post-rhinal cortices) in the rat would cause deficits in a configural spontaneous object recognition task, and a configural simultaneous oddity discrimination task, in which the task could not be solved on the basis of features, but could only be solved using conjunctive representations. As predicted by simulations using a computational model, rats with PPRh lesions were impaired during a minimal-delay configural object recognition task. These same rats were impaired during a zero-delay configural object recognition task. Furthermore, rats with localized PRh lesions were impaired in a configural simultaneous oddity discrimination task. These findings support the idea that PRh contains conjunctive representations for the resolution of feature ambiguity and that these representations underlie a dual role for PRh in memory and perception.     

Object files can be purely episodic

Our ability to track an object as the same persisting entity over time and motion may primarily rely on spatiotemporal representations which encode some, but not all, of an object's features. Previous researchers using the 'object reviewing' paradigm have demonstrated that such representations can store featural information of well-learned stimuli such as letters and words at a highly abstract level. However, it is unknown whether these representations can also store purely episodic information (i.e. information obtained from a single, novel encounter) that does not correspond to pre-existing type-representations in long-term memory. Here, in an object-reviewing experiment with novel face images as stimuli, observers still produced reliable object-specific preview benefits in dynamic displays: a preview of a novel face on a specific object speeded the recognition of that particular face at a later point when it appeared again on the same object compared to when it reappeared on a different object (beyond display-wide priming), even when all objects moved to new positions in the intervening delay. This case study demonstrates that the mid-level visual representations which keep track of persisting identity over time--e.g. 'object files', in one popular framework can store not only abstract types from long-term memory, but also specific tokens from online visual experience.     

Selective working memory disables inhibition of visual features

Recent research suggests that information held in working memory can facilitate subsequent attentional processing. Here, we explore the negative corollary of this conception: Under which circumstances does information in working memory disrupt subsequent processing? Seventy participants performed visual discriminations in a dual-task paradigm. They were asked to judge colors or shapes in an online attention task under three different working-memory conditions: Same, Switch, or Unknown. In the Same condition, participants selectively maintained one visual feature in working memory, from the same dimension as in the online attention task. In the Switch condition, participants selectively maintained one visual feature in working memory, but had to focus on another visual dimension in the online attention task. In the Unknown condition, participants could not predict which visual feature would be relevant for the working-memory task. We found that irrelevant features in the online attention task were particularly difficult to ignore in the Switch condition, that is, when the irrelevant features belong to a visual dimension that is simultaneously prioritized in selective working memory. The findings are consistent with accounts in terms of neural overlap between working-memory and attention circuits, and suggest that mechanisms of selection, rather than resource limitations, critically determine the extent of visual interference.     

工作记忆表征捕获眼动中的颜色优先性

刺激属性所具有的引导效力在工作记忆表征自上而下地引导注意捕获过程中起重要作用, 已有研究表明工作记忆表征的颜色属性在引导注意时具有一定的优势。研究采用工作记忆任务与视觉搜索任务相结合的双任务范式, 结合眼动追踪技术, 通过设置具有较强引导效力的颜色属性与朝向属性进行直接竞争的实验条件, 进一步考察工作记忆表征的颜色属性是否依然具有优先性。实验1发现工作记忆表征的颜色属性与朝向属性同时竞争眼动捕获时, 颜色属性表现出较强的优势, 而朝向属性单独呈现时并未表现出任何捕获效应。实验2与3进一步证实了颜色属性捕获眼动的优先性, 即当颜色属性在面临作为靶子属性的朝向属性的竞争时, 依然能捕获更多的注视点。这些结果直接证实了工作记忆表征的颜色属性在工作记忆表征的捕获眼动的过程中具有较强的引导效力, 相对于其他刺激属性(如朝向、形状)更具有优先性。     

工作记忆表征精度加工需求对注意引导的影响

采用注意捕获范式, 通过行为和事件相关脑电位(ERP)实验, 探讨工作记忆表征精度加工需求对注意引导的影响, 行为结果发现, 在低精度加工需求条件下, 只有一个工作记忆表征引导注意, 且处于高激活状态的工作记忆表征产生的注意捕获大于低激活状态; 而在高精度加工需求条件下, 有两个工作记忆表征引导注意, 且处于高、低激活状态的工作记忆表征产生的注意捕获没有差异。ERP结果显示, 高精度加工需求条件下诱发的NSW和LPC大于低精度加工需求条件; 在高精度加工需求条件下, 干扰项与记忆项匹配比不匹配时, 诱发更大的N2和更小的N2pc, 而在低精度加工需求条件下, 干扰项与记忆项匹配和不匹配时诱发的N2、N2pc没有差异。研究表明, 工作记忆表征精度加工需求影响注意引导的机制可能是高精度加工需求下, 工作记忆表征消耗的认知资源增加, 搜索目标获得的资源减少, 干扰项捕获的注意增加。     

Task-irrelevant distractors in the delay period interfere selectively with visual short-term memory for spatial locations

Visual short-term memory (VSTM) enables the representation of information in a readily accessible state. VSTM is typically conceptualized as a form of “active” storage that is resistant to interference or disruption, yet several recent studies have shown that under some circumstances task-irrelevant distractors may indeed disrupt performance. Here, we investigated how task-irrelevant visual distractors affected VSTM by asking whether distractors induce a general loss of remembered information or selectively interfere with memory representations. In a VSTM task, participants recalled the spatial location of a target visual stimulus after a delay in which distractors were presented on 75% of trials. Notably, the distractor’s eccentricity always matched the eccentricity of the target, while in the critical conditions the distractor’s angular position was shifted either clockwise or counterclockwise relative to the target. We then computed estimates of recall error for both eccentricity and polar angle. A general interference model would predict an effect of distractors on both polar angle and eccentricity errors, while a selective interference model would predict effects of distractors on angle but not on eccentricity errors. Results showed that for stimulus angle there was an increase in the magnitude and variability of recall errors. However, distractors had no effect on estimates of stimulus eccentricity. Our results suggest that distractors selectively interfere with VSTM for spatial locations.     

重新检视工作记忆在视觉搜索中的作用

视觉搜索是人类从作用于视觉系统的大量信息中选择相关信息进入信息加工系统的一种认知功能, 同时也是研究选择性注意的一种常用范式。工作记忆作为一种服务于当前任务信息的存储与加工的认知系统, 在视觉搜索过程中扮演着关键角色。为了深入了解工作记忆在视觉搜索过程中的作用机制, 在梳理已有成果的基础上, 分别从工作记忆对靶子模板的储存、视觉搜索项目与靶子模板在工作记忆中的匹配及工作记忆对已检测过搜索项目的记忆三个方面进行综述。最后结论表明工作记忆确实在视觉搜索过程中起作用, 但其作用机制仍存在较多争议。     

Scene and position specificity in visual memory for objects

This study investigated whether and how visual representations of individual objects are bound in memory to scene context. Participants viewed a series of naturalistic scenes, and memory for the visual form of a target object in each scene was examined in a 2-alternative forced-choice test, with the distractor object either a different object token or the target object rotated in depth. In Experiments 1 and 2, object memory performance was more accurate when the test object alternatives were displayed within the original scene than when they were displayed in isolation, demonstrating object-to-scene binding. Experiment 3 tested the hypothesis that episodic scene representations are formed through the binding of object representations to scene locations. Consistent with this hypothesis, memory performance was more accurate when the test alternatives were displayed within the scene at the same position originally occupied by the target than when they were displayed at a different position.     

Flexible working memory representation of the relationship between an object and its location as revealed by interactions with attention

Working memory (WM) selectively maintains a limited amount of currently relevant information in an active state to influence future perceptual processing, thought, and behavior. The representation of the information held in WM is unknown, particularly the degree of separation between the representation of an object’s identity and its location. The present experiments examined the flexibility of object and location WM representations by measuring reaction times on a visual discrimination task during the delay period of a WM recognition task for object identities, locations, or both. The results demonstrate that during WM delay periods, attention is biased toward information that matches the current contents of WM. Attention is not biased toward information that was present in the encoded memory sample but not relevant for the memory recognition test. This specificity of the interaction between WM and attention applies to both the identity and the location of the remembered stimulus and to the relationship between an object and its location. The results suggest that when this relationship is necessary for task performance, WM represents an object and its identity in an integrated manner. However, if this relationship is not task relevant, the object and location information are represented in WM separately.     

Incidental and intentional visual memory: What memories are and are not affected by encoding tasks?

Prior research into the impact of encoding tasks on visual memory (Castelhano & Henderson, 2005) indicated that incidental and intentional encoding tasks led to similar memory performance. The current study investigated whether different encoding tasks impacted visual memories equally for all types of objects in a conjunction search (e.g., targets, colour distractors, object category distractors, or distractors unrelated to the target). In sequences of pictures, participants searched for prespecified targets (e.g., green apple; Experiment 1), memorized all objects (Experiment 2), searched for specified targets while memorizing all objects (Experiment 3), searched for postidentified targets (Experiment 4), or memorized all objects with one object prespecified (Experiment 5). Encoding task significantly improved visual memory for targets and led to worse memory for unrelated distractors, but did not influence visual memory of distractors that were related to the target's colour or object category. The differential influence of encoding task indicates that the relative importance of the object both positively and negatively influences the memory retained.     

Selective weighting of action-related feature dimensions in visual working memory

Planning an action primes feature dimensions that are relevant for that particular action, increasing the impact of these dimensions on perceptual processing. Here, we investigated whether action planning also affects the short-term maintenance of visual information. In a combined memory and movement task, participants were to memorize items defined by size or color while preparing either a grasping or a pointing movement. Whereas size is a relevant feature dimension for grasping, color can be used to localize the goal object and guide a pointing movement. The results showed that memory for items defined by size was better during the preparation of a grasping movement than during the preparation of a pointing movement. Conversely, memory for color tended to be better when a pointing movement rather than a grasping movement was being planned. This pattern was not only observed when the memory task was embedded within the preparation period of the movement, but also when the movement to be performed was only indicated during the retention interval of the memory task. These findings reveal that a weighting of information in visual working memory according to action relevance can even be implemented at the representational level during maintenance, demonstrating that our actions continue to influence visual processing beyond the perceptual stage.     

无关工作记忆表征的负性情绪信息能否捕获视觉注意?一项眼动研究

研究通过分析视觉搜索任务的首次注视点和行为反应时, 探讨无关工作记忆表征的负性情绪信息对视觉注意选择的影响。实验1发现在反映早期注意选择的首次注视点百分率指标上, 不管工作记忆表征的情绪效价如何, 均出现了显著的注意捕获效应; 实验2发现当采用中性情绪靶子刺激时, 首次注视点百分率指标上仍表现出了稳健的注意捕获效应; 在首次注视点持续时间指标上, 实验1和实验2均发现记忆匹配条件的干扰刺激显著小于控制条件的干扰刺激, 表现出注意的快速脱离; 而在行为反应时指标上, 早期的注意捕获效应消失(实验1), 甚至被反转为注意抑制效应(实验2)。这些结果表明在早期注意选择阶段, 记忆驱动的注意捕获效应不受工作记忆表征情绪效价的影响, 但认知控制会在早期注意捕获之后促使注意快速脱离记忆匹配的干扰刺激, 其作用效果受靶子刺激情绪效价的调节。     

Perceptual organization and focused attention: The role of objects and proximity in visual processing

The influence of the Gestalt grouping principles of similarity, closure, and proximity on the size of the response-compatibility effect was examined in a focused attention task. In three studies, subjects responded to a centrally located target and attempted to ignore adjacent distractors. The distractors, which served as targets on other trials, could be compatible, incompatible, or neutral with respect to the response of the target. In addition, the distractors and the target could be embedded in the same object, presented in the same color, presented on different objects, or presented in different colors. The typical response-compatibility effect (B. A. Eriksen & C. W. Eriksen, 1974) was found when the target and distractors were embedded in the same object or presented in the same color. Performance was poorer when the target was surrounded by response-incompatible distractors than when it was surrounded by response-compatible distractors. However, the response-compatibility effect was eliminated-w-hen. the target and distractors were embedded in different objects, even when the distance between the items was less than.25° of visual angle. Furthermore, the response-compatibility effect was of intermediate size when the distractors were not grouped strongly with the target or with neutral flankers. The results are discussed in terms of space- and object-based models of visual attention.