Informative cues can slow search: The cost of matching a specific template

During visual search, observers hold in mind a search template, which they match against the stimulus. To characterize the content of this template, we trained observers to discriminate a set of artificial objects at an individual level and at a category level. The observers then searched for the objects on backgrounds that camouflaged the features that defined either the object’s identity or the object’s category. Each search stimulus was preceded by the target’s individual name, its category name, or an uninformative cue. The observers’ task was to locate the target, which was always present and always the only figure in the stimulus. The results showed that name cues slowed search when the features associated with the name were camouflaged. Apparently, the observers required a match between their mental representation of the target and the stimulus, even though this was unnecessary for the task. Moreover, this match involved all distinctive features of the target, not just the features necessary for a definitive identification. We conclude that visual search for a specific target involves a verification process that is performed automatically on all of the target’s distinctive features.     

Frames of reference for the light-from-above prior in visual search and shape judgements

Faced with highly complex and ambiguous visual input, human observers must rely on prior knowledge and assumptions to efficiently determine the structure of their surroundings. One of these assumptions is the 'light-from-above' prior. In the absence of explicit light-source information, the visual system assumes that the light-source is roughly overhead. A simple, low-cost strategy would place this 'light-from-above' prior in a retinal frame of reference. A more complex, but optimal strategy would be to assume that the light-source is gravitationally up, and compensate for observer orientation. Evidence to support one or other strategy from psychophysics and neurophysiology has been mixed. This paper pits the gravitational and retinal frames against each other in two different visual tasks that relate to the light-from-above prior. In the first task, observers had to report the presence or absence of a target where distractors and target were defined purely by shading. In the second task, observers made explicit shape judgements of similar stimuli. The orientation of the stimuli varied across trials and the observer's head was fixed at 0, +/-45 or +/-60 degrees . In both tasks the retinal frame of reference dominated. Visual search behaviour with shape-from-shading stimuli (SFS) was modulated purely by stimulus orientation relative to the retina. However, the gravitational frame of reference had a significant effect on shape judgements, with a 30% correction for observer orientation. In other words, shading information is processed quite differently depending on the demands of the current task. When a 'quick and dirty' representation is required to drive fast, efficient search, that is what the visual system provides. In contrast, when the task is to explicitly estimate shape, extra processing to compensate for head orientation precedes the perceptual judgment. These results are consistent with current neurophysiological data on SFS if we re-frame compensation for observer orientation as a cue-combination problem.     

Color singleton pop-out does not always poop out: An alternative to visual search

Folk psychology suggests that when an observer views a scene, a unique item will stand out and draw attention to itself. This belief stands in contrast to numerous studies in visual search that have found that a unique target item (e.g., a unique color) is not identified more quickly than a nonunique target. We hypothesized that this finding is the result of task demands of visual search, and that when the task does not involve visual search, uniqueness will pop out. We tested this hypothesis in a task in which observers were presented an array of letters and asked to respond aloud, as quickly as possible, with the identity of any one of the letters. The observers were significantly more likely to respond with a uniquely colored letter than would be expected by chance. In a task in which observers blurt out the first thing that they see, unique pop-out does not poop out.     

Strategic and automatic effects of visual working memory on attention in visual search

Previous research indicates that visual attention can be automatically captured by sensory inputs that match the contents of visual working memory. However, Woodman and Luck (2007) showed that information in working memory can be used flexibly as a template for either selection or rejection according to task demands. We report two experiments that extend their work. Participants performed a visual search task while maintaining items in visual working memory. Memory items were presented for either a short or long exposure duration immediately prior to the search task. Memory was tested by a change-detection task immediately afterwards. On a random half of trials items in memory matched either one distractor in the search task (Experiment 1) or three (Experiment 2). The main result was that matching distractors speeded or slowed target detection depending on whether memory items were presented for a long or short duration. These effects were more in evidence with three matching distractors than one. We conclude that the influence of visual working memory on visual search is indeed flexible but is not solely a function of task demands. Our results suggest that attentional capture by perceptual inputs matching information in visual working memory involves a fast automatic process that can be overridden by a slower top-down process of attentional avoidance.     

Categorical templates are more useful when features are consistent: Evidence from eye movements during search for societally important vehicles

Unlike in laboratory visual search tasks—wherein participants are typically presented with a pictorial representation of the item they are asked to seek out—in real-world searches, the observer rarely has veridical knowledge of the visual features that define their target. During categorical search, observers look for any instance of a categorically defined target (e.g., helping a family member look for their mobile phone). In these circumstances, people may not have information about noncritical features (e.g., the phone’s color), and must instead create a broad mental representation using the features that define (or are typical of) the category of objects they are seeking out (e.g., modern phones are typically rectangular and thin). In the current investigation (Experiment 1), using a categorical visual search task, we add to the body of evidence suggesting that categorical templates are effective enough to conduct efficient visual searches. When color information was available (Experiment 1a), attentional guidance, attention restriction, and object identification were enhanced when participants looked for categories with consistent features (e.g., ambulances) relative to categories with more variable features (e.g., sedans). When color information was removed (Experiment 1b), attention benefits disappeared, but object recognition was still better for feature-consistent target categories. In Experiment 2, we empirically validated the relative homogeneity of our societally important vehicle stimuli. Taken together, our results are in line with a category-consistent view of categorical target templates (Yu, Maxfield, & Zelinsky in, Psychological Science, 2016. doi: 10.1177/0956797616640237), and suggest that when features of a category are consistent and predictable, searchers can create mental representations that allow for the efficient guidance and restriction of attention as well as swift object identification.     

Minds on the blink: The relationship between inattentional blindness and attentional blink

Failures of conscious visual awareness occur when specific task demands prevent an observer from detecting a stimulus that would otherwise be clearly visible. Two examples are inattentional blindness (IB) and attentional blink (AB). IB is the failure to detect an unexpected stimulus when attention is otherwise engaged. AB describes the inability to detect a second target that is presented within 180-500?ms of the first target. Previous research has suggested that similar cognitive processes underlie both IB and AB; however, they are distinct phenomena, and no evidence has directly linked the two. We tested the same group of observers on an IB task and an AB task. Consistent with our hypotheses, we found that "non-noticers" who failed to detect an unexpected stimulus in the IB task also demonstrated a larger AB effect. This suggests that some observers may be more generally susceptible to failures of conscious visual awareness, regardless of specific context.     

Experience-dependent attentional tuning of distractor rejection

Irrelevant salient distractors often capture attention, but given a sufficiently specific search template, these salient items no longer capture attention. In the present experiments, we investigated whether specific target templates are sufficient to resist capture, or whether experience with the salient distractors is also necessary. To test this hypothesis, observers completed four blocks of trials, each with a different-colored irrelevant singleton present on half of the trials. Color singletons captured attention early within a block, but after sufficient experience with the irrelevant singletons, those singletons no longer captured attention in the second halves of the blocks. This result suggests that to resist capture, a specific target template must be accompanied by experience-dependent attentional tuning to distractor properties.     

Visual noise reveals category representations

How are categories represented in human memory? Exemplar models assume that a category is represented by individual instances from that category that have been experienced. More generally, a category might be represented by multiple templates stored in memory. A new item is classified according to its similarity to these templates.Prototype models represent a category with a single summary abstraction (i.e., a single template), often the central tendency of the experienced items. A new item is classified according to its similarity to these category prototypes. Here, we show how a technique for correlating observers’ responses with external noise can be used not only to distinguish single- from multiple-template representations, but also to induce the form of these templates. The technique is applied to two tasks requiring categorization of simple visual patterns; the results demonstrate that observers used multiple traces to represent their categories, and thus highlight the procedure’s potential for use in more complex settings.     

The depth of distractor processing in search with clutter

Some search tasks involve looking for a category target in clutter. This is the task faced, for example, by a baggage screener looking for weapons in a suitcase. Such tasks presumably involve the segmentation and recognition of the target object, but it is unknown whether they also involve the segmentation and recognition of the distractor objects. To examine the depth of distractor processing in this task, we had observers search through cluttered displays composed of normal and chimerical distractors. The normal distractors were photographs of recognizable objects, while the chimerical distractors were created by interchanging parts between the normal objects. The obsever's task was to identify the display quadrant that contained an animal or a vehicle target. We varied the difficulty of the search task by varying target and distractor discriminability, target uncertainty, and target occlusion. Only when the target was partially occluded did we find an effect of distractor type. In this case, observers may have found the target through a process of mentally eliminating whole distractor objects. When the target was unoccluded, we found no evidence that observers selected and rejected whole distractors during search. This second result supports our previous claim that often the items for search in clutter are not whole objects.     

On the relation between decision rules and perceptual representation in multidimensional perceptual categorization

This article examines the relation between changing categorization decision rules and the nature of the underlying perceptual representation. Observers completed a matching task that required them to adjust the length and orientation of a single line stimulus until they perceived it to "match" a second line stimulus (Alfonso-Reese, 1996, 1997). The same observers then completed four categorization tasks with the same stimuli. Data from the matching task were used to estimate a perceptual representation for each stimulus and observer. Three hypotheses regarding potential interactions between categorization decision rules and perceptual representation were examined. One assumed that there was no interaction between decision rules and perceptual representation. The second assumed that linear categorization rules affect the perceptual representation differently from nonlinear categorization rules. The third assumed that dimensional integration rules affected the perceptual representation differently from decision rules that require the observer to set a criterion along one stimulus dimension while ignoring the other; this is referred to as decisional selective attention. The results suggested that (1) the matching task perceptual representation provided a good account of the categorization data, (2) decisional selective attention affected the perceptual representation differently from decisional integration, and (3) decisional selective attention generally decreased the perceptual variability along the attended dimension.     

Matching of visual input to only one item at any one time

When we perform a visual search we know what we are looking for and determine where it is. A representation of the object in our working memory, the ‘search-template’, is compared to the items in the scene until a match is found. So far it is unknown whether observers can search for multiple items at the same time. Here we compare the performance of subjects between a task in which they search for one of two target-items in a stream of visual objects and a task with only a single target. We find that search is effectively limited to one item at a time. This limitation occurs for simple and complex objects and even if the subjects have to look for two features from different domains. We conclude that matching has a fundamental capacity-limitation as the visual input can be matched to only one search-template at a time.     

How does the purpose of inspection influence the potency of visual salience in scene perception?

Salience-map models have been taken to suggest that the locations of eye fixations are determined by the extent of the low-level discontinuities in an image. While such models have found some support, an increasing emphasis on the task viewers are performing implies that these models must combine with cognitive demands to describe how the eyes are guided efficiently. An experiment is reported in which eye movements to objects in photographs were examined while viewers performed a memory-encoding task or one of two search tasks. The objects depicted in the scenes had known salience ranks according to a popular model. Participants fixated higher-salience objects sooner and more often than lower-salience objects, but only when memorising scenes. This difference shows that salience-map models provide useful predictions even in complex scenes and late in viewing. However, salience had no effects when searching for a target defined by category or exemplar. The results suggest that salience maps are not used to guide the eyes in these tasks, that cognitive override by task demands can be total, and that modelling top-down search is important but may not be easily accomplished within a salience-map framework.     

Searching through the hierarchy: How level of target categorization affects visual search

Does the same basic-level advantage commonly observed in the categorization literature also hold for targets in a search task? We answered this question by first conducting a category verification task to define a set of categories showing a standard basic-level advantage, which we then used as stimuli in a search experiment. Participants were cued with a picture preview of the target or its category name at either superordinate, basic, or subordinate levels, then shown a target-present/absent search display. Although search guidance and target verification was best using pictorial cues, the effectiveness of the categorical cues depended on the hierarchical level. Search guidance was best for the specific subordinate-level cues, whereas target verification showed a standard basic-level advantage. These findings demonstrate different hierarchical advantages for guidance and verification in categorical search. We interpret these results as evidence for a common target representation underlying categorical search guidance and verification.     

Effect of template complexity on visual search and dual-task performance

Even dissimilar tasks interfere with one another when done together. We used visual search to examine the underlying cause of such interference. In many models, visual search is a process of biased competition controlled by a template describing the target to be sought. When the display is processed, matching against this template guides attention to the target. We show that increasing template complexity increased interference with a dissimilar concurrent task, story memory. This result was independent of reaction time: Increases in template complexity were associated with no increase in search time in Experiment 1 and with a decrease in search time in Experiment 2. The results show that the dual-task demands of visual search reflect the complexity of the template used in task control, and that this factor can be isolated from other sources of difficulty.     

Reconceptualizing of the overjustification effect: A template-matching approach

The paper reviews traditional attributional explanations for the over-justification effect in task motivation, isolates their weaknesses, and proposes an alternative account based on the notion that individuals process task information schematically. It is proposed that task information relating to motivation is interpreted by cognitive schema or “templates,” which identify tasks as being either instrumental or expressive in nature. When the expressive template is evoked, the task is perceived to be playlike and is experienced as inherently motivating. When the instrumental template is evoked, the task is perceived as a means to an end and task motivation results from the perceived value of the task for attaining intrinsic and/or extrinsic rewards. Structural characteristics of these templates are proposed. According to this account, overjustification effects occur when the perceived characteristics of tasks change such that the expressive template is replaced by the instrumental template and expressive motivation is transformed into instrumental motivation.     

Upper-left gaze bias reveals competing search strategies in a reverse Stroop task

Three experiments with a total of 87 human observers revealed an upper-left spatial bias in the initial movement of gaze during visual search. The bias was present whether or not the explicit control of gaze was required for the task. This bias may be part of a search strategy that competed with the fixed-gaze parallel search strategy hypothesized by Durgin [Durgin, F. H. (2003). Translation and competition among internal representations in a reverse Stroop effect. Perception &Psychophysics, 65, 367-378.] for this task. When the spatial probabilities of the search target were manipulated either in accord with or in opposition to the existing upper-left bias, two orthogonal factors of interference in the latency data were differentially affected. The two factors corresponded to two different forms of representation and search. Target probabilities consistent with the gaze bias encouraged opportunistic serial search (including gaze shifts), while symmetrically opposing target probabilities produced latency patterns more consistent with parallel search based on a sensory code.     

工作记忆表征的激活与抑制状态对注意引导效应的影响

本研究采用双任务范式, 通过定向遗忘任务操纵工作记忆表征状态, 分别在目标无关和目标相关条件下考察工作记忆激活与抑制状态对视觉搜索早期注意引导效应的影响。实验1与实验2发现当工作记忆表征只可能与视觉搜索分心物匹配时(目标无关条件), 处于激活状态的工作记忆表征会引导视觉注意偏向到与之匹配的分心物, 表现出注意引导效应, 而处于抑制状态的工作记忆表征则没有观察到注意引导效应。实验3与实验4发现, 当工作记忆表征有可能与视觉搜索目标匹配时(目标相关条件), 处于激活状态的工作记忆表征能捕获注意, 而处于抑制状态的工作记忆表征只有与视觉搜索目标匹配时, 才表现出对该搜索目标反应的延迟。这些研究的结果表明(1)处于激活状态的工作记忆表征能有效地引导注意偏向到与之匹配的搜索目标或分心物, 并且这种注意引导效应并未受到抑制动机的影响而被消除或反转; (2)处于抑制状态的工作记忆表征能将抑制状态传递到视觉搜索阶段, 并延迟对与之匹配的搜索目标的反应。     

Sex differences in unfamiliar face identification: evidence from matching tasks

Research on sex differences in face recognition has reported mixed results, on balance suggesting an advantage for female observers. However, it is not clear whether this advantage is specific to face processing or reflects a more general superiority effect in episodic memory. The current study therefore examined sex differences with a face-matching task that eliminates memory demands. Across two experiments, female but not male observers showed an own-sex advantage on match trials, in which two pictures have to be identified as the same person. This advantage was present for whole faces and when only the internal or external facial features were shown. Female observers were also more accurate in these three conditions on mismatch encounters, in which two photographs have to be identified as different people, but this reflects a more general effect that is present for male and female faces. These findings converge with claims of a female advantage in face recognition and demonstrate that this effect persists when memory demands are eliminated.