Collinear masking effect in visual search is independent of perceptual salience

Searching for a target in a salient region should be easier than looking for one in a nonsalient region. However, we previously discovered a contradictory phenomenon in which a local target in a salient structure was more difficult to find than one in the background. The salient structure was constructed of orientation singletons aligned to each other to form a collinear structure. In the present study, we undertake to determine whether such a masking effect was a result of salience competition between a global structure and the local target. In the first 3 experiments, we increased the salience value of the local target with the hope of adding to its competitive advantage and eventually eliminating the masking effect; nevertheless, the masking effect persisted. In an additional 2 experiments, we reduced salience of the global collinear structure by altering the orientation of the background bars and the masking effect still emerged. Our salience manipulations were validated by a controlled condition in which the global structure was grouped noncollinearly. In this case, local target salience increase (e.g., onset) or global distractor salience reduction (e.g., randomized flanking orientations) effectively removed the facilitation effect of the noncollinear structure. Our data suggest that salience competition is unlikely to explain the collinear masking effect, and other mechanisms such as contour integration, border formation, or the crowding effect may be prospective candidates for further investigation.     

Feature analysis and the role of similarity in preattentive vision

Texture arrays of line elements at various orientations were used to study three phenomena of preattentive vision. Subjects were asked (1) to discriminate texture areas and to distinguish their form (experiments on texture segmentation); (2) to detect salient or vertical line elements (experiments on pop-out); and (3) to identify configurations of similar or dissimilar targets (experiments on grouping). Within the patterns, line orientation was systematically varied to distinguish the effect of differences between areas from the effect of similarity within areas. In all of the experiments, performance was found to depend on local orientation contrast at texture borders rather than on the analysis of line orientation itself. Texture areas were correctly identified only when the orientation contrast at the border well exceeded the overall variation of line orientation in the pattern. Similarly, only target elements with high local orientation contrast were detected fast and “in parallel.” Targets with an orientation contrast lower than background variation required serial search. Preattentive grouping was found to depend on saliency, as defined by local orientation contrast, but not on the similarity of line elements. In addition to local orientation contrast, which played an important role in all of the visual phenomena studied, influences from the alignment of line elements with the outline of a figure were also seen.     

Feature saliency affects delayed matching of an attended feature

We examined how top-down attentional modulation and bottom-up stimulus saliency interact with feature memory. Experiment 1 used a delayed-matching-to-sample (DMS) task to examine the relative saliency between features by observing the relative accuracy of recognition at different stimulus durations. Feature salience decreased according to the following order: colour, form, and texture. In a modified DMS task (Experiments 2 and 3), participants were required to attend to one of three features and ignore the others. After a delay, they were required to choose which of the two test stimuli matched the reference stimulus on the attended feature, disregarding other task-irrelevant features. The target was either identical to the reference stimulus or mismatched the reference stimulus on one of the irrelevant features. The results showed that colour matching was affected neither by a form change nor by a texture change. Form matching was affected by a colour change, and texture matching was affected by a colour or form change. These results are consistent with the relative saliency hypothesis. Even when all features of an attended object are maintained, a relatively more salient task-irrelevant feature can interfere with the delayed recognition of a less salient feature.     

Feature analysis and the role of similarity in preattentive vision.

Texture arrays of line elements at various orientations were used to study three phenomena of preattentive vision. Subjects were asked (1) to discriminate texture areas and to distinguish their form (experiments on texture segmentation); (2) to detect salient or vertical line elements (experiments on pop-out); and (3) to identify configurations of similar or or dissimilar targets (experiments on grouping). Within the patterns, line orientation was systematically varied to distinguish the effect of differences between areas from the effect of similarity within areas. In all of the experiments, performance was found to depend on local orientation contrast at texture borders rather than on the analysis of line orientation itself. Texture areas were correctly identified only when the orientation contrast at the border well exceeded the overall variation of line orientation in the pattern. Similarly, only target elements with high local orientation contrast were detected fast and "in parallel". Targets with an orientation contrast lower than background variation required serial search. Preattentive grouping was found to depend on saliency, as defined by local orientation contrast, but not on the similarity of line elements. In addition to local orientation contrast, which played an important role in all of the visual phenomena studied, influences from the alignment of line elements with the outline of a figure were also seen.     

Arousal (but not valence) amplifies the impact of salience

Previous findings indicate that negative arousal enhances bottom-up attention biases favouring perceptual salient stimuli over less salient stimuli. The current study tests whether those effects were driven by emotional arousal or by negative valence by comparing how well participants could identify visually presented letters after hearing either a negative arousing, positive arousing or neutral sound. On each trial, some letters were presented in a high contrast font and some in a low contrast font, creating a set of targets that differed in perceptual salience. Sounds rated as more emotionally arousing led to more identification of highly salient letters but not of less salient letters, whereas sounds’ valence ratings did not impact salience biases. Thus, arousal, rather than valence, is a key factor enhancing visual processing of perceptually salient targets.     

The Differential Salience of Spatial Information Features in the Geometric Reproductions of Young Children

To assess the differential salience of geometric features embedded in spatial displays, 60 preschool children, 3 to 5 years old, were required to reconstruct a series of geometric displays. Each arrangement included the depiction of a topological feature, unconnectedness; a Euclidean feature, linearity; and a projective feature, orientation. Children built their reconstructions under two demand conditions. The reconstructions were scored for the number that preserved each of the different geometric features. Results from a mixed-design analysis of variance revealed main effects for age, demand condition, and geometric feature, as well as for several first-order interactions. Data indicated that the Euclidean feature was the most salient and most frequently preserved characteristic and that the topological and projective ones were more problematic. The findings were discussed as a contrast to Piagetian predictions.     

The differential salience of spatial information features in the geometric reproductions of young children

To assess the differential salience of geometric features embedded in spatial displays, 60 preschool children, 3 to 5 years old, were required to reconstruct a series of geometric displays. Each arrangement included the depiction of a topological feature, unconnectedness; a Euclidean feature, linearity; and a projective feature, orientation. Children built their reconstructions under two demand conditions. The reconstructions were scored for the number that preserved each of the different geometric features. Results from a mixed-design analysis of variance revealed main effects for age, demand condition, and geometric feature, as well as for several first-order interactions. Data indicated that the Euclidean feature was the most salient and most frequently preserved characteristic and that the topological and projective ones were more problematic. The findings were discussed as a contrast to Piagetian predictions.     

A computational feature binding model of human texture perception

We present a computational model for human texture perception which assigns functional principles to the Gestalt laws of similarity and proximity. Motivated by early vision mechanisms, in the first stage, local texture features are extracted by utilizing multi-scale filtering and nonlinear spatial pooling. In the second stage, features are grouped according to the spatial feature binding model of the competitive layer model (CLM; Wersing et al. 2001). The CLM uses cooperative and competitive interactions in a recurrent network, where binding is expressed by the layer-wise coactivation of feature-representing neurons. The Gestalt law of similarity is expressed by a non-Euclidean distance measure in the abstract feature space with proximity being taken into account by a spatial component. To choose the stimulus dimensions which allow the most salient similarity-based texture segmentation, the feature similarity metrics is reduced to the directions of maximum variance. We show that our combined texture feature extraction and binding model performs segmentation in strong conformity with human perception. The examples range from classical microtextures and Brodatz textures to other classical Gestalt stimuli, which offer a new perspective on the role of texture for more abstract similarity grouping.     

Parallel pattern processing and visual agnosia.

A series of visual search experiments are reported examining pattern processing in a visual agnosic patient. We examined search for targets defined by: (I) the combination of their features relative to homogeneous distractors; (2) the combination of their features relative to heterogeneous distractors; and (3) a single feature difference relative to the distractors (their orientation). Normal subjects demonstrate evidence of spatially parallel search when combined-feature targets are detected against homogeneous distractors, and when targets are defined by a salient feature difference. There are non-linear effects of the number of distractors present, and absent responses can be as fast as present. In contrast, search times for combined-feature targets amongst heterogeneous distractors increase linearly with display size, with the slope for absent responses about twice that for present. The contrast between search for combined-feature targets amongst homogeneous and heterogeneous distractors can be attributed to the effects of grouping between distractors and between distractors and targets (Duncan & Humphreys, 1989, 1992; Humphreys & Muller, in press). Grouping between homogeneous distractors facilitates search. An agnosic patient, HJA, showed normal search functions for single-feature targets and for combined-feature targets amongst heterogeneous distractors. However, he was impaired at search for combined-feature targets amongst homogeneous distractors. This suggests that HJA is selectively impaired at grouping conjunctions of form features. The relations between HJA's agnosia and his problem in the parallel grouping of form conjunctions are discussed, as are the implications of the work for understanding normal vision.     

A new method for calibrating perceptual salience across dimensions in infants: the case of color vs. luminance

We report a new method for calibrating differences in perceptual salience across feature dimensions, in infants. The problem of inter-dimensional salience arises in many areas of infant studies, but a general method for addressing the problem has not previously been described. Our method is based on a preferential looking paradigm, adapted to determine the relative salience of two stimuli. We report here on the case of stimuli differing in color and luminance, though the method has wider potential. We were able to determine on a psychophysical curve the point at which a color contrast was equally salient to infants as a given luminance contrast. We then used these calibrated, 'iso-salient' stimuli in an object memory study. Results showed that 6.5-month-old infants noticed a color, but not a luminance, change while tracking an occluded object. Our method should have numerous applications in the study of bottom-up effects on infant attention and visual working memory.     

Repetition effects in visual search

Maljkovic and Nakayama (1994) demonstrated an automatic benefit of repeating the defining feature of the target in search guided by salience. Thus, repetition influences target selection in search guided by bottom-up factors. Four experiments demonstrate this repetition effect in search guided by top-down factors, and so the repetition effect is not merely part of the mechanism for determining what display elements are salient. The effect is replicated in singleton search and in three situations requiring different degrees of top-down guidance: when the feature defining the target is less salient than the feature defining the response, when there is more than one singleton in the defining dimension, and when the target is defined by a conjunction of features. Repetition does not change the priorities of targets, relative to distractors: Display size affects search equally whether the target is repeated or changed. More than one mechanism may underlie the repetition effect in different experiments, but assuming that there is a unitary mechanism, a short-term episodic memory mechanism is proposed.     

Reinstating salience effects over time: the influence of stimulus changes on visual selection behavior over a sequence of eye movements

Recently, we showed that salience affects initial saccades only in a static stimulus environment; subsequent saccades were unaffected by salience but, instead, were directed in line with task requirements (Siebold, van Zoest, & Donk, PLoS ONE 6(9): e23552, 2011). Yet multiple studies have shown that people tend to fixate salient regions more often than nonsalient ones when they are looking at images—in particular, when salience is defined by dynamic changes. The goal of the present study was to investigate how oculomotor selection beyond an initial saccade is affected by salience as derived from changing, as opposed to static, stimuli. Observers were presented with displays containing two fixation dots, one target, one distractor, and multiple background elements. They were instructed to fixate on one of the fixation dots and make a speeded eye movement to the target, either directly or preceded by an initial eye movement to the other fixation dot. In Experiment 1, target and distractor differed in orientation contrast relative to the background, such that one was more salient than the other, whereas in Experiments 2 and 3, the orientation contrast between the two elements was identical. Here, salience was implemented by a continuous luminance flicker or by a difference in luminance contrast, respectively, which was presented either simultaneously with display onset or contingent upon the first saccade. The results showed that in all experiments, initial saccades were strongly guided by salience, whereas second saccades were consistently goal directed if the salience manipulation was present from display onset. However, if the flicker or luminance contrast was presented contingent upon the initial saccade, salience effects were reinstated. We argue that salience effects are short-lived but can be reinstated if new information is presented, even when this occurs during an eye movement.     

On the Interaction of Prior Knowledge and Stimulus Structure in Category Learning

Contemporary theories of categorization propose that concepts are coherent in virtue of being embedded in a network of theories about the world. Those theories function to pick out some of the many possible features of a set of objects as most salient for purposes of classification, a process that is complex and still poorly understood (Murphy & Medin, 1985). Part of what makes this account incomplete is a lack of information as to (1) what makes a feature salient on a given occasion and (2) how feature salience interacts with category structure to determine the course of learning. We report on the results of three studies of category learning using complex schematic drawings to show that (1) the contrast set defined by one's initial encounters with category exemplars can be a source of individual differences in feature salience assignments; (2) such effects are short-lived in the face of clear evidence about actual feature diagnosticity; and (3) more robust prior hypotheses interact with category structure to either enhance learning or impede it. The enhancement occurs when the hypothesis emphasizes category-relevant features, even if the hypothesis is in fact incorrect. A hypothesis that assigns high salience to irrelevant features impedes learning. Learning does occur as feedback concerning category structure leads to enhanced salience for relevant features. Salience of irrelevant features remains high, however, suggesting that such learning as occurs involves augmentation and not total revision of the (incorrect) prior hypothesis.     

Measuring and modeling salience with the theory of visual attention

For almost three decades, the theory of visual attention (TVA) has been successful in mathematically describing and explaining a wide variety of phenomena in visual selection and recognition with high quantitative precision. Interestingly, the influence of feature contrast on attention has been included in TVA only recently, although it has been extensively studied outside the TVA framework. The present approach further develops this extension of TVA’s scope by measuring and modeling salience. An empirical measure of salience is achieved by linking different (orientation and luminance) contrasts to a TVA parameter. In the modeling part, the function relating feature contrasts to salience is described mathematically and tested against alternatives by Bayesian model comparison. This model comparison reveals that the power function is an appropriate model of salience growth in the dimensions of orientation and luminance contrast. Furthermore, if contrasts from the two dimensions are combined, salience adds up additively.     

幼儿在辨别过程中图形维度显著性的研究

采用Triad Classification法和等级图形模式研究了4～6岁幼儿在辨别过程中图形维度显著性效应。实验1让幼儿进行自由辨别任务,发现颜色显著性强于形状,局部特征的显著性强于整体特征;随被试年龄增长,整体特征和颜色的显著性逐渐增强;对维度显著性等级模式的信息加工比对整体局部特征等级模式的加工反应时长。实验2进行按指定标准来辨别的任务,发现仍然出现图形维度显著性效应。这些结果说明图形维度显著性效应可能是自动发生的,可能比整体局部特征的认知加工更复杂。     

Why does a red snake in the grass capture your attention?

It has been suggested that affective stimuli automatically capture attention; this preferential processing is thought to be related to the evolutionary significance of affective stimuli. However, recent evidence suggests that perceptual salience alone might explain why some affective stimuli are more likely to influence attentional processes in certain contexts. In this study, we manipulated affective and perceptual salience to better understand how affective information is processed and how it impacts attentional processes in different contexts. We used stimuli that are both affectively and perceptually salient, while varying the task requirement to encourage the processing of perceptually salient (Experiment 1) or affectively salient (Experiment 2) information. This design made it possible to observe independent and interdependent relationships between perceptual and affective salience. The results showed that when the task encouraged the processing of perceptually salient information, affective salience did not influence task performance. In contrast, when the task encouraged the processing of affectively salient information, affectively salient information impaired task performance. The findings suggest that the affective nature of the stimuli does not always influence attentional processes.     

A clash of bottom-up and top-down processes in visual search: the reversed letter effect revisited

It is harder to find the letter "N" among its mirror reversals than vice versa, an inconvenient finding for bottom-up saliency accounts based on primary visual cortex (V1) mechanisms. However, in line with this account, we found that in dense search arrays, gaze first landed on either target equally fast. Remarkably, after first landing, gaze often strayed away again and target report was delayed. This delay was longer for target "N" We suggest that the delay arose because bottom-up saliency clashed with top-down shape recognition. Thus, although gaze landed accurately and quickly to the distinctive feature in the target shape (the orientation of the diagonal bar in "N" or "И"), the identical zigzag shape of target and distractors was registered, leading to temporary confusion. In sparser search arrays with smaller set sizes, top-down target shape recognition occurs earlier and bottom-up saliency is weaker. The clash in this case causes search asymmetry even before target location at first gaze landing. Our findings rule out previous suggestions that search asymmetry stems from stronger preattentive salience for the reversed target and/or faster rejection of familiar distractors.     

Cue summation enables perceptual grouping

In order to study how basic features interact in shape perception, subjects detected target figure presence and identified target figure shape in a combined 2-alternative forced-choice task. Target figures were embedded in Gabor random fields and were defined by feature contrast in spatial frequency, orientation, or both. Two figure classes were used: block figures, which could not be identified at low feature-contrast levels, and lozenge figures, which could be identified to a moderate degree. Results showed a substantial double-cue benefit for both figure classes in detection. In identification, however, a double-cue benefit was practically absent for blocks, whereas, for lozenges, cue summation proved to be much stronger than in detection. The finding that the way basic features interact is modulated by figure class and psychophysical task indicates involvement of 2 distinct perceptual mechanisms in shape perception. The 1st one highlights salient features and enables local grouping on an early feature-specific processing level. The 2nd one is higher level, serves form completion and grouping of salient contours into global shapes, and enables figure perception.     

Top-down versus bottom-up attentional control: a failed theoretical dichotomy

Prominent models of attentional control assert a dichotomy between top-down and bottom-up control, with the former determined by current selection goals and the latter determined by physical salience. This theoretical dichotomy, however, fails to explain a growing number of cases in which neither current goals nor physical salience can account for strong selection biases. For example, equally salient stimuli associated with reward can capture attention, even when this contradicts current selection goals. Thus, although 'top-down' sources of bias are sometimes defined as those that are not due to physical salience, this conception conflates distinct--and sometimes contradictory--sources of selection bias. We describe an alternative framework, in which past selection history is integrated with current goals and physical salience to shape an integrated priority map.     

Efficient visual search without top-down or bottom-up guidance

Two types of mechanisms have dominated theoretical accounts of efficient visual search. The first are bottom-up processes related to the characteristics of retinotopic feature maps. The second are top-down mechanisms related to feature selection. To expose the potential involvement of other mechanisms, we introduce a new search paradigm whereby a target is defined only in a context-dependent manner by multiple conjunctions of feature dimensions. Because targets in a multiconjunction task cannot be distinguished from distractors either by bottom-up guidance or top-down guidance, current theories of visual search predict inefficient search. While inefficient search does occur for the multiple conjunctions of orientation with color or luminance, we find efficient search for multiple conjunctions of luminance/size, luminance/shape, and luminance/topology. We also show that repeated presentations of either targets or a set of distractors result in much faster performance and that bottom-up feature extraction and top-down selection cannot account for efficient search on their own. In light of this, we discuss the possible role of perceptual organization in visual search. Furthermore, multiconjunction search could provide a new method for investigating perceptual grouping in visual search.