Dependent spatial channels in visual processing

The present experiments were designed to test whether or not processing in visual information channels defined by spatial position is independent in the visual search paradigm. In Experiment 1 subjects were asked to judge whether or not a red square was present in a display of two colored geometric figures. Their mean reaction time (RT) to respond no to a “divided target” display in which one figure was red and the other was a square was about 100 msec longer than to control displays containing either two red circles or two green squares. This result is inconsistent with a spatially serial independent-channel model and with many spatially parallel independent-channel models. The relatively slow responding to divided target displays was replicated in Experiments 2 and 3, when subjects judged whether or not an “A” was present in a display of two alphanumeric characters, and a divided target display was one which contained two features of “A.” Experiments 4 and 5 demonstrated that the dependence observed in the first three experiments was probably the result of two mechanisms: crosstalk integration, whereby the target features are integrated across the two spatial channels, and repetition facilitation, whereby processing is facilitated (in some cases) when the two figures in the display are physically identical. Experiment 6 suggested that subjects organized the display in terms of spatial channels even when the task allowed subjects to ignore spatial location.     

The detection of feature singletons defined in two dimensions is based on salience summation, rather than on serial exhaustive or interactive race architectures

Influential models of visual search assume that dimension-specific feature contrast signals are summed into a master saliency map in a coactive fashion. The main source of evidence for coactivation models, and against parallel race models, is violations of the race model inequality (RMI; Miller, 1982) by redundantly defined singleton feature targets. However, RMI violations do not rule out serial exhaustive (Townsend & Nozawa, 1997) or interactive race (Mordkoff & Yantis, 1991) architectures. These alternatives were tested in two experiments. In Experiment 1, we used a double-factorial design with singleton targets defined in two dimensions and at two levels of intensity, to distinguish between serial versus parallel models and self-terminating versus exhaustive stopping rules. In Experiment 2, we manipulated contingency benefits that are expected to affect the magnitude of redundancy gains and/or RMI violations on the assumption of an interactive race. The results of both experiments revealed redundancy gains as well as violations of the RMI, but the data pattern excluded serial-exhaustive and interactive race models as possible explanations for RMI violations. This result supports saliency summation (coactivation) models of search for singleton feature targets.     

Looking for two targets at the same time: One search or two?

A considerable amount of evidence suggests that, under conditions of high discriminability, subjects are able to process multiple elements in a visual display simultaneously when searching for a single target among distractors. Relatively little emphasis, however, has been placed on the question of whether subjects can search for and detect multiple targets simultaneously. This latter question is the focus of the present report. In two experiments, we compare performance in single-target and multiple-target detection tasks in order to investigate whether or not multiple targets can be detected simultaneously. In Experiment 1, subjects searched for one or two targets that were defined by color. In Experiment 2, subjects searched for a color and/or a letter target. When the two targets were presented in the same location (e.g., a red X when Target 1 was red and Target 2 was an X), they seemed to be detected simultaneously. Implications for object-based processing of visual information are discussed.     

Visual attention and stimulus identification

Previous research has provided evidence for parallel stimulus processing in visual search tasks; however, it has frequently been noted that detecting prespecified targets might be accomplished without actually identifying targets and/or distractors. A novel task was employed to require exhaustive identification: Subjects named the highest digit in an array. Reaction times and display size effects in this task were strikingly similar to the conventional search tasks reported here. Manipulation of display size and visual quality was used to test predictions of serial versus parallel encoding models. Display size was additive with two different visual quality factors in the highest digit task, a finding that argues against serial execution of the corresponding stages. Interactions with decision-related factors suggest that visual quality may have affected the rate of character recognition, not just feature extraction. Thus, various aspects of the results seem to strengthen the case for parallel (though perhaps capacity-limited) identification of multiple familiar stimuli. In the General Discussion, it is pointed out that parallel identification need not entail late selection, and some alternative possibilities are suggested.     

Visual search for dimensionally redundant pop-out targets: parallel-coactive processing of dimensions is location specific

Three visual search experiments investigated redundancy gains for single and dual odd-one-out feature targets that differed from distractors in orientation, color, or both. In Experiment 1, redundant-target displays contained (a) a single target defined in 2 dimensions, (b) dual targets each defined in a different dimension, or (c) dual targets both defined in the same dimension. The redundancy gains, relative to single nonredundant targets, decreased from the first condition on, with violations of J. Miller's (1982) race model inequality (RMI) manifested only in the first 2 conditions. Experiment 2 systematically varied the spatial separation between dual targets each defined in a different dimension. Violations of the RMI were evident only when the 2 targets occupied nearby locations. Experiment 3 provided evidence of RMI violations by dimensionally redundant targets at both precued (likely) and noncued (unlikely) display locations. Taken together, these results suggest that there is coactivation of a common mechanism by target signals in different dimensions (not by signals in the same dimension), that the coactivation effects are spatially specific, and that the coactivated mechanisms are located at a preattentive, perceptual stage of processing.     

Serial deployment of attention during visual search

This study examined whether objects are attended in serial or in parallel during a demanding visual search task. A component of the event-related potential waveform, the N2pc wave, was used as a continuous measure of the allocation of attention to possible targets in the search arrays. Experiment 1 demonstrated that the relative allocation of attention shifts rapidly, favoring one item and then another. In Experiment 2, a paradigm was used that made it possible to track the absolute allocation of attention to individual items. This experiment showed that attention was allocated to one object for 100-150 ms before attention began to be allocated to the next object. These findings support models of attention that posit serial processing in demanding visual search tasks.     

Modulation of selective attention by sequential effects in visual search tasks

In visual search detection of a target on one display facilitates its subsequent recognition on the next (Rabbitt, Cumming and Vyas, 1977). Experiment I shows that facilitation also occurs when a different display intervenes between two displays containing targets. Two further experiments show that detection of target letters among background letters is also facilitated if the same background letters recur on successive displays. Facilitation is greatest if background letters reappear in identical left-to-right spatial locations, but is also evident when the same background letters recur in different locations on successive displays. The results suggest modifications to models for the ways in which selective attention is continuously modulated by successive events during serial search.     

On the Irrelevance of Semantic Information for the llIrrelevant Speech Effect

Two experiments that tested whether semantic similarity between visually presented targets and auditorily presented distractors has an effect on serial recall of the visual targets are reported. In Experiment 1, we found no difference in the recall of two-digit numbers when distractors were either numbers or words and non-words that were designed to be phonologically similar to the targets. In Experiment 2 the 'semantic distance' between targets and distractors had no effect on serial recall. Taken together, these experiments conceptually replicate and extend earlier results, and they establish constraints for models of the effect of unattended acoustic information on serial recall.     

空间距离对视觉工作记忆巩固的影响

以往研究发现,个体对不同类型的视觉信息进行视觉工作记忆巩固的模式存在差异,如对于方向信息,一次只能有一个项目被巩固进入视觉工作记忆系统,而对于颜色信息,个体则可以一次巩固两个项目进入视觉工作记忆系统。但对于视觉信息的巩固模式是否会受其他因素的影响,目前仍然没有明确的定论。本研究将探讨视觉信息的巩固模式是否可能受到记忆项目空间距离因素的影响。研究采用变化觉察范式、序列-同时呈现操作及控制记忆项目呈现间距的方法,通过3个实验考察记忆项目之间的空间距离是否能够影响个体对颜色信息和方向信息的巩固模式。在三种空间距离水平上序列呈现或同时呈现两个记忆项目,实验结果一致发现记忆项目之间的空间距离会对视觉工作记忆巩固模式产生明显影响,个体在同时呈现条件下的正确率会随着空间距离的增大而降低。这些结果表明对同一类视觉信息进行巩固的过程中所存在的项目数量限制并不是固定的,个体可以采用序列模式或有限容量的并行模式对同一类信息进行巩固,巩固的模式可能与视觉空间注意的分配以及视觉信息所能获得的注意资源有关。     

Visual search in children and adults: Top-down and bottom-up mechanisms

Three experiments investigated visual search for targets that differed from distractors in colour, size, or orientation. In one condition the target was defined by a conjunction of these features, while in the other condition the target was the odd one out. In all experiments, 6–7- and 9–10-year-old children were compared with young adults. Experiment 1 showed that children's search differed from adults' search in two ways. In conjunction searches children searched more slowly and took longer to reject trials when no target was present. In the odd-one-out experiments, 6–7-year-old children were slower to respond to size targets than to orientation targets, and slower for orientation targets than for colour targets. Both the other groups showed no difference in their rate of responding to colour and orientation. Experiments 2 and 3 highlighted that these results were not a function of either differential density across set sizes (Experiment 2) or discriminability of orientation and colour (Experiment 3). Across all three experiments, the results of both conjunction and odd-one-out searches highlighted a development in visual search from middle to late childhood.     

Visual search in children and adults: top-down and bottom-up mechanisms

Three experiments investigated visual search for targets that differed from distractors in colour, size, or orientation. In one condition the target was defined by a conjunction of these features, while in the other condition the target was the odd one out. In all experiments, 6-7- and 9-10-year-old children were compared with young adults. Experiment 1 showed that children's search differed from adults' search in two ways. In conjunction searches children searched more slowly and took longer to reject trials when no target was present. In the odd-one-out experiments, 6-7-year-old children were slower to respond to size targets than to orientation targets, and slower for orientation targets than for colour targets. Both the other groups showed no difference in their rate of responding to colour and orientation. Experiments 2 and 3 highlighted that these results were not a function of either differential density across set sizes (Experiment 2) or discriminability of orientation and colour (Experiment 3). Across all three experiments, the results of both conjunction and odd-one-out searches highlighted a development in visual search from middle to late childhood.     

Display size effects in visual search: Analyses of reaction time distributions as mixtures

In a reanalysis of data from Cousineau and Shiffrin (2004) and two new visual search experiments, we used a likelihood ratio test to examine the full distributions of reaction time (RT) for evidence that the display size effect is a mixture-type effect that occurs on only a proportion of trials, leaving RT in the remaining trials unaffected, as is predicted by serial self-terminating search models. Experiment 1 was a reanalysis of Cousineau and Shiffrin's data, for which a mixture effect had previously been established by a bimodal distribution of RTs, and the results confirmed that the likelihood ratio test could also detect this mixture. Experiment 2 applied the likelihood ratio test within a more standard visual search task with a relatively easy target/distractor discrimination, and Experiment 3 applied it within a target identification search task within the same types of stimuli. Neither of these experiments provided any evidence for the mixture-type display size effect predicted by serial self-terminating search models. Overall, these results suggest that serial self-terminating search models may generally be applicable only with relatively difficult target/distractor discriminations, and then only for some participants. In addition, they further illustrate the utility of analysing full RT distributions in addition to mean RT.     

Visual search for dimensionally redundant pop-out targets: evidence for parallel-coactive processing of dimensions

In two visual search experiments, the detection of singleton feature targets redundantly defined on multiple dimensions was investigated. Targets differed from the distractors in orientation, color, or both (redundant targets). In Experiment 1, the various target types were presented either in separate blocks or in random order within blocks. Reaction times to redundant targets significantly violated the race model inequality (Miller, 1982), but only when there was constancy of the target-defining dimension(s) within trial blocks. In Experiment 2, there was dimensional variability within blocks. Consistent with Experiment 1, constancy of the target-defining dimension(s), but this time across successive trials (rather than within blocks), was critical for observing violations of the race model inequality. These results provide evidence for parallel-coactive processing of multiple dimensions, consistent with the dimension-weighting account of Müller, Heller, and Ziegler (1995).     

Spatial interference between attended items engenders serial visual processing

A pair of experiments investigated the architecture of visual processing, parallel versus serial, across high and low levels of spatial interference in a divided attention task. Subjects made speeded judgments that required them to attend to a pair of color-cued objects among gray filler items, with the spatial proximity between the attended items varied to manipulate the strength of interference between attended items. Systems factorial analysis (Townsend & Nozawa, Journal of Mathematical Psychology 39:321-359, 1995) was used to identify processing architecture. Experiment 1, using moderately dense displays, found evidence of parallel processing whether attended objects were in low or high proximity to one another. Experiment 2, using higher-density displays, found evidence of parallel selection when attended stimuli were widely separated but serial processing when they were in high proximity. Divided visual attention can operate in parallel under conditions of low or moderate spatial interference between selected items, but strong interference engenders serial processing.     

视觉工作记忆对前注意阶段注意定向的调节

在注意阶段,视觉工作记忆与注意共享某些特征时,视觉工作记忆内容会引导注意定向。在前注意阶段的影响又是如何？对此问题的研究却很少见,本研究采用工作记忆与基于特征的视觉搜索相结合的任务深入探讨了此问题。研究结果发现：即使在前注意阶段,注意定向也会受到视觉工作记忆自上而下的调节。然而与注意阶段不同的是：当视觉工作记忆内容与随后视觉搜索任务的目标相关时,与记忆内容匹配的搜索项目会引导注意定向到该项目所在的位置,但只有此项目作为分心物时,才会明显地延迟对靶子的加工,而此项目作为靶子时,这种影响并不明显;当视觉工作记忆中保持的项目与随后视觉搜索任务的目标无关时,注意会忽略视觉工作记忆中保持的项目,有效地检测靶子     

Target enhancement and distractor inhibition affect transitory surround suppression in dual tasks using multiple rapid serial visual presentation streams

Few studies have investigated the interaction between temporal and spatial dimensions on selective attention using dual tasks in the multiple rapid serial visual presentation (RSVP) paradigm. A phenomenon that the surround suppression in space changes over time (termed transitory surround suppression, TSS, in the present study) has been observed, suggesting the existence of this time–space interaction. However, it is still unclear whether target enhancement or distractor inhibition modulates TSS. Four behavioural experiments were conducted to investigate the mechanism of TSS by manipulating the temporal lag and spatial distance factors between two targets embedded in six RSVP streams. The TSS effect was replicated in a study that eliminated confounds of perceptual effects and attentional switch (Experiment 1). However, the TSS disappeared when two targets shared the same colour in a between-subjects design (Experiment 2a) and a within-subject design (Experiment 2b), suggesting the impact of target enhancement on TSS. Moreover, the TSS was larger for within-category than for between-category distractors (Experiment 3), indicating the impact of distractor inhibition on TSS. These two influences on TSS under different processing demands of target and distractor processing were further confirmed in a skeletal design (Experiment 4). Overall, combinative effects of target enhancement and distractor suppression contribute to the mechanisms of time–space interaction in selective attention during visual search.     

Serial search for targets defined by divergence or deformation of optic flow.

The optic flow field can be described in terms of the local differential measures, divergence, deformation, and rotation, which are informative about observer motion and the 3-D structure of the environment. Does an explicit representation of these measures exist in human visual processing in the form of a feature map? Triesman's criteria were used to investigate this; ie is there 'pop-out' for a target defined as different in local divergence or deformation from surrounding elements, or is a serial search necessary? The stimulus arrays contained 3, 5, or 9 square or rectangular elements, which each underwent repeated cycles of expansion, contraction, or deformation. The time required to detect a target undergoing the opposite transformation increased steeply with the number of elements, implying very slow serial search. (The mean time was 210 ms per element for divergence targets and 542 ms per element for deformation). The process was clearly still serial when the density and number of elements was increased up to 48 in an array 2.16 deg x 2.16 deg. In contrast, a single line element undergoing the opposite direction of translation motion to the rest of the display did show pop-out. It is concluded that no parallel processes seem to exist which are sensitive to the spatial uniformity of divergence and of deformation of optic flow. These differential properties may be derived as conjunctions of signals from a primary process which extracts local velocity. This result contrasts with our findings for targets defined by stereo disparity gradient, which show parallel processing in analogous experiments.     

Pre-attentive detection of a target defined by stereoscopic slant.

Does the visual system represent stereoscopic depth purely as a map of local disparities, or does it explicitly represent local relationships of disparity, such as disparity gradients? Experiments are reported in which visual search for a target containing the same disparity range as other elements in the display, but differing in the relationship of the disparities (stereo slant), was used to determine whether the target showed 'pop-out' like a unitary feature, or the serial search characteristic of feature conjunctions. Each stereo pair of elements was selected randomly from a range of outline parallelograms leaning to the right or to the left, so that the target could not be identified using any monocular shape cue. Response times for detection of the target (present on 50% of the trials) were independent of the number of elements in the display. This result was confirmed by varying element size and spacing, and by using oblique crosses rather than parallelograms as stimuli. It is concluded that stereoscopically defined slant, or disparity gradient, can be processed and compared in parallel across the display, and acts in this respect as an explicit unitary visual property. This contrasts with findings in analogous experiments on movement, which show that targets defined by divergence or deformation of optic flow can only be identified by serial search.     

Visual search for dimensionally redundant pop-out targets: Evidence for parallel-coactive processing of dimensions

In two visual search experiments, the detection of singleton feature targets redundantly defined on multiple dimensions was investigated. Targets differed from the distractors in orientation, color, or both (redundant targets). In Experiment 1, the various target types were presented either in separate blocks or in random order within blocks. Reaction times to redundant targets significantly violated therace model inequality (Miller, 1982), but only when there was constancy of the target-defining dimension(s) within trial blocks. In Experiment 2, there was dimensional variability within blocks. Consistent with Experiment 1, constancy of the target-defining dimension(s), but this time across successive trials (rather than within blocks), was critical for observing violations of the race model inequality. These results provide evidence for parallel-coactive processing of multiple dimensions, consistent with thedimension-weighting account of Müller, Heller, and Ziegler (1995).     

Selective search for conjunctively defined targets by children and young adults

Two experiments were conducted to investigate age-related differences in visual search for targets defined by the conjunction of two features. In the experiments, 7- and 10-year-old children and young adults searched visual displays for a black circle among distractors consisting of gray circles and black squares. In Experiment 1 (N = 60), we compared performance in the standard search task (where an equal number of each type of distractor appeared across all display sizes) with performance in a modified search task (where the number of black squares was fixed at two and the number of gray circles increased as the display size increased). In Experiment 2 (N = 60), the ratio of black stimuli to gray stimuli was varied systematically as the display size increased. Results of both experiments indicated that all participants were able to restrict search to an appropriate subset of the display rather than conduct an exhaustive search. However, the young adults were more efficient in their ability to do so than were either the 7- or 10-year-old participants. The 10-year-olds were as efficient as the young adults when the number of black stimuli in the display was relatively small. However, these children became relatively less able to restrict search effectively as the number of black stimuli increased. Discussion focused on possible preattentive and attentive processes that may change systematically with age.