Incidental encoding of numerosity in visual long-term memory

The visual system can readily extract numerosity information from brief experiences. This numerical perception is characterized by diminishing accuracy as numerosity increases, and impaired discrimination for similar quantities and large magnitudes. Here we assess whether these properties apply more broadly to numerosity in visual long-term memory. In surprise memory tests, we observed: Remarkable accuracy in estimating the number of repetitions of an exemplar image (Experiment 1a), that this accuracy decreased but remained high when estimating over categories (Experiments 1b and 1c), that numerical discrimination from memory exhibited psychophysical distance and size effects (Experiment 2), that these effects may derive from stored representations rather than post hoc approximation (Experiment 3a), and that they can reflect total elapsed experience in addition to discrete counts (Experiment 3b). Similar to how numerosity is readily extracted during visual perception, our results suggest that numerosity is encoded incidentally in visual long-term memory.     

How might the discrepancy in the effects of perceptual variables on numerosity judgment be reconciled?

It has been claimed that a genuinely abstract numerical representation would be capable of representing the numerosity of any set of discrete elements independently of the attributes of the individual elements. In practice, however, perceptual variables, such as element size, density, and others, affect numerosity judgment. In this study, we examined how perceptual variables affect the performance of numerosity judgments under the control of factors such as amount of practice and set size. In Experiment 1, we introduced the numerosity comparison task to less experienced observers in order to examine the effect of element size and array area. In Experiment 2, we examined whether and how practice would influence precision and accuracy in numerosity comparison and demonstrated that the effects of perceptual variables mostly disappeared. In Experiment 3, we examined whether the effect of practice could transfer to the performance in different stimulus conditions. Taking the results together, we demonstrate that differences in practice might be the source of inconsistent results for perceptual variables.     

The reconfiguration of task set has no effect on the efficiency of feature search

In this study, we investigated whether or not the reconfiguration of a set task could modulate the efficiency of feature search. In Experiment 1, target set size was manipulated. The results revealed that enumerating targets defined by color yields a much steeper slope when executed simultaneously with a discrimination task than when done singly. However, when distractor set size was manipulated, there was no significant difference in the efficiency of individualizing targets from distractors between the two task conditions, no matter whetherthe search was guided by bottom-up information (Experiment 2) or top-down information (Experiment 3). Drawing upon these results, the authors propose that (1) an additional task can impair the efficiency of enumeration, resulting in a steep slope of counting even when target set size is quite small, and (2) in feature search, the visual system first reconfigures the task set to match the input feature information and then detects the targets with an optimal efficiency, which does not support the theory proposed by Di Lollo, Kawahara, Zuvic, and Visser (2001; Di Lollo, Smilek, Kawahara, & Ghorashi, 2005).     

Cross-trial priming of element positions in visual pop-out search is dependent on stimulus arrangement

Two experiments examined cross-trial positional priming (V. Maljkovic & K. Nakayama, 1994, 1996, 2000) in visual pop-out search. Experiment 1 used regularly arranged target and distractor displays, as in previous studies. Reaction times were expedited when the target appeared at a previous target location (facilitation relative to neutral baseline) and slowed when the target appeared at a previous distractor location (inhibition). In contrast to facilitation, inhibition emerged only after extended practice. Experiment 2 revealed reduced facilitatory and no inhibitory priming when the elements' spatial arrangement was made irregular, indicating that positional--in particular, inhibitory--priming critically depends on the configuration of the display elements across sequences of trials. These results are discussed with respect to the role of the context for cross-trial priming in visual pop-out search.     

Mechanisms of priming of pop-out: Stored representations or feature-gain modulations?

Previous research has shown that repetition of a task-relevant attention-capturing feature facilitates popout search. This priming of pop-out effect is due to some residual memory from recent trials. We explore two possible mechanisms of priming of pop-out: a top-down attentional benefit from a memory of the previous target representation that is stored in visual short-term memory (VSTM) and a bottom-up change of attentional gains from perceptual features of the previously attended target. We manipulated participants’ ability to form a memory trace in VSTM by occupying it with a distractor task and found that occupying VSTM did not interfere with priming of pop-out. We next manipulated attentional gains associated with feature values by inserting an irrelevant task between pop-out searches. We found that the color of the target from the intervening perceptual task influenced pop-out search: The current pop-out search was facilitated when the intervening task’s target matched the target color of the pop-out search. These results suggest that priming of pop-out might not be due to a memory trace of the previous targets in VSTM but, rather, might be due to changes in attentional control based on priming from relatively low-level feature representations of previously attended objects.     

The eyes have it: visual pop-out in infants and adults

Visual search studies with adults have shown that stimuli that contain a unique perceptual feature pop out from dissimilar distractors and are unaffected by the number of distractors. Studies with very young infants have suggested that they too might exhibit pop-out. However, infant studies have used paradigms in which pop-out is measured in seconds or minutes, whereas in adults pop-out occurs in milliseconds. In addition, with the previous infant paradigms the effects from higher cognitive processes such as memory cannot be separated from pop-out and selective attention. Consequently, whether infants exhibit the phenomenon of pop-out and have selective attention mechanisms as found in adults is not clear. This study was an initial attempt to design a paradigm that would provide a comparable measure between infants and adults, thereby allowing a more accurate determination of the developmental course of pop-out and selective attention mechanisms. To this end, we measured 3-month-olds' and adults' saccade latencies to visual arrays that contained either a + among Ls (target-present) or all Ls (target-absent) with set sizes of 1, 3, 5 or 8 items. In Experiment 1, infants' saccade latencies remained unchanged in the target-present conditions as set size increased, whereas their saccade latencies increased linearly in the target-absent conditions as set size increased. In Experiment 2, adults' saccade latencies in the target-present and target-absent conditions showed the same pattern as the infants. The only difference between the infants and adults was that the infants' saccade latencies were slower in every condition. These results indicate that infants do exhibit pop-out on a millisecond scale, that it is unaffected by the number of distractors, and likely have similar functioning selective attention mechanisms. Moreover, the results indicate that eye movement latencies are a more comparable and accurate measure for assessing the phenomenon of pop-out and underlying attentional mechanisms in infants.     

Is approximate numerical judgment truly modality-independent? Visual, auditory, and cross-modal comparisons

The numerosity of any set of discrete elements can be depicted by a genuinely abstract number representation, irrespective of whether they are presented in the visual or auditory modality. The accumulator model predicts that no cost should apply for comparing numerosities within and across modalities. However, in behavioral studies, some inconsistencies have been apparent in the performance of number comparisons among different modalities. In this study, we tested whether and how numerical comparisons of visual, auditory, and cross-modal presentations would differ under adequate control of stimulus presentation. We measured the Weber fractions and points of subjective equality of numerical discrimination in visual, auditory, and cross-modal conditions. The results demonstrated differences between the performances in visual and auditory conditions, such that numerical discrimination of an auditory sequence was more precise than that of a visual sequence. The performance of cross-modal trials lay between performance levels in the visual and auditory conditions. Moreover, the number of visual stimuli was overestimated as compared to that of auditory stimuli. Our findings imply that the process of approximate numerical representation is complex and involves multiple stages, including accumulation and decision processes.     

Attentional selection of objects or features: evidence from a modified search task

Three experiments examined the domain of visual selective attention (i.e., feature-based selection vs. object-based selection). Experiment 1 extended the requirements of the visual search task by requiring a feature discrimination response to target elements presented for short durations (30-105 msec). Targets were embedded in 47 distractor elements and were defined by either a distinct color or a distinct orientation. Observers made a discrimination response to either the target's color or its orientation. When the target-defining feature and the feature to be discriminated were the same (matched conditions), accuracy was enhanced relative to when these features belonged to separate dimensions (mismatched conditions). In Experiment 2, similar results were found in a task in which the target-defining dimension varied from trial to trial and observers performed both color and orientation discriminations on every trial. The results from these two experiments are consistent with feature-based attentional selection, but not with object-based selection. Experiment 3 extended these findings by showing that the effect is rooted in the overlap between target and distractor values in the stimulus set. The results are discussed in the context of recent models of visual selective attention.     

Segmentation and selection contribute to local processing in hierarchical analysis.

The present study examined the role of segmentation and selection processes when we respond to local elements in hierarchical stimuli. The ease of segmentation and selection of an individual local element from hierarchical patterns was manipulated by making one local element substantially distinct from the others in colour. Experiment 1 showed that, when attention was spread across the global and local levels in a divided attention task, the introduction of the local red element speeded responses to local targets but slowed responses when targets appeared at the global level. Experiment 2 used a selective attention task in which subjects responded only to the local or the global shapes across a block of trials. Under these circumstances, the local red element reduced global-to-local interference in addition to speeding local responses. The results suggest that the efficiency with which local elements are segmented and selected affects responses to local aspects of hierarchical patterns; furthermore, the effect of local pop-out on global processing is contingent on top-down attentional control settings.     

Display size effects in visual search: Analyses of reaction time distributions as mixtures

In a reanalysis of data from Cousineau and Shiffrin (2004) and two new visual search experiments, we used a likelihood ratio test to examine the full distributions of reaction time (RT) for evidence that the display size effect is a mixture-type effect that occurs on only a proportion of trials, leaving RT in the remaining trials unaffected, as is predicted by serial self-terminating search models. Experiment 1 was a reanalysis of Cousineau and Shiffrin's data, for which a mixture effect had previously been established by a bimodal distribution of RTs, and the results confirmed that the likelihood ratio test could also detect this mixture. Experiment 2 applied the likelihood ratio test within a more standard visual search task with a relatively easy target/distractor discrimination, and Experiment 3 applied it within a target identification search task within the same types of stimuli. Neither of these experiments provided any evidence for the mixture-type display size effect predicted by serial self-terminating search models. Overall, these results suggest that serial self-terminating search models may generally be applicable only with relatively difficult target/distractor discriminations, and then only for some participants. In addition, they further illustrate the utility of analysing full RT distributions in addition to mean RT.     

Spontaneous visual search during the first two years: Improvement with age but no evidence of efficient search

Efficient visual search, wherein reaction times to acquire targets are largely independent of array size, is commonly observed in adults. Evidence for efficient search in infants may imply that selective attention to visual features is similar across development. In the current cross-sectional eye-tracking study, we examined spontaneous visual search at 6, 12, 18, and 24 months. Infants were presented with Random arrays (one target among 7, 13, or 26 pseudorandomly distributed elements) and Circle arrays (one target among 4, 7, or 13 elements arranged in a circle). Contrary to predictions, we did not find evidence of efficient search among infants. With increasing array size, time-to-target increased, the proportion of targets fixated (analogous to accuracy) decreased, and the proportion of first looks to the target decreased for both types of array (ps < .001). For Random arrays, the proportion of first looks to the target was similar to chance for all ages and array sizes; for Circle arrays, it exceeded chance for some ages and array sizes. The proportion of targets fixated and first looks to target increased with age across display types (ps < .05). We also tested adults with the same stimuli under similar conditions; the adults showed evidence of efficient visual search. Possible explanations and implications are discussed.     

Selection-for-action in visual search

Grasping an object rather than pointing to it enhances processing of its orientation but not its color. Apparently, visual discrimination is selectively enhanced for a behaviorally relevant feature. In two experiments we investigated the limitations and targets of this bias. Specifically, in Experiment 1 we were interested to find out whether the effect is capacity demanding, therefore we manipulated the set-size of the display. The results indicated a clear cognitive processing capacity requirement, i.e. the magnitude of the effect decreased for a larger set size. Consequently, in Experiment 2, we investigated if the enhancement effect occurs only at the level of behaviorally relevant feature or at a level common to different features. Therefore we manipulated the discriminability of the behaviorally neutral feature (color). Again, results showed that this manipulation influenced the action enhancement of the behaviorally relevant feature. Particularly, the effect of the color manipulation on the action enhancement suggests that the action effect is more likely to bias the competition between different visual features rather than to enhance the processing of the relevant feature. We offer a theoretical account that integrates the action-intention effect within the biased competition model of visual selective attention.     

Visual pop-out in infants: Evidence for preattentive search in 3- and 4-month-olds

The present experiment tested for preattentive visual search in 3- and 4-month-old infants using stimulus features described by Treisman and Souther (1985) as producing visual “pop-out” effects in adults. Infants were presented with two visual arrays to the left and right of midline. One array comprised homogeneous elements, while the other had a discrepant element embedded in it. On the basis of previous research, we expected infants to fixate the array containing the embedded discrepant element. The pattern of fixation indicated detection of the embedded discrepant element for both age groups, but only with stimuli shown to elicit visual pop out in adults. This asymmetry in detection is consistent with the presence of preattentive visual search in infants as young as 3 months.     

Temporal information affects the performance of numerosity discrimination: Behavioral evidence for a shared system for numerosity and temporal processing

In this study, we tested whether and how temporal information would affect the performance of numerosity discrimination in sequential events, in an attempt to make the relationship clear between temporal and numerosity processing. We manipulated the duration of event presentation (i.e., the stimulus duration) and the duration of the sequence (i.e., the total interval). We also employed three levels of standard event numbers (i.e., 5, 10, and 20) to test whether and how the effect would differ among event numbers. The results showed that temporal information affected the performance of numerosity discrimination; precision deteriorated when stimulus duration and the total interval were manipulated, and the number of events in the longer total interval were judged as less numerous than those in the shorter total interval across standard numbers. Accordingly, our results suggested the existence of a shared system between time and numerosity processing.     

The cognitive loci of the display and task-relevant set size effects on distractor interference: Evidence from a dual-task paradigm

The congruency effect of a task-irrelevant distractor has been found to be modulated by task-relevant set size and display set size. The present study used a psychological refractory period (PRP) paradigm to examine the cognitive loci of the display set size effect (dilution effect) and the task-relevant set size effect (perceptual load effect) on distractor interference. A tone discrimination task (Task 1), in which a response was made to the pitch of the target tone, was followed by a letter discrimination task (Task 2) in which different types of visual target display were used. In Experiment 1, in which display set size was manipulated to examine the nature of the display set size effect on distractor interference in Task 2, the modulation of the congruency effect by display set size was observed at both short and long stimulus-onset asynchronies (SOAs), indicating that the display set size effect occurred after the target was selected for processing in the focused attention stage. In Experiment 2, in which task-relevant set size was manipulated to examine the nature of the task-relevant set size effect on distractor interference in Task 2, the effects of task-relevant set size increased with SOA, suggesting that the target selection efficiency in the preattentive stage was impaired with increasing task-relevant set size. These results suggest that display set size and task-relevant set size modulate distractor processing in different ways.     

Explicit awareness supports conditional visual search in the retrieval guidance paradigm

In four experiments we explored whether participants would be able to use probabilistic prompts to simplify perceptually demanding visual search in a task we call the retrieval guidance paradigm. On each trial a memory prompt appeared prior to (and during) the search task and the diagnosticity of the prompt(s) was manipulated to provide complete, partial, or non-diagnostic information regarding the target's color on each trial (Experiments 1–3). In Experiment 1 we found that the more diagnostic prompts was associated with faster visual search performance. However, similar visual search behavior was observed in Experiment 2 when the diagnosticity of the prompts was eliminated, suggesting that participants in Experiment 1 were merely relying on base rate information to guide search and were not utilizing the prompts. In Experiment 3 participants were informed of the relationship between the prompts and the color of the target and this was associated with faster search performance relative to Experiment 1, suggesting that the participants were using the prompts to guide search. Additionally, in Experiment 3 a knowledge test was implemented and performance in this task was associated with qualitative differences in search behavior such that participants that were able to name the color(s) most associated with the prompts were faster to find the target than participants who were unable to do so. However, in Experiments 1–3 diagnosticity of the memory prompt was manipulated via base rate information, making it possible that participants were merely relying on base rate information to inform search in Experiment 3. In Experiment 4 we manipulated diagnosticity of the prompts without manipulating base rate information and found a similar pattern of results as Experiment 3. Together, the results emphasize the importance of base rate and diagnosticity information in visual search behavior. In the General discussion section we explore how a recent computational model of hypothesis generation (HyGene; Thomas, Dougherty, Sprenger, & Harbison, 2008), linking attention with long-term and working memory, accounts for the present results and provides a useful framework of cued recall visual search.     

Withdrawing attention at little or no cost: Detection and discrimination tasks

We used a concurrent-task paradigm to investigate the attentional cost of simple visual tasks. As in earlier studies, we found that detecting a unique orientation in an array of oriented elements (“pop-out”) carries little or no attentional cost. Surprisingly, this is true at all levels of performance and holds even when pop-out is barely discriminable. We discuss this finding in the context of our previous report that the attentional cost of stimulus detection is strongly influenced by the presence and nature of other stimuli in the display (Braun, 1994b). For discrimination tasks, we obtained a similarly mixed outcome: Discrimination of letter shape carried a high attentional cost whereas discrimination of color and orientation did not. Taken together, these findings lead us to modify our earlier position on the attentional costs of detection and discrimination tasks (Sagi & Julesz, 1985). We now believe that observers enjoy a significant degree of “ambient” visual awareness outside the focus of attention, permitting them to both detect and discriminate certain visual information. We hypothesize that the information in question is selected by a competition for saliency at the level of early vision.     

非数量视觉特征对数量感知的影响

以往许多研究探讨了各种视觉特征对数量判断任务的影响,但得出了不一致的结论.本研究依据信号检测论原理对刺激特征影响数量判断的方式进行考察.结果发现:刺激大小、形状和分布均匀度等因素可影响数量判断的反应标准,但不会影响辨别力;刺激聚集或组块会直接对数量判断的辨别力产生影响.结果表明,不同刺激特征对数量判断的影响方式存在差异.一方面,人类具有从刺激特征中直接抽取数量信息进行认知比较的能力;另一方面,刺激点聚集或组块可以直接影响被试的数量感知.此外,我们还推测,组块是通过改变客体表征的方式来影响数量感知的.     

The properties of object representations constructed during visual search in natural scenes

To investigate properties of object representations constructed during a visual search task, we manipulated the proportion of trials/task within a block: In a search-frequent block, 80% of trials were search tasks; remaining trials presented a memory task; in a memory-frequent block, this proportion was reversed. In the search task, participants searched for a toy car (Experiments 1 and 2) or a T-shape object (Experiment 3). In the memory task, participants had to memorize objects in a scene. Memory performance was worse in the search-frequent block than in the memory-frequent block in Experiments 1 and 3, but not in Experiment 2 (token change in Experiment 1; type change in Experiments 2 and 3). Experiment 4 demonstrated that lower performance in the search-frequent block was not due to eye-movement behaviour. Results suggest that object representations constructed during visual search are different from those constructed during memorization and they are modulated by type of target.