Reallocating attention during multiple object tracking

Wolfe, Place, and Horowitz (Psychonomic Bulletin & Review 14:344?C349, 2007) found that participants were relatively unaffected by selecting and deselecting targets while performing a multiple object tracking task, such that maintaining tracking was possible for longer durations than the few seconds typically studied. Though this result was generally consistent with other findings on tracking duration (Franconeri, Jonathon, & Scimeca Psychological Science 21:920?C925, 2010), it was inconsistent with research involving cuing paradigms, specifically precues (Pylyshyn & Annan Spatial Vision 19:485?C504, 2006). In the present research, we broke down the addition and removal of targets into separate conditions and incorporated a simple performance model to evaluate the costs associated with the selection and deselection of moving targets. Across three experiments, we demonstrated evidence against a cost being associated with any shift in attention, but rather that varying the type of cue used for target deselection produces no additional cost to performance and that hysteresis effects are not induced by a reduction in tracking load.     

Angry faces are tracked more easily than neutral faces during multiple identity tracking

We investigated whether and how emotional facial expressions affect sustained attention in face tracking. In a multiple-identity and object tracking paradigm, participants tracked multiple target faces that continuously moved around together with several distractor faces, and subsequently reported where each target face had moved to. The emotional expression (angry, happy, and neutral) of the target and distractor faces was manipulated. Tracking performance was better when the target faces were angry rather than neutral, whereas angry distractor faces did not affect tracking. The effect persisted when the angry faces were presented upside-down and when surface features of the faces were irrelevant to the ongoing task. There was only suggestive and weak evidence for a facilitatory effect of happy targets and a distraction effect of happy distractors in comparison to neutral faces. The results show that angry expressions on the target faces can facilitate sustained attention on the targets via increased vigilance, yet this effect likely depends on both emotional information and visual features of the angry faces.     

Spatial reference in multiple object tracking

Spatial reference in multiple object tracking is available from configurations of dynamic objects and static reference objects. In three experiments, we studied the use of spatial reference in tracking and in relocating targets after abrupt scene rotations. Observers tracked 1, 2, 3, 4, and 6 targets in 3D scenes, in which white balls moved on a square floor plane. The floor plane was either visible thus providing static spatial reference or it was invisible. Without scene rotations, the configuration of dynamic objects provided sufficient spatial reference and static spatial reference was not advantageous. In contrast, with abrupt scene rotations of 20°, static spatial reference supported in relocating targets. A wireframe floor plane lacking local visual detail was as effective as a checkerboard. Individually colored geometric forms as static reference objects provided no additional benefit either, even if targets were centered on these forms at the abrupt scene rotation. Individualizing the dynamic objects themselves by color for a brief interval around the abrupt scene rotation, however, did improve performance. We conclude that attentional tracking of moving targets proceeds within dynamic configurations but detached from static local background.     

Contextual cueing in multiple object tracking

In this study, we examined whether visual context can be learned through a dynamic display and whether it can facilitate sustained attentional tracking by combining a multiple object tracking (MOT) task and a contextual cueing procedure. The trajectories of the targets and distractors in the MOT task were made invariant by repeatedly presenting them. The results revealed that when the targets were repeatedly displayed, tracking performance implicitly improved, and this effect was enhanced when the unattended distractors in the displays were also repeated. However, the repetition of the distractors alone did not produce any effect. Interestingly, when the targets and distractors were switched in a display in which the distractors had been previously repeated, the tracking performance was impaired as compared with that in the case of nonrepeated displays. We concluded that the contextual information in a dynamic display facilitates attentional tracking and that different types of contextual modulations occurred in MOT processes, such as facilitation for attended targets and inhibition for ignored distractors.     

Direction information in multiple object tracking is limited by a graded resource

Is multiple object tracking (MOT) limited by a fixed set of structures (slots), a limited but divisible resource, or both? Here, we answer this question by measuring the precision of the direction representation for tracked targets. The signature of a limited resource is a decrease in precision as the square root of the tracking load. The signature of fixed slots is a fixed precision. Hybrid models predict a rapid decrease to asymptotic precision. In two experiments, observers tracked moving disks and reported target motion direction by adjusting a probe arrow. We derived the precision of representation of correctly tracked targets using a mixture distribution analysis. Precision declined with target load according to the square-root law up to six targets. This finding is inconsistent with both pure and hybrid slot models. Instead, directional information in MOT appears to be limited by a continuously divisible resource.     

多目标追踪的神经机制

多目标追踪任务是研究动态场景中视觉注意加工机制常用的范式。自1998年开始对多目标追踪神经机制的影像学研究以来, 研究者采用ERP和fMRI等技术对多目标注意追踪所涉及的神经电生理活动和脑功能区激活方面开展了大量研究。ERP研究发现, 追踪过程持续的ERP脑电成分如N2pc、CDA的波幅与注意追踪负荷有关, 并且出现在目标与非目标上的探测刺激诱发的脑电成分如N1、P1波幅的差异可反映注意资源的分配, 具体为目标在追踪过程中得到了激活, 而非目标受到了抑制。fMRI研究比较一致地发现了顶叶(包括前顶内沟、后顶内沟、顶上小叶)、背外侧额叶皮层等在注意追踪中的强烈激活。其中顶内沟主要与注意负荷有关, 顶内沟的活动水平直接决定了观察者注意追踪的行为表现。而顶上小叶可能更多的负责注意转移。背外侧额叶皮层可能负责追踪时的感觉运动预测过程。     

The role of eye fixations in concentration and amplification effects during multiple object tracking

When tracking spatially extended objects in a multiple object tracking task, attention is preferentially directed to the centres of those objects (attentional concentration), and this effect becomes more pronounced as object length increases (attentional amplification). However, it is unclear whether these effects depend on differences in attentional allocation or differences in eye fixations. We addressed this question by measuring eye fixations in a dual-task paradigm that required participants to track spatially extended objects, while simultaneously detecting probes that appeared at the centres or near the endpoints of objects. Consistent with previous research, we observed concentration and amplification effects: Probes at the centres of objects were detected more readily than those near their endpoints, and this difference increased with object length. Critically, attentional concentration was observed when probes were equated for distance from fixation during free viewing, and concentration and amplification were observed without eye movements during strict fixation. We conclude that these effects reflect the prioritization of covert attention to particular spatial regions within extended objects, and we discuss the role of eye fixations during multiple object tracking.     

Eye movements across viewpoint changes in multiple object tracking

Observers can visually track multiple objects that move independently even if the scene containing the moving objects is rotated in a smooth way. Abrupt scene rotations yield tracking more difficult but not impossible. For nonrotated, stable dynamic displays, the strategy of looking at the targets' centroid has been shown to be of importance for visual tracking. But which factors determine successful visual tracking in a nonstable dynamic display? We report two eye tracking experiments that present evidence for centroid looking. Across abrupt viewpoint changes, gaze on the centroid is more stable than gaze on targets indicating a process of realigning targets as a group. Further, we show that the relative importance of centroid looking increases with object speed.     

Category-based grouping in working memory and multiple object tracking

Two prominent cognitive capacity limitations are the maximal number of objects we can place in working memory (WM) and the maximal number of objects we can track in a display. Both are believed to have a numeric value of 3 or 4, which has led to the proposal that we have a general cognitive capacity, and that this capacity is most likely linked to limitations of how many objects we can attend simultaneously. Based on previous results showing that we can memorize more objects if they come from different categories than if they come from the same category (e.g., Feigenson & Halberda, 2008; Wong, Peterson, & Thompson, 2008; Wood, 2008), we compare how category-based grouping affects performance for WM and multiple object tracking (MOT). We present participants with either “pure” displays of either cars or faces, or with “mixed” displays of cars and faces. Overall, the effects of category are weak. In some analyses but not others, we replicate the mixed advantage for WM, albeit with a small effect size. In contrast, we observe a weak pure advantage for MOT tasks, at least in a meta-analysis of five experiments, but not in all experiments. Accordingly, WM and MOT tasks differed significantly in their sensitivity to category membership. We also find that WM is slightly better for faces than for cars, but that no such difference exists for MOT. We tentatively suggest that cognitive capacity limitations in different domains are at least partially due to the limitations of distinct mechanisms.     

多目标追踪中“线索”研究的贡献

多目标追踪范式是探讨动态情景下注意加工过程的成熟技术,其对不同阶段注意线索加工与利用的分析,对深入了解注意的动态信息加工过程具有重要意义。从注意线索的视角述评呈现阶段的内源性线索与外源性线索以及追踪阶段的目标数量动态变化和轨迹线索的研究成果及限制因素,提出多目标线索研究是客体档案理论与视觉索引理论之争的关键。虽然多目标追踪范式为内源性线索、外源性线索的提取与策略等研究提供很多便利,但目前该范式在线索的认知资源分配和加工策略上仍有研究留白,尚需进一步探索。     

Object property encoding and change blindness in multiple object tracking

The paradigm of multiple object tracking (MOT) is an established tool for investigating human performance under conditions of divided attention to several objects. We studied change detection ability for colour and shape information in the setting of MOT. Subjects had to detect colour and shape changes during an MOT task. These changes occurred either openly (with nothing to hide them) or with a mud splash in the background to hide the change transient signal. Our experiment demonstrated that (1) when hidden by mud splashes, we fail to perceive a considerable number of colour changes even in the attended objects (i.e., targets) and (2) the visual system is significantly more likely to miss colour and shape changes in distractors than in target. We conclude that a colour change will be detected a lot more efficiently if attention is drawn to its transient. When a simultaneous mud splash hides the transient signal, subjects are significantly less efficient in detecting the change.     

多目标追踪中基于运动信息的分组效应

本研究旨在探讨运动信息对多目标追踪的影响, 具体为考察多目标追踪中是否存在基于运动信息的分组效应, 以及不同类型表面特征(颜色和形状)对这一效应的影响。实验1发现多目标追踪中存在基于运动信息的分组效应, 并且这一分组效应是自动化的。实验2和实验3分别在不同颜色和不同形状组合条件下考察了基于运动信息的分组效应的稳定性, 结果都表明不同表面特征的组合不会干扰基于运动信息的分组效应的形成, 但其效应量都因表面特征的出现而缩减。整体而言, 多目标追踪中存在基于运动信息的自动化分组效应, 并且这一效应是格式塔法则中共同命运律的具体表现, 能稳定存在于不同表面特征组合之间。     

The role of visual attention in multiple object tracking: Evidence from ERPs

We examined the role of visual attention in the multiple object tracking (MOT) task by measuring the amplitude of the N1 component of the event-related potential to probe flashes presented on targets, distractors, or empty background areas. We found evidence that visual attention enhances targets and suppresses distractors (Experiments 1 and 3). However, we also found that when tracking load was light (two targets and two distractors), accurate tracking could be carried out without any apparent contribution from the visual attention system (Experiment 2). Our results suggest that attentional selection during MOT is flexibly determined by task demands, as well as tracking load, and that visual attention may not always be necessary for accurate tracking.     

Enumeration versus multiple object tracking: the case of action video game players

Here, we demonstrate that action video game play enhances subjects' ability in two tasks thought to indicate the number of items that can be apprehended. Using an enumeration task, in which participants have to determine the number of quickly flashed squares, accuracy measures showed a near ceiling performance for low numerosities and a sharp drop in performance once a critical number of squares was reached. Importantly, this critical number was higher by about two items in video game players (VGPs) than in non-video game players (NVGPs). A following control study indicated that this improvement was not due to an enhanced ability to instantly apprehend the numerosity of the display, a process known as subitizing, but rather due to an enhancement in the slower more serial process of counting. To confirm that video game play facilitates the processing of multiple objects at once, we compared VGPs and NVGPs on the multiple object tracking task (MOT), which requires the allocation of attention to several items over time. VGPs were able to successfully track approximately two more items than NVGPs. Furthermore, NVGPs trained on an action video game established the causal effect of game playing in the enhanced performance on the two tasks. Together, these studies confirm the view that playing action video games enhances the number of objects that can be apprehended and suggest that this enhancement is mediated by changes in visual short-term memory skills.     

Studying visual attention using the multiple object tracking paradigm: A tutorial review

Human observers are capable of tracking multiple objects among identical distractors based only on their spatiotemporal information. Since the first report of this ability in the seminal work of Pylyshyn and Storm (1988, Spatial Vision, 3, 179–197), multiple object tracking has attracted many researchers. A reason for this is that it is commonly argued that the attentional processes studied with the multiple object paradigm apparently match the attentional processing during real-world tasks such as driving or team sports. We argue that multiple object tracking provides a good mean to study the broader topic of continuous and dynamic visual attention. Indeed, several (partially contradicting) theories of attentive tracking have been proposed within the almost 30 years since its first report, and a large body of research has been conducted to test these theories. With regard to the richness and diversity of this literature, the aim of this tutorial review is to provide researchers who are new in the field of multiple object tracking with an overview over the multiple object tracking paradigm, its basic manipulations, as well as links to other paradigms investigating visual attention and working memory. Further, we aim at reviewing current theories of tracking as well as their empirical evidence. Finally, we review the state of the art in the most prominent research fields of multiple object tracking and how this research has helped to understand visual attention in dynamic settings.     

Hue distinctiveness overrides category in determining performance in multiple object tracking

The visual distinctiveness between targets and distractors can significantly facilitate performance in multiple object tracking (MOT), in which color is a feature that has been commonly used. However, the processing of color can be more than “visual.” Color is continuous in chromaticity, while it is commonly grouped into discrete categories (e.g., red, green). Evidence from color perception suggested that color categories may have a unique role in visual tasks independent of its chromatic appearance. Previous MOT studies have not examined the effect of chromatic and categorical distinctiveness on tracking separately. The current study aimed to reveal how chromatic (hue) and categorical distinctiveness of color between the targets and distractors affects tracking performance. With four experiments, we showed that tracking performance was largely facilitated by the increasing hue distance between the target set and the distractor set, suggesting that perceptual grouping was formed based on hue distinctiveness to aid tracking. However, we found no color categorical effect, because tracking performance was not significantly different when the targets and distractors were from the same or different categories. It was concluded that the chromatic distinctiveness of color overrides category in determining tracking performance, suggesting a dominant role of perceptual feature in MOT.     

Attentional signatures of perception: multiple object tracking reveals the automaticity of contour interpolation

Multiple object tracking (MOT) is an attentional task wherein observers attempt to track multiple targets among moving distractors. Contour interpolation is a perceptual process that fills-in nonvisible edges on the basis of how surrounding edges (inducers) are spatiotemporally related. In five experiments, we explored the automaticity of interpolation through its influences on tracking. We found that (1) when the edges of targets and distractors jointly formed dynamic illusory or occluded contours, tracking accuracy worsened; (2) when interpolation bound all four targets together, performance improved; (3) when interpolation strength was weakened (by altering the size or relative orientation of inducing edges), tracking effects disappeared; and (4) real and interpolated contours influenced tracking comparably, except that real contours could more effectively shift attention toward distractors. These results suggest that interpolation's characteristics-and, in particular, its automaticity-can be revealed through its attentional influences or "signatures" within tracking. Our results also imply that relatively detailed object representations are formed in parallel, and that such representations can affect tracking when they become relevant to scene segmentation.     

Grouping and trajectory storage in multiple object tracking: impairments due to common item motions

In our natural viewing, we notice that objects change their locations across space and time. However, there has been relatively little consideration of the role of motion information in the construction and maintenance of object representations. We investigated this question in the context of the multiple object tracking (MOT) paradigm, wherein observers must keep track of target objects as they move randomly amid featurally identical distractors. In three experiments, we observed impairments in tracking ability when the motions of the target and distractor items shared particular properties. Specifically, we observed impairments when the target and distractor items were in a chasing relationship or moved in a uniform direction. Surprisingly, tracking ability was impaired by these manipulations even when observers failed to notice them. Our results suggest that differentiable trajectory information is an important factor in successful performance of MOT tasks. More generally, these results suggest that various types of common motion can serve as cues to form more global object representations even in the absence of other grouping cues.     

Infants' knowledge of objects: beyond object files and object tracking

Two independent research communities have produced large bodies of data concerning object representations: the community concerned with the infant's object concept and the community concerned with adult object-based attention. We marshal evidence in support of the hypothesis that both communities have been studying the same natural kind. The discovery that the object representations of young infants are the same as the object files of mid-level visual cognition has implications for both fields.