Changing target trajectories influences tracking performance

People have the ability to attentively select and successfully track several moving objects, a process known as multiple-object tracking (MOT; Pylyshyn & Storm Spatial Vision 3: 179–197, 1988). Various factors have been known to influence MOT performance, such as speed, number of distractors, and proximity, while recent work has suggested that object trajectories may also be a factor (Fencsik, Kleiger, & Horowitz Perception and Psychophysics 69: 567–577, 2007). Meanwhile, unexpected changes in motion information have been demonstrated to be a critical facet for attracting attention Howard & Holcombe Attention, Perception & Psychophysics 72: 2087–2095, (2010). Therefore, we suggest that unexpected changes in target trajectories are an important factor in tracking performance. The research presented here controlled for spatial proximity while manipulating the number of instances in which an object changed trajectory. We found that spatial proximity had no effect on tracking performance but, rather, as the number of trajectory changes increased, tracking performance suffered. Results imply that the ability to track multiple moving objects is limited by unexpected changes in direction.     

Attentional costs in multiple-object tracking

Attentional demands of multiple-object tracking were demonstrated using a dual-task paradigm. Participants were asked to make speeded responses based on the pitch of a tone, while at the same time tracking four of eight identical dots. Tracking difficulty was manipulated either concurrent with or after the tone task. If increasing tracking difficulty increases attentional demands, its effect should be larger when it occurs concurrent with the tone. In Experiment 1, tracking difficulty was manipulated by having all dots briefly attract one another on some trials, causing a transient increase in dot proximity and speed. Results showed that increasing proximity and speed had a significantly larger effect when it occurred at the same time as the tone task. Experiments 2 and 3 showed that manipulating either proximity or speed independently was sufficient to produce this pattern of results. Experiment 4 manipulated object contrast, which affected tracking performance equally whether it occurred concurrent with or after the tone task. Overall, results support the view that the moment-to-moment tracking of multiple objects demands attention. Understanding what factors increase the attentional demands of tracking may help to explain why tracking is sometimes successful and at other times fails.     

The role of location and motion information in the tracking and recovery of moving objects

Observers in a multiple object tracking task can track about four to five independently moving targets among several moving distractors, even if all of the stimuli disappear for a 300-msec gap. How observers reacquire targets following such a gap reveals what kind of information they can maintain for targets. Previous research has suggested that participants maintain minimal information about a set of moving objects--namely, just their present spatial locations. We report five new experiments that demonstrate retention of location information for at least four objects, and extrapolated motion information for around two objects.     

Attentive tracking of objects versus substances

Recent research in vision science, infant cognition, and word learning suggests a special role for the processing of discrete objects. But what counts as an object? Answers to this question often depend on contrasting object-based processing with the processing of spatial areas or unbound visual features. In infant cognition and word learning, though, another salient contrast has been between rigid cohesive objects and nonsolid substances. Whereas objects may move from one location to another, a nonsolid substance must pour from one location to another. In the study reported here, we explored whether attentive tracking processes are sensitive to dynamic information of this type. Using a multiple-object tracking task, we found that subjects could easily track four items in a display of eight identical unpredictably moving entities that moved as discrete objects from one location to another, but could not track similar entities that noncohesively "poured" from one location to another-even when the items in both conditions followed the same trajectories at the same speeds. Other conditions revealed that this inability to track multiple "substances" stemmed not from violations of rigidity or cohesiveness per se, because subjects were able to track multiple noncohesive collections and multiple nonrigid deforming objects. Rather, the impairment was due to the dynamic extension and contraction during the substancelike motion, which rendered the location of the entity ambiguous. These results demonstrate a convergence between processes of midlevel adult vision and infant cognition, and in general help to clarify what can count as a persisting dynamic object of attention.     

Spatial updating of dynamic scenes: Tracking multiple invisible objects across viewpoint changes

Research on dynamic attention has shown that visual tracking is possible even if the observer’s viewpoint on the scene holding the moving objects changes. In contrast to smooth viewpoint changes, abrupt changes typically impair tracking performance. The lack of continuous information about scene motion, resulting from abrupt changes, seems to be the critical variable. However, hard onsets of objects after abrupt scene motion could explain the impairment as well. We report three experiments employing object invisibility during smooth and abrupt viewpoint changes to examine the influence of scene information on visual tracking, while equalizing hard onsets of moving objects after the viewpoint change. Smooth viewpoint changes provided continuous information about scene motion, which supported the tracking of temporarily invisible objects. However, abrupt and, therefore, discontinuous viewpoint changes strongly impaired tracking performance. Object locations retained with respect to a reference frame can account for the attentional tracking that follows invisible objects through continuous scene motion.     

Grouping and trajectory storage in multiple object tracking: impairments due to common item motions

In our natural viewing, we notice that objects change their locations across space and time. However, there has been relatively little consideration of the role of motion information in the construction and maintenance of object representations. We investigated this question in the context of the multiple object tracking (MOT) paradigm, wherein observers must keep track of target objects as they move randomly amid featurally identical distractors. In three experiments, we observed impairments in tracking ability when the motions of the target and distractor items shared particular properties. Specifically, we observed impairments when the target and distractor items were in a chasing relationship or moved in a uniform direction. Surprisingly, tracking ability was impaired by these manipulations even when observers failed to notice them. Our results suggest that differentiable trajectory information is an important factor in successful performance of MOT tasks. More generally, these results suggest that various types of common motion can serve as cues to form more global object representations even in the absence of other grouping cues.     

客体运动方向的视觉工作记忆容量

记忆动态场景中多客体的特征和时空信息是人类重要的认知活动。目前有关视觉工作记忆的研究虽然广泛探讨了对视觉信息的存储容量及机制,然而所采用的刺激材料均呈现于静态场景中,且不包含运动信息。而有关多客体追踪的研究只关注动态场景中多客体信息的实时更新,而不涉及一段时间内对客体信息的保持。本研究结合视觉工作记忆领域的变化觉察范式和多客体追踪范式,以独立运动的客体为刺激材料,探讨多个客体的运动方向信息在工作记忆中的存储容量问题。结果表明,在工作记忆中能够存储大约3个客体的运动方向信息。     

How do humans group non-rigid objects in multiple object tracking?: Evidence from grouping by self-rotation

Previous studies on perceptual grouping found that people can use spatiotemporal and featural information to group spatially separated rigid objects into a unit while tracking moving objects. However, few studies have tested the role of objects’ self-motion information in perceptual grouping, although it is of great significance to the motion perception in the three-dimensional space. In natural environments, objects always move in translation and rotation at the same time. The self-rotation of the objects seriously destroys objects’ rigidity and topology, creates conflicting movement signals and results in crowding effects. Thus, this study sought to examine the specific role played by self-rotation information on grouping spatially separated non-rigid objects through a modified multiple object tracking (MOT) paradigm with self-rotating objects. Experiment 1 found that people could use self-rotation information to group spatially separated non-rigid objects, even though this information was deleterious for attentive tracking and irrelevant to the task requirements, and people seemed to use it strategically rather than automatically. Experiment 2 provided stronger evidence that this grouping advantage did come from the self-rotation per se rather than surface-level cues arising from self-rotation (e.g. similar 2D motion signals and common shapes). Experiment 3 changed the stimuli to more natural 3D cubes to strengthen the impression of self-rotation and again found that self-rotation improved grouping. Finally, Experiment 4 demonstrated that grouping by self-rotation and grouping by changing shape were statistically comparable but additive, suggesting that they were two different sources of the object information. Thus, grouping by self-rotation mainly benefited from the perceptual differences in motion flow fields rather than in deformation. Overall, this study is the first attempt to identify self-motion as a new feature that people can use to group objects in dynamic scenes and shed light on debates about what entities/units we group and what kinds of information about a target we process while tracking objects.     

Evidence against a speed limit in multiple-object tracking

Everyday tasks often require us to keep track of multiple objects in dynamic scenes. Past studies show that tracking becomes more difficult as objects move faster. In the present study, we show that this trade-off may not be due to increased speed itself but may, instead, be due to the increased crowding that usually accompanies increases in speed. Here, we isolate changes in speed from variations in crowding, by projecting a tracking display either onto a small area at the center of a hemispheric projection dome or onto the entire dome. Use of the larger display increased retinal image size and object speed by a factor of 4 but did not increase interobject crowding. Results showed that tracking accuracy was equally good in the large-display condition, even when the objects traveled far into the visual periphery. Accuracy was also not reduced when we tested object speeds that limited performance in the small-display condition. These results, along with a reinterpretation of past studies, suggest that we might be able to track multiple moving objects as fast as we can a single moving object, once the effect of object crowding is eliminated.     

多目标追踪中基于运动信息的分组效应

本研究旨在探讨运动信息对多目标追踪的影响, 具体为考察多目标追踪中是否存在基于运动信息的分组效应, 以及不同类型表面特征(颜色和形状)对这一效应的影响。实验1发现多目标追踪中存在基于运动信息的分组效应, 并且这一分组效应是自动化的。实验2和实验3分别在不同颜色和不同形状组合条件下考察了基于运动信息的分组效应的稳定性, 结果都表明不同表面特征的组合不会干扰基于运动信息的分组效应的形成, 但其效应量都因表面特征的出现而缩减。整体而言, 多目标追踪中存在基于运动信息的自动化分组效应, 并且这一效应是格式塔法则中共同命运律的具体表现, 能稳定存在于不同表面特征组合之间。     

Tracking objects that move where they are headed

Previous work has demonstrated that the ability to keep track of moving objects is improved when the objects have unique visual features, such as color or shape. In the present study, we investigated how orientation information is used during the tracking of objects. Orientation is an interesting feature to explore in moving objects because it is directional and is often informative of the direction of motion. Most objects move forward, in the direction they are oriented. In the present experiments, participants tracked a subset of moving isosceles triangles whose orientations were constant, related, or unrelated to the direction of motion. In the standard multiple object tracking (MOT) task, tracking performance improved when orientations were unique and remained constant, but not when orientation and direction of motion were aligned. In the target recovery task, in which MOT was interrupted by a brief blanking of the display, performance did improve when orientation and direction were aligned. In the final experiment, results showed that orientation was not used before the blank to predict future target locations, but was instead used after the blank. We concluded that people use orientation to compare a stored representation to target position for recovery of lost targets.     

Self-motion impairs multiple-object tracking

Investigations of multiple-object tracking aim to further our understanding of how people perform common activities such as driving in traffic. However, tracking tasks in the laboratory have overlooked a crucial component of much real-world object tracking: self-motion. We investigated the hypothesis that keeping track of one’s own movement impairs the ability to keep track of other moving objects. Participants attempted to track multiple targets while either moving around the tracking area or remaining in a fixed location. Participants’ tracking performance was impaired when they moved to a new location during tracking, even when they were passively moved and when they did not see a shift in viewpoint. Self-motion impaired multiple-object tracking in both an immersive virtual environment and a real-world analog, but did not interfere with a difficult non-spatial tracking task. These results suggest that people use a common mechanism to track changes both to the location of moving objects around them and to keep track of their own location.     

客体运动速度的视觉工作记忆容量

自Luck等人的研究以来,诸多研究者对客体信息在视觉工作记忆中的表征与存储问题进行了探讨。现有研究主要采用呈现于静态场景的客体作为刺激材料,而不涉及对客体运动特征信息的短时存储。本研究结合多客体追踪范式和视觉工作记忆的变化觉察范式,通过比较检测项全部呈现方式与单检测项呈现方式条件下,客体运动速度的视觉工作记忆绩效,探讨了多个客体的运动速度信息在工作记忆中的存储方式和容量问题。结果表明,在工作记忆中能够存储约3仑独立客体的运动速度信息。     

Dynamic binding of identity and location information: a serial model of multiple identity tracking

Tracking of multiple moving objects is commonly assumed to be carried out by a fixed-capacity parallel mechanism. The present study proposes a serial model (MOMIT) to explain performance accuracy in the maintenance of multiple moving objects with distinct identities. A serial refresh mechanism is postulated, which makes recourse to continuous attention switching, a capacity-limited episodic buffer for identity-location bindings, indexed location information stored in the visuospatial short-term memory, and an active role of long-term memory. As identity-location bindings are refreshed serially, a location error is inherent for all other targets except the focally attended one. The magnitude of this location error is a key factor in predicting tracking accuracy. MOMIT’s predictions were supported by the data of five experiments: performance accuracy decreased as a function of target set-size, speed, and familiarity. A mathematical version of MOMIT fitted nicely to the observed data with plausible parameter estimates for the binding capacity and refresh time.     

Understanding the object benefit in visual short-term memory: the roles of feature proximity and connectedness

Past research has identified visual objects as the units of information processing in visual short-term memory (VSTM) and has shown that two features from the same object can be remembered in VSTM as well (or almost as well) as one feature of that object and are much better remembered than the same two features from two spatially separated objects. It is not clear, however, what drives this object benefit in VSTM. Is it the shared spatial location (proximity), the connectedness among features of an object, or both? In six change detection experiments, both location/proximity and connectedness were found to be crucial in determining the magnitude of the object benefit in VSTM. Together, these results indicate that location/proximity and connectedness are essential elements in defining a coherent visual object representation in VSTM.     

身份交换对多身份追踪表现的影响

本研究探讨了身份交换对多身份追踪表现的影响。实验1和实验2分别考察了全部报告法和部分报告法下身份交换对多身份追踪表现的具体影响。结果均发现, 身份交换对身份−位置绑定干扰程度越大, 位置追踪和身份识别容量也均越低, 但位置容量始终高于身份容量, 并且这些特性在不同追踪负荷上相同。此外, 部分报告法比全部报告法更具有容量测量优势。实验3则进一步从听觉通道上控制了语音复述对当前任务的干扰, 所得结果仍支持实验1和实验2。这表明, 身份交换对多身份追踪的干扰机制是身份−位置绑定机制受到损害, 而非语音复述的作用。     

视觉运动追踪的加工过程

视觉运动追踪是运动知觉研究的一个重要领域。通过构建视觉运动追踪的过程模型和分析每个阶段的认知加工任务, 可以帮助人们认识运动物体识别的本质。视觉运动追踪包括目标获取和运动追踪两个加工过程：目标获取阶段的主要任务是将目标与背景分离, 集中注意力加工追踪目标; 运动追踪阶段的主要任务是启动平滑追踪眼动和追赶性眼跳, 并发挥行为水平、眼动水平和神经活动水平的预测机制。目标获取同时受背景和目标的运动特征和身份特征影响; 运动追踪系统发挥预测机制的基础是客体表征连续性, 而客体表征连续性的建立同时依赖于目标时空属性和身份特征的编码加工。因此, 视觉运动追踪是视觉系统对客体运动信息和身份语义信息整合的结果。其中, 客体运动信息的加工特性已经获得了比较广泛的研究, 而语义信息加工机制还有待进一步加强。     

Developmental profiles for multiple object tracking and spatial memory: typically developing preschoolers and people with Williams syndrome

The ability to track moving objects, a crucial skill for mature performance on everyday spatial tasks, has been hypothesized to require a specialized mechanism that may be available in infancy (i.e. indexes). Consistent with the idea of specialization, our previous work showed that object tracking was more impaired than a matched spatial memory task in individuals with Williams syndrome (WS), a genetic disorder characterized by severe visuo‐spatial impairment. We now ask whether this unusual pattern of performance is a reflection of general immaturity or of true abnormality, possibly reflecting the atypical brain development in WS. To examine these two possibilities, we tested typically developing 3‐ and 4‐year‐olds and people with WS on multiple object tracking (MOT) and memory for static spatial location. The maximum number of objects that could be correctly tracked or remembered (estimated from the k‐statistic) showed similar developmental profiles in typically developing 3‐ and 4‐year‐old children, but the WS profile differed from either age group. People with WS could track more objects than 3‐year‐olds, and the same number as 4‐year‐olds, but they could remember the locations of more static objects than both 3‐ and 4‐year‐olds. Combining these data with those from our previous studies, we found that typically developing children show increases in the number of objects they can track or remember between the ages of 3 and 6, and these increases grow in parallel across the two tasks. In contrast, object tracking in older children and adults with WS remains at the level of 4‐year‐olds, whereas the ability to remember multiple locations of static objects develops further. As a whole, the evidence suggests that MOT and memory for static location develop in tandem typically, but not in WS. Atypical development of the parietal lobe in people with WS could play a causal role in the abnormal, uneven pattern of performance in WS. This interpretation is consistent with the idea that multiple object tracking engages different mechanisms from those involved in memory for static object location, and that the former can be particularly disrupted by atypical development.     

Multiple-object tracking is based on scene, not retinal, coordinates

This study tested whether multiple-object tracking-the ability to visually index objects on the basis of their spatiotemporal history-is scene based or image based. Initial experiments showed equivalent tracking accuracy for objects in 2-D and 3-D motion. Subsequent experiments manipulated the speeds of objects independent of the speed of the scene as a whole. Results showed that tracking accuracy was influenced by object speed but not by scene speed. This held true whether the scene underwent translation, zoom, rotation, or even combinations of all 3 motions. A final series of experiments interfered with observers' ability to see a coherent scene by moving objects at different speeds from one another and by distorting the perception of 3-D space. These reductions in scene coherence led to reduced tracking accuracy, confirming that tracking is accomplished using a scene-based, or allocentric, frame of reference.     

The impetus theory in judgments about object motion: A new perspective

Several tendencies found in explicit judgments about object motion have been interpreted as evidence that people possess a naive theory of impetus. The theory states that objects that are caused to move by other objects acquire force that determines the kind of motion exhibited by the object, and that this force gradually dissipates over time. I argue that the findings can better be understood as manifestations of a general understanding of externally caused motion based on experiences of acting on objects. Experiences of acting on objects yield the idea that properties of the cause of motion are transmitted to the effect object. This idea functions as a heuristic for explicit predictions of object motion under conditions of uncertainty. This accounts not only for the findings taken as evidence for the impetus theory, but also for several findings that fall outside the scope of the impetus theory. It has also been claimed that judgments about the location at which a moving object disappeared are influenced by the impetus theory. I argue that these judgments are better explained in a different way, as best-guess extrapolations made by the visual system as a practical guide to interactions with the object, such as interception.