Semantically incongruent objects attract eye gaze when viewing scenes for change

Past research has shown that change detection performance is often more efficient for target objects that are semantically incongruent with a surrounding scene context than for target objects that are semantically congruent with the scene context. One account of these findings is that attention is attracted to objects for which the identity of the object conflicts with the meaning of the scene, perhaps as a violation of expectancies created by earlier recruitment of scene gist information. An alternative account of the performance benefit for incongruent objects is that attention is more apt to linger on incongruent objects, as perhaps identifying these objects is more difficult due to conflicting information from the scene context. In the current experiment, we present natural scenes in a change detection task while monitoring eye movements. We find that eye gaze is attracted to these objects relatively early during scene processing.     

Failures of retrieval and comparison constrain change detection in natural scenes

In a change detection paradigm, a target object in a natural scene either rotated in depth, was replaced by another object token, or remained the same. Change detection performance was reliably higher when a target postcue allowed participants to restrict retrieval and comparison processes to the target object (Experiment 1). Change detection performance remained excellent when the target object was not attended at change (Experiment 2) and when a concurrent verbal working memory load minimized the possibility of verbal encoding (Experiment 3). Together, these data demonstrate that visual representations accumulate in memory from attended objects as the eyes and attention are oriented within a scene and that change blindness derives, at least in part, from retrieval and comparison failure.     

The verbal nature of representations of the canonical colors of objects

In selecting the canonical colors of color-specific objects, children may use verbal mediation, a cognitive process whereby an object and its color are matched using verbal rather than pictorial representation [British Journal of Developmental Psychology 14 (1996) 339]. To investigate this process, 108 2- to 5-year-old children were asked to identify 11 colors and to choose crayons to color pictures of color-specific objects. Canonical color choice was significantly predicted by color-labeling skill above the variance portion predicted by age alone. Children were also asked to explain their color choices. Children who knew their colors and who colored canonically provided explanations for their color choices consistent with verbal mediation. However, a high proportion of children who did not know a color, and thus could not use verbal mediation, also gave sophisticated explanations for their color choices if they colored the objects canonically. These findings provide modest support for the idea that identification of canonical colors of objects is a verbal process.     

An eye movement analysis of "mental rotation" of simple scenes

Participants saw a standard scene of three objects on a desktop and then judged whether a comparison scene was either the same, except for the viewpoint of the scene, or different, when one or more of the objects either exchanged places or were rotated around their center. As in Nakatani, Pollatsek, and Johnson (2002), judgment times were longer when the rotation angles of the comparison scene increased, and the size of the rotation effect varied for different axes and was larger for same judgments than for different judgments. A second experiment, which included trials without the desktop, indicated that removing the desktop frame of reference mainly affected the y-axis rotation conditions (the axis going vertically through the desktop plane). In addition, eye movement analyses indicated that the process was far more than a simple analogue rotation of the standard scene. The total response latency was divided into three components: the initial eye movement latency, the first-pass time, and the second-pass time. The only indication of a rotation effect in the time to execute the first two components was for z-axis (plane of sight) rotations. Thus, for x- and y-axis rotations, rotation effects occurred only in the probability of there being a second pass and the time to execute it. The data are inconsistent either with an initial rotation of the memory representation of the standard scene to the orientation of the comparison scene or with a holistic alignment of the comparison scene prior to comparing it with the memory representation of the standard scene. Indeed, the eye movement analysis suggests that little of the increased response time for rotated comparison scenes is due to something like a time-consuming analogue process but is, instead, due to more comparisons on individual objects being made (possibly more double checking).     

Attentional coding of categorical relations in scene perception: evidence from the flicker paradigm

The purpose of the present investigation was to determine whether the positions of objects in a scene are coded relative to one another categorically (i.e., above, below, or side of; Experiment 1) and to determine whether spatial position in scene perception is coded preattentively or only under focused attention (Experiment 2). In Experiment 1, participants viewed alternating versions of a scene in which one of the objects in the scene changed its categorical relationship to the closest object in the scene, changed only its metric relationship to the closest object in a scene, or appeared and disappeared. Participants were faster at detecting changes that disrupted categorical relations than at detecting changes that disrupted only metric relations. In Experiment 2, this categorical advantage still occurred even when participants were cued to the location of the change. These results suggest that categorical spatial relations are being coded in scene perception and that attention is required in order to encode spatial relations.     

Using eye movement measures to investigate effects of age on memory for objects in a scene

We examined whether there were age-related differences in eye movements during intentional encoding of a photographed scene that might account for age-related differences in memory of objects in the scene. Younger and older adults exhibited similar scan path patterns, and visited each region of interest in the scene with similar frequency and duration. Despite the similarity in viewing, there were fundamental differences in the viewing-memory relationship. Although overall recognition was poorer in the older than younger adults, there was no age effect on recognition probability for objects visited only once. More importantly, re-visits to objects brought gain in recognition probability for the younger adults, but not for the older adults. These results suggest that the age-related differences in object recognition performance are in part due to inefficient integration of information from working memory to longer-term memory.     

TO SEE OR NOT TO SEE:

Abstract— When looking at a scene, observers feel that they see its entire structure in great detail and can immediately notice any changes in it. However, when brief blank fields are placed between alternating displays of an original and a modified scene, a striking failure of perception is induced Identification of changes becomes extremely difficult, even when changes are large and made repeatedly. Identification is much faster when a verbal cue is provided showing that poor visibility is not the cause of this difficulty. Identification is also faster for objects considered to be important in the scene. These results support the idea that observers never form a complete, detailed representation of their surroundings. In addition, the results indicate that attention is required to perceive change, and the basis of high-level interest.     

Impossible shadows and the shadow correspondence problem

Shadows cast by objects contain potentially useful information about the location of these objects in the scene as well as their surface reflectance. However, before the visual system can use this information, it has to solve the shadow correspondence problem, that is to match the objects with their respective shadows. In the first experiment, it is shown that the estimate of the light source position is affected by a gradual luminance ramp added to the image. In the second experiment, it is shown that observers process impossible shadow images as if they ignored the local features of the objects. All together, the results suggest that the visual system solves the shadow correspondence problem by relying on a coarse representation of the scene.     

场景知觉及其研究范式

场景知觉关注的是人如何知觉和加工复杂的真实环境信息。场景包括物体和背景两个重要的组成部分,根据复杂性与真实性程度,场景刺激材料可以分为三种不同的类型。已有研究主要从自上而下和自下而上两种方式来解释场景知觉中信息的提取和加工,也有研究试图从二者交互的角度来进行解释。此外,基于不同的实验目的和技术,研究者分别采用了眼动、背景提示、物体觉察、变化觉察和点线索追随几种不同的研究范式来探讨场景信息的知觉问题。场景知觉研究在场景的定义、不同范式间的整合、研究内部效度和不同加工阶段的加工方式四个方面还需要进一步深入和探讨     

Pedestrian detection using a moving camera: A novel framework for foreground detection

While background subtraction techniques have been widely applied to detect moving objects in a video stream captured by a static camera, detecting moving objects using a moving camera still represents a challenging task. In this context, pedestrian detection using a camera placed on the top of a vehicle’s windshield has been rarely investigated. This is mainly due to the background ego-motion. Since the scene captured by the camera seems in motion, it is very difficult to distinguish the moving pedestrians from the others that belong to the static part of the scene. For this reason, a compensation step is needed to suppress the ego-motion. This paper presents a study on the main challenges facing pedestrian detection systems as well as methods proposed to handle these challenges. A novel trajectory classification framework for detecting pedestrians even in challenging real-world environments is proposed. The proposed method models the background motion between two consecutive frames in order to compensate the camera motion. Then, it defines a classification process that differentiates between the background and the foreground in the frame. Using the defined foreground, we consequently identify the presence of pedestrians in the scene. The proposed method was validated on a public benchmark dataset: CVC-14 containing both visible and far infrared video sequences in day and night times. Experimental results confirm the effectiveness of the proposed approach in capturing the dynamic aspect between frames and therefore detecting the presence of pedestrians in the scene.     

Synchronizing visual and language processing: an effect of object name length on eye movements

Are visual and verbal processing systems functionally independent? Two experiments (one using line drawings of common objects, the other using faces) explored the relationship between the number of syllables in an object's name (one or three) and the visual inspection of that object. The tasks were short-term recognition and visual search. Results indicated more fixations and longer gaze durations on objects having three-syllable names when the task encouraged a verbal encoding of the objects (i.e., recognition). No effects of syllable length on eye movements were found when implicit naming demands were minimal (i.e., visual search). These findings suggest that implicitly naming a pictorial object constrains the oculomotor inspection of that object, and that the visual and verbal encoding of an object are synchronized so that the faster process must wait for the slower to be completed before gaze shifts to another object. Both findings imply a tight coupling between visual and linguistic processing, and highlight the utility of an oculomotor methodology to understand this coupling.