The role of color in visual search in real-world scenes: evidence from contextual cuing

Because the importance of color in visual tasks such as object identification and scene memory has been debated, we sought to determine whether color is used to guide visual search in contextual cuing with real-world scenes. In Experiment 1, participants searched for targets in repeated scenes that were shown in one of three conditions: natural colors, unnatural colors that remained consistent across repetitions, and unnatural colors that changed on every repetition. We found that the pattern of learning was the same in all three conditions. In Experiment 2, we did a transfer test in which the repeating scenes were shown in consistent colors that suddenly changed on the last block of the experiment. The color change had no effect on search times, relative to a condition in which the colors did not change. In Experiments 3 and 4, we replicated Experiments 1 and 2, using scenes from a color-diagnostic category of scenes, and obtained similar results. We conclude that color is not used to guide visual search in real-world contextual cuing, a finding that constrains the role of color in scene identification and recognition processes.     

Perceiving a part and the whole of narrative scenes with interactive processing between character and surroundings

Visual recognition is a fast and accurate process. This study adopted a progressive revelation task which demonstrated the dynamic visual process to investigate narrative scene perception. Experiment 1 examined the recognition of character and surroundings that are presented in isolation. The results demonstrated an accumulation of perceptual evidence for recognition as a psychometric function, and character identification was found to be superior to surroundings identification (character advantage effect). Experiment 2 examined the character and surroundings identification in isolated and concurrent presentations. The results showed that less accumulated evidence was required for the concurrent condition than for the isolated condition in the surroundings identification but not in the character identification. The character advantage effect only appeared in the isolated condition. In Experiment 3, both the character and surroundings in semantically consistent or inconsistent scenes were reported. The results showed that consistency effects appeared in both character and surroundings reporting, and the character advantage effect appeared in both consistent and inconsistent conditions. Overall, the results of the present study, which have high ecological validity, supported the existence of an interactive relationship between the visual processing of character and surroundings in narrative scene perception.     

Visual recognition memory enhancement in children through differential outcomes

Objective

The use of differential outcomes has been shown to enhance discriminative learning and face recognition in children and adults. In this study, we further investigated whether the differential outcome procedure (DOP) would also be effective in improving recognition memory for a wide range of stimuli with varying visual complexity (familiar objects, abstract stimuli, and complex scenes) in 5- and 7-year-old children.

Method

Participants viewed a sample stimulus and, after a short (5 s) or a long (15 s) delay, they had to identify the previously seen stimulus among four choice alternatives. In the differential outcomes condition, each sample stimulus was paired with a specific outcome; whereas in the non-differential conditions outcomes were administered randomly. In Experiment 2, we replicated Experiment 1 but in addition we asked participants to perform an articulatory suppression task to prevent verbal rehearsal.

Results

Children showed a greater overall visual delayed recognition when differential outcomes were arranged in both experiments. The type of stimulus being used modulated this effect; a beneficial effect of the differential outcomes training was evident with abstract objects in Experiment 1 and with both, abstract objects and scenes in Experiment 2.     

Memory for scenes: Refixations reflect retrieval

Most conceptions of episodic memory hold that reinstatement of encoding operations is essential for retrieval success, but the specific mechanisms of retrieval reinstatement are not well understood. In three experiments, we used saccadic eye movements as a window for examining reinstatement in scene recognition. In Experiment 1, participants viewed complex scenes, while number of study fixations was controlled by using a gaze-contingent paradigm. In Experiment 2, effects of stimulus saliency were minimized by directing participants' eye movements during study. At test, participants made remember/know judgments for each recognized stimulus scene. Both experiments showed that remember responses were associated with more consistent study-test fixations than false rejections (Experiments 1 and 2) and know responses (Experiment 2). In Experiment 3, we examined the causal role of gaze consistency on retrieval by manipulating participants' expectations during recognition. After studying name and scene pairs, each test scene was preceded by the same or different name as during study. Participants made more consistent eye movements following a matching, rather than mismatching, scene name. Taken together, these findings suggest that explicit recollection is a function of perceptual reconstruction and that event memory influences gaze control in this active reconstruction process.     

Diagnostic colours contribute to the early stages of scene categorization: Behavioural and neurophysiological evidence

We examined the effects of colour cues on the express categorization of natural scenes. Using a go/no-go paradigm sensitive to fast recognition processes, we measured early event-related potential (ERP) correlates of scene categorization to elucidate the processing stage at which colour contributes to scene recognition. Observers were presented with scenes belonging to four colour-diagnostic categories (desert, forest, canyon and coastline). Scenes were presented in one of three forms: Diagnostically coloured, nondiagnostically coloured, or greyscale images. In a verification task, observers were instructed to respond whenever the presented stimulus matched a previously presented category name. Reaction times and accuracy were optimal when the stimuli were presented as their original diagnostically coloured version, followed by their greyscale version, and lastly by their nondiagostically coloured version. These effects were mirrored in the early (i.e., 150 ms following stimulus onset) ERP frontal correlates. Their onset was delayed for greyscale scenes compared to diagnostically coloured scenes, and for nondiagnostically coloured scenes compared to the other two conditions. Frontal ERP amplitudes also decreased for greyscale and nondiagnostically coloured scenes. Together, the results suggest that diagnostic colours are part of the scene gist responsible for express scene categorization.     

上下文预期在快速场景识别中的作用

本研究首先考察上下文预期是否能够影响快速场景识别,进而通过比较不同空间频率的场景信息来探究上下文预期在快速场景识别不同阶段的作用。共包括3个实验:实验1采用双眼竞争范式,考察对快速呈现场景刺激的主观选择是否受到上下文预期的影响;实验2采用词汇分类与快速场景识别的双任务范式,比较预期与非预期条件下快速场景识别绩效的差异;实验3分别以低频信息(实验3a)和高频信息(实验3b)作为实验材料,探讨预期效应的作用阶段。结果发现:上下文预期可以影响快速场景识别过程中的主观选择与反应绩效;对不同空间频率的场景信息,场景刺激与预期相一致时均可以提高辨别力,但预期对反应偏好的影响只发生在对高空间频率场景信息的加工阶段。因此,上下文预期在快速场景识别不同加工阶段的作用不同,快速场景识别需要结合不同空间频率信息加工的结果。     

Spatial frequency filtering and the direct control of fixation durations during scene viewing

The present study employed a saccade-contingent change paradigm to investigate the effect of spatial frequency filtering on fixation durations during scene viewing. Subjects viewed grayscale scenes while encoding them for a later memory test. During randomly chosen saccades, the scene was replaced with an alternate version that remained throughout the critical fixation that followed. In Experiment 1, during the critical fixation, the scene could be changed to high-pass and low-pass spatial frequency filtered versions. Under both conditions, fixation durations increased, and the low-pass condition produced a greater effect than the high-pass condition. In subsequent experiments, we manipulated the familiarity of scene information during the critical fixation by flipping the filtered scenes upside down or horizontally. Under these conditions, we observed lengthening of fixation durations but no difference between the high-pass and low-pass conditions, suggesting that the filtering effect is related to the mismatch between information extracted within the critical fixation and the ongoing scene representation in memory. We also conducted control experiments that tested the effect of changes to scene orientation (Experiment 2a) and the addition of color to a grayscale scene (Experiment 2b). Fixation distribution analysis suggested two effects on the distribution fixation durations: a fast-acting effect that was sensitive to all transsaccadic changes tested and a later effect in the tail of the distribution that was likely tied to the processing of scene information. These findings are discussed in the context of theories of oculomotor control during scene viewing.     

Influences of temporal factors on memory conjunction errors

Subjects viewed a series of faces presented two at a time for 16 seconds. Following either a 15‐minute (Experiment 1) or 24‐hour (Experiment 2) retention interval they received a recognition test that included old faces as well as faces constructed by recombining features from simultaneously presented study faces (simultaneous‐conjunction condition), faces from successive pairs (near‐conjunction condition), and faces that were two pairs apart (far‐conjunction condition). In Experiment 1, false alarm rates decreased as the temporal distance between the relevant study faces increased. In Experiment 2, the false alarm rate in the simultaneous‐conjunction condition was equal to the hit rate for old faces, and the false alarm rates for the other conditions was much lower. There was no effect of serial position during the study phase on the likelihood that parts of a face would later be miscombined to produce a recognition error in either experiment. The results suggest that witnesses to a crime are more likely to miscombine features of a to‐be‐remembered stimulus with those of another stimulus that was simultaneously present at the crime scene than with those of a stimulus encountered either earlier or later, especially when the test is delayed. Copyright © 2000 John Wiley & Sons, Ltd.     

Recognising the forest, but not the trees: an effect of colour on scene perception and recognition

Colour has been shown to facilitate the recognition of scene images, but only when these images contain natural scenes, for which colour is 'diagnostic'. Here we investigate whether colour can also facilitate memory for scene images, and whether this would hold for natural scenes in particular. In the first experiment participants first studied a set of colour and greyscale natural and man-made scene images. Next, the same images were presented, randomly mixed with a different set. Participants were asked to indicate whether they had seen the images during the study phase. Surprisingly, performance was better for greyscale than for coloured images, and this difference is due to the higher false alarm rate for both natural and man-made coloured scenes. We hypothesized that this increase in false alarm rate was due to a shift from scrutinizing details of the image to recognition of the gist of the (coloured) image. A second experiment, utilizing images without a nameable gist, confirmed this hypothesis as participants now performed equally on greyscale and coloured images. In the final experiment we specifically targeted the more detail-based perception and recognition for greyscale images versus the more gist-based perception and recognition for coloured images with a change detection paradigm. The results show that changes to images are detected faster when image-pairs were presented in greyscale than in colour. This counterintuitive result held for both natural and man-made scenes (but not for scenes without nameable gist) and thus corroborates the shift from more detailed processing of images in greyscale to more gist-based processing of coloured images.     

The effect of orthographic uniqueness and deviation points on lexical decisions: evidence from unilateral and bilateral-redundant presentations

Words with an early or late orthographic uniqueness point and nonwords with an early or late orthographic deviation point were presented to the left, right, or both visual fields simultaneously. In Experiment 1, 20 participants made lexical decision judgements to horizontal stimulus presentations. In Experiment 2, a further 20 participants completed the task using vertical presentations to control for attentional biases. Consistent with previous research, words with earlier orthographic uniqueness points prompted faster responses across visual fields, regardless of stimulus orientation. Although research has suggested that the left hemisphere's superiority for language processing stems from a comparatively parallel processing strategy, with the right hemisphere reliant upon a serial mechanism, left and right visual field presentations were not differentially affected by orthographic uniqueness point. This suggests that differential sequential effects previously reported result during processes other than retrieval from the lexicon. The overall right visual field advantage observed using horizontal presentations disappeared when stimuli were presented vertically. Contrary to expectations, there was a facilitatory effect of late orthographic deviation point for horizontal nonword presentations. Overall, the results were interpreted as being consistent with predictions of a cohort model of word recognition, and they highlighted the effect of stimulus orientation on left and right hemisphere word recognition.     

A demonstration and comparison of two types of inference-based memory errors

Participants viewed slides depicting ordinary routines (e.g., going grocery shopping) and later received a recognition test. In Experiment 1, there was higher recognition confidence to high-schema-relevant than to low-schema-relevant items. In Experiment 2, participants viewed slide sequences that sometimes contained a cause (e.g., woman taking orange from bottom of pile) but not an effect scene (oranges on floor), or an effect but not a cause scene. Participants mistook new cause scenes as old when they viewed the effect; false alarms to cause scenes and high-schema-relevant items increased with retention interval. Experiment 3 showed that the backward inference effect was accompanied by false explicit recollection, whereas false alarms to schema-high foils were based on familiarity. This suggests that the 2 types of inferential errors are produced by different underlying mechanisms.     

The effect of scene structure on time perception

The current experiments examined the hypothesis that scene structure affects time perception. In three experiments, participants judged the duration of realistic scenes that were presented in a normal or jumbled (i.e., incoherent) format. Experiment 1 demonstrated that the subjective duration of normal scenes was greater than subjective duration of jumbled scenes. In Experiment 2, gridlines were added to both normal and jumbled scenes to control for the number of line terminators, and scene structure had no effect. In Experiment 3, participants performed a secondary task that required paying attention to scene structure, and scene structure's effect on duration judgements reemerged. These findings are consistent with the idea that perceived duration can depend on visual–cognitive processing, which in turn depends on both the nature of the stimulus and the goals of the observer.     

The roles of attention and awareness in the false recognition effect

Jacoby and Whitehouse (1989) reported that masked words can unconsciously bias memory judgments. Others suggest that these results cannot be taken as evidence that words are perceived without awareness, as Jacoby and Whitehouse claimed. In the present experiments, participants' ability to attend to briefly presented context words was manipulated by masking the context words and by an instructional manipulation. In Experiment 1, masked context words increased false recognitions. Different from Jacoby and Whitehouse's results, nonmasked context words showed a similar pattern. In Experiment 2, these effects were replicated and an attended condition was added in which participants read the context words aloud and tried to remember them. False recognition was increased in both masked and unmasked conditions and decreased in the attended condition. These results suggest that the condition for increase or decrease in false recognition is not whether a stimulus is seen or not but whether a stimulus is attended. They suggest that the qualitative difference criterion proposed by Jacoby and Whitehouse is insufficient for determining whether participants are aware of masked presentations.     

Self-referencing enhances memory specificity with age

Self-referencing has been identified as an advantageous mnemonic strategy for young and older adults. However, little research has investigated the ways in which self-referencing may influence older adults' memory for details, which is typically impaired with age, beyond memory for the item itself. Experiment 1 assessed the effects of self- and other-referencing on memory for visually detailed pictures of objects in thirty-two young and thirty-two older adults. Results indicate that self- and close other-referencing similarly enhance general (item) and specific (detail) recognition for both young and older adults relative to the distant other condition. Experiment 2 extended these findings to source memory, with young and older adults encoding verbal information in self-referent, semantic, and structural conditions. Findings suggest that self-referencing provides an age-equivalent boost in general memory and specific memory for specific source details. We conclude that the mnemonic benefits of referencing the self extend to specific memory for visual and verbal information across the lifespan.     

The role of attention in the contextual enhancement of visual memory for natural scenes

The role of attention in memory for objects in natural scenes was investigated using a visual memory. In Experiment 1, participants were asked to memorize six cued (to be attended) objects in a natural scene, and were subsequently tested on one of the cued objects. Four types of test scene images were created by jumbling different sections in scene's background: Attended sections changed, unattended sections changed, both sections changed, and both unchanged. In Experiment 2, the procedure was the same as that of the jumble condition except that scenes to be memorized were also jumbled. Results showed that jumbling of attended sections reduced memory performance, whereas jumbling unattended sections did not, irrespective of the regularity of scene to be memorized. This finding suggests that attention plays an important role in mental construction of a natural scene representation, and leads to enhanced visual memory.     

The role of visual experience on the representation and updating of novel haptic scenes

We investigated the role of visual experience on the spatial representation and updating of haptic scenes by comparing recognition performance across sighted, congenitally and late blind participants. We first established that spatial updating occurs in sighted individuals to haptic scenes of novel objects. All participants were required to recognise a previously learned haptic scene of novel objects presented across the same or different orientation as learning whilst they either remained in the same position to moved to a new position relative to the scene. Scene rotation incurred a cost in recognition performance in all groups. However, overall haptic scene recognition performance was worse in the congenitally blind group. Moreover, unlike the late blind or sighted groups, the congenitally blind group were unable to compensate for the cost in scene rotation with observer motion. Our results suggest that vision plays an important role in representing and updating spatial information encoded through touch and have important implications for the role of vision in the development of neuronal areas involved in spatial cognition.