Semantic consistency versus perceptual salience in visual scenes: Findings from change detection

In a one-shot change detection task, we investigated the relationship between semantic properties (high consistency, i.e., diagnosticity, versus inconsistency with regard to gist) and perceptual properties (high versus low salience) of objects in guiding attention in visual scenes and in constructing scene representations. To produce the change an object was added or deleted in either the right or left half of coloured drawings of daily-life events. Diagnostic object deletions were more accurately detected than inconsistent ones, indicating rapid inclusion into early scene representation for the most predictable objects. Detection was faster and more accurate for high salience than for low salience changes. An advantage was found for diagnostic object changes in the high salience condition, although it was limited to additions when considering response speed. For inconsistent objects of high salience, deletions were detected faster than additions. These findings may indicate that objects are primarily selected on a perceptual basis with subsequent and supplementary effect of semantic consistency, in the sense of facilitation due to object diagnosticity or lengthening of processing time due to inconsistency.     

Enhanced change detection performance reveals improved strategy use in avid action video game players

Recent research has shown that avid action video game players (VGPs) outperform non-video game players (NVGPs) on a variety of attentional and perceptual tasks. However, it remains unknown exactly why and how such differences arise; while some prior research has demonstrated that VGPs' improvements stem from enhanced basic perceptual processes, other work indicates that they can stem from enhanced attentional control. The current experiment used a change-detection task to explore whether top-down strategies can contribute to VGPs' improved abilities. Participants viewed alternating presentations of an image and a modified version of the image and were tasked with detecting and localizing the changed element. Consistent with prior claims of enhanced perceptual abilities, VGPs were able to detect the changes while requiring less exposure to the change than NVGPs. Further analyses revealed this improved change detection performance may result from altered strategy use; VGPs employed broader search patterns when scanning scenes for potential changes. These results complement prior demonstrations of VGPs' enhanced bottom-up perceptual benefits by providing new evidence of VGPs' potentially enhanced top-down strategic benefits.     

Anxiety, conscious awareness and change detection

Attentional scanning was studied in anxious and non-anxious participants, using a modified change detection paradigm. Participants detected changes in pairs of emotional scenes separated by two task irrelevant slides, which contained an emotionally valenced scene (the 'distractor scene') and a visual mask. In agreement with attentional control theory, change detection latencies were slower overall for anxious participants. Change detection in anxious, but not non-anxious, participants was influenced by the emotional valence and exposure duration of distractor scenes. When negative distractor scenes were presented at subliminal exposure durations, anxious participants detected changes more rapidly than when supraliminal negative scenes or subliminal positive scenes were presented. We propose that for anxious participants, subliminal presentation of emotionally negative distractor scenes stimulated attention into a dynamic state in the absence of attentional engagement. Presentation of the same scenes at longer exposure times was accompanied by conscious awareness, attentional engagement, and slower change detection.     

Reflexive attention attenuates change blindness (but only briefly)

Humans are remarkably insensitive to large changes in a visual display if the change occurs simultaneously with a secondary perceptual event. A widely held view is that this change blindness occurs because the secondary perceptual event prevents the change from capturing attention. However, whereas some studies have shown that top-down attentional priming can attenuate change blindness, the evidence regarding the effect of bottom-up attentional capture on change blindness is less clear-cut. Here, we compare the effects of attentional capture on change detection with participants' performance on a well-established attentional paradigm (a Posner-style cuing task). Experiment 1 established the time course of attentional capture in our paradigm. Experiment 2 demonstrated that this attentional capture was associated with facilitated change detection at short (150-msec), but not long (480-msec), latencies. These data show that reflexive attentional shifts facilitate change detection and are consistent with the view that shifts of attention are a necessary precondition for visual awareness.     

Blur detection is unaffected by cognitive load

Blur detection is affected by retinal eccentricity, but is it also affected by attentional resources? Research showing effects of selective attention on acuity and contrast sensitivity suggests that allocating attention should increase blur detection. However, research showing that blur affects selection of saccade targets suggests that blur detection may be pre-attentive. To investigate this question, we carried out experiments in which viewers detected blur in real-world scenes under varying levels of cognitive load manipulated by the N-back task. We used adaptive threshold estimation to measure blur detection thresholds at 0°, 3°, 6°, and 9° eccentricity. Participants carried out blur detection as a single task, a single task with to-be-ignored letters, or an N-back task with four levels of cognitive load (0, 1, 2, or 3-back). In Experiment 1, blur was presented gaze-contingently for occasional single eye fixations while participants viewed scenes in preparation for an easy picture recognition memory task, and the N-back stimuli were presented auditorily. The results for three participants showed a large effect of retinal eccentricity on blur thresholds, significant effects of N-back level on N-back performance, scene recognition memory, and gaze dispersion, but no effect of N-back level on blur thresholds. In Experiment 2, we replicated Experiment 1 but presented the images tachistoscopically for 200 ms (half with, half without blur), to determine whether gaze-contingent blur presentation in Experiment 1 had produced attentional capture by blur onset during a fixation, thus eliminating any effect of cognitive load on blur detection. The results with three new participants replicated those of Experiment 1, indicating that the use of gaze-contingent blur presentation could not explain the lack of effect of cognitive load on blur detection. Thus, apparently blur detection in real-world scene images is unaffected by attentional resources, as manipulated by the cognitive load produced by the N-back task.     

The right hemisphere advantage in visual change detection depends on temporal factors

What accounts for the Right Hemisphere (RH) functional superiority in visual change detection? An original task which combines one-shot and divided visual field paradigms allowed us to direct change information initially to the RH or the Left Hemisphere (LH) by deleting, respectively, an object included in the left or right half of a scene presented centrally. We manipulated the perceptual salience and semantic relevance of the change as well as the duration of the Inter-Stimulus Interval (ISI) between the scenes in order to clarify the role of the RH in memory and attention processes, and to explore whether lengthening the ISI would enhance the contribution of the LH. When analyzing data collapsed over the two levels (high vs. low) of salience and of relevance, changes were better detected in the left visual field (lvf) than in the right visual field (rvf) in the case of a short ISI, while no difference emerged in the case of a long ISI. Moreover, lengthening the ISI resulted in a performance decrement in the lvf, both for accuracy and response speed. The fact that the RH superiority was limited to short intervals indicates that stimulus-driven orienting contributes more than perceptual processing to this hemispheric asymmetry. When considering perceptual and semantic properties of the change, the effect of the ISI duration seemed to specifically emerge in the case of low relevance, with an enhancement of accuracy in the rvf when comparing the long with the short ISI. This suggests that the ISI influence on hemispheric performance operates on different levels.     

The right hemisphere advantage in visual change detection depends on temporal factors

What accounts for the Right Hemisphere (RH) functional superiority in visual change detection? An original task which combines one-shot and divided visual field paradigms allowed us to direct change information initially to the RH or the Left Hemisphere (LH) by deleting, respectively, an object included in the left or right half of a scene presented centrally. We manipulated the perceptual salience and semantic relevance of the change as well as the duration of the Inter-Stimulus Interval (ISI) between the scenes in order to clarify the role of the RH in memory and attention processes, and to explore whether lengthening the ISI would enhance the contribution of the LH. When analyzing data collapsed over the two levels (high vs. low) of salience and of relevance, changes were better detected in the left visual field (lvf) than in the right visual field (rvf) in the case of a short ISI, while no difference emerged in the case of a long ISI. Moreover, lengthening the ISI resulted in a performance decrement in the lvf, both for accuracy and response speed. The fact that the RH superiority was limited to short intervals indicates that stimulus-driven orienting contributes more than perceptual processing to this hemispheric asymmetry. When considering perceptual and semantic properties of the change, the effect of the ISI duration seemed to specifically emerge in the case of low relevance, with an enhancement of accuracy in the rvf when comparing the long with the short ISI. This suggests that the ISI influence on hemispheric performance operates on different levels.     

Why does a red snake in the grass capture your attention?

It has been suggested that affective stimuli automatically capture attention; this preferential processing is thought to be related to the evolutionary significance of affective stimuli. However, recent evidence suggests that perceptual salience alone might explain why some affective stimuli are more likely to influence attentional processes in certain contexts. In this study, we manipulated affective and perceptual salience to better understand how affective information is processed and how it impacts attentional processes in different contexts. We used stimuli that are both affectively and perceptually salient, while varying the task requirement to encourage the processing of perceptually salient (Experiment 1) or affectively salient (Experiment 2) information. This design made it possible to observe independent and interdependent relationships between perceptual and affective salience. The results showed that when the task encouraged the processing of perceptually salient information, affective salience did not influence task performance. In contrast, when the task encouraged the processing of affectively salient information, affectively salient information impaired task performance. The findings suggest that the affective nature of the stimuli does not always influence attentional processes.     

Sensitivity to stimulus similarity is associated with greater sustained attention ability

Sustained attention is critical for tasks where perceptual information must be continuously processed, like reading or driving; however, the cognitive processes underlying sustained attention remain incompletely characterized. In the experiments that follow, we explore the relationship between sustaining attention and the contents and maintenance of task-relevant features in an attentional template. Specifically, we administered the gradual onset continuous performance task (gradCPT), a sensitive measure of sustained attention, to a large web-based sample (N>20,000) and a smaller laboratory sample for validation and extension. The gradCPT requires participants to respond to most stimuli (city scenes – 90 %) and withhold to rare target images (mountain scenes – 10 %). By using stimulus similarity to probe the representational content of task-relevant features—assuming either exemplar- or category-based feature matching—we predicted that RTs for city stimuli that were more “mountain-like” would be slower and “city-like” mountain stimuli would elicit more erroneous presses. We found that exemplar-based target-nontarget (T-N) similarity predicted both RTs and erroneous button presses, suggesting a stimulus-specific feature matching process was adopted. Importantly, individual differences in the degree of sensitivity to these similarity measures correlated with conventional measures of attentional ability on the gradCPT as well as another CPT that is perceptually less demanding. In other words, individuals with greater sustained attention ability (assessed by two tasks) were more likely to be influenced by stimulus similarity on the gradCPT. These results suggest that sustained attention facilitates the construction and maintenance of an attentional template that is optimal for a given task.     

Attenuated Change Blindness for Exogenously Attended Items in a Flicker Paradigm

When two scenes are alternately displayed, separated by a mask, even large, repeated changes between the scenes often go unnoticed for surprisingly long durations. Change blindness of this sort is attenuated at “centres of interest” in the scenes, however, supporting a theory of change blindness in which attention is necessary to perceive such changes (Rensink, O'Regan, & Clark, 1997). Problems with this measure of attentional selection - via verbally described “centres of interest” - are discussed, including worries about describability and explanatory impotence. Other forms of attentional selection, not subject to these problems, are employed in a “flicker” experiment to test the attention-based theory of change detection. Attenuated change blindness is observed at attended items when attentional selection is realized via involuntary exogenous capture of visual attention - to late-onset items and colour singletons - even when these manipulations are uncorrelated with the loci of the changes, and are thus irrelevant to the change detection task. These demonstrations ground the attention-based theory of change blindness in a type of attentional selection which is understood more rigorously than are “centres of interest”. At the same time, these results have important implications concerning the nature of exogenous attentional capture.     

Changes are not localized before they are explicitly detected

Change detection is in many ways analogous to visual search. Yet, unlike search, successful detection depends not on the salience of features within a scene, but on the difference between the original and modified scene. If, as in search, pre-attentive mechanisms guide attention to the change location, the change itself must produce a preattentively detectable signal. Despite recent evidence for implicit representation of change in the absence of conscious detection, few studies have yet explored whether attention is guided to a change location prior to explicit detection. In four “change blindness” experiments using several variants of the “flicker” task, we tested the hypothesis that implicit or preattentive mechanisms guide change localization prior to explicit detection. None of the experiments revealed improved localization of changes prior to explicit reports of detection, suggesting that implicit detection of change does not contribute to the eventual explicit localization of a change. Instead, change localization is essentially arbitrary, driven by the salience of features within scenes.     

Infants detect changes in everyday scenes: The role of scene gist

When watching physical events, infants bring to bear prior knowledge about objects and readily detect changes that contradict physical rules. Here we investigate the possibility that scene gist may affect infants, as it affects adults, when detecting changes in everyday scenes. In Experiment 1, 15-month-old infants missed a perceptually salient change that preserved the gist of a generic outdoor scene; the same change was readily detected if infants had insufficient time to process the display and had to rely on perceptual information for change detection. In Experiment 2, 15-month-olds detected a perceptually subtle change that preserved the scene gist but violated the rule of object continuity, suggesting that physical rules may overpower scene gist in infants’ change detection. Finally, Experiments 3 and 4 provided converging evidence for the effects of scene gist, showing that 15-month-olds missed a perceptually salient change that preserved the gist and detected a perceptually subtle change that disrupted the gist. Together, these results suggest that prior knowledge, including scene knowledge and physical knowledge, affects the process by which infants maintain their representations of everyday scenes.     

Differences in attentional involvement underlying the perception of distinctive and typical faces

Differences in human faces can be evaluated along a continuum that ranges from 'distinctive' to 'typical.' We examined processing differences between distinctive and typical faces by two attentional tasks that induce attentional blink (AB). Given that AB is believed to reflect temporal or capacity limits of attention, stimuli that survive AB are believed to be associated with greater processing efficiency. In a change-detection task, participants were required to detect changes in the two pairs of faces that were presented in rapid succession. Changes involving the distinctive face of a pair were more likely to be detected than those involving a typical face. In a face-identification task, distinctive faces embedded in a rapid serial visual presentation (RSVP) stream were identified with a greater accuracy than typical faces. Together, our results suggest that distinctive faces are associated with greater processing efficiency and may be explained in terms of perceptual salience, a stimulus dimension known to attract attention.     

Resting EEG in alpha and beta bands predicts individual differences in attentional breadth

Whether individuals focus their attention on the global level (the forest), or local elements that make up the stimulus (the trees) remains relatively stable over a period of at least 10 days in multiple global/local measures. Greater attentional approach tendencies and vigilance, which are likely reflected by lower alpha and higher beta power, are associated with narrowed attentional breadth. The current study investigated whether individual differences in the propensity for individuals to focus on the global or local levels (attentional breadth) can be predicted based on EEG power in alpha and its neighbouring frequency bands during a preceding rest period. Greater levels of posterior alpha and preponderance of alpha-to-beta power at rest were associated with greater attentional breadth during the subsequent Navon letters task. These results suggest that neural indices of attentional approach when not engaged in a goal-orientated task are associated with individual differences in attentional breadth.     

Time course of attentional bias to emotional scenes in anxiety: Gaze direction and duration

Pictures of emotionally neutral, positive, and negative (threat- or harm-related) scenes were presented for 3 seconds, paired with nonemotional control pictures. The eye fixations of high and low trait anxiety participants were monitored. Intensity of stimulus emotionality was varied, with two levels of perceptual salience for each picture (colour vs. greyscale). Regardless of perceptual salience, high anxiety was associated with preferential attention: (a) towards all types of emotional stimuli in initial orienting, as revealed by a higher probability of first fixation on the emotional picture than on the neutral picture of a pair; (b) towards positive and harm stimuli in a subsequent stage of early engagement, as shown by longer viewing times during the first 500 ms following onset of the pictures; and with (c) attention away from (i.e., avoidance) harm stimuli in a later phase, as indicated by shorter viewing times and lower frequency of fixation during the last 1000 ms of picture exposure. This suggests that the nature of the attentional bias varies as a function of the time course in the processing of emotional pictures.     

Time course of attentional bias to emotional scenes in anxiety: Gaze direction and duration

Pictures of emotionally neutral, positive, and negative (threat‐ or harm‐related) scenes were presented for 3 seconds, paired with nonemotional control pictures. The eye fixations of high and low trait anxiety participants were monitored. Intensity of stimulus emotionality was varied, with two levels of perceptual salience for each picture (colour vs. greyscale). Regardless of perceptual salience, high anxiety was associated with preferential attention: (a) towards all types of emotional stimuli in initial orienting, as revealed by a higher probability of first fixation on the emotional picture than on the neutral picture of a pair; (b) towards positive and harm stimuli in a subsequent stage of early engagement, as shown by longer viewing times during the first 500 ms following onset of the pictures; and with (c) attention away from (i.e., avoidance) harm stimuli in a later phase, as indicated by shorter viewing times and lower frequency of fixation during the last 1000 ms of picture exposure. This suggests that the nature of the attentional bias varies as a function of the time course in the processing of emotional pictures.     

Development of infants’ attention to faces during the first year

In simple tests of preference, infants as young as newborns prefer faces and face-like stimuli over distractors. Little is known, however, about the development of attention to faces in complex scenes. We recorded eye-movements of 3-, 6-, and 9-month-old infants and adults during free-viewing of clips from A Charlie Brown Christmas (an animated film). The tendency to look at faces increased with age. Using novel computational tools, we found that 3-month-olds were less consistent (across individuals) in where they looked than were older infants. Moreover, younger infants’ fixations were best predicted by low-level image salience, rather than the locations of faces. Between 3 and 9 months of age, infants gradually focused their attention on faces. We discuss several possible interpretations of this shift in terms of social development, cross-modal integration, and attentional/executive control.     

New perceptual objects that capture attention produce inhibition of return

New perceptual objects are known to capture attention. We show that such attentional capture is similar to that produced by peripheral luminance changes, as opposed to symbolic central cues, in that it produces inhibition of return. Two experiments employed equiluminant texture changes that attracted attention, producing an initial attentional benefit (in detection and discrimination) followed by inhibition of return. However, when the display was altered so that the texture change did not define a new object, no facilitation or inhibition was observed. The results bolster recent claims of the importance of new perceptual objects and extend our understanding of the effect of such objects on attention.     

Perceptual deterioration is reflected in the neural response: fMRI study of nappers and non-nappers

Repeated training on a perceptual task can result in performance deterioration. In the case of vision, this practice-dependent decrease, or perceptual deterioration is restored by changing the target orientation, spatial location, or by taking a daytime nap. Behavioral studies suggest the locus of these performance changes to be primary visual cortex. We used fMRI to directly probe whether perceptual deterioration and nap-dependent maintenance of performance can be detected at the level of primary visual cortex. We also asked whether these changes are due to a bottom-up, stimulus-driven response or a top-down plasticity of attentional mechanisms. Subjects were scanned while performing a texture-discrimination task. Half the subjects took a nap between sessions. We measured the relationship between changes in performance and changes in BOLD signal modulation between the two groups. Non-nappers showed performance deterioration that was significantly correlated with decreased BOLD signal modulation, exclusively in area V1 and limited to the bottom-up condition. In contrast, no change was detected in performance and BOLD response in the two conditions for nappers. These results indicate that napping prevented performance deterioration, which was reflected in the fMRI response of neurons in V1. Without a nap, perceptual deterioration was related to decreases in the stimulus-driven, bottom-up representation, rather than decreases in attentional modulation to the stimulus.     

Meaning guides attention during scene viewing,even when it is irrelevant

During real-world scene viewing, humans must prioritize scene regions for attention. What are the roles of low-level image salience and high-level semantic meaning in attentional prioritization? A previous study suggested that when salience and meaning are directly contrasted in scene memorization and preference tasks, attentional priority is assigned by meaning (Henderson & Hayes in Nature Human Behavior, 1, 743–747, 2017). Here we examined the role of meaning in attentional guidance using two tasks in which meaning was irrelevant and salience was relevant: a brightness rating task and a brightness search task. Meaning was represented by meaning maps that captured the spatial distribution of semantic features. Meaning was contrasted with image salience, represented by saliency maps. Critically, both maps were represented similarly, allowing us to directly compare how meaning and salience influenced the spatial distribution of attention, as measured by fixation density maps. Our findings suggest that even in tasks for which meaning is irrelevant and salience is relevant, meaningful scene regions are prioritized for attention over salient scene regions. These results support theories in which scene semantics play a dominant role in attentional guidance in scenes.