Fundamental properties of the N2pc as an index of spatial attention: effects of masking.

Masking is an important tool in many paradigms used to study the cognitive architecture. The N2pc is an electrophysiological event-related potential (ERP) that has been used as a tool to study the deployment of visual spatial attention. The aim of this paper was to study the effects of masking on the N2pc. Two stimuli were presented on the screen, one to left and one to right of fixation, and subjects reported the identity of one of them. The targets could be discriminated both by their category (letters vs. digit) and by their colour (pink vs. green). Backward masking was produced by presenting a second pair of bilateral stimuli after the offset of the first pair. The second pair of stimuli consisted of characters of the same colour and category as in the first pair. Forward masking was produced by using the very same stimuli as in the backward masking condition, but by instructing subjects to report the second stimulus. The forward mask trials had longer response times compared to no-mask trials, and backward mask trials had even longer response times, and also a higher error rate. Although the different masking procedures lead to clear behavioural effects, the N2pc was not affected, suggesting that the deployment of visual spatial attention, per se, was not affected by pattern masking. A sustained posterior contralateral negativity (SPCN) following the N2pc was also found (300 ms post-target, and beyond), and the amplitude of the SPCN was strongly modulated by the number of presented stimuli and the duration of the SPCN was positively correlated with RT in the behavioural task. We hypothesize that the SPCN reflects neural activity associated with the passage of information through visual short-term memory.     

Target objects defined by a conjunction of colour and shape can be selected independently and in parallel

It is generally assumed that during search for targets defined by a feature conjunction, attention is allocated sequentially to individual objects. We tested this hypothesis by tracking the time course of attentional processing biases with the N2pc component in tasks where observers searched for two targets defined by a colour/shape conjunction. In Experiment 1, two displays presented in rapid succession (100 ms or 10 ms SOA) each contained a target and a colour-matching or shape-matching distractor on opposite sides. Target objects in both displays elicited N2pc components of similar size that overlapped in time when the SOA was 10 ms, suggesting that attention was allocated in parallel to both targets. Analogous results were found in Experiment 2, where targets and partially matching distractors were both accompanied by an object without target-matching features. Colour-matching and shape-matching distractors also elicited N2pc components, and the target N2pc was initially identical to the sum of the two distractor N2pcs, suggesting that the initial phase of attentional object selection was guided independently by feature templates for target colour and shape. Beyond 230 ms after display onset, the target N2pc became superadditive, indicating that attentional selection processes now started to be sensitive to the presence of feature conjunctions. Results show that independent attentional selection processes can be activated in parallel by two target objects in situations where these objects are defined by a feature conjunction.     

Substituting objects from consciousness: A review of object substitution masking

Object substitution masking (OSM) occurs when a sparse (e.g., four-dot), temporally trailing mask obscures the visibility of a briefly presented target. Here, we review theories of OSM: those that propose that OSM reflects the interplay between feedforward and feedback/reentrant neural processes, those that predict that feedforward processing alone gives rise to the phenomenon, and theories that focus on cognitive explanations, such as object updating. We discuss how each of these theories accommodates key findings from the OSM literature. In addition, we examine the relationship between OSM and other visual-cognitive phenomena, including object correspondence through occlusion, change blindness, metacontrast masking, backward masking, and visual short-term memory. Finally, we examine the level of processing at which OSM impairs target perception. Collectively, OSM appears to reflect the conditions under which the brain confuses two visual events for one when they are encoded with low spatiotemporal resolution, due to processing resources being otherwise occupied.     

The role of executive attention in object substitution masking

It was long thought that a key characteristic of object substitution masking (OSM) was the requirement for spatial attention to be dispersed for the mask to impact visual sensitivity. However, recent studies have provided evidence questioning whether spatial attention interacts with OSM magnitude, suggesting that the previous reports reflect the impact of performance being at ceiling for the low attention load conditions. Another technique that has been employed to modulate attention in OSM paradigms involves presenting the target stimulus foveally, but with another demanding task shown immediately prior, and thus taxing executive/temporal attention. Under such conditions, when the two tasks occur in close temporal proximity relatively to greater temporal separation, masking is increased. However this effect could also be influenced by performance being at ceiling in some conditions. Here, we manipulated executive attention for a foveated target using a dual-task paradigm. Critically, ceiling performance was avoided by thresholding the target stimulus prior to it being presented under OSM conditions. We found no evidence for an interaction between executive attention load and masking. Collectively, along with the previous findings, our results provide compelling evidence that OSM as a phenomenon occurs independently of attention.     

Endogenous cueing attenuates object substitution masking

Object substitution masking (OSM) is a form of visual masking in which a briefly presented target surrounded by four small dots is masked by the continuing presence of the four dots after target offset. A major parameter in the prediction of OSM is the time required for attention to be directed to the target following its onset. Object substitution theory (Di Lollo et al. in J Exp Psychol Gen 129:481–507, 2000) predicts that the sooner attention can be focused at the target’s location, the less masking will ensue. However, recently Luiga and Bachmann (Psychol Res 71:634–640, 2007) presented evidence that precueing of attention to the target location prior to target-plus-mask onset by means of a central (endogenous) arrow cue does not reduce OSM. When attention was cued exogenously, OSM was attenuated. Based on these results, Luiga and Bachmann argued that object substitution theory should be adapted by differentiating the ways of directing attention to the target location. The goal of the present study was to further examine the dissociation between the effects of endogenous and exogenous precueing on OSM. Contrary to Luiga and Bachmann, our results show that prior shifts of attention to the target location initiated by both exogenous and endogenous cues reduce OSM as predicted by object substitution theory and its computational model CMOS.     

Size (mostly) doesn’t matter: the role of set size in object substitution masking

Conscious detection and discrimination of a visual target stimulus can be prevented by the presentation a spatially nonoverlapping, but temporally trailing, visual masking stimulus. This phenomenon, known as object substitution masking (OSM), has long been associated with spatial attention, with diffuse attention seemingly being key for the effect to be observed. Recently, this hypothesis has been questioned. We sought to provide a definitive test of the involvement of spatial attention in OSM by using an eight-alternative forced choice task under a range of mask durations, set sizes, and target/distractor spatial configurations. The results provide very little evidence that set size, and thus the distribution of spatial attention, interacts with masking magnitude. These findings have implications for understanding the mechanisms underlying OSM and the relationship between consciousness and attention.     

Temporal buffering and visual capacity: The time course of object formation underlies capacity limits in visual cognition

Capacity limits are a hallmark of visual cognition. The upper boundary of our ability to individuate and remember objects is well known but—despite its central role in visual information processing—not well understood. Here, we investigated the role of temporal limits in the perceptual processes of forming “object files.” Specifically, we examined the two fundamental mechanisms of object file formation—individuation and identification—by selectively interfering with visual processing by using forward and backward masking with variable stimulus onset asynchronies. While target detection was almost unaffected by these two types of masking, they showed distinct effects on the two different stages of object formation. Forward “integration” masking selectively impaired object individuation, whereas backward “interruption” masking only affected identification and the consolidation of information into visual working memory. We therefore conclude that the inherent temporal dynamics of visual information processing are an essential component in creating the capacity limits in object individuation and visual working memory.     

Visual distraction increases the detection of an unexpected object in inattentional blindness

Distraction is typically thought to be detrimental to performance and concentration, and stimuli are classified as “distractions” if they take attention away from a primary task. However it has been shown that, under certain circumstances, distractors can also improve task performance. The current study extends this literature by exploring the role of a single discrete transient visual distracting event in increasing attention to an unexpected visual object in an inattentional blindness (IB) paradigm. Experiment 1 investigated the impact of a 48 ms visual distraction stimulus on rates of IB; a second experiment used a shortened, 16 ms visual distracting event. Both the long 48 ms and brief 16 ms distractors significantly reduced overall IB rates, by approximately 50% compared to a no distractor condition. Moreover, this reduction in IB is obtained independent of whether the visual distracting event was noted by the observer. Our findings demonstrate that a single discrete visual distraction can improve the detectability of an unexpected object in an IB task. Implications for theories of distributed attention in such tasks are discussed.     

Resolving competition when naming an object in a multiple-object display

Naming an object in the context of other objects requires the selection and processing of the target object at different levels, while the processing of competing representations activated by context objects has to be constrained. At what stage are these competing representations attenuated? To address this question, we presented pairs of target and context objects that were either similar in visual shape (e.g., umbrella–palm tree) or dissimilar in visual shape (e.g., umbrella–ladder), so that the context object would attract various amounts of attention. The activation of the context object at different levels of processing was assessed by means of auditory distractors (semantically related, or phonologically related, or unrelated to the context object). Semantic and phonological distractor effects were observed for shape-related object pairs, but not for unrelated object pairs. This finding suggests that context objects do not activate their associated lexical representations to any substantial amount, unless they capture attention. In that case, they undergo full lexical processing up to a phonological level. Implications for models of word production are discussed.     

Object-substitution masking degrades the quality of conscious object representations

Object-substitution masking (OSM) is a unique paradigm for the examination of object updating processes. However, existing models of OSM are underspecified with respect to the impact of object updating on the quality of target representations. Using two paradigms of OSM combined with a mixture model analysis we examine the impact of post-perceptual processes on a target’s representational quality within conscious awareness. We conclude that object updating processes responsible for OSM cause degradation in the precision of object representations. These findings contribute to a growing body of research advocating for the application of mixture model analysis to the study of how cognitive processes impact the quality (i.e., precision) of object representations.     

Attentional and anatomical considerations for the representation of simple stimuli in visual short-term memory: evidence from human electrophysiology

Observers encoded the spatial arrangement of two or three horizontal line segments relative to a square frame presented for 150 ms either in left or right visual field and either above or below the horizontal midline. The target pattern was selected on the basis of colour (red vs. green) from an equivalent distractor pattern in the opposite left–right visual hemifield. After a retention interval of 450 or 650 ms a test pattern was presented at fixation. The task was to decide whether the test was the same as the encoded pattern or different. Selection of the to-be-memorised pattern produced an N2pc response that was not influenced by the number of line segments nor by the length of the retention interval, but that was smaller in amplitude for patterns presented in the upper visual field compared with patterns presented in the lower visual field. A sustained posterior contralateral negativity (SPCN) followed the N2pc. The SPCN was larger for patterns with three line segments than for two, was larger for patterns encoded from lower visual field than from upper visual field, and returned to baseline sooner for the shorter retention interval than for the longer interval. These results, and others, provide an interesting and complex pattern of similarities and differences between the N2pc and SPCN, consistent with the view that N2pc reflects mechanisms of attentional selection whereas the SPCN reflects maintenance in visual short-term memory.     

Time-course of hemispheric preference for processing contralateral relevant shapes: P1pc, N1pc, N2pc, N3pc

A most sensitive and specific electrophysiological indicator of selective processing of visual stimuli is the N2pc component. N2pc is a negative EEG potential peaking 250 ms after stimulus onset, recorded from posterior sites contralateral to relevant stimuli. Additional deflections preceding or following N2pc have been obtained in previous studies, possibly produced by specific stimulus features or specific prime-target sequences. To clarify the entire time-course of the contralateral- ipsilateral (C-I) difference recorded from the scalp above visual cortex in response to left-right pairs of targets and distracters, C-I differences were here compared between two types of stimuli and between stimuli that were or were not preceded by masked neutral primes. The C-I difference waveform consisted of several peaks, termed here P1pc (60-100 ms after target onset), N1pc (120-160 ms), N2pc (220-280 ms), and N3pc (360-400 ms). Being markedly enhanced when stimuli were preceded by the neutral primes, P1pc may indicate a response to stimulus change. Also, when stimuli were primed, N2pc reached its peak earlier, thereby tending to merge with N1pc. N3pc seemed to increase when target discrimination was difficult. N1pc, N2pc, and N3pc appear as three periods of one process. N3pc probably corresponds to L400 or SPCN as described in other studies. These observations suggest that the neurophysiological basis of stimulus-driven focusing of attention on target stimuli is a process that lasts for hundreds of milliseconds, with the relevant hemisphere being activated in an oscillating manner as long as required by the task.     

Objects with reduced visibility still contribute to size averaging

People can rapidly judge the average size of a collection of objects with considerable accuracy. In this study, we tested whether this size-averaging process relies on relatively early object representations or on later object representations that have undergone iterative processing. We asked participants to judge the average size of a set of circles and, in some conditions, presented two additional circles that were either smaller or larger than the average. The additional circles were surrounded by four-dot masks that either lingered longer than the circle array, preventing further processing with object substitution masking (OSM), or disappeared simultaneously with the circle array, allowing the circle representation to reach later visual processing stages. Surprisingly, estimation of average circle size was modulated by both visible circles and circles whose visibility was impaired by OSM. There was also no correlation across participants between the influence of the masked circles and susceptibility to OSM. These findings suggest that relatively early representations of objects can contribute to the size-averaging process despite their reduced visibility.     

A processing advantage associated with analytic perceptual tendencies: European Americans outperform Asians on multiple object tracking

Analytic visual processing and holistic visual processing have been conceptualized in terms of attention to focal objects vs. the background. We expand the study of perceptual biases associated with these attentional patterns using the multiple object tracking task, which measures people's ability to track multiple moving target objects amidst otherwise identical distractors. We test two competing hypotheses: (1) Asians' more frequent eye saccades will enable them to quickly cycle through the multiple target objects before the objects move too far away, giving them another perceptual advantage; and (2) European Americans' tendency to focus attention on the focal objects while inhibiting attention to less important objects might facilitate tracking of multiple moving objects. We find that European Americans significantly outperform Asians on multiple object tracking. The research expands the conceptualization of analytic processing and holistic processing to include selective attention as a key component, a facet that has not been previously identified.     

Exogenous spatial precuing reliably modulates object processing but not object substitution masking

Object substitution masking (OSM) is used in behavioral and imaging studies to investigate processes associated with the formation of a conscious percept. Reportedly, OSM occurs only when visual attention is diffusely spread over a search display or focused away from the target location. Indeed, the presumed role of spatial attention is central to theoretical accounts of OSM and of visual processing more generally (Di Lollo, Enns, & Rensink, Journal of Experimental Psychology: General 129:481–507, 2000). We report a series of five experiments in which valid spatial precuing is shown to enhance the ability of participants to accurately report a target but, in most cases, without affecting OSM. In only one experiment (Experiment 5) was a significant effect of precuing observed on masking. This is in contrast to the reliable effect shown across all five experiments in which precuing improved overall performance. The results are convergent with recent findings from Argyropoulos, Gellatly, and Pilling (Journal of Experimental Psychology: Human Perception and Performance 39:646–661, 2013), which show that OSM is independent of the number of distractor items in a display. Our results demonstrate that OSM can operate independently of focal attention. Previous claims of the strong interrelationship between OSM and spatial attention are likely to have arisen from ceiling or floor artifacts that restricted measurable performance.     

情绪诱发视盲任务中的情绪注意控制机制：来自脑电ERP和时频分析的证据

采用脑电时频分析技术,对情绪诱发视盲任务中的情绪控制机制进行了分析。实验设置负性图片、中性图片及填充图片三种干扰刺激条件,关注被试正确完成目标识别时的干扰刺激加工过程。实验结果发现,负性与中性干扰刺激在注意加工阶段均较控制性的填充图片条件诱发前额中央分布的theta同步化效应,而且负性刺激所诱发的此效应又较中性情绪刺激更多分布在左侧前额和颞枕部。实验结果表明：（1）情绪诱发视盲任务下被试确实存在对于情绪干扰刺激的自上而下控制;（2）相比中性干扰刺激,负性干扰刺激在EIB中的情绪注意控制机制不仅包括前人所发现的后部颞枕区对刺激识别的注意控制,而且包括前额叶参与下的负性情绪控制。     

Visual search for arbitrary objects in real scenes

How efficient is visual search in real scenes? In searches for targets among arrays of randomly placed distractors, efficiency is often indexed by the slope of the reaction time (RT) × Set Size function. However, it may be impossible to define set size for real scenes. As an approximation, we hand-labeled 100 indoor scenes and used the number of labeled regions as a surrogate for set size. In Experiment 1, observers searched for named objects (a chair, bowl, etc.). With set size defined as the number of labeled regions, search was very efficient (~5 ms/item). When we controlled for a possible guessing strategy in Experiment 2, slopes increased somewhat (~15 ms/item), but they were much shallower than search for a random object among other distinctive objects outside of a scene setting (Exp. 3: ~40 ms/item). In Experiments 4–6, observers searched repeatedly through the same scene for different objects. Increased familiarity with scenes had modest effects on RTs, while repetition of target items had large effects (>500 ms). We propose that visual search in scenes is efficient because scene-specific forms of attentional guidance can eliminate most regions from the “functional set size” of items that could possibly be the target.     

On the role of object representations in substitution masking

Three experiments were conducted to investigate the role of object representations in object substitution masking (OSM). OSM occurs when a very sparse mask is presented simultaneously with a target stimulus and the target offsets first, leaving the mask to linger in the display for some time. Results confirm earlier claims that there is an isolatable object-level component to OSM and indicate that a target can be protected from OSM if, prior to offsetting, it can be represented as a distinct object from the mask. When the mask was presented as sliding past the target (Experiment 1), as jiggling independently of the target (Experiment 2), or in a different color from the target (Experiment 3), OSM was reduced or eliminated. This suggests that OSM reflects basic updating processes that allow the perception of continuity of object identity over change.     

When the target becomes the mask: using apparent motion to isolate the object-level component of object substitution masking

J. T. Enns and V. Di Lollo (1997) discovered a new form of visual masking that they labeled object substitution masking (OSM). OSM occurs when 4 dots, presented around a target, trail in the display after target offset. The present study showed that the physical presence of the masking dots after target offset is not necessary for OSM. Instead, the continued presence of a changing high-level representation associated with the target suffices to yield OSM. Apparent motion was used to define such representation. In these experiments, the initial display offset and was followed by a 2nd display where masks appeared at new locations. Only when the spatiotemporal properties of the stimuli on the 2nd display supported the perception of the target moving and turning into the mask was OSM observed.     

Visual object agnosia as a problem in integrating parts and part relations

Current models of vision generally assume that the recognition of visual objects is achieved by encoding their component parts, as well as the spatial relations among parts. The current study examined how the processing of parts and their configurations may be affected in visual agnosia due to brain damage. Both a visual agnosic patient (AR) and healthy control subjects performed a visual search task in which they had to discriminate between targets and distractors that varied according to whether they shared their parts and/or their configuration. The results show that AR's visual search rates are disproportionally slow when targets and distractors share the same configuration than when they have different configurations. AR is also found to be disproportionately slow in discriminating targets and distractors that share identical parts when the targets and distractors share the same configuration. With differently configured targets and distractors, AR shows no part sharing effect. For controls, in contrast, the part and configuration sharing effects occur independently of one another. It is concluded that AR's object recognition deficit arises from difficulties in discriminating objects that share their configuration, and from an abnormal dependency of part information processing upon object configuration.