On the role of object representations in substitution masking

Three experiments were conducted to investigate the role of object representations in object substitution masking (OSM). OSM occurs when a very sparse mask is presented simultaneously with a target stimulus and the target offsets first, leaving the mask to linger in the display for some time. Results confirm earlier claims that there is an isolatable object-level component to OSM and indicate that a target can be protected from OSM if, prior to offsetting, it can be represented as a distinct object from the mask. When the mask was presented as sliding past the target (Experiment 1), as jiggling independently of the target (Experiment 2), or in a different color from the target (Experiment 3), OSM was reduced or eliminated. This suggests that OSM reflects basic updating processes that allow the perception of continuity of object identity over change.     

Asymmetric object substitution masking

Object substitution masking occurs when a lateral mask persists beyond the duration of a target, reflecting reentrant processes in vision (V. Di Lollo, J. Enns, & R. Rensink, 2000). The authors studied whether substitution masking is location specific and whether it is symmetric around the target. A brief circular display of letters was presented along with a mask that designated the target. The mask was centered on the target or 1.1 degrees to the central or to the peripheral side. Substitution masking was found even when the target and the mask were at different locations. It was asymmetric and stronger when the mask was to the peripheral side of the target than to the central side. Asymmetric substitution was observed using various masks. It could not be explained by retina acuity gradients and was not attenuated by focused attention. The authors propose that target selection triggers an asymmetric inhibitory surround that is stronger toward the central side of the target.     

Understanding recovery from object substitution masking

When we look at a scene, we are conscious of only a small fraction of the available visual information at any given point in time. This raises profound questions regarding how information is selected, when awareness occurs, and the nature of the mechanisms underlying these processes. One tool that may be used to probe these issues is object-substitution masking (OSM). In OSM, a sparse, temporally-trailing four dot mask can interfere with target perception, even though the target and mask have different contours and do not spatially overlap (Enns & Di Lollo, 1997). Here, we investigate the mechanisms underlying the recently discovered recovery from OSM observed with prolonged mask exposure (Goodhew, Visser, Lipp, & Dux, 2011). In three experiments, we demonstrate that recovery is unaffected by mask offset, and that prolonged physical exposure of the mask is not necessary for recovery. These findings confirm that recovery is not due to: (a) an offset transient impairing the visibility of other stimuli that are nearby in space and time, or (b) mask adaptation or temporal object-individuation cues resulting from prolonged mask exposure. Instead, our results confirm recovery as a high-level visual-cognitive phenomenon, which is inherently tied to target-processing time. This reveals the prolonged iterative temporal dynamics of conscious object perception.     

Endogenous cueing attenuates object substitution masking

Object substitution masking (OSM) is a form of visual masking in which a briefly presented target surrounded by four small dots is masked by the continuing presence of the four dots after target offset. A major parameter in the prediction of OSM is the time required for attention to be directed to the target following its onset. Object substitution theory (Di Lollo et al. in J Exp Psychol Gen 129:481–507, 2000) predicts that the sooner attention can be focused at the target’s location, the less masking will ensue. However, recently Luiga and Bachmann (Psychol Res 71:634–640, 2007) presented evidence that precueing of attention to the target location prior to target-plus-mask onset by means of a central (endogenous) arrow cue does not reduce OSM. When attention was cued exogenously, OSM was attenuated. Based on these results, Luiga and Bachmann argued that object substitution theory should be adapted by differentiating the ways of directing attention to the target location. The goal of the present study was to further examine the dissociation between the effects of endogenous and exogenous precueing on OSM. Contrary to Luiga and Bachmann, our results show that prior shifts of attention to the target location initiated by both exogenous and endogenous cues reduce OSM as predicted by object substitution theory and its computational model CMOS.     

Implicit semantic perception in object substitution masking

Decades of research on visual perception has uncovered many phenomena, such as binocular rivalry, backward masking, and the attentional blink, that reflect ‘failures of consciousness’. Although stimuli do not reach awareness in these paradigms, there is evidence that they nevertheless undergo semantic processing. Object substitution masking (OSM), however, appears to be the exception to this rule. In OSM, a temporally-trailing four-dot mask interferes with target perception, even though it has different contours from and does not spatially overlap with the target. Previous research suggests that OSM has an early locus, blocking the extraction of semantic information. Here, we refute this claim, showing implicit semantic perception in OSM using a target-mask priming paradigm. We conclude that semantic information suppressed via OSM can nevertheless guide behavior.     

A novel paradigm reveals the role of reentrant visual processes in object substitution masking

Object substitution masking (OSM) occurs when an initial display of a target and mask continues with the mask alone, creating a mismatch between the reentrant hypothesis, triggered by the initial display, and the ongoing low-level activity. We tested the proposition that the critical factor in OSM is not whether the mask remains in view after target offset, but whether the representation of the mask is sufficiently stronger than that of the target when the reentrant signal arrives. In Experiment 1, a variable interstimulus interval (ISI) was inserted between the initial display and the mask alone. The trailing mask was presumed to selectively boost the strength of the mask representation relative to that of the target. As predicted, OSM occurred at intermediate ISIs, at which the mask was presented before the arrival of the reentrant signal, creating a mismatch, but not at long ISIs, at which a comparison between the reentrant signal and the low-level activity had already been made. Experiment 2, conducted in dark-adapted viewing, ruled out the possibility that low-level inhibitory contour interactions (metacontrast masking) had played a significant role in Experiment 1. Metacontrast masking was further ruled out in Experiment 3, in which the masking contours were reduced to four small dots. We concluded that OSM does not depend on extended presentation of the mask alone, but on a mismatch between the reentrant signals and the ongoing activity at the lower level. The present results place constraints on estimates of the timing of reentrant signals involved in OSM.     

Testing models of object substitution with backward masking

A briefly presented visual target stimulus can be difficult to identify if shown in the context of a mask stimulus. There are several quantitative models that have been used to explain many different masking effects. Here, we look at modeling what has been called object substitution. We analyze four models and show that three of the models work with a common principle, whereas the fourth behaves quite differently. The three similar models have previously been used to explain many other aspects of visual masking, whereas the fourth model was designed exclusively to deal with object substitution masking effects. We identify an experimental test on the basis of which to choose between the models. The experimental results support the behavior of the fourth model.     

Object substitution masking and the object updating hypothesis

The object updating hypothesis of object substitution masking proposes that the phenomenon arises when the visual system fails to individuate target and mask at the level of object token representations. This hypothesis is tested in two experiments using modifications of the dot mask paradigm developed by Lleras and Moore (2003). Target—mask individuation is manipulated by the presentation of additional display items that influence the linking apparent motion seen between a target and a spatially separated mask (Experiment 1), and by the use of placeholders that maintain the target object’s presence during mask presentation (Experiment 2). Results in both cases are consistent with the updating hypothesis in showing significantly reduced masking when the conditions promoted target—mask individuation. However, in both experiments, some masking was still present under conditions of individuation, an effect we attribute to attentional capture by the mask.     

Exogenous spatial precuing reliably modulates object processing but not object substitution masking

Object substitution masking (OSM) is used in behavioral and imaging studies to investigate processes associated with the formation of a conscious percept. Reportedly, OSM occurs only when visual attention is diffusely spread over a search display or focused away from the target location. Indeed, the presumed role of spatial attention is central to theoretical accounts of OSM and of visual processing more generally (Di Lollo, Enns, & Rensink, Journal of Experimental Psychology: General 129:481–507, 2000). We report a series of five experiments in which valid spatial precuing is shown to enhance the ability of participants to accurately report a target but, in most cases, without affecting OSM. In only one experiment (Experiment 5) was a significant effect of precuing observed on masking. This is in contrast to the reliable effect shown across all five experiments in which precuing improved overall performance. The results are convergent with recent findings from Argyropoulos, Gellatly, and Pilling (Journal of Experimental Psychology: Human Perception and Performance 39:646–661, 2013), which show that OSM is independent of the number of distractor items in a display. Our results demonstrate that OSM can operate independently of focal attention. Previous claims of the strong interrelationship between OSM and spatial attention are likely to have arisen from ceiling or floor artifacts that restricted measurable performance.     

Attend to it now or lose it forever: selective attention,metacontrast masking,and object substitution

Metacontrast masking occurs when the visibility of a brief target stimulus is decreased by the subsequent appearance of another nearby visual stimulus. Early explanations of the phenomenon involved low-level mechanisms, but subsequent studies have suggested a role for selective attention. The results of three experiments presented here extend previous findings to the metacontrast paradigm. It is shown that the strength of metacontrast masking increases with the number of distractor items in a display, decreases when the target location is validly but not invalidly precued, and is eliminated when search for the target is efficient (pop-out search) but not when search is inefficient (serial search). A connection between metacontrast masking and object substitution masking is considered.     

ERP evidence for temporal independence of set size and object updating in object substitution masking

To keep track of dynamically changing objects in one’s environment, it is necessary to individuate them from other objects, both temporally and spatially. Spatially, objects can be selected from nearby distractors using selective attention. Temporally, object updating processes incorporate new information into existing representations over time. Both of these processes have been implicated in a type of visual masking called object-substitution masking (OSM). Previous studies have found that the number of distractors (impacting selective attention) interacts with the strength of OSM. However, it has been suggested that this interaction is an artifact of ceiling performance at low set sizes, rather than necessitating a failure of attention during masking. Using event-related potentials (ERPs), we examined whether set size and masking interact as measured by markers of selective attention (N2pc) and visual working memory consolidation/maintenance (SPCN). Set size was found to affect the N2pc (200–350 ms) and late SPCN (500–650 ms), reflecting increased demands on selective attention and unnecessary storage respectively. An early window of the SPCN (350–500 ms) was affected by masking, suggesting that OSM influences object consolidation processes in this window, independent of the number of distractors. Overall, it was found that selective attention and visual awareness are dissociable neural processes in OSM, and that they are independently affected by set size and masking manipulations. Moreover, we found that the early SPCN may reflect disruptions to object consolidation, potentially revealing a neural mechanism supporting an object individuation-through-updating account of OSM.     

Substituting objects from consciousness: A review of object substitution masking

Object substitution masking (OSM) occurs when a sparse (e.g., four-dot), temporally trailing mask obscures the visibility of a briefly presented target. Here, we review theories of OSM: those that propose that OSM reflects the interplay between feedforward and feedback/reentrant neural processes, those that predict that feedforward processing alone gives rise to the phenomenon, and theories that focus on cognitive explanations, such as object updating. We discuss how each of these theories accommodates key findings from the OSM literature. In addition, we examine the relationship between OSM and other visual-cognitive phenomena, including object correspondence through occlusion, change blindness, metacontrast masking, backward masking, and visual short-term memory. Finally, we examine the level of processing at which OSM impairs target perception. Collectively, OSM appears to reflect the conditions under which the brain confuses two visual events for one when they are encoded with low spatiotemporal resolution, due to processing resources being otherwise occupied.     

Masking by object substitution: dissociation of masking and cuing effects

In a newly discovered form of visual masking, a target stimulus is masked by 4 flanking dots if their offset is delayed relative to the target (V. Di Lollo, J. T. Enns, & R. A. Rensink, 2000). In Di Lollo et al. (2000), the dot pattern also cued the relevant target and therefore required deliberate attention. In the present Experiments 2-6, a central arrow cued 1 of 2 letters for an E/F discrimination, with dots flanking both letters. Masking was reduced compared with the mask-cue procedure but was still robust. Delayed-offset dots flanking the nontarget also impaired performance, indicating competition for attention. Masking was unaffected by brightness of the dots relative to the target. Masking was attenuated not only by precuing attention to the target location but also by preview of an uninformative dot mask. Theories of masking by object substitution must therefore accommodate the prior context into which the target stimulus is introduced.     

The effect of spatial competition between object-level representations of target and mask on object substitution masking

One of the processes determining object substitution masking (OSM) is thought to be the spatial competition between independent object file representations of the target and mask (e.g., Kahan & Lichtman, 2006). In a series of experiments, we further examined how OSM is influenced by this spatial competition by manipulating the overlap between the surfaces created by the modal completion of the target (an outline square with a gap in one of its sides) and the mask (a four-dot mask). The results of these experiments demonstrate that increasing the spatial overlap between the surfaces of the target and mask increases OSM. Importantly, this effect is not caused by the mask interfering with the processing of the target features it overlaps. Overall, the data indicate, consistent with Kahan and Lichtman, that OSM can arise through competition between independent target and mask representations.     

Visual masking during the attentional blink: tests of the object substitution hypothesis

When 2 masked targets are presented in a rapid sequence, correct identification of the 1st hinders identification of the 2nd. Visual masking of the 2nd target plays a critical role during this 2nd-target deficit, or "attentional blink" (AB). The object substitution hypothesis (B. Giesbrecht & V. Di Lollo, 1998) predicts that late-stage visual processes involved in object substitution mediate masking of the 2nd target during AB, whereby stronger masking should produce a more severe deficit. Six experiments are presented, together testing this hypothesis. Although masking by object substitution was observed, it did not interact with the AB. An alternative hypothesis is proposed stating that mostly early-stage visual processes mediate the masking effects that are critical to the AB.     

The role of visual attention in multiple object tracking: Evidence from ERPs

We examined the role of visual attention in the multiple object tracking (MOT) task by measuring the amplitude of the N1 component of the event-related potential to probe flashes presented on targets, distractors, or empty background areas. We found evidence that visual attention enhances targets and suppresses distractors (Experiments 1 and 3). However, we also found that when tracking load was light (two targets and two distractors), accurate tracking could be carried out without any apparent contribution from the visual attention system (Experiment 2). Our results suggest that attentional selection during MOT is flexibly determined by task demands, as well as tracking load, and that visual attention may not always be necessary for accurate tracking.     

Looking at object-substitution masking in depth and motion: toward a two-object theory of object substitution

When attention is divided, a briefly presented target surrounded by four small dots is difficult to identify when the dots persist beyond target offset, but not when these dots terminate with the target. This object-substitution masking effect likely reflects processes at both the image level and the object level. At the image level, visual contours of the mask make feature extraction difficult. Recent data (Lleras & Moore, 2003) suggest that, at the object level, an object file is created for the target-plus-mask, and this single-object token later morphs into a single-object token containing the mask alone. In the present experiments, we used stimuli presented in 3-D space and apparent motion; the results indicate that object-substitution masking also arises when the mask and the target are represented in two separate object tokens and the mask token interferes with the target token.     

Informational masking and auditory attention

Informational masking is broadly defined as a degradation of auditory detection or discrimination of a signal embedded ina context of other similar sounds; it is not related to energetic masking caused by physical interactions between signal and masker. In this paper, we report a systematic release from informational masking of a target tone in anine-tone rapid auditory sequence as the target is increasingly isolated in frequency or intensity from the remaieining sequence components. Improved target-tone frequency difference limens as isolation increases are interpreted as a reflection of increasingly focused auditory attention. The change from diffuse to highly focused attention is gradual over the frequency and intensity ranges examined, with each 1-dB increment in target intensity relative to the remaining components producing performance improvements equivalent to those produced by a 2% increase in frequency isolation. The results are modeled as bands of attention in the frequency and intensity domains. For attention directed by frequency isolation, there is a strong correspondence with auditory filters predicted by the power spectrum model of masking. These data also support the existence of an attention band of intensity, with a bandwidth of about 5–7 dB at the moderate levels used in this experiment.