Contextual illusions reveal the limit of unconscious visual processing

The perception of even the most elementary features of the visual environment depends strongly on their spatial context. In the study reported here, we asked at what level of abstraction such effects require conscious processing of the context. We compared two visual illusions that alter subjective judgments of brightness: the simultaneous brightness contrast illusion, in which two circles of identical physical brightness appear different because of different surround luminance, and the Kanizsa triangle illusion, which occurs when the visual system extrapolates a surface without actual physical stimulation. We used a novel interocular masking technique that allowed us to selectively render only the context invisible. Simultaneous brightness contrast persisted even when the surround was masked from awareness. In contrast, participants did not experience illusory contours when the inducing context was masked. Our findings show that invisible context is resolvable by low-level processes involved in surface-brightness perception, but not by high-level processes that assign surface borders through perceptual completion.     

Visual masking during the attentional blink: tests of the object substitution hypothesis

When 2 masked targets are presented in a rapid sequence, correct identification of the 1st hinders identification of the 2nd. Visual masking of the 2nd target plays a critical role during this 2nd-target deficit, or "attentional blink" (AB). The object substitution hypothesis (B. Giesbrecht & V. Di Lollo, 1998) predicts that late-stage visual processes involved in object substitution mediate masking of the 2nd target during AB, whereby stronger masking should produce a more severe deficit. Six experiments are presented, together testing this hypothesis. Although masking by object substitution was observed, it did not interact with the AB. An alternative hypothesis is proposed stating that mostly early-stage visual processes mediate the masking effects that are critical to the AB.     

Competition for consciousness among visual events: the psychophysics of reentrant visual processes

Advances in neuroscience implicate reentrant signaling as the predominant form of communication between brain areas. This principle was used in a series of masking experiments that defy explanation by feed-forward theories. The masking occurs when a brief display of target plus mask is continued with the mask alone. Two masking processes were found: an early process affected by physical factors such as adapting luminance and a later process affected by attentional factors such as set size. This later process is called masking by object substitution, because it occurs whenever there is a mismatch between the reentrant visual representation and the ongoing lower level activity. Iterative reentrant processing was formalized in a computational model that provides an excellent fit to the data. The model provides a more comprehensive account of all forms of visual masking than do the long-held feed-forward views based on inhibitory contour interactions.     

Representational masking and the attentional blink

After successful detection of a target item within a stream of rapidly displayed visual stimuli, subsequent detection of an additional target is impaired for roughly 500 ms. This impairment is known as the “attentional blink” (AB). Previous studies have found that if either the first (Tl; Raymond, Shapiro, & Arnell, 1992) or second target (T2; Giesbrecht & Di Lollo, 1998) is not followed by a mask, the AB impairment is significantly reduced. Whereas low-level perceptual factors have been found to influence the efficacy of masking in the AB (e.g., Seiffert & Di Lollo, 1997), the current experiment used a higher level (representational) manipulation, i.e., repetition blindness to reduce the efficacy of target masking in the AB. These findings contribute to the growing literature suggesting that masking plays more than a perceptual role in the AB phenomenon.     

The levels of perceptual processing and the neural correlates of increasing subjective visibility

According to the levels-of-processing hypothesis, transitions from unconscious to conscious perception may depend on stimulus processing level, with more gradual changes for low-level stimuli and more dichotomous changes for high-level stimuli. In an event-related fMRI study we explored this hypothesis using a visual backward masking procedure. Task requirements manipulated level of processing. Participants reported the magnitude of the target digit in the high-level task, its color in the low-level task, and rated subjective visibility of stimuli using the Perceptual Awareness Scale. Intermediate stimulus visibility was reported more frequently in the low-level task, confirming prior behavioral results. Visible targets recruited insulo-fronto-parietal regions in both tasks. Task effects were observed in visual areas, with higher activity in the low-level task across all visibility levels. Thus, the influence of level of processing on conscious perception may be mediated by attentional modulation of activity in regions representing features of consciously experienced stimuli.     

Controlling low-level image properties: The SHINE toolbox

Visual perception can be influenced by top-down processes related to the observer’s goals and expectations, as well as by bottom-up processes related to low-level stimulus attributes, such as luminance, contrast, and spatial frequency. When using different physical stimuli across psychological conditions, one faces the problem of disentangling the contributions of low- and high-level factors. Here, we make available the SHINE (spectrum, histogram, and intensity normalization and equalization) toolbox for MATLAB, which we have found useful for controlling a number of image properties separately or simultaneously. The toolbox features functions for specifying the (rotational average of the) Fourier amplitude spectra, for normalizing and scaling mean luminance and contrast, and for exact histogram specification optimized for perceptual visual quality. SHINE can thus be employed for parametrically modifying a number of image properties or for equating them across stimuli to minimize potential low-level confounds in studies on higher level processes.     

The role of the magnocellular visual pathway in the attentional blink

Visual attention has temporal limitations. In the attentional blink (AB) a stream of stimuli such as letters or digits are presented to a participant on a computer monitor at a rapid rate. Embedded in the stream are two targets that the participant must try to identify. Identification of the second target is severely impaired if it is presented within approximately 500ms of the first target. This is the 'blink' in visual attention. In this study we examined the role of the magnocellular visual pathway in the AB. This fast conducting pathway has high temporal resolution and contrast sensitivity. It is also insensitive to the direction of chromatic contrast, and this attribute was exploited in order to isolate its contributions to temporal attention. Colour defined, luminance noise masked AB streams were compared to AB streams of varying achromatic contrast. The four observers, (2F and 2M) aged between 21 and 35years, had normal visual acuity and colour vision. The colour stimuli produced a similar blink to the moderate contrast achromatic stimuli. This indicates that the magnocellular pathway does not have a privileged role in the attentional blink. We provide an explanation of previous apparently contradictory findings in terms of the role of different types of visual masking in the attentional blink.     

Awareness becomes necessary between adaptive pattern coding of open and closed curvatures

Visual pattern processing becomes increasingly complex along the ventral pathway, from the low-level coding of local orientation in the primary visual cortex to the high-level coding of face identity in temporal visual areas. Previous research using pattern aftereffects as a psychophysical tool to measure activation of adaptive feature coding has suggested that awareness is relatively unimportant for the coding of orientation, but awareness is crucial for the coding of face identity. We investigated where along the ventral visual pathway awareness becomes crucial for pattern coding. Monoptic masking, which interferes with neural spiking activity in low-level processing while preserving awareness of the adaptor, eliminated open-curvature aftereffects but preserved closed-curvature aftereffects. In contrast, dichoptic masking, which spares spiking activity in low-level processing while wiping out awareness, preserved open-curvature aftereffects but eliminated closed-curvature aftereffects. This double dissociation suggests that adaptive coding of open and closed curvatures straddles the divide between weakly and strongly awareness-dependent pattern coding.     

Object recognition and Random Image Structure Evolution

We present a technique called Random Image Structure Evolution (RISE) for use in experimental investigations of high-level visual perception. Potential applications of RISE include the quantitative measurement of perceptual hysteresis and priming, the study of the neural substrates of object perception, and the assessment and detection of subtle forms of agnosia. In simple terms, RISE involves the measurement of perceptual and/or neural responses as visual stimuli are systematically transformed—in particular, as recognizable objects evolve from, then dissolve into, randomness. Points along the sequences corresponding to the onset and offset of subjects’ percepts serve as markers for quantitatively and objectively characterizing several perceptual phenomena. Notably, these image sequences are created in a manner that strictly controls a number of important low-level image properties, such as luminance and frequency spectra, thus reducing confounds in the analysis of high-level visual processes. Here we describe the RISE paradigm, report the results of a few basic RISE experiments, and discuss a number of experimental and clinical applications of this approach.     

The effect of spatial attention on invisible stimuli

The influence of selective attention on visual processing is widespread. Recent studies have demonstrated that spatial attention can affect processing of invisible stimuli. However, it has been suggested that this effect is limited to low-level features, such as line orientations. The present experiments investigated whether spatial attention can influence both low-level (contrast threshold) and high-level (gender discrimination) adaptation, using the same method of attentional modulation for both types of stimuli. We found that spatial attention was able to increase the amount of adaptation to low- as well as to high-level invisible stimuli. These results suggest that attention can influence perceptual processes independent of visual awareness.     

Auditory attentional blink: masking the second target is necessary, delayed masking is sufficient.

When two target items (T1 and T2) are presented in rapid succession among fillers, processing T2 is often impaired. This phenomenon is known as the attentional blink (AB). Within the visual modality, this second-target deficit generally occurs only if T2 is masked by a trailing item. The current study was designed to examine whether masking of T2 also plays a critical role in the auditory AB. Results showed a reliable AB effect even when the item following T2 was replaced by silence. However, the AB deficit was abolished when T2 was the last presented stimulus. Our results suggest that, as in vision, T2 masking is necessary for the AB to take place in audition, but that masking is effective even when delayed, providing evidence that the phenomenon shares some functional mechanisms across sensory modalities.     

Attention attenuates metacontrast masking

The influence of attention on perceptual awareness was examined using metacontrast masking. Attention was manipulated with endogenous cues to assess the effects on the temporal and spatial parameters of target visibility. Experiment 1 examined the time course of effective masking when the target and mask set were presented at an attended vs. an unattended location. The valid allocation of attention decreased the magnitude of the masking effect (i.e. increased visibility) for approximately 80 ms. Furthermore, even with spatial displacements of the target and mask and center-to-center separations of 1.5 degrees or 2.7 degrees of visual angle (Experiment 2), target visibility was increased when attention was validly allocated. These results indicate that attention influences low-level visual processes to enhance visual awareness.     

Sources of interference in the attentional blink: target-distractor similarity revisited

Observers monitored streams of words or letters (10 items/sec) for one or two targets. An attentional blink (AB) effect was observed in which identification of the first target temporarily impaired identification of the second target. Target identification was impaired when the distractors were composed of either letters or false-font characters (cf. Maki, Couture, Frigen, & Lien, 1997). An asymmetrical AB effect was observed with letters and mathematical symbols; the AB effect was largest for symbol targets and letter distractors. The characters used in these experiments were rated on their meaningfulness, familiarity, and other stimulus properties. The rating data showed that pixel density best accounted for the asymmetrical target-distractor similarity effects. Modulation of the AB effect by target-distractor similarity appears to result partly from low-level masking. But masking effects may be reduced by attentional capture by target features.     

The roles of location specificity and masking mechanisms in the attentional blink

In a series of four experiments using rapid serial visual presentations of two target letters embedded in numeral distractors, with different numbers of display positions and with or without masking, we show that (1) the nonmonotonic, U-shaped attentional blink (AB) function, which occurs when all items are presented at the same display location, is eliminated in favor of a monotonic function when targets and distractors are presented randomly dispersed over four or nine adjacent positions; (2) the AB monotonicity is maintained with the spatially distributed presentation even when backward masks are used in all possible stimulus positions and when the location of the next item in sequence is predictable; and (3) the If-shaped AB is not due to position-specific forward or backward masking effects occurring at early levels of visual processing. We tentatively conclude that the U-shaped AB is primarily a function of the interruption of late visual processing produced when the item following the first target occurs at the same location. In order for the AB to severely disrupt performance, the item following the first target must be presented at the same location as the target so that it can serve both as a distractor and as a mask interrupting or interfering with subsequent visual processing.     

The roles of location specificity and masking mechanisms in the attentional blink.

In a series of four experiments using rapid serial visual presentations of two target letters embedded in numeral distractors, with different numbers of display positions and with or without masking, we show that (1) the nonmonotonic, U-shaped attentional blink (AB) function, which occurs when all items are presented at the same display location, is eliminated in favor of a monotonic function when targets and distractors are presented randomly dispersed over four or nine adjacent positions; (2) the AB monotonicity is maintained with the spatially distributed presentation even when backward masks are used in all possible stimulus positions and when the location of the next item in sequence is predictable; and (3) the U-shaped AB is not due to position-specific forward or backward masking effects occurring at early levels of visual processing. We tentatively conclude that the U-shaped AB is primarily a function of the interruption of late visual processing produced when the item following the first target occurs at the same location. In order for the AB to severely disrupt performance, the item following the first target must be presented at the same location as the target so that it can serve both as a distractor and as a mask interrupting of interfering with subsequent visual processing.     

The influence of action observation on action execution: Dissociating the contribution of action on perception,perception on action,and resolving conflict

For more than 15 years, motor interference paradigms have been used to investigate the influence of action observation on action execution. Most research on so-called automatic imitation has focused on variables that play a modulating role or investigated potential confounding factors. Interestingly, furthermore, a number of functional magnetic resonance imaging (fMRI) studies have tried to shed light on the functional mechanisms and neural correlates involved in imitation inhibition. However, these fMRI studies, presumably due to poor temporal resolution, have primarily focused on high-level processes and have neglected the potential role of low-level motor and perceptual processes. In the current EEG study, we therefore aimed to disentangle the influence of low-level perceptual and motoric mechanisms from high-level cognitive mechanisms. We focused on potential congruency differences in the visual N190 ? a component related to the processing of biological motion, the Readiness Potential ? a component related to motor preparation, and the high-level P3 component. Interestingly, we detected congruency effects in each of these components, suggesting that the interference effect in an automatic imitation paradigm is not only related to high-level processes such as self-other distinction but also to more low-level influences of perception on action and action on perception. Moreover, we documented relationships of the neural effects with (autistic) behavior.     

A review of abnormalities in the perception of visual illusions in schizophrenia

Specific abnormalities of vision in schizophrenia have been observed to affect high-level and some low-level integration mechanisms, suggesting that people with schizophrenia may experience anomalies across different stages in the visual system affecting either early or late processing or both. Here, we review the research into visual illusion perception in schizophrenia and the issues which previous research has faced. One general finding that emerged from the literature is that those with schizophrenia are mostly immune to the effects of high-level illusory displays, but this effect is not consistent across all low-level illusions. The present review suggests that this resistance is due to the weakening of top–down perceptual mechanisms and may be relevant to the understanding of symptoms of visual distortion rather than hallucinations as previously thought.     

Learning expressive percussion performance under different visual feedback conditions

A study was conducted to test the effect of two different forms of real-time visual feedback on expressive percussion performance. Conservatory percussion students performed imitations of recorded teacher performances while receiving either high-level feedback on the expressive style of their performances, low-level feedback on the timing and dynamics of the performed notes, or no feedback. The high-level feedback was based on a Bayesian analysis of the performances, while the low-level feedback was based on the raw participant timing and dynamics data. Results indicated that neither form of feedback led to significantly smaller timing and dynamics errors. However, high-level feedback did lead to a higher proficiency in imitating the expressive style of the target performances, as indicated by a probabilistic measure of expressive style. We conclude that, while potentially disruptive to timing processes involved in music performance due to extraneous cognitive load, high-level visual feedback can improve participant imitations of expressive performance features.     

The role of levels of processing in disentangling the ERP signatures of conscious visual processing

We aimed to distinguish electrophysiological signatures of visual awareness from other task-related processes through manipulating the level of processing of visual stimuli. During an event-related EEG experiment, 36 subjects performed either color (low-level condition) or magnitude (high-level condition) evaluations of masked digits. Participants also assessed subjective visibility of each stimulus using the Perceptual Awareness Scale (PAS). Mean amplitude of the components of interest was analyzed (VAN − 140–240 ms; LP − 380–480 ms) with weighted regression mixed model. In the VAN component time window the mean amplitude correlated with PAS rating in both conditions. Mean amplitude in the LP time window correlated with PAS ratings in the high-level condition, but not in the low-level condition. Our results support the temporal unfolding of ERP makers of conscious processing, with an early component reflecting the initial perceptual experience and a late component being a correlate of the conscious experience of non-perceptual information.     

Modality-specific and amodal sources of interference in the attentional blink

When two masked targets (T1 and T2) are visually or auditorily presented in rapid succession, processing of T1 produces an attentional blink (AB)--that is, a transient impairment of T2 identification. The present study was conducted to compare the relative impact of masking T1 and T2 between vision and audition. Within a rapidly presented sequence, each of the two verbal targets, discriminated by their offset (Experiment 1) or their onset (Experiment 2), could be followed by either a single item, acting as a mask, or a blank gap. Masking of T2 appeared to be necessary for the occurrence of the AB for both the visual and the auditory modality. However, whereas masking of T1 affected the expression of the visual AB in both experiments, the same effect was observed in the auditory modality only when the targets varied at the onset. These results provide further evidence that processing auditory and visual information is restricted by similar attentional limitations but also suggest that these limits are constrained by properties specific to each sensory system.