The role of motion direction selective extrastriate regions in reading: a transcranial magnetic stimulation study

Why reading ability is correlated with motion processing ability is perplexing. Activity in motion direction processing regions (Area V5/MT+) was perturbed by means of repetitive transcranial magnetic stimulation (rTMS) to examine its effect on reading. A functional probe (significant shortening of the motion aftereffect) was used to identify Area V5/MT+. Right-handed participants (8 m, 8 f) received three 7.5 min blocks of rTMS, after which two phonological and one orthographic reading tasks were administered. Application of rTMS to Area V5/MT+ (as compared to a non-rTMS baseline) significantly decreased performance only during non-word naming. The pattern of naming errors and the absence of deficits on the second phonological task were not consistent with a role for Area V5/MT+ in phonological decoding. Instead, its role in reading may be limited to image stabilization and/or letter localization.     

Transcranial magnetic stimulation over MT/MST fails to impair judgments of implied motion

The medial temporal and medial superior temporal cortex (MT/MST) is involved in the processing of visual motion, and fMRI experiments indicate that there is greater activation when subjects view static images that imply motion than when they view images that do not imply motion at all. We applied transcranial magnetic stimulation (TMS) to MT/MST in order to assess the functional necessity of this region for the processing of implied motion represented in static images. Area MT/MST was localized by the use of a TMS-induced misperception of visual motion, and its location was verified through the monitored completion of a motion discrimination task. We controlled for possible impairments in general visual processing by having subjects perform an object categorization task with and without TMS. Although MT/MST stimulation impaired performance in a motion discrimination task (and vertex stimulation did not), there was no difference in performance between the two forms of stimulation in the implied motion discrimination task. MT/MST stimulation did, however, improve subjects’ performance in the object categorization task. These results indicate that, within 150 msec of stimulus presentation, MT/MST is not directly involved in the visual processing of static images in which motion is implied. The results do, however, confirm previous findings that disruption of MT/MST may improve efficiency in more ventral visual processing streams.     

Representational momentum and the brain: An investigation into the functional necessity of V5/MT

The mental representation of objects can imply motion and momentum. This can be explored by investigating a distortion in recognition memory for pictures that depict objects “frozen” in mid-air, implying motion. This distortion is called representational momentum (RM). Recent functional neuroimaging studies have suggested that the V5/MT system (the area of the brain thought to be responsible for perceptual processing of motion) is involved in the mediation of RM. The results of these studies are reviewed here. However the presence of functional activity revealed in brain imaging studies does not mean that this part of the brain is necessary for a particular cognitive task. A greater degree of functional necessity can be inferred by disrupting function in that part of the brain. One way in which this can be done is with Transcranial Magnetic Stimulation (TMS, a method of temporarily suspending cortical activity). We extended the findings of the previous fMRI experiments by using TMS in conjunction with an RM paradigm. Repetitive magnetic stimulation to V5/MT during the so-called freeze-frame RM task resulted in an absence of the stereotypical distortion in recognition memory (compared to stimulation at the vertex) for approximately 60% of     

Visual masking during the attentional blink: tests of the object substitution hypothesis

When 2 masked targets are presented in a rapid sequence, correct identification of the 1st hinders identification of the 2nd. Visual masking of the 2nd target plays a critical role during this 2nd-target deficit, or "attentional blink" (AB). The object substitution hypothesis (B. Giesbrecht & V. Di Lollo, 1998) predicts that late-stage visual processes involved in object substitution mediate masking of the 2nd target during AB, whereby stronger masking should produce a more severe deficit. Six experiments are presented, together testing this hypothesis. Although masking by object substitution was observed, it did not interact with the AB. An alternative hypothesis is proposed stating that mostly early-stage visual processes mediate the masking effects that are critical to the AB.     

Substituting objects from consciousness: A review of object substitution masking

Object substitution masking (OSM) occurs when a sparse (e.g., four-dot), temporally trailing mask obscures the visibility of a briefly presented target. Here, we review theories of OSM: those that propose that OSM reflects the interplay between feedforward and feedback/reentrant neural processes, those that predict that feedforward processing alone gives rise to the phenomenon, and theories that focus on cognitive explanations, such as object updating. We discuss how each of these theories accommodates key findings from the OSM literature. In addition, we examine the relationship between OSM and other visual-cognitive phenomena, including object correspondence through occlusion, change blindness, metacontrast masking, backward masking, and visual short-term memory. Finally, we examine the level of processing at which OSM impairs target perception. Collectively, OSM appears to reflect the conditions under which the brain confuses two visual events for one when they are encoded with low spatiotemporal resolution, due to processing resources being otherwise occupied.     

Motion in the mind’s eye: Comparing mental and visual rotation

Mental rotation is among the most widely studied visuospatial skills in humans. The processes involved in mental rotation have been described as analogous to seeing an object physically rotate. We used functional magnetic resonance imaging of the whole brain and localized motion-sensitive hV5/MT1 to compare brain activation for stimuli when they were mentally or visually rotated. The results provided clear evidence for activation in hV5/MT1 during both mental and visual rotation of figures, with increased activation for larger rotations. Combined with the overall similarities between mental and visual rotation in this study, these results suggest that mental rotation recruits many of the same neural substrates as observing motion.     

When the target becomes the mask: using apparent motion to isolate the object-level component of object substitution masking

J. T. Enns and V. Di Lollo (1997) discovered a new form of visual masking that they labeled object substitution masking (OSM). OSM occurs when 4 dots, presented around a target, trail in the display after target offset. The present study showed that the physical presence of the masking dots after target offset is not necessary for OSM. Instead, the continued presence of a changing high-level representation associated with the target suffices to yield OSM. Apparent motion was used to define such representation. In these experiments, the initial display offset and was followed by a 2nd display where masks appeared at new locations. Only when the spatiotemporal properties of the stimuli on the 2nd display supported the perception of the target moving and turning into the mask was OSM observed.     

Neural correlates of coherent and biological motion perception in autism

Recent evidence suggests those with autism may be generally impaired in visual motion perception. To examine this, we investigated both coherent and biological motion processing in adolescents with autism employing both psychophysical and fMRI methods. Those with autism performed as well as matched controls during coherent motion perception but had significantly higher thresholds for biological motion perception. The autism group showed reduced posterior Superior Temporal Sulcus (pSTS), parietal and frontal activity during a biological motion task while showing similar levels of activity in MT+/V5 during both coherent and biological motion trials. Activity in MT+/V5 was predictive of individual coherent motion thresholds in both groups. Activity in dorsolateral prefrontal cortex (DLPFC) and pSTS was predictive of biological motion thresholds in control participants but not in those with autism. Notably, however, activity in DLPFC was negatively related to autism symptom severity. These results suggest that impairments in higher-order social or attentional networks may underlie visual motion deficits observed in autism.     

Warning: Attending to a mask may be hazardous to your perception

Object substitution is a type of backward masking that occurs when a mask appears during visual search for a target. We tested the hypothesis that object substitution is an overwriting process triggered by attentional selection of the mask. Impeding attentional selection of a mask by embedding it in an array of distractors eliminated object substitution. Similarly, object substitution did not occur when the mask appeared in advance of the target and, therefore, could not capture attention during search for the target. However, masking was reinstated when the mask was revealed from background contours at the moment of target onset and could therefore capture attention during search. These observations demonstrate that attentional selection of the mask is a necessary step in this type of masking and suggest that object substitution is active overwriting of unattended information triggered by selection of other visual information at a nearby location.     

整体运动知觉老化伴随颞中回静息态功能改变

以个体整体运动一致性阈值为指标, 探讨老年人整体运动敏感性(GMS)下降和静息态下兴趣脑区功能活动的关系。发现与阈值负相关且老年人低于青年人的指标主要有：MT/V5区的ReHo和ALFF值, 各网络拓扑属性; 与阈值正相关且老年人显著高于青年人的有：MT/V5区与前运动皮层之间的、各兴趣脑区之间的功能连接。结果用“去分化”等观点进行了解释, 提示老年人GMS的下降可能不仅与安静状态下MT/V5区的功能改变有关, 还可能与全脑更广泛区域的功能改变有关。     

The effect of smoking on sensory and attentional masking

This study examined the influence of smoking on low-level sensory and higher level visual cognitive abilities. Three groups (nonsmokers, deprived smokers, and nondeprived smokers) of 22 observers were tested using a visual target discrimination task. To assess sensory and visual cognitive differences, a masking task developed by Enns and Di Lollo (1997) was used. In the task, the target was masked by either a contour mask (contour masking) or an object mask (attentional masking by object substitution). The strongest masking effects were found in the group of nondeprived smokers, for both sensory and attentional masking. This pattern of results as well as results in the deprived smokers indicated changes in transient visual processing channels due to the acute actions of nicotine, not mediated by withdrawal relief.     

Object substitution masking and the object updating hypothesis

The object updating hypothesis of object substitution masking proposes that the phenomenon arises when the visual system fails to individuate target and mask at the level of object token representations. This hypothesis is tested in two experiments using modifications of the dot mask paradigm developed by Lleras and Moore (2003). Target—mask individuation is manipulated by the presentation of additional display items that influence the linking apparent motion seen between a target and a spatially separated mask (Experiment 1), and by the use of placeholders that maintain the target object’s presence during mask presentation (Experiment 2). Results in both cases are consistent with the updating hypothesis in showing significantly reduced masking when the conditions promoted target—mask individuation. However, in both experiments, some masking was still present under conditions of individuation, an effect we attribute to attentional capture by the mask.     

A comparison of masking by visual and transcranial magnetic stimulation: implications for the study of conscious and unconscious visual processing

Visual stimuli as well as transcranial magnetic stimulation (TMS) can be used: (1) to suppress the visibility of a target and (2) to recover the visibility of a target that has been suppressed by another mask. Both types of stimulation thus provide useful methods for studying the microgenesis of object perception. We first review evidence of similarities between the processes by which a TMS mask and a visual mask can either suppress the visibility of targets or recover such suppressed visibility. However, we then also point out a significant difference that has important implications for the study of the time course of unconscious and conscious visual information processing and for theoretical accounts of the processes involved. We present evidence and arguments showing: (a) that visual masking techniques, by revealing more detailed aspects of target masking and target recovery, support a theoretical approach to visual masking and visual perception that must take into account activities in two separate neural channels or processing streams and, as a corollary, (b) that at the current stage of methodological sophistication visual masks, by acting in more highly specifiable ways on these pathways, provide information about the microgenesis of form perception not available with TMS masks.     

Competition for consciousness among visual events: the psychophysics of reentrant visual processes

Advances in neuroscience implicate reentrant signaling as the predominant form of communication between brain areas. This principle was used in a series of masking experiments that defy explanation by feed-forward theories. The masking occurs when a brief display of target plus mask is continued with the mask alone. Two masking processes were found: an early process affected by physical factors such as adapting luminance and a later process affected by attentional factors such as set size. This later process is called masking by object substitution, because it occurs whenever there is a mismatch between the reentrant visual representation and the ongoing lower level activity. Iterative reentrant processing was formalized in a computational model that provides an excellent fit to the data. The model provides a more comprehensive account of all forms of visual masking than do the long-held feed-forward views based on inhibitory contour interactions.     

Motion, not masking, provides the medium for feature attribution

ABSTRACT— Understanding the dynamics of how separate features combine to form holistic object representations is a central problem in visual cognition. Feature attribution (also known as feature transposition and feature inheritance) refers to the later of two stimuli expressing the features belonging to the earlier one. Both visual masking and apparent motion are implicated in feature attribution. We found that when apparent motion occurs without masking, it correlates positively with feature attribution. Moreover, when apparent motion occurs with masking, feature attribution remains positively correlated with apparent motion after the contribution of masking is factored out, but does not correlate with masking after the contribution of apparent motion is similarly factored out. Hence, motion processes on their own provide the effective medium for feature attribution. Our results clarify the dynamics of feature binding in the formation of integral and unitary object representations in human vision.     

Temporal buffering and visual capacity: The time course of object formation underlies capacity limits in visual cognition

Capacity limits are a hallmark of visual cognition. The upper boundary of our ability to individuate and remember objects is well known but—despite its central role in visual information processing—not well understood. Here, we investigated the role of temporal limits in the perceptual processes of forming “object files.” Specifically, we examined the two fundamental mechanisms of object file formation—individuation and identification—by selectively interfering with visual processing by using forward and backward masking with variable stimulus onset asynchronies. While target detection was almost unaffected by these two types of masking, they showed distinct effects on the two different stages of object formation. Forward “integration” masking selectively impaired object individuation, whereas backward “interruption” masking only affected identification and the consolidation of information into visual working memory. We therefore conclude that the inherent temporal dynamics of visual information processing are an essential component in creating the capacity limits in object individuation and visual working memory.     

视觉意识及其神经机制

视觉意识的神经机制是当前认知神经科学研究的热点问题之一。过去普遍认为视觉信息加工主要有两条通路:腹侧通路和背侧通路;而新近的研究表明还存在不经过初级视觉皮层(V1区)的第三条通路。高级视觉皮层、V1区和皮层下结构都对意识觉知的产生起到了相应的作用。已有的实验证据表明,意识的产生过程异常复杂,仍有很多问题值得继续深入讨论和研究。     

Differential activation patterns of occipital and prefrontal cortices during motion processing: Evidence from normal and schizophrenic brains

Visual motion perception is normally mediated by neural processing in the posterior cortex. Focal damage to the middle temporal area (MT), a posterior extrastriate region, induces motion perception impairment. It is unclear, however, how more broadly distributed cortical dysfunction affects this visual behavior and its neural substrates. Schizophrenia manifests itself in a variety of behavioral and perceptual abnormalities that have proved difficult to understand through a dysfunction of any single brain system. One of these perceptual abnormalities involves impaired motion perception. Motion processing provides an opportunity to clarify the roles of multiple cortical networks in both healthy and schizophrenic brains. Using fMRI, we measured cortical activation while participants performed two visual motion tasks (direction discrimination and speed discrimination) and one nonmotion task (contrast discrimination). Normal controls showed robust cortical activation (BOLD signal changes) in MT during the direction and speed discrimination tasks, documenting primary processing of sensory input in this posterior region. In patients with schizophrenia, cortical activation was significantly reduced in MT and significantly increased in the inferior convexity of the prefrontal cortex, an area that is normally involved in higher level cognitive processing. This shift in cortical responses from posterior to prefrontal regions suggests that motion perception in schizophrenia is associated with both deficient sensory processing and compensatory cognitive processing. Furthermore, this result provides evidence that in the context of broadly distributed cortical dysfunction, the usual functional specificity of the cortex becomes modified, even across the domains of sensory and cognitive processing.     

Gestalt grouping and common onset masking

A four-dot mask that surrounds and is presented simultaneously with a briefly presented target will reduce a person's ability to identity that target if the mask persists beyond target offset and attention is divided (Enns & Di Lollo, 1997, 2000). This masking effect, referred to as common onset masking, reflects reentrant processing in the visual system and can best be explained with a theory of object substitution (Di Lollo, Enns, & Rensink, 2000). In the present experiments, we investigated whether Gestalt grouping variables would influence the strength of common onset masking. The results indicated that (1) masking was impervious to grouping by form, similarity of color, position, luminance polarity, and common region and (2) masking increased with the number of elements in the masking display.     

Preserved and Impaired Detection of Structure From Motion by a 'Motion-blind" Patient

Following bilateral extrastriate damage to areas that include the suspected human homologue of V5/MT, the patient LM has a specific deficit in processing moving stimuli. She has difficulty detecting the movement or coding the velocity of single moving dots. Nevertheless, we find that she can report human actions in Johansson “biological motion ”; displays. This requires the accurate coding of the direction and velocity of many moving dots. The implication is that structure can be extracted from motion in regions of visual cortex other than those traditionally associated with motion processing. However, she cannot report the spatial disposition of the actors whose actions she has recognized, not their movement in depth relative to her. A possible interpretation is that coding in these additional regions is primarily object-centred. Adding a small number of random stationary “noise” dots to the display prevents her from identifying the actions, suggesting that segregation by motion is implemented within the traditional movement areas.