Motion aftereffect of combined first-order and second-order motion

When, after prolonged viewing of a moving stimulus, a stationary (test) pattern is presented to an observer, this results in an illusory movement in the direction opposite to the adapting motion. Typically, this motion aftereffect (MAE) does not occur after adaptation to a second-order motion stimulus (i.e. an equiluminous stimulus where the movement is defined by a contrast or texture border, not by a luminance border). However, a MAE of second-order motion is perceived when, instead of a static test pattern, a dynamic test pattern is used. Here, we investigate whether a second-order motion stimulus does affect the MAE on a static test pattern (sMAE), when second-order motion is presented in combination with first-order motion during adaptation. The results show that this is indeed the case. Although the second-order motion stimulus is too weak to produce a convincing sMAE on its own, its influence on the sMAE is of equal strength to that of the first-order motion component, when they are adapted to simultaneously. The results suggest that the perceptual appearance of the sMAE originates from the site where first-order and second-order motion are integrated.     

Similarity structure in visual speech perception and optical phonetic signals

A complete understanding of visual phonetic perception (lipreading) requires linking perceptual effects to physical stimulus properties. However, the talking face is a highly complex stimulus, affording innumerable possible physical measurements. In the search for isomorphism between stimulus properties and phoneticeffects, second-order isomorphism was examined between theperceptual similarities of video-recorded perceptually identified speech syllables and the physical similarities among the stimuli. Four talkers produced the stimulus syllables comprising 23 initial consonants followed by one of three vowels. Six normal-hearing participants identified the syllables in a visual-only condition. Perceptual stimulus dissimilarity was quantified using the Euclidean distances between stimuli in perceptual spaces obtained via multidimensional scaling. Physical stimulus dissimilarity was quantified using face points recorded in three dimensions by an optical motion capture system. The variance accounted for in the relationship between the perceptual and the physical dissimilarities was evaluated using both the raw dissimilarities and the weighted dissimilarities. With weighting and the full set of 3-D optical data, the variance accounted for ranged between 46% and 66% across talkers and between 49% and 64% across vowels. The robust second-order relationship between the sparse 3-D point representation of visible speech and the perceptual effects suggests that the 3-D point representation is a viable basis for controlled studies of first-order relationships between visual phonetic perception and physical stimulus attributes.     

Resolving ambiguities in orientation, motion, and depth domains.

Three different perceptual systems--orientation, motion, and depth--can recover a global perceptual organization from spatially correlated random multielement patterns. In all three cases the global structure composed of random elements is evaluated by mechanisms performing measurements in the energy domain within appropriately defined local space-time areas. The selective increase in energy of one fraction of the elements may dramatically change the whole perceptual organization of the stimulus. In specially devised patterns one and the same element can belong to two or more separate perceptual organizations, the perceptual salience of one of which can be reinforced by a luminance increment of the elements comprising it. If a stimulus provides two different perceptual organizations to which each element could potentially belong, one of four possible solutions of the existing ambiguity will occur: suppression, rivalry, mixture, or parity. Two superimposed global orientation patterns either suppress or dominate over each other but cannot be seen simultaneously or in a mixed form. Characteristic of the depth system is that it allows multiple binocular matchings and parity of possible perceptual solutions. Finally, if a stimulus provides two or more paths along which each element may appear to move, the perceived global motion direction is determined by a mixture of directions of these competing motion paths. Dissimilarities in these ways of resolving ambiguities may be based on different principles defining regularity and coherence of an object in the orientation, motion, and depth domains.     

What is the reference in reference repulsion?

Reference repulsion is a mechanism posited to explain systematic biases of direction judgment of single drifting dot displays (Rauber and Treue, 1998 Perception 27 393-402). Rauber and Treue obtained systematic but, surprisingly, very different effects depending upon whether standard and comparison stimuli were presented simultaneously or successively. Successive effects were described as exhibiting repulsion from both vertical and horizontal cardinal axes, whereas simultaneous effects showed repulsion from horizontal only. We contend that the proposed mechanism makes no testable predictions because the so-called reference can only be specified a posteriori, a fact acknowledged by Rauber and Treue. We attempted to replicate Rauber and Treue's experiments, but we obtained no systematic biases of direction judgment. Comparisons across several studies suggest that errors in direction judgments of single drifting dot patterns vary widely in magnitude and direction, as might be expected with what are essentially baseline or pretest measures. In our view, reference repulsion describes neither a real perceptual mechanism nor a predictable pattern of direction misjudgments.     

Effects of similarity on apparent motion and perceptual grouping

Effects of similarity in colour, luminance, size, and shape on apparent motion and perceptual grouping were examined in part 1 in two parallel experiments on the same seven subjects. In both experiments, the effect of similarity was compared with that of proximity in competitive, bistable stimulus situations. A combination of a larger horizontal separation between the homogeneous stimulus elements and a smaller constant vertical separation between heterogeneous stimulus elements produced two kinds of apparent motion (or perceptual grouping) with equal probabilities. Such matched separations between homogeneous stimulus elements were obtained by the double staircase method in various stimulus conditions. In both experiments on apparent motion and perceptual grouping matched separation was found to increase as the difference between the heterogeneous stimulus elements increased. High correlations (0.71 to 0.94) of matched separations were found between apparent motion and perceptual grouping in four stimulus series: colour, luminance, size, and shape. Six of the seven subjects were also tested in part 2. Here, the effects of differences were found to work additively across different perceptual attributes in both phenomena, when multiple differences were combined in heterogeneous elements. The experimental results are discussed from the point of view that apparent motion is an example of perceptual constancy.     

Motion direction discrimination training reduces perceived motion repulsion

Participants often exaggerate the perceived angular separation between two simultaneously presented motion stimuli, which is referred to as motion repulsion. The overestimation helps participants differentiate between the two superimposed motion directions, yet it causes the impairment of direction perception. Since direction perception can be refined through perceptual training, we here attempted to investigate whether the training of a direction discrimination task changes the amount of motion repulsion. Our results showed a direction-specific learning effect, which was accompanied by a reduced amount of motion repulsion both for the trained and the untrained directions. The reduction of the motion repulsion disappeared when the participants were trained on a luminance discrimination task (control experiment 1) or a speed discrimination task (control experiment 2), ruling out any possible interpretation in terms of adaptation or training-induced attentional bias. Furthermore, training with a direction discrimination task along a direction 150° away from both directions in the transparent stimulus (control experiment 3) also had little effect on the amount of motion repulsion, ruling out the contribution of task learning. The changed motion repulsion observed in the main experiment was consistent with the prediction of the recurrent model of perceptual learning. Therefore, our findings demonstrate that training in direction discrimination can benefit the precise direction perception of the transparent stimulus and provide new evidence for the recurrent model of perceptual learning.     

Attentional capture by motion onsets is modulated by perceptual load

The onset of motion captures attention during visual search even if the motion is not task relevant, which suggests that motion onsets capture attention in a stimulus-driven manner. However, we have recently shown that stimulus-driven attentional capture by abruptly appearing objects is attenuated under conditions of high perceptual load. In the present study, we examined the influence of perceptual load on attentional capture by another type of dynamic stimulus: the onset of motion. Participants searched for a target letter through briefly presented low- and high-load displays. On each trial, two irrelevant flankers also appeared, one with a motion onset and one that was static. Flankers defined by a motion onset captured attention in the low-load but not in the high-load displays. This modulation of capture in high-load displays was not the result of overall lengthening of reaction times (RTs) in this condition, since search for a single low-contrast target lengthened RTs but did not influence capture. These results, together with those of previous studies, suggest that perceptual load can modulate attentional capture by dynamic stimuli.     

Linking dynamical perceptual decisions at different levels of description in motion pattern formation: computational simulations

A two-level dynamical model of motion pattern formation is developed in which local motion/ nonmotion perceptual decisions are based on inhibitory competition between area V1 detectors responsive to motion-specifying versus motion-independent stimulus information, and pattern-level perceptual decisions are based on inhibitory competition between area MT motion detectors with orthogonal directional selectivity. The model accounts for the effects of luminance perturbations on the relative size of the pattern-level hysteresis effects reported by Hock and Ploeger (2006) and also accounts for related experimental results reported by Hock, Kelso, and Sch?ner (1993). Single-trial simulations demonstrated the crucial role of local motion/nonmotion bistability and activation-dependent future-shaping interactions in stabilizing perceived global motion patterns. Such interactions maintain currently perceived motion patterns by inhibiting the soon-to-be-stimulated motion detectors that otherwise would be the basis for the perception of an alternative pattern.     

Independent first- and second-order motion energy analyses of optic flow

The human visual system contains a functional sub-system that is specialized to extract image motion. The sensitivities of neurons change as one moves higher in the pathway. Initially cells collect responses from small retinal areas but later those local signals are combined to extract global motion; either frontoparallel or radial motion relative to the center of the visual field. This sequence of processing is conducted in parallel by pathways sensitive to the motion of either the first- or second-order luminance statistics of the image. Previously it had been shown that these two pathways were independent at the level at which local motion signals and frontoparallel global motion signals are extracted. In this study independence is tested during the extraction of radial global motion; a process strongly associated with cortical area MST (or V6) and the next logical level in the motion pathway. We find that the two pathways do provide independent estimates of radial motion and are, therefore, independent at all levels of the motion pathway that have been tested to date. Received: 20 January 1999 / Accepted: 10 January 2000     

Coherence and transparency of moving plaids composed of Fourier and non-Fourier gratings.

We examined the perceptual coherence of two-component moving plaids. The gratings that constituted the plaids were either standard Fourier gratings (F), in which luminance was determined by a drifting sinusoid, or non-Fourier gratings (NF), in which the contrast of a random background was modulated by a drifting sinusoid. These NF gratings are examples of stimuli that generate a compelling percept of motion, even though they fail to elicit a motion signal from motion analyzers based on standard cross-correlation (Chubb & Sperling, 1988). Naive observers viewed three types of stimuli consisting of superpositions of these two components: (1) two standard drifting gratings (F/F), (2) two non-Fourier drifting gratings (NF/NF), and (3) one standard and one non-Fourier drifting grating (F/NF). As expected, the F/F stimulus yielded a compelling percept of coherent motion. The dominant percept of all the observers for the NF/NF stimulus was one of coherent motion, provided that both gratings were visible and of approximately equal contrast. None of the observers reported a dominant percept of coherent motion for the F/NF condition, over a wide range of contrasts for the two grating components and across two varieties of NF gratings. In view of the results of Albright (1992) and Albright and Chaudhuri (1989), that show that single cells in macaque V1 and MT respond to both F and NF motion, one cannot interpret our findings as evidence that F and NF motion are processed independently. Alternative, "higher level" interpretations based on the intrinsically ambiguous nature of the stimuli and physical laws governing the appearance of transparent objects are discussed.     

Coherence and transparency of moving plaids composed of Fourier and non-Fourier gratings

We examined the perceptual coherence of two-component moving plaids. The gratings that constituted the plaids were either standard Fourier gratings (F), in which luminance was determined by a drifting sinusoid, or non-Fourier gratings (NF), in which the contrast of a random background was modulated by a drifting sinusoid. These NF gratings are examples of stimuli that generate a compelling percept of motion, even though they fail to elicit a motion signal from motion analyzers based on standard cross-correlation (Chubb & Sperling, 1988). Naive observers viewed three types of stimuli consisting of superpositions of these two components: (1) two standard drifting gratings (F/F), (2) two non-Fourier drifting gratings (NF/NF), and (3) one standard and one non-Fourier drifting grating (F/NF). As expected, the F/F stimulus yielded a compelling percept of coherent motion. The dominant percept of all the observers for the NF/NF stimulus was one of coherent motion, provided that both gratings were visible and of approximately equal contrast. None of the observers reported a dominant percept of coherent motion for the F/NF condition, over a wide range of contrasts for the two grating components and across two varieties of NF gratings. In view of the results of Albright (1992) and Albright and Chaudhuri (1989), that show that single cells in macaque V1 and MT respond to both F and NF motion, one cannot interpret our findings as evidence that F and NF motion are processed independently. Alternative, “higher level” interpretations based on the intrinsically ambiguous nature of the stimuli and physical laws governing the appearance of transparent objects are discussed.     

Conjunction benefits and costs reveal decision priming for first-order and second-order features

Across two experiments, decision priming was examined for conjunctions composed of first-order or first- and second-order stimulus features. Observers indicated the presence or absence of one or two features in a Gabor stimulus. When a pair of stimulus features differed in their speed of discrimination, responses indicating the presence of a conjunction were faster than those for the single feature for which discrimination was slowest (conjunction benefits). Also, responses indicating the absence of a conjunction were delayed if one of the features was present (conjunction costs). These results show that first- and second-order features can prime decisions about the presence of a conjunction and suggest that the two kinds of signals can be combined at a decision stage after the discrimination of stimulus properties has begun for each system.     

Factor Analytic Studies Of Human Brain Damage: I. First And Second-Order Factors And Their Brain Correlates

This report is concerned with identifying the first and second-order cognitive factors underlying a battery of 49 measures taken from 22 brain damage tests. The test scores from 176 brain damaged patients between 16 and 65 years of age were intercorrelated and subjected to first-order alpha factoring followed by promax rotation to oblique simple structure. Ten of the 13 first-order factors extracted were interpretable, six of them being perceptual in nature and four being of a more conceptual nature. The perceptual factors include: perceptual organization, perceptual-motor speed, pattern recognition, temporal resolution, spatial orientation, and figure-ground identification. The conceptual factors include verbal comprehension, memory, and two abstraction factors. A second-order alpha factoring was performed on the matrix of correlations among the 13 primaries. Three of the five second-order factors extracted were interpretable. They were identified as perceptual integration (subsuming the first-order factors of perceptual organization, perceptual-motor speed, and temporal resolution), verbal memory (subsuming verbal comprehension and memory), and visualization (subsuming spatial orientation and figure-ground identification). Although factor interpretations were based primarily on the patterns of high loading variables, they were also influenced by lesion effects observed in this and related studies. About half the interpretable factors are relatively localized (i.e., confined to one or two lobes of one hemisphere), with the other half more diffuse (i.e., multi-lobed, combined with laterality or bilaterality). The more localized factors include the right hemisphere factors of perceptual-motor speed, temporal resolution, and spatial orientation, and the left hemisphere factors of verbal comprehension, memory, and verbal memory. The more neurally diffuse factors include the second-order factors and such broad gauged first-order factors as abstraction I and II, and pattern recognition. Furthermore, same lobe, bilaterally hemispheric effects were rare, and only four factors (memory, verbal memory, visualization, and abstraction I) were correlated with sub-cortical lesions.     

Second-order reversed phi.

In a first-order reversed-phi motion stimulus (Anstis, 1970), the black-white contrast of successive frames is reversed, and the direction of apparent motion may, under some conditions, appear to be reversed. It is demonstrated here that, for many classes of stimuli, this reversal is a mathematical property of the stimuli themselves, and the real problem is in perceiving forward motion, which involves the second- or third-order motion systems or both. Three classes of novel second-order reversed-phi stimuli (contrast, spatial frequency, and flicker modulation) that are invisible to first-order motion analysis were constructed. In these stimuli, the salient stimulus features move in the forward (feature displacement) direction, but the second-order motion energy model predicts motion in the reversed direction. In peripheral vision, for all stimulus types and all temporal frequencies, all the observers saw only the reversed-phi direction of motion. In central vision, the observers also perceived reversed motion at temporal frequencies above about 4 Hz, but they perceived movement in the forward direction at lower temporal frequencies. Since all of these stimuli are invisible to first-order motion, these results indicate that the second-order reversed-phi stimuli activate two subsequent competing motion mechanisms, both of which involve an initial stage of texture grabbing (spatiotemporal filtering, followed by fullwave rectification). The second-order motion system then applies a Reichardt detector (or equivalently, motion energy analysis) directly to this signal and arrives at the reversed-phi direction. The third-order system marks the location of features that differ from the background (the figure) in a salience map and computes motion in the forward direction from the changes in the spatiotemporal location of these marks. The second-order system's report of reversed movement dominates in peripheral vision and in central vision at higher temporal frequencies, because it has better spatial and temporal resolution than the third-order system, which has a cutoff frequency of 3-4 Hz (Lu & Sperling, 1995b). In central vision, below 3-4 Hz, the third-order system's report of resolvable forward movement of something salient (the figure) dominates the second-order system's report of texture contrast movement.     

Second-order reversed phi

In a first-order reversed-phi motion stimulus (Anstis, 1970), the black-white contrast of successive frames is reversed, and the direction of apparent motion may, under some conditions, appear to be reversed. It is demonstrated here that, for many classes of stimuli, this reversal is a mathematical property of the stimuli themselves, and the real problem is in perceiving forward motion, which involves the second- or third-order motion systems or both. Three classes of novel second-order reversed-phi stimuli (contrast, spatial frequency, and flicker modulation) that are invisible to first-order motion analysis were constructed. In these stimuli, the salient stimulus features move in theforward (feature displacement) direction, but the second-order motion energy model predicts motion in thereversed direction. In peripheral vision, for all stimulus types and all temporal frequencies, all the observers saw only the reversed-phi direction of motion. In central vision, the observers also perceived reversed motion at temporal frequencies above about 4 Hz, but they perceived movement in the forward direction at lower temporal frequencies. Since all of these stimuli are invisible to first-order motion, these results indicate that the second-order reversed-phi stimuli activate two subsequent competing motion mech-anisms, both of which involve an initial stage of texture grabbing (spatiotemporal filtering, followed by fullwave rectification). The second-order motion system then applies a Reichardt detector (or equiva-lently, motion energy analysis) directly to this signal and arrives at the reversed-phi direction. The third-order system marks the location of features that differ from the background (the figure) in a salience map and computes motion in the forward direction from the changes in the spatiotemporal location of these marks. The second-order system’s report of reversed movement dominates in peripheral vision and in central vision at higher temporal frequencies, because it has better spatial and temporal resolu-tion than the third-order system, which has a cutoff frequency of 3–4 Hz (Lu & Sperling, 1995b). In cen-tral vision, below 3–4 Hz, the third-order system’s report of resolvable forward movement of something salient (the figure) dominates the second-order system’s report of texture contrast movement.     

From elements to perception: local and global processing in visual neurons

Gestalt psychologists in the early part of the century challenged psychophysical notions that perceptual phenomena can be understood from a punctate (atomistic) analysis of the elements present in the stimulus. Their ideas slowed later attempts to explain vision in terms of single-cell recordings from individual neurons. A rapprochement between Gestalt phenomenology and neurophysiology seemed unlikely when the first ECVP was held in Marburg, Germany, in 1978. Since that time, response properties of neurons have been discovered that invite an interpretation of visual phenomena (including illusions) in terms of neuronal processing by long-range interactions, as first proposed by Mach and Hering in the last century. This article traces a personal journey into the early days of neurophysiological vision research to illustrate the progress that has taken place from the first attempts to correlate single-cell responses with visual perceptions. Whereas initially the receptive-field properties of individual classes of cells--e.g., contrast, wavelength, orientation, motion, disparity, and spatial-frequency detectors--were used to account for relatively simple visual phenomena, nowadays complex perceptions are interpreted in terms of long-range interactions, involving many neurons. This change in paradigm from local to global processing was made possible by recent findings, in the cortex, on horizontal interactions and backward propagation (feedback loops) in addition to classical feedforward processing. These mechanisms are exemplified by studies of the tilt effect and tilt aftereffect, direction-specific motion adaptation, illusory contours, filling-in and fading, figure--ground segregation by orientation and motion contrast, and pop-out in dynamic visual-noise patterns. Major questions for future research and a discussion of their epistemological implications conclude the article.     

The effect of perceptual load on attention-induced motion blindness: the efficiency of selective inhibition

Recent visual marking studies have shown that the carry-over of distractor inhibition can impair the ability of singletons to capture attention if the singleton and distractors share features. The current study extends this finding to first-order motion targets and distractors, clearly separated in time by a visual cue (the letter X). Target motion discrimination was significantly impaired, a result attributed to the carry-over of distractor inhibition. Increasing the difficulty of cue detection increased the motion target impairment, as distractor inhibition is thought to increase under demanding (high load) conditions in order to maximize selection efficiency. The apparent conflict with studies reporting reduced distractor inhibition under high load conditions was resolved by distinguishing between the effects of "cognitive" and "perceptual" load.     

The effects of temporal modulation and spatial location on the perceived spatial frequency of visual patterns

The perceived spatial frequency of a visual pattern can increase when a pattern drifts or is presented at a peripheral visual field location, as compared with a foveally viewed, stationary pattern. We confirmed previously reported effects of motion on foveally viewed patterns and of location on stationary patterns and extended this analysis to the effect of motion on peripherally viewed patterns and the effect of location on drifting patterns. Most central to our investigation was the combined effect of temporal modulation and spatial location on perceived spatial frequency. The group data, as well as the individual sets of data for most observers, are consistent with the mathematical concept of separability for the effects of temporal modulation and spatial location on perceived spatial frequency. Two qualitative psychophysical models suggest explanations for the effects. Both models assume that the receptive-field sizes of a set of underlying psychophysical mechanisms monotonically change as a function of temporal modulation or visual field location, whereas the perceptual labels attached to a set of channels remain invariant. These models predict that drifting or peripheral viewing of a pattern will cause a shift in the perceived spatial frequency of the pattern to a higher apparent spatial frequency.     

The induced asynchrony effect: Its role in visual judgments of temporal order and its relation to other dynamic perceptual phenomena

A context-induced “illusion” in visual judgments of temporal order, termed the induced asynchrony effect (IAE), is reported. It consists of an apparent ordering in time of two simultaneous light onsets, produced by the preceding, asynchronous offsets of two other lights. The joint effect of a real stimulus onset asynchrony and a preceding stimulus offset asynchrony bn judgments of onset order appears to be additive, given a Gaussian transformation of response probability. This result is shown to be consistent with a simple statistical decision model, which provides a conceptual framework for drawing inferences from temporal order judgment data. However, it is emphasized that certain interpretations of such models are not empirically testable on the basis of temporal order data alone. An attempt is made to relate the IAE to three other dynamic perceptual phenomena; all four effects may reflect a tendency of observers to perceive the velocity of apparent motion as being constant. Questions raised by the demonstration of the IAE are discussed, and directions for further research are suggested.     

Visual motion and attentional capture

Previous work has shown that abrupt visual onsets capture attention. This occurs even with stimuli that are equiluminant with the background, which suggests that the appearance of a new perceptual object, not merely a change in luminance, captures attention. Three experiments are reported in which this work was extended by investigating the possible role of visual motion in attentional capture. Experiment 1 revealed that motion can efficiently guide attention when it is perfectly informative about the location of a visual search target, but that it does not draw attention when it does not predict the target’s position. This result was obtained with several forms of motion, including oscillation, looming, and nearby moving contours. To account for these and other results, we tested anew-object account of attentional capture in Experiment 2 by using a global/local paradigm. When motion segregated a local letter from its perceptual group, the local letter captured attention as indexed by an effect on latency of response to the task-relevant global configuration. Experiment 3 ruled out the possibility that the motion in Experiment 2 captured attention merely by increasing the salience of the moving object. We argue instead that when motion segregates a perceptual element from a perceptual group, a new perceptual object is created, and this event captures attention. Together, the results suggest that motion as such does not capture attention but that the appearance of a new perceptual object does.