Critical bands and mixed-frequency scaling: sequential dependencies, equal-loudness contours, and power function exponents

Stimuli of random intensities and various but predictable frequencies were presented for repeated magnitude estimations on the same scale (mixed-frequency scaling). The frequencies for a particular judgment session were selected so that they lay either inside each other's critical bands or outside them. Contrastive dependencies of current magnitude estimation responses on previous stimuli of a different frequency were significantly affected by whether the two frequencies were inside or outside each other's critical bands, while assimilative dependencies were not. This reinforces the idea that such dependencies are sensory in nature and arise from a different mechanism than do the assimilative dependencies. Mixed-frequency scaling of loudness also gives rise to cross-frequency matching functions from which equal-loudness contours can be calculated. These contours calculated from the present judgments are similar to those produced from other methods, even when they are extrapolated to untested intensities. Power function exponents for loudness scaled in this way are larger for lower frequencies, as has been found in previous studies, and are consistent with the flattening of the calculated equal-loudness contours for low frequencies as intensity increases.     

Comparison of contrast sensitivity functions across three orientations: implications for theory and testing.

The contrast sensitivity functions of a large group of observers (N = 71) were determined for three orientations of test gratings: vertical, oblique, and horizontal. Comparison of group means indicated that, consistent with previous findings for the 'oblique effect', sensitivity was poorer for the oblique orientation-but only for the mid-high spatial frequencies. Correlation analyses indicated that contrast sensitivity for a particular spatial frequency at a given orientation was highly correlated with contrast sensitivity for that same frequency at the other two orientations. Factor analysis of the intercorrelations revealed two strong factors, a low frequency factor, and a mid-high frequency factor. Results are discussed in terms of: (a) the implications for contrast-sensitivity testing across orientations, (b) the basis for the oblique effect, and (c) a different type of evidence for a dichotomy among spatial-frequency channels that may reflect the distinction between X cells and Y cells or between the parvocellular and magnocellular systems.     

Apparent contrast of suprathreshold gratings varies with stimulus orientation

Human contrast sensitivity is known to vary with both stimulus spatial frequency and orientation. Previous research has indicated, however, that the apparent contrast of a sinusoidal grating is independent of spatial frequency at suprathreshold levels. We have found that the apparent contrast of suprathreshold gratings is not independent of its orientation. Observers adjusted the apparent contrasts of vertical and oblique gratings to match a 40% standard. Contrast match deviations were found at a number of spatial frequencies, indicating a lack of contrast constancy with stimulus orientation. The apparent contrast of gratings in different orientations could not be predicted in any simple fashion from either contrast threshold differences or ratios.     

The role of verbal labels in the judgment of orientation and location

In an earlier study it was found that judgments of right-left orientations and locations were more difficult than judgments of up-down only when spatial words were used in the tasks. Experiments are reported in which pictures of many objects were presented to eliminate the possibility that subjects in previous studies had used strategies specific to single-stimulus tasks. In experiment 1, right-left orientations were judged more slowly than up-down orientations both when the spatial words were used and when arbitrary letters replaced the spatial words. In experiment 2, judgments of the right-left locations of pictures took longer than judgments of their up-down locations only when spatial words were used in the task; the right-left difficulty was eliminated when arbitrary letters replaced the words. The differential effect of words and letters in location judgments seems to be due to the different coding strategies adopted by subjects under the two conditions. It is concluded that a right-left difficulty does not depend on the use of spatial terms: word and letter conditions yield different results only when the task permits different judgments to be made under the two conditions.     

Cooperative representation of visual borders.

Recently it has been reported that the visual cortical cells which are engaged in cooperative coding of global stimulus features, display synchrony in their firing rates when both are stimulated. Alternative models identify global stimulus features with the course spatial scales of the image. Versions of the Munsterberg or Café Wall illusions which differ in their low spatial frequency content were used to show that in all cases it was the high spatial frequencies in the image which determined the strength and direction of these illusions. Since cells responsive to high spatial frequencies have small receptive fields, cooperative coding must be involved in the representation of long borders in the image.     

The integration of orientation information in the motion correspondence problem

We examine how differently oriented components contribute to the discrimination of motion direction along a horizontal axis. Stimuli were two-frame random-dot kinematograms that were narrowband filtered in spatial frequency. On each trial, subjects had to state whether motion was to the left or the right. For each stimulus condition, Dmax (the largest displacement supporting 80% correct direction discrimination performance) was measured. In experiment 1, Dmax was measured for orientationally narrowband stimuli as a function of their mean orientation. Dmax was found to increase as the orientation of the stimuli became closer to the axis of motion. Experiment 2 used isotropic stimuli in which some orientation bands contained a coherent motion signal, and some contained only noise. When the noise band started at vertical orientations and increased until only horizontal orientations contained a coherent motion signal, Dmax increased slightly. This suggests that near-vertical orientations interfere with motion perception at large displacements when they contain a coherent motion signal. When the noise band started at horizontal and increased until only vertical orientations contained the motion signal, Dmax decreased steadily. This implies that Dmax depends at least partly on the most horizontal motion signal in the stimulus. These results were contrasted with two models. In the first, the visual system utilises the most informative orientations (nearest horizontal). In the second, all available orientations are used equally. Results supported an intermediate interpretation, in which all orientations are used but more informative ones are weighted more heavily.     

Evidence for adaptive shoulder-elbow control in cyclical movements with different amplitudes, frequencies, and orientations

The evolution of joint dynamics and muscle patterning in the shoulder and elbow was studied for cyclical line drawing tasks at different frequencies, amplitudes, and orientations in the horizontal plane. Three main modes of control were identified: elbow-centered, shoulder-centered, and elbow-shoulder, each referring to the principal joints or joint combinations that were used to achieve the behavioral goals. The contribution of the shoulder joint was most prominent across the majority of movement orientations and largely paralleled changes in the dynamic (inertial) forces in the end effector (shoulder-centered control). The two joints either exchanged roles during the performance of the right diagonal movement (elbow-centered control) or shifted from a single-joint strategy to a dual-joint strategy during the performance of large amplitudes with low or medium cycling frequencies (shoulder-elbow control). These behavioral results support the existence of a modular control mode that allows the central nervous system to effectively tune motor commands to meet a broad variety of orientations, amplitudes, and frequencies. This refers to the emergence of a context-dependent control mode for the shoulder and elbow that optimizes the implementation of the underlying motor goals under a rich combination of spatial and temporal manipulations.     

Spatial phase differences can drive apparent motion

Can shape differences drive apparent motion? Results from previous research are equivocal. Much of the confusion may be due to the use of relatively complex stimuli: letters or geometric shapes, comprising many spatial frequencies, phases, orientations, and contrasts. We focus on relatively simple stimuli: Gaussian dampedf+nf compound sinewave gratings. We examine whether relative phase differences, which are critical for shape perception, can drive apparent motion. We find that some, but not all, phase differences can drive apparent motion. Specifically, stimuli that are easily discriminable and perceptually dissimilar can affect the solution of the correspondence problem. In this case, observers consistently perceive stimuli in one frame moving to the position of perceptually similar stimuli in the next frame. This general result holds over a wide range of spatial frequencies, orientations, and contrasts. Implications for theories of motion processing are discussed.     

Adaptive filtering in spatial vision: evidence from feature marking in plaids

Much evidence shows that early vision employs an array of spatial filters tuned for different spatial frequencies and orientations. We suggest that for moderately low spatial frequencies these preliminary filters are not treated independently, but are used to perform grouping and segmentation in the patchwise Fourier domain. For example, consider a stationary plaid made from two superimposed sinusoidal gratings of the same contrast and spatial frequency oriented +/- 45 degrees from vertical. Most of the energy in a wavelet-like (e.g. simple-cell) transform of this stimulus is in the oblique orientations, but typically it looks like a compound structure containing blurred vertical and horizontal edges. This checkerboard structure corresponds with the locations of zero crossings in the output of an isotropic (circular) filter, synthesised from the linear sum of a set of oriented basis-filters (Georgeson, 1992 Proceedings of the Royal Society of London, Series B 249 235-245). However, the addition of a third harmonic in square-wave phase causes almost complete perceptual segmentation of the plaid into two overlapping oblique gratings. Here we confirm this result psychophysically using a feature-marking technique, and argue that this perceptual segmentation cannot be understood in terms of the zero crossings marked in the output of any static linear filter that is sensitive to all of the plaid's components. If it is assumed that zero crossings or similar are an appropriate feature-primitive in human vision, our results require a flexible process that combines and segments early basis-filters according to prevailing image conditions. Thus, we suggest that combination and segmentation of spatial filters in the patchwise Fourier domain underpins the perceptual segmentation observed in our experiments. Under this kind of image-processing scheme, registration across spatial scales occurs at the level of spatial filters, before features are extracted. This contrasts with many previous schemes where feature correspondence is required between spatial edge-maps at different spatial scales.     

Recovery from adaptation as a function of stimulus orientation

These experiments examined the oblique effect in an adaptation paradigm. Reaction times (RT) to the presence of a grating test stimulus were obtained following adaptation to either a blank field or a grating of the same orientation as the test stimulus. Horizontal, vertical, and oblique test and adaptation orientations were employed. Test gratings were presented at several interstimulus intervals following offset of the adaptation stimulus. RTs following grating adaptation were elevated to a greater extent (relative to blank adaptation) for oblique then for horizontal or vertical stimuli, for two grating spatial frequencies. Differences in RT can be related to differences in sensitivity among channels responsible for detection of the various orientations.

     

Spatial frequency requirements for audiovisual speech perception

Spatial frequency band-pass and low-pass filtered images of a talker were used in an audiovisual speech-in-noise task. Three experiments tested subjects' use of information contained in the different filter bands with center frequencies ranging from 2.7 to 44.1 cycles/face (c/face). Experiment 1 demonstrated that information from a broad range of spatial frequencies enhanced auditory intelligibility. The frequency bands differed in the degree of enhancement, with a peak being observed in a mid-range band (11-c/face center frequency). Experiment 2 showed that this pattern was not influenced by viewing distance and, thus, that the results are best interpreted in object spatial frequency, rather than in retinal coordinates. Experiment 3 showed that low-pass filtered images could produce a performance equivalent to that produced by unfiltered images. These experiments are consistent with the hypothesis that high spatial resolution information is not necessary for audiovisual speech perception and that a limited range of spatial frequency spectrum is sufficient.     

Social Anxiety and Anger Identification: Bubbles Reveal Differential Use of Facial Information With Low Spatial Frequencies

ABSTRACT— We investigated the facial information that socially anxious and nonanxious individuals utilize to judge emotions. Using a reversed-correlation technique, we presented participants with face images that were masked with random bubble patterns. These patterns determined which parts of the face were visible in specific spatial-frequency bands. This masking allowed us to establish which locations and spatial frequencies were helping participants to successfully discriminate angry faces from neutral ones. Although socially anxious individuals performed as well as nonanxious individuals on the emotion-discrimination task, they did not utilize the same facial information for the task. The fine details (high spatial frequencies) around the eyes were discriminative for both groups, but only socially anxious participants additionally processed rough configural information (low spatial frequencies).     

Differential reinforcement and stimulus control of not responding

Pigeons were trained to respond with equal variable-interval reinforcement in the presence of a white key and also a white key with a vertical line. They were then trained not to respond to the vertical line by extinguishing the response or by reinforcing its non-occurrence at various frequencies. During training, the rate of key-pecking in the presence of the white key, maintained by a constant variable-interval schedule of reinforcement, depended on the frequency of reinforcement in the presence of the line. When lines of different orientations were presented in a generalization test, birds trained with extinction responded more to other orientations than to the vertical line, whereas those trained with high frequencies of reinforcement for not responding tended to respond equally at all line orientations. Intermediate frequencies of reinforcement gave mixed results.     

The effect of spatial-frequency filtering on the visual processing of global structure

In three experiments we measured reaction times (RTs) and error rates in identifying the global structure of spatially filtered stimuli whose spatial-frequency content was selected by means of three types of 2-D isotropic filters (Butterworth of order 2, Butterworth of order 10, and a filters with total or partial Gaussian spectral profile). In each experiment, low-pass (LP), bandpass (BP), and high-pass (HP) filtered stimuli, with nine centre or cut-off spatial frequencies, were used. Irrespective of the type of filter, the experimental results showed that: (a) RTs to stimuli with low spatial frequencies were shorter than those to stimuli with medium or high spatial frequencies, (b) RTs to LP filtered stimuli were nearly constant, but they increased in a nonmonotonic way with the filter centre spatial frequency in BP filtered stimuli and with the filter cut-off frequency in HP filtered stimuli, and (c) the identification of the global pattern occurred with all visible stimuli used, including BP and HP images without low spatial frequencies. To remove the possible influence of the energy, a fourth experiment was conducted with Gaussian filtered stimuli of equal contrast power (c(rms) = 0.065). Similar results to those described above were found for stimuli with spatial-frequency content higher than 2 cycles deg(-1). A model of isotropic first-order visual channels collecting the stimulus spectral energy in all orientations explains the RT data. A subsequent second-order nonlinear amplitude demodulation process, applied to the output of the most energetic first-order channel, could explain the perception of global structure of each spatially filtered stimulus, including images lacking low spatial frequencies.     

Valuable orientations capture attention

Visual attention has long been known to be drawn to stimuli that are physically salient or congruent with task-specific goals. Several recent studies have shown that attention is also captured by stimuli that are neither salient nor task relevant, but that are rendered in a colour that has previously been associated with reward. We investigated whether another feature dimension—orientation—can be associated with reward via learning and thereby elicit value-driven attentional capture. In a training phase, participants received a monetary reward for identifying the colour of Gabor patches exhibiting one of two target orientations. A subsequent test phase in which no reward was delivered required participants to search for Gabor patches exhibiting one of two spatial frequencies (orientation was now irrelevant to the task). Previously rewarded orientations robustly captured attention. We conclude that reward learning can imbue features other than colour—in this case, specific orientations—with persistent value.     

Monkeys show an oblique effect.

Monkeys aligned a cursor bar with high-contrast square-wave gratings presented in a variety of orientations. Alignment time increased with increasing spatial frequency from 6 to 24 cycles deg-1 regardless of the orientation of the grating. At higher spatial frequencies, alignment tasks took longer for obliquely oriented gratings than for horizontal and vertical ones. Reducing grating contrast by blurring the image of the 24 cycle deg-1 grating also produced longer alignment times for the obliques. These data indicate that monkeys have an oblique effect similar to that found in humans, implying that the monkey is a useful animal model for investigating the development of meridional anisotropies.     

Differential effects of stimulus context in sensory processing

Stimulus contexts in which different intensity levels are presented to two sensory–perceptual channels can produce differential effects on perception: Perceived magnitudes are depressed in whichever channel received the stronger stimuli. Context differentially can affect loudness at different sound frequencies or perceived length of lines in different spatial orientations. Reported in hearing, vision, haptic touch, taste, and olfaction, differential context effects (DCEs) are a general property of perceptual processing. Characterizing their functional properties and determining their underlying mechanisms are essential both to fully understanding sensory and perceptual processes and to properly interpreting sensory measurements obtained in applied as well as basic research settings.     

Variations in apparent spatial frequency with stimulus orientation: IL Matching data collected under normal and interferometric viewing conditions

Using an adjustment procedure, human observers matched the apparent spatial frequencies of sinusoidal gratings presented in different orientations (0, 45, 90, and 135 deg). Matches were made between all possible pairwise orientation combinations. Significant match deviations indicated that the apparent frequency of a grating depends on its orientation. The most consistent deviations were found between horizontal and vertical gratings, with horizontal gratings appearing to be of a lower spatial frequency than vertical gratings. These effects were relatively independent of stimulus contrast and persisted when the optics of the eye were bypassed with laser interferometry. A neurophysiological explanation of these effects is proposed.     

The linkage between stimulus frequency and covert peak areas as it relates to monaural localization.

Head-related transfer functions for differently centered narrow noise bands were obtained on 6 subjects. Derived from these measurements were covert peak areas (CPAs), defined as the spatial constellation of loudspeakers that generates maximal sound pressure at the entrance of the ear canal for specific bands of frequency. On the basis of previous data, we proposed that different frequency bands served as important spectral cues for monaural localization of sounds from different loci and that location judgments were directed toward the CPAs associated with the different bands. In the first study, the stimuli were bandpass filtered so that they contained only those frequencies whose associated CPAs occupied either the monaural listener's "upper" or "lower" spatial regions. Loudspeakers, separated by 15 degrees, were stationed in the left hemifield, ranging from 0 degree to 180 degrees azimuth and -45 degrees to 60 degrees elevation. Subjects reported the loudspeaker from which the sound appeared to originate. Judgments of the sound's elevation were in general accord with the CPAs associated with the different frequency segments. In the second study, monaural localization tests were administered in which different 2.0-kHz-wide frequency bands linked with specific CPAs were notch filtered from a 3.5-kHz highpass noise band. For the control condition, the highpass noise was unfiltered. The data demonstrated that filtering a frequency segment linked with specific CPAs resulted in significantly fewer location responses directed toward that particular spatial region. These results demonstrate in greater detail the relation between the directional filtering properties of the pinna and monaural localization of sound.     

The linkage between stimulus frequency and covert peak areas as it relates to monaural localization

Head-related transfer functions for differently centered narrow noise bands were obtained on 6 subjects. Derived from these measurements were covert peak areas (CPAs), defined as the spatial constellation of loudspeakers that generates maximal sound pressure at the entrance of the ear canal for specific bands of frequency. On the basis of previous data, we proposed that different frequency bands served as important spectral cues for monaural localization of sounds from different loci and that location judgments were directed toward the CPAs associated with the different bands. In the first study, the stimuli were bandpass filtered so that they contained only those frequencies whose associated CPAs occupied either the monaural listener’s “upper” or “lower” spatial regions. Loudspeakers, separated by 15°, were stationed in the left hemifield, ranging from 0° to 180° azimuth and ?45° to 60° elevation. Subjects reported the loudspeaker from which the sound appeared to originate. Judgments of the sound’s elevation were in general accord with the CPAs associated with the different frequency segments. In the second study, monaural localization tests were administered in which different 2.0-kHz-wide frequency bands linked with specific CPAs were notch filtered from a 3.5-kHz highpass noise band. For the control condition, the highpass noise was unfiltered. The data demonstrated that filtering a frequency segment linked with specific CPAs resulted in significantly fewer location responses directed toward that particular spatial region. These results demonstrate in greater detail the relation between the directional filtering properties of the pinna and monaural localization of sound.