Duration perception in crossmodally-defined intervals

How humans perform duration judgments with multisensory stimuli is an ongoing debate. Here, we investigated how sub-second duration judgments are achieved by asking participants to compare the duration of a continuous sound to the duration of an empty interval in which onset and offset were marked by signals of different modalities using all combinations of visual, auditory and tactile stimuli. The pattern of perceived durations across five stimulus durations (ranging from 100 ms to 900 ms) follows the Vierordt Law. Furthermore, intervals with a sound as onset (audio-visual, audio-tactile) are perceived longer than intervals with a sound as offset. No modality ordering effect is found for visualtactile intervals. To infer whether a single modality-independent or multiple modality-dependent time-keeping mechanisms exist we tested whether perceived duration follows a summative or a multiplicative distortion pattern by fitting a model to all modality combinations and durations. The results confirm that perceived duration depends on sensory latency (summative distortion). Instead, we did not find evidence for multiplicative distortions. The results of the model and the behavioural data support the concept of a single time-keeping mechanism that allows for judgments of durations marked by multisensory stimuli.     

STUDIES IN VISUAL PERCEPTION OF ARCHITECTURAL SPACES AND ROOMS: II. Judgments of open and closed space by category rating and magnitude estimation

G ärling , T. Studies in visual perception of architectural spaces and rooms. II. Judgments of open and closed space by category rating and magnitude estimation. Scand. J. Psychol ., 1969, 10 , 257–268.—In one experiment, colour photographs of architectural spaces were employed as stimuli and judged with respect to open and closed space. Category scales of open and closed were complementary, magnitude scales were reciprocal. Judged open space correlated positively and judged closed space negatively with physical size of actual spaces. In another experiment, judged size was found to be directly related to judged open space and inversely related to judged closed space. Furthermore, open and closed space judged in situ correlated to a significant degree with corresponding judgments from photographs.     

Effects of variation in the warning signal on reaction times of severe subnormals

Reaction times of normal and subnormal subjects were compared, when a warning stimulus varied in modality as well as in its temporal relation to the RT signal. When the warning stimulus was in a different modality from the RT signal, reaction times were shorter than when both were in the same modality. Mongols, in contrast to the other subjects, responded relatively faster to light than to sound.

The effect of varying the time interval between warning and signal was linearly related to response speed. The results are discussed in respect to the comparative alerting effects of temporal relations between stimuli and their different modalities.     

Response bias in category and magnitude estimation of difference and similarity for loudness and pitch

Interval scales of sensory magnitude were derived from magnitude and category estimates of loudness differences, loudness similarities, pitch differences, and pitch similarities. In each of the four loudness experiments, a loudness scale was constructed from a nonmetric analysis of the rank order of the judgments. The four loudness scales so constructed were found to be equivalent to one another and indicated that loudness was a power function of sound pressure with an exponent of .29. A similar analysis for the four pitch experiments found the pitch scales derived in each case to be equivalent to one another and linear with the mel scale of pitch. Thus the same sensory and similarities for two distinct perceptual continua. For both pitch and loudness, these sensory scales were used to generate scales of sensory differences. A comparison of the category and magnitude estimates of sensory differences with the scale of sensory differences derived from the nonmetric analyses indicated the presence of significant response biases in both category and magnitude estimation procedures.     

Multidimensional similarity: an experimental and theoretical comparison of vector,distance, and set theoretical models : I. Models and internal consistency of data

In an experiment (conducted by the senior author) subjects were instructed to give three kinds of quantitative judgment on pairs of simple geometrical stimuli: similarity, commonality ratio and magnitude ratio. It was assumed that the different kinds of judgments could be interpreted in terms of one cognitive structure, and that formal models for each of these judgments should be validated by predicting one kind of judgment from knowledge of another kind of judgment. The present report proposes two different, though related, systems of formal models for similarity, commonality and magnitude ratio judgments. One, called E-model, interprets the judgments in terms of set- and vector-representations, and connections between them; the other, called R-model, interprets the judgments in terms of set- and distance-representations and their connections. The results are slightly in favor of the E-model. In a subsequent paper, the authors will report the results of multidimensional analyses for the same data, which slightly favor the R-model.     

THE PROBLEM OF MAGNITUDE AND CATEGORY SCALES: INTERPRETATION OF RESULTS

J unge , K. The problem of magnitude and category scales: interpretation of results. Scand. J. Psychol ., 1962, 3 , 215–218.—It is proposed that three main factors are responsible for the relation between magnitude and category scales: (1) ratio judgments on a transformed category scale, (2) interval judgments, and (3) hybrid judgments. The last term refers to the tentative explanation that magnitude judgments are a cross between pure ratio and interval judgments.     

Tactile "capture" of audition

Previous research has demonstrated that the localization of auditory or tactile stimuli can be biased by the simultaneous presentation of a visual stimulus from a different spatial position. We investigated whether auditory localization judgments could also be affected by the presentation of spatially displaced tactile stimuli, using a procedure designed to reveal perceptual interactions across modalities. Participants made left-right discrimination responses regarding the perceived location of sounds, which were presented either in isolation or together with tactile stimulation to the fingertips. The results demonstrate that the apparent location of a sound can be biased toward tactile stimulation when it is synchronous, but not when it is asynchronous, with the auditory event. Directing attention to the tactile modality did not increase the bias of sound localization toward synchronous tactile stimulation. These results provide the first demonstration of the tactile capture of audition.     

Tactile “capture” of audition

Previous research has demonstrated that the localization of auditory or tactile stimuli can be biased by the simultaneous presentation of a visual stimulus from a different spatial position. We investigated whether auditory localization judgments could also be affected by the presentation of spatially displaced tactile stimuli, using a procedure designed to reveal perceptual interactions across modalities. Participants made left—right discrimination responses regarding the perceived location of sounds, which were presented either in isolation or together with tactile stimulation to the fingertips. The results demonstrate that the apparent location of a sound can be biased toward tactile stimulation when it is synchronous, but not when it is asynchronous, with the auditory event. Directing attention to the tactile modality did not increase the bias of sound localization toward synchronous tactile stimulation. These results provide the first demonstration of the tactilecapture of audition.     

Optimistic bias and pessimistic realism in judgments of contingency with aversive or rewarding outcomes

A depressive personality influences judgments of contingency. This is called "depressive realism." The present experiment examined whether optimistic traits, as measured by various scales, are correlated with judgments of contingency. The valences of the target stimuli were aversive or rewarding (noise avoidance or gaining points). Analysis indicated that the optimistic subjects (as measured by explanatory style for negative events) tend to overestimate noncontingent events; however, optimism measured by other scales did not show such an effect. The findings are discussed in terms of a self-defensive attributional bias.     

The additivity of loudness across critical bands: A conjoint measurement approach

Five subjects were required in each trial to compare directly two sounds and to indicate which sound was louder. Each of the 64 sounds employed consisted of a combination of one of eight intensity levels of a 2-kHz tone and one of eight intensities of a 5-kHz tone. If, as Fletcher and Munson (1933) argued, loudness is additive for tone combinations in which the frequencies are widely separated, then subjects’ judgments should reflect the summed loudnesses of the 2- and 5-kHz tones in a two-tone combination. Judgments of individual subjects were shown to satisfy the conditions for an additive structure, and individual loudness scales were constructed. These loudness scales varied from subject to subject. Since this paired comparison procedure minimized response biases, the results suggest substantial individual differences in the sensory representation of sound intensity. The relations among sensory scales derived from other structured sensory judgments, such as binaural loudness, are discussed.     

Large,colorful, or noisy? Attribute- and modality-specific activations during retrieval of perceptual attribute knowledge

Position emission tomography was used to investigate whether retrieval of perceptual knowledge from long-term memory activates unique cortical regions associated with the modality and/or attribute type retrieved. Knowledge about the typical color, size, and sound of common objects and animals was probed, in response to written words naming the objects. Relative to a nonsemantic control task, all the attribute judgments activated similar left temporal and frontal regions. Visual (color, size) knowledge selectively activated the right posterior inferior temporal (PIT) cortex, whereas sound judgments elicited selective activation in the left posterior superior temporal gyrus and the adjacent parietal cortex. All of the attribute judgments activated a left PIT region, but color retrieval generated more activation in this area. Size judgments activated the right medial parietal cortex. These results indicate that the retrieval of perceptual semantic information activates not only a general semantic network, but also cortical areas specialized for the modality and attribute type of the knowledge retrieved.     

Stimulus range,number of categories,and the “virtual” exponent

Three different stimulus modalities (line length, number, and sound pressure) were judged by magnitude scaling techniques and by 7-, 15-, 31-, and 75-point category scales. All of the 40 subjects were given the same number stimuli, but two different sound-pressure ranges were presented (each to 20 subjects) and four different line-length ranges were presented (each to 10 subjects). Analyses of lack of fit for various simple functions were performed to determine bestfitting functions. The simple power function was often found to be an adequate fit to the data for all the response modalities used, although all of the response modalities were sensitive to changes in stimulus range. For simple power functions, the category-scale exponent was a function of both the range of stimuli and the number of categories provided. Category scales did not always produce exponents smaller than those obtained with magnitude estimation, which calls into question the concept of a virtual exponent for category scales.     

Incongruence in number–luminance congruency effects

Congruency tasks have provided support for an amodal magnitude system for magnitudes that have a "spatial" character, but conflicting results have been obtained for magnitudes that do not (e.g., luminance). In this study, we extricated the factors that underlie these number-luminance congruency effects and tested alternative explanations: (unsigned) luminance contrast and saliency. When luminance had to be compared under specific task conditions, we revealed, for the first time, a true influence of number on luminance judgments: Darker stimuli were consistently associated with numerically larger stimuli. However, when number had to be compared, luminance contrast, not luminance, influenced number judgments. Apparently, associations exist between number and luminance, as well as luminance contrast, of which the latter is probably stronger. Therefore, similar tasks, comprising exactly the same stimuli, can lead to distinct interference effects.     

Mental size scaling examined

Observers made same-different shape judgments of stimuli that were identical in shape and size different in shape but not in size, or differed in relative size along a number of steps for both same- and different- shaped forms. "Same" judgment RTs increased monotonically with increases in the magnitude of the relative size difference. In contrast, "different" judgment RTs were unaffected by changes in relative size. A second experiment in which stimulus presentation was successive rather than simultaneous yielded essentially the same results. Consideration was given to a dual- process model in which a time-consuming analog process normalizes stimuli that are size discrepant prior to a comparison stage that is operative for those structures responsible for "same" decisions but not for "different" judgments. Some evidence that seems inconsistent with a normalization process which operates prior to contact with memory was discussed, and an alternative explanation in which the early detection of a size difference causes changes in decision criteria was suggested.     

The "euphoria" effect of music videos--a study of the reception of music with visual images

An attempt is made to study the impact of visual information on the perception of music by employing (rock) music videos as stimuli. Forty music videos were presented to judges, who either saw the video or only heard the respective pieces of music. They had to judge the emotions conveyed via the piece of music/video on scales and their overall impression on semantic differential scales. Results indicate that visual information as presented in music videos has considerable effects on impressions: When pieces of music are presented as music videos, more positive emotions are attributed, while presentation of the pieces of music alone resulted in more negative emotion attributions. Thus, music videos seem to "euphorize" the recipient. Furthermore, video presentation compared to presentation of music alone evoked more intense "complexity/interest" as well as "activity" judgments, while "evaluation" judgments were not influenced by the medium of presentation. In addition, a number of presentation factors (like the speed of the music or the number of cuts in the videos) do influence impressions. This leads to the conclusion that researchers should pay more attention to such microcharacteristics of stimuli. In general, the effects found to be due to the medium of presentation are independent of the effects on judgments due to content (i.e., presentation factors).     

Subjective ratios and differences in perceived heaviness

In previous studies, judgments of ratios and differences in subjective magnitude have yielded similar orders, consistent with a hypothesis that a single perceived relation underlies both judgment tasks. In the present research, 15 subjects estimated heaviness differences between 28 pairs of eight weights and each of 8 groups of 10 subjects evaluated heaviness ratios of eight variable stimuli with respect to a different standard stimulus. Presenting stimuli that were equally spaced on a cube-root scale of weight enhanced expected ordinal discrepancies between ratio and difference estimates, and employing independent groups for each standard stimulus in ratio estimation eliminated a possible bias due to varying standards within the presentation sequence. Differences in orders of ratio and difference estimates together with differences in scales obtained from non-metric analyses in terms of a difference model indicated that the judgments were based on two perceived relations that are ordinally consistent with arithmetic operations of ratios and differences. A ratio scale of heaviness was derived from the combined orders of subjective ratios and differences.     

Informational and neural adaptation curves are asynchronous.

Norwich's entropy theory of perception (plus a few additional assumptions) suggests the existence of an "infromational adaptation curves" (change in stimulus equivocation with stimulus duration) for suprathreshold prothetic stimuli that is synchronous with the "neural adaptation curve" (change in firing rate with stimulus duration) observed for sensory neurons. Five experiments are reported in which informational adaptation curves were measured for auditory and visual stimuli by having subjects make absolute identifications of suprathreshold sound or light intenstiies of various durations. Information transmissions for the shortest duration stimuli (1 and 5 msec, respectively, for light and sound) were surprisingly large (small equivocations), indicating that intensity information is acquired very rapidly by the whole organism. The equations of entropy theory were fitted to adaptation data for peripheral sensory neurons (spiral ganglion cells and retinal ganglion cells) and were compared to the informational adaptation curves. It was found that informational adaptation occurred more rapidly than neural adaptation. That is, the two types of adaptation process are asynchronous. However, for both audition and vision, the total amount of information mediated by the adaptation process (channel capacity) was about the same for both types of processes (2.03 bits vs. 2.1 bits per stimulus for sound intensity; 1.3 vs. 2.0 bits per stimulus for light intensity). Faster acquisition could be accomplished in the whole organism through convergent neural circuits that increase sampling rate by pooling the samples taken by individual receptor systems.     

Involuntary listening aids seeing: evidence from human electrophysiology

It is well known that sensory events of one modality can influence judgments of sensory events in other modalities. For example, people respond more quickly to a target appearing at the location of a previous cue than to a target appearing at another location, even when the two stimuli are from different modalities. Such cross-modal interactions suggest that involuntary spatial attention mechanisms are not entirely modality-specific. In the present study, event-related brain potentials (ERPs) were recorded to elucidate the neural basis and timing of involuntary, cross-modal spatial attention effects. We found that orienting spatial attention to an irrelevant sound modulates the ERP to a subsequent visual target over modality-specific, extrastriate visual cortex, but only after the initial stages of sensory processing are completed. These findings are consistent with the proposal that involuntary spatial attention orienting to auditory and visual stimuli involves shared, or at least linked, brain mechanisms.     

The use of an unpleasant sound as the unconditional stimulus in aversive Pavlovian conditioning experiments that involve children and adolescent participants

Ethical considerations can prohibit the use of traditional unconditional stimuli (USs), such as electric shocks or loud tones, when children or adolescents participate in aversive Pavlovian conditioning experiments. The present study evaluated whether an unpleasant sound provides a viable alternative. Fifteen boys and girls aged 13 to 17 years completed a differential Pavlovian conditioning procedure in which a conditional stimulus (CS) was followed by the sound of metal scraping on slate. Acquisition of conditioned responses was found in startle blink magnitude, expectancy judgments of the sound, and skin conductance responses. Extinction of conditioned responses was found in all measures when the CS was no longer followed by the unpleasant sound. Subjective ratings and skin conductance responses indicated that the sound was unpleasant because of its qualitative features, rather than its intensity. The results support the use of an unpleasant sound as a low-risk alternative to traditional USs in aversive Pavlovian conditioning experiments with children and adolescents.