On cross-modal similarity: the perceptual structure of pitch, loudness, and brightness

Examined how pitch and loudness correspond to brightness. In the Experiment 1, 16 Ss identified which of 2 lights more resembled each of 16 tones; in Experiment 2, 8 of the same 16 Ss rated the similarity of lights to lights, tones to tones, and lights to tones. (1) Pitch and loudness both contributed to cross-modal similarity, but for most Ss pitch contributed more. (2) Individuals differed as to whether pitch or loudness contributed more; these differences were consistent across matching and similarity scaling. (3) Cross-modal similarity depended largely on relative stimulus values. (4) Multidimensional scaling revealed 2 perceptual dimensions, loudness and pitch, with brightness common to both. A simple quantitative model can describe the cross-modal comparisons, compatible with the view that perceptual similarity may be characterized through a malleable spatial representation that is multimodal as well as multidimensional.     

Synesthetic perception and poetic metaphor

To explore the role of cross-modal perception in the apprehension of synesthetic metaphors, subjects read 15 short lines from poetry, each of which contained a metaphor relating visual and auditory qualities; the subjects' task was to set the loudness of a 1000-Hz tone and the brightness of a white light to match the levels implied by each metaphor. The sound settings and light settings suggest that a cross-modal equivalence between loudness and brightness largely underlay the responses to the metaphors. This general cross-modal equivalence was characterized by some notable intersubject differences and was modified, in part, by certain metaphors that resisted complete equivalence. Even so, the metaphorically induced settings of loudness and brightness are mainly governed by a cross-modality matching function that is qualitatively like the relation found in people with visual-auditory synesthesia, and that is quantitatively like the function obtained in more traditional psychophysical studies.     

Brightness and loudness as functions of stimulus duration

The brightness of white light and the loudness of white noise were measured by magnitude estimation for sets of stimuli that varied in intensity and duration. Brightness and loudness both grow as power functions of duration up to a critical duration, beyond which apparent magnitude is essentially independent of duration. For brightness, the critical duration decreases with increasing intensity, but for loudness the critical duration is nearly constant at about 150 msec. Loudness and brightness also grow as power functions of intensity. The loudness exponent is the same for all durations, but the brightness exponent is about half again as large for short durations as for long. The psychophysical power functions were used to generate equal-loudness and equal-brightness functions, which specify the combinations of intensity E and duration T that produce the same apparent magnitude. Below the critical duration ET equals k for equal brightness, and ET^a equa Is k for equal loudness. The value a is about 0.7 for threshold and about 1.25 for supraliminal loudness.     

Brightness and loudness as functions of stimulus duration

The brightness of white light and the loudness of white noise were measured by magnitude estimation for sets of stimuli that varied in intensity and duration. Brightness and loudness both grow as power functions of duration up to a critical duration, beyond which apparent magnitude is essentially independent of duration. For brightness, the critical duration decreases with increasing intensity, but for loudness the critical duration is nearly constant at about 150 msec. Loudness and brightness also grow as power functions of intensity. The loudness exponent is the same for all durations, but the brightness exponent is about half again as large for short durations as for long. The psychophysical power functions were used to generate equal-loudness and equal-brightness functions, which specify the combinations of intensity E and duration T that produce the same apparent magnitude. Below the critical duration ET equals k for equal brightness, and ET^a equals k for equal loudness. The value a is about 0.7 for threshold and about 1.25 for supraliminal loudness.     

Bright sneezes and dark coughs, loud sunlight and soft moonlight

Synesthetic metaphors (such as "the dawn comes up like thunder") are expressions in which words or phrases describing experiences proper to one sense modality transfer their meanings to another modality. In a series of four experiments, subjects used scales of loudness, pitch, and brightness to evaluate the meanings of a variety of synesthetic (auditory-visual) metaphors. Loudness and pitch expressed themselves metaphorically as greater brightness; in turn, brightness expressed itself as greater loudness and as higher pitch. Although loudness thus shared with brightness a metaphorical connection, pitch and brightness showed a connection that was closer and that applied more generally to different kinds of visual brightness. The ways that people evaluate synesthetic metaphors emulate the characteristics of synesthetic perception, thereby suggesting that synesthesia in perception and synesthesia in language both may emenate from the same source-from a phenomenological similarity in the makeup of sensory experiences of different modalities.     

Comparison of magnitude estimation of loudness in children and adults

This study compared children (mean age 10.9 years) and college students on the magnitude estimation of loudness. Both the 20 children and the 20 adults were unpracticed observers. In one condition, the standard tone was assigned the number 10, and in the other condition, the number 20. Under both conditions the power function was found to fit the data of the children quite well, and to give approximately the same exponent. Of particular interest was the similarity between the data of the children and adults.     

Conservatism of Israeli junior high school students: interethnic differences

The aims of the study were (a) to establish the factor structure characterizing Israeli junior high school students of Western and Oriental ethnic origin on the Children's Scale of Social Attitudes, (b) to compare the Israeli factor structure with those for school children from other societies, and (c) to examine whether the Israeli school children's factor structure resembled those for Israeli adults as well as for adults from other societies. Analysis indicated that Israeli junior high school children from both Western and Oriental ethnic groups were characterized by similar factors of general conservatism, namely, Religion, Antihedonism, and Punitiveness, although the Orientals were more conservative on these factors than the Westerners. In addition, the present factor structure resembled those for groups of school children as well as adults from other societies, reconfirming that factors of general conservatism have cross-cultural validity.     

Children's scales of length and loudness: A developmental application of cross-modal matching

The cross-modal matching techniques that have produced scales of sensory magnitude for a variety of perceptual continua in adults were used to construct similar scales in children. Subjects were adults and children 4, 6, 8, and 12 years old. Their task was, first, to match the loudness of a 1000-Hz tone to various visual lengths, and, second, to match the length of a white tape to various loudnesses of the tone. Almost all subjects were able to perform the matching tasks; the average precision of older subjects (12 and Adult) was somewhat greater, but in each of the younger age groups a majority of subjects performed with a precision that equaled that of older subjects. The exponent of the power function that relates length and loudness does not change with age. The scale factor does change, in a way that suggests either that a given sound intensity seems softer, or, more probable, that a given length seems longer, to younger children. The success of cross-modal matching with subjects as young as 4 years means that it is possible to investigate not only single perceptual scales but also intermodal organization in young children.     

Individual brightness functions

A total of 34 individual brightness functions were measured for 18 observers by two different methods. In one method the observer set various luminance levels of a white target and assigned numbers proportional to the apparent brightness of the levels set. In the other method the observer adjusted the loudness of a white noise and the luminance of a white target in order to achieve a series of cross-modality matches between loudness and brightness. Both methods gave good approximations to power functions, showing that the psychophysical power law holds for the individual perceiver.     

Brighter noise: Sensory enhancement of perceived loudness by concurrent visual stimulation

Two experiments investigated the effect of concurrently presented light on the perceived loudness of a low-level burst of white noise. The results suggest two points. First, white noise presented with light tends to be rated as louder than noise presented alone. Second, the enhancement in loudness judgments is resistant to two experimental manipulations: varying the probability that light accompanies sound and shifting from a rating method to a forced choice comparison. Both manipulations were previously shown to eliminate a complementary noise-induced enhancement in ratings of brightness. Whereas noise-induced enhancement of brightness seems to reflect a late-stage decisional process, such as a response bias, the present results suggest that light-induced enhancement of loudness may reflect an early-stage sensory interaction.     

Context effects,reliability, and internal consistency of intermodal joint scaling

Context effects, intraindividual variability, and internal consistency of intermodal joint scaling with magnitude estimation (“magnitude matching”) were studied by instructing 12 subjects to judge the three pairs of odor intensity, loudness, and brightness on a common scale of perceived intensity as well as to judge odor intensity separately (unimodal magnitude estimation). Significant context effects were found by comparing odor intensity judgments obtained by separate versus intermodal joint scaling as well as across different modalities (loudness vs. brightness) in joint scaling. But no such effects were found for loudness or brightness when compared across modality of joint scaling. Intraindividual variability in the estimates imply about equal reliability in intermodal joint scaling and separate scaling. Good internal consistency was found, indicating that subjects are successful in expressing perceived intensities of different modalities on a common scale.     

Cross-modality matching functions generated by magnitude estimation

It is possible to generate cross-modality matching functions by having subjects make magnitude estimates of sets of stimuli appropriate to different modalities. The sets are interspersed among each other in the same test session and judged on a common absolute scale of sensory magnitude. An appropriate statistical device locates stimulus levels that appear, on the average, to match. The method is fast, efficient, circumvents the need for continuous stimulus adjustment, and holds promise for the study of the individual as well as the average psychophysical function. To illustrate its potential uses, advantages, and limitations, we used the method to generate cross-modality matching functions relating loudness and brightness. Compared to the scales of loudness and brightness generated by the magnitude estimations of the same stimuli, the matching functions (1) conform better to power functions, (2) may show less variation in slope (exponent), and (3) show far less variation in absolute magnitude (position).     

Comparison of magnitude estimation and interval scaling of loudness

To identify whether equal-appearing interval or magnitude estimation scaling resulted in a data set with a closer correlation to the physical stimuli involved 20 young adults completing two tasks. In Task 1 subjects used a 7-point equal-appearing interval loudness of 18 10-sec. samples of babble speech, presented randomly at intensities of 5 to 90 dB SPL. In Task 2 subjects used magnitude estimation scaling to rate these stimuli, presented in a randomized order. Analysis showed significantly high correlations for both scaling methods and the stimuli (Spearman rho = 1.00 and .99, respectively). Subjects can use either form of scaling to rate changes in loudness.     

The shape of the vibrotactile loudness function: The effect of stimulus repetition and skin-contactor coupling

In the psychophysical literature describing the relationships between physical and psychological magnitudes, as physical intensity increases, perceived intensity often grows much faster near threshold than at higher levels. In this laboratory, however, the loudness curve for sinusoidal vibrotactile stimuli was best fit by a single-limbed function rather than by the expected two-limbed function. In the present study, we measured the growth of vibrotactile loudness of 250-Hz sinusoidal stimuli by the method of absolute magnitude estimation to explore the source of the one- versus two-limbed discrepancy. The number of times that the stimulus was presented was varied, as well as whether the stimulator contacted the skin with constant force or constant penetration. Neither of these manipulations affected the shape of the loudness function consistently. Number of repetitions influenced the shapes of the magnitude estimation functions, but only for a few individuals. Skin-contactor coupling did not affect the shapes of the functions, although the absolute level (vibrotactile loudness) was consistently greater for constant indentation.     

DEVELOPMENT OF BASIC AUDITORY DISCRIMINATION IN PRESCHOOL CHILDREN

Abstract— Intensity (loudness), frequency (pitch), and duration discrimination were examined in 41 normal-hearing children, aged 4 to 6 years, and 9 adults. A second study retested 25 of the youngest children 12 to 18 months later. Intensity discrimination showed the least improvement with age and was adultlike by age 5 for most of the children. In contrast, frequency and duration discrimination showed highly significant improvement with age, but remained poorer than adults' discrimination for many 6-year-olds. Large individual differences were observed within alt tasks and age groups.     

Continuous measurement of visible persistence

In the synchrony judgment paradigm, observers judge whether a click precedes or follows the onset of a light flash and, on other trials, whether or not a click precedes light termination. The interclick interval defines the duration of visible persistence. An elaboration of this method consists of two phases: In Phase 1, the luminance of a reference stimulus is psychophysically matched to the peak brightness of the test flash. Five luminance values between .1 and 1.0 of the reference stimulus are used subsequently. In Phase 2, a random one of the five reference stimuli, a test flash, and a click are presented; the observer judges whether the click occurred before or after the brightness of test flash reached the reference value (on onset trials) or decayed below it (on termination trials). This method was validated on 3 subjects with test stimuli whose luminance rises and decays slowly in time, and then was used to trace out the precise subjective rise and decay (temporal brightness response function) of brief flashes.     

Before you see it, you see its parts: evidence for feature encoding and integration in preschool children and adults

Preschool children and adults were compared in two experiments examining the basic issue of whether perceptual representations of objects are built-up from independent features along the dimensions of size and brightness. Experiment 1 was a visual search experiment. Subjects searched for targets which differed from distractors either by a single feature or by a conjunction of features. Results from preschoolers were comparable to those from adults, and were consistent with Treisman and Gelade's (1980, Cognitive Psychology, 12, 97-136) feature-integration theory of attention. Their theory states that independent features are encoded in parallel and are later combined with a spatial attention mechanism. However, children's significantly steeper conjunctive search slope indicated a slower speed of feature integration. In Experiment 2, four mathematical models of pattern recognition were tested against classification task data. The findings from both age groups were again consistent with a model assuming that size and brightness features are initially registered, and then integrated. Moreover, the data from Experiment 2 imply that perceptual growth entails small changes in the discriminability of featural representations; however, both experiments show that the operations performed on these representations are the same developmentally.     

4～5岁儿童对社会事件记忆的消极偏向

消极偏向是指相对于积极或中性的刺激,消极刺激能够获得更多的注意和认知加工。本研究采用故事法通过三个实验考察4~5岁儿童对社会事件的记忆是否存在消极偏向。实验一发现幼儿对威胁行为的回忆成绩显著优于对中性行为和助人行为的回忆成绩。实验二发现幼儿对悲伤事件的回忆成绩显著优于对中性和愉快事件的回忆成绩。实验三发现幼儿对威胁行为的前瞻记忆成绩显著优于中性和助人行为的前瞻记忆成绩。研究说明无论事件是威胁性的还是非威胁性的,无论是回溯记忆还是前瞻记忆,4~5岁儿童的记忆都表现出消极偏向。