Vocal fundamental and formant frequencies affect perceptions of speaker cooperativeness

In recent years, the perception of social traits in faces and voices has received much attention. Facial and vocal masculinity are linked to perceptions of trustworthiness; however, while feminine faces are generally considered to be trustworthy, vocal trustworthiness is associated with masculinized vocal features. Vocal traits such as pitch and formants have previously been associated with perceived social traits such as trustworthiness and dominance, but the link between these measurements and perceptions of cooperativeness have yet to be examined. In Experiment 1, cooperativeness ratings of male and female voices were examined against four vocal measurements: fundamental frequency (F₀), pitch variation (F₀?SD), formant dispersion (D_f), and formant position (P_f). Feminine pitch traits (F₀ and F₀?SD) and masculine formant traits (D_f and P_f) were associated with higher cooperativeness ratings. In Experiment 2, manipulated voices with feminized F₀ were found to be more cooperative than voices with masculinized F₀^, among both male and female speakers, confirming our results from Experiment 1. Feminine pitch qualities may indicate an individual who is friendly and non-threatening, while masculine formant qualities may reflect an individual that is socially dominant or prestigious, and the perception of these associated traits may influence the perceived cooperativeness of the speakers.     

On cross-modal similarity: auditory-visual interactions in speeded discrimination

A series of four experiments explored how cross-modal similarities between sensory attributes in vision and hearing reveal themselves in speeded, two-stimulus discrimination. When subjects responded differentially to stimuli on one modality, speed and accuracy of response were greater on trials accompanied by informationally irrelevant "matching" versus "mismatching" stimuli from the other modality. Cross-modal interactions appeared in (a) responses to dim/bright lights and to dark/light colors accompanied by low-pitched/high-pitched tones; (b) responses to low-pitched/high-pitched tones accompanied by dim/bright lights or by dark/light colors; (c) responses to dim/bright lights, but not to dark/light colors, accompanied by soft/loud sounds; and (d) responses to rounded/sharp forms accompanied by low-pitched/high-pitched tones. These results concur with findings on cross-modal perception, synesthesia, and synesthetic metaphor, which reveal similarities between pitch and brightness, pitch and lightness, loudness and brightness, and pitch and form. The cross-modal interactions in response speed and accuracy may take place at a sensory/perceptual level of processing or after sensory stimuli are encoded semantically.     

Response Facilitation and Inhibition in Manual,Vocal, and Oculomotor Performance: Evidence for a Modality-Unspecific Mechanism

In 2 experiments (N = 10, Experiment 1; N = 16, Experiment 2), the authors investigated whether evidence for response facilitation and subsequent inhibition elicited by masked prime stimuli can be observed for output modalities other than manual responding. Masked primes were followed by target stimuli that required a 2-choice manual, saccadic, or vocal response. Performance was measured for compatible trials in which primes and targets were identical and for incompatible trials in which they were mapped to opposite responses. When primes were presented centrally, performance benefits were obtained for incompatible trials; whereas for peripherally presented primes, performance benefits were found in compatible trials. That pattern of results was obtained for manual responses and for saccadic eye movements (Experiment 1), demonstrating that those effects are not mediated by specialized dorsal pathways involved in visuomanual control. An analogous pattern of effects was found when manual and vocal responses were compared (Experiment 2). Because vocal responding is controlled by the inferotemporal cortex, that result shows that prime-target compatibility effects are not primarily mediated by the dorsal stream, but appear to reflect modality-unspecific visuomotor links that allow rapid activation of motor responses that may later be subject to inhibition.     

Bad–good constraints on a polarity correspondence account for the spatial–numerical association of response codes (SNARC) and markedness association of response codes (MARC) effects

Performance in numerical classification tasks involving either parity or magnitude judgements is quicker when small numbers are mapped onto a left-sided response and large numbers onto a right-sided response than for the opposite mapping (i.e., the spatial–numerical association of response codes or SNARC effect). Recent research by Gevers et al. [Gevers, W., Santens, S., Dhooge, E., Chen, Q., Van den Bossche, L., Fias, W., & Verguts, T. (2010). Verbal-spatial and visuospatial coding of number–space interactions. Journal of Experimental Psychology: General, 139, 180–190] suggests that this effect also arises for vocal “left” and “right” responding, indicating that verbal–spatial coding has a role to play in determining it. Another presumably verbal-based, spatial–numerical mapping phenomenon is the linguistic markedness association of response codes (MARC) effect whereby responding in parity tasks is quicker when odd numbers are mapped onto left-sided responses and even numbers onto right-sided responses. A recent account of both the SNARC and MARC effects is based on the polarity correspondence principle [Proctor, R. W., & Cho, Y. S. (2006). Polarity correspondence: A general principle for performance of speeded binary classification tasks. Psychological Bulletin, 132, 416–442]. This account assumes that stimulus and response alternatives are coded along any number of dimensions in terms of – and + polarities with quicker responding when the polarity codes for the stimulus and the response correspond. In the present study, even–odd parity judgements were made using either “left” and “right” or “bad” and “good” vocal responses. Results indicated that a SNARC effect was indeed present for the former type of vocal responding, providing further evidence for the sufficiency of the verbal–spatial coding account for this effect. However, the decided lack of an analogous SNARC-like effect in the results for the latter type of vocal responding provides an important constraint on the presumed generality of the polarity correspondence account. On the other hand, the presence of robust MARC effects for “bad” and “good” but not “left” and “right” vocal responses is consistent with the view that such effects are due to conceptual associations between semantic codes for odd–even and bad–good (but not necessarily left–right).     

Implicit chord processing and motor representation in pianists

The aim of this paper is to assess the relevance of pitch dimension in auditory–motor interaction. Several behavioural and brain imaging studies have shown that auditory processing of sounds can activate motor representations, an effect which is however elicited only by action-related sounds, i.e., sounds linked to a specific motor repertoire. Music provides an appropriate framework for further exploration of this issue. Three groups of participants (pianists, non-pianist musicians and non-musicians) were tested with a shape decision task where left-hand and right-hand responses were required; each visual stimulus was paired with an auditory task-irrelevant stimulus (high-pitched or low-pitched piano-timbre chords). Of the three groups, only pianists had longer reaction times for left-hand/high-pitched chords and right-hand/low-pitched chords associations. These findings are consistent with an auditory-motor effect elicited by pitch dimension, as only pianists show an interaction between motor responses and implicit pitch processing. This interaction is consistent with the canonical mapping of hand gestures and pitch dimension on the piano keyboard. The results are discussed within the ideo-motor theoretical framework offered by the Theory of Event Coding (Hommel et al. in Behav Brain Sci 24:849–937, 2001).     

The Simon Effect With Wheel-Rotation Responses

The authors examined clockwise and counterclockwise wheel-rotation responses to high- or low-pitched tones presented in participants' (N = 96, Experiment 1; N = 48, Experiment 2; N = 48, Experiment 3) left and right ears. In Experiment 1, a Simon effect (fastest responding when tone location and direction of wheel turn corresponded) was obtained when participants' hands were at the top or middle of the wheel but not at the bottom. With line bottom hand placement, a Simon effect was induced by instructions emphasizing hand movements but not by instructions emphasizing wheel movements (Experiment 2), and by a visual cursor controlled by the wheel but not one triggered by the response (Experiment 3). The results of the experiments showed that the nature of the task and the instructed action goal influence the direction of the Simon effect.     

Effect of consonant/vowel letter organisation on the syllable counting task: evidence from English

Recent studies in alphabetic writing systems have investigated whether the status of letters as consonants or vowels influences the perception and processing of written words. Here, we examined to what extent the organisation of consonants and vowels within words affects performance in a syllable counting task in English. Participants were asked to judge the number of syllables in written words that were matched for the number of spoken syllables but comprised either 1 orthographic vowel cluster less than the number of syllables (hiatus words, e.g., triumph) or as many vowel clusters as syllables (e.g., pudding). In 3 experiments, we found that readers were slower and less accurate on hiatus than control words, even when phonological complexity (Experiment 1), number of reduced vowels (Experiment 2), and number of letters (Experiment 3) were taken into account. Interestingly, for words with or without the same number of vowel clusters and syllables, participants’ errors were more likely to underestimate the number of syllables than to overestimate it. Results are discussed in a cross-linguistic perspective.     

The representation of pitch in auditory imagery: Evidence from S-R compatibility and distance effects

In three experiments we explored the nature of representations constructed during the perception and imagination of pitch. We employed a same–different task to eliminate the influence of nonauditory information and to minimise use of cognitive strategies on auditory imagery. A reference tone of frequency 1000, 1500, or 2000 Hz, or an imagined tone of a pitch indicated by a visual cue, was followed by a comparison tone (1000, 1500, or 2000 Hz) to which either a speeded same or different response was required. In separate experiments, same–different judgements were mapped to vertically (Experiments 1 and 2) and horizontally arranged responses (Experiment 3). Judgements of tones closer in pitch yielded longer reaction times and higher error rates than more distant tones, indicating a pitch distance effect for perceptual and imagery tasks alike. In addition, in the imagery task, same–different responses were faster when low-pitched tones demanded a bottom or left key response and high-pitched tones a top or right response than vice versa, suggesting that pitch is coded spatially. Together, these behavioural effects support the assumption that both perceived and imagined pitch are translated into an analogical representation in the spatial domain.     

Spatial location and emotion modulate voice perception

ABSTRACT

How do we perceive voices coming from different spatial locations, and how is this affected by emotion? The current study probed the interplay between space and emotion during voice perception. Thirty participants listened to nonverbal vocalizations coming from different locations around the head (left vs. right; front vs. back), and differing in valence (neutral, positive [amusement] or negative [anger]). They were instructed to identify the location of the vocalizations (Experiment 1) and to evaluate their emotional qualities (Experiment 2). Emotion-space interactions were observed, but only in Experiment 1: emotional vocalizations were better localised than neutral ones when they were presented from the back and the right side. In Experiment 2, emotion recognition accuracy was increased for positive vs. negative and neutral vocalizations, and perceived arousal was increased for emotional vs. neutral vocalizations, but this was independent of spatial location. These findings indicate that emotional salience affects how we perceive the spatial location of voices. They additionally suggest that the interaction between spatial (“where”) and emotional (“what”) properties of the voice differs as a function of task.     

The mental representation of integers: an abstract-to-concrete shift in the understanding of mathematical concepts

Mathematics has a level of structure that transcends untutored intuition. What is the cognitive representation of abstract mathematical concepts that makes them meaningful? We consider this question in the context of the integers, which extend the natural numbers with zero and negative numbers. Participants made greater and lesser judgments of pairs of integers. Experiment 1 demonstrated an inverse distance effect: When comparing numbers across the zero boundary, people are faster when the numbers are near together (e.g., −1 vs. 2) than when they are far apart (e.g., −1 vs. 7). This result conflicts with a straightforward symbolic or analog magnitude representation of integers. We therefore propose an analog-x hypothesis: Mastering a new symbol system restructures the existing magnitude representation to encode its unique properties. We instantiate analog-x in a reflection model: The mental negative number line is a reflection of the positive number line. Experiment 2 replicated the inverse distance effect and corroborated the model. Experiment 3 confirmed a developmental prediction: Children, who have yet to restructure their magnitude representation to include negative magnitudes, use rules to compare negative numbers. Taken together, the experiments suggest an abstract-to-concrete shift: Symbolic manipulation can transform an existing magnitude representation so that it incorporates additional perceptual-motor structure, in this case symmetry about a boundary. We conclude with a second symbolic-magnitude model that instantiates analog-x using a feature-based representation, and that begins to explain the restructuring process.     

Intrinsicf0 differences in spoken and sung vowels and their perception by listeners

We explore how listeners perceive distinct pieces of phonetic information that are conveyed in parallel by the fundamental frequency (f0) contour of spoken and sung vowels. In a first experiment, we measured differences inf0 of /i/ and /a/ vowels spoken and sung by unselected undergraduate participants. Differences in “intrinsicf0” (withf0 of /i/ higher than of /a/) were present in spoken and sung vowels; however, differences in sung vowels were smaller than those in spoken vowels. Four experiments tested a hypothesis that listeners would not hear the intrinsicf0 differences as differences in pitch on the vowel, because they provide information, instead, for production of a closed or open vowel. The experiments provide clear evidence of “parsing” of intrinsicf0 from thef0 that contributes to perceived vowel pitch. However, only some conditions led to an estimate of the magnitude of parsing that closely matched the magnitude of produced intrinsicf0 differences.     

Further evaluation of response interruption and redirection as treatment for stereotypy

The effects of 2 forms of response interruption and redirection (RIRD)-motor RIRD and vocal RIRD-were examined with 4 boys with autism to evaluate further the effects of this intervention and its potential underlying mechanisms. In Experiment 1, the effects of motor RIRD and vocal RIRD on vocal stereotypy and appropriate vocalizations were compared for 2 participants. In Experiment 2, the effects of both RIRD procedures on both vocal and motor stereotypy and appropriate vocalizations were compared with 2 additional participants. Results suggested that RIRD was effective regardless of the procedural variation or topography of stereotypy and that vocal RIRD functioned as a punisher. This mechanism was further explored with 1 participant by manipulating the schedule of RIRD in Experiment 3. Results were consistent with the punishment interpretation.     

Finger posing primes number comprehension

Canonical finger postures, as used in counting, activate number knowledge, but the exact mechanism for this priming effect is unclear. Here we dissociated effects of visual versus motor priming of number concepts. In Experiment 1, participants were exposed either to pictures of canonical finger postures (visual priming) or actively produced the same finger postures (motor priming) and then used foot responses to rapidly classify auditory numbers (targets) as smaller or larger than 5. Classification times revealed that manually adopted but not visually perceived postures primed magnitude classifications. Experiment 2 obtained motor priming of number processing through finger postures also with vocal responses. Priming only occurred through canonical and not through non-canonical finger postures. Together, these results provide clear evidence for motor priming of number knowledge. Relative contributions of vision and action for embodied numerical cognition and the importance of canonicity of postures are discussed.     

Evidence for precategorical extrinsic vowel normalization

Three experiments investigated whether extrinsic vowel normalization takes place largely at a categorical or a precategorical level of processing. Traditional vowel normalization effects in categorization were replicated in Experiment 1: Vowels taken from an [?]–[ε] continuum were more often interpreted as /?/ (which has a low first formant, F ₁) when the vowels were heard in contexts that had a raised F ₁ than when the contexts had a lowered F ₁. This was established with contexts that consisted of only two syllables. These short contexts were necessary for Experiment 2, a discrimination task that encouraged listeners to focus on the perceptual properties of vowels at a precategorical level. Vowel normalization was again found: Ambiguous vowels were more easily discriminated from an endpoint [ε] than from an endpoint [?] in a high-F ₁ context, whereas the opposite was true in a low-F ₁ context. Experiment 3 measured discriminability between pairs of steps along the [?]–[ε] continuum. Contextual influences were again found, but without discrimination peaks, contrary to what was predicted from the same participants’ categorization behavior. Extrinsic vowel normalization therefore appears to be a process that takes place at least in part at a precategorical processing level.     

Attention and action: The role of response mappings in auditory attention switching

Switching auditory attention incurs a performance decrement (i.e. auditory attention-switch costs). Using an auditory attention-switching paradigm, we aimed to generalise these across different response mappings. In all three experiments, two number words, spoken by a female and male speaker, were presented dichotically via headphones. A visual cue indicated the gender of the to-be-attended speaker in each trial. The task was a magnitude judgement of the relevant number word (i.e. smaller vs. larger than 5). We additionally varied the interval between cue onset and auditory stimulus onset (cue-stimulus interval) to explore cue-based preparatory effects. In Experiment 1, attention switching was more costly with direct-verbal responses (e.g. ‘smaller’) than in the shadowing task (e.g. ‘three’). In Experiment 2, performance was largely similar for direct-verbal responses and abstract-verbal responses (e.g. ‘left’). In Experiment 3, performance was generally worse with abstract-verbal responses than with abstract-manual responses (e.g. left key press) and auditory attention-switch costs were similar for both response mappings. Overall, auditory switch costs occurred more or less invariably across response mappings in categorical (magnitude) judgements suggesting a minor role of the response mapping in auditory attention switching. Furthermore, verbal identity-based judgements (i.e. shadowing) generally seem to benefit from ideomotor compatibility.     

MODIFYING LETTER AND NUMBER REVERSALS IN ELEMENTARY SCHOOL CHILDREN1

Children from regular and special-education classes were exposed to tutoring procedures designed to modify letter and number reversals. In Experiment I, two students showed reversals during letter-naming (e.g., saying p for q) and two-digit number (e.g., writing 31 for 13) exercises. In Experiment II, one subject made two-digit reversals, while the other child reversed single-digit numbers (e.g., 9 written with circle on right side of stem). The subject in Experiment III emitted letter reversals under naming, dictation, and copying exercises. The child in Experiment IV showed written letter reversals on both sides of the “body midline” under dictation procedures. Basic treatment procedures during all experiments involved modelling of correct and incorrect symbol formation, and differential experimenter feedback following student responses. During Experiments I and II, subjects were praised for each correct response, and informed when a reversal occurred. Experiment III included a Modelling Only Phase before these feedback procedures. Besides praise, treatment conditions in Experiment IV consisted of additional feedback following correct responses (e.g., charting correct responses), and temporal delays imposed between dictated letters and student responses. Except for occasional letter-naming reversals of one subject (Experiment I), and letter dictation errors of another (Experiment IV), reversals were eliminated when all experiments terminated. The Modelling Only Phase in Experiment III also reduced reversals to a low level. These findings suggest that a variety of reversal problems may be effectively assessed and remediated via simple modelling and reinforcement procedures. In addition, postcheck observations indicated that the effects were enduring. The present procedures should be easily implemented by school personnel.     

Differential reinforcement of vocal duration

The effects of differential reinforcement of vocal duration were examined in a series of experiments in which each of 28 subjects (Ss) emitted a vowel whenever a light was flashed. In the first phase of each experiment, a penny was dispensed after each of 20 responses. In the second and subsequent phases, only those responses whose durations exceeded a criterion were reinforced; when 10 successive reinforcements were presented, one phase was terminated and the next begun. The criterion for reinforcement in each phase was determined by a different schedule in each of six experiments; it ranged from 80 to 120 per cent of the mean duration of the 10 terminal responses in the prior phase. Differential reinforcement effected a large and systematic change in the duration of vocal responses as long as the responses selected for reinforcement had a sufficiently high probability of occurrence. This requirement was formulated as the difference between the criterion duration and the mean duration of the terminal responses in the prior phase, divided by their standard deviation. This statistic, named the shaping index, was correlated with the number of responses emitted before each phase was terminated. It was found to be large whenever the shaping process failed. Many Ss failed to tact the reinforcement contingency despite marked changes in their vocal behavior and extensive probing by a questionnaire, administered at the end of each session.     

Response facilitation and inhibition in manual, vocal, and oculomotor performance: evidence for a modality-unspecific mechanism

In 2 experiments (N = 10, Experiment 1; N = 16, Experiment 2), the authors investigated whether evidence for response facilitation and subsequent inhibition elicited by masked prime stimuli can be observed for output modalities other than manual responding. Masked primes were followed by target stimuli that required a 2-choice manual, saccadic, or vocal response. Performance was measured for compatible trials in which primes and targets were identical and for incompatible trials in which they were mapped to opposite responses. When primes were presented centrally, performance benefits were obtained for incompatible trials; whereas for peripherally presented primes, performance benefits were found in compatible trials. That pattern of results was obtained for manual responses and for saccadic eye movements (Experiment 1), demonstrating that those effects are not mediated by specialized dorsal pathways involved in visuomanual control. An analogous pattern of effects was found when manual and vocal responses were compared (Experiment 2). Because vocal responding is controlled by the inferotemporal cortex, that result shows that prime-target compatibility effects are not primarily mediated by the dorsal stream, but appear to reflect modality-unspecific visuomotor links that allow rapid activation of motor responses that may later be subject to inhibition.     

Processing of order information for numbers and months

Despite a great deal of research on the processing of numerical magnitude (e.g., the quantity denoted by the number 5), few studies have investigated how this magnitude information relates to the ordinal properties of numbers (e.g., the fact that 5 is the fifth integer). In the present study, we investigated order-related processing of numbers, as well as months of the year, with a novel ordering task to see whether the processing of order information differs from the processing of magnitude information. In Experiments 1 and 2, participants were shown three numbers (Experiment 1) or three months (Experiment 2) and were required to indicate whether the stimuli were in the correct order. In Experiment 3, participants were again shown three numbers; however, now they were instructed to indicate whether the three numbers were ordered in a forward, backward, or mixed direction. Whereas number comparison tasks typically reveal distance effects (comparisons become easier with increased distance between two numbers), these three experiments reveal a different pattern of results. There were reverse distance effects when the stimuli crossed a boundary (i.e., when numbers crossed a decade or months crossed the year boundary) and no effect of distance when the stimuli did not cross a boundary (i.e., when numbers were within a decade and months were within the January—December calendar year). These data suggest that additional mechanisms are involved in the processing of order information: a scanning mechanism and a long-term memory checking mechanism.     

Learning how to learn from social feedback: The origins of early vocal development

Infants’ prelinguistic vocalizations reliably organize vocal turn-taking with social partners, creating opportunities for learning to produce the sound patterns of the ambient language. This social feedback loop supporting early vocal learning is well-documented, but its developmental origins have yet to be addressed. When do infants learn that their non-cry vocalizations influence others? To test developmental changes in infant vocal learning, we assessed the vocalizations of 2- and 5-month-old infants in a still-face interaction with an unfamiliar adult. During the still-face, infants who have learned the social efficacy of vocalizing increase their babbling rate. In addition, to assess the expectations for social responsiveness that infants build from their everyday experience, we recorded caregiver responsiveness to their infants’ vocalizations during unstructured play. During the still-face, only 5-month-old infants showed an increase in vocalizing (a vocal extinction burst) indicating that they had learned to expect adult responses to their vocalizations. Caregiver responsiveness predicted the magnitude of the vocal extinction burst for 5-month-olds. Because 5-month-olds show a vocal extinction burst with unfamiliar adults, they must have generalized the social efficacy of their vocalizations beyond their familiar caregiver. Caregiver responsiveness to infant vocalizations during unstructured play was similar for 2- and 5-month-olds. Infants thus learn the social efficacy of their vocalizations between 2 and 5 months of age. During this time, infants build associations between their own non-cry sounds and the reactions of adults, which allows learning of the instrumental value of vocalizing.