Correspondence effects with manual gestures and postures: a study of imitation

In this study, the authors applied methods and theories from research of stimulus-response compatibility (SRC) to action imitation. In 6 experiments, they adopted the logic of the Simon paradigm (B. Hommel & W. Prinz, 1996) to explore interference between task-relevant symbolic stimulus features (color) and task-irrelevant iconic stimulus features (2 hand gestures and 2 postures). The same 2 hand gestures served as responses. Pronounced correspondence effects for both gestures and postures showed up throughout. In line with theories of SRC, the authors account for these correspondence effects in terms of overlap arising between stimulus and response features in a common representational domain. As a specific extension of this approach, they propose 2 functionally independent mechanisms: One operates movement-based when dynamic information is provided, and the other operates state-based with static postures as stimuli. Implications for theories of both SRC and action imitation are discussed.     

Newborn categorization of vowel‐like sounds

While there are many theories of the development of speech perception, there are few data on speech perception in human newborns. This paper examines the manner in which newborns responded to a set of stimuli that define one surface of the adult vowel space. Experiment 1 used a preferential listening/habituation paradigm to discover how newborns divide that vowel space. Results indicated that there were zones of high preference flanked by zones of low preference. The zones of high preference approximately corresponded to areas where adults readily identify vowels. Experiment 2 presented newborns with pairs of vowels from the zones found in Experiment 1. One member of each pair was the most preferred vowel from a zone, and the other member was the least preferred vowel from the adjacent zone of low preference. The pattern of preference was preserved in Experiment 2. However, a comparison of Experiments 1 and 2 indicated that habituation had occurred in Experiment 1. Experiment 3 tested the hypothesis that the habituation seen in Experiment 1 was due to processes of categorization, by using a familiarization preference paradigm. The results supported the hypothesis that newborns categorized the vowel space in an adult‐like manner, with vowels perceived as relatively good or poor exemplars of a vowel category.     

汉语口吃者在不出声言语中的语音编码

口吃者与非口吃者在不出声言语中语音编码的差异是口吃者语音加工异常的有力证据。通过三个实验,分别考察了口吃者与非口吃者监控汉语拼音中声母、韵母及声调的差异。结果表明,口吃者对声母的监控与非口吃者相比没有显著的差异,但在监控韵母及声调时,口吃者的反应显著慢于非口吃者。研究结果支持了关于口吃的“内在修正假说”,对研究汉语的语音编码有启发,对于口吃的诊断和治疗也有重要的启示     

Regional accent variation in the shadowing task: Evidence for a loose perception–action coupling in speech

We investigated the relation between action and perception in speech processing, using the shadowing task, in which participants repeat words they hear. In support of a tight perception–action link, previous work has shown that phonetic details in the stimulus influence the shadowing response. On the other hand, latencies do not seem to suffer if stimulus and response differ in their articulatory properties. The present investigation tested how perception influences production when participants are confronted with regional variation. Results showed that participants often imitate a regional variation if it occurs in the stimulus set but tend to stick to their variant if the stimuli are consistent. Participants were forced or induced to correct by the experimental instructions. Articulatory stimulus–response differences do not lead to latency costs. These data indicate that speech perception does not necessarily recruit the production system.     

Human adults and human infants show a "perceptual magnet effect" for the prototypes of speech categories, monkeys do not

Many perceptual categories exhibit internal structure in which category prototypes play an important role. In the four experiments reported here, the internal structure of phonetic categories was explored in studies involving adults, infants, and monkeys. In Experiment 1, adults rated the category goodness of 64 variants of the vowel i parallel on a scale from 1 to 7. The results showed that there was a certain location in vowel space where listeners rated the i parallel vowels as best instances, or prototypes. The perceived goodness of i parallel vowels declined systematically as stimuli were further removed from the prototypic i parallel vowel. Experiment 2 went beyond this initial demonstration and examined the effect of speech prototypes on perception. Either the prototypic or a nonprototypic i parallel vowels was used as the referent stimulus and adults' generalization to other members of the category was examined. Results showed that the typicality of the speech stimulus strongly affected perception. When the prototype of the category served as the referent vowel, there was significantly greater generalization to other i parallel vowels, relative to the situation in which the nonprototype served as the referent. The notion of a perceptual magnet was introduced. The prototype of the category functioned like a perceptual magnet for other category members; it assimilated neighboring stimuli, effectively pulling them toward the prototype. In Experiment 3, the ontogenetic origins of the perceptual magnet effect were explored by testing 6-month-old infants. The results showed that infants' perception of vowels was also strongly affected by speech prototypes. Infants showed significantly greater generalization when the prototype of the vowel category served as the referent; moreover, their responses were highly correlated with those of adults. In Experiment 4, Rhesus monkeys were tested to examine whether or not the prototype's magnet effect was unique to humans. The animals did not provide any evidence of speech prototypes; they did not exhibit the magnet effect. It is suggested that the internal organization of phonetic categories around prototypic members is an ontogenetically early, species-specific, aspect of the speech code.     

Zebra finches and Dutch adults exhibit the same cue weighting bias in vowel perception

Vocal tract resonances, called formants, are the most important parameters in human speech production and perception. They encode linguistic meaning and have been shown to be perceived by a wide range of species. Songbirds are also sensitive to different formant patterns in human speech. They can categorize words differing only in their vowels based on the formant patterns independent of speaker identity in a way comparable to humans. These results indicate that speech perception mechanisms are more similar between songbirds and humans than realized before. One of the major questions regarding formant perception concerns the weighting of different formants in the speech signal (“acoustic cue weighting”) and whether this process is unique to humans. Using an operant Go/NoGo design, we trained zebra finches to discriminate syllables, whose vowels differed in their first three formants. When subsequently tested with novel vowels, similar in either their first formant or their second and third formants to the familiar vowels, similarity in the higher formants was weighted much more strongly than similarity in the lower formant. Thus, zebra finches indeed exhibit a cue weighting bias. Interestingly, we also found that Dutch speakers when tested with the same paradigm exhibit the same cue weighting bias. This, together with earlier findings, supports the hypothesis that human speech evolution might have exploited general properties of the vertebrate auditory system.     

Stimulus expectancy modulates inferior frontal gyrus and premotor cortex activity in auditory perception

In studies on auditory speech perception, participants are often asked to perform active tasks, e.g. decide whether the perceived sound is a speech sound or not. However, information about the stimulus, inherent in such tasks, may induce expectations that cause altered activations not only in the auditory cortex, but also in frontal areas such as inferior frontal gyrus (IFG) and motor cortices, even in the absence of an explicit task. To investigate this, we applied spectral mixes of a flute sound and either vowels or specific music instrument sounds (e.g. trumpet) in an fMRI study, in combination with three different instructions. The instructions either revealed no information about stimulus features, or explicit information about either the music instrument or the vowel features. The results demonstrated that, besides an involvement of posterior temporal areas, stimulus expectancy modulated in particular a network comprising IFG and premotor cortices during this passive listening task.     

‘Goals’ are not an integral component of imitation

Several theories suggest that actions are coded for imitation in terms of mentalistic goals, or inferences about the actor’s intentions, and that these goals solve the correspondence problem by allowing sensory input to be translated into matching motor output. We tested this intention reading hypothesis against general process accounts of imitation using the pen-and-cups task. The task has three components: participants place a pen in one of two cups, using their right or left hand, and one of two grips. Previous research has revealed a colour minimum error pattern; when one of the components is differentially coloured (e.g., one cup is red and the other blue), accuracy is greatest on the coloured dimension. We found the colour minimum error pattern, not only in the standard version of the task, where participants imitate the actions of a human model, but also in three novel variants of the task, in which participants responded on the basis of spatial or arbitrary stimulus–response mappings to ‘geometric’, non-biological stimuli. These stimuli do not afford the attribution of intentions, and therefore our results support generalist theories of imitation by showing that the colour minimum error pattern is due, not to intention reading, but to the operation of task-general processes of perception, attention and motor control.     

Similarity structure in visual speech perception and optical phonetic signals

A complete understanding of visual phonetic perception (lipreading) requires linking perceptual effects to physical stimulus properties. However, the talking face is a highly complex stimulus, affording innumerable possible physical measurements. In the search for isomorphism between stimulus properties and phoneticeffects, second-order isomorphism was examined between theperceptual similarities of video-recorded perceptually identified speech syllables and the physical similarities among the stimuli. Four talkers produced the stimulus syllables comprising 23 initial consonants followed by one of three vowels. Six normal-hearing participants identified the syllables in a visual-only condition. Perceptual stimulus dissimilarity was quantified using the Euclidean distances between stimuli in perceptual spaces obtained via multidimensional scaling. Physical stimulus dissimilarity was quantified using face points recorded in three dimensions by an optical motion capture system. The variance accounted for in the relationship between the perceptual and the physical dissimilarities was evaluated using both the raw dissimilarities and the weighted dissimilarities. With weighting and the full set of 3-D optical data, the variance accounted for ranged between 46% and 66% across talkers and between 49% and 64% across vowels. The robust second-order relationship between the sparse 3-D point representation of visible speech and the perceptual effects suggests that the 3-D point representation is a viable basis for controlled studies of first-order relationships between visual phonetic perception and physical stimulus attributes.     

Is automatic imitation a specialized form of stimulus–response compatibility? Dissociating imitative and spatial compatibilities

In recent years research on automatic imitation has received considerable attention because it represents an experimental platform for investigating a number of interrelated theories suggesting that the perception of action automatically activates corresponding motor programs. A key debate within this research centers on whether automatic imitation is any different than other long-term S-R associations, such as spatial stimulus-response compatibility. One approach to resolving this issue is to examine whether automatic imitation shows similar response characteristics as other classes of stimulus-response compatibility. This hypothesis was tested by comparing imitative and spatial compatibility effects with a two alternative forced-choice stimulus-response compatibility paradigm. The stimulus on each trial was a left or right hand with either the index or middle finger tapping down. Speeded responses were performed with the index or middle finger of the right hand in response to the identity or the left-right spatial position of the stimulus finger. Two different tasks were administered: one that involved responding to the stimulus (S-R) and one that involved responding to the opposite stimulus (OS-R; i.e., the one not presented on that trial). Based on previous research and a connectionist model, we predicted standard compatibility effects for both spatial and imitative compatibility in the S-R task, and a reverse compatibility effect for spatial compatibility, but not for imitative compatibility, in the OS-R task. The results from the mean response times, mean percentage of errors, and response time distributions all converged to support these predictions. A second noteworthy result was that the recoding of the finger identity in the OS-R task required significantly more time than the recoding of the left-right spatial position, but the encoding time for the two stimuli in the S-R task was equivalent. In sum, this evidence suggests that the processing of spatial and imitative compatibility is dissociable with regard to two different processes in dual processing models of stimulus-response compatibility.     

Spontaneous Imitation of Fundamental Frequency and Speech Rate by Nonstutterers and Stutterers

Speech can be described either in terms of acoustics, as a perceptual outcome, or as a motor event. Central to theories of speech perception and production is an attempt to describe how these aspects of speech are interrelated. The present experiment investigated how the nonstutterers' and stutterers' reproductions of acoustically presented interrogative sentences were influenced by experimental variations of intonation (sentence initial vs. sentence final) and speech rate (normal vs. time compressed). We studied the effects of these stimulus manipulations on the speech rate and fundamental frequency (F₀ ) of 10 adult German-speaking nonstutterers and seven stutterers. Experimental manipulations of intonation and speech rate significantly influenced the syllable duration and speech rate of both normal speakers and stutterers. The fundamental frequency of the subjects' responses were also significantly influenced by the intonation of the stimulus. But the stutterers' increase in F₀ for stressed syllables was generally less pronounced than that of nonstutterers. These results imply that (a) the subjects not only extract linguistic meaning from intonation but that they also store extragrammatical speech rate information, and (b) the speakers adopt these speech rate variations for their own productions. Generally, these results demonstrate that speech perception is not limited to extracting linguistically invariant information. The results show that speakers actively generate their own prosody and that this generative process is influenced by the prosodic structure of another speaker's antecedent speech. The implications of these results for theories of speech production are discussed.     

6- to 9-Month old infants discriminate vowel durations in variable speech contexts

Discriminating temporal relationships in speech is crucial for speech and language development. However, temporal variation of vowels is difficult to perceive for young infants when it is determined by surrounding speech sounds. Using a familiarization-discrimination paradigm, we show that English-learning 6- to 9-month-olds are capable of discriminating non-native acoustic vowel duration differences that systematically vary with subsequent consonantal durations. Furthermore, temporal regularity of stimulus presentation potentially makes the task easier for infants. These findings show that young infants can process fine-grained temporal aspects of speech sounds, a capacity that lays the foundation for building a phonological system of their ambient language(s).     

Human adults and human infants show a “perceptual magnet effect” for the prototypes of speech categories,monkeys do not

Many perceptual categories exhibit internal structure in which category prototypes play an important role. In the four experiments reported here, the internal structure of phonetic categories was explored in studies involving adults, infants, and monkeys. In Experiment 1, adults rated the category goodness of 64 variants of the vowel /i/ on a scale from 1 to 7. The results showed that there was a certain location in vowel space where listeners rated the /i/ vowels as best instances, or prototypes. The perceived goodness of Iii vowels declined systematically as stimuli were further removed from the prototypic Iii vowel. Experiment 2 went beyond this initial demonstration and examined the effect of speech prototypes on perception. Either the prototypic or a nonprototypic IM vowel was used as the referent stimulus and adults’ generalization to other members of the category was examined. Results showed that the typicality of the speech stimulus strongly affected perception. When the prototype of the category served as the referent vowel, there was significantly greater generalization to other /i/ vowels, relative to the situation in which the nonprototype served as the referent. The notion of aperceptual magnet was introduced. The prototype of the category functioned like a perceptual magnet for other category members; it assimilated neighboring stimuli, effectively pulling them toward the prototype. In Experiment 3, the ontogenetic origins of the perceptual magnet effect were explored by testing 6-month-old infants. The results showed that infants’ perception of vowels was also strongly affected by speech prototypes. Infants showed significantly greater generalization when the prototype of the vowel category served as the referent; moreover, their responses were highly correlated with those of adults. In Experiment 4, Rhesus monkeys were tested to examine whether or not the prototype’s magnet effect was unique to humans. The animals did not provide any evidence of speech prototypes; they did not exhibit the magnet effect. It is suggested that the internal organization of phonetic categories around prototypic members is an ontogenetically early, species-specific, aspect of the speech code     

Imagaletics: The application of covert conditioning to athletic performance

Abstract

Imagaletics is the application of covert conditioning to athletic performance. Covert conditioning is a procedure based on operant conditioning and involves the manipulation of imagery. In employing covert conditioning, the individual is asked to imagine the target behavior and then imagine specific consequences to modify that behavior. The assumptions of covert conditioning are presented and the procedures are described with applications to athletic performance.     

Perception of temporal order in vowel sequences with and without formant transitions.

Temporal-order perception of phoneme segments in running speech is much superior to temporal-order perception in repeating vowel sequences. The more rapid rates possible in running speech may be due largely to the presence of formant transitions. In a series of five experiments we observed that many temporal-order misjudgements of repeating vowels can be explained in terms of auditory stream segregation, triggered for the most part by discontinuities in first-formant frequencies of adjacent vowels. Streaming, however, can be suppressed by formant transitions appropriate for the perception of stop consonants and by continuous transitions resembling those in coarticulated vowels. At rapid sequence rates, when the constraints of auditory streaming are removed, correct temporal-order identification is limited by linguistic transformations of vowels into other phoneme segments.     

Meta-Invariant Structure in Stimulus Arrays: A Response to Mace's Zetetic Challenge to Ecological Perceptual Researchers

ABSTRACT

Ecological perception, per James Gibson's theory, avows that perception depends on informative structure in stimulus arrays, where information is defined as stimulus array invariants. Gibson, however, was somewhat vague about the nature of such structure. Consequently, ecological perceptual research—even acknowledging some remarkable successes—has generally been ad hoc: Lacking principled heuristics, researchers examine array structure, which, by some means, they have come to discover as (or believe to be) informative. Here, I propose a series of heuristic principles potentially useful for the discovery of informative structure in stimulus arrays, with examples to suggest how those principles might apply. The major benefit of principled search for stimulus array invariants is more efficient elaboration of their function in perception. While admittedly preliminary, the principles outlined may both guide perceptual investigations and prompt additional consideration of how to approach the search for stimulus array invariants.     

非言语声音影响汉语听者言语声音的知觉

采用启动范式, 以汉语听者为被试, 考察了非言语声音是否影响言语声音的知觉。实验1考察了纯音对辅音范畴连续体知觉的影响, 结果发现纯音影响到辅音范畴连续体的知觉, 表现出频谱对比效应。实验2考察了纯音和复合音对元音知觉的影响, 结果发现与元音共振峰频率一致的纯音或复合音加快了元音的识别, 表现出启动效应。两个实验一致发现非言语声音能够影响言语声音的知觉, 表明言语声音知觉也需要一个前言语的频谱特征分析阶段, 这与言语知觉听觉理论的观点一致。     

Embodied spatial transformations: "body analogy" for the mental rotation of objects

The cognitive advantage of imagined spatial transformations of the human body over that of more unfamiliar objects (e.g., Shepard-Metzler [S-M] cubes) is an issue for validating motor theories of visual perception. In 6 experiments, the authors show that providing S-M cubes with body characteristics (e.g., by adding a head to S-M cubes to evoke a posture) facilitates the mapping of the cognitive coordinate system of one's body onto the abstract shape. In turn, this spatial embodiment improves object shape matching. Thanks to the increased cohesiveness of human posture in people's body schema, imagined transformations of the body operate in a less piecemeal fashion as compared with objects (S-M cubes or swing-arm desk lamps) under a similar spatial configuration, provided that the pose can be embodied. If the pose cannot be emulated (covert imitation) by the sensorimotor system, the facilitation due to motoric embodiment will also be disrupted.     

The effects of attention on speech perception: an fMRI study

Focusing of attention to a specific speech source plays an important role in everyday speech perception. However, little is known of the neuronal substrates of focused attention in speech perception. Thus, the present study investigated the effects on neuronal activation of directed attention to auditory stimuli that differed in semantic content. Using an event-related fMRI protocol, single vowels, three-phoneme pseudowords and three- and four-phoneme real nouns and words were randomly presented to the subjects during four different instructional conditions. One condition was passive listening without any specific instructions of focusing of attention. The other conditions were attention focused on either the vowels, the pseudowords or the words. Thus, the acoustic stimulation was constant across conditions. The subjects were 13 healthy adults. Functional MRI was performed with a 1.5 T scanner, using an event-related design. During passive listening, there were significant activations bilaterally in the superior temporal gyrus. Instruction to attend to the pseudowords caused activation in middle temporal lobe areas, extending more anterior compared to the activations seen during passive listening. Instruction to attend to the vowel sounds caused an increase in activation in the superior/medial temporal lobe, with a leftward asymmetry. Instruction to attend to the words caused a leftward asymmetry, particularly in the middle and superior temporal gyri. It is concluded that attention plays a modulatory role in neuronal activation to speech sounds, producing specific activations to specific stimulus categories that may act to facilitate speech perception.