中文阅读中无关言语效应的认知机制探究：眼动证据

采用眼动追踪技术探讨中文阅读中无关言语效应的影响机制, 操纵了背景音的类型(有意义背景音、无意义背景音、无声), 通过3个实验考察其对简单句、复杂句、篇章阅读的影响。结果发现, 被试在无意义背景音条件下加工三类阅读材料时的眼动指标与无声条件相比差异均不显著; 但是, 在有意义背景音条件下, 被试在进行复杂句和篇章阅读时的眼动指标与无声条件相比差异显著, 而在简单句阅读中差异不显著。结果表明, 语义属性才是影响无关言语效应产生的关键因素, 其所起作用受到阅读任务难度的调节, 而对阅读过程的影响主要体现在晚期的词汇加工和语义整合阶段, 本研究结果支持了语义干扰假说。     

“Hearing voices”: Auditory hallucinations as failure of top‐down control of bottom‐up perceptual processes

Auditory hallucination is a key characteristic of schizophrenia that seriously debilitates the patient, with consequences for social engagement with others. Hallucinatory experiences are also observed in healthy individuals in the general population who report “hearing voices” in the absence of an external acoustic input. A view on auditory hallucinations and “hearing voices” is presented that regards such phenomena as perceptual processes, originating from speech perception areas in the left temporal lobe. Healthy individuals “hearing voices” are, however, often aware that the experience comes from inner thought processes, which is not reported by hallucinating patients. A perceptual model can therefore, not alone explain the difference in the phenomenology of how the “voices heard” are attributed to either an inner or outer cause. An expanded model is thus presented which takes into account top‐down cognitive control, localized to prefrontal cortical areas, to inhibit and re‐attribute the perceptual mis‐representations. The expanded model is suggested to be empirically validated using a dichotic listening speech perception paradigm with instructions for top‐down control of attention focus to either the right or left side in auditory space. It is furthermore suggested to use fMRI to validate the temporal and frontal lobe neuronal correlates of the cognitive processes involved in auditory hallucinations.     

Can the irrelevant speech effect turn into a stimulus suffix effect?

The irrelevant sound effect (ISE) and the stimulus suffix effect (SSE) are two qualitatively different phenomena, although in both paradigms irrelevant auditory material is played while a verbal serial recall task is being performed. Jones, Macken, and Nicholls (2004) have proposed the effect of irrelevant speech on auditory serial recall to switch from an ISE to an SSE mechanism, if the auditory-perceptive similarity of relevant and irrelevant material is maximized. The experiment reported here (n = 36) tested this hypothesis by exploring auditory serial recall performance both under irrelevant speech and under speech suffix conditions. These speech materials were spoken either by the same voice as the auditory items to be recalled or by a different voice. The experimental conditions were such that the likelihood of obtaining an SSE was maximized. The results, however, show that irrelevant speech—in contrast to speech suffixes—affects auditory serial recall independently of its perceptive similarity to the items to be recalled and thus in terms of an ISE mechanism that crucially extends to recency. The ISE thus cannot turn into an SSE.     

Reading voices and hearing text: talker-specific auditory imagery in reading

A series of experiments was conducted to determine if linguistic representations accessed during reading include auditory imagery for characteristics of a talker's voice. In 3 experiments, participants were familiarized with two talkers during a brief prerecorded conversation. One talker spoke at a fast speaking rate, and one spoke at a slow speaking rate. Each talker was identified by name. At test, participants were asked to either read aloud (Experiment 1) or silently (Experiments 1, 2, and 3) a passage that they were told was written by either the fast or the slow talker. Reading times, both silent and aloud, were significantly slower when participants thought they were reading a passage written by the slow talker than when reading a passage written by the fast talker. Reading times differed as a function of passage author more for difficult than for easy texts, and individual differences in general auditory imagery ability were related to reading times. These results suggest that readers engage in a type of auditory imagery while reading that preserves the perceptual details of an author's voice.     

Shot through with voices: Dissociation mediates the relationship between varieties of inner speech and auditory hallucination proneness

Inner speech is a commonly experienced but poorly understood phenomenon. The Varieties of Inner Speech Questionnaire (VISQ; McCarthy-Jones & Fernyhough, 2011) assesses four characteristics of inner speech: dialogicality, evaluative/motivational content, condensation, and the presence of other people. Prior findings have linked anxiety and proneness to auditory hallucinations (AH) to these types of inner speech. This study extends that work by examining how inner speech relates to self-esteem and dissociation, and their combined impact upon AH-proneness. 156 students completed the VISQ and measures of self-esteem, dissociation and AH-proneness. Correlational analyses indicated that evaluative inner speech and other people in inner speech were associated with lower self-esteem and greater frequency of dissociative experiences. Dissociation and VISQ scores, but not self-esteem, predicted AH-proneness. Structural equation modelling supported a mediating role for dissociation between specific components of inner speech (evaluative and other people) and AH-proneness. Implications for the development of “hearing voices” are discussed.     

Voice recognition by matching to sample

Voice recognition was assessed by a matching to sample procedure in 30 right-handed adults with normal hearing. The subject was required to indicate which of three voices speaking a nonsense syllable matched the speaker of a sample vowel. Subjects were able to recognize voices with reasonable accuracy, but there were no significant differences as a function of ears or practice, and performance was not markedly affected by knowledge of results or mode of response. There was a significant difference as a function of the temporal position of the matching voice, with recognition being most accurate when the matching voice was first and least accurate when it was third. Further research is necessary to determine whether voice recognition should be classified as the type of verbal ability associated with the cerebral hemisphere dominant for speech, or whether it is the type of nonverbal auditory ability associated with the nonspeech hemisphere.This research was supported in part by grant MA-1652 from the Medical Research Council of Canada.     

The varieties of inner speech: links between quality of inner speech and psychopathological variables in a sample of young adults

A resurgence of interest in inner speech as a core feature of human experience has not yet coincided with methodological progress in the empirical study of the phenomenon. The present article reports the development and psychometric validation of a novel instrument, the Varieties of Inner Speech Questionnaire (VISQ), designed to assess the phenomenological properties of inner speech along dimensions of dialogicality, condensed/expanded quality, evaluative/motivational nature, and the extent to which inner speech incorporates other people’s voices. In response to findings that some forms of psychopathology may relate to inner speech, anxiety, depression, and proneness to auditory and visual hallucinations were also assessed. Anxiety, but not depression, was found to be uniquely positively related to both evaluative/motivational inner speech and the presence of other voices in inner speech. Only dialogic inner speech predicted auditory hallucination-proneness, with no inner speech variables predicting levels of visual hallucinations/disturbances. Directions for future research are discussed.     

Limitations of episodic memory for highly similar auditory stimuli

Two experiments investigated participants’ recognition memory for word content, while varying vocal characteristics, and for vocal characteristics alone. In Experiment 1, participants performed an auditory recognition task in which they identified whether a spoken word was “new”, “old” (repeated word, repeated voice), or “similar” (repeated word, new voice). Results showed that word recognition accuracy was lower for similar trials than old trials. In Experiment 2, participants performed an auditory recognition task in which they identified whether or not a phrase was spoken in an old or new voice, with repetitions occurring after a variable number of intervening stimuli. Results showed that recognition accuracy was lower when old voices spoke an alternate message than a repeated message and accuracy decreased as a function of number of intervening items. Overall, the results suggest that speech recognition is better for lexical content than vocal characteristics alone.     

Prevalence of auditory hallucinations in Norwegian adolescents: Results from a population‐based study

Knowing the prevalence and characteristics of auditory verbal hallucinations (AVH) in adolescents is important for estimations of need for mental health care and assessment of psychosis risk. In this report we assess the prevalence of AVH in a population‐based sample of 16–19 years old Norwegian adolescents (n = 9,646, 46.4% male) using two items assessing AVH (from the extended Launay‐Slade Hallucination Scale). The prevalence of hearing a voice speaking thoughts aloud was 10.6%. The prevalence of being troubled by voices was 5.3%, showing that negative emotionality about AVH is less frequent than the experience of hearing voices. Female respondents had slightly increased risk for being troubled by voices than males (odds ratio = 1.3), while age did not modulate prevalence. This AVH prevalence is in line with earlier reports in smaller samples of adolescents and indicates that AVH are not uncommon in this period of life. Further longitudinal studies are needed to investigate the value of AVH in predicting psychiatric disorder.     

工作记忆中的语音回路对汉语阅读理解的影响

语音回路是工作记忆中一个重要的组成部分,主要负责加工和存储语音信息。采用混合实验设计,以正确数和反应时 为指标,汉语语篇为阅读材料,探讨工作记忆中的语音回路对汉语阅读理解的影响。本研究包括两个实验,实验一采用发音抑制的范式,结合错误干扰考察了语音回路中的发音复述装置对汉语阅读理解的影响;实验二采用无关言语的范式,结合错误干扰考察了语音回路中的语音存储装置对汉语阅读理解的影响。结果表明：(1)通过发音抑制和无关言语的方法证明,语音回路中的发音复述装置和语音存储装置在汉语阅读理解中起着重要作用。(2) 字音和字形都影响汉语的阅读理解,但字形比字音起着更大的作用,而且它们的作用机制也不相同,字音直接进入语音存储装置,而字形要经过字音的转换进入语音存储装置。(3) 词频与语音回路有密切关系,语音回路中的发音复述装置的作用在高频词上有明显的表现。(4) 词频与字形、字音也有密切关系,在低频词的条件下,字形的作用大于字音的作用     

Auditory Verbal Experience and Agency in Waking,Sleep Onset,REM, and Non‐REM Sleep

We present one of the first quantitative studies on auditory verbal experiences (“hearing voices”) and auditory verbal agency (inner speech, and specifically “talking to (imaginary) voices or characters”) in healthy participants across states of consciousness. Tools of quantitative linguistic analysis were used to measure participants’ implicit knowledge of auditory verbal experiences (VE) and auditory verbal agencies (VA), displayed in mentation reports from four different states. Analysis was conducted on a total of 569 mentation reports from rapid eye movement (REM) sleep, non‐REM sleep, sleep onset, and waking. Physiology was controlled with the nightcap sleep–wake mentation monitoring system. Sleep‐onset hallucinations, traditionally at the focus of scientific attention on auditory verbal hallucinations, showed the lowest degree of VE and VA, whereas REM sleep showed the highest degrees. Degrees of different linguistic‐pragmatic aspects of VE and VA likewise depend on the physiological states. The quantity and pragmatics of VE and VA are a function of the physiologically distinct state of consciousness in which they are conceived.     

Hearing by eye

Recent work on integration of auditory and visual information during speech perception has indicated that adults are surprisingly good at, and rely extensively on, lip reading. The conceptual status of lip read information is of interest: such information is at the same time both visual and phonological. Three experiments investigated the nature of short term coding of lip read information in hearing subjects. The first experiment used asynchronous visual and auditory information and showed that a subject's ability to repeat words, when heard speech lagged lip movements, was unaffected by the lag duration, both quantitatively and qualitatively. This suggests that lip read information is immediately recoded into a durable code. An experiment on serial recall of lip read items showed a serial position curve containing a recency effect (characteristic of auditory but not visual input). It was then shown that an auditory suffix diminishes the recency effect obtained with lip read stimuli. These results are consistent with the hypothesis that seen speech, that is not heard, is encoded into a durable code which has some shared properties with heard speech. The results of the serial recall experiments are inconsistent with interpretations of the recency and suffix effects in terms of precategorical acoustic storage, for they demonstrate that recency and suffix effects can be supra-modal.     

Temporal dynamics of the eye–voice span and eye movement control during oral reading

The distance between eye movements and articulation during oral reading, commonly referred to as the eye–voice span, has been a classic issue of experimental reading research since Buswell (1921). To examine the influence of the span on eye movement control, synchronised recordings of eye position and speech production were obtained during fluent oral reading. The viewing of a word almost always preceded its articulation, and the interval between the onset of a word's fixation and the onset of its articulation was approximately 500 ms. The identification and articulation of a word were closely coupled, and the fixation–speech interval was regulated through immediate adjustments of word viewing duration, unless the interval was relatively long. In this case, the lag between identification and articulation was often reduced through a regression that moved the eyes back in the text. These results indicate that models of eye movement control during oral reading need to include a mechanism that maintains a close linkage between the identification and articulation of words through continuous oculomotor adjustments.     

人声加工的神经机制

人声是人类听觉环境中最熟知和重要的声音, 传递着大量社会相关信息。与视觉人脸加工类似, 大脑对人声也有着特异性加工。研究者使用电生理、脑成像等手段找到了对人声有特异性反应的脑区, 即颞叶人声加工区(TVA), 并发现非人类动物也有类似的特异性加工区域。人声加工主要涉及言语、情绪和身份信息的加工, 分别对应于三条既相互独立又相互作用的神经通路。研究者提出了双通路模型、多阶段模型和整合模型分别对人声的言语、情绪和身份加工进行解释。未来研究需要进一步讨论人声加工的特异性能否由特定声学特征的选择性加工来解释, 并深入探究特殊人群(如自闭症和精神分裂症患者)的人声加工的神经机制。     

Spatial inattention abolishes voice adaptation

Adaptation to male voices causes a subsequent voice to be perceived as more female, and vice versa. Similar contrastive aftereffects have been reported for phonetic perception, and in vision for face perception. However, while aftereffects in the perception of phonetic features of speech have been reported to persist even when adaptors were processed inattentively, face aftereffects were previously reported to be abolished by inattention to adaptors. Here we demonstrate that auditory aftereffects of adaptation to voice gender are eliminated when the male and female adaptor voices are spatially unattended. Participants simultaneously heard gender-specific male or female adaptor voices in one ear and gender-neutral (androgynous) adaptor voices in the contralateral ear. They selectively attended to the adaptor voices in a designated ear, by either classifying voice gender (Exp. 1) or spoken syllable (Exp. 2). Voice aftereffects were found only if the gender-specific voices were spatially attended, suggesting capacity limits in the processing of voice gender for the unattended ear. Remarkably, gender-specific adaptors in the attended ear elicited comparable aftereffects in test voices, regardless of prior attention to voice gender or phonetic content. Thus, within the attended ear, voice gender was processed even when it was irrelevant for the task at hand, suggesting automatic processing of gender along with linguistic information. Overall, voice gender adaptation requires spatial, but not dimensional, selective attention.     

Inner speech as a learned skill

Three experiments are reported which address the problem of defining a role for inner speech. Experiments 1 and 2 establish that inner speech is acquired by normally developing readers between the ages of 8 and 11, and that both slow and fast readers show a similar pattern of acquistition, but do so at a different rate from normal readers. We suggest that the development of inner speech accompanies a strategy of reading aloud “with expression”; and that it is a manifestation of the need to prestructure oral utterances. These will thus contain the lexical items visible on the page within an appropriate prosodic envelope. Both segmental and suprasegmental phonemes contribute to meaning of spoken and, by analogy, written language. Experiment 3 showed that children at this critical point in learning to read comprehended text better when certain prosodic features were made visible on the text. Prosodic restructureing may thus be an important skill acquired by young readers as they progress toward fluent, silent adult reading.     

无关言语对阅读的干扰基于内容还是过程？——来自眼动研究的证据

采用眼动追踪技术,考察无关言语对句子材料相同的自然阅读和校对阅读的影响,探讨无关言语对阅读的干扰机制是基于内容还是过程。结果发现,有意义言语显著干扰了正常的阅读行为,而无意义言语与无背景音条件不存在显著差异。并且背景言语类型与任务类型的交互作用显著,表现为言语的语义成分只干扰了自然阅读,而对校对阅读没有影响。实验结果支持过程干扰假说。