Memory and encoding of spoken discourse following right hemisphere damage: evidence from the Auditory Moving Window (AMW) technique

We investigated the hypotheses that impaired discourse processing following right hemisphere damage is mediated by task difficulty and is associated with deficits in discourse encoding. Spoken discourse passages differing in contextual predictability were presented to right hemisphere-damaged (RHD) patients and to non-brain-damaged (NBD) controls for subsequent recall using the Auditory Moving Window paradigm. To manipulate processing difficulty, speech segments were of normal or accelerated speech rates. The recall results showed that RHD adults recalled less than NBD controls overall and failed to recall major idea units better than minor idea units for high predictability passages presented at accelerated speech rates. Both RHD patients and NBD controls failed to recall major idea units better than minor idea units for low predictability passages, regardless of speech rate. The encoding results showed that RHD adults were both slower overall and differentially slower than NBD controls when listening to accelerated passage segments. Taken together, the encoding and recall results are consistent with the view that extracting passage gist under difficult listening conditions is especially vulnerable for patients with right hemisphere strokes.     

Neural substrates of linguistic prosody: evidence from syntactic disambiguation in the productions of brain-damaged patients

The present investigation focussed on the neural substrates underlying linguistic distinctions that are signalled by prosodic cues. A production experiment was conducted to examine the ability of left- (LHD) and right- (RHD) hemisphere-damaged patients and normal controls to use temporal and fundamental frequency cues to disambiguate sentences which include one or more Intonational Phrase level prosodic boundaries. Acoustic analyses of subjects' productions of three sentence types-parentheticals, appositives, and tags-showed that LHD speakers, compared to RHD and normal controls, exhibited impairments in the control of temporal parameters signalling phrase boundaries, including inconsistent patterns of pre-boundary lengthening and longer-than-normal pause durations in non-boundary positions. Somewhat surprisingly, a perception test presented to a group of normal native listeners showed listeners experienced greatest difficulty in identifying the presence or absence of boundaries in the productions of the RHD speakers. The findings support a cue lateralization hypothesis in which prosodic domain plays an important role.     

Reaction times in the study of strategies in sentence-picture verification: A reconsideration

Investigations of cognitive strategies based on chronometric data may appear to contradict findings from verbal-report-based approaches. These inconsistencies may be due to misuse of RTs to infer subjects' behaviour. To test this hypothesis, 15 subjects were successively required to adopt 4 different strategies in a sentence-picture verification task. Trend analyses provide evidence that (1) highly dissimilar strategies can nevertheless yield similar mean RT curves as well as similar individual subjects' RT curves; (2) subjects using similar strategies can produce individual RT curves presenting vastly different features due partly to random variation and partly to idiosyncrasies. These findings suggest that RTs are an unreliable behavioural indicator for inferring individual or group strategies on certain experimental tasks and should be analysed in conjunction with other sources of information. An approach consisting of using RTs to test hypotheses based on subjects' verbal reports is described along with the appropriate controls. Results show that this approach provides an improved account for observed RTs.     

Sources of performance on theory of mind tasks in right hemisphere-damaged patients

Patients with right hemisphere (RHD) or left hemisphere brain damage (LHD) were tested on Theory of Mind (ToM) tasks presented with visual aids that illustrated the relevant premises. As a measure of pragmatic ability, patients were also asked to judge replies in conversation that violated Gricean maxims. Both RHD and LHD patients performed well on the ToM tasks presented with visual aids, but RHD patients displayed difficulty when the same tasks were presented only verbally. In addition, RHD patients showed reduced sensitivity to pragmatic violations. These findings point to the role of right hemisphere structures in processing information relevant to conversations. They indicate that a crucial source of RHD patients' errors in ToM tasks may involve difficulties in utterance interpretation owing to impairments of visuospatial processing required for the representation of textual information.     

高功能孤独症者非字面语义理解缺陷：隐喻视角的ERP研究

研究采用事件相关电位技术从隐喻语义理解角度考察了高功能孤独症成人非字面语义理解中的行为特点及脑半球参与模式。行为结果显示：高功能孤独症成人对新异隐喻句的反应时最长,两类隐喻句的反应时均长于普通成人,但错误率上两组被试间无差异。脑电结果显示：高功能孤独症组对新异隐喻句的N400波幅最大,未出现半球偏侧化现象,传统隐喻句在左半球的N400波幅大于右半球,两类隐喻句的N400波幅均大于正常被试。结论：高功能孤独症成人具备隐喻理解能力,并对新异隐喻的理解做出更多努力,但右脑功能异常仍旧存在,左右半球在总体功能或神经联通性上仍旧弱于常人。     

Characterizing sentence intonation in a right hemisphere-damaged population

Current production studies present a mixed view of right hemisphere-damaged (RHD) patients' ability to produce normal sentence intonation. The present study characterized the sentence intonation of RHD patients, focusing on a greater number of acoustic parameters than past works, and relying on more naturally elicited speech samples through use of a story completion task. Eight RHD speakers and seven nonneurological control subjects produced declarative and imperative sentences as well as yes-no and wh-questions. Slope of F0 change, linearity of pitch contour, and variance of F0 points were calculated for each utterance as a whole, as well as for the preterminal and the terminal contour separately. RHD contours were less linear and flatter in F0 decline than normal controls for the declarative sentences. The patients' yes-no questions also differed from normal productions, displaying smaller F0 dispersion around a mean F0. Preterminal range values were more restricted for patients' utterances of yes-no questions, while terminal properties between groups differed for three of the four sentence types examined. The present results suggest some disturbance in the patients' ability to manipulate fundamental frequency across sentential domains. These data are discussed in terms of current theories of a general dysprosody in RHD patients.     

Autobiographical memory: influence of right hemisphere damage on emotionality and specificity

This study investigated the ability of right hemisphere damaged (RHD) patients to recall autobiographical material in response to emotional versus nonemotional cues. A modified Crovitz paradigm was used in which patients were asked to recall a specific episode from their own life that related to a cue word. These episodes were rated for emotionality and specificity by independent raters. Patients also rated the emotionality of their own episodes. Independent raters judged the reports of the RHD patients as less specific and less emotional than those of matched nonneurologic control subjects. This was true for episodes in response to emotional as well as nonemotional cue words. RHD patients' own ratings of these episodes, however, did not differ from those of controls. These findings are discussed in terms of RHD patients' overall difficulties in processing emotional material and in terms of the nature of autobiographical memory.     

Reaction time and movement time as measures of stimulus evaluation and response processes

Reaction time has been divided into the time to initiate a response (RT) and the time to execute the motor response (MT) in many chronometric studies of intelligence. Our purpose was to determine which cognitive processes are reflected by RT and MT. To accomplish this, the latency of the P300 wave of the event-related potential was recorded concurrently with RT and MT measures in three experiments. P300 latency reflects the duration of stimulus evaluation relatively independently of response processes. In the first experiment, a Sternberg memory task was employed to manipulate stimulus classification requirements. In the second, the subjects' emphasis on either speed or accuracy of responding was examined during a task that also manipulated stimulus evaluation time. In the third experiment, a Stroop-like task was used to examine response processes. RT and P300 latency varied with manipulations of stimulus evaluation time, whereas MT varied with difficulty of motor execution. MT was also affected by stimulus classification processes. Both RT and MT were sensitive to processes involved in response bias and preparation. The possibility that the correlations of RT and MT with measures of intelligence are due to effects on a common stage of information processing cannot be rejected in the light of these results.     

Context use by right-hemisphere-damaged individuals under a compressed speech condition

The effect of increased processing demands on context use by RHD individuals was examined using a word-monitoring task. Subjects were required to monitor for a target word in sentences that were either normal, semantically anomalous, or both syntactically and semantically anomalous. Stimuli were presented at two rates of speech--normal and compressed to 70% of normal. Contrary to expectations, the RHD group performed similar to normals in demonstrating an effect of context at both rates of speech. Results are discussed relative to recent studies of normal brain functioning that suggest that the involvement of the LH versus the RH in context use depends upon the type of contextual information being processed.     

Processing of faces by patients with unilateral hemisphere lesions. I. Dissociation between judgments of facial affect and facial identity

In this study, right-hemisphere-damaged (RHD) subjects performed significantly worse than LHD and NHD controls across a series of seven facial identity and facial affect tasks. Even when the patient groups were statistically equated on a measure of visuoperceptual ability, the RHD group remained impaired on three emotional tasks--naming, picking, and discriminating emotional faces. These findings suggest that the defects shown by RHD patients on facial affect tasks cannot be solely attributed to defects in visuoperceptual processing and that the right-hemisphere superiority for processing facial affect exists above and beyond its superiority for processing facial identity.     

Conditional advice and inducements: are readers sensitive to implicit speech acts during comprehension?

Conditionals can implicitly convey a range of speech acts including promises, tips, threats and warnings. These are traditionally divided into the broader categories of advice (tips and warnings) and inducements (promises and threats). One consequence of this distinction is that speech acts from within the same category should be harder to differentiate than those from different categories. We examined this in two self-paced reading experiments. Experiment 1 revealed a rapid processing penalty when inducements (promises) and advice (tips) were anaphorically referenced using a mismatching speech act. In Experiment 2 a delayed penalty was observed when a speech act (promise or threat) was referenced by a mismatching speech act from the same category of inducements. This suggests that speech acts from the same category are harder to discriminate than those from different categories. Our findings not only support a semantic distinction between speech act categories, but also reveal pragmatic differences within categories.     

Gaze behavior in audiovisual speech perception: the influence of ocular fixations on the McGurk effect

We conducted three experiments in order to examine the influence of gaze behavior and fixation on audiovisual speech perception in a task that required subjects to report the speech sound they perceived during the presentation of congruent and incongruent (McGurk) audiovisual stimuli. Experiment 1 showed that the subjects' natural gaze behavior rarely involved gaze fixations beyond the oral and ocular regions of the talker's face and that these gaze fixations did not predict the likelihood of perceiving the McGurk effect. Experiments 2 and 3 showed that manipulation of the subjects' gaze fixations within the talker's face did not influence audiovisual speech perception substantially and that it was not until the gaze was displaced beyond 10 degrees - 20 degrees from the talker's mouth that the McGurk effect was significantly lessened. Nevertheless, the effect persisted under such eccentric viewing conditions and became negligible only when the subject's gaze was directed 60 degrees eccentrically. These findings demonstrate that the analysis of high spatial frequency information afforded by direct oral foveation is not necessary for the successful processing of visual speech information.     

Evaluation and integration of speech and pointing gestures during referential understanding

Two experiments investigated the relative influence of speech and pointing gesture information in the interpretation of referential acts. Children averaging 3 and 5 years of age and adults viewed a videotape containing the independent manipulation of speech and gestural forms of reference. A man instructed the subjects to choose a ball or a doll by vocally labeling the referent and/or pointing to it. A synthetic speech continuum between two alternatives was crossed with the pointing gesture in a factorial design. Based on research in other domains, it was predicted that all age groups would utilize gestural information, although both speech and gestures were predicted to influence children less than adults. The main effects and interactions of speech and gesture in combination with quantitative models of performance showed the following similarities in information processing between preschoolers and adults: (1) referential evaluation of gestures occurs independently of the evaluation of linguistic reference; (2) speech and gesture are continuous, rather than discrete, sources of information; (3) 5-year-olds and adults combine the two types of information in such a way that the least ambiguous source has the most impact on the judgment. Greater discriminability of both speech and gesture information for adults compared to preschoolers indicated small quantitative progressions with development in the ability to extract and utilize referential signals.     

Speech act conditions as tools for reconstructing argumentative discourse

According to the pragma-dialectical approach to argumentation, for analysing argumentative discourse, a normative reconstruction is required which encompasses four kinds of transformations. It is explained in this paper how speech act conditions can play a part in carrying out such a reconstruction. It is argued that integrating Searlean insights concerning speech acts with Gricean insights concerning conversational maxims can provide us with the necessary tools. For this, the standard theory of speech acts has to be amended in several respects and the conversational maxims have to be translated into speech act conditions. Making use of the rules for communication thus arrived at, and starting from the distribution of speech acts in a critical discussion as specified in the pragma-dialectical model, it is then demonstrated how indirect speech acts are to be transformed when reconstructing argumentative discourse.     

Musical ability and non‐native speech‐sound processing are linked through sensitivity to pitch and spectral information

Is the observed link between musical ability and non‐native speech‐sound processing due to enhanced sensitivity to acoustic features underlying both musical and linguistic processing? To address this question, native English speakers (N = 118) discriminated Norwegian tonal contrasts and Norwegian vowels. Short tones differing in temporal, pitch, and spectral characteristics were used to measure sensitivity to the various acoustic features implicated in musical and speech processing. Musical ability was measured using Gordon's Advanced Measures of Musical Audiation. Results showed that sensitivity to specific acoustic features played a role in non‐native speech‐sound processing: Controlling for non‐verbal intelligence, prior foreign language‐learning experience, and sex, sensitivity to pitch and spectral information partially mediated the link between musical ability and discrimination of non‐native vowels and lexical tones. The findings suggest that while sensitivity to certain acoustic features partially mediates the relationship between musical ability and non‐native speech‐sound processing, complex tests of musical ability also tap into other shared mechanisms.     

Inference deficits in right brain-damaged patients

The inferential reasoning ability of right hemisphere-damaged (RHD) patients was tested by presenting pairs of sentences which were to be treated as single, integrated units. The two sentences treated together made one interpretation likely (a correct inference); one of the sentences in isolation encouraged a different interpretation (an incorrect inference). The position of the misleading sentence was systematically varied. Results showed that, in contrast to normal controls, RHD patients have more trouble answering inference questions, especially those concerning incorrect inferences, than answering questions about the factual content of the passages. Also, RHD patients made significantly more errors when the misleading information was contained in the first rather than in the second sentence; this finding indicates that these patients have difficulty revising previously acquired knowledge in light of new information. These results suggest the impairment of several components of normal discourse processing subsequent to right hemisphere brain damage.     

Segmentation of speech in a foreign language

The subjects' ability to segment foreign speech was examined. Naturalness judgments regarding three syntactically defined pauses [between constituents (noun and verb phrases), words, or syllables] were obtained using a paired-presentation, forced-choice paradigm. It was hypothesized that segmentation skill developed through exposure to lexical and syntactic markers. Teh existence and effect of such markers was investigated by assigning subjects to various exposure conditions.Results indicated that lexical and syntactic markers exist and can be utilized by subjects in segmenting speech. Contrary to previous research, however, exposure did not facilitate performance. All groups discriminated constituents from either words or syllables, and words from syllables. Results were interpreted as reflecting the interdependence of syntax and suprasegmental phonology. Results challenged the credibility of traditional associationist accounts of language acquisition and speech perception. Results were discussed in the context of Martin's theory of the rhythmic structure of speech.     

The role of the right hemisphere in the production of linguistic stress

Recent research has proposed a general prosodic disturbance associated with right hemisphere damage (RHD), one encompassing both affective and linguistic functions. The present study attempted to explore whether the ability to produce linguistic prosody was impaired in this patient population. Productions of phonemic stress tokens (e.g., Re'dcoat vs. red coa't) as well as examples of contrastive stress, or sentential emphasis (e.g., Sam hated the movie), were elicited from eight male speakers with unilateral right hemisphere CVAs and seven male control subjects. Two types of analyses were conducted on these utterances. Acoustic analysis focused on the correlates associated with word stress, namely changes in amplitude, duration, and fundamental frequency. The perceptual saliency of emerging cues to stress was also examined by presentation of test tokens to phonetically trained listeners for identification of stress placement. The patients as a group produced fewer acoustic cues to stress compared to the normal subjects, but no statistical differences were found between groups for either stress at the phrase level or at the sentence level. In the perceptual analysis, stress produced by the patient group was judged to be less salient than that for the normal group, although a high degree of variability was evident in both populations. The data suggest a spared processing mechanism for linguistic prosody in RHD speakers, thus mitigating against the view of a general dysprosody tied to RHD.     

Recognition and discrimination of emotional faces and pictures

In order to learn whether patients with right-hemisphere disease (RHD) had a deficit in their ability to discriminate and comprehend emotional faces and pictures, we studied nine patients with RHD, nine patients with left-hemisphere disease (LHD), and nine controls. The subjects were presented with six picture tests that comprised either emotional faces or emotional scenes. Their task was either to denote (name or choose) an emotion or to discriminate (same, different) between two faces or emotions. Patients with RHD performed significantly worse than subjects with LHD when asked to discriminate between faces, to discriminate between emotional faces, and to name emotional scenes. There was also a trend for the RHD group to be more impaired than the LHD group when asked to name the emotional face or choose the emotional face. Except for the facial and emotional discrimination tests, the LHD patients also performed worse than controls.