Mental animation in the visuospatial sketchpad: Evidence from dual-task studies

We used the dual-task paradigm to provide evidence that inferring the motion of a component of a mechanical system (mental animation) is a spatial visualization process. In two experiments, participants were asked to solve mental animation problems while simultaneously retaining either a visuospatial working memory load (a configuration of dots in a grid) or a verbal memory load (a list of letters). Both experiments showed that mental animation interferes more with memory for a concurrent visuospatial load than with memory for a verbal load. Experiment 1 also showed that a visuospatial working memory load interferes more with mental animation than does a verbal memory load. Furthermore, Experiment 2 showed that mental animation interferes more with a visuospatial memory load than does a verbal reasoning task that takes approximately the same amount of time.     

The Measurement of Verbal Working Memory Capacity and Its Relation to Reading Comprehension

Ninety-four subjects were tested on the Daneman and Carpenter (1980) reading span task, four versions of a related sentence span task in which reaction times and accuracy on sentence processing were measured along with sentence-final word recall, two number generation tasks designed to test working memory, digit span, and two shape-generation tasks designed to measure visual-spatial working memory. Forty-four subjects were retested on a subset of these measures at a 3-month interval. All subjects were tested on standard vocabulary and reading tests. Correlational analyses showed better internal consistency and test-retest reliability of the sentence span tasks than of the Daneman-Carpenter reading span task. Factor analysis showed no factor that could be related to a central verbal working memory; rotated factors suggested groupings of tests into factors that correspond to digitrelated tasks, spatial tasks, sentence processing in sentence span tasks, and recall in sentence span tasks. Correlational analyses and regression analyses showed that the sentence processing component of the sentence span tasks was the best predictor of performance on the reading test, with a small independent contribution of the recall component. The results suggest that sentence span tasks are unreliable unless measurements are made of both their sentence processing and recall components, and that the predictive value of these tasks for reading comprehension abilities lies in the overlap of operations rather than in limitations in verbal working memory that apply to both.     

Sentence comprehension in Parkinson's disease: the role of attention and memory.

Sentence comprehension is a complex process involving at least attentional, memory, grammatical, and semantic components. We report three experiments designed to evaluate the impairments underlying sentence comprehension difficulties in nondemented patients with Parkinson's disease (PD). In the first experiment, we asked patients to answer simple questions about sentences which varied in terms of grammatical complexity and semantic constraint. We found that PD patients are significantly compromised in their ability to perform this task. Their difficulties became more prominent as grammatical complexity increased, but they were significantly assisted by semantic constraints that limited possible interpretations of a sentence. Analyses of individual patient profiles revealed heterogeneous performance across the group of PD patients and somewhat inconsistent performance for patients across testing sessions. In the second experiment, we tested the possibility that patients' heterogeneous performance on the sentence comprehension task is due to an impairment in memory or attention, cognitive domains known to be compromised in some PD patients. Although PD patients and control subjects differed on one memory measure, there were no significant correlations between attention and memory performance and the results of the sentence comprehension task. In the final experiment, we manipulated the sentences used in the first experiment in a fashion that stressed the need for memory and attention in a sentence. The results indicated that PD patients are significantly compromised in their ability to attend to certain critical grammatical features of a sentence. A regression analysis identified specific grammatical, semantic, and attentional mechanisms as significant contributors to PD patients' overall sentence comprehension, accounting for over 97% of the variance in their performance. We conclude that there are multiple sources of cognitive difficulty underlying PD patients' sentence comprehension impairment.     

Visuospatial working memory and mental representation of spatial descriptions

The purpose of the present research is to investigate whether different components of working memory (WM) are involved in processing spatial and nonspatial texts. The interference effects of two concurrent tasks on comprehension and recall of two kinds of text were investigated in two experiments. Each participant listened to a spatial and a nonspatial text, with one of two concurrent tasks: articulatory suppression or spatial tapping. The dependent variables in Experiment 1 were accuracy of recall and verification of information inferred from the texts. In Experiment 2 response times in the verification task were also considered. Results support the hypothesis that verbal and spatial components of working memory are differentially involved in the comprehension and memory of spatial and nonspatial texts, with a selective interference effect of the spatial concurrent task on the spatial text and an interference effect of the verbal concurrent task on both the spatial and nonspatial texts. These effects emerged for recall, sentence verification, and response times. Our findings confirm previous results showing that the verbal component of working memory is involved in the process of text comprehension and memory. In addition, they show that visuospatial working memory is involved, in so far as the text conveys visuospatial information.     

On-line syntactic processing in aphasia: studies with auditory moving window presentation

Twenty-eight aphasic patients with left hemisphere strokes and matched control subjects were tested on an auditory moving windows task in which successive phrases of a sentence were presented in response to subjects' self-paced button presses and subjects made timed judgments regarding the plausibility of each sentence. Pairs of sentences were presented that differed in syntactic complexity. Patients made more errors and/or took longer in making the plausibility judgments than controls, and were more affected than controls by the syntactic complexity of a sentence in these judgments. Normal subjects showed effects of syntactic structure in self-paced listening. On-line syntactic effects differed in patients as a function of their comprehension level. High-performing patients showed the same effects as normal control subjects; low performing patients did not show the same effects of syntactic structure. On-line syntactic effects also differed in patients as a function of their clinical diagnosis. Broca's aphasic patients' on-line performances suggested that they were not processing complex syntactic structures on-line, while fluent aphasics' performances suggested that their comprehension impairment occurred after on-line processing was accomplished. The results indicate that many aphasic patients retain their ability to process syntactic structure on-line, and that different groups of patients with syntactic comprehension disorders show different patterns of on-line syntactic processing.     

An extension of the conflict between visualization and reading

An experiment is reported which suggests that reading about a series of spatial relations and visualizing them are activities which interfere with one another. Subjects were given sentences which described a set of spatial relations. After the spatial layout described by a given sentence had been deduced, the subjects either read or listened to a final presentation of this same sentence. It was found that the modality of this final presentation influenced the speed with which the subjects performed a subsequent mental transformation of the spatial relations; the transformation was completed more slowly immediately after reading the sentence than after listening to it. This result confirms the subjects' reports that their visualization of the spatial relations was interrupted by reading the sentence, but not by listening to it. The relation between the visual and the analogical aspects of visualization is briefly discussed.     

理解能力不同的个体抑制干扰信息的效率

根据多媒语言理解测试 ,筛选出汉语综合理解能力高、低不同的两组被试 ,采用固定速移动窗口阅读与选择性再认相结合的实验范式 ,在两个实验中考察了两组被试在理解加工汉语双字词和两从句复合句的过程中对外在干扰信息的抑制效率。词汇加工与句子加工两个实验的结果一致表明 :不同语言理解能力的个体在抑制干扰信息的效率上存在差异 ,低理解能力者的抑制效率也较低 ;抑制效率受到干扰材料意义性的影响 ,越有意义的干扰越难以被抑制     

Verb processing during sentence comprehension: Contextual impenetrability

This paper examines verb processing during sentence comprehension. We describe two experiments that assess the interaction between verb complexity and the structural information contained in a sentence. Verb complexity is defined in terms of a verb's possible argument structure arrangements—linguistic information arrayed against a verb's entry in the mental lexicon. Normal subjects had to perform a secondary task presented in the immediate vicinity of the verb while listening to a sentence for meaning. Reaction times to this secondary task show that all of a verb's possible argument structures are momentarily and exhaustively activated in the vicinity of the verb, even in sentences that are structurally biased toward one particular argument structure. We thus argue that verb processing in sentences involves a contextually impenetrable subcomponent of the language comprehension system.Program in Linguistics and Cognitive Science, Department of Psychology, Brandeis University.     

Individual differences and task format in sentence verification

This study examined the effects of task format and individual differences in cognitive ability on performance of the sentence-picture verification task. Four groups of subjects were selected on the basis of their scores on psychometric tests of verbal and spatial ability: low verbal/low spatial, high verbal/high spatial, low verbal/high spatial, and high verbal/low spatial. Subjects completed four different versions of the sentence verification task, each version differing in terms of the interval between sentence and picture presentation. The results confirmed the importance of both task format and spatial ability in determining the cognitive strategy employed by subjects in carrying out the task. The finding of principal interest, however, was that spatial ability was the most significant determinant of strategy choice, and that low spatial subjects made substantial use of linguistic strategies under task formats designed to encourage imaginal strategies.     

Children's solution strategies and mental rotation: evidence for a developmental shift

We examined children's ability to anticipate the appearance of transformed multicomponents using visual stimuli with variations of a mental rotation task. We hypothesized that (a) performance would depend on the presence, location, and spatial relationship of specific stimulus features, and that (b) younger children would use a single component to make their predictions, whereas older children would be more likely to use multiple components. In Study 1, 40 first-, and fifth-grade subjects were presented with 32 rotation problems consisting of varied stimulus characteristics; subjects selected the correct option from a field where foils were indicative of the strategy used. Analyses of variance and log linear analyses revealed the hypothesized stimulus effect differentially associated with the children's ages. In Study 2, sixty 5-, 7-, and 9-year olds confronted 64 mental rotation problems with multicomponent stimuli and a construction task. Results and implications confirmed those of Study 1.     

The role of assembled phonology in reading comprehension

The contribution of assembled phonology to phonological effects in reading comprehension was assessed. In Experiment 1, subjects judged the acceptability of sentences with regular, exception, and nonword homophone substitutions and orthographic controls. Significantly more errors occurred to sentences with regular-word homophones than to exception words, and error rates for nonword homophones were low and not significant. Experiment 2 showed that this was not due to differences in the sentence frames. In Experiment 3, the subjects judged as unacceptable those sentences containing an exception word that sounded correct when read according to spelling-to-sound rules. Significantly higher error rates occurred only for low-frequency exception words. Experiment 4 showed that task conditions affect semantic-categorization error rates for nonword homophones. These results indicate that both assembled and addressed phonology contribute to sentence and word comprehension, but the low error rate for nonwords suggests that an early lexical check may be applied.     

Word order and finiteness in Dutch and English Broca's and Wernicke's aphasia

The effect of two linguistic factors in Broca's and Wernicke's aphasia was examined using Dutch and English subjects. Three tasks were used to test (1). the comprehension and (2). the construction of sentences, where verbs (in Dutch) and verb arguments (in Dutch and English) are in canonical versus non-canonical position; (3). the production of finite versus infinitive verbs. Proportions of errors as well as types of errors made by each aphasic group are similar on the sentence comprehension and sentence anagram tasks. On the verb production task the performance pattern is, again, the same, but the error types are different. The discussion focuses on how the similarities and differences across languages and across aphasia types may be interpreted with respect to the underlying deficit in Broca's and Wernicke's aphasia.     

Working memory components in written sentence generation

College students wrote either simple or complex sentences using 2 prompt nouns while components of working memory were distracted with a concurrent task. Loads on the visual and spatial components of working memory (retain a shape) and verbal component (retain 3 or 6 digits) were compared with a no-load control. Only the 6-digit load reliably reduced sentence length relative to the control, suggesting that unimpeded sentence generation requires verbal working memory. The sentence length effect may arise from a failure to retrieve and maintain lexical representations during grammatical encoding. Memory load had no effect on grammatical and spelling errors, implying that syntactic and orthographic processing were undisturbed. Other possibilities locate the difficulty in planning conceptual content or in phonological encoding, but some evidence speaks against them.     

Sentence Comprehension Deficits in Alzheimer''s Disease: A Comparison of Off-Line vs. On-Line Sentence Processing

Two studies explored whether sentence comprehension impairments in Alzheimer's disease (AD) are due to deficits in syntactic processing or memory. Study 1 used a picture-pointing sentence comprehension task to measure the final outcome of comprehension in an off-line fashion. It showed the comprehension of 30 patients with AD to be impaired, but suggested that the deficits could not be attributed solely to syntactic impairments. Study 2 investigated the effects of memory on sentence comprehension by comparing off-line (grammaticality judgment) with on-line (cross-modal naming) language processing in 11 AD and 9 control subjects. The results revealed impaired performance in the off-line task but normal performance in the on-line task using the same sentences. Performance on the off-line task correlated with independent measures of verbal working memory. These data are used to argue that sentence comprehension impairments are related to verbal working memory deficits in AD.     

Effects of verbal ability and fluid intelligence on children's emotion understanding

This study investigated the role of verbal ability and fluid intelligence on children's emotion understanding, testing the hypothesis that fluid intelligence predicts the development of emotion comprehension over and above age and verbal ability. One hundred and two children (48 girls) aged 3.6–6 years completed the Test of Emotion Comprehension (TEC) that comprised external and mental components, the Coloured Progressive Matrices and the Test for Reception of Grammar. Regression analysis showed that fluid intelligence was not equally related to the external and mental components of the TEC (Pons & Harris, 2000). Specifically, the results indicated that the external component was related to age and verbal ability only, whereas recognition of mental emotional patterns required abstract reasoning skills more than age and verbal ability. It is concluded that the development of fluid intelligence has a significant role in the development of mental component of emotion comprehension.     

Visuelle und räumliche Interferenzen beim Schlußfolgern

The present paper provides evidence for a differential involvement of spatial and visual mental resources in propositional and spatial reasoning. Two experiments consider the load on visuospatial working memory during reasoning. Subjects solve propositional and spatial reasoning tasks either alone or in combination with visual tracking. In the first experiment, subjects resource allocation strategy is manipulated. Independently of the allocation of mental resources to the reasoning tasks or the tracking task, tracking is found to interfere much more with spatial than with propositional reasoning. In the second experiment, propositional reasoning after a comprehension training is disrupted by a simultaneous secondary spatial task, but not by the visual tracking task.     

Task novelty and intelligence

Psychology students were presented with a mental puzzle based on knowledge of geometry, with several versions of Wason's selection task, and with some tasks of essay writing. Test scores were obtained on a sentence completion test and a test of spatial configuration. With the different problem-solving tasks, a relationship between success and intellectual ability was observed only in cases where the data indicated that the subjects were familiar with the task in question. The results support the theory previously set forth by Raaheim; that only in situations where the degree of novelty is moderate, will the intelligent use of past experience prove beneficial to problem solving.     

Concrete spatial language: see what I mean?

Conveying complex mental scenarios is at the heart of human language. Advances in cognitive linguistics suggest this is mediated by an ability to activate cognitive systems involved in non-linguistic processing of spatial information. In this fMRI-study, we compare sentences with a concrete spatial meaning to sentences with an abstract meaning. Using this contrast, we demonstrate that sentence meaning involving motion in a concrete topographical context, whether linked to animate or inanimate subjects nouns, yield more activation in a bilateral posterior network, including fusiform/parahippocampal, and retrosplenial regions, and the temporal-occipital-parietal junction. These areas have previously been shown to be involved in mental navigation and spatial memory tasks. Sentences with an abstract setting activate an extended largely left-lateralised network in the anterior temporal, and inferior and superior prefrontal cortices, previously found activated by comprehension of complex semantics such as narratives. These findings support a model of language, where the understanding of spatial semantic content emerges from the recruitment of brain regions involved in non-linguistic spatial processing.     

Age Differences in Learning from Instructional Animations

The present study tests the effects of the decline of executive functions and spatial abilities with aging on the comprehension of a complex instructional animation. An animation of a piano mechanism was presented individually to 33 young adults and 31 elderly participants. Two presentation speeds of the animation (normal and slow) were compared in a 2 × 2 experimental design. Eye movements were recorded during the learning time. Then, four executive function tests (inhibition, shifting, updating, and processing speed) and a spatial ability test (differential aptitude test) were undertaken by each participant. Results showed that the comprehension of animations was significantly affected by aging. Significant differences between young and old groups were found for executive functions and spatial abilities. Regressions on comprehension scores showed a strong significant effect of spatial ability. Like in previous research, presentation speed had no effect. Eye movement data showed this result was due to application of a compensation strategy. Copyright © 2015 John Wiley & Sons, Ltd.