Visual and verbal codes: Spatial information survives the icon

Three experiments are reported to demonstrate partial independence of identity and spatial position information concerning visually presented symbols. Experiment I shows that performance on these forms of information improves at different rates as a function of exposure duration. Experiment II shows that performance on one can be traded against the other. Experiment III demonstrates partial statistical independence of item and position responses and shows that increases in the duration and delay of the probe facilitate performance. Some implications of these experiments for theories involving mandatory verbal encoding of visual symbol-arrays are discussed. A model is proposed comprising visual and name stores with different acquisition rates and capacities. Both are indexed by identity but the visual code can also be interrogated by spatial cues.     

Multimodal access to verbal name codes

Congruent information conveyed over different sensory modalities often facilitates a variety of cognitive processes, including speech perception (Sumby & Pollack, 1954). Since auditory processing is substantially faster than visual processing, auditory-visual integration can occur over a surprisingly wide temporal window (Stein, 1998). We investigated the processing architecture mediating the integration of acoustic digit names with corresponding symbolic visual forms. The digits "1" or "2" were presented in auditory, visual, or bimodal format at several stimulus onset asynchronies (SOAs; 0, 75, 150, and 225 msec). The reaction times (RTs) for echoing unimodal auditory stimuli were approximately 100 msec faster than the RTs for naming their visual forms. Correspondingly, bimodal facilitation violated race model predictions, but only at SOA values greater than 75 msec. These results indicate that the acoustic and visual information are pooled prior to verbal response programming. However, full expression of this bimodal summation is dependent on the central coincidence of the visual and auditory inputs. These results are considered in the context of studies demonstrating multimodal activation of regions involved in speech production.     

Individual differences in phonological learning and verbal STM span

A relationship between phonological short-term memory tasks (e.g., nonword repetition, digit span) and vocabulary learning in both experimental and real-life conditions has been reported in numerous studies. A mechanism that would explain this correlation is, however, not known. The present study explores the possibility that it is the quality of phonological representations that affects both short-term recall and long-term learning of novel wordlike items. In Experiment 1, groups with relatively good and poor span for pseudowords were established. The good group was found to perform better at explicit memory tasks tapping the incidental learning of a limited stimulus pool used in an auditory immediate serial pseudoword recall task. In Experiment 2, the results of Experiment 1 were replicated when experience of correct recall was controlled. In Experiment 3, the immediate recall performance of the good group was found to benefit more than that of the poor group from syllable repetition within stimulus pools. It is concluded that the efficiency of a process that creates phonological representations is related both to short-term capacity for verbal items, and to long-term phonological learning of the structure of novel phonological items.     

STM capacity for Chinese and English language materials

This paper delineates the theoretical implications of a program of research on short-term memory using Chinese characters as stimuli, and compares the findings with studies of short-term memory that use English language materials. The 14 experiments on which it is principally based, carried out in the People’s Republic of China and in the U.S.A., are reported in detail in Yu et al. (1984), W. Zhanget al. (1984), and G. Zhang and Simon (this issue). One major theoretical product of this research is an experimentally tested model that reconciles the chunking theory of STM capacity with the articulatory loop theory of Baddeley, making good quantitative predictions of capacity compatible with both. Another result, obtained by using homophones as stimuli, is a demonstration that STM is mainly acoustically encoded, but that there are an additional two or three chunks of visually or semantically encoded short-term memory available. Chunks are shown to play the same role in immediate recall and rote learning in both the Chinese language and English language stimuli; and STM capacity, measured in chunks, is essentially the same for materials in both languages.     

Repetition and verbal STM in transcortical sensory aphasia: a case study

The repetition performance of a patient (S.T.) with transcortical sensory aphasia is examined in four experiments with particular emphasis on the STM capacities underlying her performance. S.T.'s repetition of word strings exceeding her span (two words) is characterized by good recall of the final items and a strong tendency to lose the initial items in the input string. This pattern contrasts with the serial position effects observed in a phonologically based STM impairment, and it is suggested that a lexical-semantic impairment, also evident in S.T.'s naming and lexical comprehension, contributes to her inability to retain the primacy portions of the input string. Lexical effects obtained in her reproduction of words and nonwords, as well as word strings (Experiments 1 and 2), indicate that under conditions of impaired semantics S.T. is relying on lexical phonological information to repeat. Priming by repeated exposure (Experiment 3) failed to improve her repetition performance, indicating that access to lexical information is brief and dependent on recent phonological input. In Experiment 4, the role of syntactic structure in S.T.'s sentence repetition was examined, and it was shown that syntactic structure affects the recall of order information, but not the number of items recalled. The repetition and verbal STM abilities of this patient, in light of her total language profile, are then evaluated in the context of a language-based view of verbal STM.     

Effect of uncertainty on the time course for selection of verbal name codes

Response selection takes time. Hick's law (Hick, 1952) predicts that the time course of response selection is a logarithmic function of the number of equally likely response alternatives. However, recent work has shown that oculomotor responses constitute noteworthy exceptions in that the latencies of saccades (Kveraga, Boucher, & Hughes, 2002) and smooth pursuit movements (Berryhill, Kveraga, Boucher, & Hughes, 2004) are completely independent of response uncertainty. This finding extends to the case in which the required response was known in advance (i.e., simple reaction times [RTs] were equivalent to choice RTs). In view of these results, we reevaluated reports that latencies to name visually presented digits (Experiment 1) and/or repeat aurally presented digits (Experiment 2) are similarly independent of the size of the response set. We found that naming latencies were equivalent for response set sizes from one to eight, but simple RTs (response set of one) were faster. Thus, the overlearned task of digit naming is indeed highly automatic but has not reached the level of automaticity characteristic of the oculomotor system.     

STM capacity for Chinese words and idioms: Chunking and acoustical loop hypotheses

The capacity of short-term memory (STM) for verbal materials depends both upon the number of familiar chunks and upon the average complexity (number of syllables) of the chunks. A model that predicts STM capacity well was built, incorporating these two factors, for a number of experiments that used both Chinese and English language materials. One experiment, which used Chinese homophones, showed that STM has a nonacoustical (visual or semantic) component as well as an acoustical one. STM capacity for material encoded nonphonologically appears to be no greater than three chunks, whereas acoustical STM has a capacity of up to seven chunks. This result was confirmed by an experiment using chunks (radicals) that do not possess highly familiar one-syllable names.     

Worry in imagery and verbal form: effect on residual working memory capacity

Worry-prone individuals have less residual working memory capacity during worry compared to low-worriers (Hayes, Hirsch, & Mathews, 2008). People typically worry in verbal form, and the present study investigated whether verbal worry depletes working memory capacity more than worry in imagery-based form. High and low-worriers performed a working memory task, random interval generation, whilst thinking about a worry in verbal or imagery form. High (but not low) worriers had less available working memory capacity when worrying in verbal compared to imagery-based form. The findings could not be accounted for by general attentional control, amount of negatively-valenced thought, or appraisals participants made about worry topics. The findings indicate that the verbal nature of worry is implicated in the depletion of working memory resources during worry among high-worriers, and point to the potential value of imagery-based techniques in cognitive-behavioural treatments for problematic worry.     

Structure and limited capacity in verbal working memory: a study with event-related potentials

In order to test recent claims about the structure of verbal working memory, two ERP experiments with Dutch speaking participants were carried out. We compared the ERP effects of syntactic and semantic mid-sentence anomalies in subject and object relative sentences. In Experiment 1, the participants made acceptability judgments, while in Experiment 2 they read for comprehension. Syntactic anomalies concerned subject-verb disagreement, while semantic anomalies were related to implausible events (e.g., *The cat that fled from the mice ran through the room). Semantic anomalies did not elicit an N400 effect. The semantic as well as syntactic anomalies elicited P600 effects, with similar centro-parietal scalp distributions. For both kinds of anomaly, the P600 effects were modulated by syntactic complexity: they were either relatively small (Experiment 1) or absent (Experiment 2) in object relative sentences. Taken together, our results suggest that: (a) verbal working memory is a limited capacity system; (b) it is not subdivided into an interpretative and a post-interpretative component (); (c) the P600 can reflect the presence of a semantic bias in syntactically unambiguous sentences; (d) the P600 is related to language monitoring: its function is to check upon the veridicality of an unexpected (linguistic) event; (e) if such a check is made, there is no integration of the event and hence no N400 effect.     

Core verbal working-memory capacity: The limit in words retained without covert articulation

Verbal working memory may combine phonological and conceptual units. We disentangle their contributions by extending a prior procedure (Chen & Cowan, 2005 Chen, Z. and Cowan, N. 2005. Chunk limits and length limits in immediate recall: A reconciliation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31: 1235–1249. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) in which items recalled from lists of previously seen word singletons and of previously learned word pairs depended on the list length in chunks. Here we show that a constant capacity of about 3 chunks holds across list lengths and list types, provided that covert phonological rehearsal is prevented. What remains is a core verbal working-memory capacity.     

Disruption of verbal STM by irrelevant speech, articulatory suppression, and manual tapping: Do they have a common source?

Under appropriate conditions, immediate serial verbal recall is impaired by irrelevant speech, articulatory suppression, and syncopated tapping. Interpretation of these variables in terms of the phonological loop component of working memory assumes separate phonological storage and articulatory rehearsal processes. In contrast, the Object-Oriented Episodic Record (O-OER) of Jones and the feature theory of Neath interpret these and other phenomena in terms of a unitary multimodal system. Three experiments investigate these disrupting tasks, with each experiment emphasizing one parameter. In each case, recall of phonologically similar and dissimilar letter sequences is compared as a marker of the presence or absence of phonological coding. In Experiment 1, subjects heard or articulated a single item, or tapped a single key at equal intervals. Only articulatory suppression impaired performance; it also abolished the effects of phonological similarity. Experiment 2 was identical, except that items were heard, or generated in a syncopated rhythm. Both suppression and tapping impaired performance to an equivalent extent and obliterated the effect of phonological similarity. Syncopated irrelevant speech caused a modest but significant impairment in performance. Experiment 3 was identical to Experiment 1, except that six tokens were used. Irrelevant speech and tapping had a clear impact on recall, but neither removed the phonological similarity effect. Again articulatory suppression had a major impact on performance and removed the effect of phonological similarity. We conclude that the pattern of results readily fits the phonological loop hypothesis, provided one accepts Saito's proposal that generating syncopated sequences uses common processes with speech production. It is not clear how the results can be explained by either the O-OER or the feature hypothesis.     

The generality of working memory capacity: a latent-variable approach to verbal and visuospatial memory span and reasoning

A latent-variable study examined whether verbal and visuospatial working memory (WM) capacity measures reflect a primarily domain-general construct by testing 236 participants in 3 span tests each of verbal WM. visuospatial WM, verbal short-term memory (STM), and visuospatial STM. as well as in tests of verbal and spatial reasoning and general fluid intelligence (Gf). Confirmatory' factor analyses and structural equation models indicated that the WM tasks largely reflected a domain-general factor, whereas STM tasks, based on the same stimuli as the WM tasks, were much more domain specific. The WM construct was a strong predictor of Gf and a weaker predictor of domain-specific reasoning, and the reverse was true for the STM construct. The findings support a domain-general view of WM capacity, in which executive-attention processes drive the broad predictive utility of WM span measures, and domain-specific storage and rehearsal processes relate more strongly to domain-specific aspects of complex cognition.     

Effects of verbal imitation and comprehension training on verbal production

This study sought to determine whether some combination of imitation training and comprehension training was necessary to achieve verbal production or whether comprehension training alone was sufficient to result in verbal production. Fifty-one first- and second-grade subjects were trained to imitate eight words (Spanish nouns) for which there were no referents. An additional set of eight words was trained in a comprehension task where overt verbal rehearsal was prohibited. Once criterion of two successive sessions of 100% performance was reached in training for both imitation and comprehension, training modes were reversed so that items initially trained in imitation were then trained in comprehension andvice versa. Results showed that initial comprehension training did result in some verbal production, whereas initial imitation training, as expected, did not. A marked improvement in verbal production performance was observed when initial comprehension training was followed by imitation training. When initial imitation training was followed by comprehension training, verbal production also resulted but not to the degree or with the consistency of performance which marked the comprehension-then-imitation sequence. Furthermore, comprehension training required more trials to reach a similar level of proficiency when it followed imitation training than when it preceded imitation. These data indicate that initial imitation training interferes with acquisition of subsequent comprehension and production responses and that the preferred training sequence is one which initially focuses on comprehension and follows this with verbal imitation.This study was supported by Grant HD 00870 from the National Institute of Child Health and Human Development and Grant NS 10468 from the National Institute of Neurological Diseases and Stroke awarded to the Bureau of Child Research, University of Kansas, Lawrence, Kansas.     

The role of verbal ability in the processing of complex verbal information

Summary This study investigated the relation between psychometric mental-ability test scores and several reaction-time measures; a simple-reaction task, a choice-reaction task, the Posner and Mitchell (1967) letter-identification task, and a variation of the sentence-verification task. Scores on the Raven Advanced Progressive Matrices and the Verbal Subtest of the Scholastic Aptitude Test (SATV) were obtained. The less complex information-processing tasks replicate earlier studies in which general intelligence was only marginally related to reaction-time measures. The sentence-verification task systematically varied task complexity. Several direct and derived measures from the task were significantly correlated with psychometric mentalability measures. However, even though a number of precautions were taken to ensure that the sentence-verification task assessed purely verbal-processing efficiency, there was little evidence for an important task-specific relation between verification measures and verbal ability. Moreover, despite its relative verbal complexity, sentence verification did not reflect a greater relationship to verbal ability than other tasks did. Overall, the information-processing efficiency measures used in this study suggested a fairly general, rather than a task-specific, relationship to intellectual ability.The research presented in this paper was conducted while the first author was affiliated with the University of Georgia, U. S. A.     

Mixing location-relevant and irrelevant tasks: Spatial compatibility effects eliminated by stimuli that share the same spatial codes

If compatible and incompatible mappings of left-right stimuli to left-right keypresses are mixed such that participants must maintain both task sets, the typical stimulus-response compatibility (SRC) effect is eliminated. Four experiments examined whether the SRC effect is influenced similarly by inclusion of trials on which stimulus location is irrelevant. The SRC effect for the location-relevant trials was eliminated in Experiments 1 and 3 when those trials shared left-right codes with the location-irrelevant trials. The SRC effect was not eliminated in Experiments 2 and 4, in which the location-relevant stimuli varied along the left-right dimension but the location-irrelevant stimuli were presented in the centre of the screen or in top-bottom locations. The Simon effect for the location-irrelevant trials in Experiments 1 and 3 was positive when the location-relevant mapping was compatible and reversed when it was incompatible. The results are generally consistent with an alternative-routes model, according to which a direct response-selection route is suppressed when compatible trials are mixed with location-irrelevant trials. Repetition analyses suggest that this suppression does not vary on a trial-to-trial basis.