The processing of structured and unstructured tonal sequences

The recall of hierarchically organized tonal sequences was investigated in two experiments. An adaptation of the technique of melodic dictation was employed, in which musically trained listeners notated each sequence after it was presented. Strong effects of sequence structure were obtained. Sequences whose tonal structure could be parsimoniously encoded in hierarchical fashion were recalled with a high level of accuracy. Sequences that could not be parsimoniously encoded produced substantially more errors in recall. Temporal segmentation was found to have a substantial effect on performance, which reflected grouping by temporal proximity regardless of tonal structure. The results provide evidence for the hypothesis that we encode tonal materials by inferring sequence structures and alphabets at different hierarchical levels, together with their rules of combination.     

Real-time examinations of lexical processing in aphasics

We argue that the lesion localizing value of disruptions to modular information processing systems emerges most clearly from on-line analyses of processing. In this respect we seek to show that left anterior (but not left posterior) damage causes slowed information access and we discuss the manner in which this slowing might yield some of the specific syntactic limitations charted in Broca's aphasia. The general possibility we raise is that the cortical area implicated in Broca's aphasia is not necessarily the locus of syntactic representations, but rather sustains particular time-based operating characteristics that in turn sustain normal real-time parsing.This research was supported in part by NIH grants NS11408 and NS06209 to Boston University School of Medicine and by the Research Service of the Veterans Administration.     

Phonological processing and lexical access in aphasia

This study explored the relationship between on-line processing of phonological information and lexical access in aphasic patients. A lexical decision paradigm was used in which subjects were presented auditorily with pairs of words or word-like stimuli and were asked to make a lexical decision about the second stimulus in the pair. The initial phonemes of the first word primes, which were semantically related to the real word targets, were systematically changed by one or more than one phonetic feature, e.g., cat-dog, gat-dog, wat-dog. Each of these priming conditions was compared to an unrelated word baseline condition, e.g., nurse-dog. Previous work with normals showed that even a nonword stimulus receives a lexical interpretation if it shares a sufficient number of phonetic features with an actual word in the listener's lexicon. Results indicated a monotonically decreasing degree of facilitation as a function of phonological distortion. In contrast, fluent aphasics showed priming in all phonological distortion conditions relative to the unrelated word baseline. Nonfluent aphasics showed priming only in the undistorted, related word condition relative to the unrelated word baseline. Nevertheless, in a secondary task requiring patients to make a lexical decision on the nonword primes presented singly, all aphasics showed phonological feature sensitivity. These results suggest deficits for aphasic patients in the various processes contributing to lexical access, rather than impairments at the level of lexical organization or phonological organization.     

Measuring lexical access during sentence processing

The results from “on-line” investigations of sentence comprehension are often difficult to interpret since it is not always apparent what component processes are reflected in the response measure. The results of two experiments reported here indicate that response latencies from phoneme-triggered lexical decision (PTLD) reflect the time needed for lexical access during sentence processing. Listeners were presented with sentences and were asked to make a word/nonword judgment for items beginning with a particular word-initial target phoneme. Speed of lexical access was manipulated by varying the semantic predictability of the target-bearing word. WORD judgments were faster for words that were preceded by semantically related verbs than were WORD judgments for words that were preceded by neutral verbs. The present results are consistent with other studies showing semantic facilitation of lexical access during the processing of fluent speech. It is argued that the phoneme-triggered lexical-decision task is a more suitable measure of lexical access during sentence processing than phoneme monitoring (Foss, 1969) or word monitoring (Marslen-Wilson & Tyler, 19751. In addition, it is pointed out that the phoneme-triggered lexical-decision task lends itself to modifications which should enable investigators to study various aspects of on-line sentence processing.     

An on-line investigation of lexical ambiguity processing in schizophrenia

The processing of lexical ambiguity in context was investigated in eight individuals with schizophrenia and a matched control group. Participants made speeded lexical decisions on the third word in auditory word triplets representing concordant (coin-bank-money), discordant (river-bank-money), neutral (day-bank-money), and unrelated (river-day-money) conditions. When the interstimulus interval (ISI) between the words was 100 ms, individuals with schizophrenia demonstrated priming consistent with selective, context-based lexical activation. At 1250 ms ISI, a pattern of nonselective meaning facilitation was obtained. These results suggest an attentional breakdown in the sustained inhibition of meanings on the basis of lexical context.     

The costs and benefits of tonal centers for chord processing

Harmonic priming studies have shown that a musical context, with its established tonal center, influences target chord processing. This study investigated costs and benefits of priming tonal centers for target processing by adding a baseline condition (sequences without a specific tonal center). Results confirmed harmonic priming, with faster processing for related than for unrelated and less related targets (tonic chord, out-of-key chord, subdominant chord). Comparing targets in baseline contexts with targets in sequences with well-established tonal centers revealed a benefit of processing for related targets but a cost of processing for unrelated and less related targets. Findings are discussed in terns of tonal knowledge activation and suggest that an activated tonal center gives rise to strong expectations for the tonic.     

Parafoveal processing across different lexical constituents in Chinese reading

We report a boundary paradigm eye movement experiment to investigate whether the linguistic category of a two-character Chinese string affects how the second character of that string is processed in the parafovea during reading. We obtained clear preview effects in all conditions but, more importantly, found parafoveal-on-foveal effects whereby a nonsense preview of the second character influenced fixations on the first character. This effect occurred for monomorphemic words, but not for compound words or phrases. Also, in a word boundary demarcation experiment, we demonstrate that Chinese readers are not always consistent in their judgements of which characters in a sentence constitute words. We conclude that information regarding the combinatorial properties of characters in Chinese is used online to moderate the extent to which parafoveal characters are processed.     

Competition in lexical processing of Italian noun/verb homographs

The study investigates the lexical representation of Italian noun/verb homographs, introducing a factor which has been analysed in production studies: the specific-word frequency (SWF). The SWF parameter allows to understand whether the grammatical class information is specified within the lexical knowledge or it is selected during post-lexical stages. We ran six lexical decision tasks employing the priming paradigm and a grammatical decision task to investigate the lexical representation of noun/verb homographs. In addition, we sought to determine the role played by the frequency of representations and the temporal activation of the grammatical class information. Our findings support the claim that these forms have independent representations for each syntactic role they can play. We interpreted these findings in the light of what we call the “Nominal Dominance” effect, which affects the lexical access of noun/verb homographs. We also discuss the relation between nominal dominance and lexical frequency.     

Semantic facilitation and lexical access during sentence processing

An experiment was conducted testing predictions derived from context-dependent and context-independent models of lexical access. Four types of unambiguous test sentences were constructed. The direct object of each test sentence was preceded by a verb that was either semantically related or unrelated to it, and by an adjective that was semantically related or unrelated. Context-dependent models predict that the speed with which the object noun is retrieved from the mental lexicon will be faster when the verb and/or the adjective is semantically related; context-independent models predict no such facilitation. Forty-four subjects each heard 32 test sentences and were asked to monitor within the sentence for a word-initial target phoneme. The target phoneme occurred on the word following the object noun. Reaction times to detect the targets were obtained. According to context-dependent models, these times should be shorter when related words precede the object noun, and that is what was found. It was also observed that the facilitation effects due to the related verbs and adjectives were additive. Implications of these results were discussed.     

Effects of relative embodiment in lexical and semantic processing of verbs

Research examining semantic richness effects in visual word recognition has shown that multiple dimensions of meaning are activated in the process of word recognition (e.g., Yap et al., 2012). This research has, however, been limited to nouns. In the present research we extended the semantic richness approach to verb stimuli in order to investigate how verb meanings are represented. We characterized a dimension of relative embodiment for verbs, based on the bodily sense described by Borghi and Cimatti (2010), and collected ratings on that dimension for 687 English verbs. The relative embodiment ratings revealed that bodily experience was judged to be more important to the meanings of some verbs (e.g., dance, breathe) than to others (e.g., evaporate, expect). We then tested the effects of relative embodiment and imageability on verb processing in lexical decision (Experiment 1), action picture naming (Experiment 2), and syntactic classification (Experiment 3). In all three experiments results showed facilitatory effects of relative embodiment, but not imageability: latencies were faster for relatively more embodied verbs, even after several other lexical variables were controlled. The results suggest that relative embodiment is an important aspect of verb meaning, and that the semantic richness approach holds promise as a strategy for investigating other aspects of verb meaning.     

Asymmetric interactions in the processing of the visual dimensions of position, width, and contrast of bar stimuli.

The processing of different dimensions of a single stimulus may be either integral or separable. Dimensions are called integral if correlated variation of one improves discrimination on the basis of the other and random variation of one interferes with discrimination on the basis of the other. For separable dimensions on the other hand, subjects can attend to one dimension and disregard variations in the other. These discrimination tests were used to find the interactions between the processing of the visual dimensions of position, width, and contrast of a light bar stimulus. The relations between these dimensions were found to be asymmetric: judgments of position and width are independent of contrast variations, but variations in these dimensions influence contrast discriminations. Furthermore, position variations influence width judgements more than vice versa. The data were analyzed for repetition effects, and it was found that this model is not sufficient to explain all the interaction phenomena. The asymmetries found may be related to the different ways these dimensions are mapped onto cortical neuron responses.     

Effects of nonlinguistic auditory variations on lexical processing in Broca's aphasics

In a series of experiments, the effect of white noise distortion and talker variation on lexical access in normal and Broca's aphasic participants was examined using an auditory lexical decision paradigm. Masking the prime stimulus in white noise resulted in reduced semantic priming for both groups, indicating that lexical access is degraded by nonlinguistic white noise distortion. However, talker variation within a prime-target pair had no effect upon the performance of either the normal or aphasic individuals. The absence of a talker variation effect suggests that voice-specific information is not encoded in the lexical representations of words. The normal performance of Broca's aphasics under conditions of both white noise and talker variation supports the view that these patients have a lexical processing impairment rather than a more generalized language deficit characterized by limited computational resources.     

The tonal function of a task-irrelevant chord modulates speed of visual processing

Harmonic priming studies have provided evidence that musical expectations influence sung phoneme monitoring, with facilitated processing for phonemes sung on tonally related (expected) chords in comparison to less-related (less-expected) chords [Bigand, Tillmann, Poulin, D’Adamo, and Madurell (2001). The effect of harmonic context on phoneme monitoring in vocal music. Cognition, 81, B11–B20]. This tonal relatedness effect has suggested two interpretations: (a) processing of music and language interact at some level of processing; and (b) tonal functions of chords influence task performance via listeners’ attention. Our study investigated these hypotheses by exploring whether the effect of tonal relatedness extends to the processing of visually presented syllables (Experiments 1 and 2) and geometric forms (Experiments 3 and 4). For Experiments 1–4, visual target identification was faster when the musical background fulfilled listeners’ expectations (i.e., a related chord was played simultaneously). In Experiment 4, the addition of a baseline condition (i.e., without an established tonal center) further showed that the observed difference was due to a facilitation linked to the related chord and not to an inhibition or disruption caused by the less-related chord. This outcome suggests the influence of musical structures on attentional mechanisms and that these mechanisms are shared between auditory and visual modalities. The implications for research investigating neural correlates shared by music and language processing are discussed.     

Semantic involvement in the lexical and sentence processing of Japanese kanji

This study examined how skilled Japanese readers activate semantic information when reading kanji compound words at both the lexical and sentence levels. Experiment 1 used a lexical decision task for two-kanji compound words and nonwords. When nonwords were composed of kanji that were semantically similar to the kanji of real words, reaction times were longer and error rates were higher than when nonwords had kanji that were not semantically similar. Experiment 2 used a proofreading task (detection of kanji miscombinations) for the same two-kanji compound words and nonwords at the sentence level. In this task, semantically similar nonwords were detected faster than dissimilar nonwords, but error rates were much higher for the semantically similar nonwords. Experiment 3 used a semantic decision task for sentences with the same two-kanji compound words and nonwords. It took longer to detect semantically similar nonwords than dissimilar nonwords. This indicates that semantic involvement in the processing of Japanese kanji produces different effects, depending on whether this processing is done at the lexical or sentence level, which in turn is related to where the reader's attention lies.     

Electrophysiological evidence for age effects on sensory memory processing of tonal patterns

In older adults, difficulties processing complex auditory scenes, such as speech comprehension in noisy environments, might be due to a specific impairment of temporal processing at early, automatic processing stages involving auditory sensory memory (ASM). Even though age effects on auditory temporal processing have been well-documented, there is a paucity of research on how ASM processing of more complex tone-patterns is altered by age. In the current study, age effects on ASM processing of temporal and frequency aspects of two-tone patterns were investigated using a passive listening protocol. The P1 component, the mismatch negativity (MMN) and the P3a component of event-related brain potentials (ERPs) to tone frequency and temporal pattern deviants were recorded in younger and older adults as a measure of auditory event detection, ASM processing, and attention switching, respectively. MMN was elicited with smaller amplitude to both frequency and temporal deviants in older adults. Furthermore, P3a was elicited only in the younger adults. In conclusion, the smaller MMN amplitude indicates that automatic processing of both frequency and temporal aspects of two-tone patterns is impaired in older adults. The failure to initiate an attention switch, suggested by the absence of P3a, indicates that impaired ASM processing of patterns may lead to less distractibility in older adults. Our results suggest age-related changes in ASM processing of patterns that cannot be explained by an inhibitory deficit.     

The role of lexical competition and acoustic-phonetic structure in lexical processing: evidence from normal subjects and aphasic patients

This study examined the effects that the acoustic-phonetic structure of a stimulus exerts on the processes by which lexical candidates compete for activation. An auditory lexical decision paradigm was used to investigate whether shortening the VOT of an initial voiceless stop consonant in a real word results in the activation of the lexical-semantic network of its voiced competitor, i.e., does acoustically modified time prime penny via dime. Results for normal subjects showed semantic priming for related pairs and mediated priming for voiced competitors, consistent with cascade models of language processing allowing for interaction between phonological and semantic levels of processing. Although Broca's aphasics showed semantic priming (dime primed penny), they failed to show priming in the context of a lexical competitor. These results are consistent with the hypothesis that these patients have a lexical processing deficit characterized by an overall reduction in lexical activation.     

Semantic processing in auditory lexical decision: Ear-of-presentation and sex differences

In this study we examined the interplay between appetitive (approach) and defensive (avoid) responses in spoken word recognition. Ninety-two right-handed participants (half women) took part in an auditory lexical decision experiment in which speech was presented to only one ear. The danger and usefulness of the word referents interacted in predicting RTs, as in previous (binaural) studies with poorer control of psycholinguistic covariates. Specifically, higher danger ratings were associated with faster RTs for words rated low on usefulness; but higher danger ratings were associated with slower RTs for words rated high on usefulness. In addition to this primary finding, men showed more lateralised performance, as indicated by significant interactions of sex and ear of presentation with word frequency, and with the animacy of the word referents. For both sexes, word frequency had a stronger effect on accuracy for speech presented to the right ear. Finally, men's but not women's RTs were related to the danger dimension. This last finding provides an intriguing avenue for future research in the area of sex differences and emotion.