Conceptual priming for environmental sounds and words: an ERP study

In this study we examined conceptual priming using environmental sounds and visually displayed words. Priming for sounds and words was observed in response latency as well as in event-related potentials. Reactions were faster when a related word followed an environmental sound and vice versa. Moreover both stimulus types produced an N400-effect for unrelated compared to related trials. The N400-effect had an earlier onset for environmental sounds than for words. The results support the theoretical notion that conceptual processing may be similar for verbal and non-verbal stimuli.     

Conceptual priming with pictures and environmental sounds

A series of experiments was conducted to examine conceptual priming within and across modalities with pictures and environmental sounds. In Experiment 1, we developed a new multimodal stimulus set consisting of two picture and sound exemplars that represented 80 object items. In Experiments 2, we investigated whether categorization of the stimulus items would be facilitated by picture and environmental sound primes that were derived from different exemplars of the target items; and in Experiments 3 and 4, we tested the additional influence on priming when trials were consolidated within a target modality and the inter stimulus interval was lengthened. The results demonstrated that target categorization was facilitated by the advanced presentation of conceptually related exemplars, but there were differences in effectiveness when pictures and sounds appeared as primes.     

Conceptual priming for realistic auditory scenes and for auditory words

Two experiments were conducted using both behavioral and Event-Related brain Potentials methods to examine conceptual priming effects for realistic auditory scenes and for auditory words. Prime and target sounds were presented in four stimulus combinations: Sound–Sound, Word–Sound, Sound–Word and Word–Word. Within each combination, targets were conceptually related to the prime, unrelated or ambiguous. In Experiment 1, participants were asked to judge whether the primes and targets fit together (explicit task) and in Experiment 2 they had to decide whether the target was typical or ambiguous (implicit task). In both experiments and in the four stimulus combinations, reaction times and/or error rates were longer/higher and the N400 component was larger to ambiguous targets than to conceptually related targets, thereby pointing to a common conceptual system for processing auditory scenes and linguistic stimuli in both explicit and implicit tasks. However, fine-grained analyses also revealed some differences between experiments and conditions in scalp topography and duration of the priming effects possibly reflecting differences in the integration of perceptual and cognitive attributes of linguistic and nonlinguistic sounds. These results have clear implications for the building-up of virtual environments that need to convey meaning without words.     

Audio-visual priming in 7-month-old infants: An ERP study

The current study investigates categorical priming across modalities in 7-month-old infants using electroencephalographic (EEG) measures. In two experiments, infants were presented with sounds as primes, followed by images of human figures and furniture items as targets. In experiment 1 (N = 20), images were preceded by infant-directed (ID) or adult-directed (AD) speech to explore effects of intermodal categorical mismatches. Furniture targets (mismatching category) elicited an increased amplitude of the Negative central (Nc) component compared to human targets (matching category), p < .01, indicating increased attention. Results did not vary with manner of speaking (ID or AD). Experiment 2 (N = 17) explored whether a categorical mismatch between prime and target would elicit increased positive slow wave (PSW) amplitudes for human targets, indicating increased memory effort. Here, bicycle ringtones and ID speech served as primes. Again, furniture targets elicited an increased Nc regardless of prime category, p < .05, and a categorical change from human speech to furniture target images elicited an increased PSW, p < .05. No PSW effect was found for human targets following bicycle ringtones, however. The experiments reported here suggest that auditory primes may increase infant attention and memory updating particularly for non-social, categorically mismatching stimuli.     

Cross-modal evaluative priming: emotional sounds influence the processing of emotion words

Cross-modal priming occurs when a prime presented in one sensory modality influences responses to a target in a different sensory modality. Currently, demonstrations of cross-modal evaluative priming have been sparse and limited. In the present study, we seek to partially rectify this state of affairs by examining cross-modal evaluative priming from auditory primes to visual targets. Significant cross-modal priming effects were found, but only for negative primes. Results are discussed in terms of the negativity bias, and several suggestions are provided for using cross-modal evaluative priming to address theoretically important questions about emotion and cognition.     

Levels of visuo-spatial selection: An ERP study of negative priming

Usually, a probe target appearing in a recently ignored distractor location is less efficiently processed. This robust phenomenon is called (visuo-) spatial negative priming (SNP). Among other explanations, concepts of persisting or retrieved spatial inhibition play a major role. Two relevant issues were investigated using event-related brain potentials (ERPs). The first pertains to context sensitivity of inhibition: Is a probe distractor necessary for SNP? The second concerns levels of processing at which spatial inhibition operates: Does SNP affect perception, selection, and/or stimulus classification? A localization task with and without probe distractors was employed while 64-channel EEG was recorded. Obviously, SNP does not require a probe distractor; the distractor-absent SNP effect was larger than the distractor-present SNP effect. Distractor-present SNP had two lateralized ERP effects, N1pc amplitude reduction and N2pc amplitude increase. Smaller N1pc may indeed reflect perceptual decrement, but was inversely related to size of behavioral SNP. By contrast, only strong-SNP participants showed N2pc increase, which points to selection disadvantage due to persisting inhibition of higher-level spatial representations. Distractor-absent SNP had no N1pc/N2pc correlates; instead, reduced amplitude of a broadly distributed P300 component suggests impaired stimulus classification due to episodic retrieval of inappropriate prime information. Overall, SNP seems to emerge from relatively late stages of processing, thus challenging the idea of context-free persisting inhibition of low-level spatial representations. Furthermore, distractor-present and distractor-absent SNP are qualitatively different from each other.     

Brain processing of task-relevant and task-irrelevant emotional words: An ERP study

Although there is evidence for preferential perceptual processing of written emotional information, the effects of attentional manipulations and the time course of affective processing require further clarification. In this study, we attempted to investigate how the emotional content of words modulates cerebral functioning (event-related potentials, ERPs) and behavior (reaction times, RTs) when the content is task-irrelevant (emotional Stroop Task, EST) or task-relevant (emotional categorization task, ECT), in a sample of healthy middle-aged women. In the EST, the RTs were longer for emotional words than for neutral words, and in the ECT, they were longer for neutral and negative words than for positive words. A principal components analysis of the ERPs identified various temporospatial factors that were differentially modified by emotional content. P2 was the first emotion-sensitive component, with enhanced factor scores for negative nouns across tasks. The N2 and late positive complex had enhanced factor scores for emotional relative to neutral information only in the ECT. The results reinforce the idea that written emotional information has a preferential processing route, both when it is task-irrelevant (producing behavioral interference) and when it is task-relevant (facilitating the categorization). After early automatic processing of the emotional content, late ERPs become more emotionally modulated as the level of attention to the valence increases.     

Crossmodal semantic priming by naturalistic sounds and spoken words enhances visual sensitivity

We propose a multisensory framework based on Glaser and Glaser's (1989) general reading-naming interference model to account for the semantic priming effect by naturalistic sounds and spoken words on visual picture sensitivity. Four experiments were designed to investigate two key issues: First, can auditory stimuli enhance visual sensitivity when the sound leads the picture as well as when they are presented simultaneously? And, second, do naturalistic sounds (e.g., a dog's "woofing") and spoken words (e.g., /d?g/) elicit similar semantic priming effects? Here, we estimated participants' sensitivity and response criterion using signal detection theory in a picture detection task. The results demonstrate that naturalistic sounds enhanced visual sensitivity when the onset of the sounds led that of the picture by 346 ms (but not when the sounds led the pictures by 173 ms, nor when they were presented simultaneously, Experiments 1-3A). At the same SOA, however, spoken words did not induce semantic priming effects on visual detection sensitivity (Experiments 3B and 4A). When using a dual picture detection/identification task, both kinds of auditory stimulus induced a similar semantic priming effect (Experiment 4B). Therefore, we suggest that there needs to be sufficient processing time for the auditory stimulus to access its associated meaning to modulate visual perception. Besides, the interactions between pictures and the two types of sounds depend not only on their processing route to access semantic representations, but also on the response to be made to fulfill the requirements of the task.     

The dynamic influence of emotional words on sentence comprehension: An ERP study

In the present study, we explored the influence of emotional words on the semantic integration of their following neutral nouns during sentence comprehension. We manipulated the emotionality of verbs and the semantic congruity of their following (neutral) object nouns in sentences. Event-related potentials were recorded to the verbs, which were either negative or neutral, and to the object nouns, which were either semantically congruent or incongruent relative to the preceding contexts. We found an N400 and a P600 effect in response to the semantic congruity of the nouns when they followed the neutral verbs. However, the P600 (but not the N400) semantic congruity effect may have been attenuated when the nouns followed the negative verbs. Meanwhile, the negative verbs elicited a larger P2 and N400 than did the neutral verbs. The results indicate that the attention captured by emotional words impaired reanalysis of the following incongruent information, demonstrating a dynamic influence of emotional words on the semantic processing of following information during sentence comprehension.     

The organization of words and environmental sounds in the second year: Behavioral and electrophysiological evidence

The majority of research examining early auditory‐semantic processing and organization is based on studies of meaningful relations between words and referents. However, a thorough investigation into the fundamental relation between acoustic signals and meaning requires an understanding of how meaning is associated with both lexical and non‐lexical sounds. Indeed, it is unknown how meaningful auditory information that is not lexical (e.g., environmental sounds) is processed and organized in the young brain. To capture the structure of semantic organization for words and environmental sounds, we record event‐related potentials as 20‐month‐olds view images of common nouns (e.g., dog) while hearing words or environmental sounds that match the picture (e.g., “dog” or barking), that are within‐category violations (e.g., “cat” or meowing), or that are between‐category violations (e.g., “pen” or scribbling). Results show both words and environmental sounds exhibit larger negative amplitudes to between‐category violations relative to matches. Unlike words, which show a greater negative response early and consistently to within‐category violations, such an effect for environmental sounds occurs late in semantic processing. Thus, as in adults, the young brain represents semantic relations between words and between environmental sounds, though it more readily differentiates semantically similar words compared to environmental sounds.     

The more you ignore me the closer I get: An ERP study of evaluative priming

We used event-related brain potentials (ERPs) to investigate the various mental processes contributing to evaluative priming—that is, more positive judgments for targets preceded by affectively positive, as opposed to negative, prime stimuli. To ensure ecological validity, we employed a priori meaningful landscape pictures as targets and emotional adjectives as visual primes and presented both primes and targets for relatively long durations (>1 s). Prime-related lateralized readiness potentials (LRPs) revealed response priming as one source of the significant evaluative priming effect. On the other hand, greater right-frontal positive slow wave in the ERP for pictures following negative, as compared with positive, primes indicated altered impression formation, thus supporting automatic spreading activation and/or affect misattribution accounts. Moreover, target LRPs suggested conscious counter-control to reduce the evaluative priming net effect. Finally, when comparing prime ERPs for two groups of participants showing strong versus weak evaluative priming, we found strong evidence for the role of depth of prime processing: In the weak-effect group, prime words evoked an increased visual P1/N1 complex, a larger posterior P2 component, and a greater left-parietal processing negativity presumably reflecting semantic processing. By contrast, a larger medial-frontal P2/N2 complex in the strong-effect group suggested top-down inhibition of the prime’s emotional content. Thus, trying to ignore the primes can actually increase, rather than decrease, the evaluative priming effect.     

An ERP investigation of location invariance in masked repetition priming

In an experiment combining masked repetition priming and the recording of event-related potentials (ERPs) the location of prime stimuli relative to centrally located target words was manipulated. Prime words could appear at the same location as targets or shifted one letter position to the right or to the left. Repetition priming effects (amplitude differences across the repeat vs. unrelated prime conditions) were found in a series of ERP components starting at around 100 msec posttarget onset. The earliest of these, the N/P150 component, was found to be sensitive to prime location. Repetition priming was only apparent with centrally located primes in this component. Repetition priming effects in later components (N250 and N400), on the other hand, were not affected by prime location. The results are interpreted in terms of location-specific letter detectors that map onto a higher level, location-invariant orthographic code for printed words.     

Equivalent inter- and intramodality long-term priming: Evidence for a common lexicon for words seen and words heard

Weaker inter- than intramodality long-term priming of words has promoted two hypotheses: (1) separate visual and auditory lexicons and (2) modality dependence of implicit memory. In five experiments, we employed manipulations aimed to minimize study-test asymmetries between the two priming conditions. Activities at visual and auditory study were matched, words were phonologically consistent, and study modality was manipulated between subjects. Equal magnitudes of inter- and intramodality priming were found in experiments with visual and auditory stem completion at test, with visual fragment completion at test, and with visual and auditory perceptual identification at test. A within-subjects experiment yielded the conventional intramodality advantage. The results point to a single amodal lexicon and to modality-independent phonological processing as the basis of implicit word memory.     

Phonemic priming with words and pseudowords

Abstract

The bi-alphabetic nature of the Serbo-Croatian writing system allows unequivocal examination of phonemic similarity unconfounded with graphemic similarity. The Roman and Cyrillic alphabets are largely independent but map onto the same sounds. A lower-case context written in one alphabet bears no visual similarity to an uppercase target written in the other alphabet. One naming experiment and one lexical decision experiment investigated phonemic priming of high-frequency words and pseudowords with word and pseudoword contexts. For naming, targets that were phone-mically similar to the preceding context were named significantly faster than were phonemically dissimilar targets. This result was indifferent to the lexicality of the contexts and targets. For lexical decision, in contrast, phonemically similar word-word pairs showed inhibition, whereas phonemically similar pseudoword-word pairs showed facilitation relative to their phonemically dissimilar counterparts. These results were discussed in terms of (1) a model of visual word processing that posits a layer of phoneme units between letter units and word units, and (2) the idea that active word units inhibit one another in proportion to each one's frequency. In this account, phonemic similarity effects in naming are based on the states of the phoneme units, while phonemic similarity effects in lexical decision are based on the states of the word units. These results lend further support to the claim that, for readers of Serbo-Croatian, the visual computation of phonology is automatic and prelexical.     

Auditory priming: implicit and explicit memory for words and voices.

Five experiments explore priming effects on auditory identification and completion tasks as a function of semantic and nonsemantic encoding tasks and whether speaker's voice is same or different at study and test. Auditory priming was either unaffected by the study task manipulation (Experiments 2, 4, and 5) or was less affected than was explicit memory (Experiments 1 and 3). Study-to-test changes of speaker's voice had nonsignificant effects on priming when white noise masked target items on the identification test (Experiments 1 and 2) or the stem-completion test (Experiment 5). However, significant voice change effects were observed on priming of completion performance when stems were spoken clearly (Experiments 3 and 4). Results are consistent with the idea that a presemantic auditory perceptual representation system plays an important role in the observed priming. Alternative explanations of the presence or absence of voice change effects under different task conditions are considered.     

Learning words and learning sounds: Advances in language development

Phonological development is sometimes seen as a process of learning sounds, or forming phonological categories, and then combining sounds to build words, with the evidence taken largely from studies demonstrating ‘perceptual narrowing’ in infant speech perception over the first year of life. In contrast, studies of early word production have long provided evidence that holistic word learning may precede the formation of phonological categories. In that account, children begin by matching their existing vocal patterns to adult words, with knowledge of the phonological system emerging from the network of related word forms. Here I review evidence from production and then consider how the implicit and explicit learning mechanisms assumed by the complementary memory systems model might be understood as reconciling the two approaches.     

Masked priming of words and nonwords in a naming task: Further evidence for a nonlexical basis for priming

Masked priming effects in word identification tasks such as lexical decision and word naming have been attributed to a lexical mechanism whereby the masked prime opens a lexical entry corresponding to the target word. Two experiments are reported in which masked repetition priming effects of similar magnitude were obtained with word and nonword targets in a naming task. Masked orthographic priming was more stable for word than for nonword targets, although morphological primes produced no advantage beyond that achieved by matched orthographic primes. These results, taken together with the recent finding that repetition priming of nonwords can be obtained in the lexical decision task, support the view that masked priming of words and nonwords has a nonlexical component. We suggest that masked primes can enhance target identification by contributing to the construction of an orthographic or a phonological representation of the target, regardless of the target's lexical status.