Interference of spoken word recognition through phonological priming from visual objects and printed words

Three cross-modal priming experiments examined the influence of preexposure to pictures and printed words on the speed of spoken word recognition. Targets for auditory lexical decision were spoken Dutch words and nonwords, presented in isolation (Experiments 1 and 2) or after a short phrase (Experiment 3). Auditory stimuli were preceded by primes, which were pictures (Experiments 1 and 3) or those pictures’ printed names (Experiment 2). Prime–target pairs were phonologically onset related (e.g., pijl–pijn, arrow–pain), were from the same semantic category (e.g., pijl–zwaard, arrow–sword), or were unrelated on both dimensions. Phonological interference and semantic facilitation were observed in all experiments. Priming magnitude was similar for pictures and printed words and did not vary with picture viewing time or number of pictures in the display (either one or four). These effects arose even though participants were not explicitly instructed to name the pictures and where strategic naming would interfere with lexical decision making. This suggests that, by default, processing of related pictures and printed words influences how quickly we recognize spoken words.     

Reading spoken words: orthographic effects in auditory priming

Three experiments examined the involvement of orthography in spoken word processing using a task - unimodal auditory priming with offset overlap - taken to reflect activation of prelexical representations. Two types of prime-target relationship were compared; both involved phonological overlap, but only one had a strong orthographic overlap (e.g., dream-gleam vs. scheme-gleam). In Experiment 1, which used lexical decision, phonological overlap facilitated target responses in comparison with an unrelated condition (e.g., stove-gleam). More importantly, facilitation was modulated by degree of orthographic overlap. Experiment 2 employed the same design as Experiment 1, but with a modified procedure aimed at eliciting swifter responses. Again, the phonological priming effect was sensitive to the degree of orthographic overlap between prime and target. Finally, to test whether this orthographic boost was caused by congruency between response type and valence of the prime-target overlap, Experiment 3 used a pseudoword detection task, in which participants responded "yes" to novel words and "no" to known words. Once again phonological priming was observed, with a significant boost in the orthographic overlap condition. These results indicate a surprising level of orthographic involvement in speech perception, and provide clear evidence for mandatory orthographic activation during spoken word recognition.     

Acoustic,semantic and phonetic influences in spoken warning signal words

Three experiments are reported which explore the relationship between semantic, acoustic and phonetic variables in the judgement of eight warning signal words. Experiment 1 shows that listeners can distinguish very clearly between urgent and non‐urgent versions of the words when spoken by real speakers, and that some signal words such as ‘deadly’ and ‘danger’ score more highly than words such as ‘attention’ and ‘don't’. It also shows that the three dimensions of perceived urgency, appropriateness and believability of these words are highly correlated. Experiment 2 replicates Experiment 1 using synthesized voices where acoustic variables are controlled. The semantic effects are replicated, and to some extent appropriateness and believability are found to function differently from that of perceived urgency. Experiment 3 compares the same set of eight signal words with a set of phonetically similar neutral words, showing that warning signal words are rated significantly higher, and largely maintain their previous rank ordering. Copyright © 2003 John Wiley & Sons, Ltd.     

Perceptual and response components in repetition priming of spoken words and pseudowords

Two experiments explored repetition priming effects for spoken words and pseudowords in order to investigate abstractionist and episodic accounts of spoken word recognition and repetition priming. In Experiment 1, lexical decisions were made on spoken words and pseudowords with half of the items presented twice (～12 intervening items). Half of all repetitions were spoken in a “different voice” from the first presentations. Experiment 2 used the same procedure but with stimuli embedded in noise to slow responses. Results showed greater priming for words than for pseudowords and no effect of voice change in both normal and effortful processing conditions. Additional analyses showed that for slower participants, priming is more equivalent for words and pseudowords, suggesting episodic stimulus–response associations that suppress familiarity-based mechanisms that ordinarily enhance word priming. By relating behavioural priming to the time-course of pseudoword identification we showed that under normal listening conditions (Experiment 1) priming reflects facilitation of both perceptual and decision components, whereas in effortful listening conditions (Experiment 2) priming effects primarily reflect enhanced decision/response generation processes. Both stimulus–response associations and enhanced processing of sensory input seem to be voice independent, providing novel evidence concerning the degree of perceptual abstraction in the recognition of spoken words and pseudowords.     

Conceptual priming for environmental sounds and words: An ERP study

In this study we examined conceptual priming using environmental sounds and visually displayed words. Priming for sounds and words was observed in response latency as well as in event-related potentials. Reactions were faster when a related word followed an environmental sound and vice versa. Moreover both stimulus types produced an N400-effect for unrelated compared to related trials. The N400-effect had an earlier onset for environmental sounds than for words. The results support the theoretical notion that conceptual processing may be similar for verbal and non-verbal stimuli.     

Conceptual priming for environmental sounds and words: an ERP study

In this study we examined conceptual priming using environmental sounds and visually displayed words. Priming for sounds and words was observed in response latency as well as in event-related potentials. Reactions were faster when a related word followed an environmental sound and vice versa. Moreover both stimulus types produced an N400-effect for unrelated compared to related trials. The N400-effect had an earlier onset for environmental sounds than for words. The results support the theoretical notion that conceptual processing may be similar for verbal and non-verbal stimuli.     

The nature of control by spoken words over visual stimulus selection.

Eight retarded adolescents were trained to select one (a trained S+) of two visual stimuli in response to a spoken word (a trained word). Two different visual stimuli alternated randomly as the S-. To determine if the spoken work was merely a temporal discriminative stimulus for when to respond, or if it also specified which visual stimulus to select, the subjects were given intermittent presentations of untrained (novel) spoken words. All subjects consistently selected the trained S+ in response to the trained spoken word and selected the previous S- in response to the untrained spoken words. It was hypothesized that the subjects were responding away from the trained S+ in response to untrained spoken words, and control by untrained spoken words would not be observed when the trained S+ was not present. The two visual S- stimuli selected on trials of untrained spoken words were presented simultaneously. The untrained spoken words presented on these trials no longer controlled stimulus selections for seven subjects. The results supported the hypothesis that previous control by spoken words was due to responding away from the trained S+ in response to untrained spoken words.     

No negative semantic priming from unconscious flanker words in sight

In replicating 1 of the within-language conditions of E. Fox's (1996) Experiment 1, the authors confirmed that unattended words presented 2.4 degrees above and below fixation are mostly unavailable to awareness. However, no negative semantic priming was observed in a lexical decision on a probe letter string appearing about 1 s later, which does not replicate Fox's finding. These results are compatible with the hypothesis underlying the present study, according to which positive semantic priming, if any, rather than negative semantic priming is expected in Fox's situation. The reason is that unavailability to awareness of the parafoveal words is not achieved by means of an act of selective inhibition combined with attentional diversion through masking but is achieved simply by means of perceptual degradation.     

Cross-modal evaluative priming: emotional sounds influence the processing of emotion words

Cross-modal priming occurs when a prime presented in one sensory modality influences responses to a target in a different sensory modality. Currently, demonstrations of cross-modal evaluative priming have been sparse and limited. In the present study, we seek to partially rectify this state of affairs by examining cross-modal evaluative priming from auditory primes to visual targets. Significant cross-modal priming effects were found, but only for negative primes. Results are discussed in terms of the negativity bias, and several suggestions are provided for using cross-modal evaluative priming to address theoretically important questions about emotion and cognition.     

Effects of semantic priming on visual encoding of pictures

We investigated the effects of semantic priming on initial encoding of briefly presented pictures of objects and scenes. Pictures in four experiments were presented for varying durations and were followed immediately by a mask. In Experiments 1 and 2, pictures of simple objects were either preceded or not preceded by the object's category name (e.g., dog). In Experiment 1 we measured immediate object identification; in Experiment 2 we measured delayed old/new recognition in which targets and distractors were from the same categories. In Experiment 3 naturalistic scenes were either preceded or not preceded by the scene's category name (e.g., supermarket). We measured delayed recognition in which targets and distractors were described by the same category names. In Experiments 1-3, performance was better for primed than for unprimed pictures. Experiment 4 was similar to Experiment 2 in that we measured delayed recognition for simple objects. As in Experiments 1-3, a prime that preceded the object improved subsequent memory performance for the object. However, a prime that followed the object did not affect subsequent performance. Together, these results imply that priming leads to more efficient information acquisition. We offer a picture-processing model that accounts for these results. The model's central assumption is that knowledge of a picture's category (gist) increases the rate at which visual information is acquired from the picture.     

跨通道语义启动对视觉注意的影响

采用生活中的真实客体,考察了跨通道语义相关性对视觉注意的影响以及跨通道促进的时程。结合启动范式和点探测范式,实验1发现在听觉启动600ms后,被试对高相关视觉刺激的反应比对低相关刺激的反应更快,而在视觉启动下没有发现启动效应。实验2发现在启动刺激呈现900ms后跨通道启动效应消失。研究证明了基于先前经验的视、听语义相关能够促进视觉的选择性注意。     

Sound specificity effects in spoken word recognition: The effect of integrality between words and sounds

Recent evidence has shown that nonlinguistic sounds co-occurring with spoken words may be retained in memory and affect later retrieval of the words. This sound-specificity effect shares many characteristics with the classic voice-specificity effect. In this study, we argue that the sound-specificity effect is conditional upon the context in which the word and sound coexist. Specifically, we argue that, besides co-occurrence, integrality between words and sounds is a crucial factor in the emergence of the effect. In two recognition-memory experiments, we compared the emergence of voice and sound specificity effects. In Experiment 1 , we examined two conditions where integrality is high. Namely, the classic voice-specificity effect (Exp. 1a) was compared with a condition in which the intensity envelope of a background sound was modulated along the intensity envelope of the accompanying spoken word (Exp. 1b). Results revealed a robust voice-specificity effect and, critically, a comparable sound-specificity effect: A change in the paired sound from exposure to test led to a decrease in word-recognition performance. In the second experiment, we sought to disentangle the contribution of integrality from a mere co-occurrence context effect by removing the intensity modulation. The absence of integrality led to the disappearance of the sound-specificity effect. Taken together, the results suggest that the assimilation of background sounds into memory cannot be reduced to a simple context effect. Rather, it is conditioned by the extent to which words and sounds are perceived as integral as opposed to distinct auditory objects.     

The effect of semantic priming on the detection of letters within words

Memory & Cognition - Smith (1979) reported an experiment in which subjects were to detect whether or not a displayed word contained a particular target letter. Her data indicated that if the...     

Identity and semantic negative priming in rapid serial visual presentation streams

In selective attention tasks, the efficiency of processing concurrently presented target and distractor stimuli in a given display is often influenced by the relationship these stimuli have with those in the previous display. When a to-be-attended target on a current trial (the probe trial) matches the ignored, non-target distractor on a previous trial (the prime trial), a response to the target is typically delayed compared with when the two stimuli are not associated. This negative priming (NP) phenomenon has been observed in numerous studies with traditional NP tasks presenting the target and distractor simultaneously in both the prime and probe trial couplets. Here, however, in four experiments using a mixture of stimulus types (letters, digits, English number words, and logographic Chinese number words), target and distractor stimuli were temporally separated in two rapid serial visual presentation (RSVP) streams instead of concurrently presented. The findings provide a conceptual replication and substantial extension of a recent study by Wong (Plos One, 7, e37023, 2012), and suggest that active suppression of irrelevant distracting information is a more ubiquitous form of cognitive control than previously thought.     

Tracking recognition of spoken words by tracking looks to printed words

Eye movements of Dutch participants were tracked as they looked at arrays of four words on a computer screen and followed spoken instructions (e.g., “Klik op het woord buffel”: Click on the word buffalo). The arrays included the target (e.g., buffel), a phonological competitor (e.g., buffer, buffer), and two unrelated distractors. Targets were monosyllabic or bisyllabic, and competitors mismatched targets only on either their onset or offset phoneme and only by one distinctive feature. Participants looked at competitors more than at distractors, but this effect was much stronger for offset-mismatch than onset-mismatch competitors. Fixations to competitors started to decrease as soon as phonetic evidence disfavouring those competitors could influence behaviour. These results confirm that listeners continuously update their interpretation of words as the evidence in the speech signal unfolds and hence establish the viability of the methodology of using eye movements to arrays of printed words to track spoken-word recognition.     

Repetition priming within and between languages in semantic classification of concrete and abstract words

Although concrete nouns are generally agreed to have shared core conceptual representations across languages in bilinguals, it has been proposed that abstract nouns have separate representations or share fewer semantic components. Conceptual repetition priming methodology was used to evaluate whether translation equivalents of abstract nouns have shared conceptual representations and compare the degree of conceptual overlap for concrete and abstract nouns. Here 72 Spanish-English bilinguals made concrete-abstract decisions on English and Spanish nouns. Both concrete and abstract nouns elicited substantial between-language priming and these effects were of equivalent size, indicating that translation equivalents of both concrete and abstract nouns have shared conceptual representations and that abstract words do not share fewer components. The between-language priming effects and their attenuation relative to within-language priming indicate that the within-language effect is based on facilitation of both word comprehension and semantic decision processes.     

Tracking recognition of spoken words by tracking looks to printed words

Eye movements of Dutch participants were tracked as they looked at arrays of four words on a computer screen and followed spoken instructions (e.g., “Klik op het woord buffel”: Click on the word buffalo). The arrays included the target (e.g., buffel), a phonological competitor (e.g., buffer, buffer), and two unrelated distractors. Targets were monosyllabic or bisyllabic, and competitors mismatched targets only on either their onset or offset phoneme and only by one distinctive feature. Participants looked at competitors more than at distractors, but this effect was much stronger for offset-mismatch than onset-mismatch competitors. Fixations to competitors started to decrease as soon as phonetic evidence disfavouring those competitors could influence behaviour. These results confirm that listeners continuously update their interpretation of words as the evidence in the speech signal unfolds and hence establish the viability of the methodology of using eye movements to arrays of printed words to track spoken-word recognition.     

Repetition priming within and between languages in semantic classification of concrete and abstract words

Although concrete nouns are generally agreed to have shared core conceptual representations across languages in bilinguals, it has been proposed that abstract nouns have separate representations or share fewer semantic components. Conceptual repetition priming methodology was used to evaluate whether translation equivalents of abstract nouns have shared conceptual representations and compare the degree of conceptual overlap for concrete and abstract nouns. Here 72 Spanish–English bilinguals made concrete–abstract decisions on English and Spanish nouns. Both concrete and abstract nouns elicited substantial between-language priming and these effects were of equivalent size, indicating that translation equivalents of both concrete and abstract nouns have shared conceptual representations and that abstract words do not share fewer components. The between-language priming effects and their attenuation relative to within-language priming indicate that the within-language effect is based on facilitation of both word comprehension and semantic decision processes.