Interference of spoken word recognition through phonological priming from visual objects and printed words

Three cross-modal priming experiments examined the influence of preexposure to pictures and printed words on the speed of spoken word recognition. Targets for auditory lexical decision were spoken Dutch words and nonwords, presented in isolation (Experiments 1 and 2) or after a short phrase (Experiment 3). Auditory stimuli were preceded by primes, which were pictures (Experiments 1 and 3) or those pictures’ printed names (Experiment 2). Prime–target pairs were phonologically onset related (e.g., pijl–pijn, arrow–pain), were from the same semantic category (e.g., pijl–zwaard, arrow–sword), or were unrelated on both dimensions. Phonological interference and semantic facilitation were observed in all experiments. Priming magnitude was similar for pictures and printed words and did not vary with picture viewing time or number of pictures in the display (either one or four). These effects arose even though participants were not explicitly instructed to name the pictures and where strategic naming would interfere with lexical decision making. This suggests that, by default, processing of related pictures and printed words influences how quickly we recognize spoken words.     

Age-of-acquisition effects in delayed picture-naming tasks

We report two experiments that explored the linguistic locus of age-of-acquisition effects in picture naming by using a delayed naming task that involved only a low proportion of trials (25 %) while, for the large majority of the trials (75 %), participants performed another task—that is, the prevalent task. The prevalent tasks were semantic categorization in Experiment 1a and grammatical-gender decision in Experiments 1b and 2. In Experiment 1a, in which participants were biased to retrieve semantic information in order to perform the semantic categorization task, delayed naming times were affected by age of acquisition, reflecting a postsemantic locus of the effect. In Experiments 1b and 2, in which participants were biased to retrieve lexical information in order to perform the grammatical gender decision task, there was also an age-of-acquisition effect. These results suggest that part of the age-of-acquisition effect in picture naming occurs at the level at which the phonological properties of words are retrieved.     

Time-compressed spoken word primes crossmodally enhance processing of semantically congruent visual targets

Findings from three experiments support the conclusion that auditory primes facilitate the processing of related targets. In Experiments 1 and 2, we employed a crossmodal Stroop color identification task with auditory color words (as primes) and visual color patches (as targets). Responses were faster for congruent priming, in comparison to neutral or incongruent priming. This effect also emerged for different levels of time compression of the auditory primes (to 30 % and 10 % of the original length; i.e., 120 and 40 ms) and turned out to be even more pronounced under high-perceptual-load conditions (Exps. 1 and 2). In Experiment 3, target-present or -absent decisions for brief target displays had to be made, thereby ruling out response-priming processes as a cause of the congruency effects. Nevertheless, target detection (d') was increased by congruent primes (30 % compression) in comparison to incongruent or neutral primes. Our results suggest semantic object-based auditory–visual interactions, which rapidly increase the denoted target object’s salience. This would apply, in particular, to complex visual scenes.     

Foreign accent strength and listener familiarity with an accent codetermine speed of perceptual adaptation

We investigated how the strength of a foreign accent and varying types of experience with foreign-accented speech influence the recognition of accented words. In Experiment 1, native Dutch listeners with limited or extensive prior experience with German-accented Dutch completed a cross-modal priming experiment with strongly, medium, and weakly accented words. Participants with limited experience were primed by the medium and weakly accented words, but not by the strongly accented words. Participants with extensive experience were primed by all accent types. In Experiments 2 and 3, Dutch listeners with limited experience listened to a short story before doing the cross-modal priming task. In Experiment 2, the story was spoken by the priming task speaker and either contained strongly accented words or did not. Strongly accented exposure led to immediate priming by novel strongly accented words, while exposure to the speaker without strongly accented tokens led to priming only in the experiment’s second half. In Experiment 3, listeners listened to the story with strongly accented words spoken by a different German-accented speaker. Listeners were primed by the strongly accented words, but again only in the experiment’s second half. Together, these results show that adaptation to foreign-accented speech is rapid but depends on accent strength and on listener familiarity with those strongly accented words.     

The consequences of language proficiency and difficulty of lexical access for translation performance and priming

Repetition priming was used to assess how proficiency and the ease or difficulty of lexical access influence bilingual translation. Two experiments, conducted at different universities with different Spanish–English bilingual populations and materials, showed repetition priming in word translation for same-direction and different-direction repetitions. Experiment 1, conducted in an English-dominant environment, revealed an effect of translation direction but not of direction match, whereas Experiment 2, conducted in a more balanced bilingual environment, showed an effect of direction match but not of translation direction. A combined analysis on the items common to both studies revealed that bilingual proficiency was negatively associated with response time (RT), priming, and the degree of translation asymmetry in RTs and priming. An item analysis showed that item difficulty was positively associated with RTs, priming, and the benefit of same-direction over different-direction repetition. Thus, although both participant accuracy and item accuracy are indices of learning, they have distinct effects on translation RTs and on the learning that is captured by the repetition-priming paradigm.     

Animates are better remembered than inanimates: further evidence from word and picture stimuli

In three experiments, we showed that animate entities are remembered better than inanimate entities. Experiment 1 revealed better recall for words denoting animate than inanimate items. Experiment 2 replicated this finding with the use of pictures. In Experiment 3, we found better recognition for animate than for inanimate words. Importantly, we also found a higher recall rate of “remember” than of “know” responses for animates, whereas the recall rates were similar for the two types of responses for inanimate items. This finding suggests that animacy enhances not only the quantity but also the quality of memory traces, through the recall of contextual details of previous experiences (i.e., episodic memory). Finally, in Experiment 4, we tested whether the animacy effect was due to animate items being richer in terms of sensory features than inanimate items. The findings provide further evidence for the functionalist view of memory championed by Nairne and coworkers (Nairne, 2010; Nairne & Pandeirada, Cognitive Psychology, 61:1–22, 2010a, 2010b).     

Boundaries of semantic distraction: Dominance and lexicality act at retrieval

Three experiments investigated memory for semantic information with the goal of determining boundary conditions for the manifestation of semantic auditory distraction. Irrelevant speech disrupted the free recall of semantic category- exemplars to an equal degree regardless of whether the speech coincided with presentation or test phases of the task (Experiment 1), and this occurred regardless of whether it comprised random words or coherent sentences (Experiment 2). The effects of background speech were greater when the irrelevant speech was semantically related to the to-be-remembered material, but only when the irrelevant words were high in output dominance (Experiment 3). The implications of these findings in relation to the processing of task material and the processing of background speech are discussed.     

Is naming faces different from naming objects? Semantic interference in a face- and object-naming task

A current debate regarding face and object naming concerns whether they are equally vulnerable to semantic interference. Although some studies have shown similar patterns of interference, others have revealed different effects for faces and objects. In Experiment 1, we compared face naming to object naming when exemplars were presented in a semantically homogeneous context (grouped by their category) or in a semantically heterogeneous context (mixed) across four cycles. The data revealed significant slowing for both face and object naming in the homogeneous context. This semantic interference was explained as being due to lexical competition from the conceptual activation of category members. When focusing on the first cycle, a facilitation effect for objects but not for faces appeared. This result permits us to explain the previously observed discrepancies between face and object naming. Experiment 2 was identical to Experiment 1, with the exception that half of the stimuli were presented as face/object names for reading. Semantic interference was present for both face and object naming, suggesting that faces and objects behave similarly during naming. Interestingly, during reading, semantic interference was observed for face names but not for object names. This pattern is consistent with previous assumptions proposing the activation of a person identity during face name reading.     

A comparison of visual and auditory representational momentum in spatial tasks

Similarities have been observed in the localization of the final position of moving visual and moving auditory stimuli: Perceived endpoints that are judged to be farther in the direction of motion in both modalities likely reflect extrapolation of the trajectory, mediated by predictive mechanisms at higher cognitive levels. However, actual comparisons of the magnitudes of displacement between visual tasks and auditory tasks using the same experimental setup are rare. As such, the purpose of the present free-field study was to investigate the influences of the spatial location of motion offset, stimulus velocity, and motion direction on the localization of the final positions of moving auditory stimuli (Experiment 1 and 2) and moving visual stimuli (Experiment 3). To assess whether auditory performance is affected by dynamically changing binaural cues that are used for the localization of moving auditory stimuli (interaural time differences for low-frequency sounds and interaural intensity differences for high-frequency sounds), two distinct noise bands were employed in Experiments 1 and 2. In all three experiments, less precise encoding of spatial coordinates in paralateral space resulted in larger forward displacements, but this effect was drowned out by the underestimation of target eccentricity in the extreme periphery. Furthermore, our results revealed clear differences between visual and auditory tasks. Displacements in the visual task were dependent on velocity and the spatial location of the final position, but an additional influence of motion direction was observed in the auditory tasks. Together, these findings indicate that the modality-specific processing of motion parameters affects the extrapolation of the trajectory.     

Effects of study time and meaningfulness on environmental context-dependent recognition

In two experiments, we examined whether the size of place-context-dependent recognition decreased with study time and with the meaningfulness of the to-be-remembered materials. A group of 80 undergraduates intentionally studied a list of words in a short (1.5?s per item) or a long (4.0?s per item) study-time condition (Exp. 1). Another 40 undergraduates studied lists consisting of words and nonwords in the long-study-time condition (Exp. 2). After a short retention interval, recognition for the targets was tested in the same or in a different context. Context was manipulated by means of the combination of place, subsidiary task, and experimenter. Significant context-dependent recognition discrimination was found for words in the short-study-time condition (Exp. 1), but not in the long-study-time condition (Exps. 1 and 2). Significant effects were found as well for nonwords, even in the long-study-time condition (Exp. 2). These results are explained well by an outshining account: that is, by principles of outshining and encoding specificity.     

The effects of interleaving versus blocking on foreign language pronunciation learning

Many studies have shown that students learn better when they are given repeated exposures to different concepts in a way that is shuffled or interleaved, rather than blocked (e.g., Rohrer Educational Psychology Review, 24, 355–367, 2012). The present study explored the effects of interleaving versus blocking on learning French pronunciations. Native English speakers learned several French words that conformed to specific pronunciation rules (e.g., the long “o” sound formed by the letter combination “eau,” as in bateau), and these rules were presented either in blocked fashion (bateau, carreau, fardeau . . . mouton, genou, verrou . . . tandis, verglas, admis) or in interleaved fashion (bateau, mouton, tandis, carreau, genou, verglas . . .). Blocking versus interleaving was manipulated within subjects (Experiments 1–3) or between subjects (Experiment 4), and participants’ pronunciation proficiency was later tested through multiple-choice tests (Experiments 1, 2, and 4) or a recall test (Experiment 3). In all experiments, blocking benefited the learning of pronunciations more than did interleaving, and this was true whether participants learned only 4 words per rule (Experiments 1–3) or 15 words per rule (Experiment 4). Theoretical implications of these findings are discussed.     

The function of regressions in reading: Backward eye movements allow rereading

Standard text reading involves frequent eye movements that go against normal reading order. The function of these “regressions” is still largely unknown. The most obvious explanation is that regressions allow for the rereading of previously fixated words. Alternatively, physically returning the eyes to a word’s location could cue the reader’s memory for that word, effectively aiding the comprehension process via location priming (the “deictic pointer hypothesis”). In Experiment 1, regression frequency was reduced when readers knew that information was no longer available for rereading. In Experiment 2, readers listened to auditorily presented text while moving their eyes across visual placeholders on the screen. Here, rereading was impossible, but deictic pointers remained available, yet the readers did not make targeted regressions in this experiment. In Experiment 3, target words in normal sentences were changed after reading. Where the eyes later regressed to these words, participants generally remained unaware of the change, and their answers to comprehension questions indicated that the new meaning of the changed word was what determined their sentence representations. These results suggest that readers use regressions to reread words and not to cue their memory for previously read words.     

Famous talker effects in spoken word recognition

Previous work has demonstrated that talker-specific representations affect spoken word recognition relatively late during processing. However, participants in these studies were listening to unfamiliar talkers. In the present research, we used a long-term repetition-priming paradigm and a speeded-shadowing task and presented listeners with famous talkers. In Experiment 1, half the words were spoken by Barack Obama, and half by Hillary Clinton. Reaction times (RTs) to repeated words were shorter than those to unprimed words only when repeated by the same talker. However, in Experiment 2, using nonfamous talkers, RTs to repeated words were shorter than those to unprimed words both when repeated by the same talker and when repeated by a different talker. Taken together, the results demonstrate that talker-specific details can affect the perception of spoken words relatively early during processing when words are spoken by famous talkers.     

Response retrieval in a go/no-go priming-of-popout task

Priming of popout is the finding that singleton search is faster when features of a target and of nontargets are repeated across trials than when the features switch. Theoretical accounts suggest that intertrial repetition influences perceptual and attentional selection processes, episodic retrieval processes, or both. The present study combined a popout search task with a go/no-go task. In Experiment 1, the nontarget distractors in each display carried the go/no-go feature, and in Experiment 2, the texture of all items carried the go/no-go feature. Results showed that the go/no-go task moderated the intertrial repetition effects. In Experiment 1, the target color elicited retrieval of the preceding distractor color and associated no-go response, resulting in larger interference effects. In Experiment 2, the target color elicited retrieval of the preceding target color and no-go response, resulting in reduced facilitation effects. Additional results from both experiments showed that the colors in a search display also influenced target selection on the following trial. Taken together, the results of both experiments suggest that intertrial repetition influences both early selection and postselection retrieval processes.     

Strength cues and blocking at test promote reliable within-list criterion shifts in recognition memory

In seven experiments, we explored the potential for strength-based, within-list criterion shifts in recognition memory. People studied a mix of target words, some presented four times (strong) and others studied once (weak). In Experiments 1, 2, 4A, and 4B, the test was organized into alternating blocks of 10, 20, or 40 trials. Each block contained lures intermixed with strong targets only or weak targets only. In strength-cued conditions, test probes appeared in a unique font color for strong and weak blocks. In the uncued conditions of Experiments 1 and 2, similar strength blocks were tested, but strength was not cued with font color. False alarms to lures were lower in blocks containing strong target words, as compared with lures in blocks containing weak targets, but only when strength was cued with font color. Providing test feedback in Experiment 2 did not alter these results. In Experiments 3A–3C, test items were presented in a random order (i.e., not blocked by strength). Of these three experiments, only one demonstrated a significant shift even though strength cues were provided. Overall, the criterion shift was larger and more reliable as block size increased, and the shift occurred only when strength was cued with font color. These results clarify the factors that affect participants’ willingness to change their response criterion within a test list.     

Relational and item-specific influences on generate–recognize processes in recall

The generate–recognize model and the relational–item-specific distinction are two approaches to explaining recall. In this study, we consider the two approaches in concert. Following Jacoby and Hollingshead (Journal of Memory and Language 29:433–454, 1990), we implemented a production task and a recognition task following production (1) to evaluate whether generation and recognition components were evident in cued recall and (2) to gauge the effects of relational and item-specific processing on these components. An encoding task designed to augment item-specific processing (anagram-transposition) produced a benefit on the recognition component (Experiments 1–3) but no significant benefit on the generation component (Experiments 1–3), in the context of a significant benefit to cued recall. By contrast, an encoding task designed to augment relational processing (category-sorting) did produce a benefit on the generation component (Experiment 3). These results converge on the idea that in recall, item-specific processing impacts a recognition component, whereas relational processing impacts a generation component.     

What is in a tool concept? Dissociating manipulation knowledge from function knowledge

Research on patients with apraxia, a deficit in skilled action, has shown that the ability to use objects may be differentially impaired relative to knowledge about object function. Here we show, using a modified neuropsychological test, that similar dissociations can be observed in response times in healthy adults. Participants were asked to decide which two of three presented objects shared the same manipulation or the same function; triads were presented in picture and word format, and responses were made manually (button press) or with a basic-level naming response (verbally). For manual responses (Experiment 1), participants were slower to make manipulation judgments for word stimuli than for picture stimuli, while there was no difference between word and picture stimuli for function judgments. For verbal-naming responses (Experiment 2), participants were again slower for manipulation judgments over word stimuli, as compared with picture stimuli; however, and in contrast to Experiment 1, function judgments over word stimuli were faster than function judgments over picture stimuli. These data support the hypotheses that knowledge of object function and knowledge of object manipulation correspond to dissociable types of object knowledge and that simulation over motor information is not necessary in order to retrieve knowledge of object function.     

Investigating the speed–accuracy trade-off: Better use deadlines or response signals?

Deadlines (DLs) and response signals (RSs) are two well-established techniques for investigating speed–accuracy trade-offs (SATs). Methodological differences imply, however, that corresponding data do not necessarily reflect equivalent processes. Specifically, the DL procedure grants knowledge about trial-specific time demands and requires responses before a prespecified period has elapsed. In contrast, RS intervals often vary unpredictably between trials, and responses must be given after an explicit signal. Here, we investigated the effects of these differences in a flanker task. While all conditions yielded robust SAT functions, a right-shift of the curves pointed to reduced performance in RS conditions (Experiment 1, blocked; Experiments 2 and 3, randomized), as compared with DL conditions (Experiments 1–3, blocked), indicating that the detection of the RS imposes additional task demands. Moreover, the flanker effect vanished at long intervals in RS settings, suggesting that stimulus-related effects are absorbed in a slack when decisions are completed prior to the signal. In turn, effects of a flat (Experiment 2) versus a performance-contingent payment (Experiment 3) indicated that susceptibility to response strategies is higher in the DL than in the RS method. Finally, the RS procedure led to a broad range of slow responses and high accuracies, whereas DL conditions resulted in smaller variations in the upper data range (Experiments 1 and 2); with performance-contingent payment (Experiment 3), though, data ranges became similar. Together, the results uncover characteristic procedure-related effects and should help in selection of the appropriate technique.     

The production effect in paired-associate learning: Benefits for item and associative information

In five experiments, we extended the production effect—better memory for items said aloud than for items read silently—to paired-associate learning, the goal being to explore whether production enhances associative information in addition to enhancing item information. In Experiments 1 and 2, we used a semantic-relatedness task in addition to the production manipulation and found no evidence of a production effect, whether the measure was cued recall or item recognition. Experiment 3 showed that the semantic-relatedness task had overshadowed the production effect; the effect was present when the semantic-relatedness task was removed, again whether cued recall or item recognition was the measure. Experiments 4 and 5 provided further evidence that production can enhance recall for word pairs and, using an associate recognition test with intact versus rearranged pairs, indicated that production may also enhance associative information. That production boosts memory for both types of information is considered in terms of distinctive encoding.     

Top-down constraint on recognition memory

Can recognition memory be constrained “at the front end,” such that people are more likely to retrieve information about studying a recognition-test probe from a specified target source than they are to retrieve such information about a probe from a nontarget source? We adapted a procedure developed by Jacoby, Shimizu, Daniels, and Rhodes (Psychonomic Bulletin & Review 12:852–857, 2005) to address this question. Experiment 1 yielded evidence of source-constrained retrieval, but that pattern was not significant in Experiments 2, 3, and 4 (nor in several unpublished pilot experiments). In Experiment 5, in which items from the two studied sources were perceptibly different, a pattern consistent with front-end constraint of recognition emerged, but this constraint was likely exercised via visual attention rather than memory. Experiment 6 replicated both the absence of a significant constrained-retrieval pattern when the sources did not differ perceptibly (as in Exps. 2, 3 and 4) and the presence of that pattern when they did differ perceptibly (as in Exp. 5). Our results suggest that people can easily constrain recognition when items from the to-be-recognized source differ perceptibly from items from other sources (presumably via visual attention), but that it is difficult to constrain retrieval solely on the basis of source memory.