Interference of spoken word recognition through phonological priming from visual objects and printed words

Three cross-modal priming experiments examined the influence of preexposure to pictures and printed words on the speed of spoken word recognition. Targets for auditory lexical decision were spoken Dutch words and nonwords, presented in isolation (Experiments 1 and 2) or after a short phrase (Experiment 3). Auditory stimuli were preceded by primes, which were pictures (Experiments 1 and 3) or those pictures’ printed names (Experiment 2). Prime–target pairs were phonologically onset related (e.g., pijl–pijn, arrow–pain), were from the same semantic category (e.g., pijl–zwaard, arrow–sword), or were unrelated on both dimensions. Phonological interference and semantic facilitation were observed in all experiments. Priming magnitude was similar for pictures and printed words and did not vary with picture viewing time or number of pictures in the display (either one or four). These effects arose even though participants were not explicitly instructed to name the pictures and where strategic naming would interfere with lexical decision making. This suggests that, by default, processing of related pictures and printed words influences how quickly we recognize spoken words.     

Top-down constraint on recognition memory

Can recognition memory be constrained “at the front end,” such that people are more likely to retrieve information about studying a recognition-test probe from a specified target source than they are to retrieve such information about a probe from a nontarget source? We adapted a procedure developed by Jacoby, Shimizu, Daniels, and Rhodes (Psychonomic Bulletin & Review 12:852–857, 2005) to address this question. Experiment 1 yielded evidence of source-constrained retrieval, but that pattern was not significant in Experiments 2, 3, and 4 (nor in several unpublished pilot experiments). In Experiment 5, in which items from the two studied sources were perceptibly different, a pattern consistent with front-end constraint of recognition emerged, but this constraint was likely exercised via visual attention rather than memory. Experiment 6 replicated both the absence of a significant constrained-retrieval pattern when the sources did not differ perceptibly (as in Exps. 2, 3 and 4) and the presence of that pattern when they did differ perceptibly (as in Exp. 5). Our results suggest that people can easily constrain recognition when items from the to-be-recognized source differ perceptibly from items from other sources (presumably via visual attention), but that it is difficult to constrain retrieval solely on the basis of source memory.     

Searching the same display twice: Properties of short-term memory in repeated search

Consecutive search for different targets in the same display is supported by a short-term memory mechanism: Distractors that have recently been inspected in the first search are found more quickly in the second search when they become the target (Exp. 1). Here, we investigated the properties of this memory process. We found that this recency advantage is robust to a delay between the two searches (Exp. 2) and that it is only slightly disrupted by an interference task between the two searches (Exp. 3). Introducing a concurrent secondary task (Exp. 4) showed that the memory representations formed in the first search are based on identity as well as location information. Together, these findings show that the short-term memory that supports repeated visual search stores a complex combination of item identity and location that is robust to disruption by either time or interference.     

Guidance of attention by information held in working memory

Information held in working memory (WM) can guide attention during visual search. The authors of recent studies have interpreted the effect of holding verbal labels in WM as guidance of visual attention by semantic information. In a series of experiments, we tested how attention is influenced by visual features versus category-level information about complex objects held in WM. Participants either memorized an object’s image or its category. While holding this information in memory, they searched for a target in a four-object search display. On exact-match trials, the memorized item reappeared as a distractor in the search display. On category-match trials, another exemplar of the memorized item appeared as a distractor. On neutral trials, none of the distractors were related to the memorized object. We found attentional guidance in visual search on both exact-match and category-match trials in Experiment 1, in which the exemplars were visually similar. When we controlled for visual similarity among the exemplars by using four possible exemplars (Exp. 2) or by using two exemplars rated as being visually dissimilar (Exp. 3), we found attentional guidance only on exact-match trials when participants memorized the object’s image. The same pattern of results held when the target was invariant (Exps. 2–3) and when the target was defined semantically and varied in visual features (Exp. 4). The findings of these experiments suggest that attentional guidance by WM requires active visual information.     

The production effect in paired-associate learning: Benefits for item and associative information

In five experiments, we extended the production effect—better memory for items said aloud than for items read silently—to paired-associate learning, the goal being to explore whether production enhances associative information in addition to enhancing item information. In Experiments 1 and 2, we used a semantic-relatedness task in addition to the production manipulation and found no evidence of a production effect, whether the measure was cued recall or item recognition. Experiment 3 showed that the semantic-relatedness task had overshadowed the production effect; the effect was present when the semantic-relatedness task was removed, again whether cued recall or item recognition was the measure. Experiments 4 and 5 provided further evidence that production can enhance recall for word pairs and, using an associate recognition test with intact versus rearranged pairs, indicated that production may also enhance associative information. That production boosts memory for both types of information is considered in terms of distinctive encoding.     

Dissociable yet tied inhibitory processes: The structure of inhibitory control

Cognitive and neural models have proposed the existence of a single inhibitory process that regulates behavior and depends on the right frontal operculum (rFO). The aim of this study was to make a contribution to the ongoing debate as to whether inhibition is a single process or is composed of multiple, independent processes. Here, within a single paradigm, we assessed the links between two inhibitory phenomena—namely, resistance to involuntary visual capture by abrupt onsets and resolving of spatial stimulus–response conflict. We did so by conducting three experiments, two involving healthy volunteers (Exps. 1 and 3), and one with the help of a well-documented patient, R.J., with selectively weakened inhibition following a lesion of the rFO. The results suggest that resistance to capture and stimulus–response conflict are independent, because (a) additive effects were found (Exps. 1 and 3), (b) capture did not correlate with compatibility effects (Exp. 1), (c) dual tasking affected the two phenomena differently (Exp. 3), and (d) a dissociation was found between the two in patient R.J. (Exp. 2). However, the results also show that these two phenomena may share some processing components, given that (a) both were affected in patient R.J., but to different degrees (Exp. 2), and (b) increasing the difficulty of dual tasking produced an increasingly negative correlation between capture and compatibility (Exp. 3), which suggests that when resources are withdrawn from the control of the former, they are used to control the latter.     

Intuitively detecting what is hidden within a visual mask: Familiar–novel discrimination and threat detection for unidentified stimuli

Recognition without identification is the finding that, among recognition test items that go unidentified (as when a word is unidentified from a fragment), participants can discriminate those that were studied from those that were unstudied. In the present study, we extended this phenomenon to the more life-like situation of discriminating known from novel stimuli. Pictures of famous and nonfamous faces (Exp. 1), famous and nonfamous scenes (Exp. 2), and threatening and nonthreatening images (Exp. 3) were filtered in order to impede identification. As in list-learning recognition-without-identification paradigms, participants attempted to identify each image (e.g., whose face it was, what scene it was, or what was in the picture) and rated how familiar the image seemed on a scale of 0 (very unfamiliar) to 10 (very familiar). Among the unidentified stimuli, higher familiarity ratings were given to famous than to nonfamous faces (Exp. 1) and scenes (Exp. 2), and to threatening than to nonthreatening living/animate (but not to nonliving/nonanimate) images (Exp. 3). These findings suggest that even when a stimulus is too occluded to allow for conscious identification, enough information can be processed to allow a sense of familiarity or novelty with it, which appears also to be related to the sense of whether or not a living creature is a threat. That the sense of familiarity for unidentified stimuli may be related to threat detection for living or animate things suggests that it may be an adaptive aspect of human memory.     

Strength cues and blocking at test promote reliable within-list criterion shifts in recognition memory

In seven experiments, we explored the potential for strength-based, within-list criterion shifts in recognition memory. People studied a mix of target words, some presented four times (strong) and others studied once (weak). In Experiments 1, 2, 4A, and 4B, the test was organized into alternating blocks of 10, 20, or 40 trials. Each block contained lures intermixed with strong targets only or weak targets only. In strength-cued conditions, test probes appeared in a unique font color for strong and weak blocks. In the uncued conditions of Experiments 1 and 2, similar strength blocks were tested, but strength was not cued with font color. False alarms to lures were lower in blocks containing strong target words, as compared with lures in blocks containing weak targets, but only when strength was cued with font color. Providing test feedback in Experiment 2 did not alter these results. In Experiments 3A–3C, test items were presented in a random order (i.e., not blocked by strength). Of these three experiments, only one demonstrated a significant shift even though strength cues were provided. Overall, the criterion shift was larger and more reliable as block size increased, and the shift occurred only when strength was cued with font color. These results clarify the factors that affect participants’ willingness to change their response criterion within a test list.     

What skilled typists don’t know about the QWERTY keyboard

We conducted four experiments to investigate skilled typists’ explicit knowledge of the locations of keys on the QWERTY keyboard, with three procedures: free recall (Exp.?1), cued recall (Exp.?2), and recognition (Exp.?3). We found that skilled typists’ explicit knowledge of key locations is incomplete and inaccurate. The findings are consistent with theories of skilled performance and automaticity that associate implicit knowledge with skilled performance and explicit knowledge with novice performance. In Experiment?4, we investigated whether novice typists acquire more complete explicit knowledge of key locations when learning to touch-type. We had skilled QWERTY typists complete a Dvorak touch-typing tutorial. We then tested their explicit knowledge of the Dvorak and QWERTY key locations with the free recall task. We found no difference in explicit knowledge of the two keyboards, suggesting that typists know little about key locations on the keyboard, whether they are exposed to the keyboard for 2 h or 12 years.     

The modulation of semantic transparency on the recognition memory for two-character Chinese words

This study demonstrated that semantic transparency as a linguistic property modulates the recognition memory for two-character Chinese words, with opaque words (i.e., words whose meanings cannot be derived from constituent characters—e.g., “光[/guang/, light]棍[/gun/, stick]”, bachelor) remembered better than transparent words (i.e., words whose meanings can be derived from constituent characters—e.g., “茶[/cha/, tea]杯[/bei/, cup]”, teacup). In Experiment 1, the participants made lexical decisions on transparent words, opaque words, and nonwords in the study and then engaged in an old/new recognition test. Experiment 2 employed a concreteness judgment as the encoding task to ensure equivalent semantic processing for opaque and transparent words. In Experiment 3, the neighborhood size of the two-character words was manipulated together with their semantic transparency. In all three experiments, opaque words were found to be better remembered than transparent words. We concluded that the conceptual incongruence between the meanings of a whole word and its constituent characters made opaque words more distinctive and, hence, better remembered than transparent words.     

When disfluency is—and is not—a desirable difficulty: The influence of typeface clarity on metacognitive judgments and memory

There are many instances in which perceptual disfluency leads to improved memory performance, a phenomenon often referred to as the perceptual-interference effect (e.g., Diemand-Yauman, Oppenheimer, & Vaughn (Cognition 118:111–115, 2010); Nairne (Journal of Experimental Psychology: Learning, Memory, and Cognition 14:248–255, 1988)). In some situations, however, perceptual disfluency does not affect memory (Rhodes & Castel (Journal of Experimental Psychology: General 137:615–625, 2008)), or even impairs memory (Glass, (Psychology and Aging 22:233–238, 2007)). Because of the uncertain effects of perceptual disfluency, it is important to establish when disfluency is a “desirable difficulty” (Bjork, 1994) and when it is not, and the degree to which people’s judgments of learning (JOLs) reflect the consequences of processing disfluent information. In five experiments, our participants saw multiple lists of blurred and clear words and gave JOLs after each word. The JOLs were consistently higher for the perceptually fluent items in within-subjects designs, which accurately predicted the pattern of recall performance when the presentation time was short (Exps. 1a and 2a). When the final test was recognition or when the presentation time was long, however, we found no difference in recall for clear and blurred words, although JOLs continued to be higher for clear words (Exps. 2b and 3). When fluency was manipulated between subjects, neither JOLs nor recall varied between formats (Exp. 1b). This study suggests a boundary condition for the desirable difficulty of perceptual disfluency and indicates that a visual distortion, such as blurring a word, may not always induce the deeper processing necessary to create a perceptual-interference effect.     

The effects of interleaving versus blocking on foreign language pronunciation learning

Many studies have shown that students learn better when they are given repeated exposures to different concepts in a way that is shuffled or interleaved, rather than blocked (e.g., Rohrer Educational Psychology Review, 24, 355–367, 2012). The present study explored the effects of interleaving versus blocking on learning French pronunciations. Native English speakers learned several French words that conformed to specific pronunciation rules (e.g., the long “o” sound formed by the letter combination “eau,” as in bateau), and these rules were presented either in blocked fashion (bateau, carreau, fardeau . . . mouton, genou, verrou . . . tandis, verglas, admis) or in interleaved fashion (bateau, mouton, tandis, carreau, genou, verglas . . .). Blocking versus interleaving was manipulated within subjects (Experiments 1–3) or between subjects (Experiment 4), and participants’ pronunciation proficiency was later tested through multiple-choice tests (Experiments 1, 2, and 4) or a recall test (Experiment 3). In all experiments, blocking benefited the learning of pronunciations more than did interleaving, and this was true whether participants learned only 4 words per rule (Experiments 1–3) or 15 words per rule (Experiment 4). Theoretical implications of these findings are discussed.     

Escaping the recent past: Which stimulus dimensions influence proactive interference?

Proactive interference occurs when information from the past disrupts current processing and is a major source of confusion and errors in short-term memory (STM; Wickens, Born, & Allen, Journal of Verbal Learning and Verbal Behavior, 2:440–445, 1963). The present investigation examines potential boundary conditions for interference, testing the hypothesis that potential competitors must be similar along task-relevant dimensions to influence proactive interference effects. We manipulated both the type of task being completed (Experiments 1, 2, and 3) and dimensions of similarity irrelevant to the current task (Experiments 4 and 5) to determine how the recent presentation of a probe item would affect the speed with which participants could reject that item. Experiments 1, 2, and 3 contrasted STM judgments, which require temporal information, with semantic and perceptual judgments, for which temporal information is irrelevant. In Experiments 4 and 5, task-irrelevant information (perceptual similarity) was manipulated within the recent probes task. We found that interference from past items affected STM task performance but did not affect performance in semantic or perceptual judgment tasks. Conversely, similarity along a nominally irrelevant perceptual dimension did not affect the magnitude of interference in STM tasks. Results are consistent with the view that items in STM are represented by noisy codes consisting of multiple dimensions and that interference occurs when items are similar to each other and, thus, compete along the dimensions relevant to target selection.     

Language statistics explain the spatial–numerical association of response codes

The spatial–numerical association of response codes (SNARC) has shown that parity judgments with participants’ left hands yield faster response times (RTs) for smaller numbers than for larger numbers, with the opposite result for right-hand responses. These findings have been explained by participants perceptually simulating magnitude on a mental number line. In three RT experiments, we showed that the SNARC effect can also be explained by language statistics. Participants made parity judgments of number words (Exp. 1) and Arabic numerals (Exp. 2). Linguistic frequencies of the number words and numbers mirrored the SNARC effect, explaining aspects of processing that a perceptual simulation account could not. In Experiment 3, we investigated whether high- and low-frequency nonnumerical words would also elicit a SNARC-like effect. Again, RTs were faster for high-frequency words for left-hand responses, with the opposite result for right-hand responses. These results demonstrate that what has only been attributed to perceptual simulation should also be attributed to language statistics.     

The effects of initial testing on false recall and false recognition in the social contagion of memory paradigm

In three experiments, participants studied photographs of common household scenes. Following study, participants completed a category-cued recall test without feedback (Exps. 1 and 3), a category-cued recall test with feedback (Exp. 2), or a filler task (no-test condition). Participants then viewed recall tests from fictitious previous participants that contained erroneous items presented either one or four times, and then completed final recall and source recognition tests. The participants in all conditions reported incorrect items during final testing (a social contagion effect), and across experiments, initial testing had no impact on false recall of erroneous items. However, on the final source-monitoring recognition test, initial testing had a protective effect against false source recognition: Participants who were initially tested with and without feedback on category-cued initial tests attributed fewer incorrect items to the original event on the final source-monitoring recognition test than did participants who were not initially tested. These data demonstrate that initial testing may protect individuals’ memories from erroneous suggestions.     

The role of flicker and abrupt displacement in attention capture by motion onsets

Sunny and von Mühlenen (Psychonomic Bulletin & Review, 18, 1050–1056, 2011) showed that an onset of motion captured attention only when the motion was jerky (refreshed at 8 or 17 Hz), but not when it was smooth (33 or 100 Hz). However, it remained unclear why the onset of jerky motion captures attention. In the present study, we systematically tested the role of different aspects of jerky motion in capturing attention. Simple flicker without motion did not capture attention in the same way as jerky motion (Exp. 1). An abrupt displacement between 0.26° and 1.05° captured attention, irrespective of whether the stimulus subsequently continued to move smoothly (Exp. 2) or whether it remained stationary (Exps. 3 and 4). A displaced stimulus that was preceded briefly at the new location by a figure-8 placeholder did not capture attention (Exp. 5). These results are explained within a masking account, according to which abrupt onsets and abrupt displacements receive a processing advantage because they escape forward masking by the preceding figure-8 placeholders.     

The importance of context information for the spatial specificity of gaze cueing

In three experiments, we investigated the spatial allocation of attention in response to central gaze cues. In particular, we examined whether the allocation of attentional resources is influenced by context information—that is, the presence or absence of reference objects (i.e., placeholders) in the periphery. On each trial, gaze cues were followed by a target stimulus to which participants had to respond by keypress or by performing a target-directed saccade. Targets were presented either in an empty visual field (Exps. 1 and 2) or in previewed location placeholders (Exp. 3) and appeared at one of either 18 (Exp. 1) or six (Exps. 2 and 3) possible positions. The spatial distribution of attention was determined by comparing response times as a function of the distance between the cued and target positions. Gaze cueing was not specific to the exact cued position, but instead generalized equally to all positions in the cued hemifield, when no context information was provided. However, gaze direction induced a facilitation effect specific to the exact gazed-at position when reference objects were presented. We concluded that the presence of possible objects in the periphery to which gaze cues could refer is a prerequisite for attention shifts being specific to the gazed-at position.     

Dissociations between vision for perception and vision for action depend on the relative availability of egocentric and allocentric information

In three experiments, we scrutinized the dissociation between perception and action, as reflected by the contributions of egocentric and allocentric information. In Experiment 1, participants stood at the base of a large-scale one-tailed version of a Müller-Lyer illusion (with a hoop) and either threw a beanbag to the endpoint of the shaft or verbally estimated the egocentric distance to that location. The results confirmed an effect of the illusion on verbal estimates, but not on throwing, providing evidence for a dissociation between perception and action. In Experiment 2, participants observed a two-tailed version of the Müller-Lyer illusion from a distance of 1.5 m and performed the same tasks as in Experiment 1, yet neither the typical illusion effects nor a dissociation became apparent. Experiment 3 was a replication of Experiment 1, with the difference that participants stood at a distance of 1.5 m from the base of the one-tailed illusion. The results indicated an illusion effect on both the verbal estimate task and the throwing task; hence, there was no dissociation between perception and action. The presence (Exp. 1) and absence (Exp. 3) of a dissociation between perception and action may indicate that dissociations are a function of the relative availability of egocentric and allocentric information. When distance estimates are purely egocentric, dissociations between perception and action occur. However, when egocentric distance estimates have a (complementary) exocentric component, the use of allocentric information is promoted, and dissociations between perception and action are reduced or absent.     

Foreign accent strength and listener familiarity with an accent codetermine speed of perceptual adaptation

We investigated how the strength of a foreign accent and varying types of experience with foreign-accented speech influence the recognition of accented words. In Experiment 1, native Dutch listeners with limited or extensive prior experience with German-accented Dutch completed a cross-modal priming experiment with strongly, medium, and weakly accented words. Participants with limited experience were primed by the medium and weakly accented words, but not by the strongly accented words. Participants with extensive experience were primed by all accent types. In Experiments 2 and 3, Dutch listeners with limited experience listened to a short story before doing the cross-modal priming task. In Experiment 2, the story was spoken by the priming task speaker and either contained strongly accented words or did not. Strongly accented exposure led to immediate priming by novel strongly accented words, while exposure to the speaker without strongly accented tokens led to priming only in the experiment’s second half. In Experiment 3, listeners listened to the story with strongly accented words spoken by a different German-accented speaker. Listeners were primed by the strongly accented words, but again only in the experiment’s second half. Together, these results show that adaptation to foreign-accented speech is rapid but depends on accent strength and on listener familiarity with those strongly accented words.     

Evidence for habituation of the irrelevant-sound effect on serial recall

Working memory theories make opposing predictions as to whether the disruptive effect of task-irrelevant sound on serial recall should be attenuated after repeated exposure to the auditory distractors. Although evidence of habituation has emerged after a passive listening phase, previous attempts to observe habituation to to-be ignored distractors on a trial-by-trial basis have proven to be fruitless. With the present study, we suggest that habituation to auditory distractors occurs, but has often been overlooked because past attempts to measure habituation in the irrelevant-sound paradigm were not sensitive enough. In a series of four experiments, the disruptive effects of to-be-ignored speech and music relative to a quiet control condition were markedly reduced after eight repetitions, regardless of whether trials were presented in blocks (Exp. 1) or in a random order (Exp. 2). The auditory distractor’s playback direction (forward, backward) had no effect (Exp. 3). The same results were obtained when the auditory distractors were only presented in a retention interval after the presentation of the to-be-remembered items (Exp. 4). This pattern is only consistent with theoretical accounts that allow for attentional processes to interfere with the maintenance of information in working memory.