An investigation of cross-modality effects in implicit and explicit memory

Three experiments are reported which investigate the effects of study/test compatibility on implicit and explicit memory performance. In the first experiment subjects either named each visually presented target item, or generated each item from a close semantic associate. They were then given either a free recall test or a visual word-stem completion task. A generation effect was evident in the free recall data (generated items were better recalled than named items) and this pattern was reversed for word-stem completion. In the second experiment subjects again named or generated items and were then given an auditory word-stem completion task. Under these conditions, cross-modal priming was found both for named and for generated items, but the reverse generation effect, which was evident in Experiment 1 with word-stem completion, was eliminated. In the final experiment, subjects were asked to name the targets, read them silently, or read them under conditions of articulatory suppression, and were then given an auditory stem completion task. Significant cross-modal priming was observed under all three conditions. The strongest priming was found in the naming condition and the weakest in the suppression condition. The results are interpreted within the transfer appropriate processing framework.     

Semantic transparency and masked morphological priming: The case of prefixed words

In four lexical decision experiments, we investigated masked morphological priming with Dutch prefixed words. Reliable effects of morphological relatedness were obtained with visual primes and visual targets in the absence of effects due to pure form overlap. In certain conditions, priming effects were significantly greater with semantically transparent prefixed primes (e.g., rename-name) relative to the priming effects obtained with semantically opaque prefixed words (e.g., relate-late), even with very brief (40-msec) prime durations. With visual primes and auditory targets (cross-modal priming), significant facilitation was found in all related prime conditions, independent of whether or not primes were morphologically related to targets. The results are interpreted within a bimodal hierarchical model of word recognition in which morphological effects arise through the interplay of sublexical (morpho-orthographic) and supralexical (morpho-semantic) representations. The word stimuli from this study may be downloaded as supplemental materials from http://mc.psychonomic-journals .org/content/supplemental.     

A functional disconnection between spoken and visual word recognition: evidence from unconscious priming.

The goal of the present study is to assess whether there is an automatic and obligatory activation of the phonological lexicon upon the presentation of a written word under unconscious processing conditions. We use a cross-modal version of the masked repetition priming procedure introduced by Forster and Davis (Journal of Experimental Psychology: Learning, Memory, and Cognition 10 (1984) 680) which consists of priming a spoken word by its written equivalent under masked conditions. These trials are randomly mixed with within-modal (visual-visual) repetition priming control trials. Our results show that cross-modal priming effects are absent unless primes are consciously perceived, as assessed by d' scores obtained with a letter/pseudo discrimination task. In contrast, priming effects within the written modality are observed under conscious as well as unconscious processing conditions. We conclude that the systems underlying written and spoken word processing are, respectively, autonomous and connected only under conscious conditions.     

The role of explicit memory processes in cross-modal priming: an investigation of stem completion priming in amnesia

To clarify the role of explicit memory processes in cross-modal priming, two experiments examined the status of cross-modal stem completion priming in amnesia. Experiment 1 used a standard behavioral paradigm in which stems corresponding to studied and unstudied words were intermixed. Amnesic patients showed intact within- and cross-modal priming, but, in contrast to controls, they recognized very few of their completions as having been on the study list. This finding suggests that memorial awareness is not necessary for cross-modal priming to occur. Experiment 2 used a paradigm modeled after functional imaging studies, in which stems corresponding to studied and unstudied words were blocked. Amnesic patients showed intact within-modal priming, but impaired cross-modal priming. This finding is consistent with the notion that a blocked format induces voluntary retrieval strategies in normal participants.     

Orthography plays a critical role in cognate priming: Evidence from French/English and Arabic/French cognates

A series of three experiments was carried out in order to better characterize the representations that support long-term cognate priming. In Experiment 1, robust priming was obtained between orthographically similar French/English cognates in bilingual speakers, and this priming was mediated, in part, by orthographic codes, given that priming for these items was dramatically reduced following a study-test modality shift. In Experiment 2, no priming was obtained between the same set of French/English cognates in monolingual English speakers. Finally, in Experiment 3, priming for orthographically unrelated Arabic/French cognates was no larger than cross-modal priming, suggesting that these effects were mediated by nonorthographic representations. The role of orthography in supporting cognate priming is discussed.     

Automatic processes in lexical access and spreading activation.

The semantic priming effect can be reduced or eliminated depending on how the prime word is processed. The experiments reported here investigate this prime task effect. Two experiments used identity and semantic priming tasks to determine whether the prime word is encoded at a lexical level under letter-search conditions. When the prime task was naming, both identity and semantic priming occurred; however, when a letter-search task was performed on the prime word, only identity priming occurred, thus supporting the argument that the search task affects activation of semantic associates rather than lexical access of the prime word. Another experiment demonstrated that this identity priming was the result of lexical processes rather than of letter-by-letter priming. A cross-modal priming technique demonstrated that the letter-search prime task does not actively suppress activation of semantic associates. The implications of these results for automaticity and for proposed mechanisms of priming are discussed.     

Morphological priming: Dissociation of phonological, semantic, and morphological factors

Previous experiments based on a masked-priming paradigm revealed robust morphological priming effects induced by two derivational morphemes in Hebrew: the root and the verbal pattern. However, considering the special characteristics of the masked-priming paradigm, the possible contributions of phonological and/or semantic factors to these morphological effects could not be firmly assessed. In the present study, the role of these factors in morphological priming was examined, using cross-modal presentation. Experiment 1 revealed that priming between morphologically related words in Hebrew is determined by higher level linguistic characteristics and cannot be reduced to phonological overlap. Experiment 2 confirmed that morphological priming occurs in Hebrew even when primes and targets are not semantically related but, nevertheless, increases with semantic similarity. The results support the claim that morphological priming cannot be accounted for by considering semantic and phonological factors alone, and they exemplify the potential of using both masked and cross-modal priming to examine morphological processing.     

Missing information in spoken word recognition: nonreleased stop consonants.

Cross-modal semantic priming and phoneme monitoring experiments investigated processing of word-final nonreleased stop consonants (e.g., kit may be pronounced /kit/ or /ki/), which are common phonological variants in American English. Both voiced /d/ and voiceless /t/ segments were presented in release and no-release versions. A cross-modal semantic priming task (Experiment 1) showed comparable priming for /d/ and /t/ versions. A second set of stimuli ending in /s/ were presented as intact, missing /s/, or with a mismatching final segment and showed significant but reduced priming for the latter two conditions. Experiment 2 showed that phoneme monitoring reaction time for release and no-release words and onset mismatching stimuli (derived pseudowords) increased as acoustic-phonetic similarity to the intended word decreased. The results suggest that spoken word recognition does not require special mechanisms for processing no-release variants. Rather, the results can be accounted for by means of existing assumptions concerning probabilistic activation that is based on partial activation.     

象似性和手语学习经验对中国手语-汉语跨模态语义启动效应的影响

采用启动条件下的词汇判断任务,考察熟练手语使用者和无手语经验成年听人的跨模态语义启动效应。结果发现：1)在象似词条件下,两组被试判断汉语语义相关词的反应时均快于语义无关词,说明手语象似词和汉语词之间存在跨模态语义启动效应。2)在非象似词条件下,仅手语熟练被试判断汉语语义相关词的反应时快于语义无关词,无手语经验被试判断汉语语义相关词和无关词的速度没有差异。这是由于前者心理词库中的手语词和口语词共享语义表征,而后者主要依赖手语象似词的视觉模拟性。整个研究表明,中国手语和汉语间存在跨模态语义启动效应,但该效应受到手语词象似性和手语学习经历的调节。     

Cross-modal evaluative priming: emotional sounds influence the processing of emotion words

Cross-modal priming occurs when a prime presented in one sensory modality influences responses to a target in a different sensory modality. Currently, demonstrations of cross-modal evaluative priming have been sparse and limited. In the present study, we seek to partially rectify this state of affairs by examining cross-modal evaluative priming from auditory primes to visual targets. Significant cross-modal priming effects were found, but only for negative primes. Results are discussed in terms of the negativity bias, and several suggestions are provided for using cross-modal evaluative priming to address theoretically important questions about emotion and cognition.     

保留的跨通道启动与老化：对于近期观点的总结

通道内重复启动的研究提示老年人内隐记忆未受损, 这不只体现在视觉通道上还包括其他感觉通道(例如触觉、听觉和嗅觉)。然而很少有研究考察启动任务是否具有通道特异性。在以年轻人为被试的研究中发现跨通道迁移(视觉到触觉和触觉到视觉)和通道内迁移(视觉到视觉, 触觉到触觉)具有相似性。一项最近的研究进一步探索老年人在跨通道启动任务上是否受损。结果显示视觉和触觉间的跨通道启动在年轻被试和老年被试上都是保留的且具有对称性。并且, 对于自然声响、图片的通道内和跨通道启动任务随着年老化发展仍旧保留。这些行为结果和其它最近神经科学结果显示跨通道启动发生于枕叶后纹状皮层区, 而这一区域在老年人中未损坏。这一领域未来的研究方向包括利用不同知觉通道间、利用熟悉的和新异的刺激并结合行为的和脑成像的方法, 通过设计完善的跨通道启动来研究正常老人与阿尔兹海默病人, 还包括将设计得完善的启动任务包括在用于改善老年人记忆功能的项目中。     

Implicit memory for phonological processes in visual stem completion

Four experiments were conducted investigating the role of phonology in repetition priming. Experiment 1 used a cross-modal priming paradigm in which participants made semantic judgments about spoken words and then performed a visual stem completion task. In Experiments 2–4, both the primes and the test stems were presented visually. The results of the first three experiments revealed that priming transfers across interpretations of a homophone. That is, seeing or hearingweek primes bothweek andweak. The results of Experiment 4 showed that homophone priming cannot be attributed to the orthographic similarity of homophonic words. Together, these results indicate that repetition priming on a visual word completion task includes a phonological component.     

Cross-modal priming and explicit memory in patients with verbal production deficits

Implicit memory is often thought to reflect an influence of past experience on perceptual processes, yet priming effects are found when the perceptual format of stimuli changes between study and test episodes. Such cross-modal priming effects have been hypothesized to depend upon stimulus recoding processes whereby a stimulus presented in one modality is converted to other perceptual formats. The present research examined recoding accounts of cross-modal priming by testing patients with verbal production deficits that presumably impair the conversion of visual words into auditory/phonological forms. The patients showed normal priming in a visual stem completion task following visual study (Experiment 1), but showed impairments following auditory study in both implicit (Experiment 2) and explicit (Experiment 3) stem completion. The results are consistent with the hypothesis that verbal production processes contribute to the recoding of visual stimuli and support cross-modal priming. The results also indicate that shared processes contribute to both explicit memory and cross-modal implicit memory.     

False memories and lexical decision: even twelve primes do not cause long-term semantic priming

Semantic priming effects are usually obtained only if the prime is presented shortly before the target stimulus. Recent evidence obtained with the so-called false memory paradigm suggests, however, that in both explicit and implicit memory tasks semantic relations between words can result in long-lasting effects when multiple 'primes' are presented. The aim of the present study was to investigate whether these effects would generalize to lexical decision. In four experiments we showed that even as many as 12 primes do not cause long-term semantic priming. In all experiments, however, a repetition priming effect was obtained. The present results are consistent with a number of other results showing that semantic information plays a minimal role in long-term priming in visual word recognition.     

数量空间表征的特点:跨视听通道下的SNARC效应

从跨通道的角度入手,采用大小比较任务,对视听单通道及跨通道下数量空间表征的特点及表征过程中的相互影响进行探讨。结果发现,视觉通道和听觉通道均存在SNARC效应;在跨通道任务下,无论启动通道是视觉还是听觉通道,都表现出,当启动通道的数量大小信息与主通道的数量大小一致或无关时,主通道的SNARC效应没有显著变化;但当启动通道的数量大小信息与主通道不一致时,主通道的SNARC效应受到显著影响,表现为降低或消失。这进一步证明了SNARC效应受情境影响的特点,并发现在进行跨通道数量空间表征时,听觉通道的数量信息对视觉通道下的数量空间表征的影响大于视觉通道的数量信息对听觉通道下的数量空间表征的影响。     

Morphological priming in the German mental lexicon.

We present results from cross-modal priming experiments on German participles and noun plurals. The experiments produced parallel results for both inflectional systems. Regular inflection exhibits full priming whereas irregularly inflected word forms show only partial priming: after hearing regularly inflected words (-t participles and -s plurals), lexical decision times on morphologically related word forms (presented visually) were similar to reaction times for a base-line condition in which prime and target were identical, but significantly shorter than in a control condition where prime and target were unrelated. In contrast, prior presentation of irregular words (-n participles and -er plurals) led to significantly longer response times on morphologically related word forms than the prior presentation of the target itself. Hence, there are clear priming differences between regularly and irregularly inflected German words. We compare the findings on German with experimental results on regular and irregular inflection in English and Italian, and discuss theoretical implications for single versus dual-mechanism models of inflection.     

Representation and competition in the perception of spoken words

We present data from four experiments using cross-modal priming to examine the effects of competitor environment on lexical activation during the time course of the perception of a spoken word. The research is conducted from the perspective of a distributed model of speech perception and lexical representation, which focuses on activation at the level of lexical content. In this model, the strength of competition between simultaneously active lexical items depends on the degree of coherence between their distributed semantic and phonological representations. Consistent with this model, interference effects are more complete when the purely semantic aspects of these coactive representations are probed (using semantic priming) than when phonological aspects are probed as well (using repetition priming).     

Regularity re-revisited: modality matters

The issue of regular-irregular past tense formation was examined in a cross-modal lexical decision task in Modern Greek, a language where the orthographic and phonological overlap between present and past tense stems is the same for both regular and irregular verbs. The experiment described here is a follow-up study of previous visual lexical decision experiments (Tsapkini, Kehayia, & Harema, 2002) that also addressed the regular-irregular distinction in Greek. In the present experiment, we investigated the effect of input modality in lexical processing and compared different types of regular and irregular verbs. In contrast to our previous intra-modal (visual-visual) priming experiments, in this cross-modal (auditory-visual) priming study, we found that regular verbs with an orthographically salient morphemic aspectual marker elicited the same facilitation as those without an orthographically salient marker. However, irregular verbs did not exhibit a different priming pattern with respect to modality. We interpret these results in the framework of a two-level lexical processing approach with modality-specific access representations at a surface level and modality-independent morphemic representations at a deeper level.     

The effect of generation on long-term repetition priming in auditory and visual perceptual identification

Perceptual implicit memory is typically most robust when the perceptual processing at encoding matches the perceptual processing required during retrieval. A consistent exception is the robust priming that semantic generation produces on the perceptual identification test (Masson & MacLeod, 2002), a finding which has been attributed to either (1) conceptual influences in this nominally perceptual task, or (2) covert orthographic processing during generative encoding. The present experiments assess these possibilities using both auditory and visual perceptual identification, tests in which participants identify auditory words in noise or rapidly-presented visual words. During the encoding phase of the experiments, participants generated some words and perceived others in an intermixed study list. The perceptual control condition was visual (reading) or auditory (hearing), and varied across participants. The reading and hearing conditions exhibited the expected modality–specificity, producing robust intra-modal priming and non-significant cross-modal priming. Priming in the generate condition depended on the perceptual control condition. With a read control condition, semantic generation produced robust visual priming but no auditory priming. With a hear control condition, the results were reversed: semantic generation produced robust auditory priming but not visual priming. This set of results is not consistent with a straightforward application of either the conceptual-influence or covert-orthography account, and implies that the nature of encoding in the generate condition is influenced by the broader list context.     

Visual-auditory events: cross-modal perceptual priming and recognition memory.

Modality specificity in priming is taken as evidence for independent perceptual systems. However, Easton, Greene, and Srinivas (1997) showed that visual and haptic cross-modal priming is comparable in magnitude to within-modal priming. Where appropriate, perceptual systems might share like information. To test this, we assessed priming and recognition for visual and auditory events, within- and across- modalities. On the visual test, auditory study resulted in no priming. On the auditory priming test, visual study resulted in priming that was only marginally less than within-modal priming. The priming results show that visual study facilitates identification on both visual and auditory tests, but auditory study only facilitates performance on the auditory test. For both recognition tests, within-modal recognition exceeded cross-modal recognition. The results have two novel implications for the understanding of perceptual priming: First, we introduce visual and auditory priming for spatio-temporal events as a new priming paradigm chosen for its ecological validity and potential for information exchange. Second, we propose that the asymmetry of the cross-modal priming observed here may reflect the capacity of these perceptual modalities to provide cross-modal constraints on ambiguity. We argue that visual perception might inform and constrain auditory processing, while auditory perception corresponds to too many potential visual events to usefully inform and constrain visual perception.