Abstract Conceptual Feature Ratings Predict Gaze Within Written Word Arrays: Evidence From a Visual Wor(l)d Paradigm

The Abstract Conceptual Feature (ACF) framework predicts that word meaning is represented within a high‐dimensional semantic space bounded by weighted contributions of perceptual, affective, and encyclopedic information. The ACF, like latent semantic analysis, is amenable to distance metrics between any two words. We applied predictions of the ACF framework to abstract words using eyetracking via an adaptation of the classical “visual word paradigm” (VWP). Healthy adults (n = 20) selected the lexical item most related to a probe word in a 4‐item written word array comprising the target and three distractors. The relation between the probe and each of the four words was determined using the semantic distance metrics derived from ACF ratings. Eye movement data indicated that the word that was most semantically related to the probe received more and longer fixations relative to distractors. Importantly, in sets where participants did not provide an overt behavioral response, the fixation rates were nonetheless significantly higher for targets than distractors, closely resembling trials where an expected response was given. Furthermore, ACF ratings which are based on individual words predicted eye fixation metrics of probe‐target similarity at least as well as latent semantic analysis ratings which are based on word co‐occurrence. The results provide further validation of Euclidean distance metrics derived from ACF ratings as a measure of one facet of the semantic relatedness of abstract words and suggest that they represent a reasonable approximation of the organization of abstract conceptual space. The data are also compatible with the broad notion that multiple sources of information (not restricted to sensorimotor and emotion information) shape the organization of abstract concepts. While the adapted “VWP” is potentially a more metacognitive task than the classical visual world paradigm, we argue that it offers potential utility for studying abstract word comprehension.     

The role of category information in word identification: A parallel decision model

Four experiments consider the role of semantic category information in word identification using a serial classification reaction time paradigm. Experimental variables were manipulated by varying the semantic properties of blocks of trials and the target search instructions. Experiments 1, 2, and 3 investigated the facilitation on target word recognition of manipulating the categorical homogeneity of the nontarget words. An homogeneous nontarget set facilitated the classification of unrelated target words. This category contrast effect was obtained in all conditions, although its magnitude depended upon target search instructions. Experiment 3 also investigated whether word identification was inhibited if subjects were prevented from utilizing the category information to distinguish target from nontarget words. Target and nontarget word identification was slower under such conditions. Experiment 4 demonstratd that both the category contrast and category interference effects were dependent upon the use of short response-stimulus intervals to define a functional semantic background. This suggests the category effects are perceptual in nature. Current models of word recognition cannot easily explain the findings. A committee decision model is outlined to accommodate the data; the model proposes that visual analysis, identification, and categorization proceed in parallel.     

概念内隐记忆中的注意促进效应

Swallow和Jiang (2010)最早发现, 编码时的目标探测会促进同时呈现的背景信息在随后记忆测验中的表现, 并将这一现象称为注意促进效应(Attentional Boost Effect, ABE)。随后研究发现这一现象并不会出现在概念内隐测验中, 由此提出目标探测主要促进的是背景信息的知觉加工, 而非语义加工。本研究通过3个实验, 操纵了对背景信息的编码加工类型(知觉加工或概念加工)。结果发现, 当与目标探测同时进行的是对背景信息的概念加工任务, 则ABE会出现在随后的概念内隐测验中。反之, 当对背景信息进行的是知觉加工任务时, 则ABE会出现在随后的知觉内隐测验而不是概念内隐测验中。这些结果表明, 目标探测既可能促进背景信息的知觉加工, 也可能促进背景信息的语义加工, 但只有在目标探测下背景信息的编码加工与随后内隐测验中所依赖的提取加工具有一致性, 才会产生ABE。     

Interaction of stimulus and contextual information during reading: Identifying words within sentences

In general, studies on the effects of a sentence context on word identification have focused on how context affects the efficiency of processing a single target word, presented separately from the context. Such studies probably would be incapable of measuring contextual facilitation resulting from cascaded or parallel processing of neighboring words within a sentence. To measure these and other types of facilitation, we presented entire phrases and sentences for subjects to read as fast as possible and to monitor for nonwords. Subjects read at rates representative of natural reading. Experiment 1 demonstrated a large contextual facilitation effect on decision time. Experiment 2 showed that facilitation is caused by specific semantic information and, perhaps to a greater degree, by nonpredictive syntactic information. Experiment 3 showed that the amount of facilitation is greater than could be accounted for by separate contributions from autonomous word level and sentence level processes. These results present difficulties for an autonomous model of reading, but are consistent with interactive models, in which the results of ongoing sentential analyses are combined with stimulus information to identify words.     

汉语句子阅读理解中的语境效应

采用计算机快速系列视觉呈现技术,以反应时为指标,利用命名法,考察了汉语句子阅读中的语境效应。该研究表明：语境的作用机制是灵活的,它会随语境条件的变化而变化。在启动词与目标词语义联结弱的情况下,如果语境对目标词是一种低干扰,那么各模块之间彼此独立,一个模块不受另一个模块的影响;如果句法关系改变后的语境对目标词形成高干扰,各模块相互作用,不同语境对词汇通达有不同的作用。当启动词与目标词间有较强的语义联结时,语境效应主要来源于词与词之间的联结启动,这时的语境作用机制符合模块化理论;而当启动词与目标词间有较弱的语义联结时,随语境干扰强度的增加,目标词的词汇通达也随之增加,这时的语境作用机制则符合相互作用理论。     

The interaction of sentence context and perceptual analysis in word identification

The influence of sentence context on word identification has, in some interactive models, been attributed to enhanced accuracy or speed of perceptual analysis. This view is challenged by two experiments in which contextually enhanced word identification was found only when a target’s relevance to the sentence context was correlated with its presence. When this constraint was removed by using contextually relevant foils, accuracy in detecting words in normal and scrambled sentences did not differ reliably. Moreover, under conditions that constituted a negative correlation between target relevance and presence, word identification was more accurate with scrambled than with normal sentences. These results are consistent with models of sentence context effects that are based on the assumptions that (1) perceptual analysis proceeds independently of contextual analysis, and (2) the results of these analyses are integrated to determine a word’s identity.     

Access to perceptual and conceptual information in the left and right hemispheres.

It is assumed that there are hemispheric differences in the type of information available for the processing of word meanings, e.g., categorical or associative information. In the present experiment, we used a semantic priming paradigm to examine whether perceptual or conceptual properties of word meanings would be associated with the left or right hemisphere. The present experiment also examined time-course activation of these properties across the hemispheres, using short and long stimulus onset asynchronies. The results indicated that perceptual information is available only in the right hemisphere at an early rather than a late stage of target processing, while conceptual information is available in both hemispheres at both early and later stages of target processing. It is suggested that the imagery system in the right hemisphere may contribute to the perceptual priming observed in this hemisphere.     

Semantic context and figure-ground organization

Summary The semantic-priming paradigm was used to investigate the effect of semantic context on the latency to identify visually ambiguous and unambiguous targets. Ambiguous targets had reversible figure-ground organizations analogous to Rubin's vase-profiles picture in which the figural vase is shaped by the same contour that, if reassigned, shapes two figural profiles. The two organizations of the ambiguous targets were either a series of black irregular shapes or a familiar word in white letters; subjects were required to achieve the latter organization. Unambiguous target words were not reversible. Related primes, unlike unrelated primes, facilitated the identification of both types of target; but the magnitude of facilitation was greater for ambiguous targets. The results demonstrate that semantic context influences the speed of figure-ground organization and add perceptual ambiguity to the target manipulations that interact with context to affect encoding.     

The dual effect of context on memory of related and unrelated themes: Discrimination at encoding and cue at retrieval

The influence of contextual factors on encoding and retrieval in recognition memory was investigated using a retroactive interference paradigm. Participants were randomly assigned to four context conditions constructed by manipulating types of presentation modality (pictures vs words) for study, interference, and test stages, respectively (ABA, ABB, AAA, & AAB). In Experiment 1 we presented unrelated items in the study and interference stages, while in Experiment 2 each stage contained items from the same semantic category. The results demonstrate a dual role for context in memory processes-at encoding as well as at retrieval. In Experiment 1 there is a hierarchical order between the four context conditions, depending on both target-test and target-interference contextual similarity. Adding a categorical context in Experiment 2 helped to specify each list and therefore better distinguish between target and interferer information, and in some conditions compensated for their perceptual similarity.     

Effects of context on eye movements when reading about possible and impossible events

Plausibility violations resulting in impossible scenarios lead to earlier and longer lasting eye movement disruption than violations resulting in highly unlikely scenarios (K. Rayner, T. Warren, B. J. Juhasz, & S. P. Liversedge, 2004; T. Warren & K. McConnell, 2007). This could reflect either differences in the timing of availability of different kinds of information (e.g., selectional restrictions, world knowledge, and context) or differences in their relative power to guide semantic interpretation. The authors investigated eye movements to possible and impossible events in real-world and fantasy contexts to determine when contextual information influences detection of impossibility cued by a semantic mismatch between a verb and an argument. Gaze durations on a target word were longer to impossible events independent of context. However, a measure of the time elapsed from first fixating the target word to moving past it showed disruption only in the real-world context. These results suggest that contextual information did not eliminate initial disruption but moderated it quickly thereafter.     

Covert operations: orthographic recoding as a basis for repetition priming in word identification

When a word is generated from a semantic cue, coincident orthographic visualization of that word may cause priming on a subsequent perceptual identification test. A task was introduced that required subjects to visualize the orthographic pattern of auditorily presented words. When used at study, this task produced a pattern of priming similar to that produced by a generate study task. When used at test, equal priming on the orthographic task was produced by read and generate study tasks but not by a generate study task that failed to invite orthographic visualization. Priming on perceptually based word identification tests that results from a generate study episode may be largely due to orthographic recoding of the target rather than to conceptual processing.     

The use of abstract graphemic information in lexical access

Three experiments investigated the nature of the information required for the lexical access of visual words. A four-field masking procedure was used, in which the presentation of consecutive prime and target letter strings was preceded and followed by presentations of a pattern mask. This procedure prevented subjects from identifying, and thus intentionally using, prime information. Experiment I extablished the existence of a semantic priming effect on target identification, demonstrating the lexical access of primes under these conditions. It also showed a word repetition effect independent of letter case. Experiment II tested whether this repetition effect was due to the activation of graphemic or phonemic information. The graphemic and phonemic similarity of primes and targets was varied. No evidence for phonemic priming was found, although a graphemic priming effect, independent of the physical similarity of the stimuli, was obtained. Finally Experiment III demonstrated that, irrespective of whether the prime was a word or a nonword, graphemic priming was equally effective. In both Experiments II and III, however, the word repetition effect was stronger than the graphemic priming effect. It is argued that facilitation from graphemic priming was due to the prime activating a target representation coded for abstract (non-visual) graphemic features, such as letter identities. The extra facilitation from same identity priming was attributed to semantic as well as graphemic activation. The implications of these results for models of word recognition are discussed.     

The prolonged influence of subsequent context on spoken word recognition

Connine, Blasko, and Hall (Journal of Memory and Language 30:234–250, 1991) suggested that within a 1-second temporal window, subsequent biasing information can influence the identification of a previously spoken word. Four experiments further explored this hypothesis. Our participants heard sentences in which an ambiguous target word was followed less than or more than a second later by a word biased in favor of either the target word or another word. Overall, the effects of the contextual biases on responding, measured using phonemic restoration and phoneme identification, were almost as large after 1 second as before 1 second. The implications of these results for defining the window of contextual effects are discussed.     

Voice-specificity effects on auditory word priming

This research explores the nature of the memory traces that support spoken word identification. Specifically, do voice-specificity effects in implicit memory depend on information in a perceptual representational system or, alternatively, on the similarity of study and test exemplars? Memory for words and voices was assessed with two perceptual identification tests—the identification of words in noise and the identification of low-pass filtered words—after two encoding conditions (identification of words in noise and of words in the clear). At test, a word was presented in the same voice as at study or in a different voice. The data from the two experiments showed that study-to-test changes in voice reduced priming and that voice-specificity effects were greatest when the type of processing engaged at study overlapped with that required at test. Taken together, the results implicate the goodness of the processing match between encoding and test as the primary determinant of voice-specificity effects on perceptual identification tests and support the hypothesis that both voice and word information is represented within a single episodic memory system.     

右侧基底节损伤遗忘症患者的知觉性启动效应与语义性启动效应的分离与定位

采用偏好、自由联想、字根补笔和字辨认等4项任务观察一例单纯性右侧基底节损伤遗忘症患者和两组正常对照的启动效应。结果发现：（1）该患者知觉性启动效应障碍,而语义性启动效应正常。认为知觉性启动效应的神经学基础可能在基底节。（2）该患者知觉性启动效应与语义性启动效应分离。认为神经组织的损伤可导致不同形式启动效应的分离,提出内隐记忆或启动效应的不同形式可能存在不同的神经学基础。     

The effect of generation on long-term repetition priming in auditory and visual perceptual identification

Perceptual implicit memory is typically most robust when the perceptual processing at encoding matches the perceptual processing required during retrieval. A consistent exception is the robust priming that semantic generation produces on the perceptual identification test (Masson & MacLeod, 2002), a finding which has been attributed to either (1) conceptual influences in this nominally perceptual task, or (2) covert orthographic processing during generative encoding. The present experiments assess these possibilities using both auditory and visual perceptual identification, tests in which participants identify auditory words in noise or rapidly-presented visual words. During the encoding phase of the experiments, participants generated some words and perceived others in an intermixed study list. The perceptual control condition was visual (reading) or auditory (hearing), and varied across participants. The reading and hearing conditions exhibited the expected modality–specificity, producing robust intra-modal priming and non-significant cross-modal priming. Priming in the generate condition depended on the perceptual control condition. With a read control condition, semantic generation produced robust visual priming but no auditory priming. With a hear control condition, the results were reversed: semantic generation produced robust auditory priming but not visual priming. This set of results is not consistent with a straightforward application of either the conceptual-influence or covert-orthography account, and implies that the nature of encoding in the generate condition is influenced by the broader list context.     

FUNCTIONAL MAGNETIC RESONANCE IMAGING OF SEMANTIC MEMORY PROCESSES IN THE FRONTAL LOBES

Abstract— Frontal-lobe activation during semantic memory performance was examined using functional magnetic resonance imaging (fMRI), a noninvasive technique for localizing neural activity associated with cognitive function. Left inferior prefrontal cortex was more activated for semantic than for perceptual encoding of words, and for initial than for repeated semantic encoding of words. Decreased activation for semantic encoding of repeated words reflects repetition priming, that is, implicit retrieval of memory gained in the initial semantic encoding of a word. The left inferior prefrontal region may sub-serve semantic working memory processes that participate in semantic encoding and that have decreased demands when such encoding can be facilitated by recent semantic experience. These results demonstrate that fMRI can visualize changes in an individual's brain function associated with the encoding and retrieval of new memories.     

Pictorial encoding reduces false recognition of semantic associates

High levels of false recognition can be observed after people study lists of semantic associates that all converge on a nonpresented lure word. To test the idea that encoding distinctive perceptual information would help to reduce false recognition, we presented a line drawing representing each associated word during study list presentation and later tested recognition of studied words and lure words. Two experiments revealed marked reductions in false recognition after pictorial encoding, relative after to word encoding. Results suggest that people reject related and unrelated lures because these items lack the distinctive qualities associated with remembered pictures.     

Episodic encoding and recognition of pictures and words: role of the human medial temporal lobes

In the present PET study, we examined brain activity related to processing of pictures and printed words in episodic memory. Our goal was to determine how the perceptual format of objects (verbal versus pictorial) is reflected in the neural organization of episodic memory for common objects. We investigated this issue in relation to encoding and recognition with a particular focus on medial temporal-lobe (MTL) structures. At encoding, participants saw pictures of objects or their written names and were asked to make semantic judgments. At recognition, participants made yes-no recognition judgments in four different conditions. In two conditions, target items were pictures of objects; these objects had originally been encoded either in picture or in word format. In two other conditions, target items were words; they also denoted objects originally encoded either as pictures or as words. Our data show that right MTL structures are differentially involved in picture processing during encoding and recognition. A posterior MTL region showed higher activation in response to the presentation of pictures than of words across all conditions. During encoding, this region may be involved in setting up a representation of the perceptual information that comprises the picture. At recognition, it may play a role in guiding retrieval processes based on the perceptual input, i.e. the retrieval cue. Another more anterior right MTL region was found to be differentially involved in recognition of objects that had been encoded as pictures, irrespective of whether the retrieval cue provided was pictorial or verbal in nature; this region may be involved in accessing stored pictorial representations. Our results suggest that left MTL structures contribute to picture processing only during encoding. Some regions in the left MTL showed an involvement in semantic encoding that was picture specific; others showed a task-specific involvement across pictures and words. Together, our results provide evidence that the involvement of some but not all MTL regions in episodic encoding and recognition is format specific.     

Effects of perceptual and conceptual similarity in semantic priming

Summary The study investigates the different contributions to semantic priming of two components of the semantic representation underlying a word. The two components are perceptually based information and conceptually based information. Perceptual information is based on physical attributes such as shape or color, while conceptual information consists of more abstract elements such as functional attributes. The question asked in this study was whether both components would produce an effect in semantic priming. Pairs of words either related because of a conceptual property (banana-apple), a perceptual property (ball-apple), or both because of a perceptual and conceptual property (cherry-apple) were presented as prime and target in a lexical decision and a word-naming task. The results showed independent contributions of perceptual and conceptual attributes to semantic priming.This research was supported by a grant from the Dutch Organization for the Advancement of Pure Research (ZWO). All three authors are senior authors and have contributed to all parts of the project.