Context effects of pictures and words in naming objects, reading words, and generating simple phrases

In five language production experiments it was examined which aspects of words are activated in memory by context pictures and words. Context pictures yielded Stroop-like and semantic effects on response times when participants generated gender-marked noun phrases in response to written words (Experiment 1A). However, pictures yielded no such effects when participants simply read aloud the noun phrases (Experiment 2). Moreover, pictures yielded a gender congruency effect in generating gender-marked noun phrases in response to the written words (Experiments 3A and 3B). These findings suggest that context pictures activate lemmas (i.e., representations of syntactic properties), which leads to effects only when lemmas are needed to generate a response (i.e., in Experiments 1A, 3A, and 3B, but not in Experiment 2). Context words yielded Stroop-like and semantic effects in picture naming (Experiment 1B). Moreover, words yielded Stroop-like but no semantic effects in reading nouns (Experiment 4) and in generating noun phrases (Experiment 5). These findings suggest that context words activate the lemmas and forms of their names, which leads to semantic effects when lemmas are required for responding (Experiment 1B) but not when only the forms are required (Experiment 4). WEAVER++ simulations of the results are presented.     

The gender congruency effect and the selection of freestanding and bound morphemes: evidence from croatian

The authors report 3 picture-word interference experiments in which they explore some properties of the agreement process in speech production. In Experiment 1, Croatian speakers were asked to produce utterances in which the noun's gender value had an impact on the selection of gender-marked freestanding morphemes (pronouns) while ignoring the presentation of same- or different-gender distractor words. In Experiments 2 and 3, Croatian speakers were asked to name the same pictures using noun phrases in which the noun's gender value surfaced as an inflectional suffix. Different-gender distractors interfered more than same-gender distractors (the gender congruency effect) in Experiment 1, but not in Experiments 2 and 3. These contrasting results show that the cause of the gender congruency effect is not at the level where lexical-grammatical information is selected but at the level of selection of freestanding morphemes.     

Phonological Regularities and Grammatical Gender Retrieval in Spoken Word Recognition and Word Production

Two experiments investigate whether native speakers of French can use a noun’s phonological ending to retrieve its gender and that of a gender-marked element. In Experiment 1, participants performed a gender decision task on the noun’s gender-marked determiner for auditorily presented nouns. Noun endings with high predictive values were selected. The noun stimuli could either belong to the gender class predicted by their ending (congruent) or they could belong to the gender class that was different from the predicted gender (incongruent). Gender decisions were made significantly faster for congruent nouns than for incongruent nouns, relative to a (lexical decision) baseline task. In Experiment 2, participants named pictures of the same materials as used in Experiment 1 with noun phrases consisting of a gender-marked determiner, a gender-marked adjective and a noun. In this Experiment, no effect of congruency, relative to a (bare noun naming) baseline task, was observed. Thus, the results show an effect of phonological information on the retrieval of gender-marked elements in spoken word recognition, but not in word production.     

Crossmodal semantic priming by naturalistic sounds and spoken words enhances visual sensitivity

We propose a multisensory framework based on Glaser and Glaser's (1989) general reading-naming interference model to account for the semantic priming effect by naturalistic sounds and spoken words on visual picture sensitivity. Four experiments were designed to investigate two key issues: First, can auditory stimuli enhance visual sensitivity when the sound leads the picture as well as when they are presented simultaneously? And, second, do naturalistic sounds (e.g., a dog's "woofing") and spoken words (e.g., /d?g/) elicit similar semantic priming effects? Here, we estimated participants' sensitivity and response criterion using signal detection theory in a picture detection task. The results demonstrate that naturalistic sounds enhanced visual sensitivity when the onset of the sounds led that of the picture by 346 ms (but not when the sounds led the pictures by 173 ms, nor when they were presented simultaneously, Experiments 1-3A). At the same SOA, however, spoken words did not induce semantic priming effects on visual detection sensitivity (Experiments 3B and 4A). When using a dual picture detection/identification task, both kinds of auditory stimulus induced a similar semantic priming effect (Experiment 4B). Therefore, we suggest that there needs to be sufficient processing time for the auditory stimulus to access its associated meaning to modulate visual perception. Besides, the interactions between pictures and the two types of sounds depend not only on their processing route to access semantic representations, but also on the response to be made to fulfill the requirements of the task.     

The role of visual form in lexical access: Evidence from Chinese classifier production

The interface between the conceptual and lexical systems was investigated in a word production setting. We tested the effects of two conceptual dimensions – semantic category and visual shape – on the selection of Chinese nouns and classifiers. Participants named pictures with nouns (“rope”) or classifier–noun phrases (“one-classifier–rope”) in three blocked picture naming experiments. In Experiment 1, we observed larger semantic category interference with phrases than with nouns, suggesting comparable semantic categorical effects on classifier and noun selection. In Experiments 2 and 3, items with similar shapes produced an interference effect when they were named with classifier–noun phrases, but not with bare nouns. This indicates that object shape modulates classifier (but not noun) selection. We conclude that object shape properties can by themselves influence word selection processes just as semantic relationships (captured by semantic category) do. The factors operating during word selection may be more diverse than has been previously thought.     

Effects of semantic context in the naming of pictures and words

Two experiments investigated whether lexical retrieval for speaking can be characterized as a competitive process by assessing the effects of semantic context on picture and word naming in German. In Experiment 1 we demonstrated that pictures are named slower in the context of same-category items than in the context of items from various semantic categories, replicating findings by Kroll and Stewart (Journal of Memory and Language, 33 (1994) 149). In Experiment 2 we used words instead of pictures. Participants either named the words in the context of same- or different-category items, or produced the words together with their corresponding determiner. While in the former condition words were named faster in the context of same-category items than of different-category items, the opposite pattern was obtained for the latter condition. These findings confirm the claim that the interfering effect of semantic context reflects competition in the retrieval of lexical entries in speaking.     

Pictures in sentences: understanding without words

To understand a sentence, the meanings of the words in the sentence must be retrieved and combined. Are these meanings represented within the language system (the lexical hypothesis) or are they represented in a general conceptual system that is not restricted to language (the conceptual hypothesis)? To evaluate these hypotheses, sentences were presented in which a pictured object replaced a word (rebus sentences). Previous research has shown that isolated pictures and words are processed equally rapidly in conceptual tasks, but that pictures are markedly slower than words in tasks requiring lexical access. The lexical hypothesis would therefore lead one to expect that rebus sentences will be relatively difficult, whereas the conceptual hypothesis would predict that rebus sentences would be rather easy. Sentences were shown using rapid serial visual presentation (RSVP) at a rate of 10 or 12 words per second. With one set of materials (Experiments 1 and 2), readers took longer to judge the plausibility of rebus sentences than all-word sentences, although the accuracy of judgment and of recall were similar for the two formats. With two new sets of materials (Experiments 3 and 5), rebus and all-word sentences were virtually equivalent except in one circumstance: when a picture replaced the noun in a familiar phrase such as seedless grapes. In contrast, when the task required overt naming of the rebus picture in a sentence context, latency to name the picture was markedly longer than to name the corresponding word, and the appropriateness of the sentence context affected picture naming but not word naming (Experiment 4). The results fail to support theories that place word meanings in a specialized lexical entry. Instead, the results suggest that the lexical representation of a noun or familiar noun phrase provides a pointer to a nonlinguistic conceptual system, and it is in that system that the meaning of a sentence is constructed.     

Semantic component of a cross-modal Stroop-like task

Three experiments showed that the pattern of interference of single-modality Stroop tests also exists cross-modally. Distractors and targets were either pictures or auditory words. In a naming task (Experiment 1), word distractors from the same semantic category as picture targets interfered with picture naming more than did semantically unrelated distractors; the semantic category of picture distractors did not differentially affect word naming. In a categorization task (Experiment 2), this Stroop-like effect was reversed: Picture distractors from the same semantic category as word targets interfered less with word categorization than picture distractors that were semantically unrelated; the semantic category of word distractors did not differentially affect picture categorization. Experiment 3 replicated these effects when each subject performed both tasks; the task, naming or categorizing, determined the pattern of interference between pictures and auditory words. The results thus support the existence of a semantic component of a cross-modal Stroop-like effect.     

About the locus of the distractor frequency effect: Evidence from the production of clitic pronouns

In this study, we report results from two experiments in which pictures were shown with superimposed distractors that varied along two dimensions: frequency (high vs. low) and semantic relation with respect to the picture (related vs. unrelated). In one condition of Experiment 1, participants named pictures with a noun utterance; in the other condition of Experiment 1 and in Experiment 2 participants named pictures with a pronominal utterance. Low frequency distractor words produced greater interference with respect to high frequency words in noun production, but not in pronoun production. Critically, a semantic interference effect, greater interference in the semantically related than unrelated condition, was reported in both experiments, suggesting that distractor words were equally processed in both noun and pronoun conditions. These results are discussed in the context of current models of picture–word interference.     

Contributions of response set and semantic relatedness to cross-modal Stroop-like picture-word interference in children and adults

Resistance to interference from irrelevant auditory stimuli undergoes development throughout childhood. To test whether semantic processes account for age-related changes in a Stroop-like picture-word interference effect, children (3- to 12-year-olds) and adults named pictures while listening to words varying in terms of semantic relatedness to the pictures and response set membership. In Experiments 1 and 2, with animal and clothing pictures, the interference effect observed in children, but not in adults, depended on the distractors' status as members of the response set. In Experiment 3, with unrelated pictures, adults, but not children, showed greater interference for trials with distractors in the response set. These results indicate developmental changes in picture-word interference involving the establishment of a response set in working memory.     

Pictures and words in visual search

Ss in three experiments searched through an array of pictures or words for a target item that had been presented as a picture or a word. In Experiments I and II, the pictures were line drawings of familiar objects and the words were their printed labels; in Experiment III, the stimuli were photographs of the faces of famous people and their corresponding printed names. Search times in Experiments I and II were consistently faster when the array items were pictures than when they were words, regardless of the mode of the target items. Search was also faster with pictures than with words as targets when the search array also consisted of pictures, but target mode had no consistent effect with words as array items. Experiment III yielded a completely different pattern of results: Search time with names as targets and faces as search array items was significantly slower than in the other three conditions, which did not differ from each other. Considered in relation to several theories, the results are most consistent with a dual-coding interpretation. That is, items that are cognitively represented both verbally and as nonverbal images can be searched and compared in either mode, depending on the demands of the task. The mode actually used depends on whether the search must be conducted through an array of pictures or words.     

In search of perceptual priming in a semantic classification task

Four experiments tested for perceptual priming for written words in a semantic categorization task. Repetition priming was obtained for low-frequency words when unrelated categorizations were performed at study and test (Experiment 1), but it was not orthographically mediated given that written-to-written and spoken-to-written word priming was equivalent (Experiments 2 and 3). Furthermore, no priming was obtained between pictures and words (Experiment 4), suggesting that the nonorthographic priming was largely phonological rather than semantic. These results pose a challenge to standard perceptual theories of priming that should expect orthographic priming when words are presented in a visual format at study and test.     

The neural substrates of action retrieval: An examination of semantic and visual routes to action

We report three PET experiments that examine the neural substrates of the conceptual components of action retrieval. In all three experiments, subjects made action or screen-size decisions to familiar objects presented either as pictures or written words (the names ofthe objects). In Experiment 1, a third task was included, requiring a decision on the real-life size of the stimuli. In Experiment 2, a third stimulus type was included, with action and size decisions also performed on pictures of meaningless novel objects. Finally, in Experiment 3, we changed the response mode from a button press to a more explicit movement made with a “manipulandum”. Based on neuropsychological findings, we predicted that when action responses were made to pictures of familiar or novel objects, relative to words, there would be less activation in semantic regions but greater activation in visual, motor, and perhaps parietal cortices. We found that, action relative to screen-size decisions on both pictures and words activated the left hemisphere temporo-frontal semantic system with activation in the left posterior middle temporal cortex specific to action retrieval (Experiment 1). In addition, action retrieval elicited more activation for (1) words than pictures in areas associated with semantics; and (2) novel objects than words or familiar objects in areas associated with pre-semantic object processing. These results are discussed in the context of semantic and visual routes to action retrieval.     

Typicality effects in picture‐word interference paradigm: An evaluation of the response exclusion hypothesis

The response exclusion hypothesis suggests that the polarity of semantic effects in the picture‐word interference paradigm is determined by the response‐relevant criteria. Semantic interference effects would be observed when semantically related distractor words satisfy the response‐relevant criteria; otherwise, semantic facilitation effects should be found. The purpose of this study was to further evaluate the response exclusion hypothesis by exploring the typicality effects in pictures naming. In two experiments, pictures of objects were named either in the context of verb distractor words with different typicality of passive functions or in the context of adjective distractor words with different typicality of characteristics. Facilitation effects were observed in context of typical verbs and adjectives, while interference effects were observed in the context of atypical verbs and adjectives. Given that neither typical nor atypical distractor words satisfy the response‐relevant criteria to produce noun, these findings are problematic for the response exclusion hypothesis. Role of syntagmatic relationships in lexical retrieval was invoked to explain present findings.     

Effect of Representational Distance Between Meanings on Recognition of Ambiguous Spoken Words

Previous research indicates that mental representations of word meanings are distributed along both semantic and syntactic dimensions such that nouns and verbs are relatively distinct from one another. Two experiments examined the effect of representational distance between meanings on recognition of ambiguous spoken words by comparing recognition of unambiguous words, noun–verb homonyms, and noun–noun homonyms. In Experiment 1, auditory lexical decision was fastest for unambiguous words, slower for noun–verb homonyms, and slowest for noun–noun homonyms. In Experiment 2, response times for matching spoken words to pictures followed the same pattern and eye fixation time courses revealed converging, gradual time course differences between conditions. These results indicate greater competition between meanings of ambiguous words when the meanings are from the same grammatical class (noun–noun homonyms) than when they are from different grammatical classes (noun–verb homonyms).     

Determiner selection in noun phrase production

In 3 experiments, native speakers of German named pictures of 1 or 2 objects by producing singular or plural noun phrases consisting of a definite gender-marked determiner and a noun. When singular and plural determiners differed (masculine and neuter gender), naming latencies were longer for plural utterances than for singular utterances. By contrast, when singular and plural determiners were identical (feminine gender), no such effect was obtained. When participants produced bare nouns, the Gender x Number interaction disappeared. This pattern indicates that during the production of plural definite-determiner noun phrases, singular and plural determiners compete for selection. The resulting constraints on number and gender processing in noun phrase production are discussed in the framework of models of language production.     

Testing the theory of embodied cognition with subliminal words

In the current study, we tested the embodied cognition theory (ECT). The ECT postulates mandatory sensorimotor processing of words when accessing their meaning. We test that prediction by investigating whether invisible (i.e., subliminal) spatial words activate responses based on their long-term and short-term meaning. Masking of the words is used to prevent word visibility and intentional elaboration of the words’ semantic content. In this way, masking specifically isolates mandatory sensorimotor processing of words as predicted by the ECT. Do spatial subliminal words activate responses nonetheless? In Experiment 1, we demonstrate a spatial congruence effect of the invisible words if they precede visible target words. In Experiment 2, we show that masked words activate responses based on their long-term meaning. In Experiment 3, we demonstrate that masked words are also processed according to their short-term response meaning. We conclude that the ECT is supported by our findings and discuss implications of our results for embodied theories of semantic word processing and masked priming experiments.     

Interference of spoken word recognition through phonological priming from visual objects and printed words

Three cross-modal priming experiments examined the influence of preexposure to pictures and printed words on the speed of spoken word recognition. Targets for auditory lexical decision were spoken Dutch words and nonwords, presented in isolation (Experiments 1 and 2) or after a short phrase (Experiment 3). Auditory stimuli were preceded by primes, which were pictures (Experiments 1 and 3) or those pictures’ printed names (Experiment 2). Prime–target pairs were phonologically onset related (e.g., pijl–pijn, arrow–pain), were from the same semantic category (e.g., pijl–zwaard, arrow–sword), or were unrelated on both dimensions. Phonological interference and semantic facilitation were observed in all experiments. Priming magnitude was similar for pictures and printed words and did not vary with picture viewing time or number of pictures in the display (either one or four). These effects arose even though participants were not explicitly instructed to name the pictures and where strategic naming would interfere with lexical decision making. This suggests that, by default, processing of related pictures and printed words influences how quickly we recognize spoken words.     

Grammatical gender in the production of single words: some evidence from Greek

The present study investigated the effect of prior grammatical gender information provided by the production of a bare noun on the production of a syntactically unrelated, gender-inflected color adjective. The target language was Greek. A lexical priming task involving picture naming was employed. Participants saw a series of pictures, some in color and some in black-and-white; they had to name a black-and-white picture with the single noun (prime) and a color picture with the appropriately inflected color adjective (target). Prior gender information was shown to affect subsequent production of gender-marked words. The effect was restricted to nouns of one gender class (masculine) only. The implications of these results for the representation and processing of gender in production are discussed.     

Meaning and modality: influences of context, semantic memory organization, and perceptual predictability on picture processing

Using event-related potentials (ERPs), the authors investigated the influences of sentence context, semantic memory organization, and perceptual predictability on picture processing. Participants read pairs of highly or weakly constraining sentences that ended with (a) the expected item, (b) an unexpected item from the expected semantic category, or (c) an unexpected item from an unexpected category. Pictures were unfamiliar in Experiment 1 but preexposed in Experiment 2. ERPs to pictures reflected both contextual fit and memory organization, as do ERPs to words in the same contexts (K. D. Federmeier & M. Kutas, 1999). However, different response patterns were observed to pictures than to words. Some of these arose from perceptual predictability differences, whereas others seem to reflect true modality-based differences in semantic feature activation. Although words and pictures may share semantic memory, the authors' results show that semantic processing is not amodal.