Can pictures promote the acquisition of sight‐word reading? An evaluation of two potential instructional strategies

Sight‐word instruction can be a useful supplement to phonics‐based methods under some circumstances. Nonetheless, few studies have evaluated the conditions under which pictures may be used successfully to teach sight‐word reading. In this study, we extended prior research by examining two potential strategies for reducing the effects of overshadowing when using picture prompts. Five children with developmental disabilities and two typically developing children participated. In the first experiment, the therapist embedded sight words within pictures but gradually faded in the pictures as needed using a least‐to‐most prompting hierarchy. In the second experiment, the therapist embedded text‐to‐picture matching within the sight‐word reading sessions. Results suggested that these strategies reduced the interference typically observed with picture prompts and enhanced performance during teaching sessions for the majority of participants. Text‐to‐picture matching also accelerated mastery of the sight words relative to a condition under which the therapist presented text without pictures.     

A STIMULUS CONTROL ANALYSIS OF THE PICTURE-WORD PROBLEM IN CHILDREN WHO ARE MENTALLY RETARDED: THE BLOCKING EFFECT

Conditioning to one member of a compound stimulus can be blocked by the presence of a second member to which the response was previously conditioned. This account of selective stimulus control can be used to explain the finding that pictures inhibit learning of written words if the relevant pictures and their verbal equivalents have been paired previously. We tested the blocking explanation of the picture-word problem with 8 mentally retarded students. Following baseline, each student was presented daily with four conditions in an alternating treatments design. In Condition A (blocking), a picture was presented alone and then was followed by the presentation of a picture and written word compound stimulus; in Condition B (blocking/control), a word was presented alone; in Condition C (blocking minimized), a word was enhanced in size and presented alone followed by the word and a picture; and, in Condition D (blocking minimized/control), the enhanced word was presented alone. Each stimulus was presented for 15 s. All students had the lowest percentage of words read correctly in the blocking condition, and all improved when blocking was minimized. Six of 8 students reached their highest percentage of words read correctly in the two control conditions when the words were presented as a single stimulus without pictures. These results indicate that pictures inhibit some students' learning of new words; this may be due to the blocking of conditioning to written words by prior conditioning to pictures.     

Semantic and phonological information flow in the production lexicon

When speakers produce words, lexical access proceeds through semantic and phonological levels of processing. If phonological processing begins based on partial semantic information, processing is cascaded; otherwise, it is discrete. In standard models of lexical access, semantically processed words exert phonological effects only if processing is cascaded. In 3 experiments, speakers named pictures of objects with homophone names (ball), while auditory distractor words were heard beginning 150 ms prior to picture onset. Distractors speeded picture naming (compared with controls) only when related to the nondepicted meaning of the picture (e.g., dance), exhibiting an early phonological effect, thereby supporting the cascaded prediction. Distractors slowed picture naming when categorically (e.g., frisbee) related to the depicted picture meaning, but not when associatively (e.g., game) related to it. An interactive activation model is presented.     

Are pictures good for learning new vocabulary in a foreign language? Only if you think they are not

The current study explored whether new words in a foreign language are learned better from pictures than from native language translations. In both between-subjects and within-subject designs, Swahili words were not learned better from pictures than from English translations (Experiments 1-3). Judgments of learning revealed that participants exhibited greater overconfidence in their ability to recall a Swahili word from a picture than from a translation (Experiments 2-3), and Swahili words were also considered easier to process when paired with pictures rather than translations (Experiment 4). When this overconfidence bias was eliminated through retrieval practice (Experiment 2) and instructions warning participants to not be overconfident (Experiment 3), Swahili words were learned better from pictures than from translations. It appears, therefore, that pictures can facilitate learning of foreign language vocabulary--as long as participants are not too overconfident in the power of a picture to help them learn a new word.     

Word Production and the Picture-Word Interference Paradigm: The Role of Learning

Psycholinguistic experiments conducted with the picture-word interference paradigm are typically preceded by a phase during which participants learn the words they will have to produce in the experiment. In Experiment 1, the pictures (e.g., a frog) were to be named and were presented with a categorically related (e.g., cat) or unrelated distracter (e.g., pen). In the related condition responses were slower relative to the unrelated condition for the participants who had gone through the learning phase. In contrast, participants who had not been previously familiarized with the materials showed facilitation. In Experiment 2 one group of participants, as usual, learned to produce the targets upon presentation of the corresponding pictures (e.g., a frog). The other group learned to produce the same targets upon presentation of unrelated pictures (e.g., a clock). They showed very similar semantic effects. The implications of the findings in the study of word production are discussed.     

Interference of Sentence and Picture Contexts on Learning Prepositions

The effects of extra stimulus cues, such as pictures and sentences, on learning of preposition words were examined in two experiments. A one-way repeated-measures design was applied in the study. The results show that both sentences and pictures interfered with and blocked the learning of these context-dependent words in the simultaneous presentations. The superiority of feedback presentations over simultaneous presentations indicate that feedback techniques neutralize the blocking effect. More interestingly, however, the prepositions were learned more quickly in the absence of any context cues and this suggested that it is better to teach basic preposition words either by the presentation of them alone or if extra stimulus cues are to be used they should be presented as feedback.     

Context effects of pictures and words in naming objects, reading words, and generating simple phrases

In five language production experiments it was examined which aspects of words are activated in memory by context pictures and words. Context pictures yielded Stroop-like and semantic effects on response times when participants generated gender-marked noun phrases in response to written words (Experiment 1A). However, pictures yielded no such effects when participants simply read aloud the noun phrases (Experiment 2). Moreover, pictures yielded a gender congruency effect in generating gender-marked noun phrases in response to the written words (Experiments 3A and 3B). These findings suggest that context pictures activate lemmas (i.e., representations of syntactic properties), which leads to effects only when lemmas are needed to generate a response (i.e., in Experiments 1A, 3A, and 3B, but not in Experiment 2). Context words yielded Stroop-like and semantic effects in picture naming (Experiment 1B). Moreover, words yielded Stroop-like but no semantic effects in reading nouns (Experiment 4) and in generating noun phrases (Experiment 5). These findings suggest that context words activate the lemmas and forms of their names, which leads to semantic effects when lemmas are required for responding (Experiment 1B) but not when only the forms are required (Experiment 4). WEAVER++ simulations of the results are presented.     

Context effects of pictures and words in naming objects,reading words,and generating simple phrases

In five language production experiments it was examined which aspects of words are activated in memory by context pictures and words. Context pictures yielded Stroop-like and semantic effects on response times when participants generated gender-marked noun phrases in response to written words (Experiment 1A). However, pictures yielded no such effects when participants simply read aloud the noun phrases (Experiment 2). Moreover, pictures yielded a gender congruency effect in generating gender-marked noun phrases in response to the written words (Experiments 3A and 3B). These findings suggest that context pictures activate lemmas (i.e., representations of syntactic properties), which leads to effects only when lemmas are needed to generate a response (i.e., in Experiments 1A, 3A, and 3B, but not in Experiment 2). Context words yielded Stroop-like and semantic effects in picture naming (Experiment 1B). Moreover, words yielded Stroop-like but no semantic effects in reading nouns (Experiment 4) and in generating noun phrases (Experiment 5). These findings suggest that context words activate the lemmas and forms of their names, which leads to semantic effects when lemmas are required for responding (Experiment 1B) but not when only the forms are required (Experiment 4). WEAVER++ simulations of the results are presented.     

Moving words: dynamic representations in language comprehension

Eighty-two participants listened to sentences and then judged whether two sequentially presented visual objects were the same. On critical trials, participants heard a sentence describe the motion of a ball toward or away from the observer (e.g., “The pitcher hurled the softball to you”). Seven hundred and fifty milliseconds after the offset of the sentence, a picture of an object was presented for 500 ms, followed by another picture. On critical trials, the two pictures depicted the kind of ball mentioned in the sentence. The second picture was displayed 175 ms after the first. Crucially, it was either slightly larger or smaller than the first picture, thus suggesting movement of the ball toward or away from the observer. Participants responded more quickly when the implied movement of the balls matched the movement described in the sentence. This result provides support for the view that language comprehension involves dynamic perceptual simulations.     

Subliminal primes for global or local processing influence judgments of vehicular traffic

Previous studies on semantic priming show that briefly presented words can unconsciously manipulate subjects’ mental states, behaviors, and attitudes. Here we evaluated whether semantic primes can also manipulate the breadth of subjects’ visual attention. We primed participants with briefly presented words that indicate either broadness or narrowness; each prime was followed by either a large or a small picture of a street intersection with vehicles, and participants had to indicate in which order the vehicles were legally allowed to pass the intersection. Participants responded to large pictures faster when primed with words denoting broadness, and to small pictures faster when primed with words denoting narrowness. From this we concluded that semantic priming can be effectively applied to manipulate the breadth of attention, which could be exploited in real-world scenarios.     

新颖词汇学习中大脑激活模式的fMRI研究

该研究利用功能磁共振脑成像(fMRI)技术,比较在新颖语言学习和母语学习过程中大脑皮层参与的异同。实验设置德语学习和汉语学习两个条件,采用跨通道联结学习范式,要求被试在听到听觉词汇后,按键判断屏幕上所呈现的图片是否与所听词汇匹配。行为数据显示,被试在六段实验后基本掌握了德语语音和语义之间的联结关系;脑成像数据显示,两种学习任务都激活了语言加工的主要脑区,而德语词汇学习过程相比汉语参照条件对应的颞叶激活强度与范围有较大的差异,并且比汉语条件表现出更显著的前额叶区域激活。     

图片部分线索效应的学习时间分配的发展

部分线索效应指让学习者学习一系列材料, 在随后的测试阶段, 给学习者提供先前所学材料的一部分作为提取线索, 让其回忆剩余的材料, 回忆成绩反而比没有提取线索时回忆成绩差的现象。通过3个实验, 以图片为实验材料, 考察了图片部分线索效应学习时间分配的发展特点。实验1考察了图片部分线索效应的边界条件, 结果发现：图片学习中, 以物体名称为线索时, 不存在部分线索效应; 而以图片为线索时, 存在部分线索效应。结果表明：跨域线索是图片部分线索效应的边界条件。实验2利用图片作线索, 考察了图片部分线索效应的发展特点, 结果发现：图片学习中, 不同年龄被试均存在部分线索效应。结果表明：年龄不是图片部分线索效应的边界条件。实验3考察不同年龄被试对部分线索消极作用的记忆监控的发展变化趋势, 结果发现：小学二年级儿童即使经过多次学习, 也不能意识到部分线索的消极作用; 小学五年级儿童经过二次学习后, 方可意识到这种消极作用, 并在部分线索条件下安排了更多的学习时间; 初二和高二年级学生经过一次学习, 即可意识到部分线索的消极作用, 他们均在部分线索条件下安排了更长的学习时间。结果表明：儿童的学习时间分配决策能力在小学二年级到小学五年级之间有一个质的提高; 与初二学生相比, 高二学生对部分线索带来的消极影响做了更多的时间补偿。     

Conditions of directed attention inhibit recognition performance for explicitly presented target-aligned irrelevant stimuli

The fate of irrelevant and overtly presented stimuli that was temporally aligned with an attended target in a separate task was explored. Seitz and Watanabe (2003) demonstrated that if an irrelevant motion stimulus was implicit (i.e., subthreshold), a later facilitation for the same motion direction was observed if the previously presented implicit motion (of the same direction) was temporally aligned with the presence of an attended target. Later research, however, demonstrated that if the motion stimulus aligned with the attended target was explicit (i.e., suprathreshold), a later inhibition was observed (Tsushima, Seitz, & Watanabe, 2008). The current study expands on this by using more salient stimuli (words and pictures) in an inattentional blindness paradigm, and suggests that when attention is depleted, recognition for target-aligned task-irrelevant items is impaired in a subsequent recognition task. Participants were required to respond to either immediate picture, or word, repetitions in a stream of simultaneously presented line drawings and written words, and later given a surprise recognition test that measured recognition for the words or the pictures. When analyzing word recognition performance after attention had been directed to the pictures, words that had appeared simultaneously with a picture repetition in the repetition detection task were recognized at levels significantly below chance. The same inhibition was mirrored when testing for picture recognition after having attended to the words in the repetition detection task. These data suggest an inhibitory mechanism that is exhibited in later recognition tests for salient information that was previously unattended and had been simultaneously being presented with an attended target in a different task.     

Do separate processes identify objects as exemplars versus members of basic-level categories? Evidence from hemispheric specialization

When an object is identified as a specific exemplar, is it analyzed differently than when it is identified at the basic level? On the basis of a previous theory, we predicted that the left hemisphere (LH) is specialized for classifying objects at the basic level and the right hemisphere (RH) is specialized for classifying objects as specific exemplars. To test this prediction, participants were asked to view lateralized pictures of animals, artifacts, and faces of famous people; immediately after each picture was presented, a label was read aloud by the computer, and the participants decided whether the label was correct for that picture. A label could name the object at either the basic level (e.g., bird) or as an exemplar (e.g., robin). As predicted, we found that basic-level labels were matched faster when pictures were presented in the right visual field (and hence encoded initially in the LH), whereas exemplar labels were matched faster when pictures were presented in the left visual field (and hence encoded initially in the RH).     

Segment duration as a cue to word boundaries in spoken-word recognition

In two eye-tracking experiments, we examined the degree to which listeners use acoustic cues to word boundaries. Dutch participants listened to ambiguous sentences in which stop-initial words (e.g., pot, jar) were preceded by eens (once); the sentences could thus also refer to cluster-initial words (e.g., een spot, a spotlight). The participants made fewer fixations to target pictures (e.g., ajar) when the target and the preceding [s] were replaced by a recording of the cluster-initial word than when they were spliced from another token of the target-bearing sentence (Experiment 1). Although acoustic analyses revealed several differences between the two recordings, only [s] duration correlated with the participants' fixations (more target fixations for shorter [s]s). Thus, we found that listeners apparently do not use all available acoustic differences equally. In Experiment 2, the participants made more fixations to target pictures when the [s] was shortened than when it was lengthened. Utterance interpretation can therefore be influenced by individual segment duration alone.     

Reversing the picture superiority effect: A speed—accuracy trade-off study of recognition memory

Speed-accuracy trade-off methods have been used to contrast single- and dual-process accounts of recognition memory. With these procedures, subjects are presented with individual test items and required to make recognition decisions under various time constraints. In three experiments, we presented words and pictures to be intentionally learned; test stimuli were always visually presented words. At test, we manipulated the interval between the presentation of each test stimulus and that of a response signal, thus controlling the amount of time available to retrieve target information. The standard picture superiority effect was significant in long response deadline conditions (i.e., > or = 2,000 msec). Conversely, a significant reverse picture superiority effect emerged at short response-signal deadlines (< 200 msec). The results are congruent with views suggesting that both fast familiarity and slower recollection processes contribute to recognition memory. Alternative accounts are also discussed.     

Semantic classification of pictures and words

We provide new behavioural norms for semantic classification of pictures and words. The picture stimuli are 288 black and white line drawings from the International Picture Naming Project ([Székely, A., Jacobsen, T., D'Amico, S., Devescovi, A., Andonova, E., Herron, D., et al. (2004). A new on-line resource for psycholinguistic studies. Journal of Memory & Language, 51, 247–250]). We presented these pictures for classification in a living/nonliving decision, and in a separate version of the task presented the corresponding word labels for classification. We analyzed behavioural responses to a subset of the stimuli in order to explore questions about semantic processing. We found multiple semantic richness effects for both picture and word classification. Further, while lexical-level factors were related to semantic classification of words, they were not related to semantic classification of pictures. We argue that these results are consistent with privileged semantic access for pictures, and point to ways in which these data could be used to address other questions about picture processing and semantic memory.     

The cumulative semantic cost does not reflect lexical selection by competition

The cumulative semantic cost describes a phenomenon in which picture naming latencies increase monotonically with each additional within-category item that is named in a sequence of pictures. Here we test whether the cumulative semantic cost requires the assumption of lexical selection by competition. In Experiment 1 participants named a sequence of pictures, while in Experiment 2 participants named words instead of pictures, preceded by a gender marked determiner. We replicate the basic cumulative semantic cost with pictures (Exp. 1) and show that there is no cumulative semantic cost for word targets (Exp. 2). This pattern was replicated in Experiment 3 in which pictures and words were named along with their gender marked definite determiner, and were intermingled within the same experimental design. In addition, Experiment 3 showed that while picture naming induces a cumulative semantic cost for subsequently named words, word naming does not induce a cumulative semantic cost for subsequently named pictures. These findings suggest that the cumulative semantic cost arises prior to lexical selection and that the effect arises due to incremental changes to the connection weights between semantic and lexical representations.     

An auditory analog of the picture superiority effect

Previous research has found that pictures (e.g., a picture of an elephant) are remembered better than words (e.g., the word "elephant"), an empirical finding called the picture superiority effect (Paivio & Csapo. Cognitive Psychology 5(2):176-206, 1973). However, very little research has investigated such memory differences for other types of sensory stimuli (e.g. sounds or odors) and their verbal labels. Four experiments compared recall of environmental sounds (e.g., ringing) and spoken verbal labels of those sounds (e.g., "ringing"). In contrast to earlier studies that have shown no difference in recall of sounds and spoken verbal labels (Philipchalk & Rowe. Journal of Experimental Psychology 91(2):341-343, 1971; Paivio, Philipchalk, & Rowe. Memory & Cognition 3(6):586-590, 1975), the experiments reported here yielded clear evidence for an auditory analog of the picture superiority effect. Experiments 1 and 2 showed that sounds were recalled better than the verbal labels of those sounds. Experiment 2 also showed that verbal labels are recalled as well as sounds when participants imagine the sound that the word labels. Experiments 3 and 4 extended these findings to incidental-processing task paradigms and showed that the advantage of sounds over words is enhanced when participants are induced to label the sounds.     

Locus of semantic interference in picture-word interference tasks

Picture#x2014;word interference studies typically show that semantically related distractor words embedded within a picture slow picture-naming responses, relative to unrelated ones. This semantic interference effect is commonly interpreted as arising from the competition of lexical#x2014;semantic (e.g., Schriefers, Meyer, & Levelt, 1990) or lexical#x2014;phonological (e.g., Starreveld & La Heij, 1996) codes. The experiment reported here tests a crucial assumption shared by these accounts#x2014;namely, that the effect reflects a lexical, rather than a nonverbal, conceptual conflict. Pictures were named while participants attempted to ignore embedded distractors that were in either verbal or pictorial format. The presence of both words and pictures substantially interfered with naming responses, but only words, not pictures, were found to induce semantic interference. These findings support the claim that for semantic interference to arise, both target picture and distractor have to be lexicalized. Consequently, a general conceptual locus of the effect can be excluded, and the claim that semantic interference is based on a lexical conflict is confirmed.