The role of visual form in lexical access: Evidence from Chinese classifier production

The interface between the conceptual and lexical systems was investigated in a word production setting. We tested the effects of two conceptual dimensions – semantic category and visual shape – on the selection of Chinese nouns and classifiers. Participants named pictures with nouns (“rope”) or classifier–noun phrases (“one-classifier–rope”) in three blocked picture naming experiments. In Experiment 1, we observed larger semantic category interference with phrases than with nouns, suggesting comparable semantic categorical effects on classifier and noun selection. In Experiments 2 and 3, items with similar shapes produced an interference effect when they were named with classifier–noun phrases, but not with bare nouns. This indicates that object shape modulates classifier (but not noun) selection. We conclude that object shape properties can by themselves influence word selection processes just as semantic relationships (captured by semantic category) do. The factors operating during word selection may be more diverse than has been previously thought.     

Perceptual simulation in developing language comprehension

We tested an embodied account of language proposing that comprehenders create perceptual simulations of the events they hear and read about. In Experiment 1, children (ages 7–13 years) performed a picture verification task. Each picture was preceded by a prerecorded spoken sentence describing an entity whose shape or orientation matched or mismatched the depicted object. Responses were faster for matching pictures, suggesting that participants had formed perceptual-like situation models of the sentences. The advantage for matching pictures did not increase with age. Experiment 2 extended these findings to the domain of written language. Participants (ages 7–10 years) of high and low word reading ability verified pictures after reading sentences aloud. The results suggest that even when reading is effortful, children construct a perceptual simulation of the described events. We propose that perceptual simulation plays a more central role in developing language comprehension than was previously thought.     

Feeling the past: The absence of experimental evidence for anomalous retroactive influences on text processing

In two self-paced reading experiments, we investigated the hypothesis that information moves backward in time to influence prior behaviors (Bem Journal of Personality and Social Psychology 100:407?C425, 2011a). In two of Bem??s experiments, words were presented after target pictures in a pleasantness judgment task. In a condition in which the words were consistent with the emotional valence of the picture, reaction times to the pictures were significantly shorter , as compared with a condition in which the words were inconsistent with the emotional valence of the picture. Bem Journal of Personality and Social Psychology 100:407?C425, (2011a) interpreted these results as showing a ??retroactive priming?? effect resulting from precognition. To test the precognition hypothesis, we adapted a standard repetition priming paradigm from psycholinguistics. In the experiments, participants read a set of texts. In one condition, the participants read the same text twice. In other conditions, participants read two different texts. The precognition hypothesis predicts that readers who encounter the same text twice will experience reductions in processing load during their first encounter with the text. Hence, these readers' average reading times should be shorter than those of readers who encounter the target text only once. Our results indicated that readers processed the target text faster the second time they read it. Also, their reading times decreased as their experience with the self-paced reading procedure increased. However, participants read the target text equally quickly during their initial encounter with the text, whether or not the text was subsequently repeated. Thus, the experiments demonstrated normal repetition priming and practice effects but offered no evidence for retroactive influences on text processing.     

实物形状的知觉相似性对视觉隐喻加工的影响

视觉隐喻是众多研究者比较关注的领域, 当前多以物体简笔画、漫画及广告等方面的研究为主, 但对与生活密切相关的实物的视觉隐喻研究甚少。因此研究采用掩蔽启动范式、李克特9点量表及语音生成等研究方法, 在物体概念类型(概念相同、概念相异)及形状类型(形状相似、形状相异)条件下, 针对实物图片的形状知觉相似性是否对视觉隐喻加工产生影响进行探讨。结果发现无论物体概念是否相同, 形状相似性对个体的物体识别具有“促进”作用, 并有利于视觉隐喻加工; 在物体识别中, 当两个物体概念不同时, 个体会试图建立一个特设类别来对形状相似的物体进行归类, 从而实现了视觉隐喻的加工。因此研究进一步证明了实物形状的知觉相似性有利于视觉隐喻的加工。     

Language comprehenders retain implied shape and orientation of objects

According to theories of embodied cognition, language comprehenders simulate sensorimotor experiences to represent the meaning of what they read. Previous studies have shown that picture recognition is better if the object in the picture matches the orientation or shape implied by a preceding sentence. In order to test whether strategic imagery may explain previous findings, language comprehenders first read a list of sentences in which objects were mentioned. Only once the complete list had been read was recognition memory tested with pictures. Recognition performance was better if the orientation or shape of the object matched that implied by the sentence, both immediately after reading the complete list of sentences and after a 45-min delay. These results suggest that previously found match effects were not due to strategic imagery and show that details of sensorimotor simulations are retained over longer periods.     

Working memory interference during processing texts and pictures: Implications for the explanation of the modality effect

Auditory text presentation improves learning with pictures and texts. With sequential text–picture presentation, cognitive models of multimedia learning explain this modality effect in terms of greater visuo‐spatial working memory load with visual as compared to auditory texts. Visual texts are assumed to demand the same working memory subsystem as pictures, while auditory texts make use of an additional cognitive resource. We provide two alternative assumptions that relate to more basic processes: First, acoustic‐sensory information causes a retention advantage for auditory over visual texts which occurs no matter if a picture is presented or not. Second, eye movements during reading hamper visuo‐spatial rehearsal. Two experiments applying elementary procedures provide first evidence for these assumptions. Experiment 1 demonstrates that, regarding text recall, the auditory advantage is independent of visuo‐spatial working memory load. Experiment 2 reveals worse matrix recognition performance after reading text requiring eye movements than after listening or reading without eye movements. Copyright © 2008 John Wiley & Sons, Ltd.     

Perceived object trajectories during occlusion constrain visual statistical learning

Visual statistical learning of shape sequences was examined in the context of occluded object trajectories. In a learning phase, participants viewed a sequence of moving shapes whose trajectories and speed profiles elicited either a bouncing or a streaming percept: the sequences consisted of a shape moving toward and then passing behind an occluder, after which two different shapes emerged from behind the occluder. At issue was whether statistical learning linked both object transitions equally, or whether the percept of either bouncing or streaming constrained the association between pre- and postocclusion objects. In familiarity judgments following the learning, participants reliably selected the shape pair that conformed to the bouncing or streaming bias that was present during the learning phase. A follow-up experiment demonstrated that differential eye movements could not account for this finding. These results suggest that sequential statistical learning is constrained by the spatiotemporal perceptual biases that bind two shapes moving through occlusion, and that this constraint thus reduces the computational complexity of visual statistical learning.     

Parts, cavities, and object representation in infancy

Part representation is not only critical to object perception but also plays a key role in a number of basic visual cognition functions, such as figure-ground segregation, allocation of attention, and memory for shapes. Yet, virtually nothing is known about the development of part representation. If parts are fundamental components of object shape representation early in life, then the infant visual system should give priority to parts over other aspects of objects. We tested this hypothesis by examining whether part shapes are more salient than cavity shapes to infants. Five-month-olds were habituated to a stimulus that contained a part and a cavity. In a subsequent novelty preference test, 5-month-olds exhibited a preference for the cavity shape, indicating that part shapes were more salient than cavity shapes during habituation. The differential processing of part versus cavity contours in infancy is consistent with theory and empirical findings in the literature on adult figure-ground perception and indicates that basic aspects of part-based object processing are evident early in life.     

Metalinguistic Awareness and Reading Performance: A Cross Language Comparison

The study examined two questions: (1) do the greater phonological awareness skills of billinguals affect reading performance; (2) to what extent do the orthographic characteristics of a language influence reading performance and how does this interact with the effects of phonological awareness. We estimated phonological metalinguistic abilities and reading measures in three groups of first graders: monolingual Hebrew speakers, bilingual Russian–Hebrew speakers, and Arabic-speaking children. We found that language experience affects phonological awareness, as both Russian–Hebrew bilinguals and the Arabic speakers achieved higher scores on metalinguistic tests than Hebrew speakers. Orthography affected reading measures and their correlation with phonological abilitites. Children reading Hebrew showed better text reading ability and significant correlations between phonological awareness and reading scores. Children reading Arabic showed a slight advantage in single word and nonword reading over the two Hebrew reading groups, and very weak relationships between phonological abilities and reading performance. We conclude that native Arabic speakers have more difficulty in processing Arabic orthography than Hebrew monolinguals and bilinguals have in processing Hebrew orthography, and suggest that this is due to the additional visual complexity of Arabic orthography.     

Picture and pattern perception in the sighted and the blind: the advantage of the late blind

Two experiments are reported on the contribution of visual experience to tactile perception. In the first experiment, sighted, congenitally blind, and late blind individuals made tactual matches to tangible embossed shapes. In the second experiment, the same subjects attempted tactile identification of raised-line drawings. The three groups did not differ in the accuracy of shape matching, but both groups of blind subjects were much faster than the sighted. Late blind observers were far better than the sighted or congenitally blind at tactile picture identification. Four of the twelve pictures were correctly identified by most of the late blind subjects. The sighted and congenitally blind performed at comparable levels in picture naming. There was no evidence that visual experience alone aided the sighted in the tactile task under investigation, since they performed no better than did the early blind. The superiority of the late blind suggests that visual exposure to drawings and the rules of pictorial representation may help tactile picture identification when combined with a history of tactual experience.     

插图在说明文阅读理解中的作用

研究的目的在于揭示插图对说明文阅读理解的影响。实验中使用移动窗口技术对阅读过程中插图的作用进行探讨,并考察空间想象能力在其中的作用。结果表明：１．插图可以改进说明文的阅读理解,提高阅读速度;２．插图可以帮助读者建立文章所描述物体的参照表征,在建立参照表征的过程中,插图有利于重要概念的理解和有关参照表征信息的整合;３．插图有助于空间想象能力低的读者理解重要概念以及整合有关信息。     

Familiarization effects for bilingual letter detection involving translation or exact text repetition.

In two experiments, English-Spanish bilinguals read passages, performing letter detection on some passages by circling target letters as they read. Detection passages were sometimes familiarized (primed) by prior reading of the same passage or a translation of it. Participants detected letters in English passages in Experiment 1 and in Spanish passages in Experiment 2. For both experiments, a missing letter effect occurred (depressed detection accuracy on frequent function words relative to less frequent content words). Familiarization promoted overall improvements in letter detection only for English passages, suggesting that reprocessing benefits depend on high language fluency. For Spanish passages, cognates engendered greater error rates than noncognates; the visual similarity of Spanish and English cognates apparently enabled faster identification of Spanish cognates in a way unaffected by familiarization of the whole text passage. Priming by familiarized text was significantly higher when the passages were in the same language than when they were in different languages, suggesting that the reprocessing benefits are at the word level instead of the semantic level. These results are consistent with the GO model of reading (Greenberg, Healy, Koriat, & Kreiner, 2004) but require an expanded consideration of attention redistribution processes in that model.     

Prereaders’ eye movements during shared storybook reading are language-mediated but not predictive

When viewing a visual scene, eye movements are often language-mediated: people look at objects as those objects are named. Eye movements can even reflect predictive language processing, moving to an object before it is named. Children are also capable of making language-mediated eye movements, even predictive ones, and prediction may be involved in language learning. The present study explored whether eye movements are language-mediated in a more naturalistic task – shared storybook reading. Research has shown that children fixate illustrations during shared storybook reading, ignoring text. The present study used high-precision eye-tracking to replicate this finding. Further, prereader participants showed increased likelihood of fixating relevant storybook illustrations as words were read aloud, indicating that their eye movements were language mediated like the adult participants. Language-mediated eye movements to illustrations were reactive, not predictive, in both participant groups.     

Oculomotor inhibition of return in normal and mindless reading

Oculomotor inhibition of return (O-IOR) is an increase in saccade latency prior to an eye movement to a recently fixated location, as compared with other locations. To investigate O-IOR in reading, subjects participated in two conditions while their eye movements were recorded: normal reading and mindless reading with words replaced by geometric shapes. We investigated the manifestation of O-IOR in reading and whether it is related to extracting meaning from the text or is an oculomotor phenomenon. The results indicated that fixation durations prior to a saccade returning to the immediately preceding fixated word were longer than those to other words, consistent with O-IOR. Furthermore, fixation durations were longest prior to a saccade that returned the eyes to the specific character position in the word that had previously been fixated and dropped off as the distance between the previously fixated character and landing position increased. This result is consistent with the hypothesis that O-IOR is relatively precise in its application during reading and drops off as a gradient. Both of these results were found for text reading and for mindless reading, suggesting that they are consequences of oculomotor control, and not of language processing. Finally, although these temporal IOR effects were robust, no spatial consequences of IOR were observed: Previously fixated words and characters were as likely to be refixated as new words and characters.     

Individual differences in the shape bias in preschool children with specific language impairment and typical language development: theoretical and clinical implications

We investigated whether preschool children with specific language impairment (SLI) exhibit the shape bias in word learning: the bias to generalize based on shape rather than size, color, or texture in an object naming context (‘This is a wek; find another wek’) but not in a non‐naming similarity classification context (‘See this? Which one goes with this one?’). Fifty‐four preschool children (16 with SLI, 16 children with typical language [TL] in an equated control group, and 22 additional children with TL included in individual differences analyses but not group comparisons) completed a battery of linguistic and cognitive assessments and two experiments. In Experiment 1, children made generalization choices in object naming and similarity classification contexts on separate days, from options similar to a target object in shape, color, or texture. On average, TL children exhibited the shape bias in an object naming context, but children with SLI did not. In Experiment 2, we tested whether the failure to exhibit the shape bias might be linked to ability to detect systematicities in the visual domain. Experiment 2 supported this hypothesis, in that children with SLI failed to learn simple paired visual associations that were readily learned by children with TL. Analyses of individual differences in the two studies revealed that visual paired‐associate learning predicted degree of shape bias in children with SLI and TL better than any other measure of nonverbal intelligence or standard assessments of language ability. We discuss theoretical and clinical implications.     

Representing object colour in language comprehension

Embodied theories of cognition hold that mentally representing something red engages the neural subsystems that respond to environmental perception of that colour. This paper examines whether implicit perceptual information on object colour is represented during sentence comprehension even though doing so does not necessarily facilitate task performance. After reading a sentence that implied a particular colour for a given object, participants were presented with a picture of the object that either matched or mismatched the implied colour. When asked if the pictured object was mentioned in the preceding sentence, people's responses were faster when the colours mismatched than when they matched, suggesting that object colour is represented differently to other object properties such as shape and orientation. A distinction between stable and unstable embodied representations is proposed to allow embodied theories to account for these findings.     

Speech segmentation is facilitated by visual cues

Evidence from infant studies indicates that language learning can be facilitated by multimodal cues. We extended this observation to adult language learning by studying the effects of simultaneous visual cues (nonassociated object images) on speech segmentation performance. Our results indicate that segmentation of new words from a continuous speech stream is facilitated by simultaneous visual input that it is presented at or near syllables that exhibit the low transitional probability indicative of word boundaries. This indicates that temporal audio-visual contiguity helps in directing attention to word boundaries at the earliest stages of language learning. Off-boundary or arrhythmic picture sequences did not affect segmentation performance, suggesting that the language learning system can effectively disregard noninformative visual information. Detection of temporal contiguity between multimodal stimuli may be useful in both infants and second-language learners not only for facilitating speech segmentation, but also for detecting word–object relationships in natural environments.     

Primates do not spontaneously use shape properties for object individuation: a competence or a performance problem?

Several recent studies have documented that non-human primates can individuate objects according to property and/or kind information in much the same way as human infants do from around one year of age when they begin to acquire language. Some studies suggest, however, that only some properties are used for the individuation of food items: color, but not shape. The present study investigated whether these findings reveal a true competence problem with shape properties in the food domain or whether they merely reveal a performance problem (e.g., lack of attention to shapes). We tested 25 great apes (chimpanzees, bonobos and gorillas) in two food individuation tasks. We manipulated subjects’ experience with differences in color and shape properties of food items. Results indicated (i) that all subjects, regardless of their prior experience, solved the color-based object individuation task and (ii) that only the group with previous experience with different shape properties succeeded in the shape-based individuation task. Great apes can thus be primed to take shape into account for individuating food objects, and this results clearly speaks in favor of a performance (rather than a competence) problem in using shape for object individuation of food items.     

Eye movements of second language learners when reading spaced and unspaced Chinese text

The effect of spacing in relation to word segmentation was examined for four groups of non-native Chinese speakers (American, Korean, Japanese, and Thai) who were learning Chinese as second language. Chinese sentences with four types of spacing information were used: unspaced text, word-spaced text, character-spaced text, and nonword-spaced text. Also, participants' native languages were different in terms of their basic characteristics: English and Korean are spaced, whereas the other two are unspaced; Japanese is character based whereas the other three are alphabetic. Thus, we assessed whether any spacing effects were modulated by native language characteristics. Eye movement measures showed least disruption to reading for word-spaced text and longer reading times for unspaced than character-spaced text, with nonword-spaced text yielding the most disruption. These effects were uninfluenced by native language (though reading times differed between groups as a result of Chinese reading experience). Demarcation of word boundaries through spacing reduces non-native readers' uncertainty about the characters that constitute a word, thereby speeding lexical identification, and in turn, reading. More generally, the results indicate that words have psychological reality for those who are learning to read Chinese as a second language, and that segmentation of text into words is more beneficial to successful comprehension than is separating individual Chinese characters with spaces.     

Language comprehenders mentally represent the shapes of objects

We examined the prediction that people activate perceptual symbols during language comprehension. Subjects read sentences describing an animal or object in a certain location. The shape of the object or animal changed as a function of its location (e.g., eagle in the sky, eagle in a nest). However, this change was only implied by the sentences. After reading a sentence, subjects were presented with a line drawing of the object in question. They judged whether the object had been mentioned in the sentence (Experiment 1) or simply named the object (Experiment 2). In both cases, responses were faster when the pictured object's shape matched the shape implied by the sentence than when there was a mismatch. These results support the hypothesis that perceptual symbols are routinely activated in language comprehension.