Actions speak louder than words: Differences in memory flexibility between monolingual and bilingual 18‐month‐olds

Bilingual infants from 6‐ to 24‐months of age are more likely to generalize, flexibly reproducing actions on novel objects significantly more often than age‐matched monolingual infants are. In the current study, we examine whether the addition of novel verbal labels enhances memory generalization in a perceptually complex imitation task. We hypothesized that labels would provide an additional retrieval cue and aid memory generalization for bilingual infants. Specifically, we hypothesized that bilinguals might be more likely than monolinguals to map multiple perceptual features onto a novel label and therefore show enhanced generalization. Eighty‐seven 18‐month‐old monolingual and bilingual infants were randomly assigned to one of two experimental conditions or a baseline control condition. In the experimental conditions, either no label or a novel label was added during demonstration and again at the beginning of the test session. After a 24‐hr delay, infants were tested with the same stimulus set to test cued recall and with a perceptually different but functionally equivalent stimulus set to test memory generalization. Bilinguals performed significantly above baseline on both cued recall and memory generalization in both experimental conditions, whereas monolinguals performed significantly above baseline only on cued recall in both experimental conditions. These findings show a difference between monolinguals and bilinguals in memory generalization and suggest that generalization differences between groups may arise from visual perceptual processing rather than linguistic processing. A video abstract of this article can be viewed at https://youtu.be/yXB4pM3fF2k     

Factors affecting children's graphic symbol use in the third year: Language,similarity, and iconicity

The question addressed in this study is whether the claim that children understand the symbolic status of pictures by the middle of their third year is an overestimate of their ability. Specifically, we asked whether children use language if possible to facilitate their performance in graphic symbolic tasks. Language (availability of verbal labels) was manipulated along with iconicity (degree of resemblance between symbol and referent) and perceptual similarity (between choice items) in a series of four experiments. Children 2.5 and 3 years old were presented with a graphic symbol for 4 s and immediately asked to choose the object depicted (referent) from two choice objects. In Study 1, degree of iconicity between picture and referent was varied and both choice objects had the same verbal label. The 2.5-year-olds failed to use any pictures or replicas as symbols. The 3-year-olds performed well with all types of symbols and better with highly iconic symbols. In Study 2, verbal label availability was manipulated by presenting choice objects having the same or different labels and by varying familiarity of labels. The 2.5-year-olds performed at chance when verbal labels were unavailable but above chance when they were available. The 3-year-olds were above chance in all conditions but performed less well when verbal labels were unavailable. Study 3 confirmed that young children use language to mediate picture symbol use. When 2.5-year-olds were provided with subordinate verbal labels in the matching task, subsequent performance was good even when choice objects had the same basic level verbal label. In Study 4, verbal label availability was contrasted with perceptual similarity between choice objects. When verbal labels could be used and choice objects were dissimilar, performance was best, and when verbal labels could not be used and choice objects were similar, it was worst. The results suggest that children's developing understanding of the symbolic function of pictures is tenuous in the third year, and is supported by their use of verbal labels.     

ACQUISITION OF EXPRESSIVE SIGNING BY AUTISTIC CHILDREN: AN EVALUATION OF THE RELATIVE EFFECTS OF SIMULTANEOUS COMMUNICATION AND SIGN-ALONE TRAINING

Two methods of training autistic children to use manual signs were compared. Two children, one mute and one capable of some verbal imitation, were taught to use signs as expressive labels for pictures of objects. Using an alternating treatments design, speed of sign acquisition was compared across two training conditions in which signs were presented either accompanied by, or without, the corresponding verbal label. In both conditions, the training procedure incorporated reinforcement, modeling, prompting, fading, and stimulus rotation. The efficacy of training in both treatment conditions was demonstrated by the use of a multiple baseline control across signs, but no clear differences in acquisition speed across conditions were apparent. Posttests conducted to assess stimulus control of signing, and learning of verbal labels when these were present in training, showed that the behavior of the imitative, but not the mute, child was controlled by the verbal stimuli. The implications of the results both for understanding deficits characteristic of autistic children and for developing appropriate language training procedures are discussed.     

Language is not just for talking: redundant labels facilitate learning of novel categories

In addition to having communicative functions, verbal labels may play a role in shaping concepts. Two experiments assessed whether the presence of labels affected category formation. Subjects learned to categorize "aliens" as those to be approached or those to be avoided. After accuracy feedback on each response was provided, a nonsense label was either presented or not. Providing nonsense category labels facilitated category learning even though the labels were redundant and all subjects had equivalent experience with supervised categorization of the stimuli. A follow-up study investigated differences between learning verbal and nonverbal associations and showed that learning a nonverbal association did not facilitate categorization. The findings show that labels make category distinctions more concrete and bear directly on the language-and-thought debate.     

The influence of electronic sound effects on learning from televised and live models

Infants rapidly accrue information via imitation from multiple sources, including television and electronic toys. In two experiments, we examined whether adding sound effects to video or live demonstrations would influence imitation by 6-, 12-, and 18-month-olds. In Experiment 1, we added matching and mismatching sound effects to target actions presented by a televised model. We found that 6-month-olds reproduced the target actions regardless of whether the sound effects were matched or mismatched, whereas 12- and 18-month-olds reproduced the actions only when the sound effects were matched. In Experiment 2, we added matching sound effects to target actions presented by a live model. The addition of sound effects disrupted imitation performance by 6-, 12-, and 18-month-olds. Overall, imitation provides a clear behavioral measure of rapid changes in learning from television and electronic toys during infancy. These findings have practical implications for producers and parents regarding learning in the digital age and theoretical implications regarding the development of integrated action-perception representational systems.     

Redundant spoken labels facilitate perception of multiple items

Because of the strong associations between verbal labels and the visual objects that they denote, hearing a word may quickly guide the deployment of visual attention to the named objects. We report six experiments in which we investigated the effect of hearing redundant (noninformative) object labels on the visual processing of multiple objects from the named category. Even though the word cues did not provide additional information to the participants, hearing a label resulted in faster detection of attention probes appearing near the objects denoted by the label. For example, hearing the word chair resulted in more effective visual processing of all of the chairs in a scene relative to trials in which the participants attended to the chairs without actually hearing the label. This facilitation was mediated by stimulus typicality. Transformations of the stimuli that disrupted their association with the label while preserving the low-level visual features eliminated the facilitative effect of the labels. In the final experiment, we show that hearing a label improves the accuracy of locating multiple items matching the label, even when eye movements are restricted. We posit that verbal labels dynamically modulate visual processing via top-down feedback--an instance of linguistic labels greasing the wheels of perception.     

Music interferes with learning from television during infancy

Infants are frequently exposed to music during daily activities, including free play, and while viewing infant‐directed videotapes that contain instrumental music soundtracks. In Experiment 1, an instrumental music soundtrack was played during a live or televised demonstration to examine its effects on deferred imitation by 6‐, 12‐, and 18‐month‐old infants. Transfer of information was indexed via deferred imitation of the target actions following a 24‐h delay. For half the infants, the music context was also reinstated at the time of test. Performance by experimental groups was compared to that of a baseline control group that participated in the test session without prior exposure to the demonstration. Imitation performance was above baseline for the live groups but not for the video groups regardless of age or the music context at test. In Experiment 2, we added matched sound effects to the video demonstration and infants performed above baseline. We conclude that the music track creates additional cognitive load, disrupts selective attention to the target actions and inhibits transfer of learning from television of the imitation task. Music may impair an infant's ability to translate information from a two‐dimensional to three‐dimensional world even if the auditory context remains the same. Copyright © 2010 John Wiley & Sons, Ltd.     

The evocative power of words: activation of concepts by verbal and nonverbal means

A major part of learning a language is learning to map spoken words onto objects in the environment. An open question is what are the consequences of this learning for cognition and perception? Here, we present a series of experiments that examine effects of verbal labels on the activation of conceptual information as measured through picture verification tasks. We find that verbal cues, such as the word "cat," lead to faster and more accurate verification of congruent objects and rejection of incongruent objects than do either nonverbal cues, such as the sound of a cat meowing, or words that do not directly refer to the object, such as the word "meowing." This label advantage does not arise from verbal labels being more familiar or easier to process than other cues, and it does extends to newly learned labels and sounds. Despite having equivalent facility in learning associations between novel objects and labels or sounds, conceptual information is activated more effectively through verbal means than through nonverbal means. Thus, rather than simply accessing nonverbal concepts, language activates aspects of a conceptual representation in a particularly effective way. We offer preliminary support that representations activated via verbal means are more categorical and show greater consistency between subjects. These results inform the understanding of how human cognition is shaped by language and hint at effects that different patterns of naming can have on conceptual structure.     

Memory retrieval by 18--30-month-olds: age-related changes in representational flexibility

Deferred imitation was used to trace changes in memory retrieval by 18-30-month-olds. In all experiments, an adult demonstrated 2 sets of actions using 2 different sets of stimuli. In Experiments 1A and 1B, independent groups of infants were tested immediately or after a 24-hr delay. Each infant was tested with 1 set of stimuli from the original demonstration and 1 set of stimuli that was different. Recall of the target actions when tested with different stimuli increased as a function of age, particularly after a delay. In Experiment 2, infants were provided with a unique verbal label for the stimuli during the demonstration and the test. The verbal label facilitated performance by 24-month-olds tested with different stimuli but had no effect on performance by 18-month-olds. One hallmark of memory development appears to be an age-related increase in the range of effective retrieval cues for a particular memory.     

The beliefs adults and children hold about television and video games.

In Phase 1 of this study, we asked 23 parents between the ages of 30 and 52 years and 26 children between the ages of 10 and 19 years to list effects of television and video games on children. A questionnaire was developed using the most frequently given responses (e.g., television influences children's aggressive behavior, verbal abilities, or time with friends). In Phase 2, this questionnaire was administered to different groups of parents and children and a control group of adults without offspring (N = 204) who were asked to rate the influence of each item on the questionnaire. Multivariate analyses of variance indicated that there were similarities and differences among the groups. For example, parents and other adults held similar beliefs about the influence of television, but parents held more positive beliefs about the influence of video games than the other adults. Children held more positive beliefs about the influence of television than parents, but parents and children held similar beliefs about the influence of video games.     

Labels can override perceptual categories in early infancy

An extensive body of research claims that labels facilitate categorisation, highlight the commonalities between objects and act as invitations to form categories for young infants before their first birthday. While this may indeed be a reasonable claim, we argue that it is not justified by the experiments described in the research. We report on a series of experiments that demonstrate that labels can play a causal role in category formation during infancy. Ten-month-old infants were taught to group computer-displayed, novel cartoon drawings into two categories under tightly controlled experimental conditions. Infants were given the opportunity to learn the two categories under four conditions: Without any labels, with two labels that correlated with category membership, with two labels assigned randomly to objects, and with one label assigned to all objects. Category formation was assessed identically in all conditions using a novelty preference procedure conducted in the absence of any labels. The labelling condition had a decisive impact on the way infants formed categories: When two labels correlated with the visual category information, infants learned two categories, just as if there had been no labels presented. However, uncorrelated labels completely disrupted the formation of any categories. Finally, consistent use of a single label across objects led infants to learn one broad category that included all the objects. These findings demonstrate that even before infants start to produce their first words, the labels they hear can override the manner in which they categorise objects.     

Facilitative effects of labeling on preschool children's copying of simple geometric forms

A total of 150 children between 2.5 and 5 yr. of age were tested on one of three conditions (one experimental and two control) of a copying task adapted from the 1982 Developmental Test of Visual Motor Integration of Beery. In the experimental condition, the geometric forms were labeled with the names of familiar objects. Analysis of scores indicated that introduction of verbal labels on the copying task facilitated preschool children's ability to reproduce geometric forms. The effect was consistent across the ages tested but was limited in that facilitation was observed only for those forms just beyond the child's demonstrated level of mastery. These results suggested that the verbal labels evoked a representational context which provided children with additional information necessary for accurate reproduction of the forms. Two alternative interpretations of this finding are discussed.     

Explaining the errors away: Young children forgive understandable semantic mistakes

Errors differ in degree of seriousness. We asked whether preschoolers would use the magnitude of an informant's errors to decide if that informant would be a good source of information later. Four- and 5-year-olds observed two informants incorrectly label familiar objects, but one informant's errors were closer to the correct answer than the other's (e.g., one referred to a comb as a brush and the other referred to the same comb as a thunderstorm). When informants had an unambiguous view of the objects, children could identify which informant was closer to being correct, but they did not favor novel labels the “closer” informant later provided. When the informants had an ambiguous view of the objects (e.g., only the handle of the comb was visible), children preferred the novel labels provided later by the “closer” informant. Preschoolers are willing to overlook semantic errors that are close to being correct, but only when there is an understandable reason for the speaker's errors.     

Media violence exposure in aggressive and control adolescents: differences in self‐ and parent‐reported exposure to violence on television and in video games

The purpose of present study was to investigate differences in media violence exposure between groups of adolescents with and without Disruptive Behavior Disorders with Aggressive Features, using a case‐controlled design and multimethod assessment. Samples of 27 adolescents aged 13‐17 with Disruptive Behavior Disorder with Aggressive Features and 27 age‐gender‐IQ matched controls completed a semistructured interview about exposure to violence on television and video games; parents completed a corresponding questionnaire measure. Moderate intercorrelations were found between most self‐ and parent‐report television and video game violence exposure measures. Compared to control adolescents, adolescents with Disruptive Behavior Disorder with Aggressive Features had higher aggregate media violence exposure, higher exposure to video game violence, and higher parent‐reported exposure to television violence. Results show that adolescents and parents agree about the adolescent's level of media violence exposure, that exposure to violence on television tends to be accompanied by exposure to violence in video games, and that the association between media violence exposure and Disruptive Behavior Disorder with Aggressive Features is not due to a spurious effect of gender or IQ. Aggr. Behav. 31:000–000, 2005. © 2005 Wiley‐Liss, Inc.     

Labeling, attention and perception, a developmental study

96 7- and 9-yr.-olds were under four experimental conditions. A "distinctive label" group (n = 24) associated four different gender-cued labels with four infants' faces. An "equivalent label" group (m = 24) associated only two of these labels. There were also two no-label groups (ns = 24), "differential perception" and "perception." In the former, perceptual cues were provided; no cues were provided in the latter. The main measure was a test of perception. 9-yr.-olds were not affected by the labels, 7-yr.-olds were but more significantly so during initial trials. It is proposed that perception is affected by labels, learning, and selective attention. These effects are determined developmentally. As age increases the effects of verbal cues diminish and of perceptual cues increase. The findings are related to cross-cultural data, indicating that Israeli toddlers classify according to gender earlier than do American children. This is probably because Hebrew more than English contains distinctive linguistic cues related to sex.     

The effects of feature-label-order and their implications for symbolic learning

Symbols enable people to organize and communicate about the world. However, the ways in which symbolic knowledge is learned and then represented in the mind are poorly understood. We present a formal analysis of symbolic learning-in particular, word learning-in terms of prediction and cue competition, and we consider two possible ways in which symbols might be learned: by learning to predict a label from the features of objects and events in the world, and by learning to predict features from a label. This analysis predicts significant differences in symbolic learning depending on the sequencing of objects and labels. We report a computational simulation and two human experiments that confirm these differences, revealing the existence of Feature-Label-Ordering effects in learning. Discrimination learning is facilitated when objects predict labels, but not when labels predict objects. Our results and analysis suggest that the semantic categories people use to understand and communicate about the world can only be learned if labels are predicted from objects. We discuss the implications of this for our understanding of the nature of language and symbolic thought, and in particular, for theories of reference.     

The influence of verbal labeling on the perception of odors: evidence for olfactory illusions?

Using the definition that an illusion is observed when a stimulus is invariant but context alters its perception, we examined whether verbal context could produce olfactory illusions. To test this effect, we chose five odors with minimally fixed sources and that could be interpreted with various hedonic connotations. The odors were violet leaf, patchouli, pine oil, menthol, and a 1:1 mixture of isovaleric and butyric acids. Subjects individually sniffed each odor at two different sessions separated by one week. At each session an odor was given a different verbal label (either positive or negative) and subjects rated the odors on several hedonic scales and provided perceptual and interpretative responses to them. Results showed that the perception of an odor could be significantly influenced by the label provided for it. We propose that the cases where verbal labels inverted odor perception are the first empirical demonstrations of olfactory illusions.     

Conceptual knowledge attenuates viewpoint dependency in visual object recognition

Learning verbal semantic knowledge for objects has been shown to attenuate recognition costs incurred by changes in view from a learned viewpoint. Such findings were attributed to the semantic or meaningful nature of the learned verbal associations. However, recent findings demonstrate surprising benefits to visual perception after learning even noninformative verbal labels for stimuli. Here we test whether learning verbal information for novel objects, independent of its semantic nature, can facilitate a reduction in viewpoint-dependent recognition. To dissociate more general effects of verbal associations from those stemming from the semantic nature of the associations, participants learned to associate semantically meaningful (adjectives) or nonmeaningful (number codes) verbal information with novel objects. Consistent with a role of semantic representations in attenuating the viewpoint-dependent nature of object recognition, the costs incurred by a change in viewpoint were attenuated for stimuli with learned semantic associations relative to those associated with nonmeaningful verbal information. This finding is discussed in terms of its implications for understanding basic mechanisms of object perception as well as the classic viewpoint-dependent nature of object recognition.     

The role of language in acquiring object kind concepts in infancy

Four experiments investigated whether 9-month-old infants could use the presence of labels to help them establish a representation of two distinct objects in a complex object individuation task. We found that the presence of two distinct labels facilitated object individuation, but the presence of one label for both objects, two distinct tones, two distinct sounds, or two distinct emotional expressions did not. These findings suggest that language may play an important role in the acquisition of sortal/object kind concepts in infancy: words may serve as "essence placeholders". Implications for the relationship between language and conceptual development are discussed.     

The effect of verbal context on olfactory perception

Three experiments were conducted to examine how verbal context and sensory stimulation interact to influence odor hedonic perception. Eight common odors were presented in their natural and synthetic forms, and verbal labels designating name and source (natural, synthetic) information were either explicitly given, self-generated, falsely provided, or not provided. Results revealed that verbal information about source influenced hedonic ratings whether or not the odorant itself was also present. When odorants were presented without verbal labels, olfactory evaluations were based in sensation. Name and source information contributed different levels of meaning and influence to perceptual evaluations. The findings are discussed with reference to an experiential-collocation model for odor-label interactions and a dual-coding hypothesis for olfactory perception.