Information from multiple modalities helps 5‐month‐olds learn abstract rules

By 7 months of age, infants are able to learn rules based on the abstract relationships between stimuli ( Marcus et al ., 1999 ), but they are better able to do so when exposed to speech than to some other classes of stimuli. In the current experiments we ask whether multimodal stimulus information will aid younger infants in identifying abstract rules. We habituated 5‐month‐olds to simple abstract patterns (ABA or ABB) instantiated in coordinated looming visual shapes and speech sounds (Experiment 1), shapes alone (Experiment 2), and speech sounds accompanied by uninformative but coordinated shapes (Experiment 3). Infants showed evidence of rule learning only in the presence of the informative multimodal cues. We hypothesize that the additional evidence present in these multimodal displays was responsible for the success of younger infants in learning rules, congruent with both a Bayesian account and with the Intersensory Redundancy Hypothesis.     

Robustness of the rule-learning effect in 7-month-old infants: A close,multicenter replication of Marcus et al. (1999)

We conducted a close replication of the seminal work by Marcus and colleagues from 1999, which showed that after a brief auditory exposure phase, 7-month-old infants were able to learn and generalize a rule to novel syllables not previously present in the exposure phase. This work became the foundation for the theoretical framework by which we assume that infants are able to learn abstract representations and generalize linguistic rules. While some extensions on the original work have shown evidence of rule learning, the outcomes are mixed, and an exact replication of Marcus et al.'s study has thus far not been reported. A recent meta-analysis by Rabagliati and colleagues brings to light that the rule-learning effect depends on stimulus type (e.g., meaningfulness, speech vs. nonspeech) and is not as robust as often assumed. In light of the theoretical importance of the issue at stake, it is appropriate and necessary to assess the replicability and robustness of Marcus et al.'s findings. Here we have undertaken a replication across four labs with a large sample of 7-month-old infants (N = 96), using the same exposure patterns (ABA and ABB), methodology (Headturn Preference Paradigm), and original stimuli. As in the original study, we tested the hypothesis that infants are able to learn abstract “algebraic” rules and apply them to novel input. Our results did not replicate the original findings: infants showed no difference in looking time between test patterns consistent or inconsistent with the familiarization pattern they were exposed to.     

Processing abstract sequence structure: learning without knowing, or knowing without learning?

Constant interaction with a dynamic environment—from riding a bicycle to segmenting speech—makes sensitivity to the sequential structure of the world a fundamental dimension of information processing. Accounts of sequence learning vary widely, with some authors arguing that parsing and segmentation processes are central, and others proposing that sequence learning involves mere memorization. In this paper, we argue that sequence knowledge is essentially statistical in nature, and that sequence learning involves simple associative prediction mechanisms. We focus on a choice reaction situation introduced by Lee (1997), in which participants were exposed to material that follows a single abstract rule, namely that stimuli are selected randomly, but never appear more than once in a legal sequence. Perhaps surprisingly, people can learn this rule very well. Or can they? We offer a conceptual replication of the original finding, but a very different interpretation of the results, as well as simulation work that makes it clear how highly abstract dimensions of the stimulus material can in fact be learned based on elementary associative mechanisms. We conclude that, when relevant, memory is optimized to facilitate responding to events that have not occurred recently, and that sequence learning in general always involves sensitivity to repetition distance.     

Bimodal emotion congruency is critical to preverbal infants’ abstract rule learning

Extracting general rules from specific examples is important, as we must face the same challenge displayed in various formats. Previous studies have found that bimodal presentation of grammar‐like rules (e.g. ABA) enhanced 5‐month‐olds’ capacity to acquire a rule that infants failed to learn when the rule was presented with visual presentation of the shapes alone (circle‐triangle‐circle) or auditory presentation of the syllables (la‐ba‐la) alone. However, the mechanisms and constraints for this bimodal learning facilitation are still unknown. In this study, we used audio‐visual relation congruency between bimodal stimulation to disentangle possible facilitation sources. We exposed 8‐ to 10‐month‐old infants to an AAB sequence consisting of visual faces with affective expressions and/or auditory voices conveying emotions. Our results showed that infants were able to distinguish the learned AAB rule from other novel rules under bimodal stimulation when the affects in audio and visual stimuli were congruently paired (Experiments 1A and 2A). Infants failed to acquire the same rule when audio‐visual stimuli were incongruently matched (Experiment 2B) and when only the visual (Experiment 1B) or the audio (Experiment 1C) stimuli were presented. Our results highlight that bimodal facilitation in infant rule learning is not only dependent on better statistical probability and redundant sensory information, but also the relational congruency of audio‐visual information. A video abstract of this article can be viewed at https://m.youtube.com/watch?v=KYTyjH1k9RQ     

Emotional facial expressions affect visual rule learning in 7- to 8-month-old infants

Rule learning (RL) is an implicit learning mechanism that allows infants to detect and generalize rule-like repetition-based patterns (such as ABB and ABA) from a sequence of elements. Increasing evidence shows that RL operates both in the auditory and the visual domain and is modulated by the perceptual expertise with the to-be-learned stimuli. Yet, whether infants’ ability to detect a high-order rule from a sequence of stimuli is affected by affective information remains a largely unexplored issue. Using a visual habituation paradigm, we investigated whether the presence of emotional expressions with a positive and a negative value (i.e., happiness and anger) modulates 7- to 8-month-old infants’ ability to learn a rule-like pattern from a sequence of faces of different identities. Results demonstrate that emotional facial expressions (either positive and negative) modulate infants’ visual RL mechanism, even though positive and negative facial expressions affect infants’ RL in a different manner: while anger disrupts infants’ ability to learn the rule-like pattern from a face sequence, in the presence of a happy face infants show a familiarity preference, thus maintaining their learning ability. These findings show that emotional expressions exert an influence on infants’ RL abilities, contributing to the investigation on how emotion and cognition interact in face processing during infancy.     

汉语声调远距离规则的内隐学习及其迁移效应

内隐学习研究领域的一个重要问题是内隐学习获得的知识究竟是什么,即内隐学习获得的知识究竟是底层的抽象规则还是表面的特征.研究以汉语声调的远距离水平映射这一远距离规则为材料,通过对表面特征和底层规则之间的分离操作,在控制组块和重复结构等表面特征的条件下,探讨声调远距离规则的习得和迁移,结果发现被试能够内隐地习得和迁移汉语平仄声调的水平映射规则,证实了内隐学习确实能够获得底层的抽象规则,为内隐学习的抽象性问题提供了新的证据.     

Infant learning is influenced by local spurious generalizations

In previous work, 11‐month‐old infants were able to learn rules about the relation of the consonants in CVCV words from just four examples. The rules involved phonetic feature relations (same voicing or same place of articulation), and infants' learning was impeded when pairs of words allowed alternative possible generalizations (e.g. two words both contained the specific consonants p and t). Experiment 1 asked whether a small number of such spurious generalizations found in a randomly ordered list of 24 different words would also impede learning. It did – infants showed no sign of learning the rule. To ask whether it was the overall set of words or their order that prevented learning, Experiment 2 reordered the words to avoid local spurious generalizations. Infants showed robust learning. Infants thus appear to entertain spurious generalizations based on small, local subsets of stimuli. The results support a characterization of infants as incremental rather than batch learners.     

Infants’ representations of same and different in match- and non-match-to-sample

Three experiments investigated the representations that underlie 14-month-old infants’ and adults’ success at match-to-sample (MTS) and non-match-to-sample (NMTS) tasks. In Experiment 1, 14-month-old infants were able to learn rules based on abstract representations of sameness and/or difference. When presented with one of eighteen sample stimuli (A) and a choice between a stimulus that was the same as the sample (A) and a different stimulus (B), infants learned to choose A in MTS and B in NMTS. In Experiments 2 and 3, we began to explore the nature of the representations at play in these paradigms. Experiment 2 confirmed that abstract representations were at play, as infants generalized the MTS and NMTS rules to stimuli unseen during familiarization. Experiment 2 also showed that infants tested in MTS learned to seek the stimulus that was the same as the sample, whereas infants tested in NMTS did not learn to seek the different stimulus, but instead learned to avoid the stimulus that was the same as the sample. Infants appeared to only use an abstract representation of the relation same in these experiments. Experiment 3 showed that adult participants, despite knowing the words “same” and “different”, also relied on representations of sameness in both MTS and NMTS in a paradigm modeled on that of Experiment 2. We conclude with a discussion of how young infants may possibly represent the abstract relation same.     

Fourteen‐month‐old infants learn similar‐sounding words

Can infants, in the very first stages of word learning, use their perceptual sensitivity to the phonetics of speech while learning words? Research to date suggests that infants of 14 months cannot learn two similar‐sounding words unless there is substantial contextual support. The current experiment advances our understanding of this failure by testing whether the source of infants’ difficulty lies in the learning or testing phase. Infants were taught to associate two similar‐sounding words with two different objects, and tested using a visual choice method rather than the standard Switch task. The results reveal that 14‐month‐olds are capable of learning and mapping two similar‐sounding labels; they can apply phonetic detail in new words. The findings are discussed in relation to infants’ concurrent failure, and the developmental transition to success, in the Switch task.     

Biracial and monoracial infant own‐race face perception: an eye tracking study

We know that early experience plays a crucial role in the development of face processing, but we know little about how infants learn to distinguish faces from different races, especially for non‐Caucasian populations. Moreover, it is unknown whether differential processing of different race faces observed in typically studied monoracial infants extends to biracial infants as well. Thus, we investigated 3‐month‐old Caucasian, Asian and biracial (Caucasian‐Asian) infants’ ability to distinguish Caucasian and Asian faces. Infants completed two within‐subject, infant‐controlled habituation sequences and test trials as an eye tracker recorded looking times and scanning patterns. Examination of individual differences revealed significant positive correlations between own‐race novelty preference and scanning frequency between eye and mouth regions of own‐race habituation stimuli for Caucasian and Asian infants, suggesting that facility in own‐race face discrimination stems from active inspection of internal facial features in these groups. Biracial infants, however, showed the opposite effect: An ‘own‐race’ novelty preference was associated with reduced scanning between eye and mouth regions of ‘own‐race’ habituation stimuli, suggesting that biracial infants use a distinct approach to processing frequently encountered faces. Future directions for investigating face processing development in biracial populations are discussed. A video abstract of this article can be viewed at http://youtu.be/a_dDXfFuEfY     

Selective social learning in infancy: looking for mechanisms

Although there is mounting evidence that selective social learning begins in infancy, the psychological mechanisms underlying this ability are currently a controversial issue. The purpose of this study is to investigate whether theory of mind abilities and statistical learning skills are related to infants’ selective social learning. Seventy‐seven 18‐month‐olds were first exposed to a reliable or an unreliable speaker and then completed a word learning task, two theory of mind tasks, and a statistical learning task. If domain‐general abilities are linked to selective social learning, then infants who demonstrate superior performance on the statistical learning task should perform better on the selective learning task, that is, should be less likely to learn words from an unreliable speaker. Alternatively, if domain‐specific abilities are involved, then superior performance on theory of mind tasks should be related to selective learning performance. Findings revealed that, as expected, infants were more likely to learn a novel word from a reliable speaker. Importantly, infants who passed a theory of mind task assessing knowledge attribution were significantly less likely to learn a novel word from an unreliable speaker compared to infants who failed this task. No such effect was observed for the other tasks. These results suggest that infants who possess superior social‐cognitive abilities are more apt to reject an unreliable speaker as informant. A video abstract of this article can be viewed at: https://youtu.be/zuuCniHYzqo     

The moment‐to‐moment pitch dynamics of child‐directed speech shape toddlers’ attention and learning

Young children have an overall preference for child‐directed speech (CDS) over adult‐directed speech (ADS), and its structural features are thought to facilitate language learning. Many studies have supported these findings, but less is known about processing of CDS at short, sub‐second timescales. How do the moment‐to‐moment dynamics of CDS influence young children's attention and learning? In Study 1, we used hierarchical clustering to characterize patterns of pitch variability in a natural CDS corpus, which uncovered four main word‐level contour shapes: ‘fall’, ‘rise’, ‘hill’, and ‘valley’. In Study 2, we adapted a measure from adult attention research—pupil size synchrony—to quantify real‐time attention to speech across participants, and found that toddlers showed higher synchrony to the dynamics of CDS than to ADS. Importantly, there were consistent differences in toddlers’ attention when listening to the four word‐level contour types. In Study 3, we found that pupil size synchrony during exposure to novel words predicted toddlers’ learning at test. This suggests that the dynamics of pitch in CDS not only shape toddlers’ attention but guide their learning of new words. By revealing a physiological response to the real‐time dynamics of CDS, this investigation yields a new sub‐second framework for understanding young children's engagement with one of the most important signals in their environment.     

“I don't know but I know who to ask”: 12‐month‐olds actively seek information from knowledgeable adults

Active social communication is an effective way for infants to learn about the world. Do pre‐verbal and pre‐pointing infants seek epistemic information from their social partners when motivated to obtain information they cannot discover independently? The present study investigated whether 12‐month‐olds (N = 30) selectively seek information from knowledgeable adults in situations of referential uncertainty. In a live experiment, infants were introduced to two unfamiliar adults, an Informant (reliably labeling objects) and a Non‐Informant (equally socially engaging, but ignorant about object labels). At test, infants were asked to make an impossible choice—locate a novel referent among two novel objects. When facing epistemic uncertainty—but not at other phases of the procedure—infants selectively referred to the Informant rather than the Non‐Informant. These results show that pre‐verbal infants use social referencing to actively and selectively seek information from social partners as part of their interrogative communicative toolkit. A video abstract of this article can be viewed at https://youtu.be/23dLPsa-fAY     

Lexical Learning May Contribute to Phonetic Learning in Infants: A Corpus Analysis of Maternal Spanish

In their first year, infants begin to learn the speech sounds of their language. This process is typically modeled as an unsupervised clustering problem in which phonetically similar speech‐sound tokens are grouped into phonetic categories by infants using their domain‐general inference abilities. We argue here that maternal speech is too phonetically variable for this account to be plausible, and we provide phonetic evidence from Spanish showing that infant‐directed Spanish vowels are more readily clustered over word types than over vowel tokens. The results suggest that infants’ early adaptation to native‐language phonetics depends on their word‐form lexicon, implicating a much wider range of potential sources of influence on infants’ developmental trajectories in language learning.     

More than a matter of getting ‘unstuck’: flexible thinkers use more abstract representations than perseverators

Why do people perseverate, repeating prior behaviours that are no longer appropriate? Many accounts point to isolated deficits in processes such as inhibition or attention. We instead posit a fundamental difference in rule representations: flexible switchers use active representations that rely on later‐developing prefrontal cortical areas and are more abstract, whereas perseverators use latent representations that rely on earlier‐developing posterior cortical and subcortical areas and are more stimulus‐specific. Thus, although switchers and perseverators should apply the rules they use to familiar stimuli equally reliably, perseverators should show unique limitations in generalizing their rules to novel stimuli, a process that requires abstract representations. Two behavioural experiments confirmed this counterintuitive prediction early in development. Three‐year‐old children sorted cards by one rule, were asked to switch to another rule, and then were asked simply to continue their behaviour, with novel cards. Perseverators applied the rule they were using (the first rule) just as reliably as switchers applied the rule they were using (the second rule) with familiar cards; however, only switchers generalized their rule to novel cards. This finding supports an early link between active representations that support switching and abstract representations that support generalization. We interpret this synergy in terms of prefrontal cortical development.     

Tuned to the signal: the privileged status of speech for young infants

Do young infants treat speech as a special signal, compared with structurally similar non‐speech sounds? We presented 2‐ to 7‐month‐old infants with nonsense speech sounds and complex non‐speech analogues. The non‐speech analogues retain many of the spectral and temporal properties of the speech signal, including the pitch contour information which is known to be salient to young listeners, and thus provide a stringent test for a potential listening bias for speech. Our results show that infants as young as 2 months of age listened longer to speech sounds. This listening selectivity indicates that early‐functioning biases direct infants’ attention to speech, granting speech a special status in relation to other sounds.     

Learning across languages: bilingual experience supports dual language statistical word segmentation

Bilingual acquisition presents learning challenges beyond those found in monolingual environments, including the need to segment speech in two languages. Infants may use statistical cues, such as syllable‐level transitional probabilities, to segment words from fluent speech. In the present study we assessed monolingual and bilingual 14‐month‐olds’ abilities to segment two artificial languages using transitional probability cues. In Experiment 1, monolingual infants successfully segmented the speech streams when the languages were presented individually. However, monolinguals did not segment the same language stimuli when they were presented together in interleaved segments, mimicking the language switches inherent to bilingual speech. To assess the effect of real‐world bilingual experience on dual language speech segmentation, Experiment 2 tested infants with regular exposure to two languages using the same interleaved language stimuli as Experiment 1. The bilingual infants in Experiment 2 successfully segmented the languages, indicating that early exposure to two languages supports infants’ abilities to segment dual language speech using transitional probability cues. These findings support the notion that early bilingual exposure prepares infants to navigate challenging aspects of dual language environments as they begin to acquire two languages.     

Bridging ears and eyes when learning spoken words: On the effects of bilingual experience at 30 months

From the very first moments of their lives, infants selectively attend to the visible orofacial movements of their social partners and apply their exquisite speech perception skills to the service of lexical learning. Here we explore how early bilingual experience modulates children's ability to use visible speech as they form new lexical representations. Using a cross‐modal word‐learning task, bilingual children aged 30 months were tested on their ability to learn new lexical mappings in either the auditory or the visual modality. Lexical recognition was assessed either in the same modality as the one used at learning (‘same modality’ condition: auditory test after auditory learning, visual test after visual learning) or in the other modality (‘cross‐modality’ condition: visual test after auditory learning, auditory test after visual learning). The results revealed that like their monolingual peers, bilingual children successfully learn new words in either the auditory or the visual modality and show cross‐modal recognition of words following auditory learning. Interestingly, as opposed to monolinguals, they also demonstrate cross‐modal recognition of words upon visual learning. Collectively, these findings indicate a bilingual edge in visual word learning, expressed in the capacity to form a recoverable cross‐modal representation of visually learned words.     

Who's my little monkey? Effects of infant‐directed speech on visual retention in infant rhesus macaques

Both human and nonhuman primate adults use infant‐directed facial and vocal expressions across many contexts when interacting with infants (e.g., feeding, playing). This infant‐oriented style of communication, known as infant‐directed speech (IDS), seems to benefit human infants in numerous ways, including facilitating language acquisition. Given the variety of contexts in which adults use IDS, we hypothesized that IDS supports learning beyond the linguistic domain and that these benefits may extend to nonhuman primates. We exposed 2.5‐month‐old rhesus macaque infants (N = 15) to IDS, adult‐directed speech (ADS), and a non‐social control (CTR) during a video presentation of unrelated stimuli. After a 5‐ or 60‐minute delay, infants were shown the familiar video side‐by‐side with a novel video. Infants exhibited a novelty preference after the 5‐minute delay, but not after the 60‐minute delay, in the ADS and CTR conditions, and a novelty preference in the IDS condition only after the 60‐minute delay. These results are the first to suggest that exposure to IDS affects infants’ long‐term memory, even in non‐linguistic animals.