Processing of formational, semantic, and iconic information in American sign language

Three experiments examined short-term encoding processes of deaf signers for different aspects of signs from American Sign Language. Experiment 1 compared short-term memory for lists of formationally similar signs with memory for matched lists of random signs. Just as acoustic similarity of words interferes with short-term memory or word sequences, formational similarity of signs had a marked debilitating effect on the ordered recall of sequences of signs. Experiment 2 evaluated the effects of the semantic similarity of the signs on short-term memory: Semantic similarity had no significant effect on short-term ordered recall of sequences of signs. Experiment 3 studied the role that the iconic (representational) value of signs played in short-term memory. Iconicity also had no reliable effect on short-term recall. These results provide support for the position that deaf signers code signs from American Sign Language at one level in terms of linguistically significant formational parameters. The semantic and iconic information of signs, however, seems to have little effect on short-term memory.     

Interactions between working memory and language in young children with specific language impairment (SLI)

The underlying structure of working memory (WM) in young children with and without specific language impairment (SLI) was examined. The associations between the components of WM and the language abilities of young children with SLI were then analyzed. The Automated Working Memory Assessment and four linguistic tasks were administered to 58 children with SLI and 58 children without SLI, aged 4–5 years. The WM of the children was best represented by a model with four separate but interacting components of verbal storage, visuospatial storage, verbal central executive (CE), and visuospatial CE. The associations between the four components of WM did not differ significantly for the two groups of children. However, the individual components of WM showed varying associations with the language abilities of the children with SLI. The verbal CE component of WM was moderately to strongly associated with all the language abilities in children with SLI: receptive vocabulary, expressive vocabulary, verbal comprehension, and syntactic development. These results show verbal CE to be involved in a wide range of linguistic skills; the limited ability of young children with SLI to simultaneously store and process verbal information may constrain their acquisition of linguistic skills. Attention should thus be paid to the language problems of children with SLI, but also to the WM impairments that can contribute to their language problems.     

Interactions between spatial and spatiotemporal information in spatiotemporal boundary formation

The surface and boundaries of an object generally move in unison, so the motion of a surface could provide information about the motion of its boundaries. Here we report the results of three experiments on spatiotemporal boundary formation that indicate that information about the motion of a surface does influence the formation of its boundaries. In Experiment 1, shape identification at low texture densities was poorer for moving forms in which stationary texture was visible inside than for forms in which the stationary texture was visible only outside. In Experiment 2, the disruption found in Experiment 1 was removed by adding a second external boundary. We hypothesized that the disruption was caused by boundary assignment that perceptually grouped the moving boundary with the static texture. Experiment 3 revealed that accurate information about the motion of the surface facilitated boundary formation only when the motion was seen as coming from the surface of the moving form. Potential mechanisms for surface motion effects in dynamic boundary formation are discussed.     

Relations between language and symbolic gesture development in early childhood

Language development is thought to be associated with other domains of mental activity that require representational capacity, like symbolic gesture. Study 1 explores associations between multiple measures of language and gesture across the third and fourth years of life. Results indicate stability in language, partial stability in gesture, and concurrent and longitudinal associations between language and gesture. Study 2 further explores language-symbolic gesture relations by measuring more finely which aspects of language relate to the symbolic representation of actions with objects and by exploring associations between symbolic gesture and a performance (nonverbal) measure of general intellectual ability.     

Electrophysiology reveals semantic memory use in language comprehension

The physical energy that we refer to as a word, whether in isolation or embedded in sentences, takes its meaning from the knowledge stored in our brains through a lifetime of experience. Much empirical evidence indicates that, although this knowledge can be used fairly flexibly, it is functionally organized in ‘semantic memory’ along a number of dimensions, including similarity and association. Here, we review recent findings using an electrophysiological brain component, the N400, that reveal the nature and timing of semantic memory use during language comprehension. These findings show that the organization of semantic memory has an inherent impact on sentence processing. The left hemisphere, in particular, seems to capitalize on the organization of semantic memory to pre-activate the meaning of forthcoming words, even if this strategy fails at times. In addition, these electrophysiological results support a view of memory in which world knowledge is distributed across multiple, plastic-yet-structured, largely modality-specific processing areas, and in which meaning is an emergent, temporally extended process, influenced by experience, context, and the nature of the brain itself.     

Stereotype priming in face recognition: interactions between semantic and visual information in face encoding

The accuracy with which previously unfamiliar faces are recognised is increased by the presentation of a stereotype-congruent occupation label [Klatzky, R. L., Martin, G. L., & Kane, R. A. (1982a). Semantic interpretation effects on memory for faces. Memory & Cognition, 10, 195-206; Klatzky, R. L., Martin, G. L., & Kane, R. A. (1982b). Influence of social-category activation on processing of visual information. Social Cognition, 1, 95-109]. For example, providing the label 'criminal' both during encoding and test improves recognition for previously unfamiliar faces that look like the stereotypical criminal. Experiments 1 and 2 both replicate this effect and show that the label exerts its influence during the encoding of stereotypical faces and has little influence at test. These findings indicate that semantic information that is congruent with novel stereotypical faces facilitates their encoding.     

Development of natural language concepts: IV. The relationship between semantic organization and learning

In Experiment 1, 30 subjects at each of three age levels were shown pictures of unfamiliar “animals”. They were told two semantic attributes for each animal (e.g., kind and strong) and were asked to learn these sets so that, when shown a picture, the appropriate attributes could be recalled. The results indicated that the dimensional structure of the attributes had a strong effect on new learning for young children. Incongruent pairs of attributes (e.g., kind and ugly) were difficult to learn compared to congruent (e.g., kind and beautiful) or unrelated (e.g., kind and tall) sets. These results indicate: (a) Attribute structure is a factor in new learning; (b) 6-year-olds tend to organize the verbal labels for attributes into bipolar dimensions, rather than into independent clusters of attributes. The latter findings require reexamination of the meaning of previous word-association data which had been interpreted as indicating that 6-year-olds tend not to organize meanings bipolarly. Experiment 2 showed that the disruptive effects of incongruence on new learning disappears by college age.     

Phonological and semantic information in adults' orthographic learning

A training paradigm was used to assess the early stages of the acquisition of novel letter strings in adults. Provision of either phonological or semantic information during training improved spelling recognition (Experiment 1). Manipulation of the processing required during training (phonological, semantic, or both) produced no consistent effects on spelling when both phonology and meaning were provided (Experiment 2). An advantage of phonological over orthographic processing on spelling recognition and cued recall was found when meaning was provided during training but phonology was not (Experiment 3). The experiments support the role of phonological information in early learning of orthography, but additional research is required to clarify when and how semantic information supports the formation of new orthographic representations.     

Constraint on the semantic flexibility in visual statistical learning

We examined whether the expression of visual statistical learning (VSL) is flexible at the superordinate-categorical level. In the familiarization phase, participants viewed a sequence of line drawings. In the test phase, participants observed two test sequences (statistically related triplets versus unrelated foils) that consisted of the same objects as those presented during the familiarization phase (the same condition) or different objects that shared the same categorical information with drawings during the familiarization (the different condition). They then decided whether the first or the second sequence was more familiar. The results of Experiment 1 showed greater familiarity above chance levels for statistically related triplets only in the same condition. In Experiment 2, even where the word stimuli representing each superordinate-level category were included in the test phase (the categorical condition), the results showed VSL only in the same condition. Our findings suggest that the semantic flexibility of VSL is limited to the basic-level category.     

Visual statistical learning in the newborn infant

Statistical learning – implicit learning of statistical regularities within sensory input – is a way of acquiring structure within continuous sensory environments. Statistics computation, initially shown to be involved in word segmentation, has been demonstrated to be a general mechanism that operates across domains, across time and space, and across species. Recently, statistical leaning has been reported to be present even at birth when newborns were tested with a speech stream. The aim of the present study was to extend this finding, by investigating whether newborns’ ability to extract statistics operates in multiple modalities, as found for older infants and adults. Using the habituation procedure, two experiments were carried out in which visual sequences were presented. Results demonstrate that statistical learning is a general mechanism that extracts statistics across domain since the onset of sensory experience. Intriguingly, present data reveal that newborn learner’s limited cognitive resources constrain the functioning of statistical learning, narrowing the range of what can be learned.     

The language environment of the young infant: implications for early perceptual development

The purpose of this article is to review recent research on the young infant's use of voice-specific as well as voice-nonspecific auditory information during early language processing, to suggest a possible mechanism that biases the young infant towards this information, and to discuss potential implications of the early saliency of this information for later language development. Auditory preferences expressed by young infants are of interest because they demonstrate which properties of complex auditory events are effective in capturing the infant's attention. Moreover, the presence of such auditory preferences has led to speculations about their possible origins in both pre- and postnatal auditory experience. Research examining the role of early auditory experience in the formation of preferences is presented, along with a discussion of how the constrained nature of early auditory experience (particularly prenatal) may bias the young infant towards specific features of maternal as well as nonmaternal speech.     

Modeling semantic memory: Effects of presenting semantic information in different modalities

How is semantic information from different modalities integrated and stored? If related ideas are encountered in French and English, or in pictures and sentences, is the result a single representation in memory, or two modality-dependent ones? Subjects were presented with items in different modalities, then were asked whether or not subsequently presented items were identical with the former ones. Subjects frequently accepted translations and items semantically consistent with those presented earlier as identical, although not as often as they accepted items actually seen previously. The same pattern of results was found when the items were French and English sentences, and when they were pictures and sentences. The results can be explained by the hypothesis that subjects integrate information across modalities into a single underlying semantic representation. A computer model, embodying this hypothesis, made predictions in close agreement with the data.     

Word comprehension mediates the link between gesture and word production: Examining language development in infant siblings of children with autism spectrum disorder

Children's gesture production precedes and predicts language development, but the pathways linking these domains are unclear. It is possible that gesture production assists in children's developing word comprehension, which in turn supports expressive vocabulary acquisition. The present study examines this mediation pathway in a population with variability in early communicative abilities—the younger siblings of children with autism spectrum disorder (ASD; high‐risk infants, HR). Participants included 92 HR infants and 28 infants at low risk (LR) for ASD. A primary caregiver completed the MacArthur‐Bates Communicative Development Inventory (Fenson, et al., 1993) at 12, 14, and 18 months, and HR infants received a diagnostic evaluation for ASD at 36 months. Word comprehension at 14 months mediated the relationship between 12‐month gesture and 18‐month word production in LR and HR infants (ab = 0.263; p < 0.01). For LR infants and HR infants with no diagnosis or language delay, gesture was strongly associated with word comprehension (as = 0.666; 0.646; 0.561; ps < 0.01). However, this relationship did not hold for infants later diagnosed with ASD (a = 0.073; p = 0.840). This finding adds to a growing literature suggesting that children with ASD learn language differently. Furthermore, this study provides an initial step toward testing the developmental pathways by which infants transition from early actions and gestures to expressive language.     

Lateralization of object-shape information in semantic processing

An experiment was conducted to examine whether perceptual information, specifically the shape of objects, is activated during semantic processing. Subjects judged whether a target word was related to a prime word. Prime-target pairs that were not associated, but whose referents had similar shapes (e.g. LADDER-RAILROAD) yielded longer "no" responses than unassociated prime-target pairs, suggesting that shape information had been activated. A visual-field manipulation showed that, in right-handed subjects, this effect was localized in the left hemisphere. This finding is consistent with behavioral, brain imaging, and lesion data, which suggest that object shape at the category level is represented in the left hemisphere.     

The large-scale structure of semantic networks: statistical analyses and a model of semantic growth

We present statistical analyses of the large-scale structure of 3 types of semantic networks: word associations, WordNet, and Roget's Thesaurus. We show that they have a small-world structure, characterized by sparse connectivity, short average path lengths between words, and strong local clustering. In addition, the distributions of the number of connections follow power laws that indicate a scale-free pattern of connectivity, with most nodes having relatively few connections joined together through a small number of hubs with many connections. These regularities have also been found in certain other complex natural networks, such as the World Wide Web, but they are not consistent with many conventional models of semantic organization, based on inheritance hierarchies, arbitrarily structured networks, or high-dimensional vector spaces. We propose that these structures reflect the mechanisms by which semantic networks grow. We describe a simple model for semantic growth, in which each new word or concept is connected to an existing network by differentiating the connectivity pattern of an existing node. This model generates appropriate small-world statistics and power-law connectivity distributions, and it also suggests one possible mechanistic basis for the effects of learning history variables (age of acquisition, usage frequency) on behavioral performance in semantic processing tasks.     

Time course of word identification and semantic integration in spoken language

The minimum duration signal necessary to identify a set of spoken words was established by the gating technique; most words could be identified before their acoustic offset. Gated words were used as congruous and incongruous sentence completions, and isolation points established in the gating experiment were compared with the time course of semantic integration evident in event-related brain potentials. Differential N400 responses to contextually appropriate and inappropriate words were observed about 200 ms before the isolation point. Semantic processing was evident before the acoustic signal was sufficient to identify the words uniquely. Results indicate that semantic integration can begin to operate with only partial, incomplete information about word identity. Influences of semantic constraint, word frequency, and rate of presentation are described.     

The relation between pointing and language development: A meta-analysis

The use of the pointing gesture is one of the first ways to communicate with the world. This gesture emerges before the second year of life and it is assumed to be the first form of intentional communication. This meta-analysis examined the concurrent and longitudinal relation between pointing and the emergence of language. Twenty-five studies were included into the meta-analysis, including 734 children. The role of several moderators was examined: pointing modality, pointing motive, age at which the pointing was measured, the assessment method of the pointing gesture and language development, the modality of language, SES, and country. The results showed both a concurrent (r = .52) and a longitudinal (r = .35) relation between pointing and language development. The relation between pointing and language development became stronger with age, and was found for pointing with a declarative and general motive, but not for pointing with an imperative motive. It is concluded that the pointing gesture is a key joint-attention behavior involved in the acquisition of language.     

Cognitive integration of language and memory in bilinguals: semantic representation

Understanding cognitive research on the integration of 2 languages in bilingual memory is difficult because of the different terminology, methodology, analysis, and interpretation strategies that scholars with different backgrounds bring to the research. These studies can be usefully categorized on 2 dimensions: memory for verbal experience versus linguistic knowledge, and systemwise versus pairwise issues. Experimental findings in this area converge on the conclusion that at the word meaning/conceptual level, both episodic and linguistic memory can be characterized as shared at the systems level and at least partly shared at the pairwise translation-equivalent level. Interpretation problems that stem from weak hypothesis testing structure and from covert translation can be minimized by using appropriate design and analysis techniques.