Perception of object shape and texture in human newborns: evidence from cross-modal transfer tasks

The present research investigates newborn infants' perceptions of the shape and texture of objects through studies of the bi-directionality of cross-modal transfer between vision and touch. Using an intersensory procedure, four experiments were performed in newborns to study their ability to transfer shape and texture information from vision to touch and from touch to vision. The results showed that cross-modal transfer of shape is not bi-directional at birth. Newborns visually recognized a shape previously held but they failed to tactually recognize a shape previously seen. In contrast, a bi-directional cross-modal transfer of texture was observed. Taken together, the results suggest that newborn infants, like older children and adults, gather information differently in the visual and tactile modes, for different object properties. The findings provide evidence for continuity in the development of mechanisms for perceiving object properties.     

Le transfert intermodal des objets solides à leurs représentations graphiques chez les enfants : les capacités intermodales s’améliorent-elles avec l’âge ?

Children aged of four to six years participated in two cross-modal transfer tasks. (1) They were tactually familiarized with solid objects and then tested for visual recognition memory with outline drawings of them; (2) they were visually familiarized with drawings of objects and then tested for tactually recognition of solid objects. Six simple geometric shapes were presented to the children and could be named by them. Because a preliminary V-V transfer task was totally mastered by three to four year-old children, the children of this experiment were only subjected to an additional T-T transfer task with solid objects. This task permitted the investigation, in the course of development, of their ability to haptically recognize the correct familiar shape without seeing it. Correct recognitions were recorded. They increase similarly from four to five years in the three tasks. However, V-T cross-modal transfer was really mastered between five and six-years. These results are discussed in relation to the development of sensory modes and educational factors such as the learning of writing and reading in nursery school.     

Communication and crying in newborns

Few studies have analysed newborns’ crying behaviour in relation to the communicative context. In the present study, duration, latency and dysphony of newborns’ cry were analysed in three different communicative conditions: absent, continuous and discontinuous tactile communication. Thirty newborns were randomly assigned to three tactile communicative procedures. Subsequently they were presented with two visual stimuli, face (social-stimulus) and square (non-social-stimulus). The study showed that newborns cried only during visual stimuli presentation both in absent and continuous communication conditions. Newborns with absent communication cried more, with shorter latency and more dysphony than newborns with continuous communication. No significant differences were found in duration, latency and dysphony of newborns’ cry between the two stimuli. Newborns in the discontinuous communicative condition did not cry either during tactile communication or during visual stimuli presentation. Different communicative contexts affected the newborns’ crying behaviour during stimuli presentation. Different interpretations are discussed here in order to explain the results.     

Tactual learning and cross-modal transfer of an oddity problem in young children

The ability to solve tactual oddity problems, and transfer of oddity learning across the visual and the tactual modalities, was studied in 3- to 8-year-old children (N = 294). Oddity tasks consisting of one odd and two equal objects were made from stimuli that were easily discriminated visually and tactually. The results showed that tactual oddity learning increased gradually with age. The growth in tactual performance begins later than visual, suggesting that children are more adept at encoding visual stimulus invariances or relational properties than tactual ones. Bidirectional cross-modal transfer of oddity learning was found, supporting the suggestion that such transfer occurs when training and transfer oddity tasks share a common vehicle dimension. The cross-modal effect also shows that oddity learning is independent of a specific modality-labeled perceptual context. Our results are consistent with the view that development of oddity learning depends on a single rather than a dual process, and that the oddity relation may be treated as an amodal stimulus feature.     

Evidence of amodal representation of small numbers across visuo-tactile modalities in 5-month-old infants

Two experiments investigated 5-month-old infants’ amodal sensitivity to numerical correspondences between sets of objects presented in the tactile and visual modes. A classical cross-modal transfer task from touch to vision was adopted. Infants were first tactually familiarized with two or three different objects presented one by one in their right hand. Then, they were presented with visual displays containing two or three objects. Visual displays were presented successively (Experiment 1) or simultaneously (Experiment 2). In both experiments, results showed that infants looked longer at the visual display which contained a different number of objects from the tactile familiarization phase. Taken together, the results revealed that infants can detect numerical correspondences between a sequence of tactile and visual stimulation, and they strengthen the hypothesis of amodal and abstract representation of small numbers of objects (two or three) across sensory modalities in 5-month-old infants.     

Number versus extent in newborns’ spontaneous preference for collections of dots

This study investigated processing of number and extent in newborns. Using visual preference, we showed that newborns discriminated between small sets of dot collections relying solely on implicit numerical information when non-numerical continuous variables were strictly controlled (Experiment 1), and solely on continuous information when numerical variables were controlled (Experiment 2). When number and extent were pitted against each other (Experiment 3), newborns showed no visual preference, suggesting that the two variables play comparable roles in attracting newborns’ visual attention. In contrast to reports of dominance of continuous variables, these findings suggest that multiple dimensions attract newborns’ attention and guide their visual exploration.     

Haptic perception of texture gradients

To pick up 3-D aspects of pictures is arguably the most difficult problem concerning tactile pictorial perception by the blind. The aim of the experiments reported was to examine the potential utility of texture gradients in this context. Since there is no theoretical basis for predicting absolute values of 3-D properties from 2-D patterns read by the finger pads, the abilities of participants to perceive gradients lying between known maxima and minima were assessed. Experiment 1 involved blindfolded sighted participants making verbal magnitude estimations of texture-gradient magnitudes corresponding to plane surfaces at different slants. In experiment 2 the participants' task was to orient a surface at a slant corresponding to the texture gradients depicted tactually, and experiment 3 required early-blind participants to attempt the same task. The results revealed that participants can scale the magnitudes of texture gradients with high precision and that they can also accurately produce surface slants from depictions, providing the extreme conditions are clearly defined and there are opportunities for learning. Texture gradients appear as informative to the blind as they do to the sighted. To what extent these data can be generalised to other gradients and textures or to other projections of 3-D scenes remains to be investigated.     

Spilling thoughts: configuring attentional resources in infants’ goal-directed actions

The focus and organization of attention in perception-action coupling is systematically examined in two studies involving 9 and 10 -month-old infants engaged in learning goal-directed behaviors. Experiment 1 (discrimination study) observed the influence of an attentionally demanding motor task on learning and cognition, while Experiment 2 (means-ends study) observed the influence of an attentionally demanding goal on motor planning and reaching performance. Taken together the results of these two experiments revealed that when mental processing resources were directed to thinking about movement, discrimination performance became compromised; conversely, when processing resources were directed to thinking about the goal-state, the motor planning and execution became compromised. These results suggest a “spilling forward” of thoughts onto actions and goal-states and thus an attention-driven cognition/action trade-off for infants’ goal-directed actions. Findings highlight the ultimate importance of emerging motor skills on cognition and are contextualized within the on-going dialogues and developmental debates surrounding perceptual-motor skill development and problem-solving strategies during the first year.     

Stimulus control in a simple instrumental task: The role of internal and external stimuli

Two experiments using rats in a straight alley runway task tested the hypothesis that standard stimuli such as tones and lights (“external” stimuli) and schedule-generated aftereffect stimuli (“internal” stimuli) operate similarly and are similarly subject to the compounding rules specified by R. A. Rescorla and A. R. Wagner (In A. Black & W. Prokasy (Eds.), Classical conditioning II: Current theory and research. New York: Appleton-Century-Crofts, 1972). The experimental task was an instrumental analog of the classic blocking experiment (L. J. Kamin, In M. R. Jones (Ed.). In Experiment 1, blocking of an external discriminative stimulus by a different asymptotic discrimination was accomplished. In Experiment 2, blocking of an internal stimulus discrimination by an asymptotic external stimulus discrimination was obtained. The present results support the view that internal and external stimuli are indeed similar and function in the same manner with regard to blocking of stimulus control.     

Partial perceptual equivalence between vision and touch for texture information

The present study examined the extent to which vision and touch are perceptually equivalent for texture information in adults. Using Garbin's method, we selected two sets of textures having high versus low cross-modal dissimilarity values between vision and touch (Experiment 1). The two sets of textures were then used as material in a cross-modal matching task (Experiment 2). Results showed that asymmetries occurred in the performances when the stimuli had high cross-modal dissimilarity values, but not when the stimuli had low cross-modal dissimilarity values. These results extend Garbin's findings on shape information to the texture domain and support the idea that partial perceptual equivalence exists between vision and touch.     

Tactual, visual, and cross-modal transfer of texture in 5- and 8-year-old children

Children's tactual, visual, and cross-modal transfer abilities for texture were investigated in a delayed matching-to-sample paradigm. Transfer performance from vision to touch was found to increase between 5 and 8 years of age, whereas transfer performance from touch to vision did not vary with age and matched touch-to-touch performance. Asymmetrical cross-modal abilities were observed at the age of 8 years, vision-to-touch transfer performance being higher than touch-to-vision transfer performance (experiment 2). This developmental pattern could not be attributed to limitations in the tactual or visual discriminability of the textures or to differences in tactual or visual memory between the two age groups (experiment 1). It is suggested that the increase with age in vision-to-touch performance may be related to the intervention of more efficient top-down perceptual processes in the older children.     

Human variable ratio performance

The generality of the mathematical principles of reinforcement (MPR) was tested with humans. In Experiment 1A, participants’ mouse clicks were reinforced according to a series of variable-ratio (VR) values. In one condition, a situated task was used (searching for treasure on a map presented via a PC monitor); in the other, abstract version of the task, participants clicked on a white screen. Under the “map” condition, response rates increased with increasing ratio value before decreasing with further ratio increases; under the “no-map” condition, response rates decreased linearly from a peak at the smallest ratio. In Experiment 1B, the pattern of responding was confirmed under the “map” conditions using a different set of ratio values. In Experiment 2, reinforcer magnitude was manipulated using the “map” context. Response rates did not differ significantly when large rather than small cash reinforcers were delivered according to a VR 30 but were significantly higher when large rather than small cash reinforcers were delivered according to a VR 120. Together these experiments offer qualified support for extending MPR to the behavior of human participants.     

Aging and the visual, haptic, and cross-modal perception of natural object shape

One hundred observers participated in two experiments designed to investigate aging and the perception of natural object shape. In the experiments, younger and older observers performed either a same/different shape discrimination task (experiment 1) or a cross-modal matching task (experiment 2). Quantitative effects of age were found in both experiments. The effect of age in experiment 1 was limited to cross-modal shape discrimination: there was no effect of age upon unimodal (ie within a single perceptual modality) shape discrimination. The effect of age in experiment 2 was eliminated when the older observers were either given an unlimited amount of time to perform the task or when the number of response alternatives was decreased. Overall, the results of the experiments reveal that older observers can effectively perceive 3-D shape from both vision and haptics.     

Vibro-tactile and visual asynchronies: sensitivity and consistency

We investigated the consistency between tactually and visually designated empty time intervals. In a forced-choice discrimination task, participants judged whether the second of two intervals was shorter or longer than the first interval. Two pulses defined the intervals. The pulse was either a vibro-tactile burst presented to the fingertip, or a foveally presented white square. The comparisons were made for uni-modal and cross-modal intervals. We used four levels of standard interval durations in the range of 100- 800 ms. The results showed that tactile empty intervals must be 8.5% shorter to be perceived as long as visual intervals. This cross-modal bias is larger for small intervals and decreases with increasing standard intervals. The Weber fractions (the threshold divided by the standard interval) are 20% and are constant over the standard intervals. This indicates that the Weber law holds for the range of interval lengths tested. Furthermore, the Weber fractions are consistent over uni-modal and cross-modal comparisons, which indicates that there is no additional noise involved in the cross-modal comparisons.     

Repetition priming and the haptic recognition of familiar and unfamiliar objects

In four experiments, we examined the haptic recognition of 3-D objects. In Experiment 1, blindfolded participants named everyday objects presented haptically in two blocks. There was significant priming of naming, but no cost of an object changing orientation between blocks. However, typical orientations of objects were recognized more quickly than nonstandard orientations. In Experiment 2, participants accurately performed an unannounced test of memory for orientation. The lack of orientation-specific priming in Experiment 1, therefore, was not because participants could not remember the orientation at which they had first felt an object. In Experiment 3, we examined haptic naming of objects that were primed either haptically or visually. Haptic priming was greater than visual priming, although significant cross-modal priming was also observed. In Experiment 4, we tested recognition memory for familiar and unfamiliar objects using an old-new recognition task. Objects were recognized best when they were presented in the same orientation in both blocks, suggesting that haptic object recognition is orientation sensitive. Photographs of the unfamiliar objects may be downloaded from www.psychonomic.org/archive.     

Children's ascriptions of property rights with changes of ownership

Ownership is not a “natural” property of objects, but is determined by human intentions. Facts about who owns what may be altered by appropriate decisions. However, young children often deny the efficacy of transfer decisions, asserting that original owners retain rights to their property. In Experiment 1, 4–5-year-old and 7–8-year-old children and adults were asked to resolve disputes between initial owners and various types of receivers (finders, borrowers, buyers). Experiment 2 involved disputes both before and after transfers of ownership. At all ages participants privileged owners over non-owners and accepted the effectiveness of property transfers. Overall, children's intuitions about property rights were similar to those of adults. Observed differences may reflect older participants’ willingness to segregate property rights from other considerations in assessing the acceptability of actions.     

Aging and the perception of depth and 3-D shape from motion parallax

The ability of younger and older observers to perceive 3-D shape and depth from motion parallax was investigated. In Experiment 1, the observers discriminated among differently curved 3-dimensional (3-D) surfaces in the presence of noise. In Experiment 2, the surfaces' shape was held constant and the amount of front-to-back depth was varied; the observers estimated the amount of depth they perceived. The effects of age were strongly task dependent. The younger observers' performance in Experiment 1 was almost 60% higher than that of the older observers. In contrast, no age effect was obtained in Experiment 2. Older observers can effectively perceive variations in depth from patterns of motion parallax, but their ability to discriminate 3-D shape is significantly compromised.     

Task determinants of ear differences in melody processing

In Experiment 1 nonmusicians were presented with dichotic melodies, which differed either on all pitches or by a single note, followed by a set of four binaural melodies. They were asked to recognize among the alternatives only one member of the dichotic pair in the “single-focus” task, and both dichotic melodies in the “double-focus” task. These different attention requirements led to a LEA in the first task which contrasted with the REA observed in the other task when melodies differed by all pitches. A possible confounding (fusion of the common pitches) prevents comparison of the tasks for melodies differing by a single pitch. The role of the extent of melody differences was further investigated in a second experiment by changing melodies on one, two, or three notes. No effect of material was observed on ear asymmetries. Task demands appeared as the most critical determinant of ear differences and are discussed in terms of their particular influence on the adoption of an analytic or holistic processing mode. Male subjects were found to be more responsive than females to analytic processing suggestions.     

Interactions between presentation modality and encoding task in frequency judgements

In two experiments, presentation modality of a list of items and encoding task were varied, and subjects judged the frequency with which certain words had been presented in the list. In Experiment 1, auditory presentation led to higher judgements of frequency than did visual presentation when subjects counted the consonants in the words but not when they rated imageability or when they kept a running count of the number of presentations of each word. In Experiment 2, encoding questions about the rhyme or spelling patterns of target words produced opposite effects for auditory and visual items. The results are interpreted as indicating that cross-modal translation during encoding produces a bias towards higher-frequency judgements and may also produce better frequency discrimination.     

Learning words’ sounds before learning how words sound: 9-Month-olds use distinct objects as cues to categorize speech information

One of the central themes in the study of language acquisition is the gap between the linguistic knowledge that learners demonstrate, and the apparent inadequacy of linguistic input to support induction of this knowledge. One of the first linguistic abilities in the course of development to exemplify this problem is in speech perception: specifically, learning the sound system of one’s native language. Native-language sound systems are defined by meaningful contrasts among words in a language, yet infants learn these sound patterns before any significant numbers of words are acquired. Previous approaches to this learning problem have suggested that infants can learn phonetic categories from statistical analysis of auditory input, without regard to word referents. Experimental evidence presented here suggests instead that young infants can use visual cues present in word-labeling situations to categorize phonetic information. In Experiment 1, 9-month-old English-learning infants failed to discriminate two non-native phonetic categories, establishing baseline performance in a perceptual discrimination task. In Experiment 2, these infants succeeded at discrimination after watching contrasting visual cues (i.e., videos of two novel objects) paired consistently with the two non-native phonetic categories. In Experiment 3, these infants failed at discrimination after watching the same visual cues, but paired inconsistently with the two phonetic categories. At an age before which memory of word labels is demonstrated in the laboratory, 9-month-old infants use contrastive pairings between objects and sounds to influence their phonetic sensitivity. Phonetic learning may have a more functional basis than previous statistical learning mechanisms assume: infants may use cross-modal associations inherent in social contexts to learn native-language phonetic categories.