Intermodal matching of vision and audition in infancy: A proposal for a new taxonomy

The aim of this review paper is first to devise a common framework for the various procedures used in experimental investigations of intermodal auditory – visual matching by human infants, and second to propose a new taxonomy of intermodal tasks in order to gain a better understanding of the perceptual-cognitive processing underlying these tasks and their relationships to other cognitive achievements such as the development of language. Based on an examination of the tasks used in the developmental literature, we suggest analysing them in terms of (a) their mode of presentation (simultaneous or sequential) for accessing the information in the two modalities (auditory and visual) and (b) the type of relation (amodal or arbitrary) between these two stimulus sources. A review of the literature in the light of this classification shows that most experimental studies employ parallel intermodal presentation (PIP) using both amodal and arbitrary relations between stimuli. Very few investigations have used sequential intermodal presentation (SIP) with amodal relations, and none have used SIP procedures with arbitrary relations. It is claimed here that this last approach might be the most appropriate one for furthering our understanding of (a) the categorical and semantic processing involved in intermodal matching and (b) how the developing infant learns to process words.