Complex Communication Dynamics: Exploring the Structure of an Academic Talk

Communication is a multimodal phenomenon. The cognitive mechanisms supporting it are still understudied. We explored a natural dataset of academic lectures to determine how communication modalities are used and coordinated during the presentation of complex information. Using automated and semi‐automated techniques, we extracted and analyzed, from the videos of 30 speakers, measures capturing the dynamics of their body movement, their slide change rate, and various aspects of their speech (speech rate, articulation rate, fundamental frequency, and intensity). There were consistent but statistically subtle patterns in the use of speech rate, articulation rate, intensity, and body motion across the presentation. Principal component analysis also revealed patterns of system‐like covariation among modalities. These findings, although tentative, do suggest that the cognitive system is integrating body, slides, and speech in a coordinated manner during natural language use. Further research is needed to clarify the specific coordination patterns that occur between the different modalities.     

Parallel discrimination of subjective contours defined by offset gratings

Recent physiological studies (von der Heydt & Peterhans, 1989) suggest that the orientation of subjective contours is encoded very early in the visual system (V2 in monkey). This result is seemingly at odds with existing psychophysical data which suggest that the detection of subjective contours involves selective attention. It is argued that certain subjective contours are registered in a reflexive (bottom-up) manner by the visual system but that selective attention may be needed to gain access to this representation. To assess this suggestion, a visual-search task was used in which subjects were to detect the presence of a horizontal (vertical) subjective contour (defined by offset gratings) in a variable number of vertical (horizontal) subjective contours (also defined by offset gratings). When there were no competing organizations within the display, detection was indeed independent of the number of nontarget distractors, that is, selective attention was unnecessary. In a second experiment, we found that a curved form (a crescent defined by subjective contours) was easier to detect in a background of vertical bars (also defined by subjective contours) than vice versa, namely, a search asymmetry paralleling those found by Treisman and Gormican (1988). A final experiment showed that when the horizontal and vertical bars of the first experiment formed textured regions, they could be discriminated at very brief display durations (30–120 msec), However, when the line terminations aligned along the subjective contour were tapered rather than abrupt, discrimination dropped off with the degree of tapering. The latter result is consistent with the assumption that the registration of subjective contours in V2 involves the integration of responses from aligned, end-stopped cells found in VI (von der Heydt & Peterhans, 1989).