Eye gaze as a means of giving and seeking information during musical interaction

During skilled music ensemble performance, a multi-layered network of interaction processes allows musicians to negotiate common interpretations of ambiguously-notated music in real-time. This study investigated the conditions that encourage visual interaction during duo performance. Duos recorded performances of a new piece before and after a period of rehearsal. Mobile eye tracking and motion capture were used in combination to map uni- and bidirectional eye gaze patterns. Musicians watched each other more during temporally-unstable passages than during regularly-timed passages. They also watched each other more after rehearsal than before. Duo musicians may seek visual interaction with each other primarily, but not exclusively, when coordination is threatened by temporal instability. Visual interaction increases as musicians become familiar with the piece, suggesting that they visually monitor each other once a shared interpretation of the piece is established. Visual monitoring of co-performers’ movements and attention may facilitate feelings of engagement and high-level creative collaboration.     

Visual tracking and entrainment to an environmental rhythm

This study investigated the role that visual tracking plays in coupling rhythmic limb movements to an environmental rhythm. Two experiments were conducted in which participants swung a hand-held pendulum while tracking an oscillating stimulus or while keeping their eyes fixed on a stationary location directly above an oscillating stimulus. It was expected that the participants' rhythmic movements would become entrained to the oscillating stimulus in both conditions but that visual tracking would strengthen this entrainment. Experiment 1 investigated the role of visual tracking in establishing unintentional entrainment. Experiment 2 investigated the role of visual tracking in intentional entrainment. As predicted, participants exhibited greater unintentional coordination and more stable intentional coordination when they tracked the stimulus. These findings highlight the importance of understanding the role of eye movements in environmental coordination.     

Rocking together: dynamics of intentional and unintentional interpersonal coordination

The current study investigated the interpersonal coordination that occurred between two people when sitting side-by-side in rocking chairs. In two experiments participant pairs rocked in chairs that had the same or different natural periods. By instructing pairs to coordinate their movements inphase or antiphase, Experiment 1 investigated whether the stable patterns of intentional interpersonal coordination were consistent with the dynamics of within person interlimb coordination. By instructing the participants to rock at their own preferred tempo, Experiment 2 investigated whether the rocking chair movements of visually coupled individuals would become unintentionally coordinated. The degree to which the participants fixated on the movements of their co-actor was also manipulated to examine whether visual focus modulates the strength of interpersonal coordination. As expected, the patterns of coordination observed in both experiments demonstrated that the intentional and unintentional interpersonal coordination of rocking chair movements is constrained by the self-organizing dynamics of a coupled oscillator system. The results of the visual focus manipulations indicate that the stability of a visual interpersonal coupling is mediated by attention and the degree to which an individual is able to detect information about a co-actor's movements.     

Synchronising movements with the sounds of a virtual partner enhances partner likeability

Previous studies have demonstrated that synchronising movements with other people can influence affiliative behaviour towards them. While research has focused on synchronisation with visually observed movement, synchronisation with a partner who is heard may have similar effects. We replicate findings showing that synchronisation can influence ratings of likeability of a partner, but demonstrate that this is possible with virtual interaction, involving a video of a partner. Participants performed instructed synchrony in time to sounds instead of the observable actions of another person. Results show significantly higher ratings of likeability of a partner after moving at the same time as sounds attributed to that partner, compared with moving in between sounds. Objectively quantified synchrony also correlated with ratings of likeability. Belief that sounds were made by another person was manipulated in Experiment 2, and results demonstrate that when sounds are attributed to a computer, ratings of likeability are not affected by moving in or out of time. These findings demonstrate that interaction with sound can be experienced as social interaction in the absence of genuine interpersonal contact, which may help explain why people enjoy engaging with recorded music.     

Asynchrony in discrete bimanual aiming: Evidence for visual strategies of coordination

The bimanual coupling literature supposes an inherent drive for synchrony between the upper limbs when making discrete bimanual movements. The level of synchrony is argued to be task dependent, reliant on the visual demands of the two targets, and the result of a complex pattern of hand and eye movements (Bingham, Hughes, & Mon-Williams, 2008 ; Riek, Tresilian, Mon-Williams, Coppard, & Carson, 2003 ). However, recent work by Bruyn and Mason ( 2009 ) suggests that temporal coordination is not solely influenced by visual saccades. In this experimental series, a total of 8 participants performed congruent movements to targets either near or far from the midline. Targets far from the midline, requiring a visual saccade, resulted in greater terminal asynchrony. Initial and terminal asynchrony were not consistent, but linked to the task demands at that stage of the movement. If the asynchrony evident at the end of a bimanual movement is due to a complex pattern of hand and eye movements then the removal of visual feedback should result in an increase in synchrony. Sixteen participants then completed congruent and incongruent bimanual aiming movements to near and/or far targets. Movements were made with or without visual feedback of hands and targets. Analyses revealed that movements made without visual feedback showed increased synchrony between the limbs, yet movements to incongruent targets still showed greater asynchrony. We suggest that visual constraints are not the sole cause of asynchrony in discrete bimanual movements.     

Auditory, tactile, and multisensory cues facilitate search for dynamic visual stimuli

Presenting an auditory or tactile cue in temporal synchrony with a change in the color of a visual target can facilitate participants’ visual search performance. In the present study, we compared the magnitude of unimodal auditory, vibrotactile, and bimodal (i.e., multisensory) cuing benefits when the nonvisual cues were presented in temporal synchrony with the changing of the target’s color (Experiments 1 and 2). The target (a horizontal or vertical line segment) was presented among a number of distractors (tilted line segments) that also changed color at various times. In Experiments 3 and 4, the cues were also made spatially informative with regard to the location of the visual target. The unimodal and bimodal cues gave rise to an equivalent (significant) facilitation of participants’ visual search performance relative to a no-cue baseline condition. Making the unimodal auditory and vibrotactile cues spatially informative produced further performance improvements (on validly cued trials), as compared with cues that were spatially uninformative or otherwise spatially invalid. A final experiment was conducted in order to determine whether cue location (close to versus far from the visual display) would influence participants’ visual search performance. Auditory cues presented close to the visual search display were found to produce significantly better performance than cues presented over headphones. Taken together, these results have implications for the design of nonvisual and multisensory warning signals used in complex visual displays.     

DISSOCIATION OF SPATIAL AND TEMPORAL COUPLING IN THE BIMANUAL MOVEMENTS OF CALLOSOTOMY PATIENTS

Abstract— The neural mechanisms of limb coordination were investigated by Jesting callosotomy patients and normal control subjects on bimanual movements. Normal subjects produced deviations in the trajectories when spatial demands for the two spatial deviations, although their hands moved with normal temporal synchrony. Normal subjects but not callosotomy patients exhibited large increases in planning and execution time for movements with different spatial demands for the two hands relative to movements with identical spatial demands for the two hands. This neural dissociation indicate that spatial interference in movements results from callosal connections whereas temporal synchrony in movement onset does not rely on the corpus callosum.     

Examining the relationship between skilled music training and attention

While many aspects of cognition have been investigated in relation to skilled music training, surprisingly little work has examined the connection between music training and attentional abilities. The present study investigated the performance of skilled musicians on cognitively demanding sustained attention tasks, measuring both temporal and visual discrimination over a prolonged duration. Participants with extensive formal music training were found to have superior performance on a temporal discrimination task, but not a visual discrimination task, compared to participants with no music training. In addition, no differences were found between groups in vigilance decrement in either type of task. Although no differences were evident in vigilance per se, the results indicate that performance in an attention-demanding temporal discrimination task was superior in individuals with extensive music training. We speculate that this basic cognitive ability may contribute to advantages that musicians show in other cognitive measures.     

Meter isn't everything: The case of a timeline-oriented Cuban polyrhythm

Meter serves as a robust temporal referent for the creation and perception of musical rhythm. In music from Africa and the diaspora, a parallel referent is often present in the form of repetitive rhythmic patterns known as timelines. This paper examines how a well-known timeline (the standard pattern) serves as a grounding framework for quinto (lead conga drum) rhythms heard in different drumming performances of Afro-Cuban rumba columbia. Focusing on the layout of alignment points between the constituent elements of the various temporal layers—rhythm, timeline, and possible meters—indicates that the quinto players may be orienting their playing according to the timeline's onsets.     

Developmental changes in associations between auditory-visual events

The goal of the present study was twofold: to examine the influence of two amodal properties, co-location and temporal synchrony, on infants' associating a sight with a sound, and to determine if the relative influence of these properties on crossmodal learning changes with age. During familiarization 2-, 4-, 6- and 8-month-olds were presented two toys and a sound, with sights and sounds varying with respect to co-location and temporal synchrony. Following each familiarization phase infants were given a paired preference test to assess their learning of sight-sound associations. Measures of preferential looking revealed age-related changes in the influence of co-location and temporal synchrony on infants' learning sight-sound associations. At all ages, infants could use temporal synchrony and co-location as a basis for associating an auditory with a visual event and, in the absence of temporal synchrony, co-location was sufficient to support crossmodal learning. However, when these cues conflicted there were developmental changes in the influence of these cues on infants' learning auditory-visual associations. At 2 and 4 months infants associated the sounds with the toy that moved in synchrony with the sound's rhythm despite extreme violation of co-location of this sight and sound. In contrast, 6- and 8-month-olds did not associate a specific toy with the sound when co-location and synchrony information conflicted. The findings highlight the unique and interactive effects of distinct amodal properties on infants' learning arbitrary crossmodal relations. Possible explanations for the age shift in performance are discussed.     

Cross‐sectional study on the relationship between music training and working memory in adults

Learning to play musical instruments has been shown to enhance a wide variety of cognitive domains. The present study investigated the specific aspects of working memory (WM) that differed between adult musicians and non‐musicians. Twenty‐four musicians and 30 non‐musicians matched for age, gender, years of formal education, and verbal intelligence performed several WM tasks. A multivariate analysis of covariance, wherein family income was controlled, revealed that musicians outperformed non‐musicians in tasks related to visual–motor coordination, visual scanning ability, visual processing speed, and spatial memory. However, no significant differences were found in phonological and visual memory capacity. This study supports the view that music training is associated to specific (and not general) WM skills.     

Multi-person and multisensory synchronization during group dancing

Synchronized group dancing is one of the hallmarks of both coordination and cooperation in the humans species. While a large amount of research has focused on joint action in dyads, the mechanisms of coordination in larger groups are not well understood. In the present study, we explored the coordination dynamics of a group of folk dancers by examining the influence of three sensory-coupling channels on the stability of group coordination. Using 3D motion capture, we recorded a group of 13 expert folk dancers performing to the beat of music (auditory coupling) while holding hands in a circle (haptic coupling) and seeing their fellow dancers (visual coupling). Analyses of group synchrony using cluster phase analysis demonstrated that selective elimination of any one of the three types of sensory coupling significantly reduced group synchrony, where haptic coupling had the strongest effect on movements in the horizontal plane, but also impacted the vertical axis. This study provides some of the first evidence of how sensory couplings support multi-person coordination in a large group, and in particular the effect of body contact on this coordination.     

Joint drumming: social context facilitates synchronization in preschool children

The human capacity to synchronize body movements to an external acoustic beat enables uniquely human behaviors such as music making and dancing. By hypothesis, these first evolved in human cultures as fundamentally social activities. We therefore hypothesized that children would spontaneously synchronize their body movements to an external beat at earlier ages and with higher accuracy if the stimulus was presented in a social context. A total of 36 children in three age groups (2.5, 3.5, and 4.5 years) were invited to drum along with either a human partner, a drumming machine, or a drum sound coming from a speaker. When drumming with a social partner, children as young as 2.5 years adjusted their drumming tempo to a beat outside the range of their spontaneous motor tempo. Moreover, children of all ages synchronized their drumming with higher accuracy in the social condition. We argue that drumming together with a social partner creates a shared representation of the joint action task and/or elicits a specific human motivation to synchronize movements during joint rhythmic activity.     

Learning and discrimination of audiovisual events in human infants: the hierarchical relation between intersensory temporal synchrony and rhythmic pattern cues

This study examined 4- to 10-month-old infants' perception of audio-visual (A-V) temporal synchrony cues in the presence or absence of rhythmic pattern cues. Experiment 1 established that infants of all ages could successfully discriminate between two different audiovisual rhythmic events. Experiment 2 showed that only 10-month-old infants detected a desynchronization of the auditory and visual components of a rhythmical event. Experiment 3 showed that 4- to 8-month-old infants could detect A-V desynchronization but only when the audiovisual event was nonrhythmic. These results show that initially in development infants attend to the overall temporal structure of rhythmic audiovisual events but that later in development they become capable of perceiving the embedded intersensory temporal synchrony relations as well.     

When music tempo affects the temporal congruence between physical practice and motor imagery

When people listen to music, they hear beat and a metrical structure in the rhythm; these perceived patterns enable coordination with the music. A clear correspondence between the tempo of actual movement (e.g., walking) and that of music has been demonstrated, but whether similar coordination occurs during motor imagery is unknown. Twenty participants walked naturally for 8 m, either physically or mentally, while listening to slow and fast music, or not listening to anything at all (control condition). Executed and imagined walking times were recorded to assess the temporal congruence between physical practice (PP) and motor imagery (MI). Results showed a difference when comparing slow and fast time conditions, but each of these durations did not differ from soundless condition times, hence showing that body movement may not necessarily change in order to synchronize with music. However, the main finding revealed that the ability to achieve temporal congruence between PP and MI times was altered when listening to either slow or fast music. These data suggest that when physical movement is modulated with respect to the musical tempo, the MI efficacy of the corresponding movement may be affected by the rhythm of the music. Practical applications in sport are discussed as athletes frequently listen to music before competing while they mentally practice their movements to be performed.     

Age Changes in Interlimb Coupling and the Development of Bimanual Coordination

Changes in interlimb coupling, and their role in the development of bimanual coordination, were studied longitudinally in 6- to 12-month-old infants (N = 6). Infants were observed while they were reaching for simple objects of 2 different sizes. Their use of a uni-versus bimanual strategy for reaching as well as the coupling of their bimanual movements were compared; progress in bimanual coordination of complementary movements was evaluated on 8 different bimanual tasks. The bimanual tasks involved an asymmetrical cooperation between the 2 hands. Although spatiotemporal coupling of bimanual reaching movements did not decrease during the age period studied, infants around 7 months of age used their 2 hands infrequently for reaching. Occurrences of bimanual reaching were particularly low at the session preceding the first bimanual success at a bimanual task. This suggests that the temporal coincidence between greater independence of the 2 hands and progress in bimanual coordination of complementary movements acts in 2 directions: Infants may be more at ease when using their 2 hands in differentiated patterns as the hands move less in synchrony, but, in turn, they may be less likely to move their hands in synchrony as the anticipate mirror manipulations of the object less. The frequency of bimanual reaches increased toward the end of the 1st year. This might have been caused by an increase in the repertoire of bimanual asymmetrical object manipulations and by the fact that the development of bimanual coordination allows infants to manipulate objects with complementary movements even after a bimanual approach toward the object.     

Relations Among Preschool Children's Understanding of Visual Perspective Taking,False Belief,and Lying

This study investigated the relations among preschool children's ability to understand that other people see things differently than they do, that other people can believe things differently than the children know to be true, and that they can manipulate others' beliefs through intentional lying. Children between the ages of 3 and 5 were given tasks that tested their knowledge of Level 2 visual perspective taking, understanding of false belief, and the discriminative use of deceptive ploys. The Peabody Picture Vocabulary Test (PPVT-III) was administered as a measure of language proficiency. The children's scores on the three types of tasks were correlated with each other and with children's age, but not with scores on the PPVT-III. Most children either passed all the tasks or failed all the tasks. Regression analyses indicated that scores on visual perspective taking and false belief independently predicted each other, and scores on false belief and the discriminative use of deception independently predicted each other. The results provide evidence that advances in visual perspective taking, false belief understanding, and the discriminative use of deceptive ploys are developmentally related and occur in close synchrony.     

The rhythm of rapport: Interpersonal synchrony and social perception

The temporal coordination of behavior during dyadic interactions is a foundation for effective social exchange with synchronized actions enhancing perceptions of rapport and interpersonal connectedness. What has yet to be established, however, are the precise characteristics of behavioral coordination that give rise to such effects. Informed by a dynamical systems approach, the current investigation considered whether judgments of rapport are influenced by the mode of interpersonal synchrony. In two experiments, participants rated the degree of rapport manifest by a simulated pair of walkers exhibiting various configurations of synchronized strides. The results revealed that the highest levels of rapport were associated with the most stable forms of interpersonal coordination (i.e., in-phase and anti-phase synchrony), regardless of whether coordination between the walkers was conveyed via the presentation of visual (Expt. 1a) or auditory (Expt. 1b) cues. These findings underscore the importance of interpersonal coordination to core aspects of social perception.     

Dyadic drumming across the lifespan reveals a zone of proximal development in children

Many social interactions require the synchronization--be it automatically or intentionally--of one's own behavior with that of others. Using a dyadic drumming paradigm, the authors delineate lifespan differences in interpersonal action synchronization (IAS). Younger children, older children, younger adults, and older adults in same- and mixed-age dyads were instructed to drum in synchrony with their interaction partner at a constant, self-chosen tempo. Adult-only dyads showed the highest and children-only the lowest levels of IAS accuracy. It is important to note that children improved reliably in IAS accuracy when paired with older partners. The observed age-related differences in IAS accuracy remained reliable after statistically controlling for individual differences in the ability to synchronize to a metronome and for between-dyad differences in tempo. The authors conclude that IAS improves from middle childhood to adulthood and that adult interaction partners may facilitate its development.     

The effects of music exposure and own genre preference on conscious and unconscious cognitive processes: a pilot ERP study

Did Beethoven and Mozart have more in common with each other than Clapton and Hendrix? The current research demonstrated the widely reported Mozart Effect as only partly significant. Event-related brain potentials (ERPs) were recorded from 16 professional classical and rock musicians during a standard 2 stimulus visual oddball task, while listening to classical and rock music. During the oddball task participants were required to discriminate between an infrequent target stimulus randomly embedded in a train of repetitive background or standard stimuli. Consistent with previous research, the P3 and N2 ERPs were elicited in response to the infrequent target stimuli. Own genre preference resulted in a reduction in amplitude of the P3 for classical musicians exposed to classical music and rock musicians exposed to rock music. Notably, at the pre-attentive stage of processing (N2) beneficial effects of exposure to classical music were observed for both groups of musicians. These data are discussed in terms of short and long-term music benefits on both conscious and unconscious cognitive processes.