句子重音对汉语同音异义词的解歧作用

通过针对包含两对汉语同音异义词(“qui(4)shi(4)”(“趣事”或“去世”和“sheng(1)xue(2)”(“声学”或“升学”))的10个发音人语料的声学特征分析和知觉实验,结果发现：消除这两对同音异义词歧义的不是词重音而是句子重音。这个研究结果说明：汉语中句子重音能够通过选择强调同音异义词的某个音节来消除它们的歧义。     

国外关于韵律特征和重音的一些研究

该文对韵律特征（包括其中的重音）这一研究领域近年的一些主要研究成果进行了一个小结。小结分两部分：（１）韵律特征及其作用;（２）关于重音的研究。文章对后者进行较详细的讨论,这个讨论分为重音的声学参数、重音的作用以及重音和其它韵律特征变量相互作用三个部分。     

Infants’ behaviours elicit different verbal,nonverbal, and multimodal responses from caregivers during early play

Caregivers use a range of verbal and nonverbal behaviours when responding to their infants. Previous studies have typically focused on the role of the caregiver in providing verbal responses, while communication is inherently multimodal (involving audio and visual information) and bidirectional (exchange of information between infant and caregiver). In this paper, we present a comprehensive study of caregivers’ verbal, nonverbal, and multimodal responses to 10-month-old infants’ vocalisations and gestures during free play. A new coding scheme was used to annotate 2036 infant vocalisations and gestures of which 87.1 % received a caregiver response. Most caregiver responses were verbal, but 39.7 % of all responses were multimodal. We also examined whether different infant behaviours elicited different responses from caregivers. Infant bimodal (i.e., vocal-gestural combination) behaviours elicited high rates of verbal responses and high rates of multimodal responses, while infant gestures elicited high rates of nonverbal responses. We also found that the types of verbal and nonverbal responses differed as a function of infant behaviour. The results indicate that infants influence the rates and types of responses they receive from caregivers. When examining caregiver-child interactions, analysing caregivers’ verbal responses alone undermines the multimodal richness and bidirectionality of early communication.     

普通话韵律词重音知觉

实验一研究了韵律词重音的多个声学相关物,及其对韵律词重音知觉贡献的大小,结果表明,按照贡献大小的次序,影响普通话韵律词重音感知的声学参数是：时长、音高、频谱倾斜和平均能量。实验二研究非声学参数因素对普通话韵律词重音知觉的影响,实验结果表明,听者关于普通话韵律词重音方面的语言学知识对韵律词重音的知觉有显著影响。     

Beyond Dyadic Coordination: Multimodal Behavioral Irregularity in Triads Predicts Facets of Collaborative Problem Solving

We hypothesize that effective collaboration is facilitated when individuals and environmental components form a synergy where they work together and regulate one another to produce stable patterns of behavior, or regularity, as well as adaptively reorganize to form new behaviors, or irregularity. We tested this hypothesis in a study with 32 triads who collaboratively solved a challenging visual computer programming task for 20 min following an introductory warm‐up phase. Multidimensional recurrence quantification analysis was used to examine fine‐grained (i.e., every 10 s) collective patterns of regularity across team members' speech rate, body movement, and team interaction with the shared user interface. We found that teams exhibited significant patterns of regularity as compared to shuffled baselines, but there were no systematic trends in regularity across time. We also found that periods of regularity were associated with a reduction in overall behavior. Notably, the production of irregular behavior predicted expert‐coded metrics of collaborative activity, such as teams' ability to construct shared knowledge and effectively negotiate and coordinate execution of solutions, net of overall behavioral production and behavioral self‐similarity. Our findings support the theory that groups can interact to form interpersonal synergies and indicate that information about system‐level dynamics is a viable way to understand and predict effective collaborative processes.     

Language development at 18 months is related to multimodal communicative strategies at 12 months

The present study investigated the degree to which an infants’ use of simultaneous gesture–speech combinations during controlled social interactions predicts later language development. Nineteen infants participated in a declarative pointing task involving three different social conditions: two experimental conditions (a) available, when the adult was visually attending to the infant but did not attend to the object of reference jointly with the child, and (b) unavailable, when the adult was not visually attending to neither the infant nor the object; and (c) a baseline condition, when the adult jointly engaged with the infant's object of reference. At 12 months of age measures related to infants’ speech-only productions, pointing-only gestures, and simultaneous pointing–speech combinations were obtained in each of the three social conditions. Each child's lexical and grammatical output was assessed at 18 months of age through parental report. Results revealed a significant interaction between social condition and type of communicative production. Specifically, only simultaneous pointing–speech combinations increased in frequency during the available condition compared to baseline, while no differences were found for speech-only and pointing-only productions. Moreover, simultaneous pointing–speech combinations in the available condition at 12 months positively correlated with lexical and grammatical development at 18 months of age. The ability to selectively use this multimodal communicative strategy to engage the adult in joint attention by drawing his attention toward an unseen event or object reveals 12-month-olds’ clear understanding of referential cues that are relevant for language development. This strategy to successfully initiate and maintain joint attention is related to language development as it increases learning opportunities from social interactions.     

Impact of interface design on drivers’ behavior in partially automated cars: An on-road study

In partially automated vehicles, the driver and the automated system share control of the vehicle. Consequently, the driver may have to switch between driving and monitoring activities. This can critically impact the driver’s situational awareness. The human–machine interface (HMI) is responsible for efficient collaboration between driver and system. It must keep the driver informed about the status and capabilities of the automated system, so that he or she knows who or what is in charge of the driving. The present study was designed to compare the ability of two HMIs with different information displays to inform the driver about the system’s status and capabilities: a driving-centered HMI that displayed information in a multimodal way, with an exocentric representation of the road scene, and a vehicle-centered HMI that displayed information in a more traditional visual way. The impact of these HMIs on drivers was compared in an on-road study. Drivers’ eye movements and response times for questions asked while driving were measured. Their verbalizations during the test were also transcribed and coded. Results revealed shorter response times for questions on speed with the exocentric and multimodal HMI. The duration and number of fixations on the speedometer were also greater with the driving-centered HMI. The exocentric and multimodal HMI helped drivers understand the functioning of the system, but was more visually distracting than the traditional HMI. Both HMIs caused mode confusions. The use of a multimodal HMI can be beneficial and should be prioritized by designers. The use of auditory feedback to provide information about the level of automation needs to be explored in longitudinal studies.     

The role of redundant verbal labels in 8- and 10-month-olds’ working memory

Verbal labels have been shown to help preverbal infants’ performance on various cognitive tasks, such as categorization. Redundant labels also aid adults’ visual working memory (WM), but it is not known if this linguistic benefit extends to preverbal infants’ WM. In two eye-tracking studies, we tested whether 8- and 10-month-old infants’ WM performance would improve with the presence of redundant labels in a Delayed Match Retrieval (DMR) paradigm that tested infants’ WM for object-location bindings. Findings demonstrated that infants at both ages were unable to remember two object-location bindings when co-presented with labels at encoding. Moreover, infants who encoded the object-location bindings with labels were not significantly better than those who did so in silence. These findings are discussed in the context of label advantages in cognition and auditory dominance.     

A Slippery Myth: How Learning Style Beliefs Shape Reasoning about Multimodal Instruction and Related Scientific Evidence

The learning style myth is a commonly held myth that matching instruction to a student's “learning style” will result in improved learning, while providing mismatched instruction will result in suboptimal learning. The present study used a short online reasoning exercise about the efficacy of multimodal instruction to investigate the nature of learning styles beliefs. We aimed to: understand how learning style beliefs interact with beliefs about multimodal learning; characterize the potential complexity of learning style beliefs and understand how this short exercise might influence endorsements of learning styles. Many participants who believed in the learning style myth supported the efficacy of multimodal learning, and many were willing to revise their belief in the myth after the exercise. Personal experiences and worldviews were commonly cited as reasons for maintaining beliefs in learning styles. Findings reveal the complexity of learning style beliefs, and how they interact with evidence in previously undocumented ways.     

Evaluation of two short-term stress interventions in the context of mobility

ObjectivesIn our lives we experience different types of stress that emanate from a variety of situations. This stress can potentially spill over into unrelated situations, including the operation of a vehicle in a safe manner. It is not well known which types of countermeasures can actually mitigate such stress during driving. For this purpose, one needs valid stress intervention methods for the different types of stress that commonly occur during driving. In this study, it was therefore evaluated whether or not two stress interventions were effective in reducing stress. These two stress interventions were Positive Psychology–i.e., being an activity to reflect about thankful moments–and Biofeedback–i.e., being an activity aimed at continued relaxation based on the display of the participants own stress level.MethodsA study with 41 (n = 21 male) participants was conducted in a stationary vehicle to evaluate the effectiveness of Positive Psychology and Biofeedback on stress reduction. Stress was induced using the Stroop Task. During a Stroop Task high stress is caused by naming color words displayed in another, incongruent color. In the Baseline Condition, participants looked at neutral images, which were expected to have no effect on stress levels. These conditions were then compared.FindingsThe results revealed that participant stress levels were significantly higher during each stress induction period in comparison to each stress intervention period. This indicated that a reduction of stress is possible by administering stress interventions in a stationary setting. Yet, there was no difference between Positive Psychology, Biofeedback, and the Baseline Condition, supposedly due to the short administration, stress-reducing attributes of the Baseline Condition itself, or regression to the mean effects.NoveltyThe overall goal of this research is the development of stress interventions to target different types of stress that can occur in the context of mobility, an application context not yet investigated. These interventions are expected to improve well-being and safety inside the vehicle by improving concentration, attention, and psychomotor control, which can be reduced by high stress. The study took a first step to achieve this goal by developing and evaluating Positive Psychology and Biofeedback as stress intervention activities to mitigate stress in a stationary vehicle–a situation comparable to automated driving. The developed interventions showed stress-reducing effects in the stationary setting whereas looking at neutral pictures–although serving as the baseline–was similarly stress-reducing. This enables the next step–adding the task of manual driving to the interventions to look into both the effectiveness of the interventions during manual driving and driving safety at the same time.