The dynamics of multimodal integration: The averaging diffusion model

We combine extant theories of evidence accumulation and multi-modal integration to develop an integrated framework for modeling multimodal integration as a process that unfolds in real time. Many studies have formulated sensory processing as a dynamic process where noisy samples of evidence are accumulated until a decision is made. However, these studies are often limited to a single sensory modality. Studies of multimodal stimulus integration have focused on how best to combine different sources of information to elicit a judgment. These studies are often limited to a single time point, typically after the integration process has occurred. We address these limitations by combining the two approaches. Experimentally, we present data that allow us to study the time course of evidence accumulation within each of the visual and auditory domains as well as in a bimodal condition. Theoretically, we develop a new Averaging Diffusion Model in which the decision variable is the mean rather than the sum of evidence samples and use it as a base for comparing three alternative models of multimodal integration, allowing us to assess the optimality of this integration. The outcome reveals rich individual differences in multimodal integration: while some subjects’ data are consistent with adaptive optimal integration, reweighting sources of evidence as their relative reliability changes during evidence integration, others exhibit patterns inconsistent with optimality.     

Enacting musical emotions. sense-making,dynamic systems,and the embodied mind

The subject of musical emotions has emerged only recently as a major area of research. While much work in this area offers fascinating insights to musicological research, assumptions about the nature of emotional experience seem to remain committed to appraisal, representations, and a rule-based or information-processing model of cognition. Over the past three decades alternative ‘embodied’ and ‘enactive’ models of mind have challenged this approach by emphasising the self-organising aspects of cognition, often describing it as an ongoing process of dynamic interactivity between an organism and its environment. More recently, this perspective has been applied to the study of emotion in general, opening up interesting new possibilities for theory and research. This new approach, however, has received rather limited attention in musical contexts. With this in mind, we critically review the history of music and emotion studies, arguing that many existing theories offer only limited views of what musical-emotional experience entails. We then attempt to provide preliminary grounding for an alternative perspective on music and emotion based on the enactive/dynamic systems approach to the study of mind.     

When does between-sequence phonological similarity promote irrelevant sound disruption?

Typically, the phonological similarity between to-be-recalled items and TBI auditory stimuli has no impact if recall in serial order is required. However, in the present study, the authors have shown that the free recall, but not serial recall, of lists of phonologically related to-be-remembered items was disrupted by an irrelevant sound stream (end rhymes) sharing similar phonological content. These findings can be explained by the notion that between-sequence phonological similarity effects emerge when category-cueing processes become an important determinant for recall, such as when shared category information can be used as a retrieval aid to cue list items or plausible list candidates. In this case, the presence of categorically similar irrelevant items impairs the retrieval of list items and leads to intrusion error. Implications of these results for theories of auditory distraction are discussed.     

Interference by process, not content, determines semantic auditory distraction

Distraction by irrelevant background sound of visually-based cognitive tasks illustrates the vulnerability of attentional selectivity across modalities. Four experiments centred on auditory distraction during tests of memory for visually-presented semantic information. Meaningful irrelevant speech disrupted the free recall of semantic category-exemplars more than meaningless irrelevant sound (Experiment 1). This effect was exacerbated when the irrelevant speech was semantically related to the to-be-remembered material (Experiment 2). Importantly, however, these effects of meaningfulness and semantic relatedness were shown to arise only when instructions emphasized recall by category rather than by serial order (Experiments 3 and 4). The results favor a process-oriented, rather than a structural, approach to the breakdown of attentional selectivity and forgetting: performance is impaired by the similarity of process brought to bear on the relevant and irrelevant material, not the similarity in item content.     

Preparing for Year 12 examinations: Predictors of psychological distress and sleep

This study examined the influence of protective factors on psychological distress and sleep among Year 12 students 1 month prior to their externally assessed examinations. The sample included 195 Year 12 students who were to sit for at least one examination. Students completed the Adolescent Resilience Questionnaire, a measure of subjective stress, the Depression Anxiety and Stress Scales – 21, and measures of sleep. A sizeable minority of students reported high levels of subjective stress, severe symptoms of depression, anxiety and stress, and very inadequate sleep. Freedom from negative cognitions was the factor most strongly associated with protection from psychological distress. None of the factors protected against inadequate sleep. Results showed few gender differences. The findings validate popular concern about the wellbeing of Year 12 students. They also confirm that protective factors do not provide equal protection for all individuals against all adverse outcomes.     

What causes auditory distraction?

The role of separating task-relevant from task-irrelevant aspects of the environment is typically assigned to the executive functioning of working memory. However, pervasive aspects of auditory distraction have been shown to be unrelated to working memory capacity in a range of studies of individual differences. We measured individual differences in global pattern matching and deliberate recoding of auditory sequences, and showed that, although deliberate processing was related to short-term memory performance, it did not predict the extent to which that performance was disrupted by task-irrelevant sound. Individual differences in global sequence processing were, however, positively related to the degree to which auditory distraction occurred. We argue that much auditory distraction, rather than being a negative function of working memory capacity, is in fact a positive function of the acuity of obligatory auditory processing.     

Commentary on Baddeley and Larsen (2007). The phonological store abandoned

Baddeley and Larsen (2007) argue that a number of key findings reported by Jones, Macken, and Nicholls (2004) and Jones, Hughes, and Macken (2006) pointing to shortcomings of the phonological store construct arise from the store being abandoned with long lists. In our rejoinder we point out that Baddeley and Larsen use a procedure in which retrieval from the supposed phonological storage would not--according to their own theory--have been possible, and we present theoretical, empirical, and logical problems with their "store abandonment" argument and highlight a number of difficulties associated with the interpretation of suffix and prefix effects. We conclude that our data are still problematic for the phonological store construct and suggest that a reformulation of short-term memory theory needs to embody (or indeed focus exclusively upon) perceptual and effector systems rather than bespoke storage modules.     

Misremembering colostomies? Former patients give lower utility ratings than do current patients.

Community members often evaluate health conditions more negatively than do the patients who have them. The authors investigated whether experience with a health condition reduces this discrepancy by surveying colostomy patients by mail (n = 195), some of whom (n = 100) had their colostomies reversed and normal bowel function restored. The authors also surveyed a community sample recruited via the Internet (n = 567). They then compared all 3 groups' utility value for life with a colostomy by using the time trade-off utility measure and by examining ratings of current quality of life. Despite having direct experience with the health condition, former colostomy patients provided much lower utility valuations than did current patients. In fact, their valuations were similar to those given by a community sample. Rather than accurately remembering their actual experiences with colostomies, the former patients may have applied a theory of how colostomies had influenced their lives; this is consistent with other research on theory driven recall bias.