Modelling audiovisual integration of affect from videos and music

Two experiments examined how affective values from visual and auditory modalities are integrated. Experiment 1 paired music and videos drawn from three levels of valence while holding arousal constant. Experiment 2 included a parallel combination of three levels of arousal while holding valence constant. In each experiment, participants rated their affective states after unimodal and multimodal presentations. Experiment 1 revealed a congruency effect in which stimulus combinations of the same extreme valence resulted in more extreme state ratings than component stimuli presented in isolation. An interaction between music and video valence reflected the greater influence of negative affect. Video valence was found to have a significantly greater effect on combined ratings than music valence. The pattern of data was explained by a five parameter differential weight averaging model that attributed greater weight to the visual modality and increased weight with decreasing values of valence. Experiment 2 revealed a congruency effect only for high arousal combinations and no interaction effects. This pattern was explained by a three parameter constant weight averaging model with greater weight for the auditory modality and a very low arousal value for the initial state. These results demonstrate key differences in audiovisual integration between valence and arousal.     

Fostering learning from instructional video in a second language

This study investigated the most effective way to present an instructional video that contains words in the students' second language. Korean‐speaking university students received a 16‐min video lesson on Antarctica that included English narration (video + narration group), English text subtitles (video + text group), or English narration with simultaneous text subtitles (video + narration + text group). On a comprehension test, the video + text group scored higher than each of the other two groups, in contrast to the modality effect; and the video + narration + text group outscored the video + narration group, in contrast to the redundancy effect. Each of the lessons that included text was rated as less difficult than the lesson with narration only. The narration + text group reported lower effort than each of the other groups. Results highlight boundary conditions for two principles of multimedia instructional design that apply for college students who are learning in a second language. Theoretical implications are discussed.     

Cross-modality translations improve recognition by reducing false alarms

Conway and Gathercole [(1990). Writing and long-term memory: Evidence for a “translation” hypothesis. The Quarterly Journal of Experimental Psychology, 42, 513–527] proposed a translation account to explain why certain types of encoding produce benefits in memory: Switching modalities from what is presented to what is encoded enhances item distinctiveness. We investigated this hypothesis in a recognition experiment in which the presentation modality of a study list (visual vs. auditory) and the encoding activity (speaking vs. typing vs. passive encoding) were manipulated between-subjects. Manipulating encoding activity between-subjects ruled out any potential influence of the relationally distinct processing that can occur in a within-subject manipulation (in which all previous translation effects have been demonstrated). We found no overall difference in memory for words presented auditorily vs. visually nor for visual vs. auditory encoding, but critically presentation modality and encoding activity did interact. Translating from one modality to another – particularly from auditory presentation to visual encoding (typing) – led to the best memory discrimination. This was largely because of reduced false alarms, not increased hits, consistent with the distinctiveness heuristic.     

Measuring the flashbulb-like nature of memories for private events: the flashbulb memory checklist

What do we remember following an emotionally charged event? The assessment of memory characteristics for an emotional event represents one of the most challenging issues in the domain of autobiographical memory. Literature of flashbulb memories (FBMs) provides a crucial contribution on this issue: Following an emotional and unexpected public event, people remember not only central details of the episode, but also irrelevant, peripheral and idiosyncratic details of the reception context in which they learned of the news. The present study was set up to assess the factorial structure (samples 1 and 2) and convergent validity (sample 2) of an FBM checklist, an instrument designed to measure Flashbulb-like features of memories for emotional private events. Factorial analyses account for an oblique two-factor solution – FBM Specificity and Confidence – while correlational analyses support the convergent validity of this instrument. Practical implications are discussed, especially for the credibility assessment of witnesses of emotional events in forensic settings.     

A matter of focus: Detailed memory in the intentional autobiographical recall of older and younger adults

The intricately interwoven role of detailed autobiographical memory in our daily lives and in our imaginative envisioning of the future is increasingly recognized. But how is the detail-rich nature of autobiographical memory best assessed and, in particular, how can possible aging-related differences in autobiographical memory specificity be most effectively evaluated? This study examined whether a modified interview, involving fewer and time-matched events for older and younger adults, yielded age-related outcomes similar to those that have been previously reported. As in earlier studies, modest age-related changes in the specificity of autobiographical recall were observed, yet the largest most robust effect for both age groups was the substantial proportion of specific details retrieved. Both age groups rated recent memories as significantly less important and as less emotional than more temporally distant events. Our findings counter conceptions of older adults’ autobiographical memories as invariably less episodically rich than those of younger adults.     

Diversity and unity of modularity

Since the publication of Fodor's (1983) The Modularity of Mind, there have been quite a few discussions of cognitive modularity among cognitive scientists. Generally, in those discussions, modularity means a property of specialized cognitive processes or a domain-specific body of information. In actuality, scholars understand modularity in many different ways. Different characterizations of modularity and modules were proposed and discussed, but they created misunderstanding and confusion. In this article, I classified and analyzed different approaches to modularity and argued for the unity of modularity. Modularity is a multidimensional property consisting of features from several dimensions specifying different aspects of cognition. Among those, there are core features of modularity, and these core features form a cross-dimensional unity. Despite the diverse and liberal characterizations, modularity contributes to cognitive science because of the unity of the core features.     

Collaboration Talk: The Folk Theories of Nano Research

The nano initiative in the US and elsewhere encourages and promotes various forms of multi-stakeholder activities, such as industrial collaborations. Forming part of the discourse of expectations around emerging technologies, collaboration is an important resource holding together different practices of knowledge production. In the conversations between policy and science, collaboration becomes a measurable entity and a measure in itself, figuring in the evaluations of the performance of individual faculty and research centres; however, the policy metaphor of ‘collaboration’ stands for a variety of different forms and shapes of interactions between university and industry. From a discourse analysis perspective, ‘folk theories’ of nano collaboration help to explore the dynamics of the university/industry boundary in the scientific organisational discourse as in a recent series of interactions with scientists, university officials and technology transfer officers in a number of US universities. What does the introduction of the new entity (nano) mean for scientists, and for university practices of technology transfer and commercialisation, in terms of trying to accommodate individual ‘nano’ cases into university regulations and procedures? How are these practices and experiences discussed in terms of collaboration? Assessments of value of collaboration ranged between polarised views, raising questions about occasions, audiences and communities of assessors invoked in the construction of acceptable accounts of nano collaboration. Metaphors and analogies were used to mobilise specific meanings in the discourses of the innovative potential of emerging fields. As such, assessments of the potential of terms pertinent to the emerging discourses, such as collaboration, would be better based on the assumption of shared meanings, not fixed and given, but actively achieved.     

Social support from friends predicts changes in memory specificity following a stressful life event

ABSTRACT

Exposure to negative life stress has been associated with difficulty retrieving memories for specific autobiographical events, with important consequences for the emergence of emotional disorders. We examined whether social support can protect against the effects of negative events on memory specificity. University students (N?=?143) were assigned to groups based on whether or not they experienced a negative stressor, operationalised as whether or not their recent exam performance was in line with their expectations. After receiving their exam results (T1), and one month later (T2), participants completed measures of memory specificity, their attitudes towards themselves and the occurrence of other stress-related events. Participants also completed a general measure of perceived social support from friends, family, and significant others, and an equivalent measure for social support related to performance. For participants who experienced an exam-related stressor, reduced performance-specific social support from friends was associated with reduced memory specificity at T2, even when accounting for T1 memory specificity, individual differences in attitudes towards self, the experience of additional stressors, and gender. No such relation was present for participants who did not experience a stressor. These findings provide new understanding of the influence of social variables on autobiographical memory specificity.     

Examining the long-term stability of overgeneral autobiographical memory

Overgeneral autobiographical memory (OGM) is a proposed trait-marker for vulnerability to depression, but relatively little work has examined its long-term stability. This study investigated the stability of OGM over several years in 271 late adolescents and young adults participating in a larger longitudinal study of risk for emotional disorders. The Autobiographical Memory Test (AMT) was administered twice, with test–retest intervals ranging from approximately 3 to 6 years. There was evidence of significant but modest stability in OGM over several years. Specifically, Spearman rank correlations (ρs) between the proportions of specific and categoric memories generated on the two AMTs were .31 and .32, respectively. We did not find evidence that the stability of OGM was moderated by the length of the test–retest interval. Furthermore, the stability coefficients for OGM for individuals with and without a lifetime history of major depressive disorder (MDD) were relatively similar in magnitude and not significantly different from one another (ρs=.34 and .42 for the proportions of specific and categoric memories for those with a history of MDD; ρs=.31 for both the proportions of specific and categoric memories for those without a history of MDD). Implications for the conceptualisation of OGM are discussed.