A grouping interpretation of the modality effect in immediate probed recognition

In a series of experiments on immediate probed recognition for eight 3-digit numbers, it was shown that if the target modality involved auditory components and the effect of the similarity of the modality of the probe to that of the targets was controlled, unequivocal evidence was obtained for an auditory superiority effect (modality effect) for hit rates for the final items of the list. Moreover, false-alarm rates were significantly lower following targets with an auditory component than they were following silently seen targets. It is argued that this pattern of hits and false alarms is consistent with the idea that targets that have an auditory component yield memory representations that are better grouped as units than are those for targets that are only silently seen; in particular, if a new probe has a first digit that accidentally matches the first digit of a target item, it is more likely that the subject will mistakenly identify this new probe as old (give a false alarm) if the target has only been partially encoded because it was only silently seen.     

关于克里普克模态性的一个自然主义解释

The Kripkean metaphysical modality (i.e. possibility and necessity) is one of the most important concepts in contemporary analytic philosophy and is the basis of many metaphysical speculations. These metaphysical speculations frequently commit to entities that do not belong to this physical universe, such as merely possible entities, abstract entities, mental entities or qualities not realizable by the physical, which seems to contradict naturalism or physicalism. This paper proposes a naturalistic interpretation of the Kripkean modality, as a naturalist’s response to these metaphysical speculations. It will show that naturalism can accommodate the Kripkean metaphysical modality. In particular, it will show that naturalism can help to resolve the puzzles surrounding Kripke’s a posteriori necessary propositions and a priori contingent propositions. __________ Translated from Zhexue yanjiu 哲学研究 (Philosophical Researches), 2008, (1): 18–26     

A categorically postcategorical interpretation of the modality effect: a reply to Nilsson.

Watkins found the modality effect undiminished when four-syllable rather than one-syllable words were used, and concluded that the effect has a post-categorical origin. Nilsson replicated this result, and also found that with entirely unfamiliar words the effect was greater with one-syllable words than with four-syllable words. Nilsson considered his findings to be in support of a precategorical origin of the effect. This reply argues that, to the contrary, Nilsson's findings are not only consistent with a postcategorical interpretation, but also inconsistent with a precategorical interpretation.     

A spatial modality effect in serial memory

In 2 experiments, the authors tested whether the classical modality effect-that is, the stronger recency effect for auditory items relative to visual items-can be extended to the spatial domain. An order reconstruction task was undertaken with four types of material: visual-spatial, auditory-spatial, visual-verbal, and auditory-verbal. Similar serial position curves were obtained regardless of the nature of the to-be-remembered sequences, with the exception that a modality effect was found with spatial as well as with verbal materials. The results are discussed with regard to a number of models of short-term memory.     

A modality congruency effect in verbal false memory

The involvement of working memory sub-systems in syllogistic reasoning problems was assessed by dual task methods. Effects of skill level and training on working memory involvement in syllogistic reasoning were examined. In Study 1, participants were pre-selected into groups of High and Low skill at syllogistic reasoning on the basis of a pencil-and-paper screening test. Six separate High and Low skill groups completed syllogistic reasoning tasks in control conditions and each group was also tested under one of the following six dual task conditions: articulatory suppression, unattended speech, verbal random generation, spatial random generation, tapping in a simple pattern, unattended pictures. The results indicated that the more skilled participants were generally following a high demand strategy, which loaded the central executive, phonological loop and imagery sub-systems, but that lower skill participants were generally following a less demanding strategy which did not load working memory components so heavily. In two Pilot Studies a training procedure was assessed and validated. In Study 2, participants were selected, on the basis of a screening test, as being unskilled at solving syllogisms but as performing above guessing level. These participants underwent the training regime validated in the Pilot Studies. Following training, separate groups of participants carried out syllogistic tests with and without one of the following four secondary tasks: articulatory suppression, unattended pictures, spatial random generation, and verbal random generation. The pattern of results indicated that training had induced high demand strategies (often logic-equivalent), which loaded the central executive and to a lesser extent the phonological loop.     

Sensory modality and the word-frequency effect

Two experiments were conducted to examine whether the word-frequency effect in recognition memory is primarily a modality-dependent phenomenon. In the first experiment, the presentation modality of a target word was varied orthogonally during the input of the test phases. In the second, the subjects were forced to process each input word at the letter-byo letter level, thus minimizing the orthographical differences between the high- and low-frequency words. The word-frequency effect was found in every experimental condition and should be considered a modality-independent phenomenon. A semantically based interpretation of this effect was proposed.     

A three-component analysis of the modality effect in single-trial free recall

Johann-Wolfgang-Goethe Unversität, Frankfurt am Main, West-Germany In single-trial free recall a superiority of acoustical over visual presentation has been observed in the recency part of the serial position curve. The rehearsal-buffer model by Atkinson and Shiffrin (1968) was modified to distinguish between three different explanations that are discussed in the literature. The application of the model allowed some of the parameters to vary across modes of presentation while other parameters were held constant. A model assuming either a precategorical acoustical storage or additional processing for visually presented items gives a better account of the results than does a model derived from a two-store hypothesis.     

Inverting the modality effect in serial recall

Differences in recall ability between immediate serial recall of auditorily and visually presented verbal material have traditionally been considered restricted to the end of to-be-recalled lists, the recency section of the serial position curve (e.g., Crowder & Morton, 1969). Later studies showed that--under certain circumstances--differences in recall between the two modalities can be observed across the whole of the list (Frankish, 1985). However in all these studies the advantage observed is for recall of material presented in the auditorily modality. Six separate conditions across four experiments demonstrate that a visual advantage can be obtained with serial recall if participants are required to recall the list in two distinct sections using serial recall. Judged on a list-wide basis, the visual advantage is of equivalent size to the auditory advantage of the classical modality effect. The results demonstrate that differences in representation of auditory and visual verbal material in short-term memory persist beyond lexical and phonological categorization and are problematic for current theories of the modality effect.     

The modality effect and articulation

The two experiments reported in this paper investigate the influences of irrelevant articulation on the modality effect in serial recall. Subjects performed a post-list distractor task, which involved generating a well-learned alphabetic sequence for five seconds. The modality effect was impaired when subjects vocalized the letters aloud, but was unaffected by whether the sequence was silently mouthed or silently written. These results show that the modality effect does not arise from the contribution of an articulatory code to recall of the most recent auditory items. They also question the functional equivalence of recency effects for auditory, mouthed and lipread stimuli. On the basis of these and other findings, a multi-component approach to recency effects is proposed.     

A functional theory of the McCollough effect

Pattern-contingent color aftereffects, or McCollough effects (MEs), are used to probe the visual brain's operations psychophysically. Their neural substrate is unknown, however, and theories about them are weak. Our theory proposes a strong functional role for MEs and a neuropsychological basis that accounts for "top-down" (global) constraints ignored by other theories. The functional aspect of the theory is based on the concept of contingent adaptation level, following Helson (1964), and on the "error-correcting device" of Andrews (1964), which tracks and adjusts internal representation to external-world contingencies. The neuropsychological part of the theory postulates that global properties are the result of MEs being generated not at the individual detector level but in vectorfields of which the detectors are elements. It is an implementation of Lie transformation group theory (Hoffman, 1966). Evidence for this model is assessed.     

Auditory and temporal factors in the modality effect

Subjects in five experiments read nine-digit memory lists from a cathode ray tube for immediate recall. Reading aloud always produced a localized and reliable advantage for the last item, compared to reading silently. Two experiments on whispered and mouthed lists, with or without simultaneous broadband noise, falsified expectations derived from the theory of precategorical acoustic storage. Three additional experiments showed no enhancement of recency in the silent conditions when the digits were drawn or spelled gradually on the screen, a result that is inconsistent with the changing-state hypothesis. The classic auditory-visual modality effect is large and reliable, but still poorly understood.     

Recency and the modality effect in immediate ordered recall

In immediate ordered recall, recency is the improved recall of the last item of a presentation, and the modality effect is the advantage for an acoustic presentation over a subvocalized visual presentation, primarily occurring at the last serial position. Experiment 1 tested grouped presentations. There was a modality effect for the first item of the last group, even though that item was at the third-to-last or fourth-to-last serial position. In Experiment 2, for vocalized presentations of syllables ending in a, recency was larger for staccato speech than legato speech; for subvocalized presentations, there was a substantial recency for the legato style. In Experiment 3, recency was larger for a set of syllables ending in ATE than for a set of syllables ending in AME. These results suggest that recency cannot be explained by the existence of a fixed-capacity store, auxiliary to the auditory short-term store, that retains only some types of presentations. It is suggested instead that recency might reflect an auxiliary method of using the information in the auditory short-term store.     

The modality effect of ego depletion: Auditory task modality reduces ego depletion

An initial act of self‐control that impairs subsequent acts of self‐control is called ego depletion. The ego depletion phenomenon has been observed consistently. The modality effect refers to the effect of the presentation modality on the processing of stimuli. The modality effect was also robustly found in a large body of research. However, no study to date has examined the modality effects of ego depletion. This issue was addressed in the current study. In Experiment 1, after all participants completed a handgrip task, one group's participants completed a visual attention regulation task and the other group's participants completed an auditory attention regulation task, and then all participants again completed a handgrip task. The ego depletion phenomenon was observed in both the visual and the auditory attention regulation task. Moreover, participants who completed the visual task performed worse on the handgrip task than participants who completed the auditory task, which indicated that there was high ego depletion in the visual task condition. In Experiment 2, participants completed an initial task that either did or did not deplete self‐control resources, and then they completed a second visual or auditory attention control task. The results indicated that depleted participants performed better on the auditory attention control task than the visual attention control task. These findings suggest that altering task modality may reduce ego depletion.     

The perceptual basis of the modality effect in multimedia learning

Various studies have demonstrated an advantage of auditory over visual text modality when learning with texts and pictures. To explain this modality effect, two complementary assumptions are proposed by cognitive theories of multimedia learning: first, the visuospatial load hypothesis, which explains the modality effect in terms of visuospatial working memory overload in the visual text condition; and second, the temporal contiguity assumption, according to which the modality effect occurs because solely auditory texts and pictures can be attended to simultaneously. The latter explanation applies only to simultaneous presentation, the former to both simultaneous and sequential presentation. This paper introduces a third explanation, according to which parts of the modality effect are due to early, sensory processes. This account predicts that-for texts longer than one sentence-the modality effect with sequential presentation is restricted to the information presented most recently. Two multimedia experiments tested the influence of text modality across three different conditions: simultaneous presentation of texts and pictures versus sequential presentation versus presentation of text only. Text comprehension and picture recognition served as dependent variables. An advantage for auditory texts was restricted to the most recent text information and occurred under all presentation conditions. With picture recognition, the modality effect was restricted to the simultaneous condition. These findings clearly support the idea that the modality effect can be attributed to early processes in perception and sensory memory rather than to a working memory bottleneck.     

The effect of study modality on false recognition

A number of previous studies have shown that false recognition of critical items in the Deese/Roediger-McDermott paradigm is reduced when study items are presented visually rather than auditorily; however, this effect has not been uniformly demonstrated. We investigated three potential boundary conditions of the effect of study modality in false recognition. Experiments 1 and 2 showed no reduction in false recognition following visual study presentation when the yes-no recognition test was not preceded by a recall test. Experiment 3 showed that visual study presentation can reduce false recognition without a preceding recall test, if the recognition test uses remember-know instructions. The order of the recognition test items did not influence the effect of visual study presentation on false recognition in Experiment 1. In general, the data imply that distinctive processing at study can reduce false memory in recognition if the test demands draw attention to the dimension of distinctive processing.     

A dual task response modality effect: Support for multiprocessor models of attention

In Experiment I two groups of 11 men performed a continuous visual input/manual output task simultaneously with a two-choice tone identification task. One group responded vocally to the tones; one group responded with the hand not involved in the continuous tracking task. In either perceptual or stimulus uncertainty terms the two combinations were identical; the only difference between them was the modality of the two-choice responses. The continuous task was performed significantly worse when the two-choice responses were manual. The probability of response production on the continuous task was affected by the production of manual responses but not by the production of vocal responses. It was concluded that although the two manual responses were produced by a single limited capacity process, the manual and vocal responses were produced by independent processes. In Experiment II the same manual tracking task was combined with a mental arithmetic task at two levels of difficulty. Tracking performance was independent of the difficulty of the arithmetic task. These results support a multi-processor approach to attention as opposed to single channel models. Results of dual task studies which have used only one pair of response modalities are re-examined in the light of the response modality effect found in Experiment I.     

A theory-based epistemology of modality

We have some justified beliefs about modal matters. A modal epistemology should explain what’s involved in our having that justification. Given that we’re realists about modality, how should we expect that explanation to go? In the first part of this essay, I suggest an answer to this question based on an analogy with games. Then, I outline a modal epistemology that fits with that answer. According to a theory-based epistemology of modality, you justifiably believe that p if (a) you justifiably believe a theory that says that p and (b) you believe p on the basis of that theory.     

Order of recall,output interference,and the modality effect

Summary In free recall, the order of recall following auditory and visual presentation differs; it tends to be forward for auditory but backward for visual. The first two experiments examined to what extent this difference in output order could account for the modality effect (i.e., a superior retention of auditorily as opposed to visually presented words). Order of recall was manipulated using postcued (Experiment 1) and precued (Experiment 2) procedures. Whereas the modality effect was unaffected with postcueing it was reduced to approximately half its size with precueing. It was concluded from these two studies that although output order cannot explain the whole modality effect, it does seem to play an important role for part of the effect in some situations. Experiments 3 and 4 used a mixed-mode and a probed recall procedure, respectively, to examine the role of output interference in modality experiments. The data suggested that output interference effects were non-monotonic; they were greater for visual than for auditory early in recall, but apparently no different later in recall. The two-store hypotheses (Murdock and Walker, 1969) was elaborated slightly to account for these results.This research was supported by Research Grants APA 146 from the National Research Council of Canada and OMHF 164 from the Ontario Mental Health Foundation. We would like to thank Doris Glavnov and Janet Metcalfe for help with the data analyses.