Short-term memory for spatial configurations in the tactile modality: A comparison with vision

This study investigates the role of acquisition constraints on the short-term retention of spatial configurations in the tactile modality in comparison with vision. It tests whether the sequential processing of information inherent to the tactile modality could account for limitation in short-term memory span for tactual-spatial information. In addition, this study investigates developmental aspects of short-term memory for tactual- and visual-spatial configurations. A total of 144 child and adult participants were assessed for their memory span in three different conditions: tactual, visual, and visual with a limited field of view. The results showed lower tactual-spatial memory span than visual-spatial, regardless of age. However, differences in memory span observed between the tactile and visual modalities vanished when the visual processing of information occurred within a limited field. These results provide evidence for an impact of acquisition constraints on the retention of spatial information in the tactile modality in both childhood and adulthood.     

Effects of perceptual modality on verbatim and gist memory

In two experiments, predictions of the fuzzy-trace theory of memory were tested. Perceptual information may play a role in retrieval and recognition processes for verbatim, but not for gist, memory. Perceptual modality effects were assessed in the present study by presenting three-sentence stories (e.g.,The bird is in the cage. The cage is over the table. The bird is yellow) and then testing recognition of probes that varied on three dimensions: (1) semantic accuracy (true vs. false), (2) wording (all original words vs. one novel word included), and (3) sentence type (premise vs. inference). In Experiment 1, study modality (auditory vs. visual) was manipulated, and in Experiment 2, both study and test modalities were manipulated. Despite replicating a number of findings consistent with fuzzy-trace theory (e.g., instruction and probe type effects), the results of both experiments failed to support the idea that perceptual information plays a role in performance on verbatim memory tests.     

DETECTING CHANGES IN NON‐SIMULATED EVENTS USING PARTIAL INTERVAL RECORDING AND MOMENTARY TIME SAMPLING: EVALUATING FALSE POSITIVES,FALSE NEGATIVES,AND TRENDING

Several studies have evaluated false positives and false negatives produced with partial interval recording (PIR) and momentary time sampling (MTS) using simulated data. However, no study to date has evaluated false positives and negatives using a large sample of non‐simulated behaviors. In addition, few studies have evaluated whether interval methods of data collection alter trends that are evident in continuous records. We conducted three experiments to evaluate the extent to which various interval sizes of MTS and PIR produced false negatives (Experiment 1), false positives (Experiment 2), and trends that were inconsistent with the continuous records (Experiment 3). Collectively, the results show the following: (i) 10‐s PIR and 10‐s MTS produced few false negatives and few false positives (i.e., both were sensitive) to changes in duration events; (ii) 10‐s PIR produced very few false negatives, but an unexpected high percentage of false positives for frequency events; and (iii) each interval size of PIR and MTS produced a high percentage of changes in trending for duration events and frequency events. We briefly discuss the potential limitations and clinical implications of these findings. Copyright © 2012 John Wiley & Sons, Ltd.     

Encoding modality can affect memory accuracy via retrieval orientation

Research indicates that false memory is lower following visual than auditory study, potentially because visual information is more distinctive. In the present study we tested the extent to which retrieval orientation can cause a modality effect on memory accuracy. Participants studied unrelated words in different modalities, followed by criterial recollection tests that selectively oriented retrieval toward one study modality at a time. Memory errors were lower when oriented toward visual than toward auditory information, thereby generalizing the modality effect to an explicit source memory task. Moreover, these effects persisted independent of the test presentation modality, indicating that retrieval orientation overrode the potential cuing properties of the test stimulus. An independent manipulation check confirmed that visual recollections were subjectively experienced as more distinctive than auditory recollections. These results suggest that retrieval orientation is sufficient to cause a modality effect on memory accuracy by focusing monitoring processes on the recollection of studied features that are diagnostic of prior presentation.     

Congruency effect of presentation modality on false recognition of haptic and visual objects

Studying a list of items related to an item that is not presented (lure item) produces a false memory. We investigated whether a haptic study/test results in false recognition and, if so, whether congruency of presentation modality between study and test reduces the false recognition. After haptic or visual study of lists of real objects that are related to a lure object, participants were asked to recognise whether the objects were presented haptically or visually. We obtained false recognition results with haptic study and/or test. False recognition was reduced when presentation and study modalities were congruent. After haptic study, false recognition was reduced in the haptic test, as compared to the visual test. In contrast, visual study always reduced visual false recognition. These results indicate that there is a general effect of retrieval cues that will reduce false recognition.     

Semantic effects on sensory-motor modality switching

Language processing always involves a combination of sensory (auditory or visual) and motor modalities (vocal or manual). In line with embodied cognition theories, we additionally assume a semantically implied modality (SIM) due to modality references of the underlying concept. Understanding ear-related words (e.g. “noise”), for example, should activate the auditory SIM. In the present study, we investigated the influence of the SIM on sensory-motor modality switching (e.g. switching between the auditory-vocal and visual-manual combination). During modality switching, participants categorised words with regard to their SIM (e.g. ear- versus eye-related words). Overall performance was improved and switch costs were reduced whenever there was concordance between SIMs and sensory-motor modalities (e.g. an auditory presentation of ear-related words). Thus, the present study provides first evidence for semantic effects during sensory-motor modality switching in terms of facilitation effects whenever the SIM was in concordance with sensory-motor modalities.     

Sensory modality and method of item information presentation in memory

Investigated were differences in paired-associate learning for auditory versus visual modalities and within each modality the anticipation and study test methods of item presentation were compared. Extant reports re these two sensory modalities and of the two learning methods had been inconsistent. In this study of 40 university students, the learning of CVC-CVC nonsense syllable pairs was significantly better with the visual than with the auditory modality. The study-test method was significantly superior to the anticipation method in the visual mode. With auditory presentations, however, acquisition levels for both methods were the same. Significant interactions were observed between sensory modalities and methods of presentation. At present the retention interval theory (Izawa 1972–1979b) appears to account best for the varied findings with respect to the two methods of presentation.     

The cost of expecting events in the wrong sensory modality

We examined the effects of modality expectancy on human performance. Participants judged azimuth (left vs. right location) for an unpredictable sequence of auditory, visual, and tactile targets. In some blocks, equal numbers of targets were presented in each modality. In others, the majority (75%) of the targets were presented in just one expected modality. Reaction times (RTs) for targets in an unexpected modality were slower than when that modality was expected or when no expectancy applied. RT costs associated with shifting attention from the tactile modality were greater than those for shifts from either audition or vision. Any RT benefits for the most likely modality were due to priming from an event in the same modality on the previous trial, not to the expectancy per se. These results show that stimulus-driven and expectancy-driven effects must be distinguished in studies of attending to different sensory modalities.     

Good vibrations: Human interval timing in the vibrotactile modality

This article reports a detailed examination of timing in the vibrotactile modality and comparison with that of visual and auditory modalities. Three experiments investigated human timing in the vibrotactile modality. In Experiment 1, a staircase threshold procedure with a standard duration of 1,000 ms revealed a difference threshold of 160.35 ms for vibrotactile stimuli, which was significantly higher than that for auditory stimuli (103.25 ms) but not significantly lower than that obtained for visual stimuli (196.76 ms). In Experiment 2, verbal estimation revealed a significant slope difference between vibrotactile and auditory timing, but not between vibrotactile and visual timing. That is, both vibrations and lights were judged as shorter than sounds, and this comparative difference was greater at longer durations than at shorter ones. In Experiment 3, performance on a temporal generalization task showed characteristics consistent with the predications of scalar expectancy theory (SET: Gibbon, 1977) with both mean accuracy and scalar variance exhibited. The results were modelled using the modified Church and Gibbon model (MCG; derived by Wearden, 1992, from Church & Gibbon 1982). The model was found to give an excellent fit to the data, and the parameter values obtained were compared with those for visual and auditory temporal generalization. The pattern of results suggest that timing in the vibrotactile modality conforms to SET and that the internal clock speed for vibrotactile stimuli is significantly slower than that for auditory stimuli, which is logically consistent with the significant differences in difference threshold that were obtained.     

Presentation modality affects false memory

Roediger and McDermott (1995) rejuvenated interest in Deese’s (1959) paradigm for producing reliable intrusions and false alarms. Using this paradigm in three experiments, we demonstrated that visual study presentation dramatically reduces the rate of false memories. Only auditory study presentation resulted in equal production of studied and critical items. Correct recall and recognition were unaffected. The suggestion that visual presentation provides a means for discriminating between false and true memories was supported by Experiment 3: Pleasantness rating of study items significantly reduced the creation of false memories regardless of modality.     

Dual coding under conditions of second stimulus modality uncertainty in successive matching tasks

Subjects matched successively presented stimuli within and across modalities. In conditions in which they were informed of the modalities of the two stimuli, no differences in matching performance were obtained between the four types of match (visual-visual, auditory-auditory, visual-auditory, and auditory-visual). Thus, there appeared to be no difference between the modalities in ability to perceive or retain the particular stimuli used. In conditions in which subjects were informed of the modality of the first stimulus but only of the modality in which the second stimulus would appear on 80% of trials, there was again no significant difference between auditory-auditory and visual-visual matching. However, auditory-visual matching was much faster than visual-auditory matching when the second stimulus appeared in the unexpected modality. The results suggest that subjects prepare for both possible types of match when uncertain of the second stimulus modality and that the cross-modal asymmetry reflects the additional attentional load that this incurs.     

On measuring selective attention to an expected sensory modality

Perceptual judgments can be affected by expectancies regarding the likely target modality. This has been taken as evidence for selective attention to particular modalities, but alternative accounts remain possible in terms of response priming, criterion shifts, stimulus repetition, and spatial confounds. We examined whether attention to a sensory modality would still be apparent when these alternatives were ruled out. Subjects made a speeded detection response (Experiment 1), an intensity or color discrimination (Experiment 2), or a spatial discrimination response (Experiments 3 and 4) for auditory and visual targets presented in a random sequence. On each trial, a symbolic visual cue predicted the likely target modality. Responses were always more rapid and accurate for targets presented in the expected versus unexpected modality, implying that people can indeed selectively attend to the auditory or visual modalities. When subjects were cued to both the probable modality of a target and its likely spatial location (Experiment 4), separable modality-cuing and spatial-cuing effects were observed. These studies introduce appropriate methods for distinguishing attention to a modality from the confounding factors that have plagued previous normal and clinical research.     

Influence of recall procedures on the modality effect with numbers and enumerated stimuli

Experiment 1 extended J. S. Nairne and W. L. McNabb's (1985) counting procedure for presenting numerical stimuli to examine the modality effect. The present authors presented participants with dots and beeps and instructed participants to count the items to derive to-be-remembered numbers. In addition, the authors presented numbers as visual and auditory symbols, and participants recalled items by using free-serial written recall. Experiment 1 demonstrated primacy effects, recency effects, and modality effects for visual and auditory symbols and for counts of dots and beeps. Experiment 2 replicated the procedure in Experiment 1 using strict-serial written recall instead of free-serial written recall. The authors demonstrated primacy and recency effects across all 4 presentation conditions and found a modality effect for numbers that the authors presented as symbols. However, the authors found no modality effect when they presented numbers as counts of beeps and dots. The authors discuss the implications of the results in terms of methods for testing modality effects.     

Cross-modality translations improve recognition by reducing false alarms

Conway and Gathercole [(1990). Writing and long-term memory: Evidence for a “translation” hypothesis. The Quarterly Journal of Experimental Psychology, 42, 513–527] proposed a translation account to explain why certain types of encoding produce benefits in memory: Switching modalities from what is presented to what is encoded enhances item distinctiveness. We investigated this hypothesis in a recognition experiment in which the presentation modality of a study list (visual vs. auditory) and the encoding activity (speaking vs. typing vs. passive encoding) were manipulated between-subjects. Manipulating encoding activity between-subjects ruled out any potential influence of the relationally distinct processing that can occur in a within-subject manipulation (in which all previous translation effects have been demonstrated). We found no overall difference in memory for words presented auditorily vs. visually nor for visual vs. auditory encoding, but critically presentation modality and encoding activity did interact. Translating from one modality to another – particularly from auditory presentation to visual encoding (typing) – led to the best memory discrimination. This was largely because of reduced false alarms, not increased hits, consistent with the distinctiveness heuristic.     

非熟练中-英双语者跨语言的错误记忆通道效应

采用DRM范式以112名非熟练中-英双语者为被试进行了跨语言的错误记忆通道效应实验。实验采用三因素混合设计,根据学习通道和测验通道的不同,把被试分为4组,用由汉语与英语单词组成的DRM词表进行学习和测验。结果发现,⑴在非熟练中-英双语被试中存在错误记忆的跨语言现象;⑵非熟练中-英双语者跨语言的错误记忆存在很强的语言特异性,表现为相同语言条件高于不同语言条件、汉语高于英语;⑶在学习与测验相同语言条件下运用校正的再认分数——敏感性指标Pr,进一步探讨错误记忆的通道效应,发现了跟西方不一致的结论：即无论汉语词表还是英语词表,非熟练中-英双语者在视觉通道上的错误记忆明显高于听觉通道     

Dutch modality exclusivity norms: Simulating perceptual modality in space

Perceptual information is important for the meaning of nouns. We present modality exclusivity norms for 485 Dutch nouns rated on visual, auditory, haptic, gustatory, and olfactory associations. We found these nouns are highly multimodal. They were rated most dominant in vision, and least in olfaction. A factor analysis identified two main dimensions: one loaded strongly on olfaction and gustation (reflecting joint involvement in flavor), and a second loaded strongly on vision and touch (reflecting joint involvement in manipulable objects). In a second study, we validated the ratings with similarity judgments. As expected, words from the same dominant modality were rated more similar than words from different dominant modalities; but – more importantly – this effect was enhanced when word pairs had high modality strength ratings. We further demonstrated the utility of our ratings by investigating whether perceptual modalities are differentially experienced in space, in a third study. Nouns were categorized into their dominant modality and used in a lexical decision experiment where the spatial position of words was either in proximal or distal space. We found words dominant in olfaction were processed faster in proximal than distal space compared to the other modalities, suggesting olfactory information is mentally simulated as “close” to the body. Finally, we collected ratings of emotion (valence, dominance, and arousal) to assess its role in perceptual space simulation, but the valence did not explain the data. So, words are processed differently depending on their perceptual associations, and strength of association is captured by modality exclusivity ratings.     

Inverting the modality effect in serial recall

Differences in recall ability between immediate serial recall of auditorily and visually presented verbal material have traditionally been considered restricted to the end of to-be-recalled lists, the recency section of the serial position curve (e.g., Crowder & Morton, 1969). Later studies showed that--under certain circumstances--differences in recall between the two modalities can be observed across the whole of the list (Frankish, 1985). However in all these studies the advantage observed is for recall of material presented in the auditorily modality. Six separate conditions across four experiments demonstrate that a visual advantage can be obtained with serial recall if participants are required to recall the list in two distinct sections using serial recall. Judged on a list-wide basis, the visual advantage is of equivalent size to the auditory advantage of the classical modality effect. The results demonstrate that differences in representation of auditory and visual verbal material in short-term memory persist beyond lexical and phonological categorization and are problematic for current theories of the modality effect.     

The effect of study modality on false recognition

A number of previous studies have shown that false recognition of critical items in the Deese/Roediger-McDermott paradigm is reduced when study items are presented visually rather than auditorily; however, this effect has not been uniformly demonstrated. We investigated three potential boundary conditions of the effect of study modality in false recognition. Experiments 1 and 2 showed no reduction in false recognition following visual study presentation when the yes-no recognition test was not preceded by a recall test. Experiment 3 showed that visual study presentation can reduce false recognition without a preceding recall test, if the recognition test uses remember-know instructions. The order of the recognition test items did not influence the effect of visual study presentation on false recognition in Experiment 1. In general, the data imply that distinctive processing at study can reduce false memory in recognition if the test demands draw attention to the dimension of distinctive processing.     

Test modality affects source monitoring and event-related potentials

Two experiments investigated the effect of test modality (visual or auditory) on source memory and event-related potentials (ERPs). Test modality influenced source monitoring such that source memory was better when the source and test modalities were congruent. Test modality had less of an influence when alternative information (i.e., cognitive operations) could be used to inform source judgments in Experiment 2. Test modality also affected ERP activity. Variation in parietal ERPs suggested that this activity reflects activation of sensory information, which can be attenuated when the sensory information is misleading. Changes in frontal ERPs support the hypothesis that frontal systems are used to evaluate source-specifying information present in the memory trace.     

通道呈现方式与感知学习风格的匹配性对粤-普双言切换代价的影响

选取不同感知学习风格的熟练粤-普双言者被试, 比较在不同通道呈现方式下他们刺激命名任务的表现, 由此考察感知学习风格与通道呈现方式的匹配性对熟练双言者双言切换代价的影响。结果发现, 被试在视觉线索呈现条件下要比在听觉线索条件下的切换代价小; 当感知学习风格与通道呈现方式匹配时, 双言切换代价更低。表明感知学习风格与通道呈现方式的匹配性对于双言切换代价有调节作用。