Temporal grouping effects in musical short-term memory

Recent theoretical accounts of verbal and visuo-spatial short-term memory (STM) have proposed the existence of domain-general mechanisms for the maintenance of serial order information. These accounts are based on the observation of similar behavioural effects across several modalities, such as temporal grouping effects. Across two experiments, the present study aimed at extending these findings, by exploring a STM modality that has received little interest so far, STM for musical information. Given its inherent rhythmic, temporal and serial organisation, the musical domain is of interest for investigating serial order STM processes such as temporal grouping. In Experiment 1, the data did not allow to determine the presence or the absence of temporal grouping effects. In Experiment 2, we observed that temporal grouping of tone sequences during encoding improves short-term recognition for serially presented probe tones. Furthermore, the serial position curves included micro-primacy and micro-recency effects, which are the hallmark characteristic of temporal grouping. Our results suggest that the encoding of serial order information in musical STM may be supported by temporal positional coding mechanisms similar to those reported in the verbal domain.     

Organization of visuo-spatial serial memory: interaction of temporal order with spatial and temporal grouping

This study investigates whether memory for sequences of spatial locations can be represented hierarchically, that is, as successive groups containing the order of constituent locations. Two grouping manipulations are used: Temporal grouping, based on the verbal serial memory literature, and spatial grouping, based on recent empirical work on visuo-spatial serial memory. In Experiment 1, we examine the relationship between spatial grouping and temporal order and showed that recall performance increases when both temporal and spatial organization correlate, but decreases when they clash. Experiments 2 and 3 show that the latter result is confounded by differences in path length (length of spatial path defined by the locations) between conditions, and that no effect of the spatial organization is observed when path length is controlled for. In Experiment 4, an alternative method to spatial grouping, temporal grouping, is used to induce hierarchical organization. A recall advantage is found in the temporal grouping condition. The results suggest that hierarchical representations can be imposed on order information for visuo-spatial sequences, either when participants have pre-existing knowledge about the form of the path formed by the sequence or when temporal boundaries delimit chunks; that increased path length is the cause of the performance decrement observed when dots from separate spatial groups are presented successively; and that path length and more generally sequence characteristics should be taken into account in designing future research on visuo-spatial serial memory.     

Temporal grouping, rehearsal and short-term memory

The effects of temporal grouping on auditory short-term memory are investigated, using pauses of different lengths to indicate the groups. No quantitative or qualitative differences were found between the shorter and longer pauses. This result, in conjunction with an analysis of the order errors, is used to suggest what kind of processing occurs during the pauses. This processing is selective, recoding the information about order according to position within a group.     

Strategic grouping in the spatial span memory task

Spatial short-term memory performance was examined in relation to participants' strategies. A total of 20 adult participants viewed and reproduced sequences of locations that varied in length (five, six, seven, or eight locations) and spatial separability (a manipulation of the configurations). In trial-by-trial self-reports, participants described five types of strategies. Chunking the spatial sequences into groups of three or four locations was the sole strategy associated with increased accuracy. Participants demonstrated considerable variability in the strategies that they selected, suggesting that cognitive resources are allocated to strategy selection, execution, and monitoring in the spatial span task. Spatially separable sequences were more accurately recalled than nonseparable sequences, independent of strategic grouping, suggesting two levels of grouping in the spatial span task.     

Strategic grouping in the spatial span memory task

Spatial short-term memory performance was examined in relation to participants’ strategies. A total of 20 adult participants viewed and reproduced sequences of locations that varied in length (five, six, seven, or eight locations) and spatial separability (a manipulation of the configurations). In trial-by-trial self-reports, participants described five types of strategies. Chunking the spatial sequences into groups of three or four locations was the sole strategy associated with increased accuracy. Participants demonstrated considerable variability in the strategies that they selected, suggesting that cognitive resources are allocated to strategy selection, execution, and monitoring in the spatial span task. Spatially separable sequences were more accurately recalled than nonseparable sequences, independent of strategic grouping, suggesting two levels of grouping in the spatial span task.     

Distinctiveness in serial memory for spatial information

Several studies have shown that recall performance depends on the extent to which an item differs from other items in a sequence (the distinctiveness effect; see, e.g., Kelley & Nairne, 2001). Distinctiveness effects, however, have been demonstrated mainly in the verbal domain. The present study extends distinctiveness effects to the spatial domain. In two experiments, participants recalled the order in which series of spatially located dots had been presented. Item discriminability was varied within the sequence by manipulating the duration of the interval inserted between the presentation of the dots (Experiment 1) and the perceptual characteristics of the stimuli (Experiment 2). The results showed that these manipulations in the spatial domain produce distinctiveness effects similar to those observed with verbal material (see, e.g., Neath & Crowder, 1990) and suggest that distinctiveness models of memory should take into account the processing of spatial information.     

A spatial modality effect in serial memory

In 2 experiments, the authors tested whether the classical modality effect-that is, the stronger recency effect for auditory items relative to visual items-can be extended to the spatial domain. An order reconstruction task was undertaken with four types of material: visual-spatial, auditory-spatial, visual-verbal, and auditory-verbal. Similar serial position curves were obtained regardless of the nature of the to-be-remembered sequences, with the exception that a modality effect was found with spatial as well as with verbal materials. The results are discussed with regard to a number of models of short-term memory.     

Rehearsal grouping and hierarchical organization of serial position cues in short-term memory

Lists of 8, 9, or 10 digits were presented at the rate of 1 digit/sec. to subjects instructed to rehearse silently the digits in non-overlapping groups of 1, 2, 3, 4, or 5 digits, after hearing each digit. Subjects were instructed not to rehearse any digits outside the group currently being presented. Rehearsing in 3's was optimal, irrespective of list length. Both recall of items and recall of the correct positions of items improved from 1's to 2's to 3's. Recall of items declined very little from 3's to 4's to 5's, but recall of position declined sharply. Errors in positioning digits tended, above chance, to be in the same group or the same position in a different group. The results suggest that both item-to-item associations and serial positin-to-item associations are formed in short-term memory, that only two or three serial position cues are used, but that these serial position cues can be hierarchically organized into a beginning, middle, and end group and a beginning, middle, and end position within a group.     

An isolation effect in serial memory for spatial information

This paper reports the first demonstration of an isolation effect or von Restorff effect (von Restorff, 1933) in the context of a spatial-memory task: Short-term serial recall was enhanced for both the location and the serial position of one red dot presented amongst a sequence of otherwise black dots. When the serial position of the isolate was fixed, the spatial isolation effect only emerged when participants received a control block of trials before the block of isolation trials (Experiment 1). However, when the serial position of the isolate was varied across isolation trials, an isolation effect was still produced regardless of condition order (Experiment 2). It is suggested that both temporal grouping strategies and greater item-specific processing may have contributed to the enhanced retention of the isolate.     

An isolation effect in serial memory for spatial information

This paper reports the first demonstration of an isolation effect or von Restorff effect (von Restorff, 1933 von Restorff, H. 1933. Uber die Wirkung von Bereichsbildungen im Spurenfeld [On the effect of spheres formations in the trace field]. Psychologische Forschung, 18: 299–342. [Crossref] , [Google Scholar]) in the context of a spatial-memory task: Short-term serial recall was enhanced for both the location and the serial position of one red dot presented amongst a sequence of otherwise black dots. When the serial position of the isolate was fixed, the spatial isolation effect only emerged when participants received a control block of trials before the block of isolation trials (Experiment 1). However, when the serial position of the isolate was varied across isolation trials, an isolation effect was still produced regardless of condition order (Experiment 2). It is suggested that both temporal grouping strategies and greater item-specific processing may have contributed to the enhanced retention of the isolate.     

Using auditory streaming to reduce disruption to serial memory by extraneous auditory warnings

Three experiments were conducted to examine the effects of extraneous speech warnings (i.e., low-priority warnings initiated during high-priority tasks) on cognitive performance and whether organizing the auditory warnings into streams can attenuate any disruption. Experiment 1 demonstrated that a variety of speech warnings can be separated into perceptually distinct streams by allocating them to discrete spatial locations. Experiment 2 showed that increasing the rate of presentation of the warnings to promote streaming decreased clarity ratings but increased perceived urgency ratings. Experiment 3 demonstrated that the disruption to serial memory for navigational information by extraneous speech warnings could be attenuated by streaming. Results are interpreted in light of previous research, and practical implications for auditory warning design are discussed.     

Effects of serial position and set size in auditory recognition memory

Auditorially presented lists of from one to six digits were memorized by Ss with instructions to scan the memory set to determine the presen’ce or absence of a single auditorially presented probe digit. Results showed cooccurrence of parallel linear increases in decision time with list length for positive and negative responses and effects of serial position of probes in the memory lists. A comparison with two previous studies using visual presentation of materials suggests faster encoding of auditorially presented probes but similarity in processing time in memory once probes have been encoded.     

Asymmetric binding in serial memory for verbal and spatial information

As the number of studies showing that items can be retained as bound representations in memory increases, researchers are beginning to investigate how the different features are bound together. In the present study, we examined the relative importances of the verbal and spatial features in serial memory for visual stimuli. Participants were asked to memorize the order of series of letters presented visually in different locations on the computer screen. The results showed that manipulating the phonological similarity of the letters affected recall of their spatial locations, but that increasing the complexity of the spatial pattern had no effect on recall of the letters. This finding was observed in both order reconstruction (Exps. 1 and 2) and probe serial recall (Exps. 3 and 4), suggesting that verbal–spatial binding in serial memory for visual information is asymmetric.     

Orientation dependence of spatial memory acquired from auditory experience

The present study investigated whether memory for a room-sized spatial layout learned through auditory localization of sounds exhibits orientation dependence similar to that observed for spatial memory acquired from stationary viewing of the environment. Participants learned spatial layouts by viewing objects or localizing sounds and then performed judgments of relative direction among remembered locations. The results showed that direction judgments following auditory learning were performed most accurately at a particular orientation in the same way as were those following visual learning, indicating that auditorily encoded spatial memory is orientation dependent. In combination with previous findings that spatial memories derived from haptic and proprioceptive experiences are also orientation dependent, the present finding suggests that orientation dependence is a general functional property of human spatial memory independent of learning modality.     

Domain-dependent activation during spatial and nonspatial auditory working memory

Visual system has been proposed to be divided into two, the ventral and dorsal, processing streams. The ventral pathway is thought to be involved in object identification whereas the dorsal pathway processes information regarding the spatial locations of objects and the spatial relationships among objects. Several studies on working memory (WM) processing have further suggested that there is a dissociable domain-dependent functional organization within the prefrontal cortex for processing of spatial and nonspatial visual information. Also the auditory system is proposed to be organized into two domain-specific processing streams, similar to that seen in the visual system. Recent studies on auditory WM have further suggested that maintenance of nonspatial and spatial auditory information activates a distributed neural network including temporal, parietal, and frontal regions but the magnitude of activation within these activated areas shows a different functional topography depending on the type of information being maintained. The dorsal prefrontal cortex, specifically an area of the superior frontal sulcus (SFS), has been shown to exhibit greater activity for spatial than for nonspatial auditory tasks. Conversely, ventral frontal regions have been shown to be more recruited by nonspatial than by spatial auditory tasks. It has also been shown that the magnitude of this dissociation is dependent on the cognitive operations required during WM processing. Moreover, there is evidence that within the nonspatial domain in the ventral prefrontal cortex, there is an across-modality dissociation during maintenance of visual and auditory information. Taken together, human neuroimaging results on both visual and auditory sensory systems support the idea that the prefrontal cortex is organized according to the type of information being maintained in WM.     

Temporal binding of auditory spatial information across dynamic binaural events

Simultaneity judgments were used to measure temporal binding windows (TBW) for brief binaural events (changes in interaural time and/or level differences [ITD and ILD]) and test the hypothesis that ITD and ILD contribute to perception via separate sensory dimensions subject to binding via slow (100+ ms)—presumably cortical—mechanisms as in multisensory TBW. Stimuli were continuous low-frequency noises that included two brief shifts of either type (ITD or ILD), both of which are heard as lateral position changes. TBW for judgments within a single cue dimension were narrower for ITD (mean = 444 ms) than ILD (807 ms). TBW for judgments across cue dimensions (i.e., one ITD shift and one ILD shift) were similar to within-cue ILD (778 ms). The results contradict the original hypothesis, in that cross-cue comparisons were no slower than within-cue ILD comparisons. Rather, the wide TBW values—consistent with previous estimates of multisensory TBW—suggest slow integrative processing for both types of judgments. Narrower TBW for ITD than ILD judgments suggests important cue-specific differences in the neural mechanisms or the perceptual correlates of integration across binaural-cue dimensions.     

Local temporal distinctiveness does not benefit auditory verbal and spatial serial recall

In the present study, we examined the role of randomly arranged temporal intervals preceding and following items (pre- and postitem intervals, respectively) in auditory verbal and spatial recall tasks. The duration of the pre- and postitem intervals did not affect serial recall performance. This finding calls into question (1) the suggestion that the interval following an item permits the consolidation of information in memory, even in a relatively demanding spatial task, and (2) the prediction that temporal distinctiveness should improve performance. The latter was explored further by showing that in contrast to our empirical data, a relative temporal distinctiveness model produced significant increases in recall performance when pre- and postitem intervals increased. The results are discussed with regard to recent studies revisiting the role of temporal isolation in short-term serial memory.     

Simultaneous grouping and auditory continuity

Are the conditions for illusory auditory continuity entirely local in frequency, or are judgments of continuity made on auditory objects? Listeners made continuous/pulsating judgments on a variety of complex tones that repeatedly alternated with a 100- to 500-Hz bandpass noise. A sufficiently quiet complex tone was heard as continuous when all its harmonics fell within the frequency range of the noise. Adding harmonics outside the noise's frequency range substantially reduced the impression of continuity, which was largely restored when these additional components were given a different fundamental frequency. Judgments of auditory continuity thus appear to be based on entire simultaneously grouped objects, rather than being determined solely by local criteria based on individual frequency channels.     

Transitional information in spatial serial memory: path characteristics affect recall performance

This study examined the role of stimulus characteristics in a visuospatial order reconstruction task in which participants were required to recall the order of sequences of spatial locations. The complexity of the to-be-remembered sequences, as measured by path crossing, path length, and angles, was found to affect serial memory, in terms of both recall accuracy and response times. The results demonstrate that not all sequences are remembered equally and that spatial characteristics of the sequences constitute an important variable in the understanding of visuospatial serial memory. More important, the data suggest that spatial path represents transitional information and that, as is the case in verbal serial memory, transitional information is of critical importance in serial memory.     

Encoding location and serial order in auditory working memory: evidence for separable processes

In this study, we investigated the interactions between temporal and spatial information in auditory working memory. In two experiments, participants were presented with sequences of sounds originating from different locations in space and were then asked to recall either their position or their serial order. In Experiment 1, attention during encoding was manipulated by contrasting 'pure' blocks (i.e., location-only or serial-order-only trials) to 'mixed' blocks (i.e., different percentages of spatial and serial-order trials). In Experiment 2, 'pure' blocks were contrasted to blocks in which spatial and serial-order trials were intermixed with a third task requiring a semantic categorization of sounds. Results from both experiments showed that, whereas serial-order recall is linearly affected by the simultaneous encoding of a concurrent feature, the recall of position is mostly unaffected by concurrent feature encoding. Contrastingly, overall performance level was lower for spatial recall than serial recall. We concluded that serial order and location of items appear to be independently encoded in auditory working memory. Serial order is easier to recall, but strongly affected by the processing of concurrent item dimensions, while item location is more difficult to recall, but relatively automatic, as shown by its strong resistance to interfering dimensions in encoding.