Auditory and visual spatial working memory

A series of experiments compared short-term memory for object locations in the auditory and visual modalities. The stimulus materials consisted of sounds and pictures presented at different locations in space. Items were presented in pure- or mixed-modality lists of increasing length. At test, participants responded to renewed presentation of the objects by indicating their original position. If two independent modality-specific and resource-limited short-term memories support the remembering of locations, memory performance should be higher in the mixed-modality than in the pure-modality condition. Yet, memory performance was the same for items in both types of list. In addition, responses to the memory load manipulation in both modalities showed very similar declines in performance. The results are interpreted in terms of object files binding object and location information in episodic working memory, independently of the input modality.     

Auditory and audiovisual inhibition of return

Two experiments examined any inhibition-of-return (IOR) effects from auditory cues and from preceding auditory targets upon reaction times (RTs) for detecting subsequent auditory targets. Auditory RT was delayed if the preceding auditory cue was on the same side as the target, but was unaffected by the location of the auditorytarget from the preceding trial, suggesting that response inhibition for the cue may have produced its effects. By contrast, visual detection RT was inhibited by the ipsilateral presentation of a visual target on the preceding trial. In a third experiment, targets could be unpredictably auditory or visual, and no peripheral cues intervened. Both auditory and visual detection RTs were now delayed following an ipsilateral versus contralateral target in either modality on the preceding trial, even when eye position was monitored to ensure central fixation throughout. These data suggest that auditory target—target IOR arises only when target modality is unpredictable. They also provide the first unequivocal evidence for cross-modal IOR, since, unlike other recent studies (e.g., Reuter-Lorenz, Jha, & Rosenquist, 1996; Tassinari & Berlucchi, 1995; Tassinari & Campara, 1996), the present cross-modal effects cannot be explained in terms of response inhibition for the cue. The results are discussed in relation to neurophysiological studies and audiovisual links in saccade programming.     

Auditory spatial concepts in blind football experts

ObjectivesWe compared the spatial concepts given to sounds' directions by blind football players with both blind non-athletes and sighted individuals.MethodParticipants verbally described the directions of sounds around them by using predefined spatial concept labels, under two blocked conditions: 1) facing front, 2) pointing with the hand towards the stimulus.ResultsBlind football players categorized the directions more precisely (i.e., they used simple labels for describing the cardinal directions and combined labels for the intermediate ones) than the other groups, and their categorization was less sensitive to the response conditions than blind non-athletes. Sighted participants' categorization was similar to previous studies, in which the front and back regions were generally more precisely described than the sides, where simple labels were often used for describing directions around the absolute left and right.ConclusionsThe differences in conceptual categorization of sound directions are a) in sighted individuals, influenced by the representation of the visual space b) in blind individuals, influenced by the level of expertise in action and locomotion based on non-visual information, which can be increased by auditive stimulation provided by blind football training.     

Auditory spatial attention using interaural time differences

Previous probe-signal studies of auditory spatial attention have shown faster responses to sounds at an expected versus an unexpected location, making no distinction between the use of interaural time difference (ITD) cues and interaural-level difference cues. In 5 experiments, performance on a same-different spatial discrimination task was used in place of the reaction time metric, and sounds, presented over headphones, were lateralized only by an ITD. In all experiments, performance was better for signals lateralized on the expected side of the head, supporting the conclusion that ITDs can be used as a basis for covert orienting. The performance advantage generalized to all sounds within the spatial focus and was not dissipated by a trial-by-trial rove in frequency or by a rove in spectral profile. Successful use by the listeners of a cross-modal, centrally positioned visual cue provided evidence for top-down attentional control.     

Auditory spatial pattern perception aided by visual choices

Summary Thirty-six human subjects, facing a panel of 100 loud-speakers, were requested to match sounds outlining geometrical and alphabetical patterns with visual pattern choices, which were given to them on a folder. The listeners' correct responses were found to be above chance. Geometrical patterns were better perceived when transmitted at the sound frequency of 800 cps as compared to 6400 cps. The number of visual pattern choices given with the sound pattern presentations affected the number of correct responses. The results indicate that the perception of acoustic spatial patterns depends on mechanisms different from those defining the spatial localization of single acoustic signals.This work was supported by the Swiss National Science Foundation, Grants 3.74.68, 4.0120.70 and 4.0860.73 to E. Perret.     

Inhibitory processes in auditory selective attention: Evidence of location-based and frequency-based inhibition of return

The possibility that there is an inhibitory component to auditory covert orienting was addressed. Each trial consisted of a cue followed by a target, and listeners were required to detect, localize, or identify the frequency of the target. At 150-msec stimulus onset asynchrony (SOA), performance was best when stimuli sounded from the same location or were of the same frequency. However, at 750-msec SOA, performance was best when stimuli differed in location or were of different frequencies. These results document the existence of both location-based and frequency-based auditory inhibition of return.     

Auditory and proprioceptive spatial impairments in blind children and adults

It is not clear what role visual information plays in the development of space perception. It has previously been shown that in absence of vision, both the ability to judge orientation in the haptic modality and bisect intervals in the auditory modality are severely compromised (Gori, Sandini, Martinoli & Burr, 2010; Gori, Sandini, Martinoli & Burr, 2014). Here we report for the first time also a strong deficit in proprioceptive reproduction and audio distance evaluation in early blind children and adults. Interestingly, the deficit is not present in a small group of adults with acquired visual disability. Our results support the idea that in absence of vision the audio and proprioceptive spatial representations may be delayed or drastically weakened due to the lack of visual calibration over the auditory and haptic modalities during the critical period of development.     

Tactile spatial acuity differs between fingers: a study comparing two testing paradigms

Tactile spatial acuity (TSA) is a reliable and reproducible measure of somatosensory system function that has been used to study abroad range of subject populations. Although TSA is most often assessed at the fingertip, published studies employing identical stimuli disagree on whether TSA differs between the fingers of neurologically normal subjects. Using a validated grating orientation discrimination task, we determined TSA bilaterally at the index and ring fingers of 16 healthy young adults. Motivated by earlier work, we utilized two stimulus presentation paradigms, the method of constant stimuli (MCS) and a staircase (SC) method. We found that TSA was significantly higher (the discrimination threshold was lower) at the index than at the ring finger, which was consistent with a prior study. Although mean thresholds at both fingers were higher when measured with the SC than with the MCS paradigm, this difference did not reach statistical significance (p = .14). These findings should facilitate both design and interpretation of future studies investigating TSA.     

Collaborative inhibition in spatial memory retrieval

Collaborative inhibition refers to the finding that pairs of people working together to retrieve information from memory—a collaborative group—often retrieve fewer unique items than do nominal pairs, who retrieve individually but whose performance is pooled. Two experiments were designed to explore whether collaborative inhibition, which has heretofore been studied using traditional memory stimuli such as word lists, also characterizes spatial memory retrieval. In the present study, participants learned a layout of objects and then reconstructed the layout from memory, either individually or in pairs. The layouts created by collaborative pairs were more accurate than those created by individuals, but less accurate than those of nominal pairs, providing evidence for collaborative inhibition in spatial memory retrieval. Collaborative inhibition occurred when participants were allowed to dictate the order of object placement during reconstruction (Exp. 1), and also when object order was imposed by the experimenter (Exp. 2), which was intended to disrupt the retrieval processes of pairs as well as of individuals. Individual tests of perspective taking indicated that the underlying representations of pair members were no different than those of individuals; in all cases, spatial memories were organized around a reference frame aligned with the studied perspective. These results suggest that inhibition is caused by the product of group recall (i.e., seeing a partner’s object placement), not by the process of group recall (i.e., taking turns choosing an object to place). The present study has implications for how group performance on a collaborative spatial memory task may be optimized.     

Selection and inhibition in infancy: evidence from the spatial negative priming paradigm

We used a spatial negative priming (SNP) paradigm to examine visual selective attention in infants and adults using eye movements as the motor selection measure. In SNP, when a previously ignored location becomes the target to be selected, responses to it are impaired, providing a measure of inhibitory selection. Each trial consisted of a prime and a probe, separated by 67, 200, or 550 ms interstimulus intervals (ISIs). In the prime, a target was accompanied by a distractor. In the probe, the target appeared either in the location formerly occupied by the distractor (ignored repetition) or in another location (control). Adults exhibited the SNP effect in all three ISI conditions, producing slower saccade latencies on ignored repetition versus control trials. The SNP effect obtained for infants only under 550 and 200 ms ISI conditions. These results suggest that important developments in visual selection are rooted in emerging inhibitory mechanisms.     

Auditory food cue conditioning: Effects of spatial contiguity and taste quality

The effects of spatial location of an auditory stimulus and quality of a potentiating taste on the aversive conditioning of an auditory food cue were investigated. In Experiment 1 rats ate salty food activating a tone from a speaker either in (spatially contiguous with) or displaced from the food and were then made ill. It was found that spatial contiguity during conditioning resulted in avoidance of food with a contiguous or a displaced tone in testing, and spatial displacement during conditioning resulted in avoidance of food only if the tone was also displaced in testing. Experiment 2 was identical, except rats ate salty, bitter, or sweet food with a displaced tone during conditioning and testing. The salty and bitter food groups demonstrated an avoidance of noisy food relative to the sweet food group. These results indicate that spatial contiguity interacts with taste quality in the conditioning of nongustatory food cues.     

The spatial distribution of inhibition of return

Inhibition of return (IOR) refers to the finding that response times (RTs) are typically slower for targets at previously attended (cued) locations than for targets at novel (uncued) locations. Although previous research has indicated that IOR may spread beyond a cued location, the present study is the first to examine the spatial distribution of IOR with high spatial resolution over a large portion of the central visual field. This was done by using a typical IOR procedure (cue, delay, target) with 4 cue locations and 441 target locations (each separated by 1° of visual angle). The results indicate that IOR spreads beyond the cued location to affect the cued hemifield. However, the cues also produced a gradient of RTs throughout the visual field, with inhibition in the cued hemifield gradually giving way to facilitation in the hemifield opposite the cue.     

Auditory spatial attention capture,disengagement, and response selection in normal aging

Attention control is a core element of cognitive aging, but the specific mechanisms that differ with age are unclear. Here we used a novel auditory spatial attention task to evaluate stimulus processing at the level of early attention capture, later response selection, and the lingering effects of attention capture across trials in young and older adults. We found that the shapes of spatial attention capture gradients were remarkably similar in young and older adults, but only the older group had lingering effects of attention capture on the next trial. Response selection for stimulus-response incompatibilities took longer in older subjects, but primarily when attending to the midline location. The results suggest that the likelihood and spatial tuning of attention capture is comparable among groups, but once attention is captured, older subjects take longer to disengage. Age differences in response selection were supported, but may not be a general feature of cognitive aging.     

Focal spatial attention can eliminate inhibition of return

Inhibition of return (IOR) is an orienting phenomenon characterized by slower responses to spatially cued than to uncued targets. In Experiment 1, a physically small digit that required identification was presented immediately following a peripheral cue. The digit could appear in the cued peripheral box or in the central box, thus guaranteeing a saccadic response to the cue in one condition and maintenance of fixation in the other. An IOR effect was observed when a saccadic response to the cue was required, but IOR was not generated by the peripheral cue when fixation was maintained in order to process the central digit. In Experiment 2, IOR effects were observed when participants were instructed to ignore the digits, whether those digits were presented in the periphery or at fixation. These findings suggest that behaviorally manifested, cue-induced IOR effects can be eliminated by focal spatial attentional control settings.     

Effect of aging differs for memory of object identity and object position within a spatial context

There has been considerable focus on investigating age-related memory changes in cognitively healthy older adults, in the absence of neurodegenerative disorders. Previous studies have reported age-related domain-specific changes in older adults, showing increased difficulty encoding and processing object information but minimal to no impairment in processing spatial information compared with younger adults. However, few of these studies have examined age-related changes in the encoding of concurrently presented object and spatial stimuli, specifically the integration of both spatial and nonspatial (object) information. To more closely resemble real-life memory encoding and the integration of both spatial and nonspatial information, the current study developed a new experimental paradigm with novel environments that allowed for the placement of different objects in different positions within the environment. The results show that older adults have decreased performance in recognizing changes of the object position within the spatial context but no significant differences in recognizing changes in the identity of the object within the spatial context compared with younger adults. These findings suggest there may be potential age-related differences in the mechanisms underlying the representations of complex environments and furthermore, the integration of spatial and nonspatial information may be differentially processed relative to independent and isolated representations of object and spatial information.

Advancing age is associated with changes in a number of cognitive domains (Erickson and Barnes 2003; Salthouse 2004; Craik and Bialystok 2006). Particularly age-related changes in episodic memory function have been frequently reported (Grady and Craik 2000; Craik and Bialystok 2006). In addition to a general decline in long-term retention, older adults show a reduced ability to differentiate between highly similar object representations (Yassa et al. 2011; Stark et al. 2013, 2015; Reagh et al. 2016; Berron et al. 2018) and object features (Yeung et al. 2017) compared with young adults. In contrast, spatial representations appear to be relatively spared (Fidalgo et al. 2016; Stark and Stark 2017) with older adults showing performance similar to young adults recognizing subtle changes in a spatial environment (Berron et al. 2018) and changes in the location of an object when presented on a blank screen (Reagh et al. 2016, 2018).The dissociation and integration of object and spatial information has been a key question in memory research. Older adults show significant impairments in memory binding and maintaining associations despite having intact memory for the individual items (Chalfonte and Johnson 1996; Naveh-Benjamin 2000; Old and Naveh-Benjamin 2008). This is also observed in object-location binding with impairments in recalling the specific location of objects (Kessels et al. 2007; Berger-Mandelbaum and Magen 2019; Muffato et al. 2019) as well as recalling the identity of an object within an environment (Schiavetto et al. 2002; Kessels et al. 2007; Mazurek et al. 2015). The binding of object-location information has been hypothesized to involve the medial temporal lobes, including the hippocampus (Postma et al. 2008), although age-related changes in the prefrontal cortex, posterior neocortex and other regions have also been implicated in object location and object identity tasks (Schiavetto et al. 2002; Meulenbroek et al. 2010). In the medial temporal lobes, the integration of object and spatial information is thought to arise from two parallel information processing streams (Eichenbaum 1999; Eichenbaum et al. 1999; Davachi 2006; Ranganath and Ritchey 2012; Knierim et al. 2013). One pathway, commonly referred to as the “what” pathway involves the perirhinal cortex and the lateral entorhinal cortex, and is thought to predominately process information about objects, items and events, while the “where” pathway involving the parahippocampal cortex and the medial entorhinal cortex is thought to process contextual and spatial information. Information from both pathways is projected to the hippocampus, which is then thought to integrate the spatial and nonspatial information into a cohesive “memory space” through a mechanism that is common to both object or episodic and spatial information (Eichenbaum et al. 1999).However, emerging evidence suggests the processing of object and spatial information may be more integrated than previously thought with the lateral entorhinal cortex processing multimodal information, receiving both object and spatial information (Witter et al. 2017; Doan et al. 2019; Nilssen et al. 2019). In rodent studies, the lateral entorhinal cortex has been reported to be involved in the encoding of features from both the object and the environment (Deshmukh and Knierim 2011; Yoganarasimha et al. 2011; Deshmukh et al. 2012; Knierim et al. 2013). Rodent studies using single cell recordings in the lateral entorhinal cortex show that neurons in this region encode object-related information as well as spatial information about the object (e.g., position in relationship to the environment). These studies also show cells in the lateral entorhinal cortex that track the position of an object in the environment and do not fire when that object is no longer present (Deshmukh and Knierim 2011). A different subset of cells (“object trace cells”) have been reported to fire in previously experienced positions of an object within an environment (Deshmukh and Knierim 2011; Tsao et al. 2013). Lateral entorhinal cortex lesioned rodents show no impairment in performing an object-recognition task, but are impaired at recognizing spatial changes and object changes within a set of objects in an environment including position changes of the objects (Van Cauter et al. 2013) and previously learned object-place and object-context associations (Wilson et al. 2013a; Chao et al. 2016). Together, these findings suggest that, beyond encoding information about objects, the lateral entorhinal cortex encodes contextual information and may be binding nonspatial and spatial information, specifically encoding information about objects and certain spatial properties, including information about the object''s position within environment.Few studies have examined the role of the lateral entorhinal cortex in encoding object identity, object position or changes to the spatial context in humans. Reagh and Yassa (2014) report that subtle perceptual differences between similar objects (e.g., two slightly different apples) elicits activity observed with functional magnetic resonance imaging (fMRI) in both the lateral entorhinal cortex and perirhinal cortex, while changes to an object''s position on a blank screen elicited activity in both the parahippocampal cortex and medial entorhinal cortex. Subsequent studies in older adults show impaired performance recalling the identity of object (Reagh and Yassa 2014; Stark and Stark 2017; Yeung et al. 2017; Berron et al. 2018; Reagh et al. 2018) but similar performance recalling position of the object on a screen compared with young adults (Reagh et al. 2016, 2018). However, these studies examined memory for object identity and object position on a blank screen, devoid of any spatial or contextual information. Given the findings from rodent studies, it appears that object identity and object position information are represented in relationship to the spatial environment in which they occur.To examine the integration of nonspatial and spatial information, novel stimuli were developed to mimic real-life environments where objects could occur within the environment, more closely resembling animal studies in which rodents experience objects within an environment. A series of scenes were designed to have the same perspective, spatial dimensions and outdoor scenery (Fig. 1A). Scenes were classified into five general categories: living room, dining room, kitchen, bedroom, and office rooms to allow for the placement of categorically congruent furniture (Fig. 1B). Critically, within each scene, two to five different positions were defined that an object could logically occupy (Fig. 1C). The scene stimuli were first validated using mnemonic ratings and subsequently used in a novel object-in-context task to assess memory for object identity and object position in context and examine age-related changes in performance on this task in cognitively normal older adults compared with young adults.Open in a separate windowFigure 1.Task stimuli. (A) Scenes were designed to have identical dimensions and a similar perspective. (B) Scenes were designed to have two to five different positions where an object could be reasonably placed. Across all scenes, the same general positions were available for object placement. (C) Example of a scene with an object as seen by the participant. No object was present in the scenes for the stimulus validation study.     

The import of the cortisol rise in child care differs as a function of behavioral inhibition

Children of ages 3 to 4.5 years (N = 107; 45 boys, 62 girls) were studied twice, 6 months apart, to examine whether the cortisol rise in child care at Time 1 (T1) was associated with (a) changes in anxious, vigilant behavior from T1 to Time 2 (T2) and (b) higher internalizing symptoms at T2. Controlling for measures of home environment and child care quality at T1, as well as for cortisol activity at T2, we obtained results indicating that behavioral inhibition moderated the associations between the rise in cortisol at T1 and child outcomes at T2 (i.e., anxious, vigilant behavior and internalizing symptoms). For both outcomes, the rise in cortisol at T1 became more positively predictive at increasing levels of behavioral inhibition. Specifically, at higher levels of behavioral inhibition, children with larger T1 cortisol increases expressed more internalizing symptoms than did children at lower levels of behavioral inhibition; in contrast, for those with low cortisol activity at T1, children with higher levels of inhibition expressed fewer internalizing symptoms than did children at lower levels of inhibition. In addition, children with higher levels of behavioral inhibition and lower cortisol activity at T1 exhibited reductions in anxious, vigilant behavior from T1 to T2, whereas at lower levels of behavioral inhibition, variations in the T1 cortisol rise bore no relation to changes in this behavior. These results suggest that the rise in cortisol at child care may have differential predictive value as a function of behaviorally inhibited temperament.     

The representational locus of spatial influence on backward inhibition

When one is sequentially switching among three tasks, performance is impaired when tasks alternate (ABA) relative to when one is switching between all three tasks (CBA), an effect known as backward inhibition (BI). BI is not observed when component tasks are uniquely located in space, however (Arbuthnott, 2005). In this study, the locations of task precues and target stimuli were manipulated independently to determine whether this elimination of BI is related to distinct cue location or to distinct target location. Results clearly indicated that BI is eliminated with distinct cue localization independent of the location of target stimuli. This indicates that BI, which reflects suppression of task-set representations, can be influenced by cue characteristics that are associated with task representations.