Switching in the cocktail party: exploring intentional control of auditory selective attention

Using a novel variant of dichotic selective listening, we examined the control of auditory selective attention. In our task, subjects had to respond selectively to one of two simultaneously presented auditory stimuli (number words), always spoken by a female and a male speaker, by performing a numerical size categorization. The gender of the task-relevant speaker could change, as indicated by a visual cue prior to auditory stimulus onset. Three experiments show clear performance costs with instructed attention switches. Experiment 2 varied the cuing interval to examine advance preparation for an attention switch. Experiment 3 additionally isolated auditory switch costs from visual cue priming by using two cues for each gender, so that gender repetition could be indicated by a changed cue. Experiment 2 showed that switch costs decreased with prolonged cuing intervals, but Experiment 3 revealed that preparation did not affect auditory switch costs but only visual cue priming. Moreover, incongruent numerical categories in competing auditory stimuli produced interference and substantially increased error rates, suggesting continued processing of task-relevant information that often leads to responding to the incorrect auditory source. Together, the data show clear limitations in advance preparation of auditory attention switches and suggest a considerable degree of inertia in intentional control of auditory selection criteria.     

Foreign accent strength and listener familiarity with an accent codetermine speed of perceptual adaptation

We investigated how the strength of a foreign accent and varying types of experience with foreign-accented speech influence the recognition of accented words. In Experiment 1, native Dutch listeners with limited or extensive prior experience with German-accented Dutch completed a cross-modal priming experiment with strongly, medium, and weakly accented words. Participants with limited experience were primed by the medium and weakly accented words, but not by the strongly accented words. Participants with extensive experience were primed by all accent types. In Experiments 2 and 3, Dutch listeners with limited experience listened to a short story before doing the cross-modal priming task. In Experiment 2, the story was spoken by the priming task speaker and either contained strongly accented words or did not. Strongly accented exposure led to immediate priming by novel strongly accented words, while exposure to the speaker without strongly accented tokens led to priming only in the experiment’s second half. In Experiment 3, listeners listened to the story with strongly accented words spoken by a different German-accented speaker. Listeners were primed by the strongly accented words, but again only in the experiment’s second half. Together, these results show that adaptation to foreign-accented speech is rapid but depends on accent strength and on listener familiarity with those strongly accented words.     

Prospective memory: Effects of divided attention on spontaneous retrieval

We examined the effects of divided attention on the spontaneous retrieval of a prospective memory intention. Participants performed an ongoing lexical decision task with an embedded prospective memory demand, and also performed a divided-attention task during some segments of lexical decision trials. In all experiments, monitoring was highly discouraged, and we observed no evidence that participants engaged monitoring processes. In Experiment 1, performing a moderately demanding divided-attention task (a digit detection task) did not affect prospective memory performance. In Experiment 2, performing a more challenging divided-attention task (random number generation) impaired prospective memory. Experiment 3 showed that this impairment was eliminated when the prospective memory cue was perceptually salient. Taken together, the results indicate that spontaneous retrieval is not automatic and that challenging divided-attention tasks interfere with spontaneous retrieval and not with the execution of a retrieved intention.     

Boundaries of semantic distraction: Dominance and lexicality act at retrieval

Three experiments investigated memory for semantic information with the goal of determining boundary conditions for the manifestation of semantic auditory distraction. Irrelevant speech disrupted the free recall of semantic category- exemplars to an equal degree regardless of whether the speech coincided with presentation or test phases of the task (Experiment 1), and this occurred regardless of whether it comprised random words or coherent sentences (Experiment 2). The effects of background speech were greater when the irrelevant speech was semantically related to the to-be-remembered material, but only when the irrelevant words were high in output dominance (Experiment 3). The implications of these findings in relation to the processing of task material and the processing of background speech are discussed.     

Does crossmodal correspondence modulate the facilitatory effect of auditory cues on visual search?

The ??pip-and-pop effect?? refers to the facilitation of search for a visual target (a horizontal or vertical bar whose color changes frequently) among multiple visual distractors (tilted bars also changing color unpredictably) by the presentation of a spatially uninformative auditory cue synchronized with the color change of the visual target. In the present study, the visual stimuli in the search display changed brightness instead of color, and the crossmodal congruency between the pitch of the auditory cue and the brightness of the visual target was manipulated. When cue presence and cue congruency were randomly varied between trials (Experiment 1), both congruent cues (low-frequency tones synchronized with dark target states or high-frequency tones synchronized with bright target states) and incongruent cues (the reversed mapping) facilitated visual search performance equally, relative to a no-cue baseline condition. However, when cue congruency was blocked and the participants were informed about the pitch?Cbrightness mapping in the cue-present blocks (Experiment 2), performance was significantly enhanced when the cue and target were crossmodally congruent as compared to when they were incongruent. These results therefore suggest that the crossmodal congruency between auditory pitch and visual brightness can influence performance in the pip-and-pop task by means of top-down facilitation.     

Response retrieval in a go/no-go priming-of-popout task

Priming of popout is the finding that singleton search is faster when features of a target and of nontargets are repeated across trials than when the features switch. Theoretical accounts suggest that intertrial repetition influences perceptual and attentional selection processes, episodic retrieval processes, or both. The present study combined a popout search task with a go/no-go task. In Experiment 1, the nontarget distractors in each display carried the go/no-go feature, and in Experiment 2, the texture of all items carried the go/no-go feature. Results showed that the go/no-go task moderated the intertrial repetition effects. In Experiment 1, the target color elicited retrieval of the preceding distractor color and associated no-go response, resulting in larger interference effects. In Experiment 2, the target color elicited retrieval of the preceding target color and no-go response, resulting in reduced facilitation effects. Additional results from both experiments showed that the colors in a search display also influenced target selection on the following trial. Taken together, the results of both experiments suggest that intertrial repetition influences both early selection and postselection retrieval processes.     

Evidence for habituation of the irrelevant-sound effect on serial recall

Working memory theories make opposing predictions as to whether the disruptive effect of task-irrelevant sound on serial recall should be attenuated after repeated exposure to the auditory distractors. Although evidence of habituation has emerged after a passive listening phase, previous attempts to observe habituation to to-be ignored distractors on a trial-by-trial basis have proven to be fruitless. With the present study, we suggest that habituation to auditory distractors occurs, but has often been overlooked because past attempts to measure habituation in the irrelevant-sound paradigm were not sensitive enough. In a series of four experiments, the disruptive effects of to-be-ignored speech and music relative to a quiet control condition were markedly reduced after eight repetitions, regardless of whether trials were presented in blocks (Exp. 1) or in a random order (Exp. 2). The auditory distractor’s playback direction (forward, backward) had no effect (Exp. 3). The same results were obtained when the auditory distractors were only presented in a retention interval after the presentation of the to-be-remembered items (Exp. 4). This pattern is only consistent with theoretical accounts that allow for attentional processes to interfere with the maintenance of information in working memory.     

Time-compressed spoken word primes crossmodally enhance processing of semantically congruent visual targets

Findings from three experiments support the conclusion that auditory primes facilitate the processing of related targets. In Experiments 1 and 2, we employed a crossmodal Stroop color identification task with auditory color words (as primes) and visual color patches (as targets). Responses were faster for congruent priming, in comparison to neutral or incongruent priming. This effect also emerged for different levels of time compression of the auditory primes (to 30 % and 10 % of the original length; i.e., 120 and 40 ms) and turned out to be even more pronounced under high-perceptual-load conditions (Exps. 1 and 2). In Experiment 3, target-present or -absent decisions for brief target displays had to be made, thereby ruling out response-priming processes as a cause of the congruency effects. Nevertheless, target detection (d') was increased by congruent primes (30 % compression) in comparison to incongruent or neutral primes. Our results suggest semantic object-based auditory–visual interactions, which rapidly increase the denoted target object’s salience. This would apply, in particular, to complex visual scenes.     

Escaping the recent past: Which stimulus dimensions influence proactive interference?

Proactive interference occurs when information from the past disrupts current processing and is a major source of confusion and errors in short-term memory (STM; Wickens, Born, & Allen, Journal of Verbal Learning and Verbal Behavior, 2:440–445, 1963). The present investigation examines potential boundary conditions for interference, testing the hypothesis that potential competitors must be similar along task-relevant dimensions to influence proactive interference effects. We manipulated both the type of task being completed (Experiments 1, 2, and 3) and dimensions of similarity irrelevant to the current task (Experiments 4 and 5) to determine how the recent presentation of a probe item would affect the speed with which participants could reject that item. Experiments 1, 2, and 3 contrasted STM judgments, which require temporal information, with semantic and perceptual judgments, for which temporal information is irrelevant. In Experiments 4 and 5, task-irrelevant information (perceptual similarity) was manipulated within the recent probes task. We found that interference from past items affected STM task performance but did not affect performance in semantic or perceptual judgment tasks. Conversely, similarity along a nominally irrelevant perceptual dimension did not affect the magnitude of interference in STM tasks. Results are consistent with the view that items in STM are represented by noisy codes consisting of multiple dimensions and that interference occurs when items are similar to each other and, thus, compete along the dimensions relevant to target selection.     

Age-of-acquisition effects in delayed picture-naming tasks

We report two experiments that explored the linguistic locus of age-of-acquisition effects in picture naming by using a delayed naming task that involved only a low proportion of trials (25 %) while, for the large majority of the trials (75 %), participants performed another task—that is, the prevalent task. The prevalent tasks were semantic categorization in Experiment 1a and grammatical-gender decision in Experiments 1b and 2. In Experiment 1a, in which participants were biased to retrieve semantic information in order to perform the semantic categorization task, delayed naming times were affected by age of acquisition, reflecting a postsemantic locus of the effect. In Experiments 1b and 2, in which participants were biased to retrieve lexical information in order to perform the grammatical gender decision task, there was also an age-of-acquisition effect. These results suggest that part of the age-of-acquisition effect in picture naming occurs at the level at which the phonological properties of words are retrieved.     

A comparison of visual and auditory representational momentum in spatial tasks

Similarities have been observed in the localization of the final position of moving visual and moving auditory stimuli: Perceived endpoints that are judged to be farther in the direction of motion in both modalities likely reflect extrapolation of the trajectory, mediated by predictive mechanisms at higher cognitive levels. However, actual comparisons of the magnitudes of displacement between visual tasks and auditory tasks using the same experimental setup are rare. As such, the purpose of the present free-field study was to investigate the influences of the spatial location of motion offset, stimulus velocity, and motion direction on the localization of the final positions of moving auditory stimuli (Experiment 1 and 2) and moving visual stimuli (Experiment 3). To assess whether auditory performance is affected by dynamically changing binaural cues that are used for the localization of moving auditory stimuli (interaural time differences for low-frequency sounds and interaural intensity differences for high-frequency sounds), two distinct noise bands were employed in Experiments 1 and 2. In all three experiments, less precise encoding of spatial coordinates in paralateral space resulted in larger forward displacements, but this effect was drowned out by the underestimation of target eccentricity in the extreme periphery. Furthermore, our results revealed clear differences between visual and auditory tasks. Displacements in the visual task were dependent on velocity and the spatial location of the final position, but an additional influence of motion direction was observed in the auditory tasks. Together, these findings indicate that the modality-specific processing of motion parameters affects the extrapolation of the trajectory.     

A severe capacity limit in the consolidation of orientation information into visual short-term memory

Previous research has suggested that two color patches can be consolidated into visual short-term memory (VSTM) via an unlimited parallel process. Here we examined whether the same unlimited-capacity parallel process occurs for two oriented grating patches. Participants viewed two gratings that were presented briefly and masked. In blocks of trials, the gratings were presented either simultaneously or sequentially. In Experiments 1 and 2, the presentation of the stimuli was followed by a location cue that indicated the grating on which to base one’s response. In Experiment 1, participants responded whether the target grating was oriented clockwise or counterclockwise with respect to vertical. In Experiment 2, participants indicated whether the target grating was oriented along one of the cardinal directions (vertical or horizontal) or was obliquely oriented. Finally, in Experiment 3, the location cue was replaced with a third grating that appeared at fixation, and participants indicated whether either of the two test gratings matched this probe. Despite the fact that these responses required fairly coarse coding of the orientation information, across all methods of responding we found superior performance for sequential over simultaneous presentations. These findings suggest that the consolidation of oriented gratings into VSTM is severely limited in capacity and differs from the consolidation of color information.     

Investigating the speed–accuracy trade-off: Better use deadlines or response signals?

Deadlines (DLs) and response signals (RSs) are two well-established techniques for investigating speed–accuracy trade-offs (SATs). Methodological differences imply, however, that corresponding data do not necessarily reflect equivalent processes. Specifically, the DL procedure grants knowledge about trial-specific time demands and requires responses before a prespecified period has elapsed. In contrast, RS intervals often vary unpredictably between trials, and responses must be given after an explicit signal. Here, we investigated the effects of these differences in a flanker task. While all conditions yielded robust SAT functions, a right-shift of the curves pointed to reduced performance in RS conditions (Experiment 1, blocked; Experiments 2 and 3, randomized), as compared with DL conditions (Experiments 1–3, blocked), indicating that the detection of the RS imposes additional task demands. Moreover, the flanker effect vanished at long intervals in RS settings, suggesting that stimulus-related effects are absorbed in a slack when decisions are completed prior to the signal. In turn, effects of a flat (Experiment 2) versus a performance-contingent payment (Experiment 3) indicated that susceptibility to response strategies is higher in the DL than in the RS method. Finally, the RS procedure led to a broad range of slow responses and high accuracies, whereas DL conditions resulted in smaller variations in the upper data range (Experiments 1 and 2); with performance-contingent payment (Experiment 3), though, data ranges became similar. Together, the results uncover characteristic procedure-related effects and should help in selection of the appropriate technique.     

Exploiting illusory effects to disclose similarities in numerical and luminance processing

Recent studies have suggested that numerical and physical magnitudes are similarly processed by a generalized magnitude system. The present study investigates the number?Cluminance interaction, taking advantage of illusory effects in a cued line bisection task with numerical or nonnumerical flankers and varying levels of luminance. The results showed that both dimensions influenced bisection performance. Whereas numbers (Experiment 1) induced a systematic shift of the subjective midpoint toward the larger digit, luminance (Experiment 2) modulated the bisection performance toward the darker flanker. By combining these two illusions (Experiments 3 and 4), the two dimensions interfered with each other. This pattern of results suggests overlapping representations for physical and numerical magnitudes and highlights the value of illusory effects in cognitive research.     

Consolidation of statistical information of multiple objects in working memory

The present study investigated working memory consolidation in focused and distributed attention tasks by examining the time course of the consolidation process (Experiment 1) and its dependence on capacity-limited central resources (Experiment 2) in both tasks. In a match-to-sample design using masks at various intervals to vary consolidation rates, the participants performed either an identification task (focused attention) or a mean estimation task (distributed attention) with (Experiment 1) or without (Experiment 2) prior knowledge of what task they were to perform. We found that consolidation in the distributed attention task was more efficient and was about twice as fast as in the focused attention task. In addition, both tasks suffered interference when they had to be performed together, indicating that both types of attention rely on a common set of control processes. These findings can be attributed to differences in the resolution of object representations and in the scope of attention associated with focused and distributed attention.     

Dissociations between vision for perception and vision for action depend on the relative availability of egocentric and allocentric information

In three experiments, we scrutinized the dissociation between perception and action, as reflected by the contributions of egocentric and allocentric information. In Experiment 1, participants stood at the base of a large-scale one-tailed version of a Müller-Lyer illusion (with a hoop) and either threw a beanbag to the endpoint of the shaft or verbally estimated the egocentric distance to that location. The results confirmed an effect of the illusion on verbal estimates, but not on throwing, providing evidence for a dissociation between perception and action. In Experiment 2, participants observed a two-tailed version of the Müller-Lyer illusion from a distance of 1.5 m and performed the same tasks as in Experiment 1, yet neither the typical illusion effects nor a dissociation became apparent. Experiment 3 was a replication of Experiment 1, with the difference that participants stood at a distance of 1.5 m from the base of the one-tailed illusion. The results indicated an illusion effect on both the verbal estimate task and the throwing task; hence, there was no dissociation between perception and action. The presence (Exp. 1) and absence (Exp. 3) of a dissociation between perception and action may indicate that dissociations are a function of the relative availability of egocentric and allocentric information. When distance estimates are purely egocentric, dissociations between perception and action occur. However, when egocentric distance estimates have a (complementary) exocentric component, the use of allocentric information is promoted, and dissociations between perception and action are reduced or absent.     

Breaking a habit: A further role of the phonological loop in action control

Recent research has suggested that keeping track of a task goal in rapid task switching may depend on the phonological loop component of working memory. In this study, we investigated whether the phonological loop plays a similar role when a single switch extending over several trials is required after many trials on which one has performed a competing task. Participants were shown pairs of digits varying in numerical and physical size, and they were required to decide which digit was numerically or physically larger. An experimental cycle consisted of four blocks of 24 trials. In Experiment 1, participants in the task change groups performed the numerical-size judgment task during the first three blocks, and then changed to the physical-size judgment task in the fourth. Participants in the continuation groups performed only the physical-size judgment task throughout all four blocks. We found negative effects of articulatory suppression on the fourth block, but only in the task change groups. Experiment 2 was a replication, with the modification that both groups received identical instructions and practice. Experiment 3 was a further replication using numerical-size judgment as the target task. The results showed a pattern similar to that from Experiment 1, with negative effects of articulatory suppression found only in the task change group. The congruity of numerical and physical size had a reliable effect on performance in all three experiments, but unlike the task change, it did not reliably interact with articulatory suppression. The results suggest that in addition to its well-established role in rapid task switching, the phonological loop also contributes to active goal maintenance in longer-term action control.     

Saccade latency reveals episodic representation of object color

While previous studies suggest that identity, but not color, plays a role in episodic object representation, such studies have typically used tasks in which only identity is relevant, raising the possibility that the results reflect task demands, rather than the general principles that underlie object representation. In the present study, participants viewed a preview display containing one (Experiments 1 and 2) or two (Experiment 3) letters, then viewed a target display containing a single letter, in either the same or a different location. Participants executed an immediate saccade to fixate the target; saccade latency served as the dependent variable. In all experiments, saccade latencies were longer to fixate a target appearing in its previewed location, consistent with a bias to attend to new objects rather than to objects for which episodic representations are being maintained in visual working memory. The results of Experiment 3 further demonstrate, however, that changing target color eliminates these latency differences. The results suggest that color and identity are part of episodic representation even when not task relevant and that examining biases in saccade execution may be a useful approach to studying episodic representation.     

Memory as discrimination: What distraction reveals

Recalling information involves the process of discriminating between relevant and irrelevant information stored in memory. Not infrequently, the relevant information needs to be selected from among a series of related possibilities. This is likely to be particularly problematic when the irrelevant possibilities not only are temporally or contextually appropriate, but also overlap semantically with the target or targets. Here, we investigate the extent to which purely perceptual features that discriminate between irrelevant and target material can be used to overcome the negative impact of contextual and semantic relatedness. Adopting a distraction paradigm, it is demonstrated that when distractors are interleaved with targets presented either visually (Experiment 1) or auditorily (Experiment 2), a within-modality semantic distraction effect occurs; semantically related distractors impact upon recall more than do unrelated distractors. In the semantically related condition, the number of intrusions in recall is reduced, while the number of correctly recalled targets is simultaneously increased by the presence of perceptual cues to relevance (color features in Experiment 1 or speaker’s gender in Experiment 2). However, as is demonstrated in Experiment 3, even presenting semantically related distractors in a language and a sensory modality (spoken Welsh) distinct from that of the targets (visual English) is insufficient to eliminate false recalls completely or to restore correct recall to levels seen with unrelated distractors . Together, the study shows how semantic and nonsemantic discriminability shape patterns of both erroneous and correct recall.     

Monitoring the capacity of working memory: Executive control and effects of listening effort

In two experiments, we used an interruption-and-recall (IAR) task to explore listeners’ ability to monitor the capacity of working memory as new information arrived in real time. In this task, listeners heard recorded word lists with instructions to interrupt the input at the maximum point that would still allow for perfect recall. Experiment 1 demonstrated that the most commonly selected segment size closely matched participants’ memory span, as measured in a baseline span test. Experiment 2 showed that reducing the sound level of presented word lists to a suprathreshold but effortful listening level disrupted the accuracy of matching selected segment sizes with participants’ memory spans. The results are discussed in terms of whether online capacity monitoring may be subsumed under other, already enumerated working memory executive functions (inhibition, set shifting, and memory updating).