Auditory temporal pattern learning in children with speech and language impairments

Four children demonstrating speech and language impairments were examined with respect to their ability to learn to identify certain auditory temporal perceptual information. These children listened to six-element temporal patterns and made judgments about the temporal proximity of two of the elements. Subjects listened to the patterns over a number of exposures ranging from 6 to 14, depending on the subject. Performance on the task improved significantly with repeated exposures. However, the disordered subjects' best performance was still significantly poorer than normal children who had only 1 exposure to the task. These results suggest that, in part, performance differences on temporal perceptual tasks between speech and language disordered children and normal children can be accounted for by differences in perceptual learning. However, because the disordered children never reached normal levels, learning differences may be associated with a fundamental deficit in temporal processing or some other mechanism such as impaired attention.     

Perceptual and decisional contributions to audiovisual interactions in the perception of apparent motion: a signal detection study

Motion information available to different sensory modalities can interact at both perceptual and post-perceptual (i.e., decisional) stages of processing. However, to date, researchers have only been able to demonstrate the influence of one of these components at any given time, hence the relationship between them remains uncertain. We addressed the interplay between the perceptual and post-perceptual components of information processing by assessing their influence on performance within the same experimental paradigm. We used signal detection theory to discriminate changes in perceptual sensitivity (d') from shifts in response criterion (c) in performance on a detection (Experiment 1) and a classification (Experiment 2) task regarding the direction of auditory apparent motion streams presented in noise. In the critical conditions, a visual motion distractor moving either leftward or rightward was presented together with the auditory motion. The results demonstrated a significant decrease in sensitivity to the direction of the auditory targets in the crossmodal conditions as compared to the unimodal baseline conditions that was independent of the relative direction of the visual distractor. In addition, we also observed significant shifts in response criterion, which were dependent on the relative direction of the distractor apparent motion. These results support the view that the perceptual and decisional components involved in audiovisual interactions in motion processing can coexist but are largely independent of one another.     

Knowing when to hear aids what to hear

Temporal preparation often has been assumed to influence motor stages of information processing. Recent studies, however, challenge this notion and provide evidence for a facilitation of visual processing. The present study was designed to investigate whether perceptual processing in the auditory domain also benefits from temporal preparation. To this end, we employed a pitch discrimination task. In Experiment 1, discrimination performance was clearly improved when participants were temporally prepared. This finding was confirmed in Experiment 2, which ruled out possible influences of short-term memory. The results support the notion that temporal preparation enhances perceptual processing not only in the visual, but also in the auditory, modality.     

Hearing what the eyes see: auditory encoding of visual temporal sequences

When the senses deliver conflicting information, vision dominates spatial processing, and audition dominates temporal processing. We asked whether this sensory specialization results in cross-modal encoding of unisensory input into the task-appropriate modality. Specifically, we investigated whether visually portrayed temporal structure receives automatic, obligatory encoding in the auditory domain. In three experiments, observers judged whether the changes in two successive visual sequences followed the same or different rhythms. We assessed temporal representations by measuring the extent to which both task-irrelevant auditory information and task-irrelevant visual information interfered with rhythm discrimination. Incongruent auditory information significantly disrupted task performance, particularly when presented during encoding; by contrast, varying the nature of the rhythm-depicting visual changes had minimal impact on performance. Evidently, the perceptual system automatically and obligatorily abstracts temporal structure from its visual form and represents this structure using an auditory code, resulting in the experience of "hearing visual rhythms."     

Late maturation of auditory perceptual learning

Adults can improve their performance on many perceptual tasks with training, but when does the response to training become mature? To investigate this question, we trained 11‐year‐olds, 14‐year‐olds and adults on a basic auditory task (temporal‐interval discrimination) using a multiple‐session training regimen known to be effective for adults. The adolescents all began with performance in the adult range. However, while all of the adults improved across sessions, none of the 11‐year‐olds and only half of the 14‐year‐olds did. The adolescents who failed to learn did so even though the 10‐session training regimen provided twice the number of sessions required by adults to reach asymptotic performance. Further, over the course of each session, the performance of the adults was stable but that of the adolescents, including those who learned, deteriorated. These results demonstrate that the processes that underlie perceptual learning can continue to develop well into adolescence.     

Knowing when to hear aids what to hear

Temporal preparation often has been assumed to influence motor stages of information processing. Recent studies, however, challenge this notion and provide evidence for a facilitation of visual processing. The present study was designed to investigate whether perceptual processing in the auditory domain also benefits from temporal preparation. To this end, we employed a pitch discrimination task. In Experiment 1, discrimination performance was clearly improved when participants were temporally prepared. This finding was confirmed in Experiment 2, which ruled out possible influences of short-term memory. The results support the notion that temporal preparation enhances perceptual processing not only in the visual, but also in the auditory, modality.     

IMPLICIT MEMORY IN AMNESIC PATIENTS:

Abstract— Previous observations of spared priming in amnesic patients have been based almost entirely on data from visual implicit memory tests Our research examined perceptual priming.in amnesic patients and control subjects on an auditory identification task in which previously spoken words and new words were presented in white noise We manipulated type of encoding task (semantic vs nonsemantic) and speaker's voice at study and test (same vs different) Priming was little affected.by either manipulation, and amnesic patients exhibited normal priming in all experimental conditions On an explicit test of recognition memory, by contrast, amnesic patients exhibited.severely impaired performance following the semantic study task, all subjects showed poor explicit memory following the nonsemantic study task Results are consistent with the idea that auditory priming depends largely on a presemantic auditory perceptual representation system     

It's about time: revisiting temporal processing deficits in dyslexia

Temporal processing in French children with dyslexia was evaluated in three tasks: a word identification task requiring implicit temporal processing, and two explicit temporal bisection tasks, one in the auditory and one in the visual modality. Normally developing children matched on chronological age and reading level served as a control group. Children with dyslexia exhibited robust deficits in temporal tasks whether they were explicit or implicit and whether they involved the auditory or the visual modality. First, they presented larger perceptual variability when performing temporal tasks, whereas they showed no such difficulties when performing the same task on a non‐temporal dimension (intensity). This dissociation suggests that their difficulties were specific to temporal processing and could not be attributed to lapses of attention, reduced alertness, faulty anchoring, or overall noisy processing. In the framework of cognitive models of time perception, these data point to a dysfunction of the ‘internal clock’ of dyslexic children. These results are broadly compatible with the recent temporal sampling theory of dyslexia.     

Crossmodal duration perception involves perceptual grouping, temporal ventriloquism, and variable internal clock rates

Here, we investigate how audiovisual context affects perceived event duration with experiments in which observers reported which of two stimuli they perceived as longer. Target events were visual and/or auditory and could be accompanied by nontargets in the other modality. Our results demonstrate that the temporal information conveyed by irrelevant sounds is automatically used when the brain estimates visual durations but that irrelevant visual information does not affect perceived auditory duration (Experiment 1). We further show that auditory influences on subjective visual durations occur only when the temporal characteristics of the stimuli promote perceptual grouping (Experiments 1 and 2). Placed in the context of scalar expectancy theory of time perception, our third and fourth experiments have the implication that audiovisual context can lead both to changes in the rate of an internal clock and to temporal ventriloquism-like effects on perceived on- and offsets. Finally, intramodal grouping of auditory stimuli diminished any crossmodal effects, suggesting a strong preference for intramodal over crossmodal perceptual grouping (Experiment 5).     

IMPLICIT MEMORY IN THE TACTILE MODALITY:

Abstract— Research on perceptual priming has previously focused exclusively on priming in the visual and auditory modalities. The present study explored whether perceptual priming also extends to the tactile modality. Tactile priming for Braille words was examined in a group of blind participants, using a Braille analogue of the stem-completion task. The results for tactile priming paralleled previous stem-completion results in other modalities. Manipulating the encoding task at study (semantic vs nonsemantic) dissociated implicit and explicit Braille stem-completion performance, and priming was unaffected by the number of study presentations (one vs three). Finally, Braille stem-completion priming was found in a cross-modal paradigm to have both a specifically tactile component and a cross-modal component. These results demonstrate for the first time that verbal priming can occur in the tactile domain and that tactile priming has basic functional similarities with stem-completion priming in the visual and auditory domains.     

The speed and accuracy of perceptual decisions in a random-tone pitch task

Research in perceptual decision making is dominated by paradigms that tap the visual system, such as the random-dot motion (RDM) paradigm. In this study, we investigated whether the behavioral signature of perceptual decisions in the auditory domain is similar to those observed in the visual domain. We developed an auditory version of the RDM task, in which tones correspond to dots and pitch corresponds to motion (the random-tone pitch task, RTP). In this task, participants have to decide quickly whether the pitch of a “sound cloud” of tones is moving up or down. Stimulus strength and speed–accuracy trade-off were manipulated. To describe the relationship between stimulus strength and performance, we fitted the proportional-rate diffusion model to the data. The results showed a close coupling between stimulus strength and the speed and accuracy of perceptual decisions in both tasks. Additionally, we fitted the full drift diffusion model (DDM) to the data and showed that three of the four participants had similar speed–accuracy trade-offs in both tasks. However, for the RTP task, drift rates were larger and nondecision times slower, suggesting that some DDM parameters might be dependent on stimulus modality (drift rate and nondecision time), whereas others might not be (decision bound). The results illustrate that the RTP task is suitable for investigating the dynamics of auditory perceptual choices. Future studies using the task might help to investigate modality-specific effects on decision making at both the behavioral and neuronal levels.     

Illusory recouplings of onsets and terminations of glide tone components

We present a new auditory illusion, the gap transfer illusion, supported by phenomenological and psychophysical data. In a typical situation, an ascending frequency glide of 2,500 msec with a temporal gap of 100 msec in the middle and a continuously descending frequency glide of 500 msec cross each other at their central positions. These glides move at the same constant speed in logarithmic frequency in opposite directions. The temporal gap in the long glide is perceived as if it were in the short glide. The same kind of subjective transfer of a temporal gap can take place also when the stimulus pattern is reversed in time. This phenomenon suggests that onsets and terminations of glide components behave as if they were independent perceptual elements. We also find that when two long frequency glides are presented successively with a short temporal overlap, a long glide tone covering the whole duration of the pattern and a short tone around the temporal middle can be perceived. To account for these results, we propose an event construction model, in which perceptual onsets and terminations are coupled to construct auditory events and the proximity principle connects these elements.     

Visual attention and perceptual grouping.

Perceptual organization is thought to involve an analysis of both textural discontinuities and perceptual grouping. In earlier work, we found that textural discontinuities were detected normally even when visual attention was engaged elsewhere. Here we report how perceptual grouping is affected when visual attention is engaged by a concurrent visual task. To elicit perceptual grouping, we used the Gestalt demonstrations of grouping on the basis of proximity and of similarity. Four tasks were investigated, some requiring the observer to discriminate between horizontal and vertical grouping, and some requiring the observer to merely detect the presence or absence of grouping. Visual attention was engaged at the center of the display by a form identification task. The detection of a textural discontinuity served as a control task. Concurrent form identification conflicted with all four grouping tasks, resulting in a significant reduction of grouping performance in each case. No performance reduction was observed when either form identification or grouping discrimination was combined with the detection of a textural discontinuity. These results suggest that perceptual grouping and form identification compete for visual attention, whereas the detection of a textural discontinuity does not.     

Temporal expectation weights visual signals over auditory signals

Temporal expectation is a process by which people use temporally structured sensory information to explicitly or implicitly predict the onset and/or the duration of future events. Because timing plays a critical role in crossmodal interactions, we investigated how temporal expectation influenced auditory–visual interaction, using an auditory–visual crossmodal congruity effect as a measure of crossmodal interaction. For auditory identification, an incongruent visual stimulus produced stronger interference when the crossmodal stimulus was presented with an expected rather than an unexpected timing. In contrast, for visual identification, an incongruent auditory stimulus produced weaker interference when the crossmodal stimulus was presented with an expected rather than an unexpected timing. The fact that temporal expectation made visual distractors more potent and visual targets less susceptible to auditory interference suggests that temporal expectation increases the perceptual weight of visual signals.     

The effect of generation on long-term repetition priming in auditory and visual perceptual identification

Perceptual implicit memory is typically most robust when the perceptual processing at encoding matches the perceptual processing required during retrieval. A consistent exception is the robust priming that semantic generation produces on the perceptual identification test (Masson & MacLeod, 2002), a finding which has been attributed to either (1) conceptual influences in this nominally perceptual task, or (2) covert orthographic processing during generative encoding. The present experiments assess these possibilities using both auditory and visual perceptual identification, tests in which participants identify auditory words in noise or rapidly-presented visual words. During the encoding phase of the experiments, participants generated some words and perceived others in an intermixed study list. The perceptual control condition was visual (reading) or auditory (hearing), and varied across participants. The reading and hearing conditions exhibited the expected modality–specificity, producing robust intra-modal priming and non-significant cross-modal priming. Priming in the generate condition depended on the perceptual control condition. With a read control condition, semantic generation produced robust visual priming but no auditory priming. With a hear control condition, the results were reversed: semantic generation produced robust auditory priming but not visual priming. This set of results is not consistent with a straightforward application of either the conceptual-influence or covert-orthography account, and implies that the nature of encoding in the generate condition is influenced by the broader list context.     

Crossmodal action selection: Evidence from dual-task compatibility

Response-related mechanisms of multitasking were studied by analyzing simultaneous processing of responses in different modalities (i.e., crossmodal action). Participants responded to a single auditory stimulus with a saccade, a manual response (single-task conditions), or both (dual-task condition). We used a spatially incompatible stimulus-response mapping for one task, but not for the other. Critically, inverting these mappings varied temporal task overlap in dual-task conditions while keeping spatial incompatibility across responses constant. Unlike previous paradigms, temporal task overlap was manipulated without utilizing sequential stimulus presentation, which might induce strategic serial processing. The results revealed dual-task costs, but these were not affected by an increase of temporal task overlap. This finding is evidence for parallel response selection in multitasking. We propose that crossmodal action is processed by a central mapping-selection mechanism in working memory and that the dual-task costs are mainly caused by mapping-related crosstalk.     

Visual attention and perceptual grouping

Perceptual organization is thought to involve an analysis of bothtextural discontinuities andperceptual grouping. In earlier work, we found that textural discontinuities were detected normally even when visual attention was engaged elsewhere. Here we report how perceptual grouping is affected when visual attention is engaged by a concurrent visual task. To elicit perceptual grouping, we used the Gestalt demonstrations of grouping on the basis of proximity and of similarity. Four tasks were investigated, some requiring the observer to discriminate between horizontal and vertical grouping, and some requiring the observer to merely detect the presence or absence of grouping. Visual attention was engaged at the center of the display by a form identification task. The detection of a textural discontinuity served as a control task. Concurrent form identification conflicted with all four grouping tasks, resulting in a significant reduction of grouping performance in each case. No performance reduction was observed when either form identification or grouping discrimination was combined with the detection of a textural discontinuity. These results suggest that perceptual grouping and form identification compete for visual attention, whereas the detection of a textural discontinuity does not.     

0 + 1 > 1: How adding noninformative sound improves performance on a visual task

It is well known that the nervous system combines information from different cues within and across sensory modalities to improve performance on perceptual tasks. In this article, we present results showing that in a visual motion-detection task, concurrent auditory motion stimuli improve accuracy even when they do not provide any useful information for the task. When participants judged which of two stimulus intervals contained visual coherent motion, the addition of identical moving sounds to both intervals improved accuracy. However, this enhancement occurred only with sounds that moved in the same direction as the visual motion. Therefore, it appears that the observed benefit of auditory stimulation is due to auditory-visual interactions at a sensory level. Thus, auditory and visual motion-processing pathways interact at a sensory-representation level in addition to the level at which perceptual estimates are combined.     

On the relationship between visual imagery and visual perception: Evidence from priming studies

Two priming experiments using a perceptual identification task were conducted to explore the functional and representational overlap between visual imagery and visual perception. The first experiment included a study phase in which primes were either perceived or imaged objects and a perceptual identification test task in which targets were parts of studied and non-studied objects. Imagery primed identification when subjects were instructed to count the parts of the imaged objects in the study phase but not when they were instructed to focus on the global shape of the imaged objects. This result suggests that imagery involves perceptual representations identical to those involved in perception. It also suggests that the representational overlap between imagery and perception depends on the type of images generated, as some images may consist in global shapes only, whereas others may consist in detailed, multi-part shapes. In the second experiment, we used whole objects as target stimuli which provided subjects with more information to identify masked targets and thereby reduced top-down processing. Priming from imagery fell beneath significance, suggesting that this sort of priming is elicited in a large part by a transfer of top-down processes from study to test.     

Independent priming of location and color in identification of briefly presented letters

Attention shifts are facilitated if the items to be attended remain the same across trials. Some researchers argue that this priming effect is perceptual, whereas others propose that priming is postperceptual, involving facilitated response selection. The experimental findings have not been consistent regarding the roles of variables such as task difficulty, response repetition, expectancies, and decision-making. Position priming, when repetition of a target position facilitates responses on a subsequent trial, is another source of disagreement among researchers. Experimental results have likewise been inconsistent as to whether position priming is dependent on the repetition of target features or has an independent effect on attention shifts. We attempted to isolate the perceptual components of priming by presenting brief (10–180 ms) search arrays to eight healthy observers. The task was to identify a color-singleton letter among distractors. All stimulus presentation contingencies were randomized, and responses were unspeeded, to avoid effects of observer expectation and postperceptual effects. Repeating target color and/or position strongly improved performance. The effects of color and position repetition were independent of one another and were stable across participants. The results argue for a strong perceptual component in priming, which biases selection toward recent target features and positions, showing that perceptual mechanisms are sufficient to produce priming in visual search and that such effects can be elicited with limited sensory evidence. The results are the first to demonstrate independent priming of color and position in the identification of briefly presented, postmasked stimuli.