Cross-modal source information and spoken word recognition

In a cross-modal matching task, participants were asked to match visual and auditory displays of speech based on the identity of the speaker. The present investigation used this task with acoustically transformed speech to examine the properties of sound that can convey cross-modal information. Word recognition performance was also measured under the same transformations. The authors found that cross-modal matching was only possible under transformations that preserved the relative spectral and temporal patterns of formant frequencies. In addition, cross-modal matching was only possible under the same conditions that yielded robust word recognition performance. The results are consistent with the hypothesis that acoustic and optical displays of speech simultaneously carry articulatory information about both the underlying linguistic message and indexical properties of the talker.     

The neural reality of syntactic transformations: evidence from functional magnetic resonance imaging

The functional anatomy of syntactic transformations, a major computational operation invoked in sentence processing, was identified through a functional magnetic resonance imaging investigation. A grammaticality judgment task was used, presented through a novel hidden-blocks design. Subjects listened to transformational and nontransformational sentences in which a host of other complexity generators (number of words, prepositions, embeddings, etc.) were kept constant. A series of analyses revealed that the neural processing of transformations is localizable, evoking a highly lateralized and localized activation in the left inferior frontal gyrus (Broca's region) and bilateral activation in the posterior superior temporal sulcus. The pattern of activation associated with transformational analysis was distinct from the one observed in neighboring regions, and anatomically separable from the effects of verb complexity, which yielded significant activation in the left posterior superior temporal sulcus. Taken together with neuropsychological evidence, these results uncover the neural reality of syntactic transformations.     

Cognitive constraints on ordering operations: the case of geometric analogies

Many tasks (e.g., solving algebraic equations and running errands) require the execution of several component processes in an unconstrained order. The research reported here uses the geometric analogy task as a paradigm case for studying the ordering of component processes in this type of task. In solving geometric analogies by applying mental transformations such as rotate, change size, and add a part, the order of performing the transformations is unconstrained and does not in principle affect solution accuracy. Nevertheless, solvers may bring cognitive constraints with them to the analogy task that influence the ordering of the transformations. First, we demonstrate that solvers have a preferred order for performing mental transformations during analogy solution. We then investigate three classes of explanations for the preferred order, one based on general information processing considerations, another based on task-specific considerations, and a third based on individual differences in analogy ability. In the first and third experiments, college students solved geometric analogies requiring two or three transformations and indicated the order in which they performed the transformations. There was close agreement on nearly the same order for both types of analogies. In the second experiment, subjects were directed to perform pairs of transformations in the preferred or unpreferred order. Both speed and accuracy were greater for the preferred orders, thus validating subjects' reported orders. Ability differences were observed for only the more difficult three-transformation problems: High- and middle-ability subjects agreed on an overall performance order, but the highs were more consistent in their use of this order. Low-ability subjects did not consistently order the transformations for these difficult problems. The general information processing factor examined was working-memory load. A number of task factors have been shown to affect working-memory load during the solution of inductive reasoning problems. Of these, we chose to examine process difficulty. Because analogies are solved in working memory, performing more difficult transformations earlier may reduce working-memory load and facilitate problem solution. However, the observed performance order was not correlated with transformation difficulty. The first task-specific factor considered was that some transformations may be identified earlier, possibly because of perceptual salience, and that the performance order follows the identification order.(ABSTRACT TRUNCATED AT 400 WORDS)     

Age- and practice-related influences on dual-task costs and compensation mechanisms under optimal conditions of dual-task performance

Impaired dual-task performance in younger and older adults can be improved with practice. Optimal conditions even allow for a (near) elimination of this impairment in younger adults. However, practice effects under these conditions in older adults are unknown. Further, it is open, how changed task scheduling and/ or the acquisition of task coordination skills affect the temporal overlap of two tasks in different age groups; this overlap indicate the involvement of these practice-related mechanisms to compensate for impaired dual-task performance. In a dual-task situation of Schumacher et al. (2001 , Psychological Science, 12, 230) including optimal conditions for dual-task performance, both younger and older adults were able to achieve an improvement in dual-task performance with 8 practice sessions to the same degree. The temporal task overlap changed similarly in both age groups during these sessions demonstrating a similar degree of the involvement of compensation mechanisms in younger and older adults. At the end of practice, however, we showed that older adults do not achieve the same optimized dual-task performance level of younger adults.     

An analysis of memory-based theories of automaticity

Memory-based theories of automaticity predict that performance in a memory search task which is automatic will not require a representation of the memory set in working memory. The information contained in working memory was manipulated by inserting an interference task between the presentation of a memory set and a probe stimulus in a memory search task. The interference task prevented rehearsal, necessitating the retrieval of the memory set from long-term memory in variably mapped (VM) conditions. Performance in consistently mapped (CM) conditions provided strong support for memory-based theories of automaticity. With CM practice, both the effects of memory load and the effect of the interference task were eliminated. Furthermore, there was a temporal coupling in the reduction of these two effects with consistent practice. Monte Carlo simulations of memory-based automaticity predict such a temporal coupling. Automaticity is viewed as a continuum reflecting the relative contribution of the direct memory access of past solutions from long-term memory on performance.     

No evidence for qualitative differences in the processing of short and long temporal intervals

Several lines of research suggest that two distinct timing mechanisms are involved in temporal information processing: a sensory mechanism for processing of durations in the range of milliseconds and a cognitively controlled mechanism for processing of longer durations. The present study employed a dual-task approach and a sensory interference paradigm to further elucidate the distinct timing hypothesis. Experiment 1 used mental arithmetic as a nontemporal secondary task, Experiment 2 a memory search task, and Experiment 3 a visuospatial memory task. In Experiment 4, a loudness manipulation was applied. Mental arithmetic and loudness manipulation affected temporal discrimination of both brief and long intervals, whereas the two remaining tasks did not influence timing performance. Observed differences in interference patterns may be explained by some tasks being more difficult than others. The overall pattern of results argues against two qualitatively distinct timing mechanisms, but is consistent with attention-based cognitive models of human timing.     

A high density ERP comparison of mental rotation and mental size transformation

To compare mental rotation and mental size transformation, 128-channel EEG was recorded while subjects performed both tasks using random two-dimensional shapes as stimuli. Behavioural results showed significant linear effects of both size transformation and mental rotation on reaction times. Rotation ERPs showed experimental effects at two latencies: a bilateral component distributed over posterior parietal electrodes at a latency of approximately 232-300ms and a second component at approximately 424-492ms distributed over right anterior parietal electrodes. The latency and spatial distribution of this second effect is consistent with previous research indicating a functional connection between this component and mental rotation. ERPs for the size-transformation task showed an effect at 180-228ms distributed bilaterally over occipital-temporal electrodes. These results are consistent with previous hemodynamic imaging studies that show involvement of parietal cortex in mental rotation and also the involvement of BA 19 in size-transformation tasks. However, the superior temporal resolution of the present data indicates that BA 19 activation may occur at a latency that is more likely related to apparent motion than to the size-transformation operation per se.     

Vibrotactile pattern isolation/integration

Temporal integration has been cited as a major factor in temporal masking. Two experiments were designed to examine the conditions under which temporal integration may aid or hinder the perception of vibrotactile spatial patterns. In Experiment 1, the subject’s task was to discriminate between pairs of patterns. Each pattern was composed of two temporally separated pattern elements. When the task required the subjects to perceive the individual pattern elements, performance improved with temporal isolation—that is, performance improved as the temporal separation between the elements increased. In a second task, when the discrimination could be based on either the overall pattern shape or the pattern elements, temporal integration appeared to improve performance—that is, performance improved as the temporal separation decreased. In Experiment 2, an identification task was used. Several factors appeared to determine whether temporal integration aided or hindered pattern identification. When pattern elements similar to those in Experiment 1 were tested, performance improved with increasing temporal separation (isolation). A single function was fit to the discrimination (isolation) and identification (isolation) results. Whether temporal integration aids or hinders pattern perception appears to depend on pattern shape, the pattern elements, and the nature of the task.     

Object-based perception mediates the effect of exogenous attention on temporal resolution

The effects of target distinctiveness, target placeholders, and target spatial separation on the relation between exogenous attention and temporal resolution were examined in a visual temporal order judgement (TOJ) task. When identical targets were presented at different locations within a cued or uncued placeholder, attention degraded temporal resolution (Experiment 1), but when distinct targets were presented at different locations that cueing effect disappeared (Experiment 2), and when the target placeholders were not used, attention enhanced temporal resolution for distinct targets presented at different locations (Experiment 3). Attention also degraded temporal resolution when distinct targets were presented at the same location (Experiment 4). The latter two results were then replicated in a task in which distinct targets appeared randomly at the same or different locations (Experiment 5). Clearly, the nature of the relation between exogenous attention and temporal resolution is not a straightforward one—the relative location of targets, the similarity of targets, and the presence of placeholders all qualitatively affect the cueing relation. We hypothesize a mediating role for object-related processes. Specifically, exogenous attention enhances feature binding and related object representations, which subsequently degrade temporal resolution.     

Temporal specificity of perceptual learning in an auditory discrimination task

Although temporal processing is used in a wide range of sensory and motor tasks, there is little evidence as to whether a single centralized clock or a distributed system underlies timing in the range of tens to hundreds of milliseconds. We investigated this question by studying whether learning on an auditory interval discrimination task generalizes across stimulus types, intervals, and frequencies. The degree to which improvements in timing carry over to different stimulus features constrains the neural mechanisms underlying timing. Human subjects trained on a 100- or 200-msec interval discrimination task showed an improvement in temporal resolution. This learning generalized to a perceptually distinct duration stimulus, as well as to the trained interval presented with tones at untrained spectral frequencies. The improvement in performance did not generalize to untrained intervals. To determine if spectral generalization was dependent on the importance of frequency information in the task, subjects were simultaneously trained on two different intervals identified by frequency. As a whole, our results indicate that the brain uses circuits that are dedicated to specific time spans, and that each circuit processes stimuli across nontemporal stimulus features. The patterns of generalization additionally indicate that temporal learning does not rely on changes in early, subcortical processing, because the nontemporal features are encoded by different channels at early stages.     

A Note on State Individual Differences in Accuracy of Response Imagery: Aftereffects and Reminiscence

In two sessions, separated by 7 days, subjects imagined themselves performing a tracking task under a massed practice schedule. After conditions of interpolated rest and no-rest, which were counterbalanced across sessions, subjects actually performed the tracking task. During imagery practice, subjects verbally reported the temporal component of the task. The temporal accuracy of verbal reports varied widely across subjects, but not within subjects. Furthermore, a performance gain was demonstrated as a function of interpolated rest versus no-rest (reminiscence effect). Finally, the accuracy of verbal reports predicted imagery aftereffects, but not reminiscence effects.     

Basal ganglia, dopamine and temporal processing: performance on three timing tasks on and off medication in Parkinson's disease

A pervasive hypothesis in the timing literature is that temporal processing in the milliseconds and seconds range engages the basal ganglia and is modulated by dopamine. This hypothesis was investigated by testing 12 patients with Parkinson's disease (PD), both 'on' and 'off' dopaminergic medication, and 20 healthy controls on three timing tasks. In a seconds range (30-120 s) time production task, patients tested 'on' medication showed a significantly different accuracy profile compared to controls and when tested 'off' medication. However, no group or on vs off medication differences in accuracy were found on a time reproduction task and a warned reaction time task requiring temporal processing within the 250-2000 ms range. Variability was measured using the coefficient of variation, with the performance of the patient group on the time reproduction task violating the scalar property, suggesting atypical temporal processing mechanisms. The data suggest that the integrity of the basal ganglia is necessary for 'typical' time production in the seconds range as well as for time reproduction at shorter intervals. Exploratory factor analysis suggested that the time production task uses neural mechanisms distinct from those used in the other two timing tasks. The dissociation of the effects of dopaminergic medication and nature of task on performance in PD raises interesting questions about the pharmacological mediation and task-specificity of deficits in temporal processing.     

How are bodies special? Effects of body features on spatial reasoning

Embodied views of cognition argue that cognitive processes are influenced by bodily experience. This implies that when people make spatial judgments about human bodies, they bring to bear embodied knowledge that affects spatial reasoning performance. Here, we examined the specific contribution to spatial reasoning of visual features associated with the human body. We used two different tasks to elicit distinct visuospatial transformations: object-based transformations, as elicited in typical mental rotation tasks, and perspective transformations, used in tasks in which people deliberately adopt the egocentric perspective of another person. Body features facilitated performance in both tasks. This result suggests that observers are particularly sensitive to the presence of a human head and body, and that these features allow observers to quickly recognize and encode the spatial configuration of a figure. Contrary to prior reports, this facilitation was not related to the transformation component of task performance. These results suggest that body features facilitate task components other than spatial transformation, including the encoding of stimulus orientation.     

Talking and driving: applications of crossmodal action reveal a special role for spatial language

Talking reduces attention resulting in real-world crash risks to drivers that talk on a phone and drive. Driving is a behavior that is very demanding on spatial attention, suggesting potentially large interference by spatial codes in language. The current study investigated how different types of verbal codes influence visual attention during dual-task performance. In two experiments, participants performed a spatial or non-spatial verbal task while simultaneously performing a visual attention task. The results showed a larger decrement to visual attention performance when participants were concurrently engaged in a spatial verbal task. The results of the second experiment isolated this effect to the right cerebral hemisphere, consistent with a role for shared right parietal resources. These results are consistent with the idea that processing codes are an important component of coordinating talking and driving but generally inconsistent with a broad class of bottleneck approaches that describes dual-task decrements but treats component tasks as cognitively equivalent.     

Modality differences in short-term memory for rhythms

Prior research has established that performance in short-term memory tasks using auditory rhythmic stimuli is frequently superior to that in tasks using visual stimuli. In five experiments, the reasons for this were explored further. In a same-different task, pairs of brief rhythms were presented in which each rhythm was visual or auditory, resulting in two same-modality conditions and two cross-modality conditions. Three different rates of presentation were used. The results supported the temporal advantage of the auditory modality in short-term memory, which was quite robust at the quickest presentation rates. This advantage tended to decay as the presentation rate was slowed down, consistent with the view that, with time, the temporal patterns were being recoded into a more generic form.     

Neural correlates of successful and unsuccessful verbal memory encoding

Recent neuroimaging studies suggest that episodic memory encoding involves a network of neocortical structures which may act interdependently with medial temporal lobe (mTL) structures to promote the formation of durable memories, and that activation in certain structures is modulated according to task performance. Functional magnetic resonance imaging (fMRI) was used to determine the neural structures recruited during a verbal episodic encoding task and to examine the relationship between activation during encoding and subsequent recognition memory performance across subjects. Our results show performance-correlated activation during encoding both in neocortical and medial temporal structures. Neocortical activations associated with later successful and unsuccessful recognition memory were found to differ not only in magnitude, but also in hemispheric laterality. These performance-related hemispheric effects, which have not been previously reported, may correspond to between-subject differences in encoding strategy.     

Static scene analysis for the perception of heading

In the current study, we explored observers' use of two distinct analyses for determining their direction of motion, or heading: a scene-based analysis and a motion-based analysis. In two experiments, subjects viewed sequentially presented, paired digitized images of real-world scenes and judged the direction of heading; the pairs were presented with various interstimulus intervals (ISIs). In Experiment 1, subjects could determine heading when the two frames were separated with a 1,000-ms ISI, long enough to eliminate apparent motion. In Experiment 2, subjects performed two tasks, a path-of-motion task and a memory-load task, under three different ISIs, 50 ms, 500 ms, and 1,000 ms. Heading accuracy decreased with an increase in ISI. Increasing memory load influenced heading judgments only for the longer ISI when motion-based information was not available. These results are consistent with the hypothesis that the scene-based analysis has a coarse spatial representation, is a sustained temporal process, and is capacity limited, whereas the motion-based analysis has a fine spatial resolution, is a transient temporal process, and is capacity unlimited.     

时间认知的脑机制研究

从神经心理学和脑成像2个领域综述了有关时间认知脑机制的研究。神经心理学及脑损伤的研究结果表明小脑可能与内部时钟功能有关,前额叶可能调节时间认知中的注意过程。PET和fMRI脑成象研究结果显示,基底神经节、小脑和前额叶在所有的计时作业中都被激活。ERP的研究结果还证实,时间信息加工和非时间信息加工存在时间历程上的差异,并且时间信息加工还存在的显著半球优势效应。因此基底神经节、小脑和前额叶可能是时间认知的主要脑机制,但由于研究材料、方法和程序的不同,大脑皮层的广泛区域都有可能参与时间信息的加工。     

Influence of temporal context on value in the multiple-chains and successive-encounters procedures

This set of studies explored the influence of temporal context across multiple-chain and multiple-successive-encounters procedures. Following training with different temporal contexts, the value of stimuli sharing similar reinforcement schedules was assessed by presenting these stimuli in concurrent probes. The results for the multiple-chain schedule indicate that temporal context does impact the value of a conditioned reinforcer consistent with delay-reduction theory, such that a stimulus signaling a greater reduction in delay until reinforcement has greater value. Further, nonreinforced stimuli that are concurrently presented with the preferred terminal link also have greater value, consistent with value transfer. The effects of context on value for conditions with the multiple-successive-encounters procedure, however, appear to depend on whether the search schedule or alternate handling schedule was manipulated, as well as on whether the tested stimuli were the rich or lean schedules in their components. Overall, the results help delineate the conditions under which temporal context affects conditioned-reinforcement value (acting as a learning variable) and the conditions under which it does not (acting as a performance variable), an issue of relevance to theories of choice.     

Implicit transfer of motor strategies in mental rotation

Recent research indicates that motor areas are activated in some types of mental rotation. Many of these studies have required participants to perform egocentric transformations of body parts or whole bodies; however, motor activation also has been found with nonbody objects when participants explicitly relate the objects to their hands. The current study used positron emission tomography (PET) to examine whether such egocentric motor strategies can be transferred implicitly from one type of mental rotation to another. Two groups of participants were tested. In the Hand-Object group, participants performed imaginal rotations of pictures of hands; following this, they then made similar judgments of pictures of Shepard-Metzler objects. The Object-Object group performed the rotation task for two sets of Shepard-Metzler objects only. When the second condition in each group (which always required rotating Shepard-Metzler objects) was compared, motor areas (Area 6 and M1) were found to be activated only in the Hand-Object group. These findings suggest that motor strategies can be covertly transferred to imaginal transformations of nonbody objects.