On the interplay of visuospatial and audiotemporal dominance: Evidence from a multimodal kappa effect

When participants judge multimodal audiovisual stimuli, the auditory information strongly dominates temporal judgments, whereas the visual information dominates spatial judgments. However, temporal judgments are not independent of spatial features. For example, in the kappa effect, the time interval between two marker stimuli appears longer when they originate from spatially distant sources rather than from the same source. We investigated the kappa effect for auditory markers presented with accompanying irrelevant visual stimuli. The spatial sources of the markers were varied such that they were either congruent or incongruent across modalities. In two experiments, we demonstrated that the spatial layout of the visual stimuli affected perceived auditory interval duration. This effect occurred although the visual stimuli were designated to be task-irrelevant for the duration reproduction task in Experiment 1, and even when the visual stimuli did not contain sufficient temporal information to perform a two-interval comparison task in Experiment 2. We conclude that the visual and auditory marker stimuli were integrated into a combined multisensory percept containing temporal as well as task-irrelevant spatial aspects of the stimulation. Through this multisensory integration process, visuospatial information affected even temporal judgments, which are typically dominated by the auditory modality.     

The effects of interference and retention delay on temporal generalization performance

This study investigated the effect of forgetting of the standard duration on temporal discrimination in a generalization task. In two experiments, participants were given a temporal generalization task with or without a retention delay between the learning of the standard duration and the testing of the comparison durations. During this delay, they either performed or did not perform an interference task. Results failed to reveal any effect of 15-min and 24-h retention delays on time judgments (Experiment 1). However, when an interference task was performed during the 15-min delay (Experiment 2), there was a subjective shortening effect, indicating that the standard duration was judged shorter with than without an interference task. These findings suggest that when an interference task occurs immediately after initial temporal encoding, it affects the process of consolidation in reference memory.     

Is the interference between memory processing and timing specific to the use of verbal material?

Increasing load in a memory task performed simultaneously with a timing task shortens perceived time, an effect that has been observed previously with memory tasks using verbal material. The present experiments examine whether two similar memory tasks, one in which verbal material is used and another one in which nonverbal material is used, would produce similar interference effects on concurrent time reproduction. In Experiment 1, the number of nonverbal stimuli (pseudo‐random dot patterns) was manipulated in a memory task performed while a temporal interval to be reproduced was encoded. Reproductions shortened proportionally to the duration of memory processing executed during time estimation. Verbal stimuli (consonants) were used in Experiment 2 in otherwise identical experimental conditions. Effects observed in Experiment 2 were comparable to those obtained in Experiment 1. Taken together, these results support the notion that interference from memory tasks on concurrent time estimation is not determined by the specific type of material processed in memory, but instead by the duration of memory processing.     

Is the interference between memory processing and timing specific to the use of verbal material?

Increasing load in a memory task performed simultaneously with a timing task shortens perceived time, an effect that has been observed previously with memory tasks using verbal material. The present experiments examine whether two similar memory tasks, one in which verbal material is used and another one in which nonverbal material is used, would produce similar interference effects on concurrent time reproduction. In Experiment 1, the number of nonverbal stimuli (pseudo-random dot patterns) was manipulated in a memory task performed while a temporal interval to be reproduced was encoded. Reproductions shortened proportionally to the duration of memory processing executed during time estimation. Verbal stimuli (consonants) were used in Experiment 2 in otherwise identical experimental conditions. Effects observed in Experiment 2 were comparable to those obtained in Experiment 1. Taken together, these results support the notion that interference from memory tasks on concurrent time estimation is not determined by the specific type of material processed in memory, but instead by the duration of memory processing.     

Temporal reproductions are influenced by an internal reference: Explaining the Vierordt effect

Several findings from duration perception literature suggest that when making decisions about time, participants rely on an internal reference memory for time rather than merely on the current physical stimuli. According to a recent account, such an internal reference is formed by a continuous dynamic updating process that integrates duration information from previous trials and the current trial. In the present work, we show how such a dynamic mechanism can account for the classical yet unresolved Vierordt effect, which refers to the overestimation of relatively short and the underestimation of relatively long temporal intervals. We conducted an experiment to examine this and related predictions by means of a temporal reproduction task. Specifically, participants were presented with two successive time intervals — a standard s with constant duration and a comparison c with variable duration. Instead of performing a comparison judgment, however, the participants were subsequently cued to reproduce one of the two presented stimuli. Reproductions were affected not only by the temporal position of the to-be-reproduced stimulus, but also by the stimuli presented on earlier trials. These results support the notion of a dynamically updated internal reference underlying our judgments about the time elapsed, which might also be the basis of the Vierordt effect.     

Testing the representation of time in reference memory in the bisection and the generalization task: the utility of a developmental approach

This study examined the effect of the variability of representation of durations in reference memory on temporal discrimination performance in children aged 5 and 8 years as well as in adults using a bisection (Experiment 1) and a generalization task (Experiment 2). In each task, the participants were familiarized before the blocks of tested trials with either the same referent duration values (fixed condition) or a distribution of referent duration values, with a mean equal to the referent durations used in the fixed condition and a .20 coefficient of variation (variable condition). The results showed that the sensitivity to duration was lower in the variable than in the fixed condition in the children and, to a lesser extent, in the adults. The modelling of the data indicated that this effect was due to the increase in the variability of the representation of durations in reference memory, but also to changes in the decisional processes.     

Testing the representation of time in reference memory in the bisection and the generalization task: The utility of a developmental approach

This study examined the effect of the variability of representation of durations in reference memory on temporal discrimination performance in children aged 5 and 8 years as well as in adults using a bisection (Experiment 1) and a generalization task (Experiment 2). In each task, the participants were familiarized before the blocks of tested trials with either the same referent duration values (fixed condition) or a distribution of referent duration values, with a mean equal to the referent durations used in the fixed condition and a .20 coefficient of variation (variable condition). The results showed that the sensitivity to duration was lower in the variable than in the fixed condition in the children and, to a lesser extent, in the adults. The modelling of the data indicated that this effect was due to the increase in the variability of the representation of durations in reference memory, but also to changes in the decisional processes.     

Improving time discrimination in children and adults in a temporal bisection task: The effects of feedback and no forced choice on decision and memory processes

In children aged 5 and 8 years old as well as in adults, Experiment 1 tested the effect of feedback on temporal performance using a bisection task. Experiment 2 added a no-forced-choice condition by giving the participants the possibility of responding “I don't know”. The results of Experiment 1 showed that providing feedback increased the bisection point value (point of subjective equality) in all age groups and increased sensitivity to time in the youngest children. The results of Experiment 2 showed that the proportion of “I don't know” responses peaked at the probe duration close to the arithmetic mean of the two anchor durations and decreased as the distance from this central value increased in both the adults and the 8-year-olds. In the 5-year-olds, the proportion of “I don't know” responses was lower and remained constant whatever the probe duration values. Unlike in the youngest children, giving the adults and the 8-year-olds the opportunity to respond “I don't know” increased their sensitivity to time. The modelling of our data suggests that providing feedback in a temporal bisection task affects both the memory and the decision processes. However, whereas the feedback-related effect had a similar effect on decision processes across the age groups, it had an opposite effect on memory processes in the 5-year-olds and the older participants, decreasing the variability of the memory representation of the anchor durations in the former while increasing it in the latter. Finally, in bisection, feedback only improved temporal performance when the memory for duration was imprecise as in the case of the children.     

Modality effects in memory for basic stimulus attributes: a temporal and nontemporal comparison

Previous research suggests that there are significant differences in the operation of reference memory for stimuli of different modalities, with visual temporal entries appearing to be more durable than auditory entries (Ogden, Wearden, & Jones, 2008 , 2010). Ogden et al. ( 2008 , 2010 ) demonstrated that when participants were required to store multiple auditory temporal standards over a period of delay there was significant systematic interference to the representation of the standard characterized by shifts in the location of peak responding. No such performance deterioration was observed when multiple visually presented durations were encoded and maintained. The current article explored whether this apparent modality-based difference in reference memory operation is unique to temporal stimuli or whether similar characteristics are also apparent when nontemporal stimuli are encoded and maintained. The modified temporal generalization method developed in Ogden et al. (2008) was employed; however, standards and comparisons varied by pitch (auditory) and physical line length (visual) rather than duration. Pitch and line length generalization results indicated that increasing memory load led to more variable responding and reduced recognition of the standard; however, there was no systematic shift in the location of peak responding. Comparison of the results of this study with those of Ogden et al. (2008, 2010) suggests that although performance deterioration as a consequence of increases in memory load is common to auditory temporal and nontemporal stimuli and visual nontemporal stimuli, systematic interference is unique to auditory temporal processing.     

基于客体工作记忆内容的保持对时间判断的影响

本研究通过操作工作记忆内容的有效性,探讨了记忆内容的保持对时间判断的影响。采用不规则的客体作为实验材料,使时间任务中的刺激与工作记忆内容匹配或不匹配。实验1采用工作记忆和时间判断的双任务范式,要求被试首先记忆一个客体,然后在每个试次的最后判断测试刺激是否与记忆项相同。在延迟阶段,被试判断连续出现的两个刺激的时距哪个更长（或更短）。实验2中,要求被试忽略第一个刺激,仅完成时间判断任务。结果发现,相比单任务的计时,双任务条件下,工作记忆内容的保持延长了时间判断的时间。而且,在记忆匹配和知觉匹配条件下,匹配刺激呈现的时间越长,正确率越低,反应时越长。这说明记忆内容的保持增加了决策的难度,工作记忆内容对时间判断的可能是由记忆内容引起的注意定向造成的。     

Children's memory for complex autobiographical events: does spacing of repeated instances matter?

Often, when children testify in court they do so as victims of a repeated offence and must report details of an instance of the offence. One factor that may influence children's ability to succeed in this task concerns the temporal distance between presentations of the repeated event. Indeed, there is a substantial amount of literature on the "spacing effect" that suggests this may be the case. In the current research, we examined the effect of temporal spacing on memory reports for complex autobiographical events. Children participated in one or four play sessions presented at different intervals. Later, children were suggestively questioned, and then participated in a memory test. Superior recall of distributed events (a spacing effect) was found when the delay to test was 1 day (Experiment 1) but there was little evidence for a spacing effect when the delay was 1 week (Experiment 2). Implications for understanding children's recall of repeated autobiographical events are discussed.     

Lesions in the anterior thalamic nuclei of rats do not disrupt acquisition of stimulus sequence learning

Four experiments examined the effects of encoding multiple standards in a temporal generalization task in the visual and auditory modalities both singly and cross-modally, using stimulus durations ranging, across different experiments, from 100 to 1,400 ms. Previous work has shown that encoding and storing multiple auditory standards of different durations resulted in systematic interference with the memory of the standard, characterized by a shift in the location of peak responding, and this result, from Ogden, Wearden, and Jones (2008), was replicated in the present Experiment 1. Experiment 2 employed the basic procedure of Ogden et al. using visual stimuli and found that encoding multiple visual standards did not lead to performance deterioration or any evidence of systematic interference between the standards. Experiments 3 and 4 examined potential cross-modal interference. When two standards of different modalities and durations were encoded and stored together there was also no evidence of interference between the two. Taken together, these results, and those of Ogden et al., suggest that, in humans, visual temporal reference memory may be more permanent than auditory reference memory and that auditory temporal information and visual temporal information do not mutually interfere in reference memory.     

Auditory and visual differences in time perception? An investigation from a developmental perspective with neuropsychological tests

Adults and children (5- and 8-year-olds) performed a temporal bisection task with either auditory or visual signals and either a short (0.5-1.0s) or long (4.0-8.0s) duration range. Their working memory and attentional capacities were assessed by a series of neuropsychological tests administered in both the auditory and visual modalities. Results showed an age-related improvement in the ability to discriminate time regardless of the sensory modality and duration. However, this improvement was seen to occur more quickly for auditory signals than for visual signals and for short durations rather than for long durations. The younger children exhibited the poorest ability to discriminate time for long durations presented in the visual modality. Statistical analyses of the neuropsychological scores revealed that an increase in working memory and attentional capacities in the visuospatial modality was the best predictor of age-related changes in temporal bisection performance for both visual and auditory stimuli. In addition, the poorer time sensitivity for visual stimuli than for auditory stimuli, especially in the younger children, was explained by the fact that the temporal processing of visual stimuli requires more executive attention than that of auditory stimuli.     

Visual and phonological components of working memory in children

Previous studies have shown that young children's immediate memory for a short series of drawings of objects is mediated by a visual component of working memory, whereas older children rely chiefly upon a phonological component. Three experiments investigated the hypothesis that older children rely also, but to a lesser extent, on visual working memory. Experiment 1 confirmed previous evidence that 11-year-olds' memory is disrupted by phonemic similarity of object names, but is unaffected by visual similarity of the objects themselves. However, when articulatory suppression was used to prevent phonological coding, levels of recall were sensitive to visual rather than phonemic similarity. Experiment 2 compared the effects of interpolating an auditory-verbal or a visual postlist task on memory for drawings viewed either with or without suppression. The visual task had a clear disruptive effect only in the suppression condition, where it interfered selectively with recall of the most recent item. Experiment 3 compared the effects of interpolating an auditory-verbal or a mixed-modality (visual-auditory) postlist task when subjects were not required to suppress. There was greater interference from the mixed-modality task, and this effect was confined to the last item presented. These experiments are taken as confirming the presence of a small but reliable contribution from visual memory in 11-year-old children's recall. As in younger children, visual working memory in 11-year-olds is sensitive to visual similarity and is responsible for a final-item visual recency effect. The results also show that older children's use of visual working memory is usually masked by the more pervasive phonological component of recall. Some implications for the structure of working memory and its development are discussed.     

Changing Sensitivity to Duration in Human Scalar Timing: An Experiment, a Review, and Some Possible Explanations

Evidence from a number of studies of human timing, using temporal generalization and bisection tasks, suggests more sensitive behavioural adjustment to presented durations under conditions in which the timing task demands discriminations between more closely spaced stimuli. An experiment using temporal generalization demonstrated this effect, as discrimination between a 600-msec standard duration and non-standard stimuli both shorter and longer than 600 msec was better when non-standard stimuli were more closely spaced around 600 msec. A review showed similar effects in other temporal generalization tasks and in a number of bisection studies, where time discrimination improved as the ratio of the long and short standards on the bisection task decreased. A standard model of human temporal generalization explained the experimental data in terms of a decrease in the response threshold under more difficult conditions, rather than changes in the representation of the standard duration. On the other hand, data from bisection could be modelled by assuming the contrary; that representations of the short and long standards of the task were more precise under the more difficult conditions. Explanations of some of these effects in terms of attention to duration and/or arousal-induced changes in the speed of an internal clock were discussed.     

Good vibrations: Human interval timing in the vibrotactile modality

This article reports a detailed examination of timing in the vibrotactile modality and comparison with that of visual and auditory modalities. Three experiments investigated human timing in the vibrotactile modality. In Experiment 1, a staircase threshold procedure with a standard duration of 1,000 ms revealed a difference threshold of 160.35 ms for vibrotactile stimuli, which was significantly higher than that for auditory stimuli (103.25 ms) but not significantly lower than that obtained for visual stimuli (196.76 ms). In Experiment 2, verbal estimation revealed a significant slope difference between vibrotactile and auditory timing, but not between vibrotactile and visual timing. That is, both vibrations and lights were judged as shorter than sounds, and this comparative difference was greater at longer durations than at shorter ones. In Experiment 3, performance on a temporal generalization task showed characteristics consistent with the predications of scalar expectancy theory (SET: Gibbon, 1977) with both mean accuracy and scalar variance exhibited. The results were modelled using the modified Church and Gibbon model (MCG; derived by Wearden, 1992, from Church & Gibbon 1982). The model was found to give an excellent fit to the data, and the parameter values obtained were compared with those for visual and auditory temporal generalization. The pattern of results suggest that timing in the vibrotactile modality conforms to SET and that the internal clock speed for vibrotactile stimuli is significantly slower than that for auditory stimuli, which is logically consistent with the significant differences in difference threshold that were obtained.     

Working Memory for Temporal and Nontemporal Events in Monkeys

This is the first report that introduces appropriate behavioral tasks for monkeys for investigations of working memory for temporal and nontemporal events. Using several behavioral tests, the study also shows how temporal information is coded during retention intervals in the tasks. Each of three monkeys was trained with two working memory tasks: delayed matching-to-sample of stimulus duration (DMS-D) and delayed matching-to-sample of stimulus color (DMS-C). The two tasks employed an identical apparatus and responses and differed only in the temporal and nontemporal attribute of the stimuli to be retained for correct performance. When a retention interval between the sample and comparison stimuli was prolonged, the monkeys made more incorrect responses to short samples in the DMS-C task, suggesting “trace decay” of memory for short stimuli. However, the same monkeys showed no such increase in incorrect responses to short samples in the DMS-D task, suggesting active coding of temporal information, that is, the length of stimulus duration, during the retention interval. When variable lengths of samples were presented with a fixed retention interval, the monkeys made more incorrect responses when length differences between short and long samples were small in the DMS-D task, but not in the DMS-C task. This suggests that the codes of working memory retained in the DMS-D task were not absolute (analogical) but rather were relative (categorical) and related to differences in the duration of the samples.     

Evidence for Age-related Changes to Temporal Attention and Memory from the Choice Time Production Task

ABSTRACT

The effect of aging on interval timing was examined using a choice time production task, which required participants to choose a key response based on the location of the stimulus, but to delay responding until after a learned time interval. Experiment 1 varied attentional demands of the response choice portion of the task by varying difficulty of stimulus–response mapping. Choice difficulty affected temporal accuracy equally in both age groups, but older participants' response latencies were more variable under more difficult response choice conditions. Experiment 2 tested the contribution of long-term memory to differences in choice time production between age groups over 3 days of testing. Direction of errors in time production between the two age groups diverged over the 3 sessions, but variability did not differ. Results from each experiment separately show age-related changes to attention and memory in temporal processing using different measures and manipulations in the same task.     

Time and number discrimination in a bisection task with a sequence of stimuli: a developmental approach

Children, aged 5 and 8 years, and adults were tested in a bisection task with a sequence of stimuli in which time and number co-varied. In a counting and a non-counting condition, they were instructed either to process the duration of this sequence while ignoring the number of stimuli (temporal bisection), or to process the number of stimuli while ignoring the duration (numerical bisection). In the temporal bisection task, number interfered with the 5-year-olds' temporal performance, indicating that young children did not process time and number independently in a sequence of stimuli when they had to attend to duration. However, number interference decreased both with age and counting strategy. In contrast, in the numerical bisection task, duration did not interfere with numerical discrimination for any age group.     

Time counts: Bidirectional interaction between time and numbers in human adults

Number is known for influencing time processing, but to what extent time influences number in human adults is unclear. We investigated possible bidirectional interactions (number on time and time on number) using a novel Stroop-like task; participants compared numbers or temporal durations in congruent (larger number presented for longer duration) or incongruent conditions (smaller number presented for longer duration). Time and number tasks were presented in different blocks (Experiment 1) or within the same block of trials with task instructions provided at the offset of the stimuli (Experiment 2). Analyses of response times (RTs) and their distribution revealed that number affected time from early RTs, and time affected number at late RTs – an asymmetry observed only when time and number tasks were presented in separate blocks. Thus, carefully chosen tasks and appropriate data analysis can reveal bidirectionality between time and number, consistent with shared magnitude or decision mechanisms.