Individual differences in impulsive choice and timing in rats

Individual differences in impulsive choice behavior have been linked to a variety of behavioral problems including substance abuse, smoking, gambling, and poor financial decision-making. Given the potential importance of individual differences in impulsive choice as a predictor of behavioral problems, the present study sought to measure the extent of individual differences in a normal sample of hooded Lister rats. Three experiments utilized variations of a delay discounting task to measure the degree of variation in impulsive choice behavior across individual rats. The individual differences accounted for 22-55% of the variance in choice behavior across the three experiments. In Experiments 2 and 3, the individual differences were still apparent when behavior was measured across multiple choice points. Large individual differences in the rate of responding, and modest individual differences in timing of responding were also observed during occasional peak trials. The individual differences in timing and rate, however, did not correlate consistently with individual differences in choice behavior. This suggests that a variety of factors may affect choice behavior, response rate, and response timing.     

Hazard function effects on promoting self-control in variable interval time-based interventions in rats

The present experiments investigated properties of time-based interventions used to increase self-control. Rats received impulsive-choice assessments before and after interventions that consisted of different distributions of delays to reinforcement. In Experiment 1, rats received an intervention with an increasing hazard function where delays were more evenly distributed, a decreasing hazard function where delays were mostly short, or a constant hazard function where delays were exponentially distributed. Surprisingly, rats that received the decreasing hazard function made the most self-controlled choices. Response rates during intervention trials showed that rats anticipated reinforcement based on the shape of the distributions they received. In Experiment 2, rats received an intervention with a decreasing hazard function with a steep slope or a shallow slope. Both time-based interventions increased self-control and produced similar response-rate patterns, indicating that the slope of the decreasing hazard function may not play a strong role in intervention efficacy. While this research aligns with previous literature showing that time-based interventions improved self-control, exposure to short delays produced the biggest improvements. Ultimately, exposure to short delays may increase the subjective value of the larger–later choice while occasional long delays may promote the ability to wait, which may have important implications for translational applications.     

Mice and rats fail to integrate exogenous timing noise into their time-based decisions

Endogenous timing uncertainty results in variability in time-based judgments. In many timing tasks, animals need to incorporate their level of endogenous timing uncertainty into their decisions in order to maximize the reward rate. Although animals have been shown to adopt such optimal behavioral strategies in time-based decisions, whether they can optimize their behavior under exogenous noise is an open question. In this study, we tested mice and rats in a task that required them to space their responses for a minimum duration (DRL task) in different task conditions. In one condition, the minimum wait time was fixed, whereas in other conditions minimum wait time was a Gaussian random variable. Although reward maximization entailed waiting longer with added exogenous timing variability, results indicated that both mice and rats became more impulsive and deviated from optimality with increasing levels of exogenous noise. We introduce a reward-rate-dependent sampling function to SET to account for optimal performance in noiseless and suboptimal performance in noisy environments.     

Contrasting effects of interference and of breaks in interval timing

When a break is introduced during an interval to be timed, the interval is perceived shorter as break location is delayed. This is interpreted as a result of attention sharing between timing and monitoring the source of the break signal. Similar effects and interpretations are found in another context involving interfering tasks. Such tasks are assumed to induce transient interruptions in timing, comparable to those obtained with breaks. Break and interference conditions were contrasted in a temporal reproduction procedure with identical stimuli. Both conditions induced temporal underestimation and similar location effects. Similar trends occurred in a control condition where no processing of the interfering signal was required. The data suggest that expectancy, intentional processing, and automatic attraction of attention shorten temporal estimates.     

Post-training ethanol disrupts trace conditioned fear in rats: effects of timing of ethanol, dose and trace interval duration

Ethanol has complex effects on memory performance, although hippocampus-dependent memory may be especially vulnerable to disruption by acute ethanol intoxication occurring during or shortly after a training episode. In the present experiments, the effects of post-training ethanol on delay and trace fear conditioning were examined in adolescent rats. In Experiment 1, 30-day-old Sprague-Dawley rats were given delay or trace conditioning trials in which a 10s flashing light CS was paired with a 0.5 mA shock US. For trace groups, the trace interval was 10 s. On days 31-33, animals were administered ethanol once daily (0.0 or 2.5 g/kg via intragastric intubation), and on day 34 animals were tested for CS-elicited freezing. Results showed that post-training ethanol affected the expression of trace, but had no effect on delay conditioned fear. Experiment 2 revealed that this effect was dose-dependent; doses lower than 2.5 g/kg were without effect. Experiment 3 evaluated whether proximity of ethanol to the time of training or testing was critical. Results show that ethanol administration beginning 24h after training was more detrimental to trace conditioned freezing than administration that was delayed by 48 h. Finally, in Experiment 4 animals were trained with one of three different trace intervals: 1, 3 or 10s. Results indicate that post-training administration of 2.5 g/kg ethanol disrupted trace conditioned fear in subjects trained with a 10s, but not with a 1 or 3s, trace interval. Collectively the results suggest that ethanol administration impairs post-acquisition memory processing of hippocampus-dependent trace fear conditioning.     

Timing in pigeons: effects of the similarity between intertrial interval and gap in a timing signal

Previous research suggests that when a fixed interval is interrupted (known as the gap procedure), pigeons tend to reset memory and start timing from 0 after the gap. However, because the ambient conditions of the gap typically have been the same as during the intertrial interval (ITI), ambiguity may have resulted. In the present experiment, the authors found that when ambient conditions during the gap were similar to the ITI, pigeons tended to reset memory, but when ambient conditions during the gap were different from the ITI, pigeons tended to stop timing, retain the duration of the stimulus in memory, and add to that time when the stimulus reappeared. Thus, when the gap was unambiguous, pigeons timed accurately.     

The effects of reinforcer magnitude on timing in rats

The relation between reinforcer magnitude and timing behavior was studied using a peak procedure. Four rats received multiple consecutive sessions with both low and high levels of brain stimulation reward (BSR). Rats paused longer and had later start times during sessions when their responses were reinforced with low-magnitude BSR. When estimated by a symmetric Gaussian function, peak times also were earlier; when estimated by a better-fitting asymmetric Gaussian function or by analyzing individual trials, however, these peak-time changes were determined to reflect a mixture of large effects of BSR on start times and no effect on stop times. These results pose a significant dilemma for three major theories of timing (SET, MTS, and BeT), which all predict no effects for chronic manipulations of reinforcer magnitude. We conclude that increased reinforcer magnitude influences timing in two ways: through larger immediate after-effects that delay responding and through anticipatory effects that elicit earlier responding.     

Good vibrations: Human interval timing in the vibrotactile modality

This article reports a detailed examination of timing in the vibrotactile modality and comparison with that of visual and auditory modalities. Three experiments investigated human timing in the vibrotactile modality. In Experiment 1, a staircase threshold procedure with a standard duration of 1,000 ms revealed a difference threshold of 160.35 ms for vibrotactile stimuli, which was significantly higher than that for auditory stimuli (103.25 ms) but not significantly lower than that obtained for visual stimuli (196.76 ms). In Experiment 2, verbal estimation revealed a significant slope difference between vibrotactile and auditory timing, but not between vibrotactile and visual timing. That is, both vibrations and lights were judged as shorter than sounds, and this comparative difference was greater at longer durations than at shorter ones. In Experiment 3, performance on a temporal generalization task showed characteristics consistent with the predications of scalar expectancy theory (SET: Gibbon, 1977) with both mean accuracy and scalar variance exhibited. The results were modelled using the modified Church and Gibbon model (MCG; derived by Wearden, 1992, from Church & Gibbon 1982). The model was found to give an excellent fit to the data, and the parameter values obtained were compared with those for visual and auditory temporal generalization. The pattern of results suggest that timing in the vibrotactile modality conforms to SET and that the internal clock speed for vibrotactile stimuli is significantly slower than that for auditory stimuli, which is logically consistent with the significant differences in difference threshold that were obtained.     

Exchange delays and impulsive choice in adult humans.

Choice responding by adult humans in a discrete-trial task was examined as a function of conditions that manipulated either the delay to point delivery or the delay between points and their exchange for money. In point-delay conditions, subjects chose between an "impulsive" alternative that provided a small amount of points immediately and a "self-control" alternative that provided a larger amount of points delayed by 15, 30, or 60 s. Points were exchanged for money immediately following the session. Subjects preferred the self-control alternative. In exchange-delay conditions, subjects chose between a small amount of points exchangeable for money immediately following the session and a larger amount of points exchangeable for money after 1 day, 3 weeks, or 6 weeks. A self-control preference observed for all subjects in the 1-day exchange-delay condition reversed to exclusive impulsive preference for 4 of the 6 subjects when choice conditions involved exchange delays of 3 or 6 weeks. These results show that human choice is sensitive to the manipulation of exchange delays and that impulsive preference can be obtained with exchange delays on the order of weeks.     

Temporal order in memory and interval timing: an interference analysis

The effect of varying load in memory tasks performed during a time interval production was examined. In a first experiment, increasing load in memory search for temporal order affected concurrent time production more strongly than varying load in a spatial memory task of equivalent difficulty. This result suggests that timing uses some specific resources also required in processing temporal order in memory, resources that would not be used in the spatial memory task. A second experiment showed that the interference between time production and memory search involving temporal order was stronger when, during the timing task, a decision was made on the temporal position of a memory item, than when information on temporal order was retained throughout the interval to be produced. These results underscore the importance of considering the specific resources and processes involved when the interference between timing and concurrent non-temporal tasks is analyzed.     

Modeling effects of rhythmic context on perceived duration: a comparison of interval and entrainment approaches to short-interval timing

Relative merits of interval and entrainment conceptions of the internal clock were assessed within a common theoretical framework by 4 time-judgment experiments. The timing of tone onsets marking the beginning and ending of standard and comparison time intervals relative to a context rhythm were manipulated: onsets were on time, early, or late relative to the implied rhythm, and 2 distinct accuracy patterns emerged. A quadratic ending profile indicated best performance when the standard ended on time and worst performance when it was early or late, whereas a flat beginning profile (Experiments 1-3) indicated uniform performance for the 3 expectancy conditions. Only in Experiment 4, in which deviations from expected onset times were large, did significant effects of beginning times appear in time-discrimination thresholds and points of subjective equality. Findings are discussed in the context of theoretical assumptions about clock resetting, the representation of time, and independence of successive time intervals.     

Chronic treatment with haloperidol induces deficits in working memory and feedback effects of interval timing

Normal participants (n=5) having no experience with antipsychotic drugs and medicated participants (n=5) with clinical experience with chronic low doses of haloperidol (3-10 mg/day for 2-4 months) in the treatment of neuroses were evaluated for the effects of inter-trial interval (ITI) feedback on a discrete-trials peak-interval timing procedure. Feedback was presented during the ITI in the form of a histogram showing the distribution of the responses participants made on the previous trial plotted on a relative time scale. As feedback concerning the accuracy and precision of a reproduced duration (e.g., 7- and 14-s visual signals) became more remote in time, reproduced intervals gradually lengthened in duration. This rightward horizontal shift in peak time increased as a function of the probability of feedback and was enhanced by chronic treatment with haloperidol in a manner that was proportional to the duration of the signal. Our data suggest a gradual change in the underlying representation of the signal duration as a function of the remoteness of ITI feedback that is dependent upon both changes in working memory and the speed of the internal clock used to time durations in the seconds-to-minutes range.     

Perinatal bromopride treatment: effects on sexual behavior of male and female rats

Effects of different perinatal bromopride treatments on sexual behavior were examined in adult male and female rats of Wistar origin. Female rats of mothers treated with bromopride (BRO) during lactation (VB group) and during pregnancy and lactation (BB group) showed lower lordosis quotients than those of controls (VV group). Females of mothers treated with BRO only during pregnancy (BV group) showed no differences in lordosis quotient when compared to the VV group. There were no significant differences in male sexual behavior between experimental and control groups. The effect of bromopride on the control of sexual behavior is discussed.     

Rapid acquisition of choice and timing in pigeons

Pigeons were trained on a concurrent-chains procedure in which the initial link associated with the shorter terminal-link delay to food changed unpredictably across sessions. In the minimal-variation condition, delays were always 10 s and 20 s, whereas in the maximal-variation condition delays were generated pseudorandomly for each session. On some terminal links, food was withheld to obtain measures of temporal control. Measures of choice (log initial-link response ratios) and timing (start and stop times on no-food trials) showed temporal control and stabilized within the 1st half of each session. In the maximal-variation condition, choice was a nonlinear function of the log delay ratio, consistent with a categorical discrimination but contrary to models based on the matching law. Residuals from separate regressions of log response and log start and stop time ratios on log delay ratios were positively correlated. Overall, results support cognitive models that assume that initial-link choice is based on an all-or-none decision process, and that choice and timing are mediated by a common representation of delay.     

Time and memory: towards a pacemaker-free theory of interval timing

A popular view of interval timing in animals is that it is driven by a discrete pacemaker-accumulator mechanism that yields a linear scale for encoded time. But these mechanisms are fundamentally at odds with the Weber law property of interval timing, and experiments that support linear encoded time can be interpreted in other ways. We argue that the dominant pacemaker-accumulator theory, scalar expectancy theory (SET), fails to explain some basic properties of operant behavior on interval-timing procedures and can only accommodate a number of discrepancies by modifications and elaborations that raise questions about the entire theory. We propose an alternative that is based on principles of memory dynamics derived from the multiple-time-scale (MTS) model of habituation. The MTS timing model can account for data from a wide variety of time-related experiments: proportional and Weber law temporal discrimination, transient as well as persistent effects of reinforcement omission and reinforcement magnitude, bisection, the discrimination of relative as well as absolute duration, and the choose-short effect and its analogue in number-discrimination experiments. Resemblances between timing and counting are an automatic consequence of the model. We also argue that the transient and persistent effects of drugs on time estimates can be interpreted as well within MTS theory as in SET. Recent real-time physiological data conform in surprising detail to the assumptions of the MTS habituation model. Comparisons between the two views suggest a number of novel experiments.     

The effects of aversive conditioned stimuli on the timing of unsignalled avoidance responding in rats

Rats received unsignalled avoidance training in a shuttlebox. After acquisition, classical conditioning sessions were administered. The Excitatory Group received signals paired with shock, the Inhibitory Group received signals explicitly unpaired with shock, while the Random Control Group received signals and shocks randomly in time. When subsequently superimposed on the avoidance baseline, the excitatory signal increased response rate, the inhibitory signal decreased rate and the random signal had no effect compared to signal-only control data. Unsignalled avoidance generates temporal gradients of responding; the major purpose of this study was to determine how these rate changes were reflected in the baseline temporal behavior. Very clear and simple summation rules emerged: In the presence of the excitatory signal, rats acted as if they were ahead of their actual location in the response-shock interval regardless of where the signal occurred; the inhibitory signal had the opposite effect while the random signal did not change the temporal behavior relative to signal-only control data. These results were interpreted within a motivational framework.     

Overmatching in rats: the barrier choice paradigm

The barrier choice paradigm was used to impose a cost on rats' behavior of traveling between two levers: Pressing on two levers was reinforced with food on concurrent random-interval schedules, but rats had to climb over a barrier to move from one lever to another. The height of the barrier separating the levers was increased from 30.5 to 45.7 cm across two phases that involved various pairs of random-interval schedules. With the 30.5-cm barrier, the generalized matching law showed slopes equal to or slightly above 1.0 for response and time allocation. With the 45.7-cm barrier, the generalized matching law showed slopes above 1.2 for responses, indicating that sensitivity to reinforcement increased with increasing barrier height. For time allocation the slopes remained close to 1.0; sensitivity to reinforcement did not seem to increase with increasing barrier height. The role of locomotion effort in choice situations is discussed.     

Response-stimulus interval in choice serial reaction time: Interaction with sleep deprivation, choice, and practice

In choice serial reaction time (RT), Response-to-next-Stimulus Interval (RSI) was varied from 0 to 600 msec in 40-msec steps. In three experiments, RT fell and errors rose as RSI was increased to 480 msec; they remained unchanged thereafter. The effect of RSI on RT was not linear, was reduced by 6- as compared with 4- or 3-choice responding, and was unaffected by sleep deprivation, despite loss of sleep reducing RT overall. The effect of penultimate RSI on RT was similar to that current RSI, but smaller. Two explanations of RSI—response-generated kinaesthetic feedback blocking a “central processor” and a preparatory interval as in warned simple RT—are rejected. Instead, the idea of “relative refractory state” is revived but now, because of the RSI/error finding, biased more towards responding than stimulus reception and encoding. In all three experiments the influence of RSI on RT was reduced with practice. If practice encourages automatic rather than controlled processing (Shiffrin & Schneider, 1977), the prediction is that the former will show less refractoriness.     

意向保持间隔对时间性前瞻记忆的影响

通过两个实验来探讨意向保持间隔对时间性前瞻记忆的影响。实验一仅通过嵌入前瞻目标的背景任务来操纵保持间隔,实验二通过在背景任务之前加入不同时长的填充任务来改变意向保持间隔。结果发现,(1)背景任务中的保持间隔越长,前瞻记忆成绩越差;(2)背景任务中的保持间隔和填充任务的时长对前瞻记忆的影响存在交互作用。成绩最好的为15min-2min组,最差的为15min-15min组。结果表明,背景任务和填充任务阶段对于个体保持前瞻意向可能有不同的功能。