INTERTRIAL INTERVAL DURATION AND LEARNING IN AUTISTIC CHILDREN

This study investigated the influence of intertrial interval duration on the performance of autistic children during teaching situations. The children were taught under the same conditions existing in their regular programs, except that the length of time between trials was systematically manipulated. With both multiple baseline and repeated reversal designs, two lengths of intertrial interval were employed: short intervals with the S^D for any given trial presented approximately one second following the reinforcer for the previous trial versus long intervals with the S^D presented four or more seconds following the reinforcer for the previous trial. The results showed that: (1) the short intertrial intervals always produced higher levels of correct responding than the long intervals; and (2) there were improving trends in performance and rapid acquisition with the short intertrial intervals, in contrast to minimal or no change with the long intervals. The results are discussed in terms of utilizing information about child and task characteristics in terms of selecting optimal intervals. The data suggest that manipulations made between trials have a large influence on autistic children's learning.     

Effects of discrete-trial and free-operant procedures on the acquisition and maintenance of successive discrimination in rats.

Rats were trained on a successive discrete-trial discrimination between two tonal stimuli to examine the effects of availability of a lever during intertrial intervals. In the discrete-trial condition, in which a lever was removed from the chamber during intertrial intervals, 10-s trials were initiated by the presentation of both discriminative stimulus and lever. In the free-operant condition, in which a lever was present during both trials and intertrial intervals, 10-s trials were initiated only by the presentation of a discriminative stimulus. Experiment 1 employed 50-s intertrial intervals and demonstrated that discriminative performances were acquired faster and maintained better in the free-operant conditions than in the discrete-trial conditions. Experiment 2 employed 5-s intertrial intervals and showed that poor discriminative performances in the discrete-trial conditions were improved. These results indicate that the presentation of a lever to start a trial can overshadow or mask the control by a discriminative stimulus and thereby obstruct the acquisition and maintenance of discriminative performances. Furthermore, the overshadowing or masking effects are strengthened as a function of the duration of intertrial intervals.     

The effects of variation of intertrial interval on exploration of elevatd and enclosed mazes

The interval between exploratory trials was varied in experiments using simple elevated or enclosed mazes. Activity on the second trial was depressed for short intertrial intervals but had recovered after about 10 min.; the degree of recovery was different in the two types of maze. A second decrease in second trial activity was found with inter-trial intervals of more than 20 min., but a further experiment suggested this was due to the effects of delay itself, rather than to previous experience of the environment.     

Choice in the repeated-gambles experiment

Humans chose 10 times between two roulette wheels projected on a monitor. During the first trial, the left wheel provided a hypothetical $100 with p = .94, and the right wheel provided $250 with p = .39. A titration procedure adjusted the probability of a $250 win across trials to permit estimation of an indifference point between alternatives. In Experiment 1, intertrial-interval duration (25 vs. 90 s) and whether sessions began with an intertrial interval or a trial were varied in a 2 × 2 design in this risky-choice procedure. Risk aversion (preference for the $100 wheel) increased with intertrial interval but was unaffected by whether sessions began with a trial or an intertrial interval. In Experiment 2, all sessions began with a trial, and subjects were informed that the experiment ended after 10 trials. Intertrial-interval duration had no effect on choice. In Experiment 3, intertrial-interval duration and whether subjects were given $10 or $10,000 before beginning were varied among four groups in a 2 × 2 design. In all other ways, the procedure was unchanged from Experiment 2. Intertrial interval had no effect on choice, but the $10,000 groups showed less risk aversion than the $10 groups. These results can be explained more readily in terms of Kahneman and Tversky's (1984) notion of “framing of the prospect” than in terms of Rachlin, Logue, Gibbon, and Frankel's (1986) behavioral account of risky choice.     

Counting strategies and assimilation effects in short-term retention of temporal information

The purpose of the present research was to examine proactive interference in general and assimilation effects (i.e., shifts in constant error caused by prior responses) in particular, when subjects used covert counting to aid their retention of the temporal information. Visually presented durations of 1, 4, and 8 sec. were estimated by 18 subjects under the method of reproduction. Three retention intervals (i.e., immediate, 15, and 30 sec.) and three intertrial intervals (i.e., immediate, 15, and 30 sec.) were employed. Analysis of constant error provided no indication that proactive interference was operating in the retention of temporal information as there was no increase in error across trials, no increase in error for longer retention intervals, and no interaction between trials and retention intervals. Also, there was no change in variable error as the retention intervals lengthened for any temporal duration except for the 4-sec. criterion. Finally, the rate of counting (counting units/sec.) was different across the durations to be remembered. The major conclusion of the present research was that counting greatly facilitates retention of temporal information as compared to retention without such a time-aiding strategy.     

The sex difference in rotary pursuit performance: aptitude or inhibition?

This study examined the hypothesis that male dominance in the acquisition and performance of rotary pursuit skill reflects a lower male proclivity for the generation and accumulation of reactive inhibition rather than some innately superior ability to profit from practice. On this hypothesis, the magnitude of male dominance should decline as the length of the intertrial interval increases. The experimental sample consisted of 120 Caucasian subjects (60 of each sex) who were given sixty 30-sec trials on rotary pursuit with intertrial intervals ranging from 0 to 40 sec. The principal finding was that the magnitude of the sex difference depended significantly upon the length of the intertrial interval, as hypothesized. When the interval was 10 sec or longer, performance levels of the sexes were essentially equal. The sex variance was reduced to insignificance even on the first trial when allowance was made for the inhibitory effect of practice. Thus, male dominance in rotary pursuit skill appears to be a procedural effect mediated by and inhibitory mechanism rather than a consequence of differential endowments of learning ability.     

The Sex Difference in Rotary Pursuit Performance

This study examined the hypothesis that male dominance in the acquisition and performance of rotary pursuit skill reflects a lower male proclivity for the generation and accumulation of reactive inhibition rather than some innately superior ability to profit from practice. On this hypothesis, the magnitude of male dominance should decline as the length of the intertrial interval increases. The experimental sample consisted of 120 Caucasian subjects (60 of each sex) who were given sixty 30-sec trials on rotary pursuit with intertrial intervals ranging from 0 to 40 sec. The principal finding was that the magnitude of the sex difference depended significantly upon the length of the intertrial interval, as hypothesized. When the interval was 10 sec or longer, performance levels of the sexes were essentially equal. The sex variance was reduced to insignificance even on the first trial when allowance was made for the inhibitory effect of practice. Thus, male dominance in rotary pursuit skill appears to be a procedural effect mediated by an inhibitory mechanism rather than a consequence of differential endowments of learning ability.     

Choice as a function of local versus molar reinforcement contingencies.

Rats were trained on a discrete-trial probability learning task. In Experiment 1, the molar reinforcement probabilities for the two response alternatives were equal, and the local contingencies of reinforcement differentially reinforced a win-stay, lose-shift response pattern. The win-stay portion was learned substantially more easily and appeared from the outset of training, suggesting that its occurrence did not depend upon discrimination of the local contingencies but rather only upon simple strengthening effects of individual reinforcements. Control by both types of local contingencies decreased with increases in the intertrial interval, although some control remained with intertrial intervals as long as 30 s. In Experiment 2, the local contingencies always favored win-shift and lose-shift response patterns but were asymmetrical for the two responses, causing the molar reinforcement rates for the two responses to differ. Some learning of the alternation pattern occurred with short intertrial intervals, although win-stay behavior occurred for some subjects. The local reinforcement contingencies were discriminated poorly with longer intertrial intervals. In the absence of control by the local contingencies, choice proportion was determined by the molar contingencies, as indicated by high exponent values for the generalized matching law with long intertrial intervals, and lower values with short intertrial intervals. The results show that when molar contingencies of reinforcement and local contingencies are in opposition, both may have independent roles. Control by molar contingencies cannot generally be explained by local contingencies.     

Sequential effects in pigeon delayed matching-to-sample performance

Pigeons were tested in a three-alternative delayed matching-to-sample task in which second-choices were permitted following first-choice errors. Sequences of responses both within and between trials were examined in three experiments. The first experiment demonstrates that the sample information contained in first-choice errors is not sufficient to account for the observed pattern of second choices. This result implies that second-choices following first-choice errors are based on a second examination of the contents of working memory. Proactive interference was found in the second experiment in the form of a dependency, beyond that expected on the basis of trial independent response bias, of first-choices from one trial on the first-choice emitted on the previous trial. Samples from the previous trial were not found to exert a significant influence on later trials. The magnitude of the intertrial association (Experiment 3) did not depend on the duration of the intertrial interval. In contrast, longer intertrial intervals and longer sample durations did facilitate choice accuracy, by strengthening the association between current samples and choices. These results are incompatible with a trace-decay and competition model; they suggest strongly that multiple influences act simultaneously and independently to control delayed matching-to-sample responding. These multiple influences include memory for the choice occurring on the previous trial, memory for the sample, and general effects of trial spacing.     

Molar optimization versus delayed reinforcement as explanations of choice between fixed-ratio and progressive-ratio schedules.

In a discrete-trials procedure, pigeons chose between a fixed-ratio 81 schedule and a progressive-ratio schedule by making a single peck at the key correlated with one or the other of these schedules. The response requirement on the progressive-ratio schedule began at 1 and increased by 10 each time the progressive-ratio schedule was chosen. Each time the fixed-ratio schedule was chosen, the requirement on the progressive-ratio schedule was reset to 1 response. In conditions where there was no intertrial interval, subjects chose the progressive-ratio schedule for an average of about five consecutive trials (during which the response requirement increased to 41), and then chose the fixed-ratio schedule. This ratio was larger than that predicted by an optimality analysis that assumes that subjects respond in a pattern that minimizes the response-reinforcer ratio or one that assumes that subjects respond in a pattern that maximizes the overall rate of reinforcement. In conditions with a 25-s or 50-s intertrial interval, subjects chose the progressive-ratio schedule for an average of about eight consecutive trials before choosing the fixed-ratio schedule. This change in performance with the addition of an intertrial interval was also not predicted by an optimality analysis. On the other hand, the results were consistent with the theory that choice is determined by the delays to the reinforcers delivered on the present trial and on subsequent trials.     

Surprise is predicted by event probability,outcome valence,outcome meaningfulness,and gender

The present research was designed to better understand how the magnitude of experienced surprise is affected by both individual difference variables as well as variations in surprise-eliciting stimuli. Eighty-five participants played 5 versions of a slot machine-like game. The five games only differed with respect to the probability of winning each trial—10 % (i.e., wins were highly unusual), 30, 50, 70, and 90 % (i.e., losses were highly unusual). Players were given a fictitious “bankroll” at the beginning of each game and played up to 25 trials of each game. On each trial, players selected their wager amount, “pulled” the handle, learned the outcome (win or loss), and reported their surprise level using a 1 (none) to 9 (extremely) Likert scale. Replicating past research, results revealed that self-reported surprise was inversely related to outcome probability and that wins were rated as more surprising than losses, even when wins and losses occurred at the same level of probability. Novel results include finding that larger wagers predicted greater felt surprise (regardless of outcome), and that women reported greater surprise to both wins and losses than men.     

Partial avoidance contingencies: Absolute omission and punishment probabilities

Avoidance contingencies were defined by the absolute probability of the conjunction of responding or not responding with shock or no shock. The “omission” probability (ρ₀₀) is the probability of no response and no shock. The “punishment” probability (ρ₁₁) is the probability of both a response and a shock. The traditional avoidance contingency never omits shock on nonresponse trials (ρ₀₀=0) and never presents shock on response trials (ρ₁₁=0). Rats were trained on a discrete-trial paradigm with no intertrial interval. The first lever response changed an auditory stimulus for the remainder of the trial. Shocks were delivered only at the end of each trial cycle. After initial training under the traditional avoidance contingency, one group of rats experienced changes in omission probability (ρ₀₀>0), holding punishment probability at zero. The second group of rats were studied under different punishment probability values (ρ₁₁>0), holding omission probability at zero. Data from subjects in the omission group looked similar, showing graded decrements in responding with increasing probability of omission. These subjects approximately “matched” their nonresponse frequencies to the programmed probability of shock omission on nonresponse trials, producing a very low and approximately constant conditional probability of shock given no response. Subjects in the punishment group showed different sensitivity to increasing absolute punishment probability. Some subjects decreased responding to low values as punishment probability increased, while others continued to respond at substantial levels even when shock was inevitable on all trials (noncontingent shock schedule). These results confirm an asymmetry between two dimensions of partial avoidance contingencies. When the consequences of not responding included occasional omission of shock, all subjects showed graded sensitivity to changes in omission frequency. When the consequences of responding included occasional shock delivery, some subjects showed graded sensitivity to punishment frequency while others showed control by overall shock frequency as well.     

Discrimination training, partial reinforcement, and increases in intertrial interval all reduce response speed in a continuously reinforced key-pecking task

Pigeons were trained in a discrete-trial task in which a response to the center key obtained illumination of a side key and a single response to the side key terminated a trial with either reinforcement or nonreinforcement. Center-key speeds (i.e., reciprocals of latencies) declined with increases in intertrial interval, and it is argued that this effect is related to a decreased likelihood as intertrial interval increases that birds will be near the key at trial onset. Side-key speeds on trials with reinforcement decreased both with increases in intertrial interval and with shifts from continuous reinforcement to either a discrimination or a partial-reinforcement condition. The effects on side-key speeds are compared with effects observed in alley-running tasks using rats, and an interpretation in terms of frustration theory is offered for the results obtained in both types of task.     

Choice behavior on discrete trials: a demonstration of the occurrence of a response strategy

Three pairs of pigeons were trained to peck at two keys presented simultaneoulsy in discrete trials with intertrial intervals of 1, 22, or 120 sec. Left-key responses incremented the probability of reinforcement for the first right-key response and, conversely, right-key responses incremented the probability of reinforcement for the first left-key response. In terms of relative response rates, it was found that all birds' choices were described by a momentary maximizing strategy, but this fact was not reflected in the detailed sequential statistics for birds with the longer (22 or 120 sec) intertrial intervals. It was hypothesized that choice behavior, in general, may be accurately described by a momentary maximizing sequence, but that prior failures to demonstrate this were due to “errors” in executing the momentary maximizing sequence. These misappropriated responses, which are hypothesized to be randomly distributed among the responses defining the momentary maximizing sequence, caused successive choices to appear to be statistically independent when, in fact, they were not.     

Temporal Patterning in Probabilistic Choice

Human subjects making repeated choices between probabilistic and near-certain monetary rewards tended to be less risk-averse the shorter the inter-trial interval. Subjects were also less risk-averse when the choice-outcome sequences were clustered in threes than when each choice-outcome sequence was separated from its neighbors by equal intertrial intervals. These results further extend the analogy between delay discounting and probability discounting. Probability discounting, like delay discounting, may be described by hyperbolic function relating discounted value to expected delay to the next reward.     

Self-control by pigeons in the prisoner's dilemma

Pigeons played a repeated prisoner's dilemma game against a computer that reflected their choices: If a pigeon cooperated on trial n, the computer cooperated on trial n + 1; if the pigeon defected on trial n, the computer defected on trial n + 1. Cooperation thus maximized reinforcement in the long term, but defection was worth more on the current trial. Under these circumstances, pigeons normally defect. However, when a signal correlated with the pigeon's previous choice immediately followed each current trial choice, some pigeons learned to cooperate. Furthermore, cooperation was higher when trials were close together in time than when they were separated by long intertrial intervals.     

Control of responding by sounds of different quality: an evolutionary analysis.

Two experiments investigated the acquisition of discriminations between two acoustic stimuli of different quality (noise bursts vs. a 2-kHz pulsed signal) when features of the everyday environment were incorporated into the experiments. In Experiment 1, rats were trained, using food, to press a lever. Throughout all sessions, 5-s trials of noise bursts (the random stimulus) were presented, after variable intertrial intervals, through a remote speaker mounted outside the experimental enclosure. The noise burst occurred randomly with respect to reinforcement of lever pressing and had no programmed relationship to the animal's behavior. When lever pressing was established, the 2-kHz signal was presented through a speaker adjacent to the response lever according to a different set of variable intertrial intervals. A response in the presence of the 2-kHz signal terminated the trial and was reinforced. The 2-kHz signal acquired control of responding within the first few trials, whereas the random stimulus exerted no control of responding. In Experiment 2, rats were trained to press the lever in the presence of the 2-kHz signal presented through the adjacent speaker on a variable intertrial interval. After 14 sessions, 5-s trials of noise bursts (random stimulus) were presented through the remote speaker on the second variable intertrial interval. The random stimulus initially elicited exploratory behavior, which then rapidly declined. Subsequently, the random stimulus exerted no or weak control of responding. The introduction of the random stimulus had no effect on responding in the presence of the adjacent stimulus. In Experiments 3 and 4 the random stimulus was presented through the adjacent speaker, and the stimulus correlated with reinforcement was presented through the remote speaker. In both experiments, there was persistent control of responding by the random stimulus and slow development of control by the stimulus correlated with reinforcement. In Experiment 5, both stimuli were presented through the adjacent speaker. There was persistent control of responding by the random stimulus.     

Role of intertrial interval following an escape or avoidance response in bar-press avoidance

In three experiments, rats learned bar-press avoidance as a function of the intertrial interval following an escape or an avoidance. The general hypothesis is that the length of these intervals affects bar-press avoidance differentially, depending on whether an avoidance follows an escape (avoidance/escape) or an avoidance (avoidance/avoidance) on the previous trial. Specifically, it is proposed that short escape ITIs will facilitate avoidance/escape and avoidance/avoidance, while avoidance ITIs will have no effect on avoidance responding. The results tend to support this hypothesis. The shorter the intertrial interval following an escape, the higher the probability of both measures: avoidance/escape and avoidance/avoidance. No effect of avoidance interval was found on avoidance/avoidance. Unpredictedly, however, it was found that in comparison to a very short intertrial interval following an avoidance (0.5 sec), relatively long intervals (5 and 45 sec) facilitate avoidance/escape. These results were interpreted as mainly reflecting nonassociative factors such as shock-produced activity.     

Priming and trial spacing in extinction: Effects on extinction performance,spontaneous recovery,and reinstatement in appetitive conditioning

Previous research in this laboratory suggests that priming of the conditional stimulus (CS) in short-term memory may play a role in the trial-spacing effects in appetitive conditioning. For example, a nonreinforced presentation of a CS 60 s before a reinforced trial with the same CS produced slower acquisition than a CS presentation that occurred 240 s before the reinforced trial. The results were consistent with the self-generated priming mechanism proposed by Wagner (e.g., Wagner 1978, 1981). The present experiments extended the earlier work by examining the effects of trial spacing in extinction rather than acquisition. After conditioning with a mixture of intertrial intervals (ITIs), rats received extinction with ITIs of 60 or 240 s, longer or shorter values, or different ways of “chunking” extinction trials in time. Although trial spacing produced effects on extinction performance that were consistent with our previous research on acquisition, there were few long-term differences in spontaneous recovery or in reinstatement. Short ITIs in extinction appear to affect extinction performance more than they affect extinction learning. Mechanisms of trial spacing in conditioning and extinction are discussed.     

Short-term retention of response outcome as a determinant of serial reversal learning

The correlation between short-term retention of the outcome of the preceding response and overall learning proficiency was investigated for serial reversal learning. Pigeons were trained to asymptote on a serial reversal problem and then were presented a percentage reinforcement schedule where only some correct trials were rewarded. Nonrewarded correct trials were treated exactly as incorrect trials. The difference in error probability following the two types of correct trials was then used as a measure of short-term retention. When intertrial intervals (ITI) were short (6 sec), substantial differences occurred. When the ITI's were increased, the difference in accuracy declined regularly to no difference at an ITI of 60 sec. This demonstration of a short-term retention gradient, coupled with the finding that overall reversal learning was much better with the shorter ITI's, suggests that a primary mechanism of improvement in serial reversal learning is the acquisition of a conditional discrimination based on the outcome of the preceding response.