Summation of food and shock based responding

In a multiphase experiment, dogs first received discriminative, discretetrial, barrier-jumping training with two tones (S^D, S^Δ) in a shuttle box reinforced by either shock avoidance (Group I) or by food (Group II). Then the dogs were trained on free-operant barrier-jumping reinforced by the qualitatively opposite reinforcer—food in Group I and shock avoidance in Group II. Finally, test presentations of the tone stimuli were superimposed on the free-operant behavior. The tone S^Ds markedly facilitated responding in all animals. This experiment demonstrates a summation of responding maintained by shock avoidance and food reinforcement and casts doubt on explanations of conditioned suppression outcomes that appeal solely to incompatible motivational states within the organism.     

INTERTRIAL INTERVAL DURATION AND LEARNING IN AUTISTIC CHILDREN

This study investigated the influence of intertrial interval duration on the performance of autistic children during teaching situations. The children were taught under the same conditions existing in their regular programs, except that the length of time between trials was systematically manipulated. With both multiple baseline and repeated reversal designs, two lengths of intertrial interval were employed: short intervals with the S^D for any given trial presented approximately one second following the reinforcer for the previous trial versus long intervals with the S^D presented four or more seconds following the reinforcer for the previous trial. The results showed that: (1) the short intertrial intervals always produced higher levels of correct responding than the long intervals; and (2) there were improving trends in performance and rapid acquisition with the short intertrial intervals, in contrast to minimal or no change with the long intervals. The results are discussed in terms of utilizing information about child and task characteristics in terms of selecting optimal intervals. The data suggest that manipulations made between trials have a large influence on autistic children's learning.     

Temporal parameters of the feature positive effect

Trial duration and intertrial interval duration were parametrically varied between groups of pigeons exposed to a discrimination involving the presence vs. the absence of a dot. Half the groups received the dot as the positive stimulus (feature positive groups) and half the groups received the dot as the negative stimulus (feature negative groups). Faster learning by the feature positive birds (feature positive effect) was found when the trial duration was short (5 sec) regardless of whether the intertrial interval was short (5 sec) or long (30 sec). No evidence for a feature positive effect was found when the trial duration was long (30 sec) regardless of the length of the intertrial interval (30 sec or 180 sec). The results suggest that short trial duration is a necessary condition for the occurrence of the feature positive effect, and neither intertrial interval nor trial duration/intertrial interval ratio are important for its occurrence. The suggestion that mechanisms underlying the feature positive effect and autoshaping might be similar was not supported by the present experiment since the trial duration/intertrial interval ration parameter appears to play an important role in autoshaping but not the feature positive effect.     

The effect of two schedules of primary and conditioned reinforcement

Of 23 pigeons, 11 received continuous reinforcement for key pecking, and 12 received an FR 10 schedule of reinforcement. The birds were then tested without food, but with potential conditioned reinforcers presented either on the same schedule as in training, on the other schedule, or not at all. Each bird in the subgroup trained on CRF and tested with S^r's at FR 10 not only gave more responses in testing than did each bird in both subgroups receiving no S^r's, but also gave more responses than did each bird in the S^r subgroup receiving CRF training and S^r's at CRF. Cumulative records are presented to show the effects of different schedules of conditioned reinforcers.     

Preference and response suppression under different correlations between shock and a positive reinforcer in rats

A lever-press response by rats was reinforced by food in two successively presented types of trial signalled by different discriminative stimuli. When responding was punished by a shock in one type of trial, a groups for which the shock always preceded the reinforcer by .5 sec (positive correlation) showed less suppression in those trials than a group which received the shock and food separated in time (negative correlation). When, in a second experiment, rats were given a choice between food alone in one end of a shuttle box and either positively or negatively correlated shock and food in the other on a concurrent schedule, the group receiving the negatively correlated shock showed a greater preference for the food alone end. On the basis of a third experiment in which a tone was substituted for the shock in the choice situation, it was argued that the effect of correlation was not simply due to the stimulus properties of the shock. A final experiment demonstrated that when shock punishment is administered during extinction of the lever-press response, the rate of extinction is slower if the shock has been previously paired with the food reinforcer. Pairing a shock with food seems to attenuate the intrinsic aversiveness of the shock through Pavlovian counterconditioning.     

The effect of multiple S periods on responding on a fixed-interval schedule: IV. Effect of continuous S with only short S probes

Pigeons were studied under FI 500 sec in which an S^Δ was present throughout the interval except during the terminal 50-sec segment and one earlier 50-sec segment. Very little responding occurred during the presence of S^Δ. The rate of responding in the earlier 50-sec S^D segments was lower than in the terminal S^D segment. There was a clear trend for the rate of responding in the earlier S^D segment to be progressively higher the later it occurred in the course of the FI 500 sec. This trend was shown roughly to parallel the increasing rate of responding in a conventional FI 500 sec with no interruption by S^Δ. Since the changing tendency to respond through the FI survives massive disruption by S^Δ, it is concluded that the control of responding through the FI does not require continuous mediating behavior. It is suggested that it is the decaying retroactive influence of the reinforcer on responses that occurred longer and longer before the reinforcer occurred which produces the familiar scalloped pattern of responding under FI schedules.     

Across-reinforcement blocking effects in a mediational test of the CS's general signaling property

Rats received Pavlovian aversive (shock) conditioning in which white noise was established for independent groups as a CS+, CSo, or CS−. Then, in an easy (light-dark) T-maze discrimination, the CS was presented either immediately following choice (Locus 1) or at the food cup in the goal (Locus 3), contingent upon either a food-reinforced (right) or nonreinforced (wrong) response. When presented at Locus 3, the CS+ facilitated and the CS− retarded learning for CS/right subjects, with these effects being exactly reversed but somewhat less pronounced for CS/wrong subjects. However, when the CS was presented at Locus 1, the CS+ and CS− effects for both response contingencies were attenuated. These findings oppose an interpretation of the CS's function as a general cue or transformed signal for the presence or absence of the new appetitive reinforcer and argue instead for across-reinforcement blocking effects: By signaling in the presence of food reinforcement an outcome (safety or shock) which is consonant with or discrepant from the “good” outcome obtained, the CS− blocks (retards) and the CS+ counterblocks (enhances) the association of food reinforcement and the S^D; conversely, in the presence of nonreinforcement (a “bad” outcome), the CS− counterblocks and the CS+ blocks inhibitory conditioning to the S^Δ. As in Kamin's (1968) original research, such effects are attenuated when the CS is presented early in the compound, distal to the reinforcer.     

Positive contrast obtained in reacquisition following interpolation of nonreinforced or partially reinforced trials

Two experiments investigated the effects of shifting from either nonreinforcement or partial reinforcement (PRF) to continuous reinforcement conditions (CRF). In the first experiment, three groups of rats were given food reinforcement under CRF conditions in a runway followed by regular extinction trials (RE), extinction trials where Ss were delayed for 30 sec before entering the empty goal box (DE), or CRF trials where Ss were delayed for 30 sec before entering the baited goal box (DF). Then all Ss were run on the delayed reinforcement condition (DF). In the final delayed reinforcement condition, group DE ran significantly faster than group DF, reflecting positive contrast. In the second experiment, four groups of rats were trained in a runway to receive either 4% or 18% sucrose reinforcers under either PRF or CRF conditions. Then all Ss were transferred to a Skinner box and bar presses were continuously reinforced, with each S continuing to receive the same sucrose concentration as before. The former PRF Ss, regardless of the reinforcer, bar pressed at a significantly higher rate in the Skinner box than the former CRF Ss. The evidence seemed to favor the view that the effectiveness of a reinforcer is not an absolute, unchanging quantity but rather depends on the historical context in which the reinforcer occurs.     

Context effects on choice.

Four pigeons responded on a concurrent-chains schedule in four experiments that examined whether the effectiveness of a stimulus as a conditioned reinforcer is best described by a global approach, as measured by the average interreinforcement interval, or by a local contextual approach, as measured by the onset of the stimulus preceding the conditioned reinforcer. The interreinforcement interval was manipulated by the inclusion of an intertrial interval, which increased the overall time to reinforcement but did not change the local contingencies on a given trial A global analysis predicted choice for the richer alternative to decrease with the inclusion of an intertrial interval, whereas a local analysis predicted no change in preference. Experiment 1 examined sensitivity to intertrial intervals when each was signaled by the same houselight that operated throughout the session. In Experiment 2, the intertrial interval always was signaled by the stimulus correlated with the richer terminal link. In Experiment 3, the intertrial interval was signaled by the keylights correlated with the initial links and two novel houselights. Experiment 4 provided free food pseudorandomly during the intertrial interval. In all experiments, subjects' preferences were consistent with a local analysis of choice in concurrent chains. These results are discussed in terms of delay-reduction theory, which traditionally has failed to distinguish global and local contexts.     

Heart rate conditioning in the newborn infant

In an attempt to condition heart rate in newborns, 21 infants were assigned to Conditioning, Random Control, and Backward Conditioning Groups. During training trials, the Conditioning Group received an eight-second tone (CS), a six-second ISI, and a ten-second presentation of glucose via nipple (UCS) that overlapped the last two seconds of tone. The Random Control Group received tones at the same intertrial intervals as the Conditioning Group, but glucose varied randomly. The Backward Conditioning Group received glucose during the ten seconds immediately preceding tone onset. The response to both CS and UCS during base trials was HR acceleration. The response to tone habituated in all groups, but the acceleration to glucose was maintained throughout conditioning. Although no conditioned response to the tone developed over trials, a large HR deceleration appeared during extinction to the absence of the UCS in the Conditioning Group only. This deceleration was interpreted as an orienting response to the absence of an expected event.     

Stimulus control of responding in the early trials of differential conditioning

In Experiment 1 two groups of rats were given 12 differential conditioning trials, seven to the rewarded alley (S+) and five to the nonrewarded alley (S?), prior to being extinguished in both alleys. Group S?S+ received S+ trials, following S? trials in acquisition, while Group S+S? did not receive S+ trials following S? trials in acquisition. In extinction S+ and S? trials were presented according to a quasi-random sequence for both groups. Running on the last 3 trials of acquisition was found to be faster following S+ than following S? trials. Group S?S+ showed greater resistance to extinction and less discriminative responding in extinction than Group S+S?. These results suggest that responding in differential conditioning is controlled not merely by S+ and S? but by the memories of reward (S^R) and of nonreward (S^N) as well. When the joint effects of both classes of cues were considered, e.g., S^R+S+, responding in the early trials of differential conditioning was shown to be highly orderly. Experiment 2 was highly similar to Experiment 1 except that Groups S?S+ and S+S? were equated along dimensions not equated in Experiment 1. The results obtained in Experiment 2 were highly similar to those obtained in Experiment 1.     

Observing behavior in monkeys (Macaca arctoides): Support for the information hypothesis

A single lever, discrete-trials observing procedure was used with stumptailed monkeys (Macaca arctoides). Lever-presses during a trial produced colored key lights (IS⁺ and IS^?) which signaled whether the trial would end with response-independent food or without food. During the baseline period, both IS⁺ and IS^? were produced on a variable-interval (VI) 15-sec schedule which began operating at the onset of the trial. The two experimental conditions involved a combination of this VI schedule and a DRL schedule. In one of these conditions, only a response that both met the VI requirement and was preceded by at least 6 sec of nonresponding could produce IS^? on nonfood trials, while the schedule for IS⁺ on food trials remained VI 15 sec. In the other experimental condition, the schedules for producing the two stimuli were the reverse. All subjects eventually learned to produce either IS⁺ or IS^? on the combined VI-DRL schedule. These data support an information hypothesis of observing in monkeys and contrast with data from pigeons which support a conditioned reinforcement hypothesis.     

Rats' lever-press durations as psychophysical judgments of time

Hungry rats received food following lever-press durations exceeding a minimum value, which ranged from 0 to 6.4 sec. When no intertrial intervals separated successive presses, modal press durations remained at very short values as the minimum value required for food was increased. This was particularly true immediately after a food presentation. When an 8-sec intertrial interval followed each lever release, modal press durations were always at or beyond the minimum value required for food, and outcome of the preceding press had no effect on press duration. Possible reasons for the effects of intertrial intervals included punishment of short presses, increased delay of reinforcement of short presses, and reduced density of reinforcement. In addition, functions relating discrete-trials lever-press duration to minimum duration required for food were found to be qualitatively and quantitatively similar to the power functions recently proposed by Catania (1970) for interresponse time and response latency. This similarity was taken as support for a general psychophysical law of temporal judgments.     

Concept identification: Effect of the intertrial interval on the efficacy and consistency of information processing

Two experiments following identical procedure except for the feedback duration (respectively, 2 sec and 1.5 sec) and the intertrial interval (respectively, 1 sec and 3 sec) are compared with respect to three sequential statistics whose theoretical interpretation is related to the degree of optimality of information processing. The results indicate that the values of the theoretical parameters representing the efficiency of information processing, the consistency of trial-by-trial decisions, and the efficacy of reinforcement are greater in the 3-sec interval condition. This is interpreted as a tentative explanation of the well-known effect of intertrial interval on the difficulty of the task with respect to the mean number of trials to criterion.     

Asymmetrical retention functions for sequences of light flashes or tone bursts in the rat

In Experiment 1, rats were trained in a symbolic delayed matching-to-sample task to discriminate sample stimuli that consisted of sequences of magazine light flashes. The intertrial interval was illuminated by the houselight for Group Light, and it was dark for Group Dark. Retention functions exhibited a choose-many response bias when the delay interval was illuminated by the houselight in both groups, and no consistent response bias when the delay interval was dark. In Experiment 2, rats were trained to discriminate sample stimuli that consisted of sequences of tone bursts. During delay testing, a different tone (i.e., different frequency and location than the sample tone) was present or absent during the delay interval. The retention functions exhibited a significant choose-many bias when tone was present during the delay and a choose-few bias when tone was absent. Asymmetrical retention functions for tone burst and light flash sequences are due to the similarity between the stimulus conditions of the delay interval and the modality of the sequential event being discriminated. These results are consistent with an instructional ambiguity explanation of response biases in memory for number.     

The role of instrumental responses in memory retrieval in a T-maze

Retrieval of the memory of non-reward on a rewarded trial was investigated here employing rats in a T-maze. A forced choice procedure was used. The daily rewarded (R) and non-rewarded (N) trials always occurred in a fixed order, two R, four N, and finally two R, i.e. the series was R1-R2-N1-N2-N3-N4-R3-R4. In an original acquisition phase, Trial N4 of the series having occurred in a particular spatial alternative, e.g. left, it was followed by R3 either in the same alternative, Groups C and T, or in the opposite alternative, Group R. Group T, unlike Groups C and R, received a relatively long intertrial interval between N4 and R3. In a shift phase, groups were treated as in original acquisition except that the long intertrial interval (Group T) and the change in response (Group R) now occurred between R3 and R4 rather than N4 and R3. The major finding in original acquisition was slower running by Groups T and R than by Group C on Trials N2, N3, and N4. In shift, differences between the groups disappeared. These findings are consistent with the hypothesis that response-produced cues contribute to memory retrieval.     

The role of temporal intervals on reinforcer accumulation

Animals accumulate reinforcers when they forgo the opportunity to consume available food in favor of acquiring additional food for later consumption. Laboratory research has shown that reinforcer accumulation is facilitated when an interval (either spatial or temporal) separates earning from consuming reinforcers. However, there has been no systematic investigation on the interval separating consuming reinforcers from earning additional reinforcers. This oversight is problematic because this second interval is an integral part of much of the previous research on reinforcer accumulation. The purpose of the current study was to determine the independent contributions of these two temporal intervals on reinforcer accumulation in rats. Each left lever press earned a single food pellet; delivery of the accumulated pellet(s) occurred upon a right lever press. Conditions varied based on the presence of either an intertrial interval (ITI) that separated pellet delivery from the further opportunity to accumulate more pellets, or a delay‐to‐reinforcement that separated the right lever press from the delivery of the accumulated pellet(s). Delay and ITI values of 0, 5, 10 and 20 s were investigated. The delay‐to‐reinforcement conditions produced greater accumulation relative to the ITI conditions, despite accumulation increasing the density of reinforcement more substantially in the ITI conditions. This finding suggests that the temporal separation between reinforcer accumulation and subsequent delivery and consumption was a more critical variable in controlling reinforcer accumulation.     

Choice and behavioral patterning

Ten pigeons pecked left and right keys in a discrete-trials experiment in which access to food was contingent upon changeovers to the right key after particular runs of left-key pecks. In each of three sets of conditions, two run lengths were reinforced according to a concurrent variable-interval schedule: reinforcement followed runs of either 1 or 2, 1 or 4, or 2 or 4 left-key pecks preceding changeovers. The intertrial interval separating successive pecks was varied from .5 to 10.0 sec, and the relative frequency of reinforcement for the shorter of the two reinforced runs was varied from 0 to .75. The contingencies established local behavioral patterning that roughly approximated that required for reinforcement. For a fixed pair of reinforced run lengths, preference for the shorter of the two frequently increased as the intertrial interval increased and therefore as the minimum temporal durations of both reinforced runs increased. Preference for the shorter of the two also increased as its corresponding relative frequency of reinforcement increased. Both of these effects on preference were qualitatively similar to corresponding effects in previous research with two different kinds of reinforced behavioral patterns, interresponse times and interchangeover times. In all these experiments, analytical units were found in the temporal patterns of behavior, not in the behavior immediately contiguous with a reinforcer. It is suggested that a particular local temporal pattern of behavior is established to the extent to which it is repeatedly remembered when reinforcers are delivered, regardless of whether the delivery of a reinforcer is explicitly contingent upon that pattern.     

Determinants of serial discrimination learning by squirrel monkeys

Squirrel monkeys were presented multiple serial discriminations 1, 2, 4, and 8 problems long. They were then presented problems designed to separate the effects of within-list associative interference from the effects of within-problem intertrial interval as list length was increased. The Ss committed consistently fewer errors after Trial 1 reward than after Trial 1 nonreward and showed strong stimulus perseveration. An increase in within-problem intertrial interval from 30 sec to 4 min had no effect whereas the associative interference resulting from increased problem length caused a small but significant performance decrement. Old and new problems had about equal effects on serial discrimination. The findings indicated that squirrel monkeys are relatively insensitive to within-problem associative interference.     

Inhibitory stimulus control and the magnitude of delayed reinforcement

The key pecking of pigeons was reinforced according to a variable-interval 1-min schedule during each of two successively presented stimuli. When the key was illuminated by a black line on a white background, reinforcement was delayed for 10 sec. When the key was illuminated by a plain white light, reinforcement was not delayed. For half of the subjects, the delayed reinforcer was 4.0-sec access to mixed grain, and for the remaining subjects it was 1.5-sec access. The immediate reinforcer was 1.5-sec access for all subjects. All subjects responded at a lower rate during the presentation of the black line; no between-group difference in terms of terminal response rate during the presentation of the line was found. However, subjects that received 4.0 sec of delayed reinforcement responded at a lower terminal rate during presentation of the plain white light than subjects that received 1.5 sec of delayed reinforcement. A subsequent generalization test along the line-orientation dimension produced flatter U-shaped gradients for subjects that received 4.0-sec of delayed reinforcement.