Effects of serial versus concurrent task sequencing an acquisition, maintenance, and generalization

Effects of serial and concurrent task presentation on skill acquisition, generalization, and maintenance were compared. Two severely retarded females participated. During serial training, items of one response class, tracing, were trained to mastery before those of a second task, vocal imitation. In the concurrent method, training on two different tasks, tracing and vocal imitation, alternated within sessions for fixed periods of time. There were no major differences between the serial and concurrent methods of instruction in the number of steps attained per behavior or in the number of trials required to reach criterion levels of performance. It was found however, that concurrent training resulted in more generalization. Retention results were not consistently related to training method.     

Performance of rats under concurrent variable-interval schedules of negative reinforcement

The behavior of rats under concurrent variable-interval schedules of negative reinforcement was examined. A single one-minute variable-interval programmer determined the availability of 30-second timeouts from electric shock. These were assigned to one or the other of the two component schedules with a probability of 0 to 1.0. The response requirement for the component schedules was standing to the right or left of the center of the experimental chamber. With a six-second changeover delay, the relative time spent under one component schedule varied directly and linearly with the relative number of timeouts earned under that component schedule. The absolute number of changeovers was highest when a similar number of timeouts was earned under each component schedule, and lowest when all or nearly all timeouts were earned under one component schedule. In general, these relations are similar to those reported with concurrent variable-interval schedules of positive reinforcement.     

Choice performance in several concurrent key-peck treadle-press reinforcement schedules

Five pigeons were exposed to several concurrent variable-interval food reinforcement schedules. For three subjects, one component of the schedule required a key-pecking response, the other a treadle-pressing response. For the other two subjects, both schedule components required treadle-pressing responses. The relative probability of reinforcement associated with the manipulanda was varied from 0 to 1.0 in 13 experimental conditions for the Key-Treadle subjects and nine conditions for the Treadle-Treadle subjects. The results indicated that the logarithms of relative time spent responding, and the logarithms of relative number of responses emitted on a manipulandum, approximated direct linear functions of logarithms of the relative frequencies of reinforcement associated with that manipulandum. No systematic bias in favor of time spent key pecking over time spent treadle pressing was apparent for the Key-Treadle subjects. All subjects exhibited undermatching, in that the ratios of time and response allocation at the alternatives systematically differed from the ratios of reinforcers obtained from the alternatives in the direction of indifference. Key pecking appeared to have no special link to food beyond treadle pressing or what would be expected on the basis of the reinforcement dependencies alone.     

Conservation, choice, and the concurrent fixed-ratio schedule

Five rats got all of their water in daily 60-minute sessions. Two levers and a water spout were freely available throughout baseline sessions. Contingency sessions offered a choice between two alternative fixed-ratio components, in the form of a choice between the two levers. Each component required a specified number of lever presses for access to the spout, and then a specified number of licks for another choice between components. Given the observed relative frequency, the absolute frequency of selecting each component was predicted accurately by assuming that the subject conserved between baseline and contingency the total amount of a dimension attributable to lever pressing and licking. Several quantitative models for predicting relative frequency were examined. The best of these assumed that the subject would show a nonexclusive preference for the component requiring fewer lever presses.     

Effects on choice of reinforcement delay and conditioned reinforcement

Pigeons chose between fixed-interval schedules of different durations presented in the terminal links of concurrent-chains schedules. The pair of schedules was always in the ratio of 2:1, but the absolute duration of the fixed intervals varied. In one set of conditions, the different terminal-link schedules were associated with different keylight stimuli (cued conditions). In a second set of conditions, the different terminal-link schedules were associated with the same stimulus (uncued conditions). Results from the cued conditions replicated previous findings that preference for the shorter fixed-interval schedule increased with fixed-interval duration. Preferences in the uncued conditions were lower than in the corresponding cued conditions but also increased with fixed-interval length. In addition, the degree of control under the uncued conditions was correlated with the extent to which the schedule during the terminal link was discriminated immediately upon entry into the terminal link. The pattern of results in both conditions was inconsistent with the notion that choice behavior matches relative immediacy of reinforcement. Reanalysis of previous evidence for matching (Chung and Herrnstein, 1967) showed that matching in fact did not occur, as the preferences of their subjects for the shorter of two delays also increased with the absolute size of the delays.     

Histological data: Hollard and Davison (1971)

As Mogenson and Cioé (1977) have assumed that our electrodes aimed at the ectostriatum (Hollard and Davison, 1971) were actually located there, we feel that a presentation of the histological data is necessary. Following termination of further experiments (Hollard, 1974) the pigeons, numbered 93, 95, and 119, were sacrificed and perfused with saline followed by 10% formalin. Sections, 50 microns thick, were cut on a freezing microtome. Prints were made by mounting each unstained section of a microscope slide and placing them in a standard photographic enlarger. The electrode tips of Pigeons 93 and 119 were located in the paleostriatal complex. The sections of Pigeon 95 were damaged and precise localization was not possible. Further work in this laboratory has also found that, using the same coordinates, electrode tips tend to fall in the paleostriatum, rather than in the more dorsal ectostriatum at which they are aimed. The paleostriatal placements tended to sustain self-stimulation, whereas others located in the ectostriatum sustained relatively low or unstable rates.     

Local response-rate constancy on concurrent variable-interval schedules of reinforcement

Concurrent variable-interval schedules were arranged with a main key that alternated in color and schedule assignment, along with a changeover key on which a small fixed ratio was required to changeover. Acceptable matching was observed with pigeons in two replications, but there was a tendency toward overmatching. Local response rates were found to differ for unequal schedules of a concurrent pair: local response rate was greater for the variable-interval schedule with the smaller average interreinforcement interval, but qualifications based on an interresponse-time analysis were discussed. In a second experiment, two 3-minute variable-interval schedules were arranged concurrently, and the experimental variable was the changeover procedure: either a changeover delay was incurred by each changeover or a small fixed ratio on a changeover key was required to complete a changeover. Changeover delays of 2 and 5 seconds were compared with a fixed-ratio changeover of five responses. The response output on the main key (associated with the variable-interval schedules) was greater when a changeover delay was arranged than when a fixed ratio was required to changeover. A detailed analysis of stripchart records showed that a 2-second delay generated an increased response rate for 3 seconds after a changeover, while the fixed-ratio requirement generated an increased rate during the first second only, followed by a depressed response rate for 2 seconds.     

Optimization and the matching law as accounts of instrumental behavior

The interaction between instrumental behavior and environment can be conveniently described at a molar level as a feedback system. Two different possible theories, the matching law and optimization, differ primarily in the reference criterion they suggest for the system. Both offer accounts of most of the known phenomena of performance on concurrent and single variable-interval and variable-ratio schedules. The matching law appears stronger in describing concurrent performances, whereas optimization appears stronger in describing performance on single schedules.     

Conditioned reinforcement as a function of duration of stimulus

Pigeons were provided with three keys. Pecking the center key produced grain on a schedule that alternated at unpredictable times between a variable-interval component and extinction. On concurrent variable-interval schedules, pecking either side key produced a stimulus associated with the variable-interval component on the center key provided that said schedule was currently in effect. The independent variable was the length of time this stimulus remained on the keys. Pecking one side key produced the stimulus for 27 seconds, whereas the duration produced by pecking the other key varied for successive blocks of sessions. For the first four birds, the values tested were 3, 9, 27, and 81 seconds. For the second group, numbering three birds, the values tested were 1, 3, 9, and 27 seconds. The dependent variable was the proportion of total side key pecks that occurred on the variable key. For all birds, the function was positive in slope and negative in acceleration. This finding supports a formulation that ascribes the maintenance of observing responses in a normal setting to the fact that the subject exposes itself to the positive discriminative stimulus for a longer mean duration than it does to the negative stimulus.