Effects of reinforcement history on response rate and response pattern in periodic reinforcement

Several researchers have suggested that conditioning history may have long-term effects on fixed-interval performances of rats. To test this idea and to identify possible factors involved in temporal control development, groups of rats initially were exposed to different reinforcement schedules: continuous, fixed-time, and random-interval. Afterwards, half of the rats in each group were studied on a fixed-interval 30-s schedule of reinforcement and the other half on a fixed-interval 90-s schedule of reinforcement. No evidence of long-term effects attributable to conditioning history on either response output or response patterning was found; history effects were transitory. Different tendencies in trajectory across sessions were observed for measures of early and late responding within the interreinforcer interval, suggesting that temporal control is the result of two separate processes: one involved in response output and the other in time allocation of responding and not responding.     

The history of imitation in learning theory: the language acquisition process

The concept of imitation has undergone different analyses in the hands of different learning theorists throughout the history of psychology. From Thorndike's connectionism to Pavlov's classical conditioning, Hull's monistic theory, Mowrer's two-factor theory, and Skinner's operant theory, there have been several divergent accounts of the conditions that produce imitation and the conditions under which imitation itself may facilitate language acquisition. In tracing the roots of the concept of imitation in the history of learning theory, the authors conclude that generalized imitation, as defined and analyzed by operant learning theorists, is a sufficiently robust formulation of learned imitation to facilitate a behavior-analytic account of first-language acquisition.     

The effect of modeling and vicarious reinforcement upon the subsequent imitation of a socially approved response

This study tested whether modeling and positive vicarious reinforcement produced imitation of a socially approved behavior. Eighty-eight fourth-grade girls were divided into four groups: three experimental and one control. The experimental groups watched a video tape of a peer model drawing. In one condition the model was praised; in the second, no praise was given and a short interval elapsed before the S could model the behavior; in the third, no praise was given and the S could model the behavior immediately. The control group watched a blank screen. Significant modeling effects occurred among those Ss exposed to the tapes (p < .001). Positive vicarious reinforcement, however, did not further facilitate the modeling effect. The data were discussed in light of the practicality and feasibility of using modeling procedures in the schools.     

Determinants of imitation of hand-to-body gestures in 2- and 3-year-old children

Twenty children, ten 2-year-olds and ten 3-year-olds, participated in an AB procedure. In the baseline phase, each child was trained the same four matching relations to criterion under intermittent reinforcement. During the subsequent imitation test, the experimenter modeled a total of 20 target gestures (six trials each) interspersed with intermittently reinforced baseline trials. In each session, target gestures were selected in a pre-randomized sequence from: Set 1--ear touches; Set 2--shoulder touches; Set 3--midarm touches; and Set 4--wrist touches; subjects' responses to targets were not reinforced. In each target set, half the gestures featured in nursery matching games and were termed common targets whereas the remainder, which were topographically similar but did not feature in the games, served as uncommon targets. The children produced significantly more matching responses to common target models than to uncommon ones. Common responses were also produced as mismatches to uncommon target models more often than vice versa. Response accuracy did not improve over trials, suggesting that "parity" did not serve as a conditioned reinforcer. All children showed a strong bias for "mirroring"--responding in the same hemispace as the modeler. The 2-year-olds produced more matching errors than the 3-year-olds and most children showed a bias for responding with their right hands. The strong effects of training environment (nursery matching games) are consistent with a Skinnerian account, but not a cognitive goal theory account, of imitation in young children.     

The effects of behavioral history on response acquisition with immediate and delayed reinforcement

Effects of prior exposure to the experimental chamber with levers present or absent and variable-time (VT) 60-s water deliveries arranged during one, five, or no 1-hr sessions were examined in rats during a 6-hr response-acquisition session in which presses on one lever produced water delivery immediately or after a 15-s resetting delay, and presses on the other lever canceled scheduled water deliveries. Response acquisition was (a) slower to occur when water deliveries were delayed, (b) most consistent in groups that had received five VT sessions, and (c) impaired by the presence of levers only when there had been five VT sessions and water deliveries were delayed during the acquisition session.     

Effects of reinforcement and response-cost history on instructional control

The present study compared the effects of reinforcement or punishment versus no additional consequences for instruction following on instructional control and subsequent rule-governed insensitivity. In two experiments, adult participants were presented with repeated choices between a short progressive-time schedule and either a fixed time-schedule or a longer progressive-time schedule. In Experiment 1, three groups were given an initially accurate instruction relative to the direct contingency. A control group experienced no additional consequences for compliance with instructions, whereas compliance resulted in additional points for a second group, and noncompliance led to the subtraction of points for a third group. In a subsequent phase, instructions became inaccurate and there were no additional consequences for compliance or noncompliance for any group. Consistent with previous results, rule-governed insensitivity was observed in all participants. Experiment 2 employed the same procedure, except instructions were inaccurate throughout all sessions, and compliance in the subsequent phase resulted in diminishing points per session. Reinforcement for following instructions increased instructional control and subsequent rule-governed insensitivity. This increase was maintained even after the termination of additional consequences, a result that supports theoretical suggestions that a history of reinforcement for complying with instructions and rules is an important factor in rule-governed insensitivity.     

Effects of a history of differential reinforcement on preference for choice

The effects of a history of differential reinforcement for selecting a free-choice versus a restricted-choice stimulus arrangement on the subsequent responding of 7 undergraduates in a computer-based game of chance were examined using a concurrent-chains arrangement and a multiple-baseline-across-participants design. In the free-choice arrangement, participants selected three numbers, in any order, from an array of eight numbers presented on the computer screen. In the restricted-choice arrangement, participants selected the order of three numbers preselected from the array of eight by a computer program. In initial sessions, all participants demonstrated no consistent preference or preference for restricted choice. Differential reinforcement of free-choice selections resulted in increased preference for free choice immediately and in subsequent sessions in the absence of programmed differential outcomes. For 5 participants, changes in preference for choice were both robust and lasting, suggesting that a history of differential reinforcement for choice may affect preference for choice.     

Effects of choice of stimuli as reinforcement for task responding in reinforcement for task responding in preschoolers with and without developmental disabilities

The effects of choice and no choice of stimuli as reinforcement for task responding were investigated across preschoolers with and without disabilities. Five less preferred stimuli were identified for each participant using a stimulus preference assessment. No differences were found for choice and no-choice conditions when the less preferred stimuli were used as reinforcers.     

Transient effects of acquisition history on generalization in a matching-to-sample task

This study examined the role of learning history on the acquisition of a matching-to-sample task. Twelve preschool children learned four stimulus classes through instructions, shaping, or imitation. After reaching criterion, the subjects were exposed to changed discrimination contingencies to determine how each learning history affected the acquisition of responses appropriate to the new contingencies. All subjects reached criterion on the new relations, although the subjects with a shaping history adapted slightly more quickly than those subjects with a history of instructions or imitation. Given sufficient exposure to changed contingencies, rule-driven insensitivity to contingencies was overcome by experience with consequences. This result may be specific to younger subjects, but it suggests that instructions can be used in education without creating insensitivity to contingencies.     

Effects of medial and lateral septal lesions on the partial reinforcement extinction effect at one trial a day

Rats sustained electrolytic lesions of either the medial septal (MS) area (of a kind known to eliminate the hippocampal theta rhythm) or the dorso-lateral septal (LS) area (of a kind known to spare theta) or both (a “total septal”, TS, lesion). They were compared to sham-operated controls in three experiments in the straight alley with food reward on continuous (CRF) or partial (PRF) reinforcement at one trial a day. MS lesions either left the partial reinforcement extinction effect (PREE) unchanged or enhanced it; LS lesions substantially reduced the PREE. The latter effect was due to a fall in resistance to extinction in PRF animals with no change in CRF animals. MS lesions greatly increased resistance to extinction in both CRF and PRF animals in one experiment but increased resistance to extinction only marginally and only in PRF animals in a second experiment. The TS lesion acted like the LS lesion. These results demonstrate a clear double dissociation between the effects of MS and LS lesions, especially in the PRF condition (LS lesions reduce resistance to extinction, MS lesions increase it).     

Effects of guilt and response modality upon associative sexual responses

Two experiments were conducted to test two conceptualizations of guilt. These were Mosher's social learning view and an avoidant-anxiety view suggested by Galbraith. Both experiments examined the effects of sexual guilt and response modality upon associative sexual responses. The results indicated that anonymity of responding increased the number of sexual responses of low guilt women but not that of high guilt women. The results were interpreted as supporting Mosher's preservation of self-esteem view of guilt.     

Effects of signaled and unsignaled alternative reinforcement on persistence and relapse in children and pigeons

Three experiments explored the impact of different reinforcer rates for alternative behavior (DRA) on the suppression and post‐DRA relapse of target behavior, and the persistence of alternative behavior. All experiments arranged baseline, intervention with extinction of target behavior concurrently with DRA, and post‐treatment tests of resurgence or reinstatement, in two‐ or three‐component multiple schedules. Experiment 1, with pigeons, arranged high or low baseline reinforcer rates; both rich and lean DRA schedules reduced target behavior to low levels. When DRA was discontinued, the magnitude of relapse depended on both baseline reinforcer rate and the rate of DRA. Experiment 2, with children exhibiting problem behaviors, arranged an intermediate baseline reinforcer rate and rich or lean signaled DRA. During treatment, both rich and lean DRA rapidly reduced problem behavior to low levels, but post‐treatment relapse was generally greater in the DRA‐rich than the DRA‐lean component. Experiment 3, with pigeons, repeated the low‐baseline condition of Experiment 1 with signaled DRA as in Experiment 2. Target behavior decreased to intermediate levels in both DRA‐rich and DRA‐lean components. Relapse, when it occurred, was directly related to DRA reinforcer rate as in Experiment 2. The post‐treatment persistence of alternative behavior was greater in the DRA‐rich component in Experiment 1, whereas it was the same or greater in the signaled‐DRA‐lean component in Experiments 2 and 3. Thus, infrequent signaled DRA may be optimal for effective clinical treatment.     

Effects of reinforcer consumption and magnitude on response rates during noncontingent reinforcement

Results of previous research on the effects of noncontingent reinforcement (NCR) have been inconsistent when magnitude of reinforcement was manipulated. We attempted to clarify the influence of NCR magnitude by including additional controls. In Study 1, we examined the effects of reinforcer consumption time by comparing the same magnitude of NCR when session time was and was not corrected to account for reinforcer consumption. Lower response rates were observed when session time was not corrected, indicating that reinforcer consumption can suppress response rates. In Study 2, we first selected varying reinforcer magnitudes (small, medium, and large) on the basis of corrected response rates observed during a contingent reinforcement condition and then compared the effects of these magnitudes during NCR. One participant exhibited lower response rates when large-magnitude reinforcers were delivered; the other ceased responding altogether even when small-magnitude reinforcers were delivered. We also compared the effects of the same NCR magnitude (medium) during 10-min and 30-min sessions. Lower response rates were observed during 30-min sessions, indicating that the number of reinforcers consumed across a session can have the same effect as the number consumed per reinforcer delivery. These findings indicate that, even when response rate is corrected to account for reinforcer consumption, larger magnitudes of NCR (defined on either a per-delivery or per-session basis) result in lower response rates than do smaller magnitudes.     

Effects of D-amphetamine on response acquisition with immediate and delayed reinforcement.

The present study examined in 8-hour sessions the effects of d-amphetamine (1.0, 5.6, and 10 mg/kg) on the acquisition of lever-press responding in rats that were exposed to procedures in which water delivery was delayed by 0, 8, or 16 seconds relative to the response that produced it. Both nonresetting- and resetting-delay conditions were studied. Although neither shaping nor autoshaping occurred, substantial levels of operative-lever responding developed under all conditions in which responses produced water. The lowest dose (1.0 mg/kg) of d-amphetamine either had no effect on or increased operative-lever pressing, whereas higher doses typically produced an initial reduction in lever pressing. Nonetheless, overall rates of operative-lever pressing at these doses were as high as, or higher than, those observed with vehicle. Thus, response acquisition was observed under all reinforcement procedures at all drug doses. In the absence of the drug, most responding occurred on the operative lever when reinforcement was immediate. Such differential responding also developed under both nonresetting- and resetting-delay procedures when the delay was 8 seconds, but not when it was 16 seconds. d-Amphetamine did not affect the development of differential responding under any procedure. Thus, consistent with d-amphetamine's effects under repeated acquisition procedures, the drug had no detrimental effect on learning until doses that produced general behavioral disruption were administered.     

Choice and delay of reinforcement: Effects of terminal-link stimulus and response conditions

In two experiments, pigeons were exposed to concurrent-chains schedules in which a single initial-link variable-interval schedule led to access to terminal links composed of fixed-interval or fixed-delay schedules. In Experiment 1, an 8-s (or 16-s) delay to reinforcement was associated with the standard key, while reinforcer delay values associated with the experimental key were varied from 4 to 32 s. The results of Experiment 1 showed undermatching of response ratios to delay ratios with terminal-link fixed-delay schedules, whereas in some pigeons matching or overmatching was evident with the fixed-interval schedules. In Experiment 2, one pair of reinforcer delay values, either 8 versus 16 s or 16 versus 32 s, was used. In the first condition of Experiment 2, different delays were associated with different keylight stimuli (cued condition). In the second condition, different terminal-link delays were associated with the same stimulus, either a blackout (uncued-blackout condition) or a white key (uncued-white condition). To examine the role of responses emitted during delays, the keys were retracted during a delay (key-absent condition) in the third condition and responses were required by a fixed-interval schedule in the fourth condition. Experiment 2 demonstrated that the choice proportions for the shorter delay were more extreme in the cued condition than in the uncued-blackout condition, and that the response requirement imposed by the fixed-interval schedules did not affect choice of the shorter delay, nor did the key-absent and key-present conditions. These results indicate that the keylight-stimulus conditions affected preference for the shorter of two delays and that the findings obtained in Experiment 1 depended mainly on the keylight-stimulus conditions of the terminal links (i.e., the conditioned reinforcing value of the terminal-link stimuli).