Escape from SD associated with fixed-ratio reinforcement

Throughout ascending and descending fixed-ratio (FR) sequences, rats were allowed to terminate the FR stimulus control by pressing a time-out (TO) lever. To minimize chance or accidental responses on this second lever, three presses were required to produce the 30-sec S^Δ period. As FR performance became more “strained,” there was an increased predisposition to escape from the time-in stimulus complex. The generality of this finding was extended by obtaining recoverability (independent of the direction of stimulus change) of the FR-TO function in the descending series. Typically, escapes were produced only during the post-reinforcement pause; however, under a mixed FR FR schedule, their occurrence shifted to a point within the inter-reinforcement interval corresponding to the unreinforced completion of the lower ratio component. It appears that the point where the rat can discriminate the size of the ratio requirement will be the place where TOs are imposed. This inference was supported by a substantial increase in TO frequency accompanying a shift from CRF to extinction on the FR lever. Finally, the escape lever was placed on a progressively increasing FR schedule and later extinguished to demonstrate that the TO condition was in fact reinforcing.     

Concurrent responses during multiple schedules in rats

Abstract.— Rats' lever pressing was reinforced with a sucrose solution. In the presence of a tone pressing one lever was reinforced on a FR 40 schedule, in the absence of the tone pressing another lever was reinforced on a FR 20 schedule. The components alternated every fourth minute. In both components, the duration of pauses in lever pressing after reinforcement was positively correlated with the duration of licking the empty sucrose-delivery mechanism. In the FR 40 component, the duration of pauses was also positively correlated with the number of presses on the non-reforced lever. Licking and non-reinforced lever pressing were decreased when the rate of reinforced lever pressing was high. The response interactions were similar to those described for concurrent reinforcement schedules.     

Escape behavior under different fixed ratios and shock intensities

The effects of ratio length and shock intensity on bar pressing were examined in three rats in two escape-from-shock experiments. In Experiment I, shock intensity was held constant while the schedule was varied from FR 1 to FR 20. The latency of the first escape response increased with FR length while the escape rate, computed as over-all rate in shock minus latency of the first response, decreased at FR 20. In Experiment II, the schedule was held constant at FR 5 while shock intensity was manipulated. Latency decreased as intensity increased, while escape rate increased with intensity, passing through a maximum for two subjects. Responses occurring during the last 100 sec of the 2-min escape period decreased as the FR increased for all subjects, and decreased as shock intensity increased for two subjects.     

Learned helplessness in the rat.

Four experiments attempted to produce behavior in the rat parallel to the behavior characteristic of learned helplessness in the dog. When rats received escapable, inescapable, or no shock and were later tested in jump-up escape, both inescapable and no-shock controls failed to escape. When bar pressing, rather than jumping up, was used as the tested escape response, fixed ratio (FR) 3 was interfered with by inescapable shock, but not lesser ratios. With FR-3, the no-shock control escaped well. Interference with escape was shown to be a function of the inescapability of shock and not shock per se: Rats that were "put through" and learned a prior jump-up escape did not become passive, but their yoked, inescapable partners did. Rats, as well as dogs, fail to escape shock as a function of prior inescapability, exhibiting learned helplessness.     

Additional techniques for producing multiple-schedule control in children,

The subjects in these experiments were 132 children, varying in age from 4 to 7 years. These experiments were designed to assess the efficacy of various multiple scheduling procedures in producing reliable stimulus control. The schedules studied were multiple fixed-ratio-extinction (mult FR EXT); multiple differential-reinforcement-of-other-behavior-fixed-ratio (mult DRO FR); multiple differential-reinforcement-for-low-rate-fixed-ratio (mult DRL FR); and multiple fixed-interval-fixed-ratio (mult FI FR). In addition other techniques were investigated, such as presenting FR's in blocks; increasing the size of the FR's; attaching a DRL to the FI members; temporarily shifting to new schedules; and adding an external clock to the FI's. These experiments yielded the following results.1.) Strong stimulus control was produced by mult FR EXT, mult DRO FR, and mult DRL FR schedules. Control for mult FR EXT was mediated principally by the individual stimuli, though on occasion it was dependent in part on the change of stimuli. The mult DRO FR was found to be highly useful for those children who had very high initial rates or who were generally uncooperative and unmanageable.2.) Contrary to a previous finding, some subjects were brought under stimulus control by means of mult FI FR schedules without the aid of additional procedures. Most, however, were not. Additional techniques found to augment the development of mult FI FR control included: (1) presenting FR's in blocks; (2) increasing the size of the FR's; (3) attaching a DRL to the FI component for a time and later removing it; and (4) shifting to a mult DRL FR, developing control, and then returning to the original mult FI FR.3.) Addition of an external clock to the FI components of the mult FI FR had several effects. Strongest control, including well-developed acceleratory patterns during the FI's, was developed in those subjects who had first been shifted from a regular mult FI FR to a mult FR EXT, brought under control, and then returned to the mult FI FR with the clock added. The added clock also produced strong control if it was present when the subject was first begun on a mult FI FR schedule. In some cases, the addition of the clock produced control in subjects who had not been controlled previously by the regular mult FI FR, but these were always subjects who had high rates. The addition of the clock first lowered the rate, then produced control.     

Cooperative responding in rats: II. Performance on fixed-ratio schedules of mutual reinforcement

Coordinated responses of 5 dyads of rats were investigated under fixed-ratio (FR) schedules of mutual water reinforcement. Coordinated responding was defined as 2 consecutive lever-presses, 1 from each of 2 rats, occurring <.5 s apart. In the FR schedules, each coordinated episode was defined as 1 response in the FR sequence. The size of FR schedules was parametrically manipulated assuming the values of FR 1, 6, 12, 18, 24, 30, 50, and 9, in this order. Each FR remained in effect until responding reached stability. Under all conditions, pairs of rats received access to water simultaneously (mutual reinforcement). Rates and proportions of coordinated responding showed a bitonic inverted U-shaped function of ratio size. Postreinforcement pauses increased systematically as the interreinforcement interval increased. Local rates and proportions increased as a function of response location within ratios. Results of a control condition with relaxed temporal constraints for mutual reinforcement showed decreases in rates and proportion of coordinated responses, suggesting that the coordinated responses were controlled by the mutual reinforcement contingencies. The present experiment showed that coordinated responding is quantitatively affected by 3 properties of FR schedules: response requirement, reinforcement rates, and proximity to reinforcement.     

再认的两种机制及其与启动效应的关系

通过两个实验对两种再认所涉及的心理机制及其与启动效应的关系进行探讨。实验一用高频字和低频字作实验材料,分别测量集中注意和分散注意条件下,两种再认的成绩。结果表明：学习阶段的注意分散使以提取为基础的再认成绩下降,对以熟悉性为基础的再认成绩没有影响。低频字以熟悉性为基础的再认优于高频字,但字频对以提取为基础的再认没有影响。实验二分别测量两种再认项目的补笔正确率。结果表明：以熟悉性为基础的再认的补笔正确率显著高于以提取为基础的再认的补笔正确率。据此可以推论：两种再认可能有不同的心理机制。以提取为基础的再认属于有意识记忆的范畴,以熟悉性为基础的再认属于无意识记忆的范畴。后者和启动效应的心理基础可能是共同的。     

Recency, repeatability, and reinforcer retrenchment: an experimental analysis of resurgence

Four experiments were conducted with pigeons to assess the experimental conditions necessary for the occurrence of resurgence. The general procedure consisted of the following conditions: Condition 1--reinforcement of key pecking; Condition 2--reinforcement of treadle pressing and concurrent extinction of key pecking; and Condition 3--the resurgence condition wherein resurgence was defined as the recovery of key pecking. In Experiments 1 and 2, the resurgence condition was conventional extinction. The effect of recency on resurgence magnitude was examined in Experiment 1 by manipulating the number of sessions of Condition 2, above. Resurgence was not a function of recency with the parameters used. Repeating the three conditions revealed resurgence to be a repeatable effect in Experiment 2. In Experiment 3, a variable-time schedule was in effect for the resurgence condition. Resurgence was not produced by response-independent food delivery. In Experiment 4, the resurgence condition was a variable-interval schedule for treadle pressing that arranged a lower reinforcement rate than in Condition 2 (92% reduction in reinforcers per minute). Resurgence was lower in magnitude relative to conventional extinction, although resurgence was obtained with 2 out of 3 pigeons. The results are discussed in terms of the variables controlling resurgence and the relations between behavioral history, resurgence, and other forms of response recovery.     

Recognition and recall by children and adults as a function of variations in memory encoding instructions

In four experiments Ss were instructed to learn a set of 40 words by producing implicit associative responses to each item (association instructions), by repeating items over and over (repetition instruction), or by using their own devices (neutral instructions). Experiment I showed that recognition memory (RM) accuracy was greatest under association instructions for adults and children and least under repetition instructions for children. The implications of these results for a frequency theory analysis for RM were discussed. Experiments II, III, and IV examined free recall (FR) as a function of encoding instructions at short (1 min) and long (either 90 min or 24 h) retention intervals. FR was worst under repetition instructions, with little overall difference between the association and neutral conditions. However, in Experiments III and IV, using school children, the neutral condition exceeded the others in FR after 90 min but not after 1 min.     

Determinants of reinforcer accumulation during an operant task.

Responses by rats on an earn lever made available food pellets that were delivered to a food cup by responses on a second, collect, lever. The rats could either collect and immediately consume or accumulate (defined as the percentage of multiple earn responses and as the number of pellets earned before a collect response) earned pellets. In Experiment 1, accumulation varied as a function of variations in the earn or collect response requirements and whether the earn and collect levers were proximal (31 cm) or distal (248 cm) to one another. Some accumulation occurred under all but one of the conditions, but generally was higher when the earn and collect levers were distal to one another, particularly when the earn response requirement was fixed-ratio (FR) 1. In Experiment 2, the contributions of responses and time to accumulation were assessed by comparing an FR 20 earn response requirement to a condition in which only a single earn response was required at the end of a time interval nominally yoked to the FR interval. When 248 cm separated the earn and collect levers, accumulation was always greater in the FR condition, and it was not systematically related to reinforcement rate. In Experiment 3, increasing the earn response requirement with a progressive-ratio schedule that reset only with a collect response increased the likelihood of accumulation when the collect and earn levers were 248 cm apart, even though such accumulation increased the next earn response requirement. Reinforcer accumulation is an understudied dimension of operant behavior that relates to the analysis of such phenomena as hoarding and self-control, in that they too involve accumulating versus immediately collecting or consuming reinforcers.     

Septal lesions lower responding under fixed-ratio schedules of reinforcement.

Albino Sprague-Dawley rats with complete septal lesions and rats with control operations were studied under fixed-ratio (FR) schedules of reinforcement. Both groups were trained for 10 sessions each under FR 10, 20, 40, 60, 80, and 100. In contrast to findings from progressive FR studies and some simple FR studies, septal lesions resulted in lower overall and local response rates along with longer postreinforcement pauses. These effects were especially evident during the FR 100 schedule of reinforcement. A comparison of reinforcement rate as a function of FR size within the context of behavioral economics (i.e., a demand function) indicated that septal lesions did not alter the reward value of food. These findings suggest that responding on FR schedules of reinforcement can be altered by the various procedures used to train rats to reach the terminal value of a reinforcement schedule.     

Variable-interval schedules of timeout from avoidance: effects of chlordiazepoxide, CGS 8216, morphine, and naltrexone.

Rats were trained on concurrent schedules in which pressing one lever postponed shock and pressing the other occasionally (variable-interval schedule) produced a 2-min timeout during which the shock-postponement schedule was suspended and its correlated stimuli were removed. These procedures provided a baseline for studying the effects of drugs on behavior maintained by different sources of negative reinforcement (shock avoidance and timeout from avoidance). Experiment 1 studied a benzodiazepine agonist, chlordiazepoxide, and antagonist, CGS 8216. Chlordiazepoxide (2.5-30 mg/kg) had little effect on avoidance responding except at higher doses, when it reduced responding. By comparison, responding on the timeout lever was increased in 5 of 6 rats. These effects were reversed by CGS 8216 (2.5-5 mg/kg) in the 2 rats tested, but CGS 8216 had no effect by itself. Experiment 2 studied an opiate agonist, morphine, and antagonist, naltrexone, with 3 rats. Morphine's (2.5-20 mg/kg) effects were opposite those of chlordiazepoxide: At doses that either increased or had no effect on avoidance responding, morphine depressed timeout responding. Naltrexone (5 mg/kg) reversed these actions but had no effect by itself.     

Some discriminative properties of fixed ratio performance in the pigeon

The discriminative control over a spatial choice response exercised by prior behavior was studied using a procedure involving discrete exposures to a two-member chained schedule. The initial member (red key) was either a smaller or larger fixed ratio (Mix FR:FR), the completion of which produced, after a 1-sec delay, two white response keys. If the larger FR had been completed as the initial chain member, a single peck on the right white key was reinforced; after the smaller FR, a peck on the left white key was reinforced. Frequencies of unreinforced responses (S(Delta) responses) were determined with several pairs of red-key FRs: 95-5, 75-25, 65-35, 60-40, 58-42 and 50-50. The S(Delta) response frequencies were low through the FR pair 65-35; sharp increases were obtained with pairs 60-40 and 58-42. Later, curves analogous to stimulus generalization functions were obtained using a probe procedure. Finally, the delay interval between completion of a red-key FR and the white-key choice response was manipulated: results were variable, but S(Delta) response frequencies tended to increase with increasing delays.     

Predictability,controllability, and inoculation against learned helplessness

Nondepressed human subjects were divided into seven groups. On a series of discrimination problems, a helplessness group received insoluble problems, a solvable group received contingent feedback, and a no treatment control group received no feedback. For two other groups insoluble problems were preceded by success feedback on a different task presented according to a fixed ratio (FR) or variable ratio (VR) schedule of reinforcement. Two control groups received either FR or VR schedules of success but were not examined on the discrimination problems. All groups were tested for escape/avoidance performance on a human shuttle box. Both FR and VR schedules produced an inoculation against learned helplessness; escape performance by the helplessness group was significantly worse than that of FR and VR inoculation groups. These latter groups performed similar to the solvable and three control groups. Significantly worse than that of FR and VR inoculation groups. These latter groups performed similar to the solvable and three control groups. Significantly fewer subjects in the VR inoculation group exhibited avoidance responses than their counterparts in the FR inoculation group. despite similar escape performance. The findings indicate that learned helplessness can be prevented in humans and suggest different sources of interference produced by unpredictable and uncontrollable events.     

Fixed ratio and extinction performance of infants in the second year of life

Five 14(1/2)- to 19(1/2)-month-old infants were trained to lever press for snacks on small fixed ratio schedules of reinforcement. Within four to nine sessions, responding under FR 10 was established for four subjects and FR 15 for the other. Each subject's last session revealed behavioral patterns similar to animal and human FR trained subjects-a high and constant ratio rate, mixed with a zero rate following reinforcements. Deviations were mostly in the form of prolonged and variable post-reinforcement pauses. These and other irregularities were probably due to the limited deprivation conditions and improper training procedures in which the ratio (for two subjects) was ascended too early and too quickly. Extinction was instituted during the last session. The degree to which extinction performance matched that of other organisms depended upon how stable and "ratio-like" performance was during conditioning.     

Interaction of reinforcement schedules, a behavioral prosthesis, and work-related behavior in adults with mental retardation

The effects of variable-interval (VI) and fixed-ratio (FR) schedules of reinforcement for work-related behavior and an organizer for the work materials (behavioral prosthesis) were evaluated with 3 adults with severe or profound mental retardation. The participants had been recommended for study because of high rates of off-task and aberrant behavior in their daily vocational training programs. For 2 participants, VI and FR schedules resulted in the same outcome: more aberrant behavior than on-task and off-task behavior combined. The FR schedule nearly eliminated emission of aberrant and off-task behavior by the 3rd participant. Combining the behavioral prosthesis with FR reinforcement (FR+O) increased the proportion of time spent in on-task behavior by all participants under certain FR schedule parameters. Second-by-second analyses of the observation records revealed that FR schedules reduced off-task and aberrant behavior during work sequences (i.e., ratio runs), and FR+O led to a further reduction of these behaviors during postreinforcement pauses. Overall, the results show how organizer and schedule parameters can be adjusted to produce an optimized balance between productivity and reinforcement while undesirable behavior is minimized.     

Reinforcement of drinking by running: effect of fixed ratio and reinforcement time

Rats were required to complete varying numbers of licks (FR), ranging from 10 to 300, in order to free an activity wheel for predetermined times (CT) ranging from 2 to 20 sec. The reinforcement of drinking by running was shown both by an increased frequency of licking, and by changes in length of the burst of licking relative to operant-level burst length. In log-log coordinates, instrumental licking tended to be a linear increasing function of FR for the range tested, a linear decreasing function of CT for the range tested. Pause time was implicated in both of the above relations, being a generally increasing function of both FR and CT.     

Event-related potentials, semantic processes, and expectancy factors in word recognition

Electrophysiological activity was recorded at 16 scalp locations during a word recognition task in order to investigate the effect of expectancy factors on ERPs. In each of 160 trials two stimuli (S1 and S2) were presented with a stimulus onset asynchrony (SOA) of 1500 msec. There were four experimental conditions. In the word-antonym (W-A) and the word-nonantonym (W-NA) conditions, both S1 and S2 were words. The subjects' task was to think of the antonym to S1 and respond as fast as possible after the presentation of S2 by pressing a "YES" button if S2 was an antonym to S1 (in the W-A trials), or a "NO" button if S2 was not an antonym to S1 (in the W-NA trials). In the nonword-word (NW-W) and nonword-nonword (NW-NW) conditions S1 was a nonword, while S2 was either a word (in NW-W trials) or a nonword (in NW-NW trials). If S1 was not a word, the subjects were instructed to wait for S2, and respond as fast as possible by pressing the "YES" button if it was a word an the "NO" button if it was not a word. EEG was sampled during a time epoch that started 100 msec before the onset of S1 and continued for another 2560 msec. The ERPs were analyzed separately for each experimental condition and for time epochs related to S1, to S2, and to the SOA. Expected antonyms were recognized significantly faster than any other words or nonwords. The RTs to words in the W-NA and NW-W condition, and to nonwords in the NW-NW condition did not differ significantly from each other. The ERP difference between the four conditions following S2 was interpreted in terms of a negative-going potential which appeared prior to the P300, during a time period which started 200 msec and ended 550 msec from stimulus onset. The negativity related to nonwords was significantly larger than the negativity related to words. The negativity related to the expected antonym was almost nonexistent. It is speculated that this negativity has the same origin as N400, and that it might be related to the process of lexical access.     

Discriminative and reinforcing properties of two types of food pellets

In Experiment I some discriminative functions of food pellets were studied by developing a multiple schedule of reinforcement (mult FR 30 FI 3) in which the delivery of a standard laboratory food pellet as a reinforcer set the occasion for reinforcement on every 30th response (FR 30), and the delivery of a sucrose food pellet as a reinforcer set the occasion for reinforcement after a 3-min interval (FI 3). Discriminative stimulus control by the type of pellet was also demonstrated by reversing the operant discrimination and having the standard pellet control the FI 3 and the sucrose pellet control the FR 30. In Experiment II a mult FR 30 FR 30 with two bars was developed; a standard food pellet was followed by an FR 30 on Bar 1 and extinction (ext) on Bar 2, while a sucrose pellet was followed by an FR 30 on Bar 2 and ext on Bar 1. A control rat was placed, for comparison, on a mixed (mix) FR 30 FR 30 schedule with two bars, but neither bar correlated with the type of food pellet. In Experiments I and II the similarity between pellet controlled multiple schedules and multiple primed schedules was discussed, as was the comparability of transitions and effectiveness of control between pellet controlled multiple schedules and multiple schedules providing continuous exteroceptive stimuli.     

Forgetting of an operant response: Physostigmine-produced increases in escape latency in rats as a function of time of injection

Latency of a fixed ratio (FR) 3 escape response in rats was found to be a U-shaped function of the interval between training and injection of the anticholinesterase drug physostigmine, for intervals from 30 min. to 5 days between training and injection. An increase in FR 3 escape latency was found at 28 days. FR 1 escape groups produced a latency curve of a shape similar to that of the FR 3 group. These data confirm the results of earlier experiments using a different training procedure, and a different response measure. These results are consistent with the theory that the physiological correlate of rat memory lies in synaptic change.