Session duration and the VI response function: Within-session prospective and retrospective effects

Two experiments examined the effects of session duration on responding during simple variable-interval schedules. In Experiment 1, rats were exposed to a series of simple variable-interval schedules differing in both session duration (10 min or 30 min) and scheduled reinforcement rate (7.5 s, 15 s, 30 s, and 480 s). The functions relating response rate to reinforcement rate were predominantly monotonic for the short (10-min) sessions but were predominantly bitonic for the long (30-min) sessions, when data from the entire session were considered. Examination of responding within sessions suggested that differences in the whole-session data were produced by a combination of prospective processes (i.e., processes based on events scheduled to occur later in the session) and retrospective processes (i.e., processes based on events that had already occurred in the session). In Experiment 2, rats were exposed to a modified discrimination procedure in which pellet flavor (standard or banana) predicted session duration (10 min or 30 min). All rats came to respond faster during the short (10-min) sessions than during the first 10 min of the long sessions. As in Experiment 1, the results seemed to reflect the simultaneous operation of both prospective and retrospective processes. The results shed light on the recent controversy over the form of the variable-interval response function by identifying one variable (session duration) and two types of processes (prospective and retrospective) that influence responding on these schedules.     

Punished and Nonpunished Responding in A Multiple Schedule in Humans: A Brief Report

Four male subjects responded on a multiple schedule in which responding was maintained by a random interval 20-sec (RI20) schedule of point presentation. Responding was suppressed in alternating components by an added variable ratio 30 (VR30) schedule of point subtractions. Each component was accompanied by distinctive stimulus lights. Subjects were exposed to the multiple schedule from the initial session. Two subjects experienced four 50-min sessions daily (Experiment 1) and the other two subjects participated in one 50-min session daily (Experiment 2). Once responding in the punished components had stabilized, responding in the nonpunished components continued to increase across sessions. Nonpunished responding did not stabilize even after as many as 36 sessions. These results are discussed in the context of previous studies using animals which employed multiple schedules with punished and nonpunished response contingencies.

     

Punishment shock intensity and basal skin resistance

The relationship between punishment shock intensity and basal skin resistance (BSR) was investigated in two sessions with human females selected for their ability to maintain a fairly substantial operant rate under a wide range of shock intensities. In both sessions each button-pressing response was reinforced with a counter tally. Subjects were paid one cent for each 20 counts. In session 1, punishment followed each response during alternate 4-min periods; in session 2 punishment was programmed in all 4-min periods. Shock intensities were presented randomly among the 4-min shock periods, with the restriction that the first three presentations occurred in ascending order. Operant responding showed some suppression at higher shock intensities in session 1, with substantial recovery in most subjects during session 2. Respondent behavior was characterized by greater activity at successively higher intensities, with recovery at all shock levels, especially the lowest levels, apparent during the second session.     

Altering Reinforcer Variety or Intensity Changes the Within-Session Decrease in Responding

Operant responding often changes systematically within experimental sessions. McSweeney, Hinson, and Cannon (1996) argued that sensitization and habituation produce within-session changes in responding. The present study tested two predictions of the sensitization–habituation explanation. In two experiments, rats pressed a lever for reinforcers delivered by a multiple variable interval 15-s variable interval 15-s schedule. In Experiment 1, the variety of reinforcers delivered during the session was manipulated by varying the percentage of programmed reinforcers replaced with qualitatively different reinforcers from 0 to 75%, in five different conditions. In Experiment 2, the intensity of the reinforcer was manipulated by varying the concentration of sucrose in the sucrose and water solution used as the reinforcer from 0 to 30%, in five different conditions. Increasing the variety or the intensity of the reinforcers slowed the within-session decrease in responding. The results are consistent with the predictions of a sensitization–habituation explanation of within-session changes in responding.     

“Level of Aspiration”: Preference for Time Versus Response Feedback and History Effects on the Setting of Personal Performance Standards

Human subjects responded on a computer keyboard and accumulated points according to fixed-ratio (FR) reinforcement schedules. In Experiment 1, subjects responded under a FR 500 schedule. Under baseline conditions satisfying the schedule requirement resulted in counter points and session termination. Subsequently, subjects could (a) choose to have a clock appear on the screen during the interreinforcement interval (IRI) as well as to enter a target time which they would attempt to better during that session, (b) choose to enter a target time or respond under baseline conditions, and (c) enter a target time and choose between having a clock appear throughout or at the end of experimental sessions. In Experiment 2, subjects responded under a FR 500 schedule, entered a target time each session, and could respond during the session to briefly produce either (a) clock feedback, or (b) the number of responses emitted by the subject. In Experiment 3, subjects responded under FR 250, 500, 1000, and 2000 schedule parameters, entered target times and responded for either clock or response feedback. Subjects (a) preferred responding under conditions in which target times were entered to responding under baseline conditions, (b) preferred to have the clock illuminated throughout rather than at the end of experimental sessions, (c) preferred response to clock feedback under all schedule parameters, (d) responded to having equaled or bettered a target time by lowering target time for the subsequent session, and (e) responded to having missed a target time by maintaining the same time during the subsequent session. The results were interpreted within the context of behavior analytic as opposed to more traditional personality theory.

     

The effects of session length on demand functions generated using FR schedules

In comparing open and closed economies, researchers often arrange shorter sessions under the former condition than under the latter. Several studies indicate that session length per se can affect performance and there are some data that indicate that this variable can influence demand functions. To provide further data, the present study exposed domestic hens to series of increasing fixed-ratio schedules with the length of the open-economy sessions varied over 10, 40, 60, and 120 min. Session time affected the total-session response rates and pause lengths. The shortest session gave the greatest response rates and shortest pauses and the longest gave the lowest response rates and longest pauses. The total-session demand functions also changed with session length: The shortest session gave steeper initial slopes (i.e., the functions were more elastic at small ratios) and smaller rates of change of elasticity than the longest session. Response rates, pauses, and demand functions were, however, similar for equivalent periods of responding taken from within sessions of different overall lengths (e.g., total-session data for 10-min sessions and the data for the first 10 min of 120-min sessions). These findings suggest that differences in session length can confound the results of studies comparing open and closed economies when those economies are arranged in sessions that differ substantially in length, hence data for equivalent-length periods of responding, rather than total-session data, should be of primary interest under these conditions.     

Classroom treatment of autistic children: II. individualized instruction in a group

This study was designed to assess the feasibility of providing individualized instruction in a classroom of autistic children. In particular, we investigated whether students' unsupervised responding was a variable which would influence the effectiveness of individualized instruction procedures. Initially, one teacher attempted to teach different academic behavior to four autistic children simultaneously. During these sessions the teacher rotated from child to child, providing individualized instructions and reinforcers to each. We found, however, that each child stopped responding whenever the teacher rotated to a different child and, further, no academic progress occurred for any of the children during these sessions. In a multiple baseline design, treatment procedures were then introduced (prompt fading, chaining, and programmed instructional materials) to teach each student to continue working for an extended period of time after each instruction from the teacher. After treatment, sessions of individualized instruction in a group were reintroduced for each child. The results showed that unsupervised responding was an important variable influencing the effectiveness of individualized instruction. Specifically, the data show that (1) unsupervised responding, acquired during treatment, generalized to the group setting; (2) after treatment, each child began to make progress on his assigned tasks; and (3) programming instructional materials in small steps appeared to be necessary in order to ensure the maintenance of unsupervised responding across changes in instructional materials. By the end of this study it was possible for one teacher to simultaneously teach four autistic children — with each child learning at his own rate, on his own task, with minimal supervision from the teacher. It is suggested that the generalizability of these results, to other settings where continuous supervision is difficult, may be an important concern of future research.     

Extinction of responding maintained by timeout from avoidance

The resistance to extinction of lever pressing maintained by timeout from avoidance was examined. Rats were trained under a concurrent schedule in which responses on one lever postponed shock on a free-operant avoidance (Sidman) schedule (response-shock interval = 30 s) and responses on another lever produced 2 min of signaled timeout from avoidance on a variable-ratio 15 schedule. Following extended training (106 to 363 2-hr sessions), two experiments were conducted. In Experiment 1 two different methods of extinction were compared. In one session, all shocks were omitted, and there was some weakening of avoidance but little change in timeout responding. In another session, responding on the timeout lever was ineffective, and under these conditions timeout responding showed rapid extinction. The within-session patterns produced by extinction manipulations were different than the effects of drugs such as morphine, which also reduces timeout responding. In Experiment 2 shock was omitted for many consecutive sessions. Response rates on the avoidance lever declined relatively rapidly, with noticeable reductions within 5 to 10 sessions. Extinction of the timeout lever response was much slower than extinction of avoidance in all 4 rats, and 2 rats continued responding at baseline levels for more than 20 extinction sessions. These results show that lever pressing maintained by negative reinforcement can be highly resistant to extinction. The persistence of responding on the timeout lever after avoidance extinction is not readily explained by current theories.     

Repeated,within‐session resurgence

Resurgence is a reliable, transient effect that only occasionally is replicated more than once within a single experiment or subject. In the present experiments, within‐session resurgence was generated repeatedly by dividing individual sessions into three phases (Training, Alternative‐Reinforcement, and Resurgence‐Test). In Experiments 1 and 2, resurgence reliably occurred in most of the 22‐30 daily sessions when responding was reinforced on, respectively, fixed‐ and variable‐interval schedules. Resurgence magnitude and duration did decrease across replications for some subjects, but not for others. To examine the utility of the procedure in studying the effects of an independent variable on resurgence, in Experiment 3 the effects of rich and lean baseline and alternative reinforcement rates on resurgence were compared. The target response was eliminated more rapidly, resurgence occurred more often, and usually was greater following rich alternative reinforcement rates. Resurgence was of greater magnitude when the baseline reinforcement rate was relatively lean compared to the alternative reinforcement rate. These experiments provide a reliable method for generating resurgence within individual sessions, instead of across multiple‐session conditions, that can be repeated over many successive sessions.     

Context extinction and associative learning in Lymnaea

Aerial respiratory behavior in the pond snail Lymnaea was operantly conditioned so that snails learned not to perform aerial respiration in a hypoxic environment. Snails were trained in either the standard context (no food odorant) or a carrot (food-odorant) context. An operant training procedure of two 45-min training sessions with a 1-h interval between the sessions followed by a third 45-min training session 18 h later was sufficient to produce associative learning and long-term memory (LTM) that persisted for at least 5 days. If, however, following the third operant training session snails received three 45-min extinction training sessions, with each extinction session separated by at least a 1-h interval, LTM was not observed when tested the following day. That is, the memory was extinguished. Extinction, however, did not occur if the context of the extinction training was different from the context of the associative training. That is, in the snails trained in the standard context, extinction did not occur if the extinction training sessions were performed in the food-odorant context and vice versa.     

Choice based on separately established response tendencies: The effect of recency of reinforcement

The responding of pigeons was studied in a chamber with two adjacent keys that could each be lit with either a red or a green dot. Fixed-length trials were used, with pecking on positive trials reinforced by presenting food at the end of the trial. In each session the first 40 trials were one-key trials with one key lit on each trial, either red or green, and the next four trials were choice trials with both keys lit, one red and the other green. When blocks of sessions were presented in which all one-key trials were positive trials of a single color, choice responding gradually shifted to the color presented most recently during one-key trials. When all one-key trials were nonreinforced trials of a single color, responding on choice trials shifted toward the other color. When positive one-key trials of one color were intermingled with negative one-key trials of the other color, choice responding shifted exclusively to the reinforced color. These shifts in choice responding occurred even when responding on choice trials was never reinforced, and were viewed as based on separate response tendencies for pecking red and pecking green built up during one-key trials.     

The affective interval: An investigation of the peaks and valleys during high- and moderate-intensity interval exercise in regular exercisers

Evidence supports the notion that people generally feel worse during high(er) intensity exercise but experience an affective rebound immediately following cessation that often exceeds pre-exercise feeling states. Considering rest/recovery is an integral part of interval exercise, it is of interest to determine the degree of affective reactivity and recovery that may occur during interval exercise of different intensities. The purpose of the present study was to examine affective reactivity to and recovery from an acute bout of moderate-intensity (MIIE) and high-intensity interval exercise (HIIE). Participants (N = 25, 13 females, 23.3 ± 4.0 yrs, BMI = 25.7 ± 4.1 kg m⁻²) completed 4 sessions at the same time of day with at least 24-h between each session: a baseline session to record resting affect, a graded exercise test on a stationary bike (cycle ramp protocol 25 W·min-1) to volitional exhaustion, and then completed a high- (HIIE) and moderate-intensity interval exercise (MIIE) session where affect was recorded prior to, during, and up to 30-min post exercise. Participants reported more negative feeling states during the HIIE session compared to the MIIE session, but these states recovered similarly as early as 5-min post-exercise. In addition, while affective change (reactivity and rebounds) were relatively equal during the MIIE, declines in affect during the HIIE outweighed the affective rebounds associated with rest, resulting in a large decline in affective state from pre-exercise.     

Investigating retrospective influences on induction in rats' responding for 1% sucrose when food-pellet reinforcement is upcoming

When rats lever press for 1% sucrose reinforcement in the first half of a 50-min session, response rates are higher when food-pellet reinforcement will be available in the second half than when 1% sucrose will be available. Results of past research have suggested that, under some conditions, this induction effect is prospective in nature (i.e., controlled by the conditions of reinforcement in the present session). However, that research did not rule out the possibility that, under other conditions, retrospective factors (i.e., the conditions of reinforcement in the previous session[s]) could contribute. In the present study, rats responded in two types of session, one in which 1% sucrose reinforcement was available in both halves of the session and one in which 1% sucrose and food-pellet reinforcement were available in the first and second halves, respectively. Which type of session was in effect unsignaled and session type alternated every session (Experiment 1), every second session (Experiment 2), or after at least 20 consecutive sessions of one type (Experiment 3). Across experiments, the results indicated that it takes several sessions of one type for observable retrospective effects to occur, but those effects are short lived. These results allow the authors to identify the mechanisms that must underlie induction. The authors also discuss induction as an animal model of anticipation.     

Effects of session duration on functional analysis outcomes.

We examined the extent to which variations in session duration affected the outcomes of functional analyses. Forty-six individuals, all diagnosed with mental retardation and referred for assessment and treatment of self-injurious or aggressive behavior, participated in functional analyses, consisting of repeated exposure to multiple test conditions during 15-min sessions. For each set of assessment data, new data sets based on session durations of 10 and 5 min were prepared by deleting data from the last 5 and 10 min, respectively, of each session. Each graph (N = 138) was then reviewed individually by graduate students who had previous experience conducting and interpreting functional analyses, but who were blind to both participant identity and session duration. Interpretations of behavioral function based on the 10- and 5-min data sets were then compared with those based on the 15-min data sets. All of the 10-min data sets yielded interpretations identical to those based on 15-min data sets. Interpretations based on the 5-min and 15-min data sets yielded three discrepancies, all of which were the result of increased response rates toward the latter parts of sessions. These results suggest that the efficiency of assessment might be improved with little or no loss in clarity by simply reducing the duration of assessment sessions.     

Income maximizing on concurrent ratio-interval schedules of reinforcement

Three experiments examined the effect of food availability on pigeons' choice behavior under concurrent schedules of reinforcement. In Experiment 1, 3 pigeons earned their daily food ration by choosing, in 30-min sessions, between concurrent variable-ratio 30 variable-interval 40-s schedules. Food presentations during both schedules lasted 2 or 12 s, depending upon the condition. Relative variable-ratio response rate was inversely related to hopper duration. In Experiment 2, 4 pigeons received their daily feeding by responding on the same schedule pair as in Experiment 1 (with 4-s food presentations) in sessions that varied in length from 10 to 30 min, depending on the condition. The length of a vertical slit projected on a response key increased with time so that “passage of time” might be more easily discriminable. As session duration decreased, relative variable-ratio response rate increased. In Experiment 3, 4 pigeons chose between two variable-interval 40-s schedules. One schedule operated without regard to the schedule selected, whereas the other operated only when the subject responded in its presence (dependent). Although these schedules had the same feedback function, preference for the dependent variable interval increased as session duration decreased from 30 to 10 min. The preference changes in these studies reveal the operation of an income-maximizing process in choice.     

Effects of post-session wheel running on within-session changes in operant responding

This study tested the effects of post-session wheel running on within-session changes in operant responding. Lever-pressing by six rats was reinforced by a food pellet under a continuous reinforcement (CRF) schedule in 30-min sessions. Two different flavored food pellets were used as reinforcers. In the wheel conditions, 30-min operant-sessions with one of the flavored pellets were followed by 30-min free-wheel running sessions. Meanwhile, in the home conditions, rats’ operant responding was reinforced by the other flavored pellets during 30-min operant-sessions, and the rats were then returned to their homecages. All rats were exposed to 4 wheel and 4 homecage sessions. Operant responding was lowered during the wheel conditions. However, post-session running did not alter the within-session pattern of operant responding. These effects were practically identical to the effects of drug-induced taste-aversion learning on within-session changes in operant responding, suggesting similar mechanisms in both taste-aversion preparations.     

Persistent behavior maintained by unavoidable shocks

Squirrel monkeys were trained on a multiple schedule in which 10-min periods on a continuous shock avoidance schedule, indicated by a yellow light, alternated with 10-min periods on a 1.5-min variable interval schedule of food reinforcement (VI 1.5). A white light indicated that VI 1.5 was in effect, except for the middle 2 min of the period on VI 1.5, in which a blue light appeared and terminated with the delivery of a 0.5-sec unavoidable shock. Stable response rates developed in the avoidance and VI 1.5 components. However, the highest response rates occurred in the blue, preshock stimulus. A series of experiments showed that responding in the blue stimulus persisted even when responding had been extinguished on both the VI schedule of food reinforcement and the shock avoidance schedule. Responding in the blue stimulus ceased when the blue stimulus terminated without shock or when it terminated with a response-contingent shock. Each time responding ceased, it was restored by terminating the blue stimulus with an unavoidable shock. When the blue stimulus was on throughout each session and unavoidable shocks were delivered at regular 10-min intervals, responding was well maintained. These results show that in monkeys that have been trained on a continuous avoidance schedule, unavoidable shocks can maintain responding even under conditions where responses have no programmed consequences.