Some effects of response-dependent clock stimuli in a fixed-interval schedule

Two experiments studied the effects of brief response-dependent clock stimuli in fixed-interval schedules of reinforcement. In the first experiment, two pigeons were exposed to a fixed-interval schedule. Two conditions were compared. In both conditions each peck on the key produced a brief stimulus. In one condition, pecks produced a different stimulus in successive sixths of the interval. This was the clock condition. In the other condition, the same stimulus was produced throughout the interval. Response rates were lower and the pause after reinforcement was longer in the clock condition. In the second experiment, a two-key optional clock procedure was used. Responding on the clock key produced one of three stimuli correlated with the three successive minutes of a fixed-interval schedule. A response on the other key produced grain at the end of the 3 min. When the final stimulus was removed from the situation and pecking produced nothing during the third minute, responding to the clock key declined to a very low rate. When the first two stimuli were removed and the third one replaced, responding to the clock key was resumed.     

"Turning back the clock" on serial-stimulus sign tracking.

Two experiments examined the effects of a negative (setback) response contingency on key pecking engendered by a changing light-intensity stimulus clock (ramp stimulus) signaling fixed-time 30-s food deliveries. The response contingency specified that responses would immediately decrease the light-intensity value, and, because food was delivered only after the highest intensity value was presented, would delay food delivery by 1 s for each response. The first experiment examined the acquisition and maintenance of responding for a group trained with the contingency in effect and for a group trained on a response-independent schedule with the ramp stimulus prior to introduction of the contingency. The first group acquired low rates of key pecking, and, after considerable exposure to the contingency, those rates were reduced to low levels. The rates of responding for the second group were reduced very rapidly (within four to five trials) after introduction of the setback contingency. For both groups, rates of responding increased for all but 1 bird when the contingency was removed. A second experiment compared the separate effects of each part of the response contingency. One group was exposed only to the stimulus setback (stimulus only), and a second group was exposed only to the delay of the reinforcer (delay only). The stimulus-only group's rates of responding were immediately reduced to moderate levels, but for most of the birds, these rates recovered quickly when the contingency was removed. The delay-only groups's rates decreased after several trials, to very low levels, and recovery of responding took several sessions once the contingency was removed. The results suggest that (a) sign-tracking behavior elicited by an added clock stimulus may be reduced rapidly and persistently when a setback contingency is imposed, and (b) the success of the contingency is due both to response-dependent stimulus change and response-dependent alterations in the frequency of food delivery. The operation of the contingency is compared with the effects of secondary reinforcement and punishment procedures.     

Discriminated time-out avoidance in pigeons

Performances of two pigeons were studied on a concurrent discriminated TO avoidance-VR schedule. Each avoidance response postponed a TO from a VR 140 for a specified RS interval. The warning stimulus on the TO avoidance schedule was a discontinuous clock which consisted of a series of discrete color changes that varied systematically with the RS interval. Experimental manipulations established that the avoidance behavior was under the control of the avoidance schedule and the discontinuous clock. Five-min TOs maintained higher avoidance rates than shorter TO durations; a 15-min TO maintained less avoidance responding than the 5-min TO. Chlorpromazine hydrochloride increased TO avoidance behavior and decreased concurrent VR behavior.     

TEACHING MENTALLY RETARDED ADULTS TO TIME-MANAGE IN A VOCATIONAL SETTING

Three retarded adults who had minimal ability to tell time were trained to “time-manage.” Each was given a card with clock face representations on which the hands of the clock were drawn, representing each trainee's assigned lunch and break times. Instruction was given before work to perform each of the required behaviors when the “real” clock matched the clock faces. Praise was given following correct responses, and reprimands, instruction, and, in some instances, delay or omission of the scheduled activity followed incorrect responses. Pre-instruction and instructional feedback were then sequentially withdrawn. Results indicated that the package consisting of pre-instruction, instructional feedback, and picture cues was effective in producing independent time management responding. When the first two components were withdrawn, two trainees maintained high levels of correct responding. Correct responding decreased for one trainee when pre-instruction was withdrawn. Reintroduction and subsequent withdrawal of the components resulted in maintenance by this trainee. Little improvement in time-telling ability resulted.     

Clock-delivered reinforcers in conjunctive and interlocking schedules

The effects of different temporal requirements in conjunctive and interlocking schedules of reinforcement were examined. The compound schedules were arranged so that a reinforcer could be delivered by either a rat's response or a clock. As the temporal requirements increased in the interlocking schedules, the overall rate of responding increased, but the pattern of responding remained relatively unchanged. As the temporal requirement increased in the conjunctive schedules, the overall rate decreased and a pause-and-run pattern of responding emerged. When the response requirement was reduced to one in the conjunctive schedule for one animal, a low and extremely stable rate of responding developed.     

Clock control of human performance on avoidance and fixed-interval schedules

The avoidance and fixed-interval performances of human subjects were studied in two experiments. Addition of time-correlated stimuli (added clock) improved behavioral efficiency, since response rates decreased without decreases in reinforcement rates. Response-dependent display of the clock maintained a second, observing response and reductions in clock duration weakened such observing behavior. Generally, the reinforcing properties of the clock were more apparent with the avoidance than with the fixed-interval schedule, a finding attributed to temporal cues already provided by delivery of the fixed-interval reinforcers. Reduced rates of the main response when the clock was dependent on an observing response were more than offset by rates of the observing response in the majority of subjects. Thus, the results do not support an interpretation of the reinforcing properties of added clocks simply in terms of work reduction.     

Periodic shock with added clock

Rats were shocked every 6 min while responding was maintained on a variable-interval schedule of reinforcement. With some rats, shocks were interspersed with a sequence of three different stimulus conditions (S3→S2→S1), or clock cues, each lasting 2 min. For other rats, a single stimulus condition prevailed between shocks at the beginning of the experiment and clock cues were introduced later. Response rate decreased from S3 to S1. Response rate in S3, S2, and S1 was inversely related to shock intensity. When clock cues were added, response rate increased in all 2-min intershock periods. During clock cues, an index of curvature, indicating the degree of negative acceleration of response rate, was greatest for S1 and least for S3, and was directly related to shock intensity. The response-facilitating effect of shock and its relation to a possible discriminative function of shock and to behavioral contrast is discussed.     

Intractable properties of responding under a fixed-interval schedule

The behavior engendered by the fixed-interval schedule is characterized by its variability within and across intervals. The present experiment was designed to assess further the magnitude of interval-to-interval dynamics and to explore conditions which might enhance control by response number for subsequent output. Pigeons were exposed to three experimental manipulations after responding had stabilized under a fixed-interval five-minute schedule. First, a discrete five-stimulus counter was added so that the key color changed after a fixed number of responses. Then additional grain presentations were made at the end of the interval so that high response output was differentially reinforced in the presence of the counter stimuli. Finally, the counter stimuli were presented as an irregular clock (i.e., independently of responding), but the durations were yoked to performance under the counter condition. The data show that response number can exert influence from one interval to the next, but this source of control is weak and not influenced by the experimental manipulations. Results from the clock arrangement indicate that behavior is controlled largely by the stimulus conditions prevailing at the time of interval onset.     

Differential effects of pentobarbital and cocaine on punished and nonpunished responding.

Similar rates of punished and nonpunished responding, maintained with equated rates of reinforcement, were established in pairs of rats. One subject of each pair was exposed to a random-ratio schedule of food presentation. The interreinforcement intervals for this subject comprised the intervals of a random-interval schedule of reinforcement for the other (yoked) rat. The random-ratio schedule maintained rates of responding higher than those maintained by the same rate of reinforcement schedule according to the yoked random-interval contingency. A random-ratio schedule of electric foot shock added to the random-ratio schedule of food presentation suppressed rates of responding such that similar rates of responding were observed in rats of both groups. Pentobarbital (3.0 to 17.0 mg/kg) increased punished responding at doses that had little effect on or decreased nonpunished responding, whereas cocaine (5.6 to 30 mg/kg) increased nonpunished responding at doses that decreased or did not alter punished responding. Qualitatively different effects of pharmacological agents on punished and nonpunished responding can be obtained using procedures that generate similar rates and temporal patterns of punished and nonpunished responding. The effects of pentobarbital and cocaine on responding can be determined by factors other than simply the baseline rate of responding.     

Drugs and punished responding I: rate-dependent effects under multiple schedules

The effects of drugs were studied in pigeons whose responses were punished with electric shock during one component of a multiple fixed-interval 5-min fixed-interval 5-min schedule of food presentation. Most of the drugs analyzed for rate-dependent effects increased low rates of both punished and unpunished responding, while increasing higher rates less, or decreasing them; however, low rates of punished responding sometimes were increased more by pentobarbital, diazepam, and chlordiazepoxide than were matched rates of unpunished responding. In contrast, d-amphetamine and chlorpromazine usually increased low rates of unpunished responding more than matched rates of punished responding. These two drugs also decreased high rates of unpunished responding less than they decreased high rates of punished responding. Thus, the effects of drugs on punished responding depend on the control rate of punished responding; however, the rate-dependent effects of drugs on punished responding are not always the same as they are for unpunished responding.     

Serial conditioning as a function of stimulus, response, and temporal dependencies

Six experiments were used to examine the effects of explicit response, stimulus, and temporal dependencies on responding in an interfood interval. The first two experiments demonstrated that 10-segment 60-s interfood clocks controlled similar distributions of key pecking in pigeons regardless of whether response–reinforcement contiguity was required, allowed, or precluded. The third and fourth experiments found that in the absence of an explicit response–reinforcement dependency, systematic explicit stimuli in an interfood interval were sufficient to establish and maintain the characteristic distribution of key pecking and that an interval without an explicit clock failed to establish or maintain key pecking. The last two experiments demonstrated that the interfood interval need not be of fixed length, and that a simple correlation of stimuli with increments from either a minimum to a maximum imminency or probability of food presentation controlled behavior in a similar manner. Successively higher rates generally occurred to successively later stimuli in the upper half of the range.     

Comparable Rates of Responding and Reinforcement Do Not Eliminate the Differential Effects of Ethanol on Response Chain Acquisition and Performance

Ethanol and other drugs commonly disrupt responding under repeated acquisition and performance baselines, with responding in the former condition being more sensitive to such disruption than the latter. The present study was conducted to determine if differential drug effects would occur when baseline rates of responding were comparable in the two baseline conditions. The acute effects of ethanol (0, 0.4, and 0.8 g/kg) were examined in healthy adult volunteers responding under a multiple schedule of repeated acquisition and performance of 10-response sequences. A 1-sec delay occurred after each response to keep rates of responding comparable in the acquisition and performance conditions. This delay also reduced differences in reinforcement rates between the two components. Nevertheless, responding in the acquisition condition was still more sensitive to the disruptive effects of ethanol than responding in the performance component. This differential sensitivity to ethanol was most evident in measures of accuracy of responding (e.g., percentage of errors). These findings suggest that differences in overall rates of responding and reinforcement in the repeated acquisition and performance conditions contribute little, if anything, to the differential drug effects observed on those baselines.

     

“Level of Aspiration”: Preference for Time Versus Response Feedback and History Effects on the Setting of Personal Performance Standards

Human subjects responded on a computer keyboard and accumulated points according to fixed-ratio (FR) reinforcement schedules. In Experiment 1, subjects responded under a FR 500 schedule. Under baseline conditions satisfying the schedule requirement resulted in counter points and session termination. Subsequently, subjects could (a) choose to have a clock appear on the screen during the interreinforcement interval (IRI) as well as to enter a target time which they would attempt to better during that session, (b) choose to enter a target time or respond under baseline conditions, and (c) enter a target time and choose between having a clock appear throughout or at the end of experimental sessions. In Experiment 2, subjects responded under a FR 500 schedule, entered a target time each session, and could respond during the session to briefly produce either (a) clock feedback, or (b) the number of responses emitted by the subject. In Experiment 3, subjects responded under FR 250, 500, 1000, and 2000 schedule parameters, entered target times and responded for either clock or response feedback. Subjects (a) preferred responding under conditions in which target times were entered to responding under baseline conditions, (b) preferred to have the clock illuminated throughout rather than at the end of experimental sessions, (c) preferred response to clock feedback under all schedule parameters, (d) responded to having equaled or bettered a target time by lowering target time for the subsequent session, and (e) responded to having missed a target time by maintaining the same time during the subsequent session. The results were interpreted within the context of behavior analytic as opposed to more traditional personality theory.

     

The effect of signaled reinforcement on rats' fixed-interval responding

Four experiments examined the effect on rats' response rate of presenting a brief (500 ms) stimulus simultaneously with the delivery of food on fixed-interval (FI) schedules. In Experiment 1, reinforcement signals that were spatially diffuse (both tones and lights) elevated rates of responding, but responding was attenuated by localized visual stimuli. The remaining experiments examined the signal-induced potentiation of responding. In Experiment 2, a tone reinforcement signal potentiated response rates on an FI schedule, but attenuated response rates on a variable-interval (VI) schedule. This difference was obtained even though the overall rate of responding was equated on the two schedules before the introduction of the signal. Signal-induced potentiation of responding occurred over a range of FI values employed in Experiment 3. In Experiment 4, presenting a reinforcement signal when high local rates of response had occurred immediately before reinforcement resulted in potentiated rates of responding on an FI schedule. The opposite effect on response rate occurred when the reinforcement signal followed only low local rates of response. These results indicate that a variety of factors influence the effects of a reinforcement signal. They imply, however, that the local rate of response at the time of reinforcement is a key factor in establishing the nature of the signaling effect.     

A comparison of responding maintained under second-order schedules of intramuscular cocaine injection or food presentation in squirrel monkeys.

Key pressing by squirrel monkeys was maintained under second-order schedules of either intramuscular cocaine injection or food presentation. Under one schedule, each completion of a 10-response fixed-ratio unit produced a brief visual stimulus; the first fixed-ratio unit completed after 30 minutes elapsed produced the stimulus paired with either cocaine injection or food presentation. Generally, short pauses followed by high rates of responding were maintained within the fixed-ratio units, and responding was positively accelerated over the 30-minute interval. Under another schedule, each completion of a 3-minute fixed-interval unit produced the brief stimulus; completion of the 10th fixed-interval unit produced the stimulus paired with either cocaine injection or food presentation. Generally, short pauses followed by high rates of responding were maintained within the fixed-ratio units, and responding was positively accelerated over the 30-minute interval. Under another schedule, each completion of a 3-minute fixed-interval unit produced the brief stimulus; completion of the 10th fixed-interval unit produced the stimulus paired with either cocaine injection or food presentation. Rates of responding increased within the fixed-interval units, and to a greater extent over the entire 10 fixed-interval units. Patterns of responding depended more on the schedule of reinforcement than on whether cocaine or food maintained responding. Omitting the brief stimuli following all but the last fixed-ratio or fixed-interval units decreased average rates and altered the patterns of responding. Substituting a visual stimulus that was never paired with cocaine or food following all but the last fixed-ratio or fixed-interval units decreased response rates to a lesser extent and did not substantially alter patterns of responding. When the duration of the paired stimulus was varied from .3 to 30.0 seconds, the highest response rates occurred at intermediate durations (1.0 to 10.0 seconds). The manner in which the stimulus changes affected performances depended more on the schedule of reinforcement than on whether cocaine injection or food presentation maintained responding.     

Image-dependent interaction of imagery and vision

The influence of imagery on perception depends on the content of the mental image. Sixty-three students responded to the location of the 2 hands of a clock while visualizing the correct or an incorrect clock. Reaction time was shorter with valid cueing. Could this have resulted from visual acquisition strategies such as planning visual saccades or shifting covert attention? No. In this study, a crucial control condition made participants look at rather than visualize the cue. Acquisition strategies should have affected equally both types of cueing, but we observed that the effect of the visual cue was smaller and limited to a particular subcase in which one expects visual acquisition strategies. Thus, what matters is the similarity of the content of the mental image with the visual scene. In addition, an interaction involving the hand used for responding supports the notion that composite imagery is lateralized.     

Local rates of responding and reinforcement during concurrent schedules

The literature was searched for information about the local rates of responding and reinforcement during concurrent schedules. The local rates of reinforcement obtained from the two components of a concurrent schedule were equal when a long-duration changeover delay was used and when many sessions were conducted, except when the two components provided different simple schedules. The local rates of responding were equal under some conditions, but they differed when one component provided a ratio and the other an interval schedule. Across schedules, local rates of reinforcement changed with changes in the schedule of reinforcement. Local rates of responding did not change with changes in change-over-delay duration but did with changes in the changeover ratio and with changes in the programmed rates of reinforcement. The results generally conform to the Equalizing and Melioration Principles and help to clarify current statements of the Matching Law. The results also suggest that changes in the local rates of responding and reinforcement may be orderly across schedules.     

An operant analysis of human altruistic responding

Human altruistic responding (called give responding), which delivered a reinforcer to someone other than the responder, was compared to responding where the responder was the recipient of the reinforcer (called earn responding). The same type of response (button pressing), the same reinforcer (a point representing a penny), and the same reinforcer contingency (a 40-response fixed-ratio schedule) were used for both give and earn responding. Since points representing pennies were used to reinforce give and earn responding, responding for points not worth money was also assessed. Give, earn, and point responding were arranged as concurrent incompatible operants. Lowest rates were obtained for point responding. Compared to earn responding, give responding occurred at lower rates, was more susceptible to cessation when point responding was possible, extinguished more rapidly in the absence of money, and produced less responding during reconditioning compared to conditioning when reconditioning followed a period of nonreinforcement. Give responding was less when it reduced the giver's opportunity to earn. Finally, histories of getting reinforcement from others were shown to determine give responding.     

Matching, contrast, and equalizing in the concurrent lever-press responding of rats

Five rats pressed levers for food reinforces delivered by several concurrent variable-interval variable-interval schedules. The rate of reinforcement available for responding on one component schedule was held constant at 60 reinforcers per hour. The rate of reinforcement available for responding on the other schedule varied from 30 to 240 reinforcers per hour. The behavior of the rats resembled the behavior of pigeons pecking keys for food reinforcers. The ratio of the overall rates of responding emitted under, and the ratio of the time spent responding under, the two components of each concurrent schedule were approximately equal to the ratio of the overall rates of reinforcement obtained from the components. The overall rate of responding emitted under, and the time spent responding under, the variable component schedule varied directly with the overall rate of reinforcement from that schedule. The overall rate of responding emitted under, and the time spent responding under, the constant component schedule varied inversely with the overall rate of reinforcement obtained from the variable component. The local rates of responding emitted under, and the local rates of reinforcement obtained from, the two components did not differ consistently across subjects. But they were not exactly equal either.     

Effects of ethanol on multiple fixed-interval fixed-ratio schedule performances: dynamic interactions at different fixed-ratio values.

Key pecking by three pigeons was maintained under a multiple fixed-interval fixed-ratio schedule of food presentation. The fixed-interval value remained at 3 minutes, while the fixed-ratio size was increased systematically in 30-response increments from 30 to either 120 (two pigeons) or 150 (one pigeon). At least two lower fixed-ratio values were also redetermined. The effects of ethanol (5 to 2.5 g/kg) were assessed at each of the different schedule parameters. Both overall and running response rates under the fixed-ratio schedule decreased with increases in the size of the fixed-ratio schedule; pause duration under the fixed-ratio schedule was directly related to increases in fixed-ratio size. Overall and running rates of responding under the fixed-interval schedule changed little with increases in the size of the fixed-ratio schedule. Despite the relative invariance of fixed-interval responding across the different fixed-ratio values, the effects of ethanol on responding under the fixed-interval schedule differed depending on the size of the fixed-ratio schedule. Greater increases occurred in both overall and in lower local rates of responding under the fixed-interval schedule when the fixed-ratio value was 120 or 150. The effects of ethanol on responding under the fixed-ratio schedule also depended on the size of the fixed ratio. Increases in responding under the fixed-ratio schedule were typically greater at the higher fixed-ratio values where response rates were lower. When the effects of ethanol were redetermined at the lower fixed-ratio parameter values, rates and patterns of responding were comparable to those obtained initially. However, the dose-effect curves for responding under both fixed-ratio and fixed-interval schedules were shifted up and to the right of those determined during the ascending series. The effects of ethanol can depend on rate or responding, behavioral history, and the context in which behavior occurs.