Second-Order Schedules

The rules which define the formal specifications of simple schedules of reinforcement have also been used to develop more complex schedules. Within these “second-order” schedules, previously neutral stimuli acquire various degrees of behavioral control. This paper describes some of the experiments used to determine the nature of this control.

     

Effects of Attribution and Schedules of Reinforcement on Performance

Abstract

We examined the impact of attributional instructions and schedules of reinforcement on performance. Attributional instructions were designed to lead to an internal or an external attribution, whereas schedules of reinforcement were either variable ratio or variable interval. Results obtained from 31 American students indicated that the subjects given external attributional instructions made a greater number of responses but did not respond more correctly. The schedule of reinforcement did not influence either the number of responses or the correctness of responses.     

Performance under Competitive and Self-Competitive Fixed-Interval Schedules of Reinforcement

The Psychological Record - Participants completed blocks of trials under simple (i.e., work-alone), competitive, and self-competitive fixed-interval 20-s schedules of reinforcement. In general,...     

Contingencies of Superstition: Self-Generated Rules and Responding During Second-Order Response-Independent Schedules

The Psychological Record - Experimental conditions explored the development of fallacious rules and assessed the rates and durations of superstitious responding by children under the influence of...     

Enhancing Classroom Performance: A Review of Reinforcement Schedules

During the past decade the application of elementary principles of behavior have become a standard in the classroom teacher's repertoire of behavior change strategies. Unfortunately, the application of more advanced principles of behavior derived through basic behavioral research lies as an untapped resource for classroom teachers. Nowhere is this more apparent than in the use of systematic procedures to deliver reinforcers to enhance academic performance. In this paper we provide educators with information on the use of reinforcement schedules in academic settings. Various schedules of reinforcement are presented along with examples of their application in applied settings.     

Functional Communication Training and Demand Fading Using Concurrent Schedules of Reinforcement

Demand fading, a schedule thinning procedure for escape-maintained behaviors, typically includes an escape extinction component. The purpose of this study was to examine the effectiveness of demand fading with alternative reinforcement utilizing concurrent reinforcement schedules without extinction. During demand fading, aggression and requests emitted prior to meeting the task completion criterion were reinforced with short, low-quality breaks, but requests emitted following the task completion criterion were reinforced with long, high-quality breaks. Results suggest that concurrent schedules of reinforcement may be an effective alternative to extinction as a component of demand fading.     

Affordances Guide Choice Behavior between Equal Schedules of Reinforcement in Rats

Abstract

Operant choice theories pose that behavior distribution between options is ruled by the consequences related with these options. Evidence suggests that rats’ performance is attuned to the affordances that the operant setting provides, such as lever height. Our aim was to explore in rats whether lever press distribution was influenced by the affordances furnished by two levers. Lever pressing was reinforced in two concurrent equal variable-ratio schedules of reinforcement, and in successive conditions lever height was varied asymmetrically—that is, one lever was higher than the other. Results showed a quadratic relation between response rates and lever height, a linear trend between preference and lever height, and higher between- and within-bout response rates on the lower lever in four out of the six pairs of lever heights assessed. These findings suggest that intermediate lever heights favored lever pressing with faster bout initiation and faster within-bout responding, and support the idea that preorganized properties of behavior (i.e., the organism’s abilities) interact with the environment before the operant contingency takes place.     

Determinants of Human Fixed-Interval Performance Following Varied Exposure to Reinforcement Schedules

The Psychological Record - Undergraduates given accurate instructions pressed keys for token points under either a variety of reinforcement schedules (variety training) or under a single schedule....     

A Comparison of Escalating Versus Fixed Reinforcement Schedules on Undergraduate Quiz Taking

Drug abstinence studies indicate that escalating reinforcement schedules maintain abstinence for longer periods than fixed reinforcement schedules. The current study evaluated whether escalating reinforcement schedules would maintain more quiz taking than fixed reinforcement schedules. During baseline and for the control group, bonus points were distributed on random days for attending class. Following baseline, students in the fixed reinforcement section received 5 bonus points for each quiz completed while students in the escalating reinforcement received 3 bonus points for the first quiz with an increase of 0 or 1 point for each consecutive quiz completed. Results indicated that the escalating reinforcement schedule maintained quiz taking significantly longer than the fixed reinforcement schedule. The control group took the fewest number of quizzes. Students with good attendance took significantly more quizzes under the escalating reinforcement schedule than students with good attendance exposed to the fixed reinforcement schedule or control condition. This study demonstrates a potential novel application for escalating reinforcement schedules. Results indicate that escalating reinforcement schedules may be successfully applied to academic settings, but more research is needed.     

Human Sensitivity To Concurrent Schedules Of Reinforcement: Effects Of Observing Schedule-correlated Stimuli

The determinants of human sensitivity to concurrent variable-interval variable-interval schedules of reinforcement have been difficult to identify, in part because of procedural differences separating published experiments. This experiment investigated vigilance to stimuli correlated with concurrent schedules. Across phases, 3 college students were provided with either no schedule-correlated stimuli, an observing response that provided brief access to the stimuli, or a contingency that required the subject to identify the stimulus correlated with the source of each obtained reinforcer. Sensitivity, as quantified by the generalized matching equation, was low when no stimuli were available. When the stimuli were response contingent, 1 subject observed them, and her behavior became more sensitive to the distribution of reinforcers across the concurrent schedules. When the procedure required discrimination of the stimulus correlated with each reinforcer, the other 2 subjects also observed the stimuli, and their schedule sensitivity was increased as well. These results implicate procedural differences, rather than inherent behavioral differences, as the source of differences in sensitivity to schedules of reinforcement between humans and nonhumans.     

Choice with Concurrent Interval Schedules of Reinforcement: The Effects of Different Timing Procedures

Using a Findley changeover procedure, two groups of rats were exposed to various concurrent variable-time (VT) schedules of milk presentation. The rules governing the operation of the timers for the stimulus events differed for the two groups with resulting differences in the overall degree of changeover responding but not with respect to time allocation measures, which in both cases consisted of undermatching. When an interrupted VT reinforcement timer was reset upon re-entry of that component, the rats tended to emit changeover responses almost exclusively to the more favorable component. When the VT reinforcement timers were left running regardless of which components the rats selected, changeover responses were significantly more frequent and equally distributed among both the more and less favorable components. In comparing the present results with those from a similar procedure in which shock was used (Deluty & Church, 1978), it is apparent that what is basic to choice in concurrent interval schedules is not matching or some mathematical variation of it. Instead, it is a tendency to optimize on the basis of the favorability of the stimulus events and the contingencies regarding how those events are timed and administered.

     

A Comparison of Five Reinforcement Schedules for use in Contingency Management-Based Treatment of Methamphetamine Abuse

The Psychological Record - One variation of contingency management involves providing vouchers with monetary value for the provision of a biological sample indicating no recent drug use. These...     

Second-Order Science and Policy

In March 2016, an interdisciplinary group met for two days and two evenings to explore the implications for policy making of second-order science. The event was sponsored by SITRA, the Finnish Parliament's Innovation Fund. Their interest arose from their concern that the well-established ways, including evidence-based approaches, of policy and decision making used in government were increasingly falling short of the complexity, uncertainty, and urgency of needed decision making. There was no assumption that second-order science or second-order cybernetics would reveal any practical possibilities at this early stage of enquiry. On the other hand, some members of the group are practioners in both policy and in facilitating change in sectors of society. Thus, the intellectual concepts were strongly grounded in experience. This is an account of the deliberations of that group and some reflections on what came out of the various shared contributions and ensuing dialogues. The overall conclusion of the event is that there definitely are possibilities that are worthy of further research and exploration.     

Schedules of response-independent conditioned reinforcement

Rates and patterns of responding of pigeons under response-independent and response-dependent schedules of brief-stimulus presentation were compared by superimposing 3-min brief-stimulus schedules on a 15-min fixed-interval schedule of food presentation. The brief-stimulus schedules were fixed time, fixed interval, variable time, and variable interval. When the brief stimulus was paired with food presentation, its effects depended upon the schedule and ongoing rates. Fixed- and variable-interval brief-stimulus schedules enhanced the low rates normally occurring early in the 15-min interval, whereas fixed- and variable-time schedules suppressed these rates. Although the overall rates later in the interval were not affected to any great extent, the fixed brief-stimulus schedules generated patterns of positively accelerated responding between stimulus presentations. These patterns appeared less frequently under the variable brief-stimulus schedules. Initially, when not paired with food delivery, presentations of the brief stimulus produced relatively little effect on either response rate or patterning. However, once the stimulus had accompanied food presentation, the original performance under the nonpaired condition was not recovered. The effects were more like those occurring when the stimulus was paired with food.