Choice and amount of reinforcement in rats

Rats were exposed to concurrent-chains schedules in which the terminal links were equal, fixed-interval (FI) schedules terminating in one or a varying number of food pellets. In most rats, choice proportions for the larger reinforcer increased with increases in reinforcer amount (e.g., from one to five food pellets). When log response ratios were plotted against log reinforcer amount ratios, the results indicated that the effects of reinforcer amount depended on the length of fixed-interval terminal links, by showing that rats undermatched their response ratios to reinforcer amount ratios with the shorter terminal links (FI 5 s, Experiment 1), whereas they overmatched with the longer terminal links (FI 20 s, Experiment 2). These results demonstrated that the manipulation of FI terminal-link schedules affected the sensitivity of choice to reinforcer amount, and are consistent with the previous findings that choice proportions for the larger of two reinforcers (one vs three food pellets) increased with increases in the length of FI terminal-link schedules.     

The Effects of Positive Peer Reporting as a Class-Wide Positive Behavior Support

School-wide, selective, and individual positive behavioral supports are critical elements of a comprehensive, tiered model of service delivery. Positive peer reporting (PPR) involves brief, highly structured sessions during which peers are provided the opportunity to praise the behavior of target students. PPR procedures were modified in this study to provide all children in a classroom the opportunity to provide or receive peer praise. The effects of class-wide PPR on teacher-recorded critical events were evaluated using a multiple baseline design across two classrooms. Results indicated marginal improvement across the two settings, as well as supplemental measures of behavior outside of the classroom and class-wide sociometric nominations. Implications for future research and emerging models of school-wide PBS are discussed.     

Effects of post-session wheel running on within-session changes in operant responding

This study tested the effects of post-session wheel running on within-session changes in operant responding. Lever-pressing by six rats was reinforced by a food pellet under a continuous reinforcement (CRF) schedule in 30-min sessions. Two different flavored food pellets were used as reinforcers. In the wheel conditions, 30-min operant-sessions with one of the flavored pellets were followed by 30-min free-wheel running sessions. Meanwhile, in the home conditions, rats’ operant responding was reinforced by the other flavored pellets during 30-min operant-sessions, and the rats were then returned to their homecages. All rats were exposed to 4 wheel and 4 homecage sessions. Operant responding was lowered during the wheel conditions. However, post-session running did not alter the within-session pattern of operant responding. These effects were practically identical to the effects of drug-induced taste-aversion learning on within-session changes in operant responding, suggesting similar mechanisms in both taste-aversion preparations.     

Operant conditioning of behavioral variability using a percentile reinforcement schedule.

The present investigation developed and tested a new percentile reinforcement schedule suited to study pattern variability, whose main feature was the relative dissociation it provided between the variability requirement defining criterional responses and overall probability of reinforcement. In a discrete-trials procedure, pigeons produced patterns of four pecks on two response keys. If the pattern emitted on the current trial differed from the N preceding patterns, reinforcement was delivered with probability mu. The schedule continuously adjusted the criterion N such that the probability of a criterional response, estimated from the subject's recent behavior, was always constant. In these circumstances, the criterion corresponded to an invariant percentile in the distribution of recent responses. Using a between-subjects design, Experiment 1 manipulated the variability requirement--the percentile--while keeping overall reinforcement probability constant. The degree of variability varied directly with the requirement. In addition, an inverse relationship existed between the requirement and within-group variance. Experiment 2 manipulated probability of reinforcement while maintaining the variability requirement constant. No consistent relationship was found between variability and reinforcement probability. A tentative hypothesis was advanced ascribing the operant conditioning of behavioral variability to a process of probability-dependent selection.     

On conditioned reinforcing effects of negative discriminative stimuli

Observing responses by pigeons were studied during sessions in which a food key and an observing key were available continuously. A variable-interval schedule and extinction alternated randomly on the food key. In one condition, food-key pecking during extinction decreased reinforcement frequency during the next variable-interval component, and in the other condition such pecking did not affect reinforcement frequency. Observing responses either changed both keylight colors from white to green (S+) or to red (S−) depending on the condition on the food key, or the observing responses never produced the S+ but produced the S− when extinction was in effect on the food key. Observing responses that produced only S− were maintained only when food-key pecking during extinction decreased reinforcement frequency in the subsequent variable-interval component. The red light conformed to conventional definitions of a negative discriminative stimulus, rendering results counter to previous findings that production of S− alone does not maintain observing. Rather than offering support for an informational account of conditioned reinforcement, the results are discussed in terms of a molar analysis to account for how stimuli acquire response-maintaining properties.     

Frequency versus magnitude of reinforcement: New data with a different procedure

Two pigeons, with previous exposure to concurrent schedules, were submitted to 29 sessions of 8 hours each with concurrent variable-interval variable-interval schedules in which reinforcement parameters changed from session to session. In the first nine sessions reinforcement durations were equal in both schedules while reinforcement frequencies varied; in Sessions 10 through 18, both frequency and duration of reinforcement were varied; in Sessions 19 through 29, only reinforcement duration was varied. Results with this different procedure confirm previous findings that behavior is more sensitive to changes in reinforcement frequency than to reinforcement magnitude.     

Delayed signal detection, differential reinforcement, and short-term memory in the pigeon.

In two discrete-trial delayed-detection experiments, six pigeons were trained on dependent concurrent variable-interval schedules. Pecking a red side key was reinforced when the brighter of two white lights (S1) had been presented on the center key, and pecking a green side key was reinforced when the duller of two white lights (S2) had been presented on the center key. Incorrect responses were red side-key pecks following S2 presentations and green side-key pecks following S1 presentations; these resulted in three-second blackouts. In Experiment 1, the time between presentation of S1 or S2 on the center key and the onset of the red and green side keys was varied nonsystematically from 0.06 seconds to 19.69 seconds across experimental conditions. Stimulus discriminability decreased as the stimulus-choice delay increased. A rectangular-hyperbolic function better described this decrease in discriminability over time than did a negative-exponential function. In Experiment 2, at each of three stimulus-choice delays (0.06, 3.85, and 10.36 seconds), relative reinforcer frequency for correct responses to the red and green side keys was varied by changing the values of the dependent concurrent variable-interval schedules. The sensitivity of choice to relative reinforcer frequency was independent of the decrease in stimulus discriminability with increasing stimulus-choice delay.     

“Where is the sun” for hemi-neglect patients?

Human observers use prior constraints to disambiguate a scene; in particular, light is preferentially seen as coming from above but also slightly from the left. One explanation of this lateral bias could be a cerebral hemispheric difference. The aim of the present study was to determine the preferred light source position for neglect patients. For this purpose, we used the ambiguous shaded “Polo Mint” stimulus, a ring divided into eight equal sectors. All sectors but one were the same shape, convex or concave, as determined by the light source position. Participants had to report the side (left or right) of the odd sector or, in a separate experiment, to report its shape (convex or concave). Eight patients with spatial neglect (left neglect N = 7, right neglect N = 1) after a right or left temporo-parietal or thalamic lesion and 14 control participants ran the experiment. Left neglect patients showed a significantly different light bias from the bias observed for controls and for the right neglect patient (i.e., a reduction of the left bias or a right bias rather than a left bias). We conclude that some disabilities presented by patients with spatial neglect may be due to difficulties processing information that is not present in the visual field or imagined in the representational scene.     

Effects of task difficulty and type of contingency on students' allocation of responding to math worksheets

This study investigated students' allocation of responding as a function of task difficulty and type of reinforcement contingency (i.e., accuracy based or time based). Four regular education fourth-grade students were presented with two identical stacks of easy and then difficult math worksheets using a reversal design. Regardless of condition, completing problems from each stack of worksheets was reinforced according to a different contingency; one required correct completion of math problems (accuracy based) and one required on-task behavior (time based). Results suggested that 3 of the 4 students preferred the accuracy-based contingency when given easy material and the time-based contingency when given difficult material. One student allocated more responding to the accuracy-based contingency when given easy problems but did not show a clear preference for either contingency with difficult problems. The implications of these findings for designing reinforcement-based programs for tasks of varying difficulty are discussed.