Fixed-ratio pausing: Joint effects of past reinforcer magnitude and stimuli correlated with upcoming magnitude

Pigeons responded on fixed-ratio schedules ending in small or large reinforcers (grain presentations of different duration) interspersed within each session. In mixed-schedule conditions, the response key was lit with a single color throughout the session, and pausing was directly related to the past reinforcer (longer pauses after large reinforcers than after small ones). In multiple-schedule conditions, different colors accompanied the ratios ending in small and large reinforcers, and pausing was affected by the upcoming reinforcer as well as the past one. Pauses were shorter before large reinforcers than before small ones, but they continued to be longer after large reinforcers than after small ones. The influence of the past reinforcer was modulated by the magnitude of the upcoming reinforcer; in the presence of the stimulus before the small reinforcer, the effect of the past reinforcer was enhanced relative to its effect in the stimulus before the large reinforcer. These results show that pausing between ratios is jointly determined by two competing factors: past conditions of reinforcement and stimuli correlated with upcoming conditions.     

The Drinking Expectancy Questionnaire: A revised measure of alcohol-related beliefs

Alcohol-related expectancies have been recently proposed as potentially important determinants of drinking behavior. This study describes the development of a New Zealand measure of such beliefs, the Drinking Expectancy Questionnaire (DEQ). Items selected through interviews, literature review, and the modification of other relevant questionnaires were piloted on 333 drinkers in a community sample and 275 college students. Factor analyses of both samples revealed nine alcohol reinforcement domains relating to assertiveness, affective change, sexual enhancement, social enhancement, relaxation, cognitive impairment, dependence, carelessness, and aggression. The potential clinical and research possibilities using this revised expectancy measure are briefly discussed, along with the scale's strength and weaknesses.The financial assistance of the Alcoholic Liquor Advisory Council of New Zealand in conducting this study is gratefully acknowledged.     

Algorithmic shaping and misbehavior in the acquisition of token deposit by rats

In two experiments, rats were trained to deposit ball bearings down a hole in the floor, using an algorithmic version of shaping. The experimenter coded responses expected to be precursors of the target response, ball bearing deposit; a computer program reinforced these responses, or not, according to an algorithm that mimicked the processes thought to occur in conventional shaping. In the first experiment, 8 of 10 rats were successfully shaped; in the second, 5 of 5 were successfully shaped, and the median number of sessions required was the same as for a control group trained using conventional shaping. In both experiments, “misbehavior,” that is, excessive handling and chewing of the ball bearings, was observed, and when the algorithmic shaping procedure was used, misbehavior could be shown to occur in spite of reduced reinforcement for the responses involved.     

THE RELATIVE MOTIVATIONAL PROPERTIES OF SENSORY AND EDIBLE REINFORCERS IN TEACHING AUTISTIC CHILDREN

We compared the effects of sensory and edible reinforcers on resistance to satiation in three autistic children while learning visual discrimination tasks. Within-subject designs were used to compare a single sensory reinforcer with a single edible reinforcer and to compare multiple sensory reinforcers with multiple edibles. Results indicated that multiple sensory reinforcers maintained responding over more trials than did multiple edible reinforcers; however, the use of single sensory reinforcers and single edibles resulted in about equal numbers of trials to satiation. Both multiple and single sensory reinforcers produced higher percentages of correct responses than edible reinforcers. The findings are discussed in terms of the advantages of sensory reinforcers in teaching autistic children.     

ASSESSMENT OF STIMULUS PREFERENCE AND REINFORCER VALUE WITH PROFOUNDLY RETARDED INDIVIDUALS

We evaluated a procedure for identifying potential reinforcers with profoundly retarded individuals. In Experiment 1, six persons were repeatedly exposed to 16 stimuli, and approach behaviors to each stimulus were used to identify preferred and nonpreferred stimuli. In Experiment 2, we examined the reinforcing properties of preferred and nonpreferred stimuli by delivering them contingently on the occurrence of arbitrarily selected responses. Results revealed that the preferred stimulus conditions typically produced higher rates of responding than did either the baseline or the nonpreferred stimulus conditions, suggesting that the procedure can be used to assess reinforcer value for individuals with limited behavioral repertoires.     

Probability and delay of reinforcement as factors in discrete-trial choice.

Pigeons chose between two alternatives that differed in the probability of reinforcement and the delay to reinforcement. A peck on the red key always produced a delay of 5 s and then a possible reinforcer. The probability of reinforcement for responding on this key varied from .05 to 1.0 in different conditions. A response on the green key produced a delay of adjustable duration and then a possible reinforcer, with the probability of reinforcement ranging from .25 to 1.0 in different conditions. The green-key delay was increased or decreased many times per session, depending on a subject's previous choices. The purpose of these adjustments was to estimate an indifference point, or a delay that resulted in a subject's choosing each alternative about equally often. In conditions where the probability of reinforcement was five times higher on the green key, the green-key delay averaged about 12 s at the indifference point. In conditions where the probability of reinforcement was twice as high on the green key, the green-key delay at the indifference point was about 8 s with high probabilities and about 6 s with low probabilities. An analysis based on these results and those from studies on delay of reinforcement suggests that pigeons' choices are relatively insensitive to variations in the probability of reinforcement between .2 and 1.0, but quite sensitive to variations in probability between .2 and 0.     

Effects of ratio reinforcement schedules on discrimination performance by Japanese monkeys

In Experiment 1, Japanese monkeys were trained on three conditional position-discrimination problems with colors as the conditional cues. Within each session, each problem was presented for two blocks of ten reinforcements; correct responses were reinforced under continuous-reinforcement, fixed-ratio 5, and variable-ratio 5 schedules, each assigned to one of the three problems. The assignment of schedules to problems was rotated a total of three times (15 sessions per assignment) after 30 sessions of acquisition training. Accuracy of discrimination increased to a moderate level with fewer trials under CRF than under ratio schedules. In contrast, the two ratio schedules, fixed and variable, were more effective in maintaining accurate discrimination than was CRF. With further training, as asymptotes were reached, accuracy was less affected by the schedule differences. These results demonstrated an interaction between the effects of reinforcement schedules and the level of acquisition. In Experiment 2, ratio sizes were gradually increased to 30. Discrimination accuracy was maintained until the ratio reached 20; ratio 30 strained the performance. Under FR conditions, accuracy increased as correct choice responses cumulated after reinforcement.     

Handling time and choice in pigeons

According to optimal foraging theory, animals should prefer food items with the highest ratios of energy intake to handling time. When single items have negligible handling times, one large item should be preferred to a collection of small ones of equivalent total weight. However, when pigeons were offered such a choice on equal concurrent variable-interval schedules in a shuttlebox, they preferred the side offering many small items per reinforcement to that offering one or a few relatively large items. This preference was still evident on concurrent fixed-cumulative-duration schedules in which choosing the alternative with longer handling time substantially lowered the rate of food intake.