Effects of reinforcement context on choice

Two experiments investigated the effects of successive reinforcement contexts on choice. In the first, concurrent variable-interval schedules of primary reinforcement operated during the initial links of concurrent chains. The rate of this reinforcement arranged by the concurrent schedules was decreased across conditions: When it was higher than the terminal-link rate, preference for the higher frequency initial-link schedule increased relative to baseline. (During baseline, a standard concurrent-schedule procedure was in effect). When the initial-link reinforcement rate was lower than the terminal-link rate, preference converged toward indifference. In the second experiment, a chain schedule was available on a third key while a concurrent schedule was in effect on the side keys. When the terminal link of the chain schedule was produced, the side keys became inoperative. Availability of the chain schedule did not affect choice between the concurrent schedules. These results show that only when successive reinforcement contexts are produced by choice responding do those successive contexts affect choice in concurrent schedules.     

Concurrent-schedule performance: Effects of relative and overall reinforcer rate

Six pigeons were trained to respond on two keys, each of which provided reinforcers on an arithmetic variable-interval schedule. These concurrent schedules ran nonindependently with a 2-s changeover delay. Six sets of conditions were conducted. Within each set of conditions the ratio of reinforcers available on the two alternatives was varied, but the arranged overall reinforcer rate remained constant. Each set of conditions used a different overall reinforcer rate, ranging from 0.22 reinforcers per minute to 10 reinforcers per minute. The generalized matching law fit the data from each set of conditions, but sensitivity to reinforcer frequency (a) decreased as the overall reinforcer rate decreased for both time allocation and response allocation based analyses of the data. Overall response rates did not vary with changes in relative reinforcer rate, but decreased with decreases in overall reinforcer rate. Changeover rates varied as a function of both relative and overall reinforcer rates. However, as explanations based on changeover rate seem unable to deal with the changes in generalized matching sensitivity, discrimination accounts of choice may offer a more promising interpretation.     

Effects of alternative reinforcement sources: A reevaluation

The effects of two alternative sources of food delivery on the key-peck responding of pigeons were examined. Pecking was maintained by a variable-interval 3-min schedule. In the presence of this schedule in different conditions, either a variable-time 3-min schedule delivering food independently of responding or an equivalent schedule that required a minimum 2-s pause between a key peck and food delivery (a differential-reinforcement-of-other-behavior schedule) was added. The differential-reinforcement-of-other-behavior schedule reduced response rates more than did the variable-time schedule in most instances. The delay between a key peck and the next reinforcer consistently was longer under the differential-reinforcement-of-other-behavior schedule than under the variable-time schedule. Response rates and median delay between responses and reinforcers were negatively correlated. These results contradict earlier conclusions about the behavioral effects of alternative reinforcement. They suggest that an interpretation in terms of response–reinforcer contiguity is consistent with the data.     

Maximizing versus matching on concurrent variable-interval schedules

Maximization and matching predictions were examined for a time-based analogue of the concurrent variable-interval variable-ratio schedule. One alternative was a variable interval whose time base operated relatively independent of the schedule chosen, and the other was a discontinuous variable interval for which timing progressed only when selected. Pigeons switched between schedules by pecking a changeover key. The maximization hypothesis predicts that subjects will show a bias toward the discontinuous variable interval and undermatching; however the obtained results conformed closely to the predictions of the matching law. Finally, a quantitative comparison was made of the bias and sensitivity estimates obtained in published concurrent variable-interval variable-ratio analogue studies. Results indicated that only the ratio-based analogue of the concurrent variable interval variable ratio studied by Green, Rachlin, and Hanson (1983) produced significant bias toward the variable-ratio alternative and undermatching, as predicted by reinforcement maximization.     

Stimulus effects on concurrent performance in transition

Six experimentally naive pigeons were exposed to concurrent variable-interval variable-interval schedules in a three-key procedure in which food reinforcement followed pecks on the side keys and pecks on the center key served as changeover responses. In Phase 1, 3 birds were exposed to 20 combinations of five variable-interval values, with each variable-interval value consistently associated with a different color on the side keys. Another 3 pigeons were exposed to the same 20 conditions, but with a more standard procedure that used a nondifferential discriminative stimulus on the two side keys throughout all conditions. In Phase 2, the differential and nondifferential stimulus conditions were reversed for each pigeon. Each condition lasted for one 5-hr session and one subsequent 1-hr session. In the last 14 conditions of each phase, the presence of differential discriminative stimuli decreased the time necessary for differential responding to develop and increased the sensitivity of behavior to reinforcement distribution in the 1st hr of training; during the last hours of training in each condition, however, the effects of the differential discriminative stimuli could not be distinguished from the effects of reinforcement distribution per se. These results show the importance of studying transitions in behavior as well as final performance. They may also be relevant to discrepancies in the results of previous experiments that have used nonhuman and human subjects.     

Choice between repleting/depleting patches: A concurrent-schedule procedure

Six pigeons responded on two concurrently available keys that defined patches with the following characteristics. Reinforcer stores repleted on a patch as a linear function of time when the bird had last responded to the other patch, or else did not replete. Repletion schedules thus timed only when the bird was absent from the patch. Reinforcer stores on a patch could be depleted and reinforcers obtained, again as a linear function of time, when the bird responded on a key. Depletion schedules thus timed only when the birds were present at a patch. Experiment 1 investigated changing relative depletion rates when repletion rates were constant and equal (Part 1) and changing relative repletion rates when the depletion rates were constant and equal (Part 2). Response- and time-allocation ratios conformed to a generalized matching relation with obtained reinforcer ratios, and there appeared to be no control by the size of the reinforcer stores. In Experiment 2, absolute depletion rates were varied with a pair of unequal repletion rates (Part 3), and absolute repletion rates were varied with a pair of unequal depletion rates (Part 4). Dwell times in the patches were not affected by either variation. Melioration theory predicted the results of Experiment 1 quite closely but erroneously predicted changing dwell times in Experiment 2. Molar maximization theory did not accurately predict the results of either experiment.     

FADING TEACHER PROMPTS PROM PEER-INITIATION INTERVENTIONS FOR YOUNG CHILDREN WITH DISABILITIES

This study examined a system for fading teacher prompts to children who served as peers in peer-initiation interventions for young children with disabilities. A teacher taught peers to direct social initiations to children with disabilities, provided verbal prompts for those initiations, and introduced a system that provided peers with visual feedback about the social interactions of the children with disabilities. She then systematically withdrew the verbal prompts to peers, and subsequently faded the visual feedback system. Peer initiations increased when the intervention began and resulted in increases in social interaction for the children with disabilities. As the teacher systematically faded the prompts and visual feedback to the peers, social interaction continued at the levels found during intervention and was maintained during a short maintenance period.     

Discriminability between alternatives in a switching-key concurrent schedule

Six pigeons were trained to discriminate between two intensities of white light in a symbolic matching-to-sample procedure. These stimuli were then used to signal which schedule was available on the main key in a switching-key concurrent schedule. The concurrent schedules led to a symbolic matching-to-sample phase in which the subject identified the concurrent schedule to which it last responded before a reinforcer could be obtained. The concurrent schedules were varied across conditions. Discriminability, measured during the symbolic matching-to-sample performance, was high throughout and did not differ across the two procedures. Performance in the concurrent schedules was like that typically obtained using these schedules. Delays were then arranged between completion of the concurrent schedules and presentations of the symbolic matching-to-sample phase. A series of conditions with an intervening delay of 10 s showed that both concurrent-schedule performance and symbolic matching-to-sample performance were affected by the delay in a similar way; that is, choice responding was closer to indifference.     

Diathesis-stress models of psychopathology: A quantitative genetic perspective

When genetics is considered in diathesis-stress models of psychopathology, it is often assumed that heredity provides the diathesis and environmental factors are responsible for the stressor. We discuss two quantitative genetic models relevant to the diathesis-stress construct. One model focuses on genotype-environment interaction, which is the usual way in which genetic influence is represented in diathesis-stress models. A second model—genotype-environment correlation—provides an alternative that represents both genetic and environmental influences relevant to the development of psychopathology. Implications of these models for clinical research are discussed.     

The accuracy of maternal self-reports: Agreement between reports on a computer simulation compared with observed behaviour in the supermarket

The validity of maternal self-reports about their parenting behaviour is evaluated with two studies. In both studies, the mothers were observed shopping in the supermarket with their 2-year-old children. One week later they responded to multiple choice questions on a computer that simulated the experience of shopping with their children. The exact agreement between the two types of data was then assessed. The results from the first study involving 28 mothers revealed some agreement, although it was generally low. In an effort to increase the level of agreement, the computer simulation was revised to allow multiple responses and to clarify some of the simulation vigenettes. A replication study resulted in a considerably higher level of agreement for 22 mothers. Implications of this method for researchers and practitioners are discussed.