How do reinforcers affect choice? Preference pulses after responses and reinforcers

In concurrent schedules, reinforcers are often followed by a brief period of heightened preference for the just‐productive alternative. Such ‘preference pulses’ may reflect local effects of reinforcers on choice. However, similar pulses may occur after nonreinforced responses, suggesting that pulses after reinforcers are partly unrelated to reinforcer effects. McLean, Grace, Pitts, and Hughes (2014) recommended subtracting preference pulses after responses from preference pulses after reinforcers, to construct residual pulses that represent only reinforcer effects. Thus, a reanalysis of existing choice data is necessary to determine whether changes in choice after reinforcers in previous experiments were actually related to reinforcers. In the present paper, we reanalyzed data from choice experiments in which reinforcers served different functions. We compared local choice, mean visit length, and visit‐length distributions after reinforcers and after nonreinforced responses. Our reanalysis demonstrated the utility of McLean et al.'s preference‐pulse correction for determining the effects of reinforcers on choice. However, visit analyses revealed that residual pulses may not accurately represent reinforcer effects, and reinforcer effects were clearer in visit analyses than in local‐choice analyses. The best way to determine the effects of reinforcers on choice may be to conduct visit analyses in addition to local‐choice analyses.     

Young children's affective decision-making in a gambling task: Does difficulty in learning the gain/loss schedule matter?

This research investigated the development of affective decision-making (ADM) during early childhood, in particular role of difficulty in learning a gain/loss schedule. In Experiment 1, we administrated the Children's Gambling Task (CGT) to 60 Chinese children aged 3 and 4, replicating the results obtained by Kerr and Zelazo [Kerr, A., & Zelazo, P. D. (2004). Development of “hot” executive function: The Children's Gambling Task. Brain and Cognition, 55, 148–157]. In Experiment 2, the CGT was modified to make it easier for young children to learn the gain/loss schedule by increasing delayed loss frequency and magnitude in the disadvantageous deck, and a larger sample (181 children aged 3–5) was assessed. Age-differences between 3- and 4-year-olds, rather than 4- and 5-year-olds, showed that ADM develops rapidly between 3 and 4 years. The reduction of the difficulty in learning the gain/loss schedule provides the basis for an account of the development of young children's AMD.     

Further investigation of differential reinforcement of alternative behavior without extinction for escape‐maintained destructive behavior

Previous research indicates that manipulating dimensions of reinforcement during differential reinforcement of alternative behavior (DRA) for situations in which extinction cannot be implemented is a potential approach for treating destructive behavior. Therefore, we replicated and extended previous research by determining (a) the conditions under which DRA without extinction decreased and maintained low levels of destructive behavior and (b) whether intervention effects maintained during reinforcement schedule thinning for the alternative response (i.e., compliance). Results showed that effective treatments were developed in the absence of extinction by manipulating the quality of reinforcement for compliance for 2 participants and by combining manipulations of the magnitude and quality of reinforcement for compliance for the other 2 participants. However, maintaining treatment effects during reinforcement schedule thinning required combining the magnitude and quality of reinforcement for 3 of the 4 participants. We discuss the clinical utility of this approach, review limitations of the study, and suggest directions for future research.     

Bouts of responding: the relation between bout rate and the rate of variable-interval reinforcement

By nose poking a lighted key, rats obtained food pellets on either a variable-interval schedule of reinforcement or a schedule that required an average of four additional responses after the end of tile variable-interval component (a tandem variable-interval variable-ratio 4 schedule). With both schedule types, the mean variable interval was varied between blocks of sessions from 16 min to 0.25 min. Total rate of key poking increased similarly as a function of the reinforcer rate for the two schedule types, but response rate was higher with than without the four-response requirement. Analysis of log survivor plots of interresponse times showed that key poking occurred in bouts. The rate of initiating bouts increased as a function of reinforcer rate but was either unaffected or was decreased by adding the four-response requirement. Within-bout response rate was insensitive to reinforcer rate and only inconsistently affected by the four-response requirement. For both kinds of schedule, the ratio of bout time to between-bout pause time was approximately a power function of reinforcer rate, with exponents above and below 1.0.     

The effects of delayed reinforcement on variability and repetition of response sequences

Four experiments examined the effects of delays to reinforcement on key peck sequences of pigeons maintained under multiple schedules of contingencies that produced variable or repetitive behavior. In Experiments 1, 2, and 4, in the repeat component only the sequence right-right-left-left earned food, and in the vary component four-response sequences different from the previous 10 earned food. Experiments 1 and 2 examined the effects of nonresetting and resetting delays to reinforcement, respectively. In Experiment 3, in the repeat component sequences had to be the same as one of the previous three, whereas in the vary component sequences had to be different from each of the previous three for food. Experiment 4 compared postreinforcer delays to prereinforcement delays. With immediate reinforcement sequences occurred at a similar rate in the two components, but were less variable in the repeat component. Delays to reinforcement decreased the rate of sequences similarly in both components, but affected variability differently. Variability increased in the repeat component, but was unaffected in the vary component. These effects occurred regardless of the manner in which the delay to reinforcement was programmed or the contingency used to generate repetitive behavior. Furthermore, the effects were unique to prereinforcement delays.     

An architect of the golden years

William H. Morse has played a major role in the experimental analysis of behavior. His view of operant behavior as the outcome of differential reinforcement provides an invaluable lesson in scientific research and theory. He studied schedules of reinforcement to generate an in-depth analysis of the complex interactions existing when contingencies exert their control over behavior. He has been instrumental in showing how behavior is determined by the dynamic interaction of factors brought into play by the imposition of any schedule, and he has a remarkably intuitive understanding of the nature of these determining variables. Some of these causal events are imposed directly by the schedule, but others arise in a more indirect manner through necessary constraints. In Morse's view, schedules can be more fundamental in determining behavior than are the scheduled events themselves. Behavior is the shaped product of an organism's history in combination with present environmental conditions. His impact deserves to be more than historical: A study of his work continues to reward the reader with exciting insights into the nature of behavioral control.     

Rats' performance on variable-interval schedules with a linear feedback loop between response rate and reinforcement rate

Three experiments investigated whether rats are sensitive to the molar properties of a variable-interval (VI) schedule with a positive relation between response rate and reinforcement rate (i.e., a VI+ schedule). In Experiment 1, rats responded faster on a variable ratio (VR) schedule than on a VI+ schedule with an equivalent feedback function. Reinforced interresponse times (IRTs) were shorter on the VR as compared to the VI+ schedule. In Experiments 2 and 3, there was no systematic difference in response rates maintained by a VI+ schedule and a VI schedule yoked in terms of reinforcement rate. This was found both when the yoking procedure was between-subject (Experiment 2) and within-subject (Experiment 3). Mean reinforced IRTs were similar on both the VI+ and yoked VI schedules, but these values were more variable on the VI+ schedule. These results provided no evidence that rats are sensitive to the feedback function relating response rate to reinforcement rate on a VI+ schedule.     

Associative symmetry in the pigeon after successive matching-to-sample training

If an organism is explicitly taught an A→B association, then might it also spontaneously learn the symmetrical B→A association? Little evidence attests to such “associative symmetry” in nonhuman animals. We report for the first time a clear case of associative symmetry in the pigeon. Experiment 1 used a successive go/no go matching‐to‐sample procedure, which showed all of the training and testing stimuli in one location and intermixed arbitrary and identity matching trials. We found symmetrical responding that was as robust during testing (B→A) as during training (A→B). In Experiment 2, we trained different pigeons using only arbitrary matching trials before symmetry testing. No symmetrical responding was found. In Experiment 3, we trained other pigeons with only arbitrary matching trials and then tested for symmetry. When these pigeons, too, did not exhibit symmetrical responding, we retrained them with intermixed identity and arbitrary matching trials. Less robust symmetrical responding was obtained here than in Experiment 1. Collectively, these results suggest that identity matching may have to be learned concurrently with arbitrary matching from the outset of training for symmetry to emerge.     

The effect of test schedules on the formation of linked perceptual classes

After training conditional discriminations among selected stimuli from two perceptual classes, the emergence of novel relations involving other members of both classes was assessed using cross-class probes. The cross-class probes were presented using one of four different testing schedules. In the 2/9 test, nine different probes were presented in each of two test blocks. In the 6/3 test, three different probes were presented in each of six test blocks. In the 18/1-RND test, each of the 18 cross-class probes was presented in separate test blocks. In the 2/9 and 6/3 tests, the cross-class probes were presented in a randomized order within test block. In the 18/1-RND test, the cross-class probes were presented in a randomized sequence. In the 18/1-PRGM test, however, the cross-class probes were presented in a programmed order (i.e., the values of the stimuli in each cross-class probe were changed systematically in the succession of probe presentations). About 55% of the linked perceptual classes emerged during the 2/9, 6/3, and 18/1-RND tests. Thus the number of different probes in a test block did not influence the emergence of classes as long as the probes were presented in a random order. Virtually all classes emerged during the 18/1-PRGM test. Thus at least one ordered introduction of different cross probes resulted in the reliable emergence of linked perceptual classes. Mechanisms responsible for linked perceptual class formation are discussed along with the relation of these classes to other complex categories.     

The Implications of Conjunctive and Disjunctive Forgiveness for Sexual Abuse

This article examines the relationship between forgiveness styles (conjunctive and disjunctive models) and sexual abuse. Surveys from 114 university students were analyzed for differences between non-sexually abused and sexually abused subjects on a number of psychological and physical well-being variables. A number of differences were found including higher levels of reported verbal and physical abuse for the sexually abused subjects. Only one sexually abused subject was found that fit the pattern of conjunctive forgiveness (one of reconciliation) towards the offender. The majority of sexually abused subjects preferred to keep their distance from the abuser, regardless of the extent to which the abuser had been forgiven. The results suggest that reconciliation within forgiveness may not be an appropriate goal for all subjects.