Stimuli, reinforcers, and behavior: an integration

We propose that a fundamental unit of behavior is the concurrent discriminated operant, and we discuss in detail a quantitative model of the concurrent three-term contingency that is based on the notion that an animal's behavior is controlled to differing extents by both stimulus—behavior and behavior—reinforcer relations. We show how this model can describe performance in a variety of experimental procedures: conditional discrimination and matching to sample, both with and without reinforcement for responses that are traditionally identified as errors; conditional discrimination with more than two stimuli and choice alternatives; delayed matching to sample and delayed reinforcement in matching to sample; second-order and complex conditional discrimination; and multiple and concurrent schedules. Although the model is incomplete in its coverage, and may be incorrect, we believe that this conceptual approach will bear fruit in the development of behavior theory.     

Pavlovian contingencies and resistance to change in a multiple schedule

According to theoretical accounts of behavioral momentum, the Pavlovian stimulus—reinforcer contingency determines resistance to change. To assess this prediction, 8 pigeons were exposed to an unsignaled delay-of-reinforcement schedule (a tandem variable-interval fixed-time schedule), a signaled delay-of-reinforcement schedule (a chain variable-interval fixed-time schedule), and an immediate, zero-delay schedule of reinforcement in a three-component multiple schedule. The unsignaled delay and signaled delay schedules employed equal fixed-time delays, with the only difference being a stimulus change in the signaled delay schedule. Overall rates of reinforcement were equated for the three schedules. The Pavlovian contingency was identical for the unsignaled and immediate schedules, and response—reinforcer contiguity was degraded for the unsignaled schedule. Results from two disruption procedures (prefeeding subjects prior to experimental sessions and adding a variable-time schedule to timeout periods separating baseline components) demonstrated that response—reinforcer contiguity does play a role in determining resistance to change. The results from the extinction manipulation were not as clear. Responding in the unsignaled delay component was consistently less resistant to change than was responding in both the immediate and presignaled segments of the signaled delay components, contrary to the view that Pavlovian contingencies determine resistance to change. Probe tests further supported the resistance-to-change results, indicating consistency between resistance to change and preference, both of which are putative measures of response strength.     

Discrimination of multidimensional geometrical figures by chickens: categorization and pattern-learning

Japanese bantam hens were trained to discriminate between geometrical figures varying along four integral dimensions. Only one dimension predicted food: selections of sharp-cornered figures were reinforced, while selections of rounded figures were not. In experiment 1, hens were subsequently trained to discriminate between nine figure pairs in a simultaneous discrimination task. Because single pairs contained multiple redundant cues, whereas the relevant dimension was obvious only across stimulus pairs, the results revealed effects of both generalization and reversal learning. Accordingly, learning speed was enhanced for later discriminations. Experiment 2 tested the hens’ transfer performance to unknown pairs, following experience of 9 or 18 figure pairs. Four of seven hens showed reliable transfer after experience with 9 figures, but only three showed transfer after experience with 18 figures, indicating lower transfer with higher number of stimulus pairs learned. In experiment 3, hens were trained to discriminate 27 figure pairs. Discrimination ratios further decreased and the groups of pairs differed significantly in their ratios of discrimination. Individual hens’ pecking behaviour was analysed in relation to each dimension of single figures and in relation to relative differences in the levels of dimensions between paired figures. Hens were shown to be oriented towards irrelevant information and more towards relational and configurational than elemental and dimensional aspects. The results are discussed in the biological context of individual recognition in chickens’ dominance hierarchies, in which we suppose that chickens identify individual flock mates by representation of their visual pattern rather than by single characteristics. Received: 18 September 1998 / Accepted after revision: 23 December 1998     

Reduction of stimulus overselectivity with nonverbal differential observing responses

Three individuals with mental retardation exhibited stimulus overselectivity in a delayed matching-to-sample task in which two sample stimuli were displayed on each trial. Intermediate accuracy scores indicated that participants could match one of the samples but not both of them. Accuracy in a baseline condition was compared to accuracy with a differential observing response procedure. This procedure prompted participants to make simultaneous identity-matching responses that required observation and discrimination of both sample stimuli. These observing responses were never followed by differential consequences. When observing responses were prompted, participants' accuracy scores improved. In a return to the baseline condition, when differential observing responses were no longer prompted, accuracy returned to intermediate levels. The results show that stimulus overselectivity can be greatly reduced by a behavioral intervention that controls observing behavior and verifies discrimination, but that exposure to such procedures alone may be insufficient for lasting benefits.     

INCREASING HABILITATIVE SERVICES FOR PERSONS WITH PROFOUND HANDICAPS: AN APPLICATION OF STRUCTURAL ANALYSIS TO STAFF MANAGEMENT

We evaluated a structural analysis methodology for enhancing the utility of a staff management program. In Experiment 1, a structural analysis of direct-care staff behavior in a mental retardation facility revealed differences in work patterns over time. Specific times were identified when few basic care duties were necessary and staff engaged in nonwork activity. In Experiment 2, a management program was implemented to increase staff members' training activities during periods identified through the structural analysis. The program was accompanied by increases in training activities and decreases in nonwork behavior. The improvements were maintained during a 43-week period while the most labor-intensive component of the program was withdrawn. Staff acceptability measures indicated a positive response to the management intervention, although responses varied across components within the multifaceted program. The increased training was accompanied by beneficial changes among clients with profound handicaps. Results are discussed regarding practical considerations for improving staff performance and for adopting innovations resulting from applied research.     

Multiple determinants of the effects of reinforcement magnitude on free-operant response rates

Four experiments examined the effects of increasing the number of food pellets given to hungry rats for a lever-press response. On a simple variable-interval 60-s schedule, increased number of pellets depressed response rates (Experiment 1). In Experiment 2, the decrease in response rate as a function of increased reinforcement magnitude was demonstrated on a variable-interval 30-s schedule, but enhanced rates of response were obtained with the same increase in reinforcement magnitude on a variable-ratio 30 schedule. In Experiment 3, higher rates of responding were maintained by the component of a concurrent variable-interval 60-s variable-interval 60-s schedule associated with a higher reinforcement magnitude. In Experiment 4, higher rates of response were produced in the component of a multiple variable-interval 60-s variable-interval 60-s schedule associated with the higher reinforcement magnitude. It is suggested that on simple schedules greater reinforcer magnitudes shape the reinforced pattern of responding more effectively than do smaller reinforcement magnitudes. This effect is, however, overridden by another process, such a contrast, when two magnitudes are presented within a single session on two-component schedules.     

Quantitative and methodological aspects of stimulus equivalence

The number of different ways of linking stimuli in the training phase of a conditional discrimination procedure designed to teach equivalence relations has hitherto been underestimated. An algorithm from graph theory that produces the correct number of such different ways is given. The establishment of equivalence relations requires transitive stimulus control. A misconception in a previous analysis of the conditions necessary for demonstrating transitive stimulus control is indicated. This misconception concerns responding in an unreinforced test trial to a negative rather than a positive comparison stimulus. Such behavior cannot be attributed to discriminative control by degree of association with reinforcement if the negative comparison stimulus has been less associated with reinforcement than the positive comparison stimulus in an antecedent training phase.     

Effects of d-amphetamine on responding under second-order schedules of reinforcement with paired and nonpaired brief stimuli.

Three pigeons were studied under a multiple schedule in which pecks in each component were reinforced according to a variable-interval 120-s second-order schedule with fixed-interval 60-s units. In the first component of the multiple schedule, the completion of a fixed interval produced either food or a 4-s change in key color plus houselight illumination. In the second component an identical schedule was in effect, but the stimulus was a 0.3-s change in key color. Both long and short brief stimuli were not paired with food presentations in Conditions 1 and 3 and were paired with food in Condition 2. There were no consistent differences in response patterns under paired and nonpaired brief-stimulus conditions when the stimulus was a 4-s change in key color accompanied by houselight illumination. However, pairing the 0.3-s key-color change with food presentations resulted in higher indices of curvature and lower response rates in the early segments of the fixed interval than when the stimulus was not paired with food presentations. Low doses of d-amphetamine (0.3 and 1 mg/kg) produced small and inconsistent increases in overall response rates, and higher doses (3 and 10 mg/kg) decreased overall response rates. d-Amphetamine altered response patterns within fixed intervals by decreasing the indices of curvature and increasing response rates in the early segments of the fixed interval. Response rates and patterns under paired and nonpaired brief-stimulus conditions were not differentially affected by d-amphetamine. Thus, evidence for the enhancement of the conditioned reinforcement effects of psychomotor stimulant drugs was not found with the second-order schedules used in the present study.     

Local contrast in behavior allocation during multiple-schedule components

Allocation of responses between two keys was studied during two alternating multiple-schedule components. Responses were recorded in successive quarters of each component. Variable-interval reinforcer schedules on the two keys were constant throughout the experiment for one (constant) component and were varied over conditions on one key for the other, producing changes in reinforcer ratios for the varied component. Behavior allocation for the first quarter of the constant component was inversely related to varied-component reinforcer ratios, a form of local contrast, but this relationship was not observed later in the component. During the first quarter of the varied component, slopes of matching lines were high and decreased later in the component. It is argued that this form of local contrast cannot be explained in terms of reallocation of extraneous reinforcers between components, and that the matching law for concurrent operants does not capture some sources of control over behavior allocation. A simple extension of the matching law is offered that adequately describes behavior changes during both components. A version of this formulation can predict contrast effects in absolute response rates.     

Protocol analysis of the correspondence of verbal behavior and equivalence class formation.

In two equivalence experiments, a "think aloud" procedure modeled after Ericsson and Simon's (1980) protocol analysis was implemented to examine subjects' covert verbal responses during matching to sample. The purpose was to identify variables that might explain individual differences in equivalence class formation. The results from Experiment 1 suggested that subjects who formed equivalence classes described the relations among stimuli, whereas those not showing equivalence described sample and comparison stimuli as unitary compounds. Because Experiment 1 only demonstrated a correlation between describing stimulus compounds and the absence of equivalence classes, a second study was conducted. In Experiment 2, equivalence class formation was brought under experimental control through pretraining manipulations that facilitated responding either to stimulus compounds or to relations among stimuli. The results demonstrated that a history of describing stimulus compounds, when compared with describing the relations among the stimuli, interfered with the emergence of stimulus equivalence. These findings clarify individual differences in stimulus equivalence. They also demonstrate the utility of analyzing verbal reports to identify possible variables that can be manipulated experimentally.