Choice and number of reinforcers

Pigeons were exposed to the concurrent-chains procedure in two experiments designed to investigate the effects of unequal numbers of reinforcers on choice. In Experiment 1, the pigeons were indifferent between long and short durations of access to variable-interval schedules of equal reinforcement density, but preferred a short high-density terminal link over a longer, lower density terminal link, even though in both sets of comparisons there were many more reinforcers per cycle in the longer terminal link. In Experiment 2, the pigeons preferred five reinforcers, the first of which was available after 30 sec, over a single reinforcer available at 30 sec, but only when the local interval between successive reinforcers was short. The pigeons were indifferent when this local interval was sufficiently long. The pigeons' behavior appeared to be under the control of local terminal-link variables, such as the intervals to the first reinforcer and between successive reinforcers, and was not well described in terms of transformed delays of reinforcement or reductions in average delay to reinforcement.     

Effects of response-independent negative reinforcers on negatively reinforced key pecking

Previous research has shown that presenting response-independent positive reinforcers reduces the response rate of an operant maintained by positive reinforcement. The present experiment investigated a similar effect using shock-free time as a negative reinforcer. Brief shocks were delivered in the presence of a distinctive stimulus, and pigeon's key pecks were reinforced by the occasional presentation of a 2-minute shock-free period. Extra 2-minute shock-free periods were added independently of behavior. For each of three pigeons, response rate during shock-on periods declined with added shock-free periods; the more frequently the extra shock-free periods occurred the greater the decline in response rate. This outcome is predicted by extending the Law of Effect to include negative reinforcement.     

Free-operant choice behavior: A molecular analysis

Pigeons' pecks to two concurrent initial-link stimuli occasionally produced one of two mutually exclusive terminal links. Further responding to the terminal-link stimulus produced food under fixed-interval or fixed-ratio schedules. In such concurrent chained schedules, investigators rarely use a changeover delay to control superstitious switching, although it is customary to use a changeover delay in simple concurrent schedules in which choice responses produce food directly. When terminal-link fixed-interval schedules were equal or similar in duration and no changeover delay was employed, conditional probabilities of choice for a schedule were found to be lower if the last choice was for that schedule than if the last choice was for the other schedule (“switching dependency”). Imposition of a changeover delay with equal or unequal terminal links produced the opposite pattern: conditional probabilities of choice for a schedule were higher if the last choice was for that schedule than if the last choice was for the other schedule. Turning off all chamber lights during the changeover delay interval attenuated these “repetition dependencies.” The results indicate that excessive switching can complicate the interpretation of data from concurrent chains much as from simple concurrent schedules, and that using blackouts to control switching may be preferable to using a changeover delay.     

DEVIATIONS FROM MATCHING AS A MEASURE OF PREFERENCE FOR ALTERNATIVES IN PIGEONS

Preferences for larger or smaller formally defined response classes were investigated in a concurrent schedule procedure. Twelve pigeons were run on a series of concurrent variable-interval reinforcement schedules, from which baseline matching functions were obtained. An experimental phase followed, in which a second response key was available in one concurrent schedule alternative. For half the birds, the second key was programmed identically with the first; for the other half, the added key was programmed for extinction, with position irrelevant. Comparison of baseline and experimental matching functions revealed no systematic changes in either slope or intercept for birds in the latter group. Systematic shifts in function intercepts in the former group indicate a response bias toward the response-constrained (single-key) schedule alternative. Although contrary to the literature of preference for choice, this finding may be interpretable through an account dealing with imposed variability of responding.     

Interresponse-time shaping by variable-interval-like interresponse-time reinforcement contingencies

The interresponse-time reinforcement contingencies and distributions of interreinforcement intervals characteristic of certain variable-interval schedules were mimicked by reinforcing each key peck with a probability equal to the duration of the interresponse time it terminated, divided by the scheduled mean interreinforcement interval. The interresponse-time reinforcement contingency was then eliminated by basing the probability of reinforcement on the fifth interresponse time preceding the key peck. Even though distributions of interreinforcement intervals were unaffected by this manipulation, response rates consistently increased. A second experiment replicated this effect and showed it to combine additively with that of mean reinforcement rate. These results provide strong support for the contention that current analyses of variable-interval response rates that ignore the inherent interresponse-time reinforcement contingency may be seriously in error.     

Transfer of pigeons' matching to sample to novel sample locations

This study examined the conditions under which conditional stimulus control by the sample stimuli in three-key matching-to-sample paradigms would generalize across the different possible sample locations. In Experiments 1 and 2, the samples appeared on the left and right side keys during initial training and then on the center key during testing. Transfer of pigeons' matching performances to the center-key samples was evident after both identity and symbolic matching training. In Experiment 3, pigeons trained on symbolic matching with two side-key samples or with a side-key and a center-key sample generally transferred their learned matching performances to those samples when they subsequently appeared in the remaining (novel) location. These results indicate that, when two-choice conditional discriminations are learned with more than one sample location, the visual characteristics of the sample per se predominantly come to control the pigeons' comparison choices. This finding encourages the use of the multiple-location training procedure as a way of reducing control by location, thus providing a more discriminating test of symmetry in animals.     

The effects of morphine on fixed-interval patterning and temporal discrimination

Changes produced by drugs in response patterns under fixed-interval schedules of reinforcement have been interpreted to result from changes in temporal discrimination. To examine this possibility, this experiment determined the effects of morphine on the response patterning of 4 pigeons during a fixed-interval 1-min schedule of food delivery with interpolated temporal discrimination trials. Twenty of the 50 total intervals were interrupted by choice trials. Pecks to one key color produced food if the interval was interrupted after a short time (after 2 or 4.64 s). Pecks to another key color produced food if the interval was interrupted after a long time (after 24.99 or 58 s). Morphine (1.0 to 10.0 mg/kg) decreased the index of curvature (a measure of response patterning) during fixed intervals and accuracy during temporal discrimination trials. Accuracy was equally disrupted following short and long sample durations. Although morphine disrupted temporal discrimination in the context of a fixed-interval schedule, these effects are inconsistent with interpretations of the disruption of response patterning as a selective overestimation of elapsed time. The effects of morphine may be related to the effects of more conventional external stimuli on response patterning.     

Decision Pattern Analysis as a General Framework for Studying Individual Differences in Decision Making

This paper investigated decision pattern analysis (DPA) as a general and standard framework for studying individuals' consistent decision making behavior within and between contexts. DPA classifies decisions on the basis of judgement accuracy and the goal orientation of the decided‐upon action. Over repeated decisions, patterns of individuals' decision behavior are described by five variables: competence, optimality, recklessness, hesitancy and decisiveness. A fictitious medical decision making test and three standard cognitive ability tests (extended with confidence ratings and a ‘submit answer for marking’ decision) were used to investigate the psychometric properties of these DPA variables. Internal consistency of the decision patterns ranged from good to excellent. Convergent validity was assessed via cognitive abilities, metacognitive confidence and a control criterion imposed on confidence that determines the decision to be made: the point of sufficient certainty. Personality variables were included to assess discriminant validity. As hypothesised, cognitive abilities showed positive correlations with competence and optimality. High confidence, low points of sufficient certainty and a greater discrepancy between them were associated with higher decisiveness and recklessness, and lower hesitancy. Personality measures showed mixed and generally weak correlations with the DPA variables. These convergent and discriminant results also held after controlling for all variables in regression. The results provide preliminary psychometric support for DPA as a general framework of behavioral decision making. DPA has the potential to be exploited in many contexts for uses that, to date, have been unachievable in a psychometrically valid manner. Copyright © 2015 John Wiley & Sons, Ltd.