Independence of stimulus discriminability from absolute rate of reinforcement in a signal-detection procedure.

Three experiments are reported in which two pigeons were trained to detect differences in stimulus duration under varying levels of absolute rate of reinforcement. Two red stimuli, differing in duration, were arranged probabilistically on the center key of a three-key chamber. On completion of the center-key duration, the center keylight was extinguished and the two side keys were illuminated white. Correct responses were left-key pecks following the shorter duration and right-key pecks following the longer duration. In Experiment 1, relative rate of reinforcement for correct responses was held constant and absolute rate of reinforcement was varied in seven conditions from continuous reinforcement to a variable-interval 90-second schedule. In Experiment 2, relative rate of reinforcement was manipulated across three different absolute rates of reinforcement (continuous reinforcement, variable-interval 15-second, and variable-interval 45-second). Stimulus discriminability was unaffected by changes in absolute or relative rates of reinforcement. Experiment 3 showed that discriminability was also unaffected by arranging the same consequences (three-second blackout) for unreinforced correct responses and errors.     

Independence of sensitivity to relative reinforcement rate and discriminability in signal detection.

Six pigeons were trained to detect differences between two white stimuli, S1 and S2, differing in duration and arranged probabilistically on the center key of a three-key chamber. Detection performance was measured at two levels of discriminability. At one level, S1 was five seconds and S2 was thirty seconds. At the other level, S1 was twenty seconds and S2 was thirty seconds. The procedure was a standard signal-detection yes-no design in which stimulus-presentation probability was varied from .1 to .9 at both discriminability levels. On completion of the center-key stimulus, a peck on the center key darkened the center-key light and turned on the two red side keys. A left-key response was "correct" on S1 trials, and a right-key response was "correct" on S2 trials. Correct responses produced food reinforcement on a variable-ratio 1.3 schedule. Incorrect responses produced three second blackout. Discriminability was higher for the five-second versus thirty-second conditions than for the twenty-second versus thirty-second conditions, but there were no differences in sensitivity of behavior to reinforcement variation for the two stimulus pairs. Response bias was a function of the relative reinforcement rate for correct choice responses.     

Reinforcer control and human signal-detection performance

Eight humans participated in a two-choice signal-detection task in which stimulus disparity was varied over four levels. Two procedures arranged asymmetrical numbers of reinforcers received for correct left- and right-key responses (the reinforcer ratio). The controlled procedure ensured that the obtained reinforcer ratio remained constant over changes in stimulus disparity, irrespective of subjects' performances. In the uncontrolled procedure, the asymmetrical reinforcer ratio could covary with subjects' performances. The receiver operating characteristic (ROC) patterns obtained from the controlled procedure approximated isobias functions predicted by criterion location measures of bias. The uncontrolled procedure produced variable ROC patterns that were somewhat like the isobias predictions made by likelihood ratio measures of bias; however, the obtained reinforcer ratio became more extreme as discriminability decreased. The obtained pattern of bias was directly related to the obtained reinforcer ratio. This research indicates that criterion location measures seem to be preferable indices of response bias.     

Reporting contingencies of reinforcement in concurrent schedules

Five pigeons were trained on concurrent variable-interval schedules in which two intensities of yellow light served as discriminative stimuli in a switching-key procedure. A conditional discrimination involving a simultaneous choice between red and green keys followed every reinforcer obtained from both alternatives. A response to the red side key was occasionally reinforced if the prior reinforcer had been obtained from the bright alternative, and a response to the green side key was occasionally reinforced if the prior reinforcer had been obtained from the dim alternative. Measures of the discriminability between the concurrent-schedule alternatives were obtained by varying the reinforcer ratio for correct red and correct green responses across conditions in two parts. Part 1 arranged equal rates of reinforcement in the concurrent schedule, and Part 2 provided a 9:1 concurrent-schedule reinforcer ratio. Part 3 arranged a 1:9 reinforcer ratio in the conditional discrimination, and the concurrent-schedule reinforcer ratio was varied across conditions. Varying the conditional discrimination reinforcer ratio did not affect response allocation in the concurrent schedule, but varying the concurrent-schedule reinforcer ratio did affect conditional discrimination performance. These effects were incompatible with a contingency-discriminability model of concurrent-schedule performance (Davison & Jenkins, 1985), which implies a constant discriminability parameter that is independent of the obtained reinforcer ratio. However, a more detailed analysis of conditional discrimination performance showed that the discriminability between the concurrent-schedule alternatives decreased with time since changing over to an alternative. This effect, combined with aspects of the temporal distribution of reinforcers obtained in the concurrent schedules, qualitatively predicted the molar results and identified the conditions that operate whenever contingency discriminability remains constant.     

Evaluating the effects of discriminability on behavioral persistence during and following time‐based reinforcement

With four children with autism we evaluated a refinement to time‐based reinforcement designed to reduce response persistence when we simultaneously introduced time‐based reinforcement and extinction. We further evaluated whether this refinement mitigated response recurrence when all reinforcer deliveries ceased during an extinction‐only disruptor phase. The refinement involved increasing the saliency of the contingency change from contingent reinforcement (during baseline) to time‐based reinforcement by delivering different colored reinforcers during time‐based reinforcement. Behavioral momentum theory predicts that increasing the discriminability of the change from variable‐interval to variable‐time reinforcement should lead to faster reductions in responding. We present data on four participants, three of whom displayed response patterns consistent with the predictions of behavioral momentum theory during time‐based reinforcement. However, the participants showed more varied patterns of recurrent behavior during extinction. We discuss these results within a translational research framework focusing on strategies used to mitigate treatment relapse for severe destructive behavior, as time‐based reinforcement is one of the most commonly prescribed interventions for destructive behavior displayed by individuals with intellectual and developmental disabilities.     

The effect of feature discriminability on the intertrial inhibition of focused attention

Identifying the shape of a colour oddball is faster when the distractor colour is viewed in the preceding target-absent trial and slower when the target colour is previewed, an intertrial effect known as the distractor previewing effect (DPE). We tested the effect of feature discriminability on the DPE. In Experiment 1, we determined the interitem discriminability of two colour pairs and two shape pairs. In Experiments 2 and 3, we measured DPEs with these set of target–distractor discriminability pairs. Our results showed that when the defining features allow for efficient parallel search, the a priori degree of interitem discriminability did not modulate the DPE. The results suggest the DPE does not arise as a strictly bottom-up modulation of saliency of the search-relevant features but reflects an attentional bias aimed at preventing attention from revisiting recently rejected “search features”. The underlying mechanism of this attentional bias is discussed.     

Delayed signal detection, differential reinforcement, and short-term memory in the pigeon.

In two discrete-trial delayed-detection experiments, six pigeons were trained on dependent concurrent variable-interval schedules. Pecking a red side key was reinforced when the brighter of two white lights (S1) had been presented on the center key, and pecking a green side key was reinforced when the duller of two white lights (S2) had been presented on the center key. Incorrect responses were red side-key pecks following S2 presentations and green side-key pecks following S1 presentations; these resulted in three-second blackouts. In Experiment 1, the time between presentation of S1 or S2 on the center key and the onset of the red and green side keys was varied nonsystematically from 0.06 seconds to 19.69 seconds across experimental conditions. Stimulus discriminability decreased as the stimulus-choice delay increased. A rectangular-hyperbolic function better described this decrease in discriminability over time than did a negative-exponential function. In Experiment 2, at each of three stimulus-choice delays (0.06, 3.85, and 10.36 seconds), relative reinforcer frequency for correct responses to the red and green side keys was varied by changing the values of the dependent concurrent variable-interval schedules. The sensitivity of choice to relative reinforcer frequency was independent of the decrease in stimulus discriminability with increasing stimulus-choice delay.     

Sample-stimulus discriminability and sensitivity to reinforcement in delayed matching to sample

Five pigeons were trained in a delayed matching-to-sample task with red and green stimuli. The retention interval between sample-stimulus presentation and the availability of the choice stimuli was varied between 0.01 s and 12 s within each session. The probability of food produced by correct-red and correct-green responses was varied across conditions. Sample-stimulus discriminability and response bias were measured at four different retention intervals. The results of these analyses showed an interaction between the discriminability of the sample stimuli and the control exerted by differential reinforcement. At longer retention intervals, sample discriminability decreased and sensitivity of choice behavior to changes in the red/green reinforcer ratio increased. An analogous relation has been reported in conditional discriminations in which the physical disparity of stimuli has been varied. This correspondence suggests that increasing the delay between presentation of one of two stimuli and an opportunity to respond discriminatively to it may be functionally similar to increasing the physical similarity of the two stimuli.