Delayed signal detection, differential reinforcement, and short-term memory in the pigeon.

In two discrete-trial delayed-detection experiments, six pigeons were trained on dependent concurrent variable-interval schedules. Pecking a red side key was reinforced when the brighter of two white lights (S1) had been presented on the center key, and pecking a green side key was reinforced when the duller of two white lights (S2) had been presented on the center key. Incorrect responses were red side-key pecks following S2 presentations and green side-key pecks following S1 presentations; these resulted in three-second blackouts. In Experiment 1, the time between presentation of S1 or S2 on the center key and the onset of the red and green side keys was varied nonsystematically from 0.06 seconds to 19.69 seconds across experimental conditions. Stimulus discriminability decreased as the stimulus-choice delay increased. A rectangular-hyperbolic function better described this decrease in discriminability over time than did a negative-exponential function. In Experiment 2, at each of three stimulus-choice delays (0.06, 3.85, and 10.36 seconds), relative reinforcer frequency for correct responses to the red and green side keys was varied by changing the values of the dependent concurrent variable-interval schedules. The sensitivity of choice to relative reinforcer frequency was independent of the decrease in stimulus discriminability with increasing stimulus-choice delay.     

Effects of relative reinforcer frequency on complex color detection

Pigeons were trained under a discrete-trials detection procedure in which one of a set of color stimuli was presented on the center key and a single response turned off the stimulus and illuminated two side keys. Single responses to one or the other side key produced occasional reinforcers depending on the value of the color stimulus. In Experiment 1, one color-stimulus set comprised 559, 564, 569, and 574 nm, and right-key pecks were occasionally reinforced following presentations of members of this set. The other stimulus set comprised 579, 584, 589, and 594 nm, and left-key pecks were occasionally reinforced following presentations of members of this set. Across seven experimental conditions, the left/(left + right) relative reinforcer frequency was varied from .1 to .9. In Experiment 2, one stimulus set contained only one member, 574 nm, and right-key responses were occasionally reinforced following its presentation. Over 12 experimental conditions, two manipulations were carried out. First, the number of stimuli comprising the other stimulus set was increased from one (579 nm) to two (579 and 584 nm) to three (579, 584, and 589 nm) and to four (579, 584, 589, and 594 nm), and left-key responses were reinforced occasionally following center-key presentations of members of this set. Second, for each stimulus combination, the left/(left + right) relative reinforcer frequency was varied from .1 to .5 to .9 across three experimental conditions. The principal finding of Experiments 1 and 2 was that reinforcers and stimuli interacted in their effects on behavior. In Experiment 3, pairs of adjacent stimuli (5 nm apart) in the range 559 to 594 nm were presented in each experimental condition, and the left/(left + right) relative reinforcer frequency was held constant at .5. The data from all three experiments were analyzed according to a detection model describing performance in multiple-stimulus two-response procedures. This model provided independent measures of stimulus discriminability, contingency discriminability, and bias. The analysis showed that (a) consistent with the color-naming function, pigeons were better able to discriminate between higher nanometer values than lower nanometer values; (b) their ability to discriminate between the stimuli was independent of the number of wavelengths comprising each stimulus set; (c) they allocated delivered reinforcers very accurately to the previously emitted response; and (d) no consistent biases emerged.     

Reporting contingencies of reinforcement in concurrent schedules

Five pigeons were trained on concurrent variable-interval schedules in which two intensities of yellow light served as discriminative stimuli in a switching-key procedure. A conditional discrimination involving a simultaneous choice between red and green keys followed every reinforcer obtained from both alternatives. A response to the red side key was occasionally reinforced if the prior reinforcer had been obtained from the bright alternative, and a response to the green side key was occasionally reinforced if the prior reinforcer had been obtained from the dim alternative. Measures of the discriminability between the concurrent-schedule alternatives were obtained by varying the reinforcer ratio for correct red and correct green responses across conditions in two parts. Part 1 arranged equal rates of reinforcement in the concurrent schedule, and Part 2 provided a 9:1 concurrent-schedule reinforcer ratio. Part 3 arranged a 1:9 reinforcer ratio in the conditional discrimination, and the concurrent-schedule reinforcer ratio was varied across conditions. Varying the conditional discrimination reinforcer ratio did not affect response allocation in the concurrent schedule, but varying the concurrent-schedule reinforcer ratio did affect conditional discrimination performance. These effects were incompatible with a contingency-discriminability model of concurrent-schedule performance (Davison & Jenkins, 1985), which implies a constant discriminability parameter that is independent of the obtained reinforcer ratio. However, a more detailed analysis of conditional discrimination performance showed that the discriminability between the concurrent-schedule alternatives decreased with time since changing over to an alternative. This effect, combined with aspects of the temporal distribution of reinforcers obtained in the concurrent schedules, qualitatively predicted the molar results and identified the conditions that operate whenever contingency discriminability remains constant.     

Transfer of pigeons' matching to sample to novel sample locations

This study examined the conditions under which conditional stimulus control by the sample stimuli in three-key matching-to-sample paradigms would generalize across the different possible sample locations. In Experiments 1 and 2, the samples appeared on the left and right side keys during initial training and then on the center key during testing. Transfer of pigeons' matching performances to the center-key samples was evident after both identity and symbolic matching training. In Experiment 3, pigeons trained on symbolic matching with two side-key samples or with a side-key and a center-key sample generally transferred their learned matching performances to those samples when they subsequently appeared in the remaining (novel) location. These results indicate that, when two-choice conditional discriminations are learned with more than one sample location, the visual characteristics of the sample per se predominantly come to control the pigeons' comparison choices. This finding encourages the use of the multiple-location training procedure as a way of reducing control by location, thus providing a more discriminating test of symmetry in animals.     

Fixed-ratio discrimination: effects of intermittent reinforcement

Four pigeons had discrimination training that required the choice of a left side-key after completing a fixed-ratio 10 on the center key, and a right side-key choice after fixed-ratio 20. Correct choices were reinforced on various fixed-interval, fixed-ratio, random-interval, and random-ratio schedules. When performance was examined across successive 15-second intervals (fixed-interval and fixed-ratio schedules) accuracy was high in the first 15-second interval, decreased in one or several of the next 15-second intervals, and then increased again as reinforcement was approached. When performance was examined across correct trials on fixed-interval and fixed-ratio schedules, accuracy was lowest immediately after reinforcement, followed by a systematic increase in accuracy as the number of correct choices increased. These patterns were due primarily to errors on fixed-ratio 20 trials. Systematic accuracy patterns did not occur on random-interval or random-ratio schedules. The results indicate that when choice patterns differed on fixed-interval and fixed-ratio schedules, the differences were due to the method of data analysis.     

Delayed reinforcement and delayed choice in symbolic matching to sample: Effects on stimulus discriminability

Six pigeons were trained to peck a red side key when the brighter of two white lights (S₁) had been presented on the center key, and to peck a green side key when the dimmer of two white lights (S₂) had been presented on the center key. Equal frequencies of reinforcers were provided for the two types of correct choice. Incorrect choices, red side-key pecks following S₂ presentations and green side-key pecks following S₁ presentations, resulted in blackout. With 0-s delay between choice and reinforcement, the delay between sample presentation and choice was varied from 0 to 20 s. Then, with 0-s delay between sample presentation and choice, the delay between choice and reinforcement was varied from 0 to 20 s. Both types of delay resulted in decreased discriminability (defined in terms of a signal-detection analysis) of the center-key stimuli, but delayed choice had more effect on discriminability than did delayed reinforcement. These data are consistent with the view that the two kinds of delay operate differently. The effect of a sample-choice delay may result from a degradation of the conditional discriminative stimuli during the delay; the effect of a choice-reinforcer delay may result from a decrement in control by differential reinforcement.     

Response-rate invariance in concurrent schedules: effects of different changeover contingencies

In a two-key chamber, one key (the food key) was either red or green with different variable-interval schedules operating concurrently in each color and a second key (the changeover key) served to change the food-key color. Three pigeons were trained with either a 2-sec changeover delay or a 0-sec changeover delay and three birds with a fixed-ratio 2 on the changeover key instead of a changeover delay. The proportion of time spent in red approximated the proportion of reinforcers delivered in red for all birds. When the procedure was changed so that reinforcers were signalled in the green schedule, rates of reinforcement were unaltered, but the pigeons spent virtually the whole session in red. Changeovers to green were allowed only when a reinforcer was assigned by the schedule associated with green. For all pigeons with the fixed–ratio requirement on the changeover key or with a 0-sec changeover delay, the overall rate of red-key responses was higher during the signalling condition than during unsignalled, or baseline, condition. The present data question the generality of previous reports that the rate of one response is independent of the amount of time allocated to the alternative response.     

On the effects of signaling reinforcer probability and magnitude in delayed matching to sample

Two experiments examined whether postsample signals of reinforcer probability or magnitude affected the accuracy of delayed matching to sample in pigeons. On each trial, red or green choice responses that matched red or green stimuli seen shortly before a variable retention interval were reinforced with wheat access. In Experiment 1, the reinforcer probability was either 0.2 or 1.0 for both red and green responses. Reinforcer probability was signaled by line or cross symbols that appeared after the sample had been presented. In Experiment 2, all correct responses were reinforced, and the signaled reinforcer durations were 1.0 s and 4.5 s. Matching was more accurate when larger or more probable reinforcers were signaled, independently of retention interval duration. Because signals were presented postsample, the effects were not the result of differential attention to the sample.     

Human symbolic matching-to-sample performance: Effects of reinforcer and sample-stimulus probabilities

Four experiments, each with 6 human subjects, varied the distribution of reinforcers for correct responses and the probability of sample-stimulus presentation in symbolic matching-to-sample procedures. Experiment 1 held the sample-stimulus probability constant and varied the ratio of reinforcers obtained for correct responses on the two alternatives across conditions. There was a positive relation between measures of response bias and the ratio of reinforcers. Experiment 2 held the ratio of reinforcers constant and varied the sample-stimulus probability across conditions. Unlike previous studies that used pigeons as subjects, there was a negative relation between bias and the ratio of sample-stimulus presentations. In Experiment 3, the sample-stimulus probability and the reinforcer ratio covaried across conditions. Response bias did not vary systematically across conditions. In Experiments 1 to 3, correct responses were reinforced intermittently. Experiment 4 used the same procedure as Experiment 3, but all correct responses now produced some scheduled consequence. There was a positive relation between response bias and the ratio of reinforcers. The results suggest that human performance in these tasks was controlled by both the relative frequency of reinforced responses and the relative frequency of nonreinforced responses.     

Fixed-ratio discrimination: effects of response-produced blackouts

For three pigeons, reinforcement depended upon a left side-key response after execution of a fixed ratio 10 on the center key, and upon a right side-key response after fixed ratio 20. Each response during the fixed ratios produced a 0.5-sec blackout. The time between the first and last response in fixed ratio 10 was then equated with the time between the first and last response in fixed ratio 20 by increasing the blackout duration. The accuracy of side-key choice was disrupted, thereby suggesting that time, rather than number of responses, controlled choice responding. When the time between the first and last response was equated during both ratios, asymptotic accuracy was approximately equal to (two birds) or somewhat higher than (one bird) that obtained previously. The results of probes with intermediate fixed ratios and blackouts suggested that control of side-key choice had transferred from the time between the first and last response in ratios to blackout duration.     

On the measurement of time allocation on multiple variable-interval schedules

Six pigeons were trained on a modified multiple-schedule procedure. In a three-key chamber, the center key was lighted red or green, depending upon which component schedule was in effect. A response on this key transferred this color to each of two side keys, and responses on one of those keys produced reinforcers according to the component schedule. After 2 s, the side-key lights were extinguished, the center key was reilluminated, and a further center-key response was required to give access, as before, to the component schedules. Components alternated every 3 min. This limited-access procedure allowed both times spent switched into the side keys and time spent not switched in to be measured in the two components. Component reinforcer rates were varied over eight experimental conditions. Both component response rate and component time allocation were increasing functions of relative component reinforcer rate, and these functions were not significantly different. This finding implies that local response rates (responses divided by time switched in) were unaffected by changing component reinforcer rates on multiple schedules. Because a similar result was recently obtained for concurrent schedules, models of multiple and concurrent-schedule performance may need to consider only the time allocation of behavior emitted at equal tempo in the component schedules.     

Autoshaped responding: A baseline for studying stimulus preference

In an autoshaping procedure with pigeons, trials consisted of the illumination of two keys, each with a different color, and then a response-independent feeder operation. Over successive conditions, all key-color pairs were arranged from the set of amber, red, green, and blue lamps. During sessions with a given pair, the left-right configuration of the colors varied irregularly, and the two colors alternated in illuminating the feeder. With one red and one green key, for example, red appeared sometimes on the left and sometimes on the right, and the feeder was alternately lit red or green on successive trials. Both total pecks and proportion of trials with at least one peck on a key of a given color were generally greater for red and amber than for green and blue, and relations among preferences were generally transitive across different color pairs. Repeating the procedure with decreased red and amber intensities and increased green and blue intensities reduced red and amber pecking relative to green and blue pecking, implying that differences in responding were determined more strongly by intensive than by chromatic properties of the stimuli.     

Control by sample location in pigeons'' matching to sample.

Three experiments assessed the impact of sample location in pigeons' matching to sample. Experiments 1 and 2 demonstrated that after line or hue identity matching was acquired to high levels of accuracy with center-key samples, varying sample location across the three keys disrupted performances. The drop in accuracy occurred following both zero-delay and simultaneous training and was mostly confined to trials in which the sample appeared on a side key. Experiment 3 attempted to diminish control by location by training birds to match samples that could appear in any location prior to center-key sample training and moving-sample testing with another set of stimuli. In testing, all birds performed accurately on center-sample trials and on side-key sample trials in which the matching choice appeared on the center key. Accuracy was below chance, however, on side-key sample trials in which the matching choice appeared on the other side key. One implication of the persistent control by sample location in the three-key paradigm is that it precludes the possibility of symmetry because symmetry tests require a change in the locations at which samples and comparisons appear.     

The emergence of symmetry in a conditional discrimination task using different responses as propioceptive samples in pigeons

In Experiment 1, 10 pigeons were exposed to a successive symbolic matching-to-sample procedure in which the sample was generated by the pigeons' own behavior. Each trial began with both response keys illuminated white, one being the "correct" key and the other the "incorrect" key. The pigeons had no way of discriminating which key was correct and which incorrect, since these roles were assigned on a random basis with the same probability of 0.5 for each key. A fixed ratio of five responses was required on the correct key. However, each time the pigeon pecked the incorrect key, the correct key response counter reset. Five consecutive pecks on the correct key was the only way to end this component, and switch off both key lights. Two seconds later, these same keys were illuminated again, one green and the other red (comparison stimuli). Now, if the correct white key had been on the left, a peck at one color produced food, and if the correct white key had been on the right, a peck at the other color produced food. When the pigeons had learned this discrimination, they were exposed to several symmetry tests (simultaneous presentations of both keys illuminated the same color-i.e., both red or both green), in order to interchange the sample with the comparison stimuli. In Experiment 2, the importance of requiring discrimination between the samples and between the comparisons was analyzed. In Experiment 3, we compared the results of Experiment 1 with a slightly different experiment, which resulted in discrimination of key position, an exteroceptive stimulus. The results showed that symmetry emerged only when different responses were used as samples.     

Latencies to name one of three stimulus dimensions: A study of probability effects and dimension integrality

Following each of 400 stimuli that varied according to three binary dimensions (location, color, and shape), subjects named the value of one particular dimension as quickly as possible. Each stimulus appeared on the “left” and “right” side of a screen (location dimension), and was a “red” or “green” triangle (color dimension) with apex oriented “up” or “down” (shape dimension). The alternatives of each dimension varied according to different probability distributions (90/10, 70/30, or 50/50), and three schedule conditions were contrived so that each distribution occurred once for each dimension. Nine groups of 10 subjects each defined the factorial of 3 (response conditions: identify location, color, or shape) by 3 (schedule conditions: 90 left/70 red/50 down, 70 left/50 red/90 down, or 50 left/90 red/70 down). Latencies to identify the shape dimension were influenced reliably by the probabilities of both response-relevant and response-irrelevant stimuli. Shape probabilities did not affect latencies to identify location of color, but these latencies were significantly influenced by both color and location probabilities. Results are discussed with reference to the locus of the stimulus probability effect and dimensional integrality.     

Choice with probabilistic reinforcement: effects of delay and conditioned reinforcers.

Two experiments measured pigeons' choices between probabilistic reinforcers and certain but delayed reinforcers. In Experiment 1, a peck on a red key led to a 5-s delay and then a possible reinforcer (with a probability of .2). A peck on a green key led to a certain reinforcer after an adjusting delay. This delay was adjusted over trials so as to estimate an indifference point, or a duration at which the two alternatives were chosen about equally often. In all conditions, red houselights were present during the 5-s delay on reinforced trials with the probabilistic alternative, but the houselight colors on nonreinforced trials differed across conditions. Subjects showed a stronger preference for the probabilistic alternative when the houselights were a different color (white or blue) during the delay on nonreinforced trials than when they were red on both reinforced and nonreinforced trials. These results supported the hypothesis that the value or effectiveness of a probabilistic reinforcer is inversely related to the cumulative time per reinforcer spent in the presence of stimuli associated with the probabilistic alternative. Experiment 2 tested some quantitative versions of this hypothesis by varying the delay for the probabilistic alternative (either 0 s or 2 s) and the probability of reinforcement (from .1 to 1.0). The results were best described by an equation that took into account both the cumulative durations of stimuli associated with the probabilistic reinforcer and the variability in these durations from one reinforcer to the next.     

Delayed matching-to-sample performance: Effects of relative reinforcer frequency and of signaled versus unsignaled reinforcer magnitudes

Six pigeons were trained on a delayed red-green matching-to-sample task that arranged four delays within sessions. Matching responses intermittently produced either 1.5-s access to food or 4.5-s access to food, and nonmatching responses produced either 1.5-s or 4.5-s blackout. Two phases were conducted: a signaled phase in which the reinforcer magnitudes (small and large) were signaled by houselights (positioned either on the left or right of the chamber), and an unsignaled phase in which there was no correlation between reinforcer magnitude and houselight position. In both phases, the relative frequency with which red and green matching responses produced food was varied across five values. Both matching accuracy and the sensitivity of performance to the distribution of reinforcers for matching responses decreased with increasing delays in both phases. In addition, accuracy and reinforcer sensitivity were significantly lower on signaled small-reinforcer trials compared with accuracy and sensitivity values on signaled large-reinforcer trials and on both types of unsignaled trials. These results are discussed in the context of research on both nonhuman animal and human memory.     

Reinforcement contingencies and signal detection.

Pigeons were trained to discriminate temporal stimuli in a discrete-trial signal-detection procedure. Pecks to one side key were reinforced intermittently after exposure to one duration, and pecks to the other side key were reinforced intermittently after exposure to a different duration. In Experiment I, the allocation of reinforcers was varied systematically for correct responses and for errors, using a procedure that controlled the obtained numbers of reinforcers. When reinforcers were allocated symmetrically, the level of discrimination decreased as the proportion of reinforcers for errors increased. When reinforcers were allocated asymmetrically, the decrease in discrimination was less systematic. Bias toward one or the other side key roughly matched the ratio of reinforcers obtained by pecks at those keys, independent of the level of discrimination. In Experiment II, the overall rate of reinforcement for correct responses was varied both within and between experimental conditions. The level of discrimination was positively related to the overall rate of reinforcement. The discrimination data of both experiments were interpreted in relation to the contingencies of reinforcement and nonreinforcement, characterized by the average difference in reinforcement probability for correct responses and errors.     

Effect of compatibility of S-R mapping on reactions toward the stimulus source

This research was concerned with separating the effects of three varieties of S-R compatibility: reactions toward the stimulus source, compatibility of S-R mapping, and display-control arrangement correspondence. In experiments 1 and 2, subjects pressed a green or red key located on the left and right in response to the onset of a green or red stimulus presented in a left or right window. Half of the subjects pressed the key which corresponded to the color of the stimulus (compatible S-R mapping) while the other half pressed the alternate colored key (incompatible S-R mapping). In the compatible mapping task, reactions were faster when location of stimulus and response corresponded than when they did not while, in the incompatible task, reactions were faster when location of stimulus and response did not correspond. This apparent reversal in the tendency to react toward the stimulus source was attributed to display- control arrangement correspondence rather than to logical recoding of the directional cue. Experiment 3 established that faster reactions toward the stimulus source occured only under compatible mapping instructions.     

特征和位置信息在价值驱动注意捕获中的作用

本研究采用训练−测试范式考察颜色和位置信息在价值驱动注意捕获中的作用。实验1考察是否存在基于具体位置的价值驱动的注意捕获效应。在训练阶段, 被试对8个位置中两个位置出现的红色目标反应伴随着高奖励反馈, 而对另外两个位置出现的红色目标反应伴随着低奖励反馈, 其它4个位置为中性位置, 没有目标出现。在测试阶段, 一半试次中红色刺激作为分心物出现。结果发现, 只有当分心刺激出现在高奖励位置和两个高奖励位置之间的中性位置时才能够捕获注意; 实验2考察颜色和位置信息在价值驱动注意捕获中的交互作用。在训练阶段, 将颜色特征和位置信息联合起来进行学习。在测试阶段, 和高、低奖励相联结的颜色刺激各在1/3试次中作为分心物出现。结果发现, 只有当高奖励颜色出现在高奖励位置或出现在高奖励位置之间的中性位置时才能够捕获注意。研究结果表明：(1)位置联结的价值驱动的注意捕获效应能够泛化到特定邻近位置上; (2)个体在训练阶段将颜色和位置的联合特征与奖励建立联结, 训练阶段建立的联结不能泛化到部分特征上。价值驱动注意捕获效应的泛化具有选择性。