Rate and temporal pattern of key pecking under autoshaping and omission schedules of reinforcement

The role of response-reinforcer contiguity on autoshaped key pecking in pigeons was studied by scheduling response-dependent nonreinforcement at the beginning or the end of brief (8-sec) discrete trials. Schedules that permitted chance conjunctions of key pecking and food sustained high rates of responding, whereas those that prevented the occurrence of key peck-food intervals shorter than 4 sec sustained low response rates. In addition, selective reinforcement schedules supported accelerating or decelerating rates of responding within individual trials. These effects were traceable to response-reinforcer (operant), but not stimulus-reinforcer (respondent) factors.     

Signalled free-operant avoidance of shock by pigeons pecking a key

Two pigeons were trained to peck a key under a free-operant avoidance schedule. Then, changes in key color signalled the beginning (safe period) and the end (warning period) of the response-shock interval, with a response required to change the key color. Finally, a change in key color signalled the warning period and either a response or a shock reinstated the safe stimulus. During signalled avoidance, response rate was higher during the warning stimulus than during the safe stimulus. More responding tended to occur in the warning stimulus when it was terminated by either a response or a shock than by only a response. In either procedure, response latency during the warning stimulus was a function of the duration of the warning stimulus. In general, response and shock rate were higher during unsignalled than during signalled avoidance. When the warning stimulus was brief, the results were similar to those of unsignalled avoidance. These results confirm previous findings with pigeons, are in general agreement with data provided by other species in studies of signalled avoidance, and thereby indicate the transituationality of the key-pecking operant.     

Choice, time allocation, and response rate during stimulus generalization

Six pigeons were trained to discriminate between two noise intensities using a procedure that assessed choice, time allocation, and response rate simultaneously and independently. Responses on the left or right key (R1 or R2) were respectively correct in the presence of two different intensities, S1 and S2. After a correct response, reinforcement became available for pecks on the center key. Reinforcement density for R1¦S1 relative to R2¦S2 was varied across experimental conditions. Generalization tests followed extensive training at each condition. As a function of stimulus intensity, proportions of initial choices of R2, of time spent in R2-initiated components, and of center-key responses emitted in R2-initiated components all yielded sigmoidal gradients of similar slope, which shifted slightly in location when relative reinforcement density changed. Changeovers were maximal where initial choice proportions approximated 0.5. Gradients relating the absolute number of center-key responses to stimulus intensity were also roughly sigmoidal, but were more sensitive to changes in reinforcement density. Gradients of momentary response rate also depended on reinforcement density. During training, large but transitory shifts in choice responding occurred when reinforcement density changed, while differences in momentary response rate developed slowly, suggesting separate control of choice and response rate by the contingencies of reinforcement.     

A comparison of the key-peck and treadle-press operants in the pigeon: differential-reinforcement-of-low-rate schedule of reinforcement

Key pecking and treadle pressing in pigeons were compared under concurrent (key-treadle) and single-operant differential-reinforcement-of-low-rate schedules of food reinforcement ranging from 5 to 60 sec (concurrent procedure) or 5 to 120 sec (single-operant procedure). Under both procedures, the two operants followed the same general law: decreasing response rate and reinforcement rate and increasing number of responses per reinforcement as a function of increasing schedule interval. High correlations were found between key pecking and treadle pressing for the measures of response rate, reinforcement rate, and responses per reinforcement. Regression equations allowed the prediction of treadle pressing from key pecking. More bursting occurred in responding to the key, and key pecking showed a more precise temporal discrimination than treadle pressing. A test for sequential dependencies between key and treadle responses showed significant dependencies not only under the concurrent procedure but also in data created artificially by merging key and treadle sequences from different pigeons under the concurrent procedure and from the same pigeon under the single-operant procedure. It seems likely that the sequential dependencies found were due to the independent action of the schedule on each operant and that behavioral dependencies did not occur with the concurrent training procedure. The key-peck operant does not appear to have any special qualities that preclude its use in discovering general laws of behavior, at least under the differential-reinforcement-of-low-rate schedule. The usefulness of the key peck in other situations requires direct experimental study.     

The stages of acquisition in stimulus fading

Pigeons were exposed to a stimulus fading procedure in which control of responding was transferred from red and black stimuli to lines of different angular orientation. After superimposing one line on the red stimulus and the other line on the black stimulus, the intensity of the lines was gradually increased and that of the red stimulus was gradually reduced. Probes consisting of red and line stimuli presented separately were used during the course of fading to assess control exerted by each element of the compound. As the lines were faded in, they did not acquire control of responding. As red was faded out, control of responding was acquired first by the lower intensity red stimuli in combination with the line stimulus, and finally by the angular orientation of the lines. Probes also determined the point at which the line stimuli, presented alone, would maintain a high degree of stimulus control. The results demonstrated that new stimuli in fading acquire dimensional control of responding in two sequential stages. Acquisition of stimulus control in fading was explained in terms of attenuation of stimulus blocking.     

Positive reinforcement and the elimination of reinforced responses

Key pecking was maintained on a fixed-interval schedule while either a differential-reinforcement-of-not-responding or a fixed-time schedule was imposed simultaneously. The lower the time parameter of the not-responding schedule, the lower was the response rate. Similar effects occurred with the fixed-time schedule, if the pigeons had experience with reinforcement for not responding. Otherwise the effects were less orderly, to the extent that rate could reach maximum with the lowest-valued fixed-time schedule. The not-responding and the response-independent schedules had similar effects on rate in experienced pigeons only when the time parameter or nominal frequency of food presentation was considered. When considered in terms of obtained frequency of food presentation, reinforcement of not responding produced larger decrements in rate than did the fixed-time schedule.     

Behavioral contrast as a function of the temporal location of reinforcement

Pigeons were trained on a multiple variable-interval variable-interval schedule of reinforcement. One component was then changed to a variation of a fixed-interval schedule in which the same rate of reinforcement was obtained as previously but the location of the reinforcer was fixed within the component. The effects of different temporal locations were compared. An increase in response rate for the unchanged variable-interval component (behavioral contrast) occurred when the reinforcer was located in the middle or at the end of the FI component, but response suppression occurred when it was located at the beginning of the component. The pattern of results cannot be explained by any previous theories of contrast. The overall response rates, and the pattern of local rates within the components, were consistent with the hypothesis that the major determinant of the contrast effect was the transition to a lower reinforcement rate following the unchanged component.     

Interactions in multiple schedules: the role of the stimulus-reinforcer contingency

In Experiments I and II, pigeons were exposed to single-key multiple schedules of response-independent and -dependent food presentation. Components were correlated with different keylights. When the rate of food presentation in the first component exceeded that in the second component, the local rate of key pecking was relatively high at onset of the first component. Overall rate in that component varied inversely with component duration and the rate of food presentation in the second component. When responding was maintained in the second component, the local rate of key pecking was relatively low at onset of that component. Overall rate in the second component varied directly with component duration and the rate of food presentation in that component. In Experiment III, pigeons were exposed to a two-key multiple schedule. Pecks on a constantly illuminated key produced food. Components were correlated with the color of a second key on which pecks had no scheduled consequences. The effects of component duration and rate of food presentation under the single-key response-dependent schedule were synthesized by combining response rates on each concurrently available key under the two-key procedure. The results support an account of multiple-schedule interactions in terms of the joint influence on responding of stimulus-reinforcer and response-reinforcer contingencies.     

Stimulus control of differential-reinforcement-of-low-rate responding

Five pigeons were given single-stimulus training on an 8-sec differential-reinforcement-of-low-rate schedule followed by steady-state generalization training using 12 wavelength stimuli. Three birds had a high percentage of reinforced responses on the training schedule and flat generalization gradients of total responses. The birds with fewer reinforced responses had much steeper generalization gradients. Generalization gradients plotted as a function of both stimulus wavelength and interresponse time showed that for most birds, stimulus control was restricted to responses with long interresponse times. Responses with very short interresponse times were not under stimulus control and there was some evidence of inhibitory control of short interresponse times. Interresponse-times-per-opportunity functions, plotted as a function of stimulus wavelength, showed that stimulus wavelength controlled the temporal distribution of responses, rather than the overall rate of response. The data indicate that the differential-reinforcement-of-low-rate schedule generates several response categories that are controlled in different ways by wavelength and time-correlated stimuli, and that averaging responses regardless of interresponse-time length obscures this control.     

物体颜色对情景记忆的影响

本研究采用ERP技术和学习-再认范式考察视觉输入的颜色和记忆中的物体颜色知识一致性对情景记忆编码和提取的影响。结果显示, 在对物体图片进行编码时颜色不一致图片诱发更大N400, 而提取阶段则对颜色一致图片有更多熟悉性加工(实验1); 物体名称能够更快激活典型颜色知识, 对颜色一致名称有更多细节回想(LPC更正) (实验2)。实验结果表明, 颜色一致促进知觉水平的记忆编码, 而阻碍语义水平编码。同时, 颜色一致促进物体图片提取(知觉水平)中的熟悉性和回想过程; 而对物体名称提取(概念水平)的促进作用仅表现在回想上。此外, 颜色与物体名称有着密切联系, 同样影响物体的语义表征, 支持激活-扩散模型理论。本研究从知觉和概念水平上为揭示物体颜色在联结记忆中的作用提供了证据。