A molar theory of reinforcement schedules

Behavior of subjects exposed to concurrent and individual interval and ratio schedules of reinforcement may be described in terms of a set of expressions relating the value of responses to their durations, a feedback equation relating reinforcement to response duration, and the assumption that subjects allocate their time among various responses so as to maximize value.     

Delayed reinforcement of fixed-ratio performance without mediating exteroceptive conditioned reinforcement

The performance of pigeons was studied under conditions in which the completion of a fixed-ratio requirement was not contiguous with the presentation of a reinforcer. Timein and timeout periods alternated throughout the experimental sessions. Responses made by an experimental bird during the timein period were accumulated, and when a fixed-ratio requirement had been met, grain was presented to the experimental bird and a yoked control following their first response in the next timein period. Across most manipulations of the fixed-ratio requirement and of the duration of the timeout period, the response rates of the experimental birds were considerably higher than those of their controls, suggesting that the response-reinforcer dependency controlled the behavior of the experimental bird in the absence of a close temporal association between responding on the ratio schedule and reinforcer presentations.     

On the discriminability of stimulus duration.

The performance of pigeons trained to detect differences in the duration of stimuli was analysed using a matching model of signal detection. Two white stimuli, S1 and S2, differing in duration, were arranged with equal probability on the center key of a three-key chamber. S1 was systematically varied from 5 seconds to 25 seconds while S2 remained constant at 30 seconds. On completion of the center-key stimulus, a peck on the center key turned on the two red side keys. A left-key response was "correct" when S1 had been in effect on the center key and a right-key response was "correct" on S2 trials. A correct response produced a 3-second magazine light accompanied intermittently by food. Incorrect responses produced 3-second blackouts. Detection performance was measured under two procedures. In the first, the obtained reinforcement ratio was uncontrolled by allowing the number of food reinforcements obtained for correct left- and right-key responses to vary as the stimuli were changed. In the second procedure, the presentation of food reinforcement was controlled by holding the obtained reinforcement ratio constant. Discriminability changed as a function of stimulus differences under both procedures. No such trend was found in response bias.     

Alternative fixed-ratio fixed-interval schedules of reinforcement

Five rats were trained under alternative fixed-ratio fixed-interval schedules, in which food reinforcement was provided for the completion of either a fixed-ratio or a fixed-interval requirement, whichever was met first. Overall response rate and running rate (the rate of responding after the postreinforcement pause) decreased for all subjects as the fixed-ratio value increased. As the proportion of reinforcements obtained from the fixed-ratio component increased and the alternative schedule approached a simple fixed ratio, overall response rate and running rate both increased; conversely, as the proportion of reinforcements obtained from the fixed-interval component increased and the alternative schedule approached a simple fixed interval, response rates decreased. Postreinforcement pause length increased linearly as the average time between reinforcements increased, regardless of the schedule parameters. A break-run pattern of responding was predominant at low- and medium-valued fixed ratios. All subjects displayed at least occasional positively accelerated responding within interreinforcement intervals at higher fixed-ratio values.     

Effects of fixed-ratio sample and choice response requirements upon oddity matching

Three pigeons were trained on oddity matching in which either 1, 4, 8, 16, or 32 sample-key observing responses were required to turn off the sample stimuli and turn on the comparison stimuli. Oddity accuracy increased when the observing-response requirement was raised and decreased when the requirement was lowered. Next, while the observing requirement was maintained at one response, the number of responses required to the comparison stimuli was either 1, 4, 8, 16, or 32. Under these conditions, choice was defined as the comparison that first accumulated the required number of responses. In general, increasing the comparison-response requirement decreased accuracy and lowering the comparison requirement increased accuracy. The fixed-ratio observing requirements appeared to facilitate control by stimuli serving an instructional function.     

Demand for food on fixed-ratio schedules as a function of the quality of concurrently available reinforcement

Six rats lever pressed for food on concurrent fixed-ratio schedules, in a two-compartment chamber. In one compartment, mixed diet pellets were delivered on fixed-ratio schedules of 1, 6, 11, and 16; in the other, either no food was delivered, or sucrose or mixed diet pellets were delivered on fixed-ratio 8. The number of pellets obtained in the first compartment declined as a function of fixed-ratio size in that compartment in all three conditions, but the decline was greatest overall with mixed diet pellets concurrently available in the other compartment, and least with no food concurrently available. The result is discussed in terms of economic demand theory, and is consistent with the prediction that elasticity of demand for a commodity (defined in operant terms as the ratio of the proportionate change in number of reinforcements per session to the proportionate change in fixed-ratio size) is greater the more substitutable for that commodity are any concurrently available commodities.     

Effects of two teacher-presentation rates on off-task behavior, answering correctly, and participation

Off-task behavior, correct answering, and participation during beginning reading instruction were recorded for two low-achieving first-grade children during two different rates of teacher presentation. A slow-rate presentation (A) was compared with a fast-rate presentation (B) in an ABABAB design. In slow-rate presentation, there was a delay between the children's response and introduction of the next task. In fast-rate presentation, there was no delay. A new teacher taught during the final AB phases, which allowed for a brief replication. Both teachers were reminded on a fixed-interval 90-sec schedule throughout all phases of the experiment to praise the subjects, thus preventing a confounding of social praise and rate of teacher presentation. Fast-rate presentation was accompanied by a lower per cent occurrence of off-task behavior for both Subjects 1 and 2. For Subject 1, correct answering and participation were more frequent during all three fast-rate phases. For Subject 2, correct answering and participation were more frequent during the fast-rate phases after the first reversal.     

Producing a change from competition to sharing: effects of large and adjusting response requirements

Pairs of high-school students matched-to-sample for money. On each trial, the first pair member to complete a fixed ratio of knob-pulling responses could work the matching problem on that trial. Competition occurred when both pair members responded for the problem. Sharing occurred when only one pair member responded on each trial, and the subjects alternated trials. Hence, sharing requires less responding and still allows a moderate number of reinforcers for each subject. Recent research has shown that increasing the response requirement to the point that it may have aversive properties will produce a change from competition to sharing. A related variable is an adjusting schedule that adjusts the subjects' response requirements so that their abilities to take reinforcers are equal. In this way, subjects might learn that competition requires more responding but produces no more reinforcers. However, recent research also suggests that competition decreases over sessions without experimental manipulations. Because of this possibility of a time-related variable, ratio size and an adjusting schedule were studied in a group design. Competition did decrease for all groups over sessions, but the large-ratio groups switched from competition to sharing sooner than the low-ratio groups. The adjusting schedule had a similar but smaller effect.     

Stopping rules for multi-category computerized classification testing

Computerized classification testing (CCT) aims to classify persons into one of two or more possible categories to make decisions such as mastery/non-mastery or meet most/meet all/exceed. A defining feature of CCT is its stopping criterion: the test terminates when there is enough confidence to make a decision. There is abundant research on CCT with a single cut-off, and two common stopping criteria are the sequential probability ratio test (SPRT) statistic and the generalized likelihood ratio statistic (GLR). However, there is a relative scarcity of research extending the SPRT to the multi-hypothesis case for when there is more than one cut-off. In this paper, we propose a new multi-category GLR (mGLR) statistic as well as a stochastically curtailed version of the CCT with three or more categories. A simulation study was conducted to show that the mGLR statistic outperformed the existing stopping rules by generating shorter average test length without sacrificing classification accuracy. Results also revealed that the stochastically curtailed mGLR successfully increased test efficiency in certain testing conditions.     

激活水平和呈现方式对错误记忆的影响

随机抽取80名大学生参与实验,采用DRM(Deese-Roediger-Mcdermott)范式,探讨了激活水平和呈现方式对错误记忆的影响。结果发现:(1)在随机呈现条件下,关键诱饵的错误再认率显著低于分组呈现条件,但学过项目的正确再认率在两种条件下无差异。(2)在高激活水平条件下,学过项目的正确再认率明显低于低激活水平条件,但关键诱饵的错误再认率在两种激活条件下的差异不够明显。这表明,呈现方式对关键诱饵的错误再认率有显著影响,而激活水平的影响则不显著。由此可知,人们的记忆可以在没有任何外界信息干扰的情况下因内在联想过程而自发地发生改变。