Influence of the schedule of outcome presentation on causality judgements

Experiments examined the effect of various relationships between a response (pressing the space bar of a computer) and an outcome (a triangle flashing on a screen) on judgements of the causal effectiveness of the response. As the mean number of responses required per outcome on a variable-ratio (VR) schedule (Experiment 1) or the mean temporal interval on a variableinterval (VI) schedule (Experiment 2) increased, ratings of causal effectiveness of that response decreased. In Experiment 3, yoking procedures matched either the number of responses required per outcome or the temporal distributions of outcomes on a VI and a VR schedule, and responses on the VI schedule were rated more causally effective. In Experiment 4, the overall feedback function on a tandem VI VR and a tandem VR VI schedule was matched, and responses performed on the tandem VR VI schedule were rated as more causally effective.     

Schedules of reinforcement as determinants of human causality judgments and response rates

Experiments examined the effect of relationships between a response and an outcome on human judgments of causal effectiveness. In Experiment 1, the time between outcomes obtained on a variable ratio (VR) schedule became the intervals for a yoked variable interval (VI) schedule. Response rates were higher on the VR than on the VI schedule. In Experiment 2, the number of responses required per outcome on a VR schedule were matched to that on a master VI 20-s schedule. Both ratings of causal effectiveness and response rates were higher in the VR schedule. In Experiment 3, tandem VI fixed-ratio (FR) schedules produced higher rates and judgments than equivalent conjunctive VI FR schedule. In Experiment 4, a VI schedule with a reinforcement requirement for a short interresponse time (IRT) produced higher rates and judgments than a simple VI schedule. These results corroborate the view that schedules are a determinant of both response rates and causal judgments. Few current theories of causal judgment predict this pattern of results.     

Free-operant performance on variable interval schedules with a linear feedback loop: no evidence for molar sensitivities in rats

Four experiments examined rats' sensitivity to molar and molecular factors on instrumental schedules of reinforcement. Rats were exposed to a variable interval schedule with a positive feedback loop (VI+), such that faster responding led to a shorter interreinforcement interval. In Experiments 1 and 2, rats responded faster on a variable response (VR) schedule than on either a VI schedule matched for reinforcement rate or a VI+ schedule matched for the feedback function. In Experiment 3, rats responded no differently on a VI schedule than they did on a VI+ schedule with equated rates of reinforcement. In Experiment 4, rats responded faster on a VI+ schedule with an interresponse time requirement yoked to that experienced on a VR schedule, than on a VI+ schedule with the same feedback function as the VR schedule. Taken together these results suggest that rats are more sensitive to the molecular than the molar properties of the schedules.     

The schedule dependency of the signaled reinforcement effect

In Experiment 1, rats leverpressed for food reinforcement on either a variable ratio (VR) 30 schedule or a variable interval (VI) 15-s schedule. One group in each condition received a signal filling a 500-ms delay of reinforcement. This treatment enhanced rates on the VR schedule, and attenuated rates on the VI schedule, relative to the rate seen in an unsignaled control condition. In Experiment 2 there was no delay of reinforcement and the signal and food were presented simultaneously. Attenuated rates of responding were observed on VI schedules with a range of mean interval values (15 to 300 s). Experiment 3 used a range of VR schedules (10 to 150) with simultaneous presentations of signal and food. A signal-induced enhancement of response rate was found at all VR values. In Experiment 4, a signal elevated response rates on a tandem VI VR schedule, but depressed rates on a tandem VR VI schedule, compared to control conditions receiving unsignaled delayed reinforcement. These results are taken to show that the effect of a signal accompanying reinforcement depends upon the nature of the behavior that is reinforced during exposure to a given schedule.     

Rats' performance on variable-interval schedules with a linear feedback loop between response rate and reinforcement rate

Three experiments investigated whether rats are sensitive to the molar properties of a variable-interval (VI) schedule with a positive relation between response rate and reinforcement rate (i.e., a VI+ schedule). In Experiment 1, rats responded faster on a variable ratio (VR) schedule than on a VI+ schedule with an equivalent feedback function. Reinforced interresponse times (IRTs) were shorter on the VR as compared to the VI+ schedule. In Experiments 2 and 3, there was no systematic difference in response rates maintained by a VI+ schedule and a VI schedule yoked in terms of reinforcement rate. This was found both when the yoking procedure was between-subject (Experiment 2) and within-subject (Experiment 3). Mean reinforced IRTs were similar on both the VI+ and yoked VI schedules, but these values were more variable on the VI+ schedule. These results provided no evidence that rats are sensitive to the feedback function relating response rate to reinforcement rate on a VI+ schedule.     

Instrumental performance on negative schedules

Three experiments examined the performance of rats pressing a lever for food reinforcement on a schedule in which high rates of response resulted in lowered rates of reinforcement (i.e. a schedule with a negative component). In Experiment 1, rats responded on a variable interval (VI) schedule with a conjoint component such that every 30 responses a reinforcement programmed by the VI schedule was cancelled. These subjects generally emitted a lower response rate than rats responding on a VI schedule yoked to the former subjects with respect to the delivery of reinforcement, although response rate differences were sometimes not large. Similar response-rate effects were obtained in Experiment 2 using a within-subject yoking procedure. In Experiment 3, reinforced interresponse times were matched on negative and VI schedules yoked in terms of reinforcement rate, and the response rate emitted in these conditions were similar. These results give support to theories of instrumental conditioning that stress the strengthening and shaping properties of reinforcement.     

Response rate and sensitivity to the molar feedback function relating response and reinforcement rate on VI+ schedules of reinforcement

In 5 experiments, the author examined rats' sensitivity to the molar feedback function relating response rate to reinforcement rate on schedules of reinforcement. These studies demonstrated that, at lower rates of responding, rats' performance on variable ratio (VR), variable interval (VI), and variable interval with linear feedback loop (VI+) schedules was determined largely by reinforcement of interresponse times; response rates were faster on VR than on both VI and VI+ schedules. In contrast, when procedures were adopted to maintain high rates of response, rats showed sensitivity to the molar characteristics of the schedules; they responded as fast on a VI+ schedule as on a VR schedule and faster on both of these schedules than on a yoked VI schedule. When the variance of response rate was manipulated, this factor was noted as an important element in determining sensitivity to the molar characteristics of the schedule.     

Human sensitivity to reinforcement feedback functions

Two experiments investigated human sensitivity to the temporally extended aspects of reinforcement schedules. Experiment 1 investigated human sensitivity to the extended and local aspects of three reinforcement schedules: variable ratio (VR), variable interval (VI), and variable-interval-plus-linear-feedback (VI+) schedules. Experiment 2 investigated this sensitivity on two reinforcement schedules: VI and VI+ schedules. In both experiments, there was evidence of sensitivity to the temporally extended aspects of the schedule: There were differences between the response rate on the VI+ and yoked-VI schedules, but no statistical difference in rates of response between the VR and VI+ schedules. The VI+ versus VI difference was much more pronounced when a lower response force needed to depress a lever was used. These results suggest that human subjects do show some sensitivity to temporally extended aspects of schedules of reinforcement.     

More on concurrent interval-ratio schedules: a replication and review.

It has been suggested that the failure to maximize reinforcement on concurrent variable-interval, variable-ratio schedules may be misleading. Inasmuch as response costs are not directly measured, it is possible that subjects are optimally balancing the benefits of reinforcement against the costs of responding. To evaluate this hypothesis, pigeons were tested in a procedure in which interval and ratio schedules had equal response costs. On a concurrent variable time (VT), variable ratio-time (VRT) schedule, the VT schedule runs throughout the session and the VRT schedule is controlled by responses to a changeover key that switches from one schedule to the other. Reinforcement is presented independent of response. This schedule retains the essential features of concurrent VI VR, but eliminates differential response costs for the two alternatives. It therefore also eliminates at least one significant ambiguity about the reinforcement maximizing performance. Pigeons did not maximize rate of reinforcement on this procedure. Instead, their times spent on the alternative schedules matched the relative rates of reinforcement, even when schedule parameters were such that matching earned the lowest possible overall rate of reinforcement. It was further shown that the observed matching was not a procedural artifact arising from the constraints built into the schedule.     

The role of response force on the persistence and structure of behavior during extinction

Behavior Momentum Theory has emerged as a prominent account of resistance to change in both basic and applied research. Although laboratory studies often define precise, repeatable responses, application research often deals with response classes that may vary widely along a number of dimensions. In general, Behavior Momentum Theory has not addressed how response dimensions impact resistance to change, providing an opportunity to expand the model in new directions. Four rats pressed a force transducer under a multiple variable interval (VI) 60‐s VI 60‐s schedule of reinforcement. In one component, responses satisfied the schedule only if the response force fell within a “low” force band requirement; responses in the other schedule were required to satisfy a “high” force band. Once responding stabilized, extinction was programmed for three sessions. Then, the procedures were replicated. The results showed that response force came under discriminative control, but force requirements had no impact on resistance to extinction. In a follow‐up condition, the schedule was changed to a multiple VI 30‐s VI 120‐s schedule and the low‐force band operated in both components. The results showed that behavior maintained by the VI 30‐s schedule was generally more resistant to extinction. A secondary analysis showed that force distributions created under baseline maintained during extinction. Overall, the results suggest that differential response force requirements prevailing in steady state do not affect the course of extinction.     

Effect of local context of responding on human judgment of causality

Two experiments examined the effect of various relationships between a response (pressing the space bar of a computer) and an outcome (a triangle flashing on a screen) on judgments of the causal effectiveness of the response. In Experiment 1, when responses were required to be temporarily isolated from each other prior to an outcome, ratings of the causal effectiveness of the responses were higher than in a condition in which the probability of an outcome following a response was the same but in which no temporal isolation was required. In Experiment 2, when a number of responses were required to be emitted temporally close to the outcome, ratings of the causal effectiveness of the responses were lower than in a condition in which the probability of an outcome following a response was the same but in which no temporal proximity was required. These results suggest that, in addition to the overall probability that an outcome will follow a response, the local context of responding at the time an outcome is presented is critical in influencing ratings of causal effectiveness.     

Paleostriatal lesions and instrumental learning in the pigeon

In three experiments, pigeons with lesions of the paleostriatum (experimental subjects) and unoperated control birds were trained on tasks designed to assess their instrumental learning abilities. In Experiment 1, using an orthodox Skinner box, training was given on a variable interval (VI) followed by a fixed interval (FI) schedule of reinforcement and only non-significant differences between the groups emerged. Experiment 2 examined the performance of the same subjects on a VI schedule in which a response-contingent signal accompanied reinforcement. For control subjects the presence of the signal resulted in a low rate of response compared with that found in equivalent conditions with the signal omitted. Experimental subjects showed the same response rate when the signal was present as when it was absent. Experiment 3 employed naive subjects, and a Skinner box modified to facilitate key-pecking in total darkness. In this apparatus, experimental subjects showed a lowered response rate on a VI schedule. These tasks were analyzed in terms of the classical (stimulus-reinforcer) and instrumental (response-reinforcer) learning they involve. The results suggest that pigeons with paleostriatal lesions show a deficit in forming response-reinforcer associations, perhaps because the lesions reduce the salience of response-produced cues.     

Perception of causal relations in humans: Factors affecting judgments of response-outcome contingencies under free-operant procedures

In three experiments, college studients responded to and rated a range of positive, random, and negative response-outcome contingencies presented in free-operant formats. These experiments sought a paradigm that would yield sensitive and unbiased judgments of response-outcome relations and explored the role of time in the judgment of response-outcome covariation. In Experiment 1, the effects of making continuous and discrete responses on subjects' contingency judgments were compared. In Experiment 2, the effects of changing the temporal definition of discrete responses were examined as were the effects of the amount of exposure to contingency problems. In Experiment 3, the effects of temporal regularity in defining response occurrence and nonoccurrence were investigated. In all three experiments, subjects' judgments were strong linear functions of the programmed contingencies between telegraph key operation and the illumination of a brief light. This result shows free-operant scheduling of response-outcome contingencies to be a highly sensitive and unbiased method of investigating causal perception. Additionally, judgment accuracy was found to be higher for males than for females and to improve as the probability of the subject's making a recorded response rose from .00 toward .50. Finally, a correlational analysis of several possible judgment rules supported the conclusion that subjects rated response-outcome relations on the basis of the difference in the probability of an outcome given their having recently made or not made a response.     

Effect of a signalled delay between an action and outcome on human judgement of causality

Three experiments examined the influence of a stimulus inserted between an action (pressing the space bar of a computer) and an associated delayed outcome (a triangle lighting up on the screen) on ratings of the causal effectiveness of that action. In Experiment 1, subjects rated an action that produced an outcome immediately as more causally effective than an action that produced a delayed outcome. The rating of the causal effectiveness of an action that produced a delayed outcome in which the delay was filled by a stimulus was higher than the rating of actions that produced the outcome after an unsignalled delay. In Experiment 2, the effect of a stimulus presented uncorrelated with the action or the outcome was examined and found not to enhance the rating of causal effectiveness of an action that produced a delayed outcome. In Experiment 3, the degree of correlation between the stimulus and the consequence was examined. Ratings of the causal effectiveness of the action were greater the higher percentage of delay intervals that were signalled.     

Controlling for causally relevant third variables

In 3 experiments, the authors tested the conditions under which 3rd variables are controlled for in making causal judgments. The authors hypothesized that 3rd variables are controlled for when the 3rd variables are themselves perceived as causal. In Experiment 1, the participants predicted test performance after seeing information about wearing a lucky garment, taking a test-preparation course, and staying up late. The course (perceived as more causally relevant) was controlled for more than was the garment (perceived as less causally relevant) in assessing the effectiveness of staying up late. In Experiments 2 and 3, to obviate the many alternative accounts that arise from the realistic cover story of Experiment 1, participants predicted flowers' blooming after the presentation or nonpresentation of liquids. When one liquid was trained as causal, it was controlled for more in judging another liquid than when it was trained as neutral. Overall, stimuli perceived as causal were controlled for more when judging other stimuli. The authors concluded that the effect of perceived causal relevance on causal conditionalizing is real and normatively reasonable.     

Variable-ratio schedules as variable-interval schedules with linear feedback loops.

The mathematical theory of linear systems has been used successfully to describe responding on variable-interval (VI) schedules. In the simplest extension of the theory to the variable-ratio (VR) case, VR schedules are treated as if they were VI schedules with linear feedback loops. The assumption entailed by this approach, namely, that VR and VI-plus-linear-feedback schedules are equivalent, was tested by comparing responding on the two types of schedule. Four human subjects' lever pressing produced monetary reinforcers on five VR schedules, and on five VI schedules with linear feedback loops that reproduced the feedback properties of the VR schedules. Pressing was initiated by instructions in 2 subjects, and was shaped by successive approximation in the other 2. The different methods of response initiation did not have differential effects on behavior. For each of the 4 subjects, the VR and the comparable VI-plus-linear-feedback schedules generated similar average response rates and similar response patterns. The subjects' behavior on both types of schedule was similar to that of avian and rodent species on VR schedules. These results indicate that the assumption entailed by the VI-plus-linear-feedback approach to the VR case is valid and, consequently, that the approach is worth pursuing. The results also confute interresponse-time theories of schedule performance, which require interval and ratio contingencies to produce different response rates.     

Controlling for Causally Relevant Third Variables

In 3 experiments, the authors tested the conditions under which 3rd variables are controlled for in making causal judgments. The authors hypothesized that 3rd variables are controlled for when the 3rd variables are themselves perceived as causal. In Experiment 1, the participants predicted test performance after seeing information about wearing a lucky garment, taking a test-preparation course, and staying up late. The course (perceived as more causally relevant) was controlled for more than was the garment (perceived as less causally relevant) in assessing the effectiveness of staying up late. In Experiments 2 and 3, to obviate the many alternative accounts that arise from the realistic cover story of Experiment 1, participants predicted flowers' blooming after the presentation or non-presentation of liquids. When one liquid was trained as causal, it was controlled for more in judging another liquid than when it was trained as neutral. Overall, stimuli perceived as causal were controlled for more when judging other stimuli. The authors concluded that the effect of perceived causal relevance on causal conditionalizing is real and normatively reasonable.     

Some Effects Of Intertrial Interval Duration On Discrete-trial Choice

Pigeons were trained in Experiment 1 on a discrete-trial concurrent variable-interval (VI) 1-min VI 3-min schedule, and in Experiment 2 on a discrete-trial concurrent VI 1.5-min VI 1.5-min schedule. In each experiment, the intertrial-interval durations (ITIs) were 0 s, 6 s, 22 s, and 120 s, and the schedules were both independent and interdependent. The purpose of the research was to determine whether lengthening the ITI would disrupt any local control that existed, measured with respect to relative response rate and changeover probability. In Experiment 1, with the independent schedules, both preference and obtained relative reinforcement rate approximated .75 at short ITIs, but then decreased toward .50 with longer ITIs. With interdependent schedules, both preference and obtained relative reinforcement rate approximated .75 at all ITIs. In both experiments, with both independent and interdependent schedules, changeover probabilities for each response in a sequence of up to five successive responses to a given schedule were variable for individual birds. The average changeover probabilities for all birds suggested perseveration rather than a systematic increase within a given ITI or a systematic trend toward chance responding as ITI duration increased. Finally, the changeover functions did not differ when a sequence of responses was calculated to begin anew after reinforcement rather than with the first response on a schedule. Taken together, the data were inconsistent with a theory holding that only local processes underlie choice in discrete-trial procedures.     

Effects of a brief stimulus accompanying reinforcement on instrumental responding in pigeons

The responding of pigeons on a variable interval schedule of reinforcement was investigated in four experiments. In some conditions in each experiment reinforced keypecks were accompanied by a brief (0.5-sec) flash of the houselight. This procedure resulted in a low rate of response in comparison with that found in conditions when response-contingent light flashes occurred uncorrelated with reinforcement (Experiments 1 and 2) or when no light flash was presented (Experiment 3). Experiment 4 allowed a comparison between the effects of a signal accompanying the reinforced response and one accompanying the delivery of “free” food. Signaling the delivery of earned food produced a lower rate of response than did signaling the delivery of free food. The role of stimulus-reinforcer and response-reinforcer associations in producing these effects is discussed.     

反应选项对时序知觉重复启动效应的影响

先前研究采用两项反应任务发现了时序知觉重复启动效应, 这可能是反应选项导致的虚假效应, 本研究采用三项反应任务对此进行了检验。实验1运用三项判断任务以消除缺乏中间选项所致的反应偏向, 结果发现重复启动显著影响“哪个图形先出现”和“两个图形同时出现”的时序判断; 实验2在实验1的基础上对“同时出现”反应选项进行两种指导语操作, 实验结果不仅与实验1一致, 而且“有把握时判断为同时出现”和“有无把握都判断为同时出现”之间没有显著差异, 说明被试能够识别时序加以判断, 不支持反应偏向的前提条件。因此, 时序知觉重复启动效应不是反应选项产生的反应偏向引发的虚假效应, 重复启动对“系列性”和“同时性”时序知觉都存在显著影响。