Influence of temporal context on value in the multiple-chains and successive-encounters procedures

This set of studies explored the influence of temporal context across multiple-chain and multiple-successive-encounters procedures. Following training with different temporal contexts, the value of stimuli sharing similar reinforcement schedules was assessed by presenting these stimuli in concurrent probes. The results for the multiple-chain schedule indicate that temporal context does impact the value of a conditioned reinforcer consistent with delay-reduction theory, such that a stimulus signaling a greater reduction in delay until reinforcement has greater value. Further, nonreinforced stimuli that are concurrently presented with the preferred terminal link also have greater value, consistent with value transfer. The effects of context on value for conditions with the multiple-successive-encounters procedure, however, appear to depend on whether the search schedule or alternate handling schedule was manipulated, as well as on whether the tested stimuli were the rich or lean schedules in their components. Overall, the results help delineate the conditions under which temporal context affects conditioned-reinforcement value (acting as a learning variable) and the conditions under which it does not (acting as a performance variable), an issue of relevance to theories of choice.     

Effects of reinforcement context on choice

Two experiments investigated the effects of successive reinforcement contexts on choice. In the first, concurrent variable-interval schedules of primary reinforcement operated during the initial links of concurrent chains. The rate of this reinforcement arranged by the concurrent schedules was decreased across conditions: When it was higher than the terminal-link rate, preference for the higher frequency initial-link schedule increased relative to baseline. (During baseline, a standard concurrent-schedule procedure was in effect). When the initial-link reinforcement rate was lower than the terminal-link rate, preference converged toward indifference. In the second experiment, a chain schedule was available on a third key while a concurrent schedule was in effect on the side keys. When the terminal link of the chain schedule was produced, the side keys became inoperative. Availability of the chain schedule did not affect choice between the concurrent schedules. These results show that only when successive reinforcement contexts are produced by choice responding do those successive contexts affect choice in concurrent schedules.     

Memory for two stimulus-response items in pigeons

Six pigeons served in a discrete-trial experiment on short-term memory. Combinations of three key positions and two ordinal positions, yielding six possible sequences of stimulus-response pairs, were used as lists of items. A retention interval separated list presentation from the test phase in which two (for Group 1) or three (for Group 2) keys were illuminated with either red or green light. A reinforcer was delivered if a subject pecked the key of the first item on a red trial and the key of the second item on a green trial. When the retention interval was lengthened from one to five or nine seconds, a systematic loss of stimulus control resulted. Lengthening the interval between items from one to eight seconds had a much smaller effect for the birds in Group 1, whereas a systematic loss of stimulus control was found in red trials for the birds in Group 2. The functional relations between choice accuracy and delay provided an empirical basis for analysis of what relations among temporal events can become discriminative stimuli.     

Transfer tests of stimulus value in concurrent chains

We report two experiments that use transfer tests to investigate whether in concurrent chains the value of a terminal-link stimulus is affected by the alternate terminal link. In Experiment 1, two groups of pigeons were trained on multiple concurrent-chains schedules in which switching between the schedules was via pecking a changeover key. For one group, the terminal links were fixed-interval 8 s versus fixed-interval 16 s in one component and fixed-interval 16 s versus fixed-interval 32 s in the other component. For a second group, the terminal links were variable-interval 10 s versus variable-interval 20 s in one component and variable-interval 20 s versus variable-interval 40 s in the other. After sufficient baseline training had been given so that performances had stabilized, transfer tests were conducted in which the two chains with equal terminal-link schedules were presented together as a new concurrent pair. For 6 of the 7 subjects, initial-link responding changed fairly rapidly during the test in the manner predicted if the values of the terminal links were equal. In Experiment 2, pigeons were trained on multiple concurrent chains using a two-key procedure, and the terminal links were the same variable-interval schedules as in Experiment 1. After baseline training, transfer tests were conducted that assessed (a) the relative reinforcing strength of the terminal-link stimuli in a novel initial-link situation and (b) the relative ability of those stimuli to evoke responding. The data from the reinforcing strength test were consistent with those from Experiment 1, but those from the evocation strength test were not. Although this discrepancy shows that responding in transfer tests is not solely a function of stimulus value, the results from both experiments suggest, overall, that value is determined by the stimulus—reinforcer relation independently of the alternative terminal link.     

How pigeons discriminate the relative frequency of events.

This study examined how pigeons discriminate the relative frequencies of events when the events occur serially. In a discrete-trials procedure, 6 pigeons were shown one light nf times and then another nl times. Next, they received food for choosing the light that had occurred the least number of times during the sample. At issue were (a) how the discrimination was related to two variables, the difference between the frequencies of the two lights, D = nf - nl, and the total number of lights in the sample, T = nf + nl; and (b) whether a simple mathematical model of the discrimination process could account for the data. In contrast with models that assume that pigeons count the stimulus lights, engage in mental arithmetic on numerons, or remember the number of stimuli, the present model assumed only that the influence of a sample stimulus on choice increases linearly when the stimulus is presented, but decays exponentially when the stimulus is absent. The results showed that, overall, the pigeons discriminated the relative frequencies well. Their accuracy always increased with the absolute value of the difference D and, for D > 0, it decreased with T. Performance also showed clear recency, primacy, and contextual effects. The model accounted well for the major trends in the data.     

Temporal context in concurrent chains: I. Terminal-link duration

Two experiments are reported in which the ratio of the average times spent in the terminal and initial links (Tt/Ti) in concurrent chains was varied. In Experiment 1, pigeons responded in a three-component procedure in which terminal-link variable-interval schedules were in constant ratio, but their average duration increased across components by a factor of two. The log initial-link response ratio was a negatively accelerated function of Tt/Ti. Overall, the data were well described by Grace's (1994) contextual choice model (CCM) with temporal context represented as (Tt/Ti)k or 2Tt/(Tt + Ti), and by Mazur's (2001) hyperbolic value-added model (HVA), with each model accounting for approximately 93% of the variance. In Experiment 2, fixed-parameter predictions for each model were generated, based on the data from Experiment 1, for conditions in which Tt/Ti was varied over a more extreme range. Data were consistent with the predictions of CCM with temporal context represented as 2Tt/(Tt + Ti) and to a lesser extent as (Tt/Ti)k, but not with HVA. Overall, these results suggest that preference increases as a hyperbolic function of Tt/Ti when terminal-link duration is increased relative to initial-link duration, with the terminal-link schedule ratio held constant.     

Stimulus control depends on the subjective value of the outcome

Stimuli that provide information about likely future reinforcers tend to shift behavior, provided a reliable relation between the stimulus and the reinforcer can be discriminated. Stimuli that are apparently more reliable exert greater control over behavior. We asked how the subjective value (measured in terms of preference) of reinforcers associated with stimuli influences stimulus control. Five pigeons worked on a concurrent chains procedure in which half of all trials ended in a smaller reinforcer sooner, and the other half in a larger reinforcer later. In Signaled trials, the color and flash duration on the keys in the initial link signaled the outcome of the trial. In Conflicting probe trials, the color and the flash duration signaled conflicting information about the outcome of the trial. Choice in Signaled trials shifted toward the signaled outcome, but was never exclusive. In Conflicting probe trials, control was divided idiosyncratically between the 2 stimulus dimensions, but still favored the outcome with the higher subjective value. Thus, stimulus control depends not only on the perceived reliability of stimuli, but also on the subjective value of the outcome.     

Choice and the relative immediacy of reinforcement

The relative immediacy of reinforcement in concurrent-chain schedules was varied while the relative reduction in the overall average time to reinforcement associated with terminal-link entry was held constant. For each of four pigeons, choice did not vary with relative immediacy of reinforcement. Subsequently, choice by the same subjects was shown to be sensitive to relative reduction in average time to reinforcement.     

Asymmetry of the group context effect on delay discounting

Binary choice delay discounting tasks require participants to indicate preference between smaller, immediate, and larger, delayed rewards. Previous research indicates that when the delayed reward is shared with others, the delayed outcome is preferred compared with when the outcomes are for the self only, resulting in lower rates of delay discounting. The present series of studies sought to replicate and extend this finding. Study 1 compared delay discounting on a standard task in which both immediate and delayed outcomes are for the self and a group context task where the delayed outcome was shared with one other person. Replicating previous results, group context resulted in lower rates of delay discounting, and this effect was independent of how the shared outcome was presented. Study 2 compared delay discounting on a standard task and a group context task where the immediate outcome was shared. In contrast to Study 1, group context resulted in higher rates of delay discounting, suggesting that preference in intertemporal choice tracks the shared outcome. Moreover, this effect was not independent of how the shared outcome was presented. This is the first study to reveal that group context, when applied to the immediate outcome, can result in higher rates of delay discounting.     

The relative law of effect: effects of shock intensity on response strength in multiple schedules

Key pecking of four birds was reinforced with food according to a two-component multiple variable-interval 1-minute variable-interval 4-minute schedule. In addition, key pecking was punished by a brief shock according to a variable-interval 30-second schedule during both components of the multiple schedule. The intensity of the shock was varied. For all birds, punishment had a stronger suppressive effect on the responding maintained by the leaner food schedule, and the ratio of responding during the two components of the multiple schedule became closer to the ratio of reinforcement as shock intensity was increased, as the relative law of effect predicts. At the higher shock intensity, there was some evidence that the ratio of responses overmatched the ratio of reinforcements.     

The effects of context extinction on US signal value

Two experiments with rats examined the effects of context extinction on responding to the signal value of an unconditioned stimulus (US). In Experiment 1, US signal value was first trained when a single food pellet signaled the delivery of three additional pellets. After training, rats received either context extinction (CE) or home cage (HC) exposure before testing US signal value by single food pellet presentations. Results showed responding was significantly reduced in Group CE compared to Group HC. Experiment 2 replicated Experiment 1 and showed that exposure to a different context did not reduce responding to the signal value of a US. The results complement research by Kehoe et al. [Kehoe, E. J., Weidemann, G., & Dartnall, S. (2004). Apparatus exposure produces profound declines in conditioned nictitating-membrane responses to discrete conditioned stimuli by the rabbit (Oryctolagus cuniculus). Journal of Experimental Psychology: Animal Behavior Processes, 30, 259–270.] and have key implications for prominent theories of conditioning.     

Devaluation of stimuli contingent on choice: evidence for conditioned reinforcement

Pigeons were presented a concurrent-chains schedule of reinforcement that had terminal links of equal duration. The initial links of the schedule were periodically interrupted by 15-s periods during which an extinction schedule was in effect. The extinction periods were presented on either a response-contingent or a noncontingent basis. Relative response rate for the left alternative decreased when the extinction periods were accompanied by the left terminal-link stimulus. Relative response rate for the right alternative decreased when the extinction periods were accompanied by the right terminal-link stimulus. Relative response rate varied inversely with the frequency of presentation of the extinction periods but was unaffected by presence versus absence of the response contingency in the schedule of extinction-period presentation. Furthermore, relative response rate was unaffected by presentation of extinction periods accompanied by a novel stimulus. When the extinction periods were presented after reinforcement in the left terminal link instead of as interruptions of the initial links, relative response rate for the left alternative was reduced if the postreinforcement extinction period was accompanied by the terminal-link stimulus for the left chain and reduced less if the extinction period was accompanied by the terminal-link stimulus for the right chain. The results demonstrate that the correlation between the terminal-link stimulus and extinction influenced the relative response rate in the initial link.     

情境对共情的影响

共情指的是个体在与人交往的过程中共享并理解他人的情绪状态的倾向, 包括认知共情和情绪共情两种成分。现实生活中的共情总是发生在一定的具体情境中, 受到情境因素的影响。其中, 情境的公开性或私密性、意义性等均在不同程度上影响了共情的产生或共情反应的强烈程度。共情对象在特定情境中与共情主体之间的群际关系、人际关系等也是重要的情境因素, 共情主体对于和自己属于同一群体或拥有较亲密人际关系的他人更容易产生共情。情境对共情的影响通过自上而下和自下而上两种方式实现。有关情境对共情的影响研究虽然取得了一定的成果, 但仍然有进一步拓展的空间, 未来的研究需要在情境因素的内涵上进行深入挖掘, 从认知加工的角度对情境影响共情的机制做更为细致、微观地解析, 还可以从共情主体的视角明确个体差异如何调节了情境对共情的影响作用。     

Effects of reinforcer probability, delay, and response requirements on the choices of rats and pigeons: possible species differences

In Experiment 1 with rats, a left lever press led to a 5-s delay and then a possible reinforcer. A right lever press led to an adjusting delay and then a certain reinforcer. This delay was adjusted over trials to estimate an indifference point, or a delay at which the two alternatives were chosen about equally often. Indifference points increased as the probability of reinforcement for the left lever decreased. In some conditions with a 20% chance of food, a light above the left lever was lit during the 5-s delay on all trials, but in other conditions, the light was only lit on those trials that ended with food. Unlike previous results with pigeons, the presence or absence of the delay light on no-food trials had no effect on the rats' indifference points. In other conditions, the rats showed less preference for the 20% alternative when the time between trials was longer. In Experiment 2 with rats, fixed-interval schedules were used instead of simple delays, and the presence or absence of the fixed-interval requirement on no-food trials had no effect on the indifference points. In Experiment 3 with rats and Experiment 4 with pigeons, the animals chose between a fixed-ratio 8 schedule that led to food on 33% of the trials and an adjusting-ratio schedule with food on 100% of the trials. Surprisingly, the rats showed less preference for the 33% alternative in conditions in which the ratio requirement was omitted on no-food trials. For the pigeons, the presence or absence of the ratio requirement on no-food trials had little effect. The results suggest that there may be differences between rats and pigeons in how they respond in choice situations involving delayed and probabilistic reinforcers.     

The effects of a local negative feedback function between choice and relative reinforcer rate

Four pigeons were trained on two-key concurrent variable-interval schedules with no changeover delay. In Phase 1, relative reinforcers on the two alternatives were varied over five conditions from .1 to .9. In Phases 2 and 3, we instituted a molar feedback function between relative choice in an interreinforcer interval and the probability of reinforcers on the two keys ending the next interreinforcer interval. The feedback function was linear, and was negatively sloped so that more extreme choice in an interreinforcer interval made it more likely that a reinforcer would be available on the other key at the end of the next interval. The slope of the feedback function was -1 in Phase 2 and -3 in Phase 3. We varied relative reinforcers in each of these phases by changing the intercept of the feedback function. Little effect of the feedback functions was discernible at the local (interreinforcer interval) level, but choice measured at an extended level across sessions was strongly and significantly decreased by increasing the negative slope of the feedback function.     

The effects of modifying consummatory behavior on the topography of the autoshaped pecking response in pigeons

The autoshaped responses of two debeaked pigeons that had developed modified eating behavior were compared to the autoshaped responses of three control subjects that ate grain normally. The control subjects exhibited keylight responding that was judged normal by two independent raters. The debeaked subjects pecked the key and ate grain with both normal and modified responses. The results of this study demostrate that an autoshaping procedure using grain as an appetitive stimulus may be used to establish a response that is not biologically preorganized.     

The influence of prior choices on current choice

Three pigeons chose between random-interval (RI) and tandem, continuous-reinforcement, fixed-interval (crf-FI) reinforcement schedules by pecking either of two keys. As long as a pigeon pecked on the RI key, both keys remained available. If a pigeon pecked on the crf-FI key, then the RI key became unavailable and the crf-FI timer began to time out. With this procedure, once the RI key was initially pecked, the prospective value of both alternatives remained constant regardless of time spent pecking on the RI key without reinforcement (RI waiting time). Despite this constancy, the rate at which pigeons switched from the RI to the crf-FI decreased sharply as RI waiting time increased. That is, prior choices influenced current choice-an exercise effect. It is argued that such influence (independent of reinforcement contingencies) may serve as a sunk-cost commitment device in self-control situations. In a second experiment, extinction was programmed if RI waiting time exceeded a certain value. Rate of switching to the crf-FI first decreased and then increased as the extinction point approached, showing sensitivity to both prior choices and reinforcement contingencies. In a third experiment, crf-FI availability was limited to a brief window during the RI waiting time. When constrained in this way, switching occurred at a high rate regardless of when, during the RI waiting time, the crf-FI became available.     

Effects of sentential context on the processing of unambiguous words by the two cerebral hemispheres

The effect of sentence context on the processing of different aspects of meaning of unambiguous nouns by the two cerebral hemispheres was examined. Participants performed a lexical decision task on target words following two primes, an unambiguous noun preceded by an incomplete sentence. Priming sentences were consistent with either the dominant or the subordinate aspect of meaning of their final unambiguous word. Short and long SOAs were used. A principal finding of this study was that, when compared to unrelated aspects of meaning, for both the short and the long SOAs, the dominant and subordinate aspects of meaning of the unambiguous words were activated regardless of context in both hemispheres. However, the activation of the subordinate aspect of meaning of unambiguous words appears to be more sensitive to sentential context, especially when the unambiguous word is being processed by the left hemisphere.     

The influence of "preparedness" on autoshaping, schedule performance, and choice.

Two groups of experimentally naive pigeons were exposed to an autoshaping procedure in which the response key was mounted on the wall (the conventional location) or on the floor of the chamber. In two experiments, subjects readily responded to the wall key, but floor-key subjects required shaping. A subsequent experiment compared performance of wall- and floor-key groups on an ascending series of fixed-ratio schedule values, resistance to extinction, differential reinforcement of other behavior, and reversal of key assignment. Each experiment was followed by several sessions of fixed-ratio training; the performance of the wall- and floor-key groups was almost identical throughout. In the final experiment, a fixed-ratio requirement could be completed on either or both keys. Birds initially chose the key on which they had responded during the preceding (reversal of key assignment) experiment. However, within a few sessions both groups showed almost exclusive preference for the floor key. Preference for a key located on the floor may follow from the fact that pigeons are ground feeders and may thus be more "prepared" to peck the floor than to peck a wall. However, autoshaping, under the conditions prevailing here, occurred much more readily to the wall key, suggesting that pecking a vertical surface is more highly prepared. Difficulties in determining relative preparedness seem moot, however, given the lack of between-group differences in the intervening experiments. It is thus unlikely that schedule performances critically depend upon the specific operant response involved.