A contextual model of concurrent-chains choice

An extension of the generalized matching law incorporating context effects on terminal-link sensitivity is proposed as a quantitative model of behavior under concurrent chains. The contextual choice model makes many of the same qualitative predictions as the delay-reduction hypothesis, and assumes that the crucial contextual variable in concurrent chains is the ratio of average times spent, per reinforcement, in the terminal and initial links; this ratio controls differential effectiveness of terminal-link stimuli as conditioned reinforcers. Ninety-two concurrent-chains data sets from 19 published studies were fitted to the model. Averaged across all studies, the model accounted for 90% of the variance in pigeons' relative initial-link responding. The model therefore demonstrates that a matching law analysis of concurrent chains—the assumption that relative initial-link responding equals relative terminal-link value—remains quantitatively viable. Because the model reduces to the generalized matching law when terminal-link duration is zero, it provides a quantitative integration of concurrent schedules and concurrent chains.     

Choice between reliable and unreliable reinforcement alternatives revisited: Preference for unreliable reinforcement

Pigeons' choices between a reliable alternative that always provided food after a delay (i.e., 100% reinforcement) and an unreliable one that provided food or blackout equally often after a delay (i.e., 50% reinforcement) was studied using a discrete-trials concurrent-chains procedure modified to prevent choice between alternatives following a blackout outcome. Initial links were fixed-ratio 1 schedules, and terminal links were fixed-time schedules. Stimuli presented during the terminal-link delays were correlated with the food and blackout outcomes. In Experiment 1, terminal-link durations were varied. With short terminal links (i.e., 10 s), 6 of 8 subjects showed strong preference for the 50% side. As terminal-link duration increased to 30 s, preference, regardless of direction, became less extreme. In Experiment 2, the side-key location of the 50% and 100% alternatives was reversed for 3 subjects. Preference for the 50% alternative reoccurred following the key reversal. When a 5-s separation was subsequently interposed between the initial and terminal links for both alternatives, all birds reversed to a preference for the 100% side. In general, the strong preference for the 50% side was qualitatively consistent with the expectation that the procedure enhanced the conditioned-reinforcement effectiveness of the food-associated terminal-link stimulus on the 50% side. Implications of the results for various accounts of choice of the 50% alternative are discussed.     

Immediate reinforcement in delayed reward learning in pigeons

Pigeons were trained on simultaneous red-green discrimination procedures with delayed reward and sequences of stimuli during the delay. In Experiment 1, three stimuli appeared during the 60-second intervals between the correct responses and reward, and the incorrect responses and nonreward. The stimulus that immediately followed a correct response also preceded nonreward, and the stimulus that followed an incorrect response preceded reward. These stimuli were 10 or .33 second in duration for different groups. Stimuli during the remainder of the delay interval differed following correct and incorrect responses. Group 10 initially persisted in the nonrewarded choice, but shifted to a preponderance of rewarded responses after further training. Group .33 rapidly acquired the correct response. Similar results were obtained in Experiment 2 where delay intervals consisted of opposite sequences of two stimuli of equal duration and total delays were 6, 20, or 60 seconds. Early in training, generalization of differential conditioned-reinforcing properties from the conditions preceding reward and nonreward to postchoice conditions had a greater effect relative to backchaining than it did later. It was concluded that delayed-reward learning is best analyzed in terms of the conditioned-reinforcing value of the patterns of cues that follow immediately after rewarded and nonrewarded responses.     

Choice and the relative immediacy of reinforcement

The relative immediacy of reinforcement in concurrent-chain schedules was varied while the relative reduction in the overall average time to reinforcement associated with terminal-link entry was held constant. For each of four pigeons, choice did not vary with relative immediacy of reinforcement. Subsequently, choice by the same subjects was shown to be sensitive to relative reduction in average time to reinforcement.     

Spatial and temporal relations in conditioned reinforcement and observing behavior

In Experiment 1, depressing one perch produced stimuli indicating which of two keys, if pecked, could produce food (spatial information) and depressing the other perch produced stimuli indicating whether a variable-interval or an extinction schedule was operating (temporal information). The pigeons increased the time they spent depressing the perch that produced the temporal information but did not increase the time they spent depressing the perch that produced the spatial information. In Experiment 2, pigeons that were allowed to produce combined spatial and temporal information did not acquire the perch pressing any faster or maintain it at a higher level than pigeons allowed to produce only temporal information. Later, when perching produced only spatial information, the time spent depressing the perch eventually declined. The results are not those implied by the statement that information concerning biologically important events is reinforcing but are consistent with an interpretation in terms of the acquisition of reinforcing properties by a stimulus associated with a higher density of primary reinforcement.     

The delay-reduction hypothesis of conditioned reinforcement and punishment: Observing behavior

Pigeons responded in an observing-response procedure in which three fixed-interval components alternated. Pecking one response key produced food reinforcement according to a mixed schedule. Pecking the second (observing) key occasionally replaced the mixed-schedule stimulus with the stimulus correlated with the fixed-interval component then in effect. In Experiment 1, observing was best maintained by stimuli correlated with a reduction in mean time to reinforcement. That finding was consistent with the conditioned-reinforcement hypothesis of observing behavior. However, low rates of observing were also maintained by stimuli not representing delay reduction. Experiment 2 assessed the role of sensory reinforcement. It showed that response rate was higher when maintained by stimuli uncorrelated with reinforcement delay than when the stimuli were correlated with a delay increase. This latter result supports a symmetrical version of the conditioned-reinforcement hypothesis that requires suppression by stimuli correlated with an increase in time to reinforcement. The results were inconsistent with hypotheses stressing the reinforcing potency of uncertainty reduction.     

Effects of chlordiazepoxide and d-amphetamine on responding suppressed by conditioned punishment

Key pecking by two pigeons, maintained under a variable-interval two-minute schedule of food presentation, was suppressed when each response produced a five-second visual stimulus that was occasionally paired with shock. Stimulus-shock pairings occurred independently of responding according to a variable-time six-minute schedule for one bird or once per session for the other bird. The effects of chlordiazepoxide and d-amphetamine were assessed on this baseline of behavior suppressed by conditioned punishment. Chlordiazepoxide produced dose-related increases in the rate of punished responding, whereas d-amphetamine produced only decreases. In addition, chlordiazepoxide produced dose-related increases in response rate during the response-produced and response-independent stimulus presentations; d-amphetamine, however, only decreased responding during stimulus presentations.     

General Learned Irrelevance and Its Prevention

Random presentation of a tone and an electric shock to rats interfered with subsequent acquisition of a light–shock association. This interference, or “general learned irrelevance” phenomenon, however, could be prevented by prior learning of a positive relationship between the tone and the shock or that between a noise and the shock. These results strongly support the ideas that animals learn irrelevant stimulus relationships and that prior experience of stimulus relevance prevents learning irrelevance. The similarity of this observed prevention effect to an immunization effect on learned helplessness phenomena is discussed.     

Preferences for and against stimuli paired with food.

Pigeons were presented with a concurrent-chains schedule in which terminal-link entries were assigned to two response keys on a percentage basis. The terminal links were fixed delays that sometimes ended with food and sometimes did not. In most conditions, 80% of the terminal links were assigned to one key, but a smaller percentage of the terminal links ended with food for this key, so the number of food reinforcers delivered by the two alternatives was equal. When the same terminal-link stimuli (orange houselights) were used for both alternatives, the pigeons showed a preference for whichever alternative delivered more frequent terminal links. When different terminal-link stimuli (green vs. red houselights) were used for the two alternatives, the pigeons showed a preference for whichever alternative delivered fewer terminal links when terminal-link durations were long, and no systematic preferences when terminal-link durations were short. This pattern of results was consistent with the predictions of Grace's (1994) contextual choice model. Preference for the alternative that delivered more frequent terminal links was usually stronger in the first few sessions of a condition than at the end of a condition, suggesting that the conditioned reinforcing effect of the additional terminal-link presentation was, in part, transitory.     

The Biological Function Paradigm Applied to the Immunological Self-Non-Self Discrimination: Critique of Tauber's Phenomenological Analysis

Biological self reference idioms in brain-centered or nervous-system-centered self determination of the consious Self reveal an interesting contrast with biological self-determination by immunological self/non-self discrimination. This contrast is both biological and epistemological. In contrast to the consciousness conscious of itself, the immunological self-determination imposes a protective mechanism against self-recognition (Coutinho et al. 1984), which adds to a largely unconscious achievement of the biological Self (Popper 1977; Medawar 1959). The latter viewpoint is in contrast with the immunological Self-determination as an essentially cognitive process as expressed in the analysis of Tauber (1994). Comparison of the immune system in vertebrates and invertebrates, according to new biological insights, has contributed to a better understanding of the relative role of innate (or inherited) immunity versus immunity acquired during each individual life. Also in this respect, immunological self-achievement shows both a striking analogy and a fundamental discrepancy with the activity of the nervous system. The analysis of immunological Self/non-self discrimination versus brain-centered self-determination adds to the understanding of the function paradigm in biological self-reference idioms, especially when regarding the importance of the connectivity notion in both systems. Adopting functional explanatory schemes for understanding immunological self-non-self discrimination, as well as for the understanding of functional mapping of the brain at (conscious) activity (Friston et al. 1993; Frith et al. 1995), forwards the notion of effective/functional connectivity. Network connectivity not only is a primary question in solving the dimensionality question for immunological ‘idiotypic networks’ (Jerne 1974a, b; 1984), it may also have an important value in describing phase transitions in the development of both immune and nervous systems. This revised version was published online in August 2006 with corrections to the Cover Date.