Human neuropsychology: Some differences between korsakoff and normal operant performance

Summary Operant reinforcement schedules were used to investigate the effects of changes in reinforcement rates on the behavior of alcoholic Korsakoff (amnesic) patients and normal control subjects. In one test, both groups were exposed to pairs of variable-interval (VI) reinforcement schedules which operated concurrently. The distribution of reinforcements controlled the distribution of responses of normal subjects to a significantly greater extent than those of the Korsakoff patients. In a second test, two VI reinforcement schedules were arranged to run one at a time in succession. Reinforcement-rate differences with the successive (multiple) schedules did not produce corresponding response-rate differences for either group of subjects. The findings stress the complexity of the alcoholic Korsakoff syndrome, and emphasize the need to consider possible motivational abnormalities as determinants of alcohol-induced amnesia. In addition, results underscore both the value and the limitations of using operant procedures in human learning research.Supported in part by PHS Grants NS 07615 and NS 06209, by PHS RCDA K04 NS 00161 to M. O. Berman, and by the Medical Research Service of the Veterans Administration. Address offprint requests to M.O. Berman, BVAMC, 150 So. Huntington Ave., Boston, MA. 02130, USA     

The effect of manipulated success ratios on task preference

The hypothesis that success influences task preferences was tested by subjecting 230 Ss to three different success-failure reinforcement schedules and observing subsequent preferences for the tasks concerned. Success ratios of 85-15%, 70-30%, and 50-50% in tasks dealing with unpreferred stimuli were used. Results supported the hypothesis: the probability of change in task preference was greatest under high success reinforcement ratio conditions.     

Concurrent fixed-interval variable-ratio schedules and the matching relation

Five rats responded under concurrent fixed-interval variable-ratio schedules of food reinforcement. Fixed-interval values ranged from 50-seconds to 300-seconds and variable-ratio values ranged from 30 to 360; a five-second changeover delay was in effect throughout the experiment. The relations between reinforcement ratios obtained from the two schedules and the ratios of responses and time spent on the schedules were described by Baum's (1974) generalized matching equation. All subjects undermatched both response and time ratios to reinforcement ratios, and all subjects displayed systematic bias in favor of the variable-ratio schedules. Response ratios undermatched reinforcement ratios less than did time ratios, but response ratios produced greater bias than did time ratios for every subject and for the group as a whole. Local rates of responding were generally higher on the variable-ratio than on the fixed-interval schedules. When responding was maintained by both schedules, a period of no responding on either schedule immediately after fixed-interval reinforcement typically was followed by high-rate responding on the variable-ratio schedule. At short fixed-interval values, when a changeover to the fixed-interval schedule was made, responding usually continued until fixed-interval reinforcement was obtained; at longer values, a changeover back to the variable-ratio schedule usually occurred when fixed-interval reinforcement was not forthcoming within a few seconds, and responding then alternated between the two schedules every few seconds until fixed-interval reinforcement finally was obtained.     

Contextual cueing effects in the remote memory of alcoholic Korsakoff patients and normal subjects

This study examines the effects of contextual cueing on the remote memory of alcoholic Korsakoff patients and normal subjects. Naming of personalities who became famous in each of the five decades beginning 1935 was tested under two conditions: "no-context", in which minimal extraneous cues to identification were provided, and "context", where clear extraneous cues were available. Normal subjects performed better than Korsakoff patients, showed no evidence of a temporal gradient, and exhibited a contextual cueing advantage across all decades. In contrast, Korsakoff patients demonstrated a marked temporal gradient, and the contextual cueing advantage declined systematically as more recent decades were sampled. Further analyses demonstrated that the differential pattern of deficits shown by Korsakoffs and controls was not attributable to absolute differences in performance level. Theoretical implications of these data for explanations of Korsakoff retrograde amnesia are discussed.     

Concurrent variable-interval variable-ratio schedules can provide only weak evidence for matching

Herrnstein and Heyman (1979) showed that when pigeons' pecking is reinforced on concurrent variable-interval variable-ratio schedules, (1) their behavior ratios match the ratio of the schedules' reinforcer frequencies, and (2) there is more responding on the variable interval. Since maximizing the reinforcement rate would require responding more on the variable ratio, these results were presented as establishing the primacy of matching over maximizing. In the present report, different ratios of behavior were simulated on a computer to see how they would affect reinforcement rates on these concurrent schedules. Over a wide range of experimenter-specified choice ratios, matching obtained — a result suggesting that changes in choice allocation produced changes in reinforcer frequencies that correspond to the matching outcome. Matching also occurred at arbitrarily selected choice ratios when reinforcement rates were algebraically determined by each schedule's reinforcement-feedback function. Additionally, three birds were exposed to concurrent variable-interval variable-ratio schedules contingent on key pecking in which hopper durations were varied in some conditions to produce experimenter-specified choice ratios. Matching generally obtained between choice ratios and reinforcer-frequency ratios at these different choice ratios. By suggesting that reinforcer frequencies track choice on this procedure, instead of vice versa, this outcome questions whether matching-as-outcome was due to matching-as-process in the Herrnstein and Heyman study.     

Priming of spatial configurations in alcoholic Korsakoff's amnesia.

To examine priming for novel, nonverbal patterns, a modification of the paradigm used by Gabrieli et al. (1990, Neuropsychologia, 28, 417-427) was administered to a group of Korsakoff patients, a group of alcoholic controls, and a group of normal controls. Subjects were asked to connect five-dot configurations into the first pattern that came to mind. Priming was than assessed by having the subjects copy experimenter-provided interpretations for each configuration and examining the effect of this manipulation on the subjects' subsequent interpretation of the same configurations. For the Korsakoff patients, the copied prime replaced their initial perceptual interpretation less frequently than it did for normal controls. Instead, the prime had its effect by combining with the baseline percept. These findings suggest that priming for novel, nonverbal material is weaker and less direct for Korsakoff patients than it is for controls.     

Performance of humans in variable-interval avoidance schedules programmed singly, and concurrently with variable-interval schedules of positive reinforcement

Performance maintained under single variable-interval avoidance schedules, single variable-interval schedules of positive reinforcement, and concurrent schedules consisting of a variable-interval avoidance component and a variable-interval positive reinforcement component, was studied in three human subjects, using points exchangeable for money as the reinforcer. Response rate in the single variable-interval avoidance schedules was an increasing function of the frequency of monetary loss avoidance. Response rate in the single variable-interval positive reinforcement schedules was an increasing function of the frequency of obtained monetary reinforcement. In the concurrent avoidance/reinforcement schedules, the rate of responding in the avoidance component increased, and the rate of responding in the positive reinforcement schedule decreased (with one exception) as a function of the frequency of loss avoidance in the avoidance component. The logarithms of the ratios of the response rates in the two components, and the logarithms of the ratios of the times spent in the two components, were linearly related to the logarithms of the ratios of the frequency of loss avoidance in the avoidance component to the frequency of reinforcement in the positive reinforcement component. All three subjects exhibited marked undermatching of response rate ratios to reinforcement frequency ratios. The results are discussed in the context of Herrnstein's quantitative model of operant performance.     

Concurrent ratio schedules: Fixed vs. variable response requirements

Rats were trained on concurrent fixed-ratio variable-ratio or concurrent fixed-ratio mixed-ratio schedules of food reinforcement. The variable-ratio schedule was composed of an arithmetic sequence of 11 ratios that averaged 50; the mixed-ratio schedule consisted of equiprobable ratios of 1 and 99. Fixed-ratio values, varied over experimental conditions, included 25, 35, 50, 60, and 99. The proportion of responses and time allocated to the variable- or mixed-ratio schedule increased as the size of the fixed ratio increased. For most subjects, higher proportions of responses and time were maintained on the fixed-ratio schedule at fixed-ratio values of 25 and 35; higher proportions of responses and time were maintained on the variable- or mixed-ratio schedule at fixed-ratio values of 50 or higher. On concurrent variable-ratio fixed-ratio schedules, the tendency for responding to be maintained exclusively by one schedule was related to the difference in local reinforcement rates obtained from those schedules. Exclusive responding was approximated when the difference in local reinforcement rates obtained from those schedules was large; responding was more evenly distributed between the schedules as the difference in the rates at which reinforcement was obtained from each decreased.     

Strategic and automatic priming of semantic memory in alcoholic Korsakoff patients

To examine whether the organization of semantic memory is intact in alcoholic Korsakoff patients, three semantic memory tasks which do not require active search for stored information were administered to a group of Korsakoff patients and alcoholic controls. The first two tasks used a perceptual identification paradigm in which patients had to identify briefly presented targets preceded by associatively (experiment 1) or categorically (experiment 2) related primes. On both tasks, Korsakoff patients demonstrated intact priming effects. Because priming in these tasks was thought to reflect the operation of strategic processes, experiment 3 was designed to assess automatic spreading activation using a lexical decision task. Here as well, Korsakoff patients demonstrated intact priming. Taken together, these results support the view that the organization of semantic memory in Korsakoff patients has not been disrupted by their brain injury. The implications of these findings for understanding Korsakoff patients' impaired performance on semantic search tasks are discussed.     

Human concurrent performances: The effects of experience, instructions, and schedule-correlated stimuli

In order to investigate the effects of separate exposures to single schedules, of unique schedule-correlated stimuli, and of independency-informing instructions upon choice under concurrent variable-interval schedules, 28 human subjects were divided into eight groups. Each subject was exposed to a baseline procedure, an experimental procedure, and a return to the baseline procedure. Different combinations of these three manipulations were applied to the different groups only during the experimental phase (except for the independency-informing instructions, which were given to half of the groups at the start of training). For the group of subjects exposed to the combination of all three manipulations, the logarithms of the ratios of response frequencies tended to be linearly related to the logarithms of the ratios of reinforcement frequencies during the experimental phase. These orderly effects were not obtained with subjects in the other groups. The results suggest that human choice was well described by the generalized matching law when the three manipulations were simultaneously in effect, and that unreported differences in the use of these three procedural variables might partly account for contradictions between results in previous studies of human concurrent performance.     

Choice between reliable and unreliable reinforcement alternatives revisited: Preference for unreliable reinforcement

Pigeons' choices between a reliable alternative that always provided food after a delay (i.e., 100% reinforcement) and an unreliable one that provided food or blackout equally often after a delay (i.e., 50% reinforcement) was studied using a discrete-trials concurrent-chains procedure modified to prevent choice between alternatives following a blackout outcome. Initial links were fixed-ratio 1 schedules, and terminal links were fixed-time schedules. Stimuli presented during the terminal-link delays were correlated with the food and blackout outcomes. In Experiment 1, terminal-link durations were varied. With short terminal links (i.e., 10 s), 6 of 8 subjects showed strong preference for the 50% side. As terminal-link duration increased to 30 s, preference, regardless of direction, became less extreme. In Experiment 2, the side-key location of the 50% and 100% alternatives was reversed for 3 subjects. Preference for the 50% alternative reoccurred following the key reversal. When a 5-s separation was subsequently interposed between the initial and terminal links for both alternatives, all birds reversed to a preference for the 100% side. In general, the strong preference for the 50% side was qualitatively consistent with the expectation that the procedure enhanced the conditioned-reinforcement effectiveness of the food-associated terminal-link stimulus on the 50% side. Implications of the results for various accounts of choice of the 50% alternative are discussed.     

Schedule-induced drinking as a function of percentage reinforcement

Drinking was recorded in rats while lever pressing was maintained on a series of percentage reinforcement schedules in which the per cent of 1-min fixed intervals terminating with food was 100, 90, 30, 70, 10, 50, and 100%. Intervals in which a pellet was omitted were terminated by brief light flash and click stimuli that were also correlated with food presentations. Drinking failed to develop in five of six subjects following intervals in which the brief stimuli were presented regardless of percentage reinforcement. Postpellet drinking, which followed intervals terminated with pellet delivery, however, increased in both duration and amount ingested per interval as percentage reinforcement was systematically decreased. The increase in postpellet drinking above that produced by 100% reinforcement was interpreted as an analogue of the positive-contrast effect observed with food-reinforced operants.     

Choice for aperiodic versus periodic ratio schedules: A comparison of concurrent and concurrent-chain procedures

Choice between mixed-ratio schedules, consisting of equiprobable ratios of 1 and 99 responses per reinforcement, and fixed-ratio schedules of food reinforcement was assessed by two commonly used procedures: concurrent schedules and concurrent-chains schedules. Rats were trained under concurrent fixed-ratio mixed-ratio schedules, in which both ratio schedules were simultaneously available, and under a concurrent-chains schedule, in which access to one of the mutually exclusive ratio schedules comprising the terminal links was contingent on a single “choice” response. The distribution of responses between the two ratio schedules was taken as the choice proportion under the concurrent procedure, and the distribution of “choice” responses was taken as the choice proportion under the concurrent-chains procedure. Seven of eight rats displayed systematic choice; of those, each displayed nearly exclusive choice for fixed-ratio 35 to the mixed-ratio schedule under the concurrent procedure, but each displayed nearly exclusive choice for the mixed-ratio schedule to fixed-ratio 35 under the concurrent-chains procedure. Thus, preference for a fixed or a mixed schedule of reinforcement depended on the procedure used to assess preference.     

Stimulus Equivalence: Effects Of A Default-response Option On Emergence Of Untrained Stimulus Relations

Human subjects were exposed to a concurrent-chains schedule in which reinforcer amounts, delays, or both were varied in the terminal links, and consummatory responses were required to receive points that were later exchangeable for money. Two independent variable-interval 30-s schedules were in effect during the initial links, and delay periods were defined by fixed-time schedules. In Experiment 1, subjects were exposed to three different pairs of reinforcer amounts and delays, and sensitivity to reinforcer amount and delay was determined based on the generalized matching law. The relative responding (choice) of most subjects was more sensitive to reinforcer amount than to reinforcer delay. In Experiment 2, subjects chose between immediate smaller reinforcers and delayed larger reinforcers in five conditions with and without timeout periods that followed a shorter delay, in which reinforcer amounts and delays were combined to make different predictions based on local reinforcement density (i.e., points per delay) or overall reinforcement density (i.e., points per total time). In most conditions, subjects' choices were qualitatively in accord with the predictions from the overall reinforcement density calculated by the ratio of reinforcer amount and total time. Therefore, the overall reinforcement density appears to influence the preference of humans in the present self-control choice situation.     

Limited matching on concurrent-schedule reinforcement of academic behavior

Three adolescent students with special educational needs were given a choice between completing one of two available sets of math problems. Reinforcers (nickels) across these alternatives were arranged systematically in separate experimental phases according to three different concurrent variable-interval schedules (reinforcement ratios of 2:1, 6:1, and 12:1). Time allocated to the two stacks of math problems stood in linear relationship to the reinforcement rate obtained from each stack, although substantial undermatching and bias were observed for all subjects. However, changes in the schedules were not followed by changes in allocation patterns until adjunct procedures (e.g., changeover delays, limited holds, timers, and demonstrations) were introduced. The necessity of adjunct procedures in establishing matching in applied situations is discussed as a limitation to quantitative applications of the matching law in applied behavior analysis.     

Stochastic transitivity and the unidimensional control of choice

A concurrent-chains paradigm was used to test three models of preference for schedules of reinforcement. Each model assumes choice to be a monotonic function of values on a single dimension (“simple scalability”). For choices involving variable-interval and fixed-interval schedules, this dimension is assumed to be an harmonic average of the interreinforcement intervals; for choices involving fixedinterval and fixed-ratio schedules, the dimension is the time to reinforcement irrespective of response rate; for choices involving different combinations of rate and duration of reinforcement, the dimension is the rate of “reinforcement-time”, or the product of the two parameters. Each model implies a strong form of transitivity (“functional equivalence”), which held for half the subjects (that half exclusively sensitive to the reinforcement variable specified by the model). An alternative unidimensional model which implies a weaker form of transitivity (“weak binary utility model”) was consistent with the preferences of all subjects. This model states that a single factor controls the direction of preferences but not necessarily the exact choice probability, as simple scalability assumes.     

Cued recall in anterograde amnesia

After a single presentation of a word list, normal subjects exhibited better retention when prompted with semantic cues than with rhyme or letter cues. Alcoholic Korsakoff patients, patients receiving electroconvulsive therapy (ECT), and the patient N.A. exhibited impaired retention and, unlike control subjects, did not exhibit an advantage of semantic cues over letter and rhyme cues. Two experimental manipulations designed to equate the level of performance of amnesics and controls indicated that these amnesias could be understood as a reflection of weak memory strength that results from deficiencies in initial learning and retention. In addition, alcoholic Korsakoff patients appeared to have greater difficulty utilizing semantic cues than patients receiving ECT or patient N.A.     

Choice between fixed-interval schedules: Graded versus step-like choice functions

Pigeons chose between two fixed-interval schedules of food reinforcement. A single peck on one of two lighted keys started the fixed-interval schedule correlated with that key. The schedule had to be completed before the next choice opportunity. The durations of the fixed intervals were varied over conditions from 15 s to 40 s. To maximize the rate of reinforcement, the pigeons had to choose exclusively the shorter of the two schedules. Nevertheless, choice was not all-or-none. Instead, relative choice, and the rates of producing the fixed intervals, varied in a graded fashion with the disparity between the two schedules. Choice ratios under this procedure (single response to choose) were highly sensitive to the ratios of the fixed-interval schedules.     

Preference for and effects of variable-as opposed to fixed-reinforcer duration

Pigeons were trained on multiple schedules in which a fixed number of pecks produced either a fixed or a variable period of access to food, the average variable-duration reinforcement equalling the fixed. Pecking rates were generally higher during the variable-duration component. Subsequent performance on concurrent schedules revealed an initial preference for variable-duration reinforcement for all subjects; for most subjects, this preference was sustained. For one subject, the average variable duration was gradually reduced to half the fixed duration: continued preference for the variable component resulted in a loss of up to 30% of available reinforcement time. A return to multiple schedules with unequal pay-off shifted the preference to the greater fixed duration, and this preference was maintained even when the variable duration was again raised to equal the fixed duration. For the remaining subjects, the initial variable-duration preference on concurrent schedules was gradually replaced by a side preference. When the range of variable durations was varied, keeping the average variable duration equal to the fixed, the occasional longer reinforcers sustained a preference for variable-reinforcer durations for three of the four subjects.