Selective reinforcement of schizophrenics' interview responses

In this experiment each of five examiners tested and interviewed four subjects in each of three conditions. The subjects were 60 male, hospitalized schizophrenics. The three conditions were the reinforcement, after an operant period, of “sick talk”, “healthy talk”, or plural nouns during a structured interview. Half the Welsh factor A and R scale items were administered before the interview, half after the interview. Significant differences were found among experimental conditions in terms of changes from operant to reinforced interview periods in percentage of “sick talk” emitted by subjects and changes from pre- to post-testing in terms of Welsh R scores. The correlation between these two measures of change was statistically significant. The results were discussed in terms of the different therapeutic strategies of neoanalytic and behaviour therapists.     

Effects of choice and immediacy of reinforcement on single response and switching behavior of children

Children responded on a single operandum to produce marbles or candy within a two-component multiple schedule and then were allowed to choose which component was in effect. Experiment I examined the effects of exchanging marbles after sessions for subject-selected or experimenter-selected candy. Rate of response to the single operandum was not affected. However, when the subjects could switch components, they spent the majority of time and responded at somewhat higher rates in a component where marbles were exchangable for subject-selected candy. Experiment II examined the effects of eliminating the immediate marble consequence for responses. Rate of response to the single operandum was not affected. However, when subjects could switch components they spent more time in a component where immediate marble consequences were available for responses, than where no immediate marble consequences were available.     

Intermittent reinforcement of a continuous response

Konorski showed that when a go/no-go procedure was used, sound quality discriminations were rapidly acquired and sound location discriminations were slowly acquired. These findings have been interpreted as a general constraint on the acquisition of auditory discriminations (quality-location effect). However, experiments carried out within an evolutionary framework (Harrison, 1984) have shown that the rate of acquisition of sound location discriminations varies widely as a function of the inclusion or exclusion of naturalistic features. These data suggest that Konorski's findings were a function of the special conditions of the experiments. The first purpose of the present experiments was to assess whether rats showed the effects noted by Konorski when studied under similar conditions. The second purpose was to study the effect of manipulating two natural features (novelty and stimulus-response adjacency) to assess whether the acquisition rates of quality and location discriminations could be greatly modified or made approximately equal, or both. When a go/no-go procedure was used and the other conditions were similar to those of Konorski, rats acquired a quality discrimination but did not acquire a location discrimination. However, when the S+ or S- were presented through a closely adjacent speaker, the sound location discrimination was acquired as rapidly as the quality discrimination. Finally, preexposing the animal to either S+ or S- retarded the rate of or prevented the acquisition of the quality discrimination. The experiments showed that the quality-location effect was determined primarily by the conditions used in Konorski's experiments, and that the effect is not a general constraint on learning.     

Selective punishment early and late in fixed-ratio schedules of food reinforcement

Pigeons key pecked for grain on a fixed-ratio 100 schedule; electric shocks occurred intermittently at the fifteenth or eighty-fifth response in the ratio. In Experiment I, shock was at the fifteenth response for two birds, and at the eighty-fifth response for two others, in every sixth, twelfth, or eighteenth ratio. Rate of responding decreased as frequency of shock increased, and the pattern of responding included an increased initial pause and low rates or pause-run sequences that extended further into the ratio when shock was at the fifteenth response than when it was at the eighty-fifth response. Shock early in the ratio engendered longer initial pauses than shock late in the ratio. In Experiment II, four birds responded on a two-component multiple schedule in which shock occurred at the fifteenth response of the third ratio in the presence of a white keylight and at the eighty-fifth response of the third ratio in the presence of a green keylight. The overall rates of responding decreased as shock intensity increased. All four birds responded differentially to the white and green keylights, but with a pattern that varied between birds. In general, punishment reduced the probability of responses that preceded it, regardless of the ordinal position of those responses. Both studies confirm that the probability of responding is reduced less by aversive stimuli produced late in a fixed-ratio than by aversive stimuli produced early in a fixed-ratio.     

Differential reinforcement of interresponse times with controlled probability of reinforcement per response

Pigeons were presented food after interresponse times (IRTs) longer or shorter than a fixed percentage of their most recent IRTs. This procedure controlled probability of reinforcement per response while still allowing different classes of IRTs to be reinforced differentially. Support was found for IRT-reinforcement theory in that response rates were determined by the degree and direction of differential reinforcement of IRTs, but were relatively independent of probability of reinforcement per response and of the length of the control system's IRT memory. Stimulus control of these differential response rates was also demonstrated.     

Behavioral contrast and response independent reinforcement

Four pigeons received pre-training that included presentation of the reinforcer independently of behavior and then baseline training on a variable-interval schedule of reinforcement. With the introduction of a multiple schedule, in which the first stimulus was associated with a response contingent and a second stimulus with a response independent, 1-min variable-interval schedule, a reduction in response rate was obtained in the second component, which was not accompanied by a behavioral contrast effect in the first component. A further three pigeons were given the same pre-training and baseline training before the introduction of an otherwise identical multiple schedule, in which no reinforcement occured in the second component. Behavioral contrast was obtained from all three subjects. The results indicated that under conditions of constant reinforcement density a reduction in responding is not a sufficient condition for the occurrence of behavioral contrast.     

Exteroceptive control of response under delayed reinforcement

Three white rats, after 50 continuous reinforcements, were exposed successively, under dim illumination, to reinforcement delays of 1, 3, 5, 7.5, 10, 15, and 20 sec, with prolonged training at the 20-sec level. Behavior was maintained at each level, and an increase in interval was accompanied by an increase in post-reinforcement pause. Subsequently, under both 20- and 30-sec delays, the animals were tested during half of each daily session to determine the effect of introducing darkness during each delay interval. The result of this stimulus “support” was to regularize and increase response rate for each animal at both interval values.     

Sustained responding under intermittent reinforcement in psychotic children

A procedure is described that classifies abnormal children with respect to their capacity to sustain adaptive responding without consistent, extrinsic reinforcement. The procedure was used to assess individual differences in tolerance for intermittent reinforcement among a group of 21 psychotic children. The procedure was found to correlate with three variables established by previous research to be important prognostically-i.e., measures of intelligence, social competence, and language functioning. Findings are discussed with respect to the construct of motivation as distinguished from the construct of ability. It is suggested that whether or not the experimental measure is regarded as relevant to the global construct of motivation, it has clear relevance to potential deficits in the important capacity to sustain adaptive responding.Funding for this study and for the development of the computer-operated laboratory was provided by the USOE, Bureau of Education for the Handicapped, as a portion of Grant Number C007604305, Sensory discrimination, Generalization and Language Training of Autistic Children, awarded to R. L. Blanton and C. W. Deckner. Appreciation is expressed to S. A. Soraci, Jr., and A. A. Baumeister for valuable suggestions regarding this study.     

Control of preference in children by conditioned positive reinforcement

A preference measure was employed with children to evaluate the conditioned positive reinforcing function of a stimulus that preceded reinforcement. A match-to-sample procedure was arranged in which subjects could respond to either the form or color dimension of a compound sample stimulus. Intermittent token reinforcement was provided equally for color and form matches. Two stimuli were employed (Stimulus A and Stimulus B), each consisting of a distinctive tone and colored light. One of these stimuli (the paired stimulus) preceded each token delivery, and the other did not (nonpaired stimulus). The paired stimulus was dependent upon each response to one match dimension, and the nonpaired stimulus followed each response to the other dimension. Three of the five subjects responded primarily to the dimension that was followed by the paired stimulus. This effect was obtained regardless of which stimulus (A or B) was paired and on which match dimension (color or form) the paired stimulus was dependent. These results were unaltered by discontinuing the nonpaired stimulus. The other two subjects demonstrated consistent preferences for the form dimension and Stimulus A, respectively.     

Reward prospect rapidly speeds up response inhibition via reactive control

Response inhibition is an important cognitive-control function that allows for already-initiated or habitual behavioral responses to be promptly withheld when needed. A typical paradigm to study this function is the stop-signal task. From this task, the stop-signal response time (SSRT) can be derived, which indexes how rapidly an already-initiated response can be canceled. Typically, SSRTs range around 200 ms, identifying response inhibition as a particularly rapid cognitive-control process. Even so, it has recently been shown that SSRTs can be further accelerated if successful response inhibition is rewarded. Since this earlier study effectively ruled out differential preparatory (proactive) control adjustments, the reward benefits likely relied on boosted reactive control. Yet, given how rapidly such control processes would need to be enhanced, alternative explanations circumventing reactive control are important to consider. We addressed this question with an fMRI study by gauging the overlap of the brain networks associated with reward-related and response-inhibition-related processes in a reward-modulated stop-signal task. In line with the view that reactive control can indeed be boosted swiftly by reward availability, we found that the activity in key brain areas related to response inhibition was enhanced for reward-related stop trials. Furthermore, we observed that this beneficial reward effect was triggered by enhanced connectivity between task-unspecific (reward-related) and task-specific (inhibition-related) areas in the medial prefrontal cortex (mPFC). The present data hence suggest that reward information can be translated very rapidly into behavioral benefits (here, within ~200 ms) through enhanced reactive control, underscoring the immediate responsiveness of such control processes to reward availability in general.