Concurrent-schedule performance in transition: changeover delays and signaled reinforcer ratios

Six pigeons were trained in experimental sessions that arranged six or seven components with various concurrent-schedule reinforcer ratios associated with each. The order of the components was determined randomly without replacement. Components lasted until the pigeons had received 10 reinforcers, and were separated by 10-s blackout periods. The component reinforcer ratios arranged in most conditions were 27:1, 9:1, 3:1, 1:1, 1:3, 1:9 and 1:27; in others, there were only six components, three of 27:1 and three of 1:27. In some conditions, each reinforcement ratio was signaled by a different red-yellow flash frequency, with the frequency perfectly correlated with the reinforcer ratio. Additionally, a changeover delay was arranged in some conditions, and no changeover delay in others. When component reinforcer ratios were signaled, sensitivity to reinforcement values increased from around 0.40 before the first reinforcer in a component to around 0.80 before the 10th reinforcer. When reinforcer ratios were not signaled, sensitivities typically increased from zero to around 0.40. Sensitivity to reinforcement was around 0.20 lower in no-changeover-delay conditions than in changeover-delay conditions, but increased in the former after exposure to changeover delays. Local analyses showed that preference was extreme towards the reinforced alternative for the first 25 s after reinforcement in changeover-delay conditions regardless of whether components were signaled or not. In no-changeover-delay conditions, preference following reinforcers was either absent, or, following exposure to changeover delays, small. Reinforcers have both local and long-term effects on preference. The former, but not the latter, is strongly affected by the presence of a changeover delay. Stimulus control may be more closely associated with longer-term, more molar, reinforcer effects.     

Preference for information about intensity of signaled tailshock

Three experiments are reported which were designed to demonstrate preference for signaled shock and to delineate the roles of the preparatory-response, information-seeking, and signaled-safety hypotheses of this phenomenon. Experiment 1 demonstrated a preference for a signal-tailshock condition over a tailshock-signal condition in a shuttlebox. In Experiment 3, rats were exposed to signaled tailshock of two intensities in both compartments of the shuttlebox, but in one compartment the signals provided information about the intensity of the impending tailshock, whereas in the other compartment the signals did not. The tailshock intensities were .6 and 1.3 mA for one group and .6 and 1.8 mA for a second group. Experiment 2 assured that even the smaller intensity difference was readily discriminable. For Group .6-1.8 a significant preference for the condition in which the signals predicted the intensity of the impending tailshocks was obtained, but no preference for either condition was found for Group .6-1.3. As signaled safety was equated in the two compartments of Experiment 3, the observed preference cannot be accounted for by the signaled-safety hypothesis. Information seeking cannot explain the lack of preference in Group .6-1.3 as the difference between those two intensities was proven discriminable in Experiment 2. Assuming that sufficient differences in shock intensity yield different preparatory responses, the present results are compatible with the preparatory-response hypothesis and suggest that preparatory responding plays a role in producing the preference for signaled shock.     

Choice for signaled over unsignaled shock as a function of signal length.

Subjects chose between signaled and unsignaled shock conditions while signal length was varied between .5 and 2.0 seconds in steps of .5 seconds in both ascending and descending series. Preference for the signaled condition failed to develop initially for five of six subjects when signals were .5 or 1.0 seconds but became strong for all subjects when signals were 2.0 seconds (ascending series). Preference declined when signals were shortened, but for most subjects this decline was small (descending series). Since discriminable shock-free periods were present in the signaled condition at all signal lengths, these results suggest that safety may not be a sufficient condition for preference to develop for signaled shock.     

Preference for signaled over unsignaled shock schedules: Ruling out asymmetry and response fixation as factors

Experiment 1 tested whether a “symmetrical” choice procedure yields results different from those previously reported using the “unidirectional” standard changeover procedure (e.g., Badia & Culbertson, 1972). Subjects could change at any time from unsignaled to signaled shock by pressing a lever and from signaled to unsignaled shock by pressing a second lever. Results were identical to those of the standard procedure and showed that the standard procedure is fully adequate. Experiment 2 tested whether choice of high density signaled shock over low-density unsignaled shock (Badia, Coker, & Harsh, 1973) resulted from initial training with equal-density schedules. Subjects were trained and tested with signaled shock twice as dense as unsignaled shock. Three of four subjects strongly preferred the signaled condition, thus ruling out carry-over and “response fixation” as alternative explanations.     

Preference for shock signals as a function of the temporal accuracy of the signals

Three groups of rats were exposed to pairs of three different contingencies on two sides of a shuttlebox. One signaled contingency provided 10-min danger and safety cues plus an additional 10-sec cue immediately preceeding shock (P-S), another signaled contingency provided 10-min danger and safety cues but random 10-sec cues with respect to shock (R-S), and an unsignaled contingency provided no safety period, but only a 20-min danger period during which shock could occur (NS). Signaled P-S and R-S contingencies were preferred in a choice test to the unsignaled NS contingency, and P-S was preferred to R-S. Independent tests of the fear-eliciting properties of the cues made in an off-baseline test of suppression of ongoing exploration indicated more freezing (fear) to the 10-sec cue in rats experiencing the P-S contingency. The results were interpreted as indicating a preference for cues providing more precise information about the temporal location of shock even when those cues were fear-eliciting.     

Transfer of the signaling properties of aversive CSs to an instrumental appetitive discrimination

Rats received Pavlovian conditioning in which, based on a shock US, white noise was established for different groups as an aversive CS+, CSo, or CS?. Then, half of each group received the CS contingent upon either the food-reinforced or nonreinforced response in an easy, choice discrimination. Correct responses, i.e., number of reinforcements, to criterion showed that a CS+ for the reinforced response facilitated learning, whereas a CS? retarded learning; conversely, a CS+ for the nonreinforced response retarded learning, whereas a CS? facilitated learning. The same contingency difference occurred with errors to criterion for CS? subjects but was obscured for CS+ subjects apparently by an avoidance-producing effect of the CS+. In support of the generality of the transfer effect, Z-score transforms of the correct-response data showed that the magnitude of transfer was comparable to that obtained in more difficult discriminations. Collectively, the findings indicate that an aversive CS can function as a transformed signal for the presence (CS+) or absence (CS?) of an appetitive reinforcer and that the signal's control of behavior is via a within-chain mediational process.     

The value of being imitated

Theories and research on the topics of attraction, conformity, and imitation support the view that the relational stimulus arising from being imitated serves a reinforcing function. To examine this possibility, 48 preschool children performed a task in which some neutral stimuli were repeatedly associated with an adult's matching the behavior of the subject, and other neutral stimuli were associated with the same adult's mismatching the behavior of the subject. Preference for the stimuli associated with being matched was greater at the end of training than earlier, and the overall preference for the matched stimuli exceeded chance. The results are considered in terms of the thesis that similarity arising from being imitated served a reinforcing function and the thesis that response strategies were adopted by the children.     

Comprehension of gerundive constructions by Broca's aphasics

Eleven diagnosed Broca's aphasics were tested for comprehension of sentences containing gerundive constructions. Results showed that, as a group, these patients were sensitive to grammatical distinctions signaled by “function” words, contrary to the predictions of some current theories about the specific deficits exhibited in this syndrome. Further analysis showed that the patients fell into two subgroups, one which exhibited sensitivity to the distinctions in normal grammar, and another which exhibited no sensitivity to such distinctions. This suggests that the syndrome may have different manifestations in different populations—patient age is suggested as a possible means for distinguishing the two groups. Suggestions for further research into the nature of the comprehension deficits exhibited by Broca's aphasics are made.     

Acquisition and retention of control of instrumental behavior by a cue-signaling airblast: How specific are conditioned anticipations?

The conditioned state evoked by a CS that had been paired with an aversive airblast was assessed by superimposing the CS on baselines of instrumental responding. The first experiment used a shock avoidance baseline; CS-airblast pairings were administered on the baseline, with the shock avoidance schedule in effect. The CS that signaled airblast came, over trails, to accelerate shock avoidance responding. As further CS-airblast trials were administered, however, the acceleratory effect of the CS decreased, producing an inverted-U-shaped acquisition curve. A second experiment used off-baseline CS-airblast conditioning, and the CS was tested on both shock avoidance and water reinforcement baselines. After 20 CS-airblast pairings the CS accelerated shock avoidance and suppressed water-reinforced responding. After 10o pairings, however, the acceleratory effect on shock avoidance was much attenuated, although the suppressions of the water-reinforced behavior did not differ between 20- and 100-trial groups. Two further experiments examined retention, over a 45-day interval, of the attenuation of the CS's effects on shock avoidance. Over the retention interval, this attenuation disappeared. It was, however, reinstated by giving the animals “reminder” presentations of the airblast. These results are interpreted as representing systematic changes in the specificity of the conditioned state evoked by a Pavlovian CS.     

Sign-tracking in aversive conditioning

Two experiments were conducted to determine if rats tend to avoid contact with a stimulus that signals the occurrence of shock and contact a stimulus that signals the nonoccurrence of shock. The conditioned stimulus was a 60-sec platform presentation, and the unconditioned stimulus was a 2-sec inescapable shock. In each experiment, the emphasis was on two types of Pavlovian pairings: forward pairing in which each platform presentation was followed by shock, and backward pairing in which each platform presentation was preceded by shock and followed by a lengthy shock-free interval. Experiment 1 showed that in comparison with Random and CS-only procedures, the backward procedure produced a significant increase in approach and contact with the platform, but the forward procedure failed to produce a significant decrease in contact with the platform. Experiment 2, in which all groups were roughly equated for baseline levels of platform preference, demonstrated strong effects of both forward and backward conditioning. The experiments provide evidence for an aversive sign-tracking system in which animals' tendencies to withdraw from or approach and contact a platform CS are determined by the Pavlovian contingencies which render it a reliable signal for the occurrence or nonoccurrence of shock.     

Behavioral contrast produced by a signaled decrease in local rate of reinforcement

Pigeons' key pecking in the presence of one stimulus (S1) was reinforced according to a response-dependent variable-interval schedule. Pecking rate during S1 increased (behavioral contrast) when a second stimulus (S2) [associated with either a response-dependent fixed-interval schedule (Experiment I) or a response-independent reinforcement schedule in which reinforcement availability was signaled by visual (Experiment II) or temporal (Experiment III) stimuli] alternated with S1. These experiments suggest that a discriminable, signaled decrease in local reinforcement rate during S2 is an antecedent of the behavioral contrast response rate increases during S1.     

Transfer of conditioned inhibition across different aversive reinforcers in the rat

Three experiments using a conditioned suppression procedure in rats assessed transfer of conditioned inhibition across different aversive reinforcers. Experiment 1, using shock and car horn blast as reinforcers, showed that a noise negatively correlated with 0.7-mA shock between sessions attenuated suppression of lever pressing elicited by the signals for 0.7-mA shock and 110-db horn blast. Similarly, when the noise signaled the omission of horn blast, it attenuated suppression elicited by the signals for horn blast and shock. Experiment 2, using the same procedure, replicated transfer of conditioned inhibition from shock to horn found in Experiment 1, and indicated that such effects should be attributed to associative factors. Experiment 3, using the conditioned inhibition paradigm and different chambers during training and testing, replicated transfer from horn to shock and indicated that transfer cannot be attributed to multiple-background-reinforcer associations established during inhibitory training. The results of these experiments have implications for theories of conditioned inhibition.     

Teacher reactions to school-based consultation services: A multivariate analysis

The impact of consultation services on teachers' preferences for consultation versus referral approaches and upon teachers' perceptions of severity for common acting out, withdrawal, and academic types of student problems were investigated. The subjects were 96 teachers whose public and parochial schools were matched and randomly assigned to treatment and control groups. Following a 14-week period during which advanced school psychology graduate students served as consultants in the treatment schools, the Pupil Problem Behavior Inventory (PPBI) was administered to all teachers. The results of a repeated measures MANOVA analysis indicated that the teachers in the treatment group rated the acting out and academic problems on the PPBI as significantly less severe than did teachers in the control group. The subjects in both the treatment and control groups indicated a significant preference for consultation rather than referral services for all types of student problems presented in the PPBI. There was a moderate, positive correlation between perceived problem severity and teacher preference for referral rather than consultation services. The study's results were interpreted as supportive of the consultation model.     

Changeover behavior and preference in concurrent schedules

Pigeons were trained on a multiple schedule of reinforcement in which separate concurrent schedules occurred in each of two components. Key pecking was reinforced with milo. During one component, a variable-interval 40-s schedule was concurrent with a variable-interval 20-s schedule; during the other component, a variable-interval 40-s schedule was concurrent with a variable-interval 80-s schedule. During probe tests, the stimuli correlated with the two variable-interval 40-s schedules were presented simultaneously to assess preference, measured by the relative response rates to the two stimuli. In Experiment 1, the concurrently available variable-interval 20-s schedule operated normally; that is, reinforcer availability was not signaled. Following this baseline training, relative response rate during the probes favored the variable-interval 40-s alternative that had been paired with the lower valued schedule (i.e., with the variable-interval 80-s schedule). In Experiment 2, a signal for reinforcer availability was added to the high-value alternative (i.e., to the variable-interval 20-s schedule), thus reducing the rate of key pecking maintained by that schedule but leaving the reinforcement rate unchanged. Following that baseline training, relative response rates during probes favored the variable-interval 40-s alternative that had been paired with the higher valued schedule. The reversal in the pattern of preference implies that the pattern of changeover behavior established during training, and not reinforcement rate, determined the preference patterns obtained on the probe tests.     

Arousal, changeover responses, and preference in concurrent schedules

Pigeons were trained on multiple schedules that provided concurrent reinforcement in each of two components. In Experiment 1, one component consisted of a variable-interval (VI) 40-s schedule presented with a VI 20-s schedule, and the other a VI 40-s schedule presented with a VI 80-s schedule. After extended training, probe tests measured preference between the stimuli associated with the two 40-s schedules. Probe tests replicated the results of Belke (1992) that showed preference for the 40-s schedule that had been paired with the 80-s schedule. In a second condition, the overall reinforcer rate provided by the two components was equated by adding a signaled VI schedule to the component with the lower reinforcer rate. Probe results were unchanged. In Experiment 2, pigeons were trained on alternating concurrent VI 30-s VI 60-s schedules. One schedule provided 2-s access to food and the other provided 6-s access. The larger reinforcer magnitude produced higher response rates and was preferred on probe trials. Rate of changeover responding, however, did not differ as a function of reinforcer magnitude. The present results demonstrate that preference on probe trials is not a simple reflection of the pattern of changeover behavior established during training.     

Cognitive development and locus of control as predictors of preschoolers' understanding of safety and prevention

Preschoolers' cognitive level and locus of control orientation and their parents' locus of control orientation were considered as possible predictors of children's abilities to differentiate between safe and unsafe situations (safety score) and specify preventive measures (prevention score). Individual interviews were conducted with 3- to 6-year-old children enrolled at a daycare center, and their parents completed the Rotter Internal-External Locus of Control and the Accident Locus of Control (ALOC) scales. As hypothesized, children's level of causal reasoning was positively correlated with their safety and prevention scores. A curvilinear relationship was evident relationship existed with prevention score. Fathers' ALOC score was the only parent measure that predicted children's safety score, while none of the parent measures were predictive of children's prevention score. The findings were discussed in terms of safety education programs and directions for future research.     

Effects of density,activity, and personality on environmental preferences

The effects of room density, type of ongoing activity (party vs studying), and a personality variable (“personal space” or the distance which subjects place between themselves and others) on room liking were investigated. Results supported the prediction that type of activity is an important determinant of whether a high or low density setting is preferred. Evidence was also presented that a mediator between activity type and density preference is whether the presence of other people facilitates or inhibits the individual's goals in the setting. Personality factors also influence density preferences: Close standing Ss preferred a high to a low density setting; far standing Ss showed an opposite preference pattern, but only in the party condition. Correlations between Ss' personal space scores and several background and personality variables are also presented.     

RESPONDING MAINTAINED UNDER INTERMITTENT SCHEDULES OF ELECTRIC-SHOCK PRESENTATION: “SAFETY” OR SCHEDULE EFFCTS?

Four experiments were conducted in which lever pressing by squirrel monkeys was maintained under multiple, mixed, or chained schedules of electric-shock presentation. In the first two experiments, a multiple schedule was employed in which a fixed-interval schedule of shock presentation alternated with a signaled two-minute component. Initially, no events were scheduled during the two-minute component (a safety period). In the first experiment, the safety period was “degraded” by introducing and systematically increasing the frequency of periodic shocks presented during that component. In the second experiment, the proportion of overall safe time to unsafe time was decreased by decreasing the value of the fixed-interval schedule while holding constant shock frequency during the two-minute component. In the third experiment, the overall arrangement was changed from a multiple to a mixed schedule in an attempt to determine whether fixed-interval responding would be maintained when a single exteroceptive stimulus was associated with both components. In the fourth experiment, the overall arrangement was changed from a multiple to a chained schedule in an effort to determine whether fixed-interval responding would be maintained when its consequence was presentation of a signaled “unsafe” period. Fixed-interval responding was well maintained under all experimental conditions; the varied relationships obtained lend more support to conceptualizations of shock-maintained behavior as exemplifying schedule-controlled behavior than to suggestions that such behavior may be readily accounted for by “safety theory.”     

Effects of positive and negative adult-child interactions on children's social preference

The effects of positive and negative interactions on children's performance and preferences for the adults associated with each type of interaction were studied. Five children served as subjects during daily sessions in which each of three adults followed prescribed patterns of social interaction. One adult (positive) dispensed positive comments contingent upon either color-sorting or completion of arithmetic problems; a second adult (negative) mildly reprimanded the child for off-task behavior; and the third adult (extinction or nonreactive) said nothing to the child when he was present. Following each session the three adults reentered and the child chose one of them for an additional period of interaction. Three response measures (frequency, latency, and percent of time on-task) and children's adult preferences were obtained daily. The negative adult affected the most task behavior and had strongest stimulus control; the positive adult, though exerting little control over children's behavior, was the most preferred. Children's adult preferences were not specific to the task setting, but were observed across a variety of contexts.