Effects of a pre-shock stimulus on temporal control of behavior

Rats were exposed to a situation in which a response on lever B was followed by reinforcement if a preceding response on lever A had been made at least 5, 10, or 15 sec before. The effects of signalled unavoidable shock were studied on the behavior maintained by this procedure. All rats made fewer A-to-B sequences during the periods of pre-shock stimulus. In addition, when the A-to-B delay was 10 or 15 sec, the distribution of A-to-B times changed, there being more shorter intervals. However, for animals where the A-to-B delay was 5 sec, the distribution of A-to-B times was not changed during the pre-shock stimulus. In all cases, there was an increased proportion of inappropriate B responses (i.e., with no preceding A response) during the pre-shock stimulus; this was most marked with animals exposed to a 15-sec A-to-B delay.     

Signalled free-operant avoidance of shock by pigeons pecking a key

Two pigeons were trained to peck a key under a free-operant avoidance schedule. Then, changes in key color signalled the beginning (safe period) and the end (warning period) of the response-shock interval, with a response required to change the key color. Finally, a change in key color signalled the warning period and either a response or a shock reinstated the safe stimulus. During signalled avoidance, response rate was higher during the warning stimulus than during the safe stimulus. More responding tended to occur in the warning stimulus when it was terminated by either a response or a shock than by only a response. In either procedure, response latency during the warning stimulus was a function of the duration of the warning stimulus. In general, response and shock rate were higher during unsignalled than during signalled avoidance. When the warning stimulus was brief, the results were similar to those of unsignalled avoidance. These results confirm previous findings with pigeons, are in general agreement with data provided by other species in studies of signalled avoidance, and thereby indicate the transituationality of the key-pecking operant.     

Two temporal parameters of free operant discriminated avoidance in the rhesus monkey

Four monkeys were exposed to free operant discriminated avoidance (discriminated Sidman avoidance) in a parametric study of safe stimulus and warning stimulus duration. The safe stimulus was assigned values of 2, 5, 10, 20, and 40 sec, the warning stimulus values of 2, 5, and 20 sec. Rate of responding was a decreasing negatively accelerated function of safe stimulus duration, with a small effect attributable to warning stimulus duration. Control of response rate by safe stimulus duration was due to the predominance of responding in the presence of the warning stimulus. Responding during the safe stimulus was independent of the temporal parameters except at schedules combining short safe and short warning stimulus durations. Latencies of responses in the warning stimulus were analyzed, and mean latency was found to be a direct function of warning stimulus duration, with only one exception, resulting from the order in which the warning stimulus values were presented. Shock rate was not systematically related to either of the manipulated parameters.     

Changes in threshold level produced by a signal preceding or following the threshold stimulus

In a previous experiment (Howarth and Treisman, 1958) it was shown that when a warning preceded a stimulus by a fixed interval, the threshold level for the stimulus was higher the longer the fixed interval. A model of this effect was proposed, assuming that the threshold criterion adopted by the subject at any moment was modified by his estimate of the probability of a stimulus at that moment.

Three predictions are derived and tested. It is found that: the standard deviation of the response is constant despite the shifts in threshold induced; the threshold continues to fall as the interval from warning to stimulus is decreased to zero, with the lowest threshold when the warning signal and the stimulus are simultaneous; and that a warning signal following the stimulus by an interval of less than 0 5 to 1 sec. also lowers the threshold.     

Some effects of methylphenidate on stimulus control of ratio avoidance behavior in the rat

After exposure to an avoidance schedule which included a warning signal, a rat was placed on a multiple schedule in which the first component was the same as before, i.e., a single response reset the response-shock interval, delaying shock, and the second component differed only in that four bar-presses were required to postpone shock. A fixed ratio requirement of four responses (FR 4) generated behavior resembling a fixed ratio requirement of one response (FR 1) since responding was controlled by the warning signal but more shocks were received. At a dosage of 2 mg/kg, methylphenidate given intraperitoneally decreased shock frequency during FR 4 periods while FR 1 behavior was not affected; at 4 mg/kg, stimulus control of avoidance responding was impaired during both components. Results at 4 mg/kg were partially confirmed by two animals exposed to an FR 4 avoidance schedule which included a warning signal but with different parameters. Response distributions showed that methylphenidate increased response rates in the absence of the warning signal, i.e., stimulus control of ratio-avoidance behavior was impaired although the increased response rates reduced shock frequency. One hour later responses again occurred more frequently during the signal than in its absence but shocks were less frequent than during control (non-drug) periods.     

Probability effects on stimulus evaluation and response processes.

This study investigated the effects of probability information on response preparation and stimulus evaluation. Eight subjects responded with one hand to the target letter H and with the other to the target letter S. The target letter was surrounded by noise letters that were either the same as or different from the target letter. In 2 conditions, the targets were preceded by a warning stimulus unrelated to the target letter. In 2 other conditions, a warning letter predicted that the same letter or the opposite letter would appear as the imperative stimulus with .80 probability. Correct reaction times were faster and error rates were lower when imperative stimuli confirmed the predictions of the warning stimulus. Probability information affected (a) the preparation of motor responses during the foreperiod, (b) the development of expectancies for a particular target letter, and (c) a process sensitive to the identities of letter stimuli but not to their locations.     

Social facilitation of responses during a stimulus paired with electric shock

Key-pecking responses of a pigeon were maintained by a variable-interval schedule of food reinforcement. The responses were suppressed during the occasional presentation of a warning stimulus paired with electric shock. The presence of a second pigeon emitting the same response for food reinforcement reduced the suppression that otherwise occurred during the warning stimulus when the second pigeon was absent. These results reveal that the social facilitation phenomenon can be used to restore behavior that is suppressed by a conditioned aversive stimulus.     

Comparison of timing and classical conditioning

Four experiments with rats investigated if the timing of a stimulus (sound) correlated with the strength of a conditioned response (CR) to the stimulus. The timing (effective duration) of the stimulus was measured using the peak procedure, similar to a discrete-trials fixed-interval procedure. The rats were trained so that their response rate reached a maximum about 40 s or 60 s after the onset of a light; the time of the maximum measured from the start of the light (peak time) was the measure of timing. On some trials, the light was preceded by a short (5 s) or long (20 s or 30 s) interval of sound. We assumed that the difference in peak time after long and short sounds reflected the timing of the sound--if the sound was timed, the longer sound would produce a lower peak time; if the sound was not timed, the two durations of sound would produce the same peak time. The CR was lever-pressing during the sound. The sound was treated in various ways: presented alone (Experiments 1, 3, and 4), followed by food (Experiments 1, 3, and 4), preceded by food (Experiment 3), and followed by food after 20 s (Experiment 4). Treatments that produced no timing of sound produced no CR, and treatments that increased (or diseased) timing also increased (or decreased) the CR. The results suggest that there is overlap between the mechanisms that produce time discrimination and the mechanisms that produce classical conditioning.     

Conditioned suppression with extinction as the signalled stimulus

The key pecking of pigeons that was maintained by a 60-sec random-interval schedule of food reinforcement was suppressed during a variable-duration warning stimulus that signalled a 5-min extinction period. The onset of the extinction period immediately followed the termination of the warning signal and was independent of the subject's responses. All subjects eventually showed nearly complete suppression of responding during the warning stimulus.     

Response force is sensitive to the temporal uncertainty of response stimuli

Three experiments examined whether temporal uncertainty about the delivery of a response stimulus affects response force in a simple reaction time (RT) situation. All experiments manipulated the foreperiod; that is, the interval between a warning signal and the response stimulus. In the constant condition, foreperiod length was kept constant over a block of trials but changed from block to block. In the variable condition, foreperiod length varied randomly from trial to trial. A visual warning and response stimulus were used in Experiment 1; response force decreased with foreperiod length in the variable condition, but increased in the constant condition. This result is consistent with the hypothesis that responses are less forceful when the temporal occurrence of the response stimulus is predictable. In a second experiment with an auditory warning signal and a response stimulus, response force was less sensitive to foreperiod manipulations. The third experiment manipulated both the modality and the intensity of the response signal and employed a tactile warning signal. This experiment indicated that neither the modality nor the intensity of the response signal affects the relation between response force and foreperiod length. An extension of Näätänen’s (1971) motor-readiness model accounts for the main results.     

Discriminated punishment: avoidable and unavoidable shock

Warning stimuli for two punishment conditions were alternated with periods of appetitive responding by rats. In either warning stimulus, the first response produced a brief shock, terminated the stimulus, and started an interval during which the baseline appetitive schedule was in effect. Not responding resulted in stimuli of random duration, which terminated with a shock under one condition and without a shock under the other. Each subject was exposed to several shock intensities, with trials for the two conditions programmed during alternate portions of the session. In general, response frequency in the warning signal for either condition decreased with increasing intensity; however, at a given intensity, responding was more frequent in the stimulus invariably terminating with shock than in the stimulus terminating without shock when no response was made. The frequency difference was greatest at intensities intermediate between those producing minimal and maximal suppression.     

Temporal control of conditioned responding in goldfish

The peak procedure was used to characterize response timing during acquisition and maintenance of conditioned responding in goldfish. Subjects received light-shock pairings with a 5- or 15-s interstimulus interval. On interspersed peak trials, the conditioned stimulus light was presented for 45 s and no shock was delivered. Peaks in the conditioned response, general activity, occurred at about the time of the expected unconditioned stimulus, and variability in the activity distribution was scalar. Modeling of the changes in the activity distributions over sessions revealed that the temporal features of the conditioned response changed very little during acquisition. The data suggest that times are learned early in training, and, contrary to I. P. Pavlov's (1927/1960) concept of "inhibition of delay," that timing is learning when to respond rather than learning when not to respond.     

Responding in the squirrel monkey under second-order schedules of shock delivery

Lever-pressing responses were maintained in the squirrel monkey when the only consequence of responding was the delivery of a response-produced electric shock, or alternatively, a brief visual stimulus that was occasionally followed by an electric shock. When shock was produced by the first response occurring after 8 min (8-min fixed-interval schedule), a period of no responding at the beginning of the interval was followed by a gradual increase in response rate during the interval. Similar rates and patterns of responding were maintained when a 1-sec visual stimulus was produced by the first response occurring after 8 min and shock delivery followed the brief stimulus. Subsequently, patterns of positively accelerated responding were engendered during individual fixed-interval components when the first response occurring after 4 min produced a 1-sec visual stimulus and shock delivery followed the second, and later the fourth, presentation of the 1-sec stimulus. When the duration of the brief stimulus was varied over a 100-fold range from 0.1 to 10.0 sec (1) mean response rates decreased monotonically as stimulus duration increased, and (2) patterns of positively accelerated responding were least variable and response rates during the initial part of each 4-min interval were lowest at a stimulus duration of 1 sec.     

Effects of chlorpromazine on fixed-ratio responding: modification by fixed-interval discriminative stimuli.

Effects of chlorpromazine (1 to 100 mg/kg) were assessed on two pigeons' responding under various modifications of a multiple schedule of food delivery. During a fixed-interval component, the first response after 5 min produced food; during the subsequent, fixed-ratio component, the 30th response produced food. Modifications of the schedule entailed changes in stimulus conditions imposed during the fixed-ratio component that did not systematically alter characteristics of performance under non-drug conditions. In the first phase of the experiment, distinctive visual stimuli were correlated with each schedule component (conventional multiple schedule); chlorpromazine produced small decreases in fixed-ratio responding (20% at 30 mg/kg). When each response during the fixed-ratio component produced the stimulus correlated with the fixed-interval schedule (fixed-interval discriminative stimulus) for 1.2 s, effects of chlorpromazine were not different from those under the conventional multiple schedule. Chlorpromazine produced greater decreases in fixed-ratio responding (55% at 30 mg/kg) when either the first response of each fixed ratio changed the stimulus correlated with the fixed-ratio schedule to the fixed-interval discriminative stimulus for the remainder of the fixed-ratio component, or when the fixed-interval discriminative stimulus was presented independently of responding according to a matched temporal sequence. When the fixed-interval discriminative stimulus was present continuously during the fixed-ratio component (mixed schedule), chlorpromazine produced even more substantial decreases in fixed-ratio responding (greater than 80% at 30 mg/kg). Effects of chlorpromazine on fixed-interval responding were also modified by the schedules of fixed-interval discriminative stimulus presentation. The effects of chlorpromazine were a joint function of the stimuli prevailing during the multiple schedule and the degree to which responding influenced these stimuli.     

Effects of anticipation certainty on preparatory brain activity and anticipatory postural adjustments associated with voluntary unilateral arm movement while standing

We examined the effects of anticipation certainty concerning which voluntary movement is required in response to a stimulus while standing on preparatory brain activity and anticipatory postural adjustments (APAs). Ten right-handed adults abducted their left or right arm rapidly in response to a visual imperative stimulus, based on the type of stimulus. A warning cue, which did or did not contain information about the side of arm abduction, was presented 2000ms before the imperative stimulus. Preparatory brain activity before arm abduction was quantified by the mean amplitude of the contingent negative variation 100ms before the imperative stimulus (late CNV amplitude). Compared with the low anticipation condition, in the high anticipation condition the following results were obtained only in the case of right arm abduction: (1) larger late CNV amplitude, (2) earlier postural muscle activities with respect to the focal muscle of arm abduction, and (3) smaller peak displacement of center of pressure during the abduction. These findings suggest that high anticipation of voluntary movement of dominant arm to a stimulus while standing influences preparatory brain activity before the movement, resulting in earlier APAs and thus smaller disturbance of postural equilibrium during the movement.     

Extinction of Sidman avoidance behavior

Extinction of Sidman avoidance behavior by eliminating the noxious stimulus was studied in Sprague-Dawley rats with bar-pressing as the response. Each of three subjects was trained and extinguished on each of the following schedules in a different order: nondiscriminated, response-shock interval = 20 sec, shock-shock interval = 5 sec; nondiscriminated, response-shock interval = 40 sec, shock-shock interval = 5 sec; discriminated, response-white noise interval = 15 sec, noise-shock interval = 5 sec, shock-shock interval = 5 sec. Less than one 4-hr session was required for extinction for all procedures. When a warning stimulus was present, resistance to extinction increased. Subjects did not, however, respond to avoid the signal. Only small differences in extinction were found after training on different schedules with no warning signal.     

Growth hormone response to different consecutive stress stimuli in healthy men: is there any difference?

The contribution of growth hormone (GH), released during acute and repeated stressful situations, to the development of stress-related disorders is often neglected. We have hypothesized that the modulation of the GH response to sequential stress exposure in humans depends mainly on the nature of the stressor. To test this hypothesis, we compared GH responses to different stressful situations, namely aerobic exercise, hypoglycemia and hyperthermia, which were applied in two sequential sessions separated by 80-150 min. In addition, administration of the dopaminergic drug apomorphine was used as a pharmacological stimulus. GH responses to submaximal exercise (bicycle ergometer, increasing work loads of 1.5, 2.0 and 2.5 W/kg, total duration 20 min) and hyperthermia in a sauna (80 degrees C, 30 min) were prevented when preceded by the same stress stimulus. Hypoglycemia induced by insulin (0.1 IU/kg intravenously) resulted in a significant GH response also during the second of the two consecutive insulin tests, though the response was reduced. Administration of apomorphine (0.75 mg subcutaneously) or insulin prevented the increase in GH release in response to a sequential bolus of apomorphine, while hypoglycemia induced a significant elevation in GH levels even if applied after a previous treatment with apomorphine. In conclusion, the feedback inhibition of the GH response to a sequential stress stimulus depends on the stimulus used. Unlike in the case of exercise and hyperthermia, mechanisms involved in the stress response to hypoglycemia appear to overcome the usual feedback mechanisms and to re-induce the GH response when applied after another stimulus.     

Effect of locus of warning tone on auditory choice reaction time

Forty Ss pressed a left- or right-hand key depending on the ear in which they heard a 500-Hz stimulus tone. Half of the Ss were instructed to press the key on the same side as the ear stimulated (corresponding condition), while the other half pressed the key on the opposite side (noncorresponding condition). A 200-Hz warning tone preceded the stimulus tone by either 200 or 400 msec. The warning tone was presented to the left ear, the right ear, or to both ears in a predetermined random sequence. The locus of the warning tone affected RT on noncorresponding trials but not on corresponding trials. The effect consisted of a significant slowing of information processing on trials where the warning tone was contralateral to the response. Results were explained in terms of an initial tendency to respond toward the source of the warning tone.     

Conditioned suppression as a sensitive baseline for social facilitation

The key pecking of pigeons maintained on a variable-interval schedule of food reinforcement was suppressed during occasional presentations of a warning stimulus paired with electric shock. On alternate sessions, a co-actor pigeon was visible in an adjoining chamber where it emitted the same food-reinforced key peck during the warning stimulus that signalled shock for the subject. With no shock and at low shock intensities, where the subject's responding was not suppressed or suppressed only slightly, the co-actor had little effect. At the higher shock intensities, where the subject's responding was reduced by at least 40%, the response rate during the warning stimulus was consistently higher when the co-actor was present. One explanation of these results assumes a special relationship between social stimuli and aversive stimuli in which the presence of another animal reduces emotional reactions and thereby allows operant responses to increase. This was not the case here because the mere presence of the co-actor did not maintain social facilitation. Rather, the present results, taken in conjunction with previous findings, suggest that changes in social and non-social variables which affect the rate of food-reinforced responding may produce proportionately larger changes in responding when that responding is suppressed by aversive stimulation than when it is not.