Response patterns and cardiovascular effects during response sequence acquisition by humans.

The effects of temporal delays imposed between successive responses and of vitamin C administration were examined on the acquisition of response sequences and on cardiovascular reactivity during sequence acquisition. Thirteen adult subjects (6 female, 7 male), in good health, gave written consent prior to participating in 12 weekly 45-min sessions. Points, exchanged for money after each session, were presented when subjects completed 15-response sequences on a touch-sensitive three-response keypad. A position counter increased from 0 to 14 as subjects emitted correct responses in the sequence. Four novel 15-response sequences were presented each session. No delays were imposed between successive responses during the acquisition of one sequence; delays were imposed immediately following each response during the acquisition of a second sequence, thereby delaying response feedback; delays were imposed following feedback during acquisition of a third sequence, resulting in the removal of the stimulus correlated with sequence position; and, as a control condition, delays were imposed following feedback, but stimuli correlated with sequence position were reinstated prior to the next response during acquisition of a fourth sequence. Subjects were exposed to one of two delay durations (0.2 and 0.5 or 0.5 and 1.0 s) each session, and delay durations alternated every session. During Weeks 5 to 8, subjects received 3 grams of vitamin C per day, whereas during Weeks 1 to 4 and 9 to 12, subjects received placebo under single-blind conditions. All subjects acquired the sequences, as evidenced by decreasing percentages of incorrect responses across trials. When temporal delays were imposed between successive responses during sequence acquisition, acquisition efficiency was enhanced. Examination of response latencies suggested that the status of preceding responses (i.e., correct or incorrect) rather than the status of the position counter influenced subsequent responding. Cardiovascular effects were inversely related to the length of the temporal delay. Neither cardiovascular reactivity or sequence acquisition were related to vitamin C administration.     

The Effect of Delayed Responding on Stroop-Like Task Performance Among Preschoolers

Forty-four preschoolers completed 2 conditions of a Stroop-like procedure (e.g., saying “boat” for car and “car” for boat) that differed in whether a 3-s delay was imposed before responding. The test card was visible during the delay period for half of the children and occluded for the other children. Preschoolers’ interference control was significantly improved in the delay condition. There was no difference between the two delay variants (test card visible or occluded). Children were more prone to interference as testing progressed regardless of whether the delay was present. These results suggest that delays effectively reduce interference by reducing the potency of the competing response during test trials, although memory demands may moderate the effectiveness of delays.     

The effect of delayed responding on Stroop-like task performance among preschoolers

Forty-four preschoolers completed 2 conditions of a Stroop-like procedure (e.g., saying "boat" for car and "car" for boat) that differed in whether a 3-s delay was imposed before responding. The test card was visible during the delay period for half of the children and occluded for the other children. Preschoolers' interference control was significantly improved in the delay condition. There was no difference between the two delay variants (test card visible or occluded). Children were more prone to interference as testing progressed regardless of whether the delay was present. These results suggest that delays effectively reduce interference by reducing the potency of the competing response during test trials, although memory demands may moderate the effectiveness of delays.     

Reinforcement Delay Fading During Differential Reinforcement of Communication: The Effects of Signals on Response Maintenance

Signals during delays to reinforcement may lessen reductions in responding that typically occur when there is a delay between a response and its reinforcer. Sparse applied research has been devoted to understanding the conditions under which responding may be maintained when delays to reinforcement are introduced. We evaluated the extent to which providing signals during delay fading affected responding in the context of differential reinforcement of communication responses. Three individuals were exposed to gradually increasing signaled and unsignaled reinforcement delays in multiple‐schedule and/or withdrawal designs. Results for 2 of 3 participants suggested that (a) the presence of signals facilitated response maintenance under delayed reinforcement and (b) coordinated basic and applied research may advance both conceptual understanding and clinical outcomes of delayed reinforcement.     

The value hypothesis and acquisition of preference in concurrent chains

Experiment 1 compared the acquisition of initial- and terminal-link responding in concurrent chains. The terminal-link schedules were fixed interval (FI) 10 sec and FI 20 sec, but some presentations were analogous to no-food trials in the peak procedure, lasting 60 sec with no reinforcement delivery. Pigeons completed a series of reversals in which the schedules signaled by the terminal-link stimuli (red and green on the center key) were changed. Acquisition of temporal control of terminal-link responding (as measured by peak location on no-food trials) was more rapid than acquisition of preference in the initial links. Experiment 2 compared acquisition in concurrent chains, using the typical procedure in which the terminal-link schedules are changed with a novel arrangement in which the initial-link key assignments were changed while the terminal-link schedules remained the same. Acquisition of preference was faster in the latter condition, in which the terminal-link stimulus-reinforcer relations were preserved. These experiments provide the first acquisition data that support the view that initial-link preference is determined by the values of the terminal-link stimuli.     

Exchange schedules in token economies: A preliminary investigation of second‐order schedule effects

Basic research shows that token‐production and exchange‐production schedules in token economies affect each other as second‐order schedules (i.e., the exchange‐production schedule's requirements affect responding toward the token‐production schedule). This relationship has not been investigated with children in academic settings despite the widespread use of token economies in this context. This study compared the effects of fixed‐ratio (FR) and variable‐ratio (VR) exchange‐production schedules of equal ratios (2, 5, and 10) on responding toward an FR 1 token‐production schedule with a child diagnosed with autism. A concurrent chains assessment was also conducted to assess the participant's relative preference for FR and VR exchange‐production schedule arrangements within her typical discrete trial training. Results showed no difference in response rate between the two schedule types. However, the concurrent chains assessment revealed an exclusive preference for the VR arrangement.     

CHANGES IN BLOOD PRESSURE AND HEART RATE DURING FIXED‐INTERVAL RESPONDING IN SQUIRREL MONKEYS

Episodic and sustained increases in heart rate and mean arterial blood pressure can occur with recurring patterns of schedule‐controlled behavior. Most previous studies were conducted under fixed‐ratio schedules, which maintained a consistent high rate of responding that alternated with periods of no responding during times when the schedule was not in operation. The present study examined changes in heart rate and blood pressure under fixed‐interval schedules which maintained a range of rates that varied from little or no responding at the beginning of the fixed interval to high rates at the end of the interval. The relations of cardiovascular function to rate of responding were examined. Squirrel monkeys prepared with arterial catheters were trained to respond under fixed‐interval schedules of electric‐shock presentation. The duration of the interval was varied across sessions and cardiovascular parameters were examined. Local rates of responding were typically near zero during timeout periods, low at the beginning of each fixed‐interval cycle, and then increased as the fixed interval progressed. At most schedule durations, arterial blood pressure and heart rate levels were lowest at the beginning of the interval cycles, increased as the rate of responding increased, and then decreased during the timeout periods. At all parameters studied, there was a direct relationship between changes in response rate within fixed‐interval cycles and changes in heart rate and blood pressure. The results suggest that a much closer concordance of these cardiovascular parameters and schedule‐controlled responding is obtained by examining ongoing behavior as it occurs within the contingencies by which it is maintained.     

Effects of signaling on temporal control of behavior in response‐initiated fixed intervals

Behavior and events distributed in time can serve as markers that signal delays to future events. The majority of timing research has focused on how behavior changes as the time to some event, usually food availability, decreases. The primary objective of the two experiments presented here was to assess how behavior changes as time passes between two time markers when the first time marker was manipulated but the second, food delivery, was held constant. Pigeons were exposed to fixed‐interval, response‐initiated fixed‐interval, and signaled response‐initiated fixed‐interval 15‐ and 30‐s schedules of reinforcement. In Experiment 1, first‐response latencies were systematically shorter in the signaled response‐initiated schedules than response‐initiated schedules, suggesting that the first response was a more effective time marker when it was signaled. In Experiment 2, responding in no‐food (i.e. “peak”) trials indicated that timing accuracy was equivalent in the three schedule types. Compared to fixed interval schedules, timing precision was reduced in the signaled response‐initiated schedules and was lowest in response‐initiated schedules. Results from Experiments 1 and 2 coupled with previous research suggest that the overall “informativeness” of a time marker relative to other events and behaviors in the environment may determine its efficacy.     

Changeover delay and concurrent-schedule performance in domestic hens

Six domestic hens were exposed to a series of five pairs of two-key concurrent variable-interval schedules with a range of changeover delays from no delay to 15 s. Times spent responding on each alternative and total, within_, and post-changeover-delay response ratios were analyzed in terms of the generalized matching law. The sensitivity parameters, a, for response and time data were generally low when no changeover delay was programmed but were not 0.0. They were higher for all other changeover-delay values, with some tendency to increase as the changeover delay lengthened at very short delays. Within-delay responding was insensitive to reinforcement-rate differences at all changeover delays (a values close to 0.0). As a result of this insensitivity, post-changeover-delay responding was more sensitive to reinforcement-rate changes than was total responding. Interchangeover intervals increased systematically with changeover-delay duration. Responding, particularly after the changeover delay, was well predicted by an equation based on a reinforcer-loss model.     

Unsignaled delay of reinforcement, relative time, and resistance to change

Two experiments with pigeons examined the effects of unsignaled, nonresetting delays of reinforcement on responding maintained by different reinforcement rates. In Experiment 1, 3-s unsignaled delays were introduced into each component of a multiple variable-interval (VI) 15-s VI 90-s VI 540-s schedule. When considered as a proportion of the preceding immediate reinforcement baseline, responding was decreased similarly for the three multiple-schedule components in both the first six and last six sessions of exposure to the delay. In addition, the relation between response rates and reinforcement rates was altered such that both parameters of the single-response version of the matching law (i.e., k and Re) were decreased. Experiment 2 examined the effects of unsignaled delays ranging from 0.5 s to 8.0 s on responding maintained by a multiple VI 20-s VI 120-s schedule of reinforcement. Response rates in both components increased with brief unsignaled delays and decreased with longer delays. As in Experiment 1, response rates as a proportion of baseline were affected similarly for the two components in both the first six and last six sessions of exposure to the delay. Unlike delays imposed between two stimulus events, the effects of delays between responses and reinforcers do not appear to be attenuated when the average time between reinforcers is longer. In addition, the disruptions produced by unsignaled delays appear to be inconsistent with the general finding that responding maintained by higher rates of reinforcement is less resistant to change.     

Changeover delay effects on topographically tagged discriminative behavior

In a multiple variable-interval extinction schedule, pigeons' responses on an operant key were differentially reinforced in the presence of discriminative stimuli located on a signal key. Changeover delays of zero, one, two, or four seconds specified the time following a signal-key response within which an operant-key response was not reinforced. Systematic reduction of signal-key response rates with increasing changeover-delay duration indicated that signal-key responding was largely maintained by reinforcement of adventitious signal-key/operant-key response chains.     

Disruption of responding maintained by conditioned reinforcement: alterations in response-conditioned-reinforcer relations

An observing procedure was used to investigate the effects of alterations in response-conditioned-reinforcer relations on observing. Pigeons responded to produce schedule-correlated stimuli paired with the availability of food or extinction. The contingency between observing responses and conditioned reinforcement was altered in three experiments. In Experiment 1, after a contingency was established in baseline between the observing response and conditioned reinforcement, it was removed and the schedule-correlated stimuli were presented independently of responding according to a variable-time schedule. The variable-time schedule was constructed such that the rate of stimulus presentations was yoked from baseline. The removal of the observing contingency reliably reduced rates of observing. In Experiment 2, resetting delays to conditioned reinforcement were imposed between observing responses and the schedule-correlated stimuli they produced. Delay values of 0, 0.5, 1, 5, and 10 s were examined. Rates of observing varied inversely as a function of delay value. In Experiment 3, signaled and unsignaled resetting delays between observing responses and schedule-correlated stimuli were compared. Baseline rates of observing were decreased less by signaled delays than by unsignaled delays. Disruptions in response-conditioned-reinforcer relations produce similar behavioral effects to those found with primary reinforcement.     

The effects of the stimulus-reinforcer correlation in a discrete-trials IRT>t procedure

The correlation between a keylight and food in a discrete-trials, interresponse-time-greater-than 6-sec (IRT>6-sec) procedure was varied by manipulating the rate of response-independent food presentation in the intertrial interval. When the correlation was positive, the rates of pecking in the IRT>6-sec condition were high and food was obtained on only about 5% of the trials. Likewise, responding was maintained at a high rate in yoked birds that received the same presentations of the light and food as the birds in the IRT>6-sec condition. When the rate of reinforcement between trials was equated to or made greater than the rate of reinforcement within trials, the response rate decreased for all birds, and those decreases were considerably larger for the yoked birds. However, the percentage of trials in which reinforced responses occurred under the IRT>6-sec procedure did not increase substantially when the light and food were either uncorrelated or negatively correlated. The percentage of trials in which a reinforcer was obtained increased when the keylight was left on continuously and the discriminative stimulus was not presented on the key. The results show that the stimulus-reinforcer correlation affects responding in the discrete-trials IRT>6-sec procedure, but that the effects of the stimulus-reinforcer correlation vary as a function of whether reinforcement is response-dependent or response-independent. The differences between the effects of response-independent and response-dependent pairings and nonpairings of the light and food are best accounted for in terms of differences in the control of responding by background stimuli.     

Transfer of baseline reject control to transitivity trials and its effect on equivalence class formation

This study explored the role of baseline reject control on transitivity responding. In Experiment 1, participants learned to respond to a baseline of arbitrary AB and AC conditional relations, and then they were exposed to transitivity‐like BC and CB trials in which the correct comparison stimulus was replaced by a novel stimulus (D). Five of 10 participants selected stimulus D, but only 1 showed expansion of the baseline stimulus classes to include the D stimuli. In Experiment 2, the emergence of symmetry and transitivity from baseline relations was assessed before participants were exposed to the transitivity‐like trials. Six of 8 participants who showed emergence of equivalence relations selected the D stimuli on transitivity‐like trials and provided evidence that baseline classes expanded to include these stimuli. In Experiment 3, these 6 participants selected novel stimuli (E) in additional transitivity‐like trials, and all showed that the E stimuli had become members of the previously established classes, which now comprised 5 members. A route for the emergence of transitivity by way of the transfer of baseline between‐classes reject control is discussed.     

Abortive responding during punishment of bar holding

A continuous chain of homogeneous responding was established in rats by training animals to hold a lever down for 10 sec or longer before releasing it for food reinforcement. When criterion releases were subsequently punished, completed holding chains were greatly suppressed, aborted chains increased markedly, while the rate of chain initiations remained unchanged.     

DOES SENSITIVITY TO MAGNITUDE DEPEND ON THE TEMPORAL DISTRIBUTION OF REINFORCEMENT?

Our research addressed the question of whether sensitivity to relative reinforcer magnitude in concurrent chains depends on the distribution of reinforcer delays when the terminal-link schedules are equal. In Experiment 1, 12 pigeons responded in a two-component procedure. In both components, the initial links were concurrent variable-interval 40-s variable-interval 40-s, and the terminal links were both 20-s interval schedules in which responses were reinforced by either 4-s of grain in one, or 2-s of grain in the other. The only difference between the components was whether the terminal-link schedules were fixed interval or variable intervals. For all subjects, the relative rate of responding in the initial links for the terminal link that produced the 4-s reinforcer was greater when the terminal links were fixed-interval schedules than when they were variable-interval schedules. This result is contrary to the prediction of Grace's (1994) contextual choice model, but is consistent with both Mazur's (2001) hyperbolic value-added model and Killeen's (1985) incentive theory. In Experiment 2, 4 pigeons responded in a concurrent-chains procedure in which 4-s or 2-s reinforcers were provided independently of responding according to equal fixed-time or mixed-time schedules. Preference for the 4-s reinforcer increased as the variability of the intervals comprising the mixed-time schedules was decreased. Generalized-matching sensitivity of initial-link response allocation to relative reinforcer magnitude was proportional to the geometric mean of the terminal-link delays.     

Human risky choice under temporal constraints: tests of an energy-budget model

Risk-sensitive foraging models predict that choice between fixed and variable food delays should be influenced by an organism's energy budget. To investigate whether the predictions of these models could be extended to choice in humans, risk sensitivity in 4 adults was investigated under laboratory conditions designed to model positive and negative energy budgets. Subjects chose between fixed and variable trial durations with the same mean value. An energy requirement was modeled by requiring that five trials be completed within a limited time period for points delivered at the end of the period (block of trials) to be exchanged later for money. Manipulating the duration of this time period generated positive and negative earnings budgets (or, alternatively, "time budgets"). Choices were consistent with the predictions of energy-budget models: The fixed-delay option was strongly preferred under positive earnings-budget conditions and the variable-delay option was strongly preferred under negative earnings-budget conditions. Within-block (or trial-by-trial) choices were also frequently consistent with the predictions of a dynamic optimization model, indicating that choice was simultaneously sensitive to the temporal requirements, delays associated with fixed and variable choices on the upcoming trial, cumulative delays within the block of trials, and trial position within a block.     

A two-choice sound localization procedure for detecting lateralized tinnitus in animals

Rats were trained in a two-choice procedure to respond in the direction of left and right sounds. Silent trials, on which no sound was presented and for which the animals received no feedback, were interspersed among the sound trials to determine each animal’s natural side preference. Following training, the rats were exposed to a loud tone in the ear opposite their side preference. A shift in responding on the silent trials to the side of the exposed ear indicated that the animals were hearing a sound in that ear (i.e., tinnitus). Simulating lateralized tinnitus by presenting a low-level, continuous sound on one side also caused the rats to shift their responding on the silent trials to that side. Sham exposures indicated that halothane/nitrous oxide anesthesia could reinstate tinnitus in animals that had previously tested positive for it. Exposing rats to loud tones of various frequencies indicated that frequencies near the limits of the rat’s hearing range were less likely to cause tinnitus than tones in the midrange.     

Delayed matching-to-sample performance: Effects of relative reinforcer frequency and of signaled versus unsignaled reinforcer magnitudes

Six pigeons were trained on a delayed red-green matching-to-sample task that arranged four delays within sessions. Matching responses intermittently produced either 1.5-s access to food or 4.5-s access to food, and nonmatching responses produced either 1.5-s or 4.5-s blackout. Two phases were conducted: a signaled phase in which the reinforcer magnitudes (small and large) were signaled by houselights (positioned either on the left or right of the chamber), and an unsignaled phase in which there was no correlation between reinforcer magnitude and houselight position. In both phases, the relative frequency with which red and green matching responses produced food was varied across five values. Both matching accuracy and the sensitivity of performance to the distribution of reinforcers for matching responses decreased with increasing delays in both phases. In addition, accuracy and reinforcer sensitivity were significantly lower on signaled small-reinforcer trials compared with accuracy and sensitivity values on signaled large-reinforcer trials and on both types of unsignaled trials. These results are discussed in the context of research on both nonhuman animal and human memory.     

COMPARISON OF DATA‐COLLECTION METHODS IN A BEHAVIORAL INTERVENTION PROGRAM FOR CHILDREN WITH PERVASIVE DEVELOPMENTAL DISORDERS: A REPLICATION

Cummings and Carr (2009) compared two methods of data collection in a behavioral intervention program for children with pervasive developmental disorders: collecting data on all trials versus only the first trial in a session. Results showed that basing a child's progress on first‐trial data resulted in identifying mastery‐level responding slightly sooner, whereas determining mastery based on all trials resulted in slightly better skill maintenance. In the current replication, no such differences in indication of mastery or maintenance were observed when data were collected on all trials or the first trial.