Using hardware interrupts for timing visual displays and reaction-time key interfacing on the Commodore 64

The use of hardware interrupts for presenting and timing visual displays and for controlling reaction timing on the Commodore 64 is described. The three sources of interrupts discussed are reaction-time keys interfaced through the user port to on-board hardware timers, the alarm of the 60-Hz real-time clocks, and the video raster. In a demonstration program, these interrupts are used to measure display durations, to change screen displays, and to coordinate the onset of reaction timing with the onset of screen changes. In addition, an externally generated interrupt caused by a keypress is used to control reaction timing independently of CPU operations.     

Renewal of Extinguished Lever-Press Responses upon Return to the Training Context

Two experiments with rats explored renewal effects in operant conditioning preparations. When pressing a lever was trained in one context and then extinguished in a second context, the responding was renewed by returning to the original context (ABA renewal) in Experiment 1. This finding was replicated in Experiment 2 with discriminative operant performance signaled by a localized light cue. In spite of the successful demonstration of ABA renewal effect in these experiments, AAB renewal was detected in neither experiment: When the responses had been extinguished in the context of acquisition, testing the rats in a second context did not renew the responses. The demonstration of ABA renewal but no AAB renewal suggests that extinction in another context and/or a return to the original context are critical for renewal of extinguished operant performance.     

Effect of drugs on response-duration differentiation VII: response-force requirements

Rats were trained to press a lever for at least 1 s but for less than 1.3 s. The force required to press the lever was then increased or decreased by 10, 15, or 20 g. Increases in the force requirements for lever pressing decreased timing accuracy, but decreases in the force requirement had the opposite effect. Accuracy decreases at increasing force requirements were characterized by an increase in the relative frequency of responses that were too short to meet the reinforcement criterion. In contrast, increases in accuracy when the force requirements were decreased were characterized by increases in response durations that met the reinforcement criterion and decreases in the relative frequency of responses that were too short to produce the reinforcer. Phencyclidine (PCP) and methamphetamine produced dose-dependent decreases in accuracy that were associated primarily with increases in the relative frequency of short response durations, although methamphetamine also produced increases in long response durations at some doses. When the effects of PCP were determined with the force requirement increased by 10 g or decreased by 15 g, the cumulative response-duration distribution shifted toward even shorter response durations. When the effects of methamphetamine were determined with the force requirement on the lever increased by 10 g, the cumulative frequency distribution was shifted toward shorter response durations to about the same extent as it had been before force requirements increased; however, when the force required to press the lever was decreased by 15 g, these shifts toward shorter response durations almost completely disappeared. These results show that increases and decreases in the force requirements for lever pressing have different effects on the accuracy of temporal response differentiation.     

Contingency tracking during unsignaled delayed reinforcement

Three experiments were conducted with rats in which responses on one lever (labeled the functional lever) produced reinforcers after an unsignaled delay period that reset with each response during the delay. Responses on a second, nonfunctional, lever did not initiate delays, but, in the first and third experiments, such responses during the last 10 s of a delay did postpone food delivery another 10 s. In the first experiment, the location of the two levers was reversed several times. Responding generally was higher on the functional lever, though the magnitude of the difference diminished with successive reversals. In the second experiment, once a delay was initiated by a response on the functional lever, in different conditions responses on the nonfunctional lever either had no effect or postponed food delivery by 30 s. The latter contingency typically lowered response rates on the nonfunctional lever. In the first two experiments, both the functional and nonfunctional levers were identical except for their location; in the third experiment, initially, a vertically mounted, pole-push lever defined the functional response and a horizontally mounted lever defined the nonfunctional response. Higher response rates occurred on the functional lever. These results taken together suggest that responding generally tracked the response-reinforcer contingency. The results further show how nonfunctional-operanda responses are controlled by a prior history of direct reinforcement of such responses, by the temporal delay between such responses and food delivery, and as simple generalization between the two operanda.     

Amiga 1000 hardware timing and reaction-time key interfacing

A method of hardware reaction timing with millisecond accuracy, using one of the Amiga’s CIA 8520 chips, is described. The registers of this chip can be set to enable cascaded timing that functions independently of the CPU and, thereby, avoids the problems of software timing in a multitasking environment. In addition, the interfacing of a pair of reaction-time keys to one of the Amiga’s game controller connectors and a program for polling this port for keypresses are described.     

Experimental control programs for the UNIX operating system

The software described runs on Version 7 UNIX, although most run on earlier versions. Using the curses package requires two program libraries from the Fourth Berkeley Distribution (CURSES and TERMLIB). Using any of the functions requires knowledge of programming, preferably in C (Kernighan & Richie, 1978), but the sample experimental control program is usable by nonprogrammers. Because no special hardware is assumed, the resolution of timed presentations and reaction time recordings may not be accurate enough for some purposes. Functions for stimulus presentation have a resolution of 1 sec, and those for timing responses are accurate to about 17 msec.     

Choice in the time-left procedure and in concurrent chains with a time-left terminal link.

In two experiments, rats chose between a standard fixed-duration food-associated stimulus and a stimulus whose duration was the time remaining to reinforcement in an elapsing comparison interval. In Experiment 1, 4 rats responded in a time-left procedure wherein a single initial-link variable-interval schedule set up two potential terminal links simultaneously. As time elapsed in the initial-link schedule, the choice was between a standard fixed-interval 30-s terminal link and a time-left terminal link whose programmed interval requirement equaled 90 s minus the elapsed time in the initial link. Rats generally responded more on the lever with the shortest programmed terminal-link duration, but the temporal parameters of the procedure were found to vary with response distributions. Contrary to previous reports, therefore, time-left data were well predicted by choice models that make no assumptions about animal timing. In Experiment 2, 8 rats responded on a concurrent-chains schedule with independent variable-interval initial links and a time-left terminal link in one of the choice schedules. On the time-left lever, the programmed terminal-link delay equaled 90 s minus the elapsed time in the time-left initial link. On the standard lever, terminal-link responses were reinforced according to a variable-interval schedule whose average value varied over four conditions. Relative time-left initial-link responses increased in the elapsing time-left initial-link schedule as the time-left terminal link became shorter relative to the standard terminal link. Scalar expectancy theory failed to predict the resultant data, but a modified version of the delay-reduction model made good predictions. An analysis of the elaboration of scalar expectancy theory for variable delays demonstrated that the model is poorly formulated for arithmetically distributed delays.     

Orbital prefrontal cortex and guidance of instrumental behavior of rats by visuospatial stimuli predicting reward magnitude

The orbital prefrontal cortex (OPFC) is part of a circuitry mediating the perception of reward and the initiation of adaptive behavioral responses. We investigated whether the OPFC is involved in guidance of the speed of instrumental behavior by visuospatial stimuli predictive of different reward magnitudes. Unoperated rats, sham-lesioned rats, and rats with bilateral lesions of the OPFC by N-methyl-D-aspartate (NMDA) were trained in a visuospatial discrimination task. The task required a lever press on the illuminated lever of two available to obtain a food reward. Different reward magnitudes were permanently assigned to lever presses to respective sides of the operant chamber; that is, responses to one lever (e.g., the left one) were always rewarded with one pellet and responses to the other lever with five pellets. On each trial, the position of the illuminated lever was pseudorandomly determined in advance. Results revealed that OPFC lesions did not impair acquisition of the task, as the speed of conditioned responses was significantly shorter with expectancy of a high reward magnitude. In addition, during reversal, shift and reshift of lever position–reward magnitude contingencies and under extinction conditions, performance of the OPFC-lesioned and control groups did not differ. It is concluded that the OPFC in rats might not be critical for adapting behavioral responses to changes of stimulus–reward magnitude contingencies signaled by visuospatial cues.     

The 3RT Test: Three reaction time tasks for IBM PC computers

The 3RT Test consists of a simple, a choice, and a conditional reaction time (RT) task. The three tasks involve comparable visual stimuli and require identical manual responses, but they differ in the complexity of cognitive processing required. The nonverbal stimuli convey commonly known meanings. Responses can be made either on the keyboard or on response keys connected to the computer’s serial port. The computer’s internal timer/counter is used for millisecond timing. The test administration program allows flexible setting of the test conditions. The data analysis program provides summary data not only for each RT task as a whole, but also for separate trial types within each task. Summary statistics include measures of variation and central value that are not affected by extreme scores. In addition to laboratory studies with normal adults, the 3RT Test is suitable for life-span developmental studies, cross-cultural comparisons, and other uses in various clinical settings.     

Concurrent variable-ratio schedules: Implications for the generalized matching law

Rats' responses were reinforced on concurrent variable-ratio variable-ratio schedules in which responses on one lever incremented the ratio counter and responses on a second lever changed the schedule and correlated stimulus. The relative frequency of reinforcement was varied from .10 to .99. In one set of conditions, responding on the main lever incremented both ratio counters, but reinforcement required a response in the presence of the stimulus correlated with the ratio that had been completed. In a second set of conditions, responses on the main lever incremented only the ratio correlated with the stimulus that was currently present. When main-lever responses incremented both ratio counters, subjects distributed responding and time in a manner consistent with the generalized matching law. When responses on the main lever incremented only the schedule currently in effect, the rats responded almost exclusively on the schedule producing the higher frequency of reinforcement. These results extend the applicability of the generalized matching law to dependent ratio schedules.     

Some factors involved in the comparison of response systems: acquisition, extinction, and transfer of head-poke and lever-press Sidman avoidance

Head poking, a suggested natural escape reaction to shock for the rat, was compared to lever pressing in a Sidman avoidance study. Both responses could be emitted at any time, but only one was effective in a given session. Acquisition and extinction of the two responses were compared under both signalled and unsignalled avoidance. Then, a test for transfer was conducted in which acquisition conditions were re-instated, but the effectiveness of the responses was reversed. Three differences between responses were noted: (a) head poking was superior in reducing shock rates under signalled conditions; (b) head poking was more resistant to extinction, especially under signalled conditions; (c) under unsignalled conditions, animals were unable to learn to head poke if they had previously learned to lever press. Findings a and c were pursued in later experiments. Finding a depended on the location of the warning signal with respect to the response system. When the lever press required approach to the warning signal, the head poke was superior. But when the head poke required approach to the warning signal, the two responses were equally effective. Finding c depended on the absence of feedback for head poke during transfer. Two conclusions are offered: first, the two responses appear to obey the same laws when their topographical differences are taken into account. Second, response feedback appears to be more critical in transfer than in original acquisition.     

ASSESSING THE ROLE OF EFFORT REDUCTION IN THE REINFORCING EFFICACY OF TIMEOUT FROM AVOIDANCE

Rats responded on concurrent schedules of shock‐postponement or deletion (avoidance) and timeout from avoidance. In Experiment 1, 3 rats' responses on one lever postponed shocks for 20 s and responses on a second lever produced a 1‐min timeout according to a variable‐interval 45‐s schedule. Across conditions, a warning signal (white noise) was presented 19.5 s, 16 s, 12 s, 8 s, or 4 s before an impending shock. Raising the duration of the warning signal increased both avoidance and timeout response rates. Timeout responding, although positively correlated with avoidance responding, was not correlated with the prevailing shock rate. In Experiment 2, 3 rats' responses on one lever deleted scheduled shocks according to a variable‐cycle 30‐s schedule and responses on a second lever produced a 2‐min timeout as described above. After this baseline condition, the avoidance lever was removed and noncontingent shocks were delivered at intervals yoked to the receipt of shocks in the baseline sessions. Timeout responding decreased when the avoidance lever was removed, even though the shock‐frequency reduction afforded by the timeout remained constant. These results suggest that a key factor in the reinforcing efficacy of timeout is suspension of the requirement to work to avoid shock, rather than the reduction in shock frequency associated with timeout.     

Conditioned suppression of counting behavior in rats

Three rats were trained on a schedule in which a response on lever B was reinforced only if it was preceded by a minimum number of consecutive responses on lever A. The minimum requirement was 27 A responses for Rat 1, and 20 A responses for Rats 2 and 3. The schedule maintained high rates of responding on lever A, and a slow, spaced pattern of responding on lever B. The mean number of consecutive responses on lever A was slightly greater than the minimum required. The effect of superimposing on this behavior a stimulus that ended with an unavoidable shock was the suppression of responding on both levers during the pre-shock stimulus. Responses on lever A were more suppressed, and the proportion of relatively short response runs on lever A during the pre-shock stimulus increased. With all three rats, the mean number of consecutive responses on lever A during the pre-shock stimulus decreased to a value below the minimum requirement for reinforcement of the subsequent B response.     

Vocal and nonvocal discriminative performance in monkeys

Discriminative performance of a lever press and a vocal call was compared in five macaques. The animals exhibited similar scores for Response Rate, Efficiency, and Error Index. Total vocal responses were slightly higher than total lever responses. Latency for vocal responses was significantly greater than lever press. Similar scores in measures of performance of the two behaviors indicate that discriminative vocalization is not exceedingly difficult. Failure by others to achieve discriminative vocalization in studies employing weak positive-reinforcement contingencies suggest that certain experimental paradigms are unsatisfactory for vocal conditioning.     

Extinction of responding maintained by timeout from avoidance

The resistance to extinction of lever pressing maintained by timeout from avoidance was examined. Rats were trained under a concurrent schedule in which responses on one lever postponed shock on a free-operant avoidance (Sidman) schedule (response-shock interval = 30 s) and responses on another lever produced 2 min of signaled timeout from avoidance on a variable-ratio 15 schedule. Following extended training (106 to 363 2-hr sessions), two experiments were conducted. In Experiment 1 two different methods of extinction were compared. In one session, all shocks were omitted, and there was some weakening of avoidance but little change in timeout responding. In another session, responding on the timeout lever was ineffective, and under these conditions timeout responding showed rapid extinction. The within-session patterns produced by extinction manipulations were different than the effects of drugs such as morphine, which also reduces timeout responding. In Experiment 2 shock was omitted for many consecutive sessions. Response rates on the avoidance lever declined relatively rapidly, with noticeable reductions within 5 to 10 sessions. Extinction of the timeout lever response was much slower than extinction of avoidance in all 4 rats, and 2 rats continued responding at baseline levels for more than 20 extinction sessions. These results show that lever pressing maintained by negative reinforcement can be highly resistant to extinction. The persistence of responding on the timeout lever after avoidance extinction is not readily explained by current theories.     

Analysis of us-preexposure effects in appetitive conditioning

In two experiments, rats received preexposure to one type of food followed by autoshaping in which presentation of one lever was associated with the preexposed food, and presentation of another lever with a novel type of food pellet. In both it was found that acquisition of the leverpress response occurred more readily on the lever associated with the novel food. This example of the US (unconditioned stimulus) preexposure effect is not to be explained in terms of the development of competing responses during preexposure. Explanations in terms of blocking by contextual cues and of habituation to the US are considered.     

When do motor behaviors (mis)match affective stimuli? An evaluative coding view of approach and avoidance reactions

Affective-mapping effects between affective stimuli and lever movements are critically dependent upon the evaluative meaning of the response labels that are used in the task instructions. In Experiments 1 and 2, affective-mapping effects predicted by specific-muscle-activation and distance-regulation accounts were replicated when the standard response labels towards and away were used but were reversed when identical lever movements were labeled downwards and upwards. In Experiment 3, affective-mapping effects were produced with affectively labeled right and left lever movements that are intrinsically unrelated to approach and avoidance. Experiments 4 and 5 revealed that affective-mapping effects are not mediated by memory retrieval processes and depend on the execution of affectively coded responses. The results support the assumption that evaluative implications of action instructions assign affective codes to motor responses on a representational level that interact with stimulus evaluations on a response selection stage.     

Effects of d-amphetamine on observing behavior in the squirrel monkey

Four squirrel monkeys were trained to press a lever, which produced stimuli indicating availability or non-availability of reinforcement for pushing a key. Food reinforcements were available for the key response at random intervals with an average rate of 1 per min. When food was available, a single lever response produced a red light behind the key. Reinforcement availabilities and red keylights remained until terminated by a reinforced key response. When reinforcement was not available, each lever response produced a 0.5-sec green light on the key. Except after lever responses, the key remained dark. Under this procedure, lever responses functioned as observing behavior in that they produced discriminative stimuli correlated with the availability or non-availability of reinforcement for key responses. The procedure generated a high rate of responding on the lever, short latencies of the key response after onset of red lights and few responses to the key in the absence of red lights. Intra-muscular d-amphetamine, in doses from 0.125 to 1.0 mg/kg, abolished both observing behavior and key responding for periods that increased as a function of dose. However, both observing and key rates were increased at the smallest dose in two subjects whose performances included responding to the key in the absence of red lights. Results are discussed in relation to previous findings regarding effects of amphetamines on operant behavior and on observing and monitoring performance.     

Parameter value switching in discrete and continuous aiming movements

The effect of practice variations on spatial and temporal accuracy was investigated in both discrete and continuous aiming movements in the preferred hand of college-aged participants (N=25). In a completely within-subject design, participants made rapid reversal movements with a lightweight lever in the sagittal plane, practicing 20 degrees and 60 degrees movements in repeated (same distance) and alternating (switching between 20 degrees and 60 degrees) conditions. Movements were also made one at a time (discretely) or in sequences of 20 movements (continuously). Spatial constant error, spatial variable error, spatial overall error, the coefficient of variation, movement time, and the relative timing were calculated for each set of 20 movements and analyzed by within-subject analyses of variance. Movements in the repeated conditions for both discrete and continuous movements were more accurate and consistent compared to the alternating condition where the short movements were overshot and the long movements were undershot. Discrete movements were more spatially and temporally variable than continuous movements. The discrete and continuous movements showed different relative timing patterns, suggesting that the temporal structure of the motor program is affected by task characteristics.     

Drug discrimination in rats under concurrent variable-interval variable-interval schedules

Eight rats were trained to discriminate pentobarbital from saline under a concurrent variable-interval (VI) VI schedule, on which responses on the pentobarbital-biased lever after pentobarbital were reinforced under VI 20 s and responses on the saline-biased lever were reinforced under VI 80 s. After saline, the reinforcement contingencies programmed on the two levers were reversed. The rats made 62.3% of their responses on the pentobarbital-biased lever after pentobarbital and 72.2% on the saline-biased lever after saline, both of which are lower than predicted by the matching law. When the schedule was changed to concurrent VI 50 s VI 50 s for test sessions with saline and the training dose of pentobarbital, responding on the pentobarbital-biased lever after the training dose of pentobarbital and on the saline-biased lever after saline became nearly equal, even during the first 2 min of the session, suggesting that the presence or absence of the training drug was exerting minimal control over responding and making the determination of dose-effect relations of drugs difficult to interpret. When the pentobarbital dose-response curve was determined under the concurrent VI 50-s VI 50-s schedule, responding was fairly evenly distributed on both levers for most rats. Therefore, 6 additional rats were trained to respond under a concurrent VI 60-s VI 240-s schedule. Under this schedule, the rats made 62.6% of their responses on the pentobarbital-biased lever after pentobarbital and 73.5% of their responses on the saline-biased lever after saline, which also is lower than the percentages predicted by perfect matching. When the schedule was changed to a concurrent VI 150-s VI 150-s schedule for 5-min test sessions with additional drugs, the presence or absence of pentobarbital continued to control responding in most rats, and it was possible to generate graded dose-response curves for pentobarbital and other drugs using the data from these 5-min sessions. The dose-response curves generated under these conditions were similar to the dose-response curves generated using other reinforcement schedules and other species.