Effects of magnitude of food reinforcement on free-operant response rates

In Experiment 1 rats were trained to press a lever on a variable-ratio schedule of food presentation and were then exposed to progressively increasing magnitudes of food reinforcement. Response running rates (rates exclusive of the postreinforcement pause) were found to increase as a function of increasing reinforcement magnitudes. The effect of reinforcement magnitude on response rates inclusive of the postreinforcement pause, however, was less pronounced. Increases in the magnitude of reinforcement were also found to increase the length of the postreinforcement pause. Rats in Experiment 2 were trained to respond on a chained differential-reinforcement-of-low-rate variable-ratio schedule, and were exposed to increasing magnitudes of reinforcement as in Experiment 1. Response running rates increased in the variable-ratio component but decreased in the other component of the schedule. The results are discussed with reference to incentive accounts of reinforcement and the action of reinforcement on the response units generated by the operative contingencies.     

Choice with a fixed requirement for food, and the generality of the matching relation

Pigeons were trained on choice procedures in which responses on each of two keys were reinforced probabilistically, but only after a schedule requirement had been met. Under one arrangement, a fixed-interval choice procedure was used in which responses were not reinforced until the interval was over; then a response on one key would be reinforced, with the effective key changing irregularly from interval to interval. Under a second, fixed-ratio choice procedure, responses on either key counted towards completion of the ratio and then, once the ratio had been completed, a response on the probabilistically selected key would produce food. In one experiment, the schedule requirements were varied for both fixed-interval and fixed-ratio schedules. In the second experiment, relative reinforcement rate was varied. And in a third experiment, the duration of an intertrial interval separating choices was varied. The results for 11 pigeons across all three experiments indicate that there were often large deviations between relative response rates and relative reinforcement rates. Overall performance measures were characterized by a great deal of variability across conditions. More detailed measures of choice across the schedule requirement were also quite variable across conditions. In spite of this variability, performance was consistent across conditions in its efficiency of producing food. The absence of matching of behavior allocation to reinforcement rate indicates an important difference between the present procedures and other choice procedures; that difference raises questions about the specific conditions that lead to matching as an outcome.     

Variable-ratio schedules as variable-interval schedules with linear feedback loops.

The mathematical theory of linear systems has been used successfully to describe responding on variable-interval (VI) schedules. In the simplest extension of the theory to the variable-ratio (VR) case, VR schedules are treated as if they were VI schedules with linear feedback loops. The assumption entailed by this approach, namely, that VR and VI-plus-linear-feedback schedules are equivalent, was tested by comparing responding on the two types of schedule. Four human subjects' lever pressing produced monetary reinforcers on five VR schedules, and on five VI schedules with linear feedback loops that reproduced the feedback properties of the VR schedules. Pressing was initiated by instructions in 2 subjects, and was shaped by successive approximation in the other 2. The different methods of response initiation did not have differential effects on behavior. For each of the 4 subjects, the VR and the comparable VI-plus-linear-feedback schedules generated similar average response rates and similar response patterns. The subjects' behavior on both types of schedule was similar to that of avian and rodent species on VR schedules. These results indicate that the assumption entailed by the VI-plus-linear-feedback approach to the VR case is valid and, consequently, that the approach is worth pursuing. The results also confute interresponse-time theories of schedule performance, which require interval and ratio contingencies to produce different response rates.     

A comparison of delays and ratio requirements in self-control choice.

In a discrete-trial procedure, pigeons could choose between 2-s and 6-s access to grain by making a single key peck. In Phase 1, the pigeons obtained both reinforcers by responding on fixed-ratio schedules. In Phase 2, they received both reinforcers after simple delays, arranged by fixed-time schedules, during which no responses were required. In Phase 3, the 2-s reinforcer was available through a fixed-time schedule and the 6-s reinforcer was available through a fixed-ratio schedule. In all conditions, the size of the delay or ratio leading to the 6-s reinforcer was systematically increased or decreased several times each session, permitting estimation of an "indifference point," the schedule size at which a subject chose each alternative equally often. By varying the size of the schedule for the 2-s reinforcer across conditions, several such indifference points were obtained from both fixed-time conditions and fixed-ratio conditions. The resulting "indifference curves" from fixed-time conditions and from fixed-ratio conditions were similar in shape, and they suggested that a hyperbolic equation describes the relation between ratio size and reinforcement value as well as the relation between reinforcer delay and its reinforcement value. The results from Phase 3 showed that subjects chose fixed-time schedules over fixed-ratio schedules that generated the same average times between a choice response and reinforcement.     

Transfer of matching performance in pigeons.

Three pigeons were given extensive training on three-key simultaneous matching problems using geometric-form and hue stimuli. After acquisition of matching, the birds were tested with pairs of stimuli involving one or both novel members. Matching during the test stimuli occurred less often than during the later stages of the acquisition phase, but more often than would occur if no transfer had taken place. Greater positive transfer was observed for problems that involved one, rather than two, novel stimuli. In the second phase of the experiment, previously trained birds were shifted to problems that required symbolic matching, i.e., the pigeons had to associate a particular center-key stimulus with a particular side-key stimulus. On each trial, one of two simuli was presented on the center key, and two other stimuli, different from those used on the center key, were displayed on the side keys. When the problem shift was introduced, correct responding was impaired, but remained considerably above chance level and quickly recovered in following sessions. The results were interpreted as favoring a stimulus-response-chaining account of matching behavior.     

Pentobarbital and d-amphetamine effects on concurrent performances.

The effects of pentobarbital and d-amphetamine were studied in pigeons responding under several concurrent fixed-ratio variable-interval and concurrent fixed-ratio fixed-interval schedules of food presentation. Drug effects were compared with different fixed ratios, fixed and variable intervals, changeover delays, and with the schedules operating singly. Doses of d-amphetamine that increased or did not affect responding under the interval schedules decreased responding under the fixed-ratio schedule, whereas doses of pentobarbital that increased responding under the fixed-ratio schedule decreased or eliminated responding under the interval schedules. These effects depended both on the schedule of food delivery and the parameters of schedules arranged concurrently. Pentobarbital increased responding under the fixed-ratio schedule with 4-minute and 10-minute interval schedules arranged concurrently, but not with 1.5-minute schedules. d-Amphetamine decreased concurrent ratio and interval responding with the 1.5-minute interval schedules, but either increased or did not affect responding with the longer intervals. Changes in the parameter of one schedule altered responding controlled by that schedule and also other concurrent performances. As a consequence, the effects of drugs on each behavior were altered.     

Naming and categorization in young children: III. Vocal tact training and transfer of function

Following pretraining with everyday objects, 10 children aged from 1 to 4 years were given common vocal tact training with a set of three pairs of arbitrary stimuli of differing shapes; Set 1. Nine children learned to tact one stimulus as "zog" and the other as "vek" in each pair, and all passed subsequent pairwise tests for the corresponding listener behavior to each listener stimulus (i.e., /zog/ and /vek/, respectively). The children were next trained to clap to one stimulus of Pair 1 and wave to the other, and all then showed name-consistent transfer of these behaviors to the stimuli of Pair 2 and Pair 3. Seven children also were given a test of listener responding to experimenter-modeled clap and wave gestures, respectively, which they all passed. Four of the children next participated in a category match-to-sample test for the Set 1 stimuli; all 4 passed. For each pair of two additional six-stimuli sets, Set 2 and Set 3, 3 children were trained to wave to one stimulus and to clap to the other. For each set, all 3 children showed perfect transfer of the vocal tacts trained to Set 1, and of listener behavior both to the auditory stimuli /zog/ and /vek/ and to experimenter-modeled clap and wave gestures. They also sorted the stimuli perfectly in category match-to-sample tests for Set 2, Sets 1 and 2 combined, Set 3, and Sets 1, 2, and 3 combined. The results show that even in very young children, naming is a powerful means of generating new category relations among as many as 18 arbitrary stimuli.     

Effects of reinforcement schedule on facilitation of operant extinction by chlordiazepoxide

Learning and memory are central topics in behavioral neuroscience, and inbred mice strains are widely investigated. However, operant conditioning techniques are not as extensively used in this field as they should be, given the effectiveness of the methodology of the experimental analysis of behavior. In the present study, male C57B1/6 mice, widely used as background for transgenic studies, were trained to lever press on discrete-trial fixed-ratio 5 or fixed-interval (11 s or 31 s) schedules of food reinforcement and then exposed to 15 extinction sessions following vehicle or chlordiazepoxide injections (15 mg/kg i.p., administered either prior to all extinction sessions, or prior to the final 10 extinction sessions). Extinction of operant behavior was facilitated by drug administration following training on either schedule, but this facilitation only occurred once a number of extinction sessions had taken place. The extinction process proceeded more rapidly following fixed-interval training. Resistance to extinction was equally high following training with either schedule type, and was reduced by drug administration in both cases. These phenomena were evident in individual cumulative records and in analyses of group data. Results are interpreted in terms of phenomena of operant extinction identified in Skinner's (1938) Behavior of Organisms, and by behavioral momentum theory. These procedures could be used to extend the contribution of operant conditioning to contemporary behavioral neuroscience.     

On muthén’s maximum likelihood for two-level covariance structure models

Data in social and behavioral sciences are often hierarchically organized. Special statistical procedures that take into account the dependence of such observations have been developed. Among procedures for 2-level covariance structure analysis, Muthén’s maximum likelihood (MUML) has the advantage of easier computation and faster convergence. When data are balanced, MUML is equivalent to the maximum likelihood procedure. Simulation results in the literature endorse the MUML procedure also for unbalanced data. This paper studies the analytical properties of the MUML procedure in general. The results indicate that the MUML procedure leads to correct model inference asymptotically when level-2 sample size goes to infinity and the coefficient of variation of the level-1 sample sizes goes to zero. The study clearly identifies the impact of level-1 and level-2 sample sizes on the standard errors and test statistic of the MUML procedure. Analytical results explain previous simulation results and will guide the design or data collection for the future applications of MUML.This research was supported by NSF Grant DMS04-37167.We thank Dr.Bengt Muthén for providing key references. We are also grateful to three expert reviewers for their constructive comments that have led the paper to an improvement over the previous version.This revised article was published online in August 2005 with the PDF paginated correctly.     

Male physical attractiveness in Britain and Malaysia: A cross-cultural study

Three purported cues to perceived male physical attractiveness are the waist-to-chest ratio (WCR), body mass index (BMI) and the waist-to-hip ratio (WHR). This study examined the relative contribution of each cue in several socio-economically distinct populations. Ninety-five female participants from Britain and Malaysia were asked to rate a set of images of real men with known WCR, BMI and WHR. The results showed clear differences along a gradient of socio-economic development. In urban settings, WCR was the primary component of attractiveness ratings, with BMI playing a smaller role and WHR not reaching significance. In the rural setting, BMI was the primary predictor of attractiveness, with WCR playing a more minor role and WHR not reaching significance. In general, urban participants were more reliant on body shape and chose a relatively slim figure with an ‘inverted triangle’ shape; rural participants were more reliant on body weight and chose a heavier figure with a less triangular shape. These findings are discussed in terms of evolutionary psychological explanations of mate selection and sociological theories that emphasise the effect of resource scarcity on preferences for body shapes and sizes.