Testing the efficiency of Markov chain Monte Carlo with People using facial affect categories

Exploring how people represent natural categories is a key step toward developing a better understanding of how people learn, form memories, and make decisions. Much research on categorization has focused on artificial categories that are created in the laboratory, since studying natural categories defined on high-dimensional stimuli such as images is methodologically challenging. Recent work has produced methods for identifying these representations from observed behavior, such as reverse correlation (RC). We compare RC against an alternative method for inferring the structure of natural categories called Markov chain Monte Carlo with People (MCMCP). Based on an algorithm used in computer science and statistics, MCMCP provides a way to sample from the set of stimuli associated with a natural category. We apply MCMCP and RC to the problem of recovering natural categories that correspond to two kinds of facial affect (happy and sad) from realistic images of faces. Our results show that MCMCP requires fewer trials to obtain a higher quality estimate of people's mental representations of these two categories.     

Effects of atropine on the repeated acquisition and performance of response sequences in humans.

The present study assessed a 24-hr time course for the acute effects of intramuscular injections of atropine sulfate (0, 1.5, 3.0, and 6.0 mg/70 kg) in healthy adult humans responding under a two-component multiple schedule of repeated acquisition and performance of response sequences. Subjects resided in an inpatient research ward for the duration of the study. In each component of the multiple schedule, subjects completed a different sequence of 10 responses in a predetermined order using three keys of a numeric keypad. In the acquisition component, the subjects' task was to acquire a new sequence each session. Eight sessions were conducted daily: one immediately before administration of the drug and then 0.5, 1.5, 3.0, 5.0, 7.0, 9.0, and 24.0 hr after administration. In the performance component, the response sequence always remained the same. Overall percentage of errors increased and overall response rates decreased in the acquisition and performance components as an orderly function of drug dose. However, these effects were selective in that behavior in the acquisition component generally was affected at lower doses than in the performance component. When behavior was affected in both the acquisition and performance components, the time courses of effects were similar. Drug effects began at 0.5 or 1.5 hr, reached peak effects between 3.0 and 5.0 hr, and returned to placebo levels between 7.0 and 9.0 hr postdrug in both schedule components. None of the drug doses produced reliable effects the day after drug administration (24-hr postdrug) in either schedule component. The present study provides the first within-subject assessment of the magnitude and duration of the effects of an anticholinergic on repeated acquisition and performance baselines and extends to atropine the selective effects on these two baselines demonstrated previously with other compounds in humans and nonhumans.     

Effects of methadone on alternative fixed-ratio fixed-interval performance: latent influences on schedule-controlled responding.

Effects of methadone on pigeons' key pecking were examined under four conditions selected to analyze the control of behavior under alternative fixed-ratio fixed-interval schedules. In Condition 1, pigeons pecked under one of three different alternative schedules (alternative fixed-ratio 50 fixed-interval 90 s, alternative fixed-ratio 75 fixed-interval 90 s and alternative fixed-ratio 200 fixed-interval 90 s) each week. In Condition 2, fixed-ratio 50 or fixed-ratio 75 schedules were in effect during baseline sessions, and alternative fixed-ratio 50 fixed-interval 90-s or alternative fixed-ratio 75 fixed-interval 90-s schedules were in effect during sessions in which methadone was administered. In Condition 3, effects of methadone on key pecking maintained under fixed-ratio 50 and fixed-ratio 75 schedules were examined, whereas in Condition 4 the effects of methadone on key pecking under a fixed-interval 90-s schedule as well as fixed-ratio 50 and fixed-ratio 75 schedules were investigated. Control by the fixed-interval contingency was assessed by computing the proportion of total session reinforcers delivered under the fixed-interval schedule. Methadone administration (0.5-4.0 mg/kg) shifted the predominant source of schedule control under the alternative schedule from the fixed-ratio schedule to the fixed-interval contingency. This shift was dependent on methadone dose and fixed-ratio size. Control by the fixed-interval contingency was greatest following extensive exposure to the interval component embedded within the alternative schedule (Condition 1), but was apparent to a lesser degree with even very limited exposure to the alternative fixed-ratio fixed-interval schedule (Condition 2). Interreinforcement intervals comparable to those under fixed-interval schedule were not observed under the fixed-ratio schedules presented alone (Condition 3). Repeated exposure to the fixed-interval contingency outside the context of the alternative fixed-ratio fixed-interval schedule did not engender performance changes under a fixed-ratio schedule which would mimic those of increased fixed-interval contingency control (Condition 4). These data suggest that drug administration can be used to unmask the influence of contingencies that are latent under baseline conditions and reveal influences of both past and present environmental variables.     

THE BASIS OF SUPERSTITIOUS BEHAVIOR: CHANCE CONTINGENCY,STIMULUS SUBSTITUTION,OR APPETITIVE BEHAVIOR?

This research examined three explanations for the "superstitious" behavior of pigeons under frequent fixed-time delivery of food: accidental response-reward contingency, stimulus substitution, and elicited species-typical appetitive behavior. The behavior observed in these studies consisted of occasional postfood locomotion away from the food hopper, and a predominant pattern of activity directed toward the hopper wall (wall-directed behavior), including approaching, stepping side to side, scratching with the feet, bumping with the breast, pendulum movements of the extended neck, and head bobbing, though not pecking. The consistency of these behavior patterns argued against explanation by accidental response contingencies, and the complexity of behavior was incompatible with the classic stimulus-substitution account. These studies also showed that: (1) response contingencies and prior stimulus experience can modify wall-directed behavior, but within definable limits; (2) pecking sometimes can be obtained in birds of specific strains, and by providing extended training; (3) placing the hopper in the floor at the center of a large chamber replaces wall-directed behavior with circling in a manner that resembles ground foraging for food. We conclude that superstitious behavior under periodic delivery of food probably develops from components of species-typical patterns of appetitive behavior related to feeding. These patterns are elicited by a combination of frequent food presentations and the supporting stimuli present in the environment.     

Incentive theory: IV. Magnitude of reward

Incentive theory is successfully applied to data from experiments in which the amount of food reward is varied. This is accomplished by assuming that incentive value is a negatively accelerated function of reward duration. The interaction of the magnitude of a reward with its delay is confirmed, and the causes and implications of this interaction are discussed.     

Homogeneous chains, heterogeneous chains, and delay of reinforcement

Three pigeons responded on two-component chain schedules in which the required response topography in the initial and terminal links was similar (a homogeneous chain) or dissimilar (a heterogeneous chain). Key-peck responding in the initial link under a variable-interval 60-second (VI 60) schedule produced a terminal link in which, in different conditions, either key pecking or foot treadling was reinforced according to a VI 60 schedule. Multiple VI 60 VI 60 schedules, in which the responses required in the chain schedules were maintained by primary reinforcement in the two components, preceded and followed each type of chain. These multiple schedules were used to ensure that both responses occurred reliably prior to introducing the chain schedule. Key-peck response rates in the initial link of the chain consistently were higher during the homogeneous chain than during the heterogeneous chain. These results illustrate that intervening events during a period separating an operant response from primary reinforcement influence that operant, independently of the delay between the response and reinforcement.     

Preference for multiple versus mixed schedules of reinforcement

Five pigeons were trained in a concurrent-chain procedure. In the initial links, equal nonindependent variable-interval schedules were available concurrently on two keys. Completing the schedule on either key led to exclusive presentation of one of two further variable-interval schedules for a fixed period of time. During these terminal links, as many reinforcers as were scheduled could be obtained. If the response producing this terminal link occurred on one key, differential stimuli signaled which variable-interval schedule had been produced. If the response producing the terminal link occurred on the other key, no such differential stimuli were available. Once the fixed period of time elapsed, the initial links were reinstated. In Experiment 1, the period of time for which the terminal links were available was always 10 s and the absolute duration of the initial links was varied. Subjects preferred the alternative leading to the multiple schedule when the initial-link duration was short, but preferred the alternative leading to the mixed schedule when the initial-link durations were longer. In Experiment 2, both the initial-link duration and the duration of the terminal links were varied. The effect of initial-link duration was identical to that in Experiment 1 and there was no systematic effect of varying the terminal-link duration.