Preference for reinforcers under varying schedule arrangements: A behavioral economic analysis

The field of behavioral economics combines concepts from economics and operant conditioning to examine the influence of schedules or price on preference for reinforcers. Three case studies are reported in which behavioral economic analyses were used to assess relative preference for reinforcers shown by people with intellectual disabilities when schedule requirements varied. The studies examined (a) preference for different reinforcers, (b) substitutability of reinforcers, and (c) changes in preference as a function of schedule requirements.     

Open versus closed economies: performance of domestic hens under fixed ratio schedules

Domestic hens responded under fixed-ratio schedules of food (wheat) reinforcement under several experimental conditions. Part 1 (open economy) investigated performance on fixed-ratio schedules over both multisession steady-state conditions and daily changes of the schedule, with hens maintained at 80% of free-feeding weights by extraexperimental feeding. In Parts 2 and 3 (closed economy and short sessions) sessions were 40 min long, and the hens' weights were allowed to vary (Part 2) or sessions were conducted only when the hens were at approximately 80% of free-feeding weights (Part 3). In Part 4 (closed economy and long sessions) sessions were 24 hr long and the fixed-ratio requirement was changed either daily or after 7 consecutive days. In general, the daily changes of fixed-ratio requirement in the open economy and short-session closed economy gave much the same result as the steady-state open-economy sessions. Overall response and reinforcer rates decreased with increasing fixed-ratio requirement (except at the shortest fixed ratios). Running response rates decreased, and postreinforcement pauses generally increased. In contrast, overall response rates in the long-session closed economy generally increased with the fixed-ratio requirement. Session length is suggested as a cause of the differences between the short- and long-session closed-economy results.     

Modifying drug-reinforced behavior by altering the economic conditions of the drug and a nondrug reinforcer.

Six rhesus monkeys were trained to self-administer orally delivered phencyclidine (0.25 mg/mL) and saccharin (0.03% wt/vol) under concurrent fixed-ratio 16 schedules. In Condition 1 the fixed-ratio requirement for phencyclidine was changed from 16 to 4, 8, 16, 32, 64, 128 and 16 while the fixed-ratio requirement for saccharin deliveries remained constant at 16. In Condition 2 the fixed-ratio value for saccharin was systematically altered while the fixed-ratio requirement for phencyclidine remained at 16, and in Condition 3 the fixed-ratio requirements for both phencyclidine and saccharin were altered simultaneously. Water was then substituted for saccharin, and the series of fixed-ratio manipulations was replicated. The phencyclidine concentration was reduced to 0.125 mg/mL and Conditions 1 and 3 were repeated. When the fixed-ratio requirement for phencyclidine was increased and the fixed-ratio requirement for saccharin or water remained fixed at 16, phencyclidine deliveries decreased when saccharin (vs. water) was concurrently available. The magnitude of the decrease ranged from 20% to 90% (of the concurrent water condition) as the fixed-ratio requirement for phencyclidine increased from 4 to 128. When the fixed-ratio requirement for phencyclidine remained at 16 and the fixed-ratio requirements for concurrent saccharin or water varied between 4 and 128, phencyclidine deliveries decreased by 30% to 40% due to the concurrent availability of saccharin (vs. water). This decrease occurred only at the three lowest fixed-ratio values when saccharin intake was relatively high. When the fixed-ratio requirements for both phencyclidine and concurrent saccharin or water were varied simultaneously, phencyclidine deliveries were reduced from 20% to 45% when saccharin (vs. water) was concurrently present. There was little effect of reducing the phencyclidine concentration when the data were analyzed in terms of unit price (responses per milligram). Thus, changes in the fixed-ratio requirement or drug concentration were functionally similar, and unit price of phencyclidine was the variable that was influenced by the presence of concurrent saccharin. These data indicate that drug-reinforced behavior is substantially reduced when the environment is enriched with an alternative nondrug reinforcer. The economic context in which these substances are presented is an important determinant of drug-reinforced behavior.     

Economic concepts for the analysis of behavior

A review of the relationship between schedule of reinforcement, response rate, and choice suggests that certain unifying concepts from economics can contribute to a more complete science of behavior. Four points are made: 1) a behavioral experiment is an economic system and its characteristics—open or closed—can strongly determine the results; 2) reinforcers can be distinguished by a functional property called elasticity; 3) reinforcers may interact as complements as well as substitutes; 4) no simple choice rule, such as strict matching, can account for all choice behavior.     

信息经济学视角下的医患信任关系重构

在医学诊疗过程中,医患双方存在着医疗信息分布和掌握的不对称,这种情况直接影响着医患信任的建立和患者对医疗效果的评价。从信息经济学视角提出了重构医患信任关系的建议。     

The Psychology of Waste

In order to avoid the appearance of wastefulness people may be motivated to make choices that compromise their own self-interest. In Experiment 1 subjects learned that Mr Munn didn't take advantage of a ‘three-pack’ which would have enabled him to see three movies for $12, the regular price being $5 per movie. Most subjects predicted that after having attended two movies at the regular price, Mr Munn would then be unwilling to purchase a ticket to attend a potentially enjoyable third movie, either because he would consider such a purchase to be wasteful or because he would be angry at having eschewed the ‘three-pack’. In Experiment 2 subjects who could use an obsolete product to ‘trade-up’ to a new model were more likely to buy the new model than were subjects who could purchase it at the identical low price. It was hypothesized that utilizing an obsolete product to obtain a new model would seem less wasteful than making an outright purchase of the new model. In Experiment 3 a large majority of subjects faced with a sunk cost situation persevered with the failing project if the alternative was selling the material ‘for its scrap value’. However, if the alternative consisted of selling the materials for an identical price to someone who could use them, then subjects were less likely to persevere with the failing project. Marketing implications and the propriety of retrospective evaluation of prior decisions were also discussed.     

DEMAND EQUATIONS FOR QUALITATIVELY DIFFERENT FOODS UNDER FIXED‐RATIO SCHEDULES: A COMPARISON OF THREE DATA CONVERSIONS

Concurrent schedules were used to establish 6 hens' preferences for three foods. The resulting biases suggested wheat was preferred over honey‐puffed and puffed wheat, and puffed wheat was the least preferred food. The hens then responded under fixed‐ratio schedules for each food in 40‐min (excluding reinforcer time) sessions, with the response requirement doubling each session until no reinforcers were received. At the smaller ratios, the less preferred the food, the faster the hens' overall response rates (mainly as a result of shorter postreinforcement pauses) and the more reinforcers they received. The relations between the logarithms of the number of reinforcers obtained (consumption) and the response ratio (price) were well fitted by curvilinear demand functions. Wheat produced the smallest initial consumption (ln L), followed by honey‐puffed and puffed wheat, respectively. The response requirement at which the demand functions predicted maximal responding (P_max) were larger for wheat than for the other foods. Normalizing consumption and price, as suggested by Hursh and Winger (1995), moved the data for the three foods towards a single demand function; however, the P_max values were generally largest for puffed wheat. The results of normalization, as suggested by Hursh and Silberberg (2008), depended on the k value used. The parameter k is related to the range of the data, and the same k value needs to be used for all data sets that are compared. A k value of 8.0 gave significantly higher essential values (smaller α values) for puffed wheat as compared to honey‐puffed wheat and wheat, and the P_max values, in normalized standard price units, were largest for puffed wheat. Normalizing demand by converting the puffed and honey‐puffed wheat reinforcers to wheat equivalents (by applying the bias parameter from the concurrent‐schedules procedure) maintained separate demand functions for the foods. Those for wheat had the smallest rates of change in elasticity (a) and, in contrast to the other analyses, the largest P_max values. Normalizing demand in terms of concurrent‐schedule preference appears to have some advantages and to merit further investigation.     

A preliminary analysis of adaptive responding under open and closed economies

In the current investigation, we evaluated the effects of open and closed economies on the adaptive behavior of 2 individuals with developmental disabilities. Across both types of economy, progressive-ratio (PR) schedules were used in which the number of responses required to obtain reinforcement increased as the session progressed. In closed-economy sessions, participants were able to obtain reinforcement only through interaction with the PR schedule requirements (i.e., more work resulted in more reinforcer access). In open-economy sessions, participants obtained reinforcers by responding on the PR schedule and were given supplemental (free) access to the reinforcers after completion of the session. In general, more responding was associated with the closed economy.     

Real World Justice

Despite a high and growing global average income, billions of human beings are still condemned to lifelong severe poverty with all its attendant evils of low life expectancy, social exclusion, ill health, illiteracy, dependency, and effective enslavement. We citizens of the rich countries are conditioned to think of this problem as an occasion for assistance. Thanks in part to the rationalizations dispensed by our economists, most of us do not realize how deeply we are implicated, through the new global economic order our states have imposed, in this ongoing catastrophe. My sketch of how we are so implicated follows the argument of my book, World Poverty and Human Rights, but takes the form of a response to the books critics.     

Food and water intake as functions of resource consumption costs in a closed economy.

In two experiments, rats living in a closed economy were offered continuous, concurrent access to four resources: food, water, a nest, and a running wheel. Costs of consuming food and water were imposed with bar-press requirements, and the price of either one or both resources was raised. As the consumption cost increased, less was consumed in each bout of resource use. Bout frequency increased, but not sufficiently to compensate for the fall in bout size, and total intake fell. Food and water tended to be complementary resources, in that as intake of one fell with its price, intake of the other also decreased. This interaction was accounted for by the defense of the ratio of body water to lean body mass. As amount consumed decreased, increases in feed efficiency (weight gain per unit of food ingested) and the use of stored calories compensated for the reduced energy intake. There was evidence of competition between feeding and drinking at the higher costs: When both commodities were expensive, the decline in the intake of each one was greater than when only one commodity was expensive. Although the time spent nesting, running, and in unmonitored activity was adjusted when feeding or drinking took more of the rat's day, there was no particular activity that was sacrificed.