Temporal context, preference, and resistance to change

According to behavioral momentum theory, preference and relative resistance to change in concurrent-chains schedules are correlated and reflect the relative conditioned value of discriminative stimuli. In the present study, we explore the generality of this relation by manipulating the temporal context within a concurrent-chains procedure through changes in the duration of the initial links. Consistent with previous findings, preference for a richer terminal link was less extreme with longer initial links across three experiments with pigeons. In Experiment 1, relative resistance to change and preference were related inversely when responding was disrupted with response-independent food presentations during initial links, replicating a previous finding with rats. However, more food was presented with longer initial links, confounding the disrupter and initial-link duration. In Experiment 2, presession feeding was used instead and eliminated the negative relation between relative resistance to change and preference, but relative resistance to change was not sensitive to relative terminal-link reinforcement rates. In Experiment 3, with more extreme relative terminal-link reinforcement rates, increasing initial-link duration similarly decreased preference and relative resistance to change for the richer terminal link. Thus, when conditions of disruption are equal and assessed under the appropriate reinforcement conditions, changes in temporal context impact relative resistance to change and preference similarly.     

Comparing preference and resistance to change in constant- and variable-duration schedule components

Two experiments explored preference and resistance to change in concurrent chains in which the terminal links were variable-interval schedules that ended either after a single reinforcer had been delivered (variable duration) or after a fixed period of access to the schedule (constant duration). In Experiment 1, pigeons' preference between the same pair of terminal links overmatched relative reinforcement rate when the terminal links were of constant duration, but not when they were of variable duration. Responding during the richer terminal link decreased less, relative to baseline, when response-independent food was presented during the initial links according to a variable-time schedule. In Experiment 2, all subjects consistently preferred a terminal link that consisted of 20-s access to a variable-interval 20-s schedule over a terminal link that ended after one reinforcer had been delivered by the same schedule. Results of resistance-to-change tests corresponded to preference, as responding during the constant-duration terminal link decreased less, relative to baseline, when disrupted by both response-independent food during the initial links and prefeeding. Overall, these data extend the general covariation of preference and resistance to change seen in previous studies. However, they suggest that reinforcement numerosity, including variability in the number of reinforcers per terminal-link entry, may sometimes affect preference and resistance to change in ways that are difficult to explain in terms of current models.     

Preference and resistance to change with constant- and variable-duration terminal links: independence of reinforcement rate and magnitude

Pigeons responded in a three-component multiple concurrent-chains procedure in which the variable-interval reinforcement schedules were the same across components but magnitudes differed across components. The terminal links were arranged either as a variable delay followed by presentation of a reinforcer ("variable duration") or as a fixed period of access to the schedule during which a variable number of reinforcers could be earned ("constant duration"). Relative reinforcement rate was varied parametrically across both types of conditions. After baseline training in each condition, resistance to change of terminal-link responding was assessed by delivering food during the initial links according to a variable-time schedule. Both preference and resistance to change were more sensitive to reinforcement-rate differences in the constant-duration conditions. Sensitivities of preference and resistance to change to relative reinforcement rate did not change depending on relative reinforcement magnitude. Taken together, these results confirm and extend those of prior studies, and suggest that reinforcement rate and magnitude combine additively to determine preference and resistance to change. A single structural relation linking preference and resistance to change describes all the data from this and several related studies.     

The man who listens to behavior: folk wisdom and behavior analysis from a real horse whisperer

The popular novel and movie The Horse Whisperer are based on the work of several real-life horse whisperers, the most famous of whom is Monty Roberts. Over the last 50 years, Roberts has developed a technique for training horses that is both more effective and less aversive than traditional training techniques. An analysis of Roberts' methods (as described in his book, The Man Who Listens to Horses) indicates a deep understanding of behavioral principles including positive reinforcement, timeout, species-specific defense reactions, “learned helplessness,” and the behavioral analysis of language. Roberts developed his theory and techniques on the basis of personal experience and folk wisdom, and not as the result of formal training in behavior analysis. Behavior analysts can clearly learn from such insightful yet “behaviorally incorrect” practitioners, just as such practitioners can benefit from the objective science of behavior analysts.     

A PRELIMINARY EVALUATION OF EMPIRICALLY DERIVED CONSEQUENCES FOR THE TREATMENT OF PICA

Individualized treatment packages were developed for 3 children with high-rate severe pica using a discrimination training paradigm and a behavioral assessment-based procedure known as empirically derived consequences. Children received empirically derived reinforcers for eating under appropriate stimulus conditions (i.e., eating food only from a plate and placemat that served as a discriminative stimulus) and empirically derived punishers for attempts to engage in pica. This treatment package resulted in marked reductions in pica and an increase in appropriate eating for all 3 children in a “baited” analogue condition. In addition, low rates of pica were maintained for 9 months for all 3 children. These results suggest that treatment effectiveness may be enhanced when behavioral assessment data are used to identify potent consequences.     

Uncertainty processing in bees exposed to free choices: Lessons from vertebrates

Bees tend to avoid or to show indifference to uncertain (“risky”) relative to certain (“safe”) food rewards, whether in nectar volume or in nectar concentration. The unattractiveness of uncertain food rewards is also sometimes independent of the energy budget of bees. This pattern of responses seems to differ from that observed in mammals and birds, which may exhibit a strong preference for the uncertainty over the certainty of food delivery on a given trial in dual-choice tasks. Upon analysis of the conditions that determine preference and aversion for uncertain food rewards in “higher” vertebrates, I attempt to demonstrate that bees react to uncertainty in a similar way. It is argued that, because of their social organization and of the type of resources they seek, bees are essentially exposed to situations in which “higher” vertebrates find reward uncertainty unattractive as well. The nature of their representation of food distribution is discussed, and it is suggested that scout bees may differ from recruits with respect to uncertainty processing.     

Inverse relation between choice and local response rate with a schedule of response-produced blackouts

Pigeons were exposed to a two-key concurrent chains schedule in which identical frequencies and distributions of food presentations generated different response rates in the terminal links. An inverse relation between local rate of response in the terminal links and relative frequency of response in the initial links was observed. The high response rate was produced in one terminal link by a second-order schedule in which responding produced brief blackouts of the response key. Responding under the same schedule in the other terminal link did not produce blackouts. Under initial training and after spatial reversal of the terminal-link schedules, two of three pigeons had lower relative frequencies of response in the initial member of the chain with the higher terminal link response rate. The third pigeon showed no change in preference at reversal.     

Behavioral momentum and resistance to extinction across repeated extinction tests

The present experiments assessed whether resistance to extinction of pigeons' key pecking decreased across repeated extinction tests. An additional impetus for this research was to determine how the quantitative framework provided by behavioral momentum theory might be used to describe any such changes across tests. Pigeons pecked keys in two‐component multiple schedules (one component associated with a higher reinforcer rate and the other with a lower rate) in which baseline and extinction conditions alternated. In Experiment 1, baseline and extinction conditions alternated every session, and, in Experiment 2, these conditions lasted for 10 and 7 sessions, respectively. Resistance to extinction decreased across successive extinction conditions in both experiments. Fits of the behavioral‐momentum based model of extinction to the data returned uncertain results in Experiment 1 but implicated both generalization decrement and response–reinforcer contingency termination as the possible mechanisms responsible for behavior change in Experiment 2. Thus, these data suggest that experimental manipulations that affect discrimination of changes in reinforcement contingencies may influence resistance to extinction by modulating the disruptive impacts of removing reinforcers from the experimental context and of suspending response–reinforcer contingencies.     

Assessing potential reinforcement-like effects of brief stimuli unrelated to food reinforcers

It is widely assumed that reinforcers are biologically relevant stimuli, or stimuli that have been associated with biologically relevant stimuli. However, brief, arbitrary stimuli have also been reported to have reinforcement-like effects, despite being unrelated to biologically relevant stimuli like food. The present study explored the potential reinforcement-like effects of brief stimuli across 5 experiments. In Experiments 1 through 4, pigeon subjects responded for food reinforcement and brief stimulus presentations in a 2-component multiple schedule. Neither baseline response rates nor resistance to change during disruption tests were systematically greater in a component with versus without brief stimulus presentations. Increasing the rate and duration of brief stimulus presentations in Experiment 4 did not reveal reinforcement-like effects when compared directly with food. In Experiment 5, pigeons chose between independent terminal links in a concurrent-chains procedure. Across conditions, varying the location, duration, and rate of brief stimulus presentations in the terminal links had no systematic effects on preference. In contrast, varying rates of food reinforcers resulted in large and reliable shifts in preference. Therefore, the present study found no systematic evidence that brief stimuli unrelated to food reliably increase response rates, resistance to change, or preference. These data demonstrate the value of systematic replication, and a behavioral momentum approach to assessing potential reinforcement-like effects.     

揭秘经济管理中的行为异象：心理账户理论的应用启示

2017年Richard H. Thaler获得诺贝尔经济学奖, 其重要的研究贡献之一是催生并发展了心理账户理论。心理账户理论被广泛用于解释经济管理中的行为异象。文章以消费决策、金融管理决策两大领域的应用研究为外在逻辑, 以心理账户的设立、运算和关闭过程的特点为内在逻辑, 重点探讨了消费决策中的“标签效应”、“预算效应”、“价格幻觉”、“解耦效应”和“效用偏差”; 金融管理决策中的“粘蝇纸效应”、“薪酬感知之谜”、“税收-投资之谜”、“会计信息披露之谜”和“处置效应”十大行为异象。文章进一步提出未来可能的两个研究方向, 一是通过眼动技术和认知神经科学方法揭示心理账户影响行为决策的内在过程及神经机制; 二是将心理账户理论应用于“以小拨大”的行为助推, 助力政府公共管理和企业管理决策。     

Effects of free food deliveries and temporal contiguity on choice under concurrent-chain schedules

Eight pigeons responded in a concurrent chain with variable-interval (VI) 10-sec and VI 20-sec terminal links. Free food deliveries were then added to the initial links according to a variable-time (VT) 20-sec schedule in two conditions that differed in terms of whether a differential reinforcement of other (DRO) contingency was also arranged, which ensured that those deliveries could not occur within 2-sec of a response. Preference for the VI 10-sec terminal link increased when VT food was added, but not when the DRO contingency was operative, showing that free food deliveries affected preference only when those deliveries could be temporally contiguous with choice responding. This finding suggests that Mazur’s (2003) report of increased preference with added VT food, replicated here, was due to adventitious reinforcement. Current models for behavioral choice are limited because they are based entirely on temporal relations between stimuli and reinforcers and fail to take into account response-reinforcer contiguity.     

Step changes in the intertrial interval in the midsession reversal task: Predicting pigeons' performance with the learning-to-time model

Our goal was to assess the role of timing in pigeons' performance in the midsession reversal task. In discrete-trial sessions, pigeons learned to discriminate between 2 stimuli, S1 and S2. Choices of S1 were reinforced only in the first half of the session and choices of S2 were reinforced only in the second half. Typically, pigeons choose S2 before the contingency reverses (anticipatory errors) and S1 after (perseverative errors), suggesting that they time the interval from the beginning of the session to the contingency reversal. To test this hypothesis, we exposed pigeons to a midsession reversal task and, depending on the group, either increased or decreased the ITI duration. We then contrasted the pigeons' performance with the predictions of the Learning-to-Time (LeT) model: In both conditions, preference was expected to reverse at the same time as in the previous sessions. When the ITI was doubled, pigeons' preference reversal occurred at half the trial number but at the same time as in the previous sessions. When the ITI was halved, pigeons' preference reversal occurred at a later trial but at an earlier time than in the previous sessions. Hence, pigeons' performance was only partially consistent with the predictions of LeT, suggesting that besides timing, other sources of control, such as the outcome of previous trials, seem to influence choice.     

Conditioned reinforcement dynamics in three-link chained schedules.

In two experiments rats were trained on three-link concurrent-chains schedules of reinforcement. In Experiment 1, additional entries to one terminal link were added during one of the middle links to a baseline schedule that was otherwise equal for the two chains, and, depending on the condition, these additional terminal-link presentations ended either in food or in no food. When food occurred, preference was always in favor of the chain with the additional terminal-link presentations (which also entailed a higher rate of reinforcement). When no food occurred at the end of the additional terminal links, the outcome depended on the nature of the stimuli associated with these additional terminal links. When stimuli different from the reinforced baseline terminal links were used for the no-food terminal links, preference was against the choice alternative that led to the extra periods of extinction. When the same stimulus was used for the two kinds of terminal links, preference was near indifference, that is, significantly greater than when different stimuli were used. In Experiment 2, rats learned repeated reversals of a simultaneous discrimination under a three-link concurrent-chains schedule, in which the food or no-food choice outcomes were delayed until the end of the chain. Different conditions were defined by the point in the chain at which differential stimuli occurred. When the middle and terminal links provided no differential stimuli, discrimination was acquired more slowly than when differential stimuli occurred in both links. When differential stimuli occurred in the middle but not the terminal links, acquisition rates were intermediate. Both experiments together show that the effects of stimuli in a chain schedule are due partly to the time to food correlated with the stimuli and partly to the time to the next conditioned reinforcer in the sequence.     

A REPLICATION AND EXTENSION OF THE ANTISYMMETRY EFFECT IN PIGEONS

Pigeons trained on successive AB symbolic matching show emergent BA antisymmetry if they are also trained on successive AA oddity and BB identity ( Urcuioli, 2008 , Experiment 4). In other words, when tested on BA probe trials following training, they respond more to the comparisons on the reverse of the nonreinforced AB baseline trials than on the reverse of the reinforced AB baseline trials (the opposite of an associative symmetry pattern). The present experiment replicated this finding. In addition, it showed that antisymmetry also emerged after baseline training on successive AB symbolic matching, AA identity, and BB oddity, consistent with the prediction from Urcuioli's (2008) theory of pigeons' stimulus‐class formation. Together, these results provide further empirical support for that theory including the proposition that the functional stimuli in pigeons' successive matching consist of the nominal stimuli plus their ordinal positions within a trial.     

Response rate correlates with indifference points in a delay‐discounting procedure

To study how effort affects reward value, we replicated Fortes, Vasconcelos and Machado's (2015) study using an adjusting‐delay task. Nine pigeons chose between a standard alternative that gave access to 4 s of food, after a 10 s delay, and an adjusting‐delay alternative that gave access to 12 s of food after a delay that changed dynamically with the pigeons' choices, decreasing when they preferred the standard alternative, and increasing when they preferred the adjusting alternative. The delay value at which preference stabilized defined the indifference point, a measure of reward value. To manipulate effort across phases, we varied the response rate required during the delay of the standard alternative. Results showed that a) the indifference point increased in the higher‐response‐rate phases, suggesting that reward value decreased with effort, and b) in the higher‐response‐rate phases, response rate in the standard alternative was linearly related to the indifference point. We advance several conceptions of how effort may change perceived delay or amount and thereby affect reward value.     

Resistance to change of operant variation and repetition

A multiple chained schedule was used to compare the relative resistance to change of variable and fixed four-peck response sequences in pigeons. In one terminal link, a response sequence produced food only if it occurred infrequently relative to 15 other response sequences (vary). In the other terminal link, a single response sequence produced food (repeat). Identical variable-interval schedules operated in the initial links. During baseline, lower response rates generally occurred in the vary initial link, and similar response and reinforcement rates occurred in each terminal link. Resistance of responding to prefeeding and three rates of response-independent food delivered during the intercomponent intervals then was compared between components. During each disruption condition, initial- and terminal-link response rates generally were more resistant in the vary component than in the repeat component. During the response-independent food conditions, terminal-link response rates were more resistant than initial-link response rates in each component, but this did not occur during prefeeding. Variation (in vary) and repetition (in repeat) both decreased during the response-independent food conditions in the respective components, but with relatively greater disruption in repeat. These results extend earlier findings demonstrating that operant variation is more resistant to disruption than is operant repetition and suggest that theories of response strength, such as behavioral momentum theory, must consider factors other than reinforcement rate. The implications of the results for understanding operant response classes are discussed.     

Cardiac arrhythmias in the monkey during classically conditioned fear and excitement

Rhesus monkeys(Macaca mulatto) were tested in classic aversive and appetitive conditioning paradigms following complete coronary artery occlusion (CO) to test the hypothesis that “emotional stress” induces ventricular arrhythmias. Findings were based upon conditioning trials conducted for one or more weeks after occlusion in 13 animals. When all data from each animal for the week following CO were considered, there was no demonstrable tendency for arrhythmias to increase during “fear” conditioned to unavoidable electric shock or during “excitement” in anticipation of food. However, selected trials from six monkeys did reveal instances when changes in the frequency of occurrence of arrhythmias were coupled with behavioral conditioning. While analysis of these trials did not reveal any simple relationship between emotional stress and the development of ventricular arrhythmias after myocardial infarction, certain of the behavioral situations may be more potentially arrhythmogenic than others. For these selected trials, with respect to control, the number of arrhythmias may have increased or decreased upon presentation of the conditional stimulus; the exact response appears to depend upon the immediate physiologic status of the animal as well as on the behavioral condition. “More stressful” situations, such as aversive conditioning, are not necessarily associated with greater numbers of arrhythmias than were “less stressful” situations, such as appetitive conditioning. Arrhythmias appear to occur more frequently when an animal’s heart rate is within a given range; this may reflect underlying cardiac sympathetic and parasympathetic nerve activity.     

The Emergence of Sex

Biological traits, the foci of natural selection, are by definition emergent from the genes, proteins, and other “nothing-buts” that constitute them. Moreover, and with the exception of recently emergent “spandrels,” each can be accorded a teleological dimension—each is “for” some purpose conducive to an organism's continuation. Sex, which is “for” the generation of recombinant genomes, may be one of the most ancient and ubiquitous traits in biology. In the course of its evolution, many additional traits, such as gender and nurture, have emerged. Patterns of sexual exchange are the basis for patterns of biological evolution and are central to the process of eukaryotic speciation. Human sexuality is central to our selves.     

Suboptimal choice in a percentage-reinforcement procedure: effects of signal condition and terminal-link length.

Pigeons' choice between reliable (100%) and unreliable (50%) reinforcement was studied using a concurrent-chains procedure. Initial links were fixed-ratio 1 schedules, and terminal links were equal fixed-time schedules. The duration of the terminal links was varied across conditions. The terminal link on the reliable side always ended in food; the terminal link on the unreliable side ended with food 50% of the time and otherwise with blackout. Different stimuli present during the 50% terminal links signaled food or blackout outcomes under signaled conditions but were uncorrelated with outcomes under unsignaled conditions. In signaled conditions, most pigeons displayed a nearly exclusive preference for the 100% alternative when terminal links were short (5 or 10 s), but with terminal links of 30 s or longer, preference for the 100% alternative was sharply reduced (often to below .5). In unsignaled conditions, most pigeons showed extreme preference for the 100% alternative with either short (5 s) or longer (30 s) terminal links. Thus, pigeons' choice between reliable and unreliable reinforcement is influenced by both the signal conditions on the unreliable alternative and the duration of the terminal-link delay. With a long delay and signaled outcomes, many pigeons display a suboptimal tendency to choose the unreliable side.     

ASSESSMENT AND TRAINING OF CLINICAL INTERVIEWING SKILLS: ANALOGUE ANALYSIS AND FIELD REPLICATION

Two studies were conducted to assess and train clinical interviewing skills. In Experiment 1, eight university practicum students (“therapists”) and either role played or volunteer “clients” were audiotaped during simulated interviews. Following the collection of baseline data on both therapist and client responses, training was provided by way of written materials, classroom instruction and practice, and quizzes. Results of a multiple baseline design across subjects showed improvements in therapists' interviewing skills and subsequent increases in client responding. Experiment 2 replicated and extended the research to a hospital outpatient clinic, in which therapists interviewed the parents of children with behavior problems. In addition, four months following the completion of Experiment 2, follow-up data collected during a maintenance condition showed continued high levels of therapist and client behavior. Finally, a panel of expert peers indicated that each response category was judged highly relevant to the behavioral assessment process.