Internet‐based self‐tailored deposit contracts to promote smoking reduction and abstinence

Deposit contracting may reduce costs and increase efficacy in contingency management interventions. We evaluated two Internet‐based deposit contract arrangements for smoking. In Experiment 1, nine participants deposited self‐selected amounts that could be earned back for meeting goals. During treatment, participants were reimbursed for breath samples with less than or equal to 6 parts per million carbon monoxide and met the criterion for 47% of samples compared to 1% during baseline. In Experiment 2, 10 participants’ deposits were matched up to $50. No samples met the criterion during baseline but 41.5% met it during treatment. The average deposit was $82 in Experiment 1 and $49 in Experiment 2. Participants rated the intervention favorably and sample submission rates were high. These experiments suggest that Internet‐based self‐tailored deposits are acceptable, feasible, and can promote brief reduction and abstinence in some smokers. Future research should investigate individual and intervention factors that affect long‐term cessation and uptake of deposit contracts.     

The effects of a deposit contract as a component in a behavioural programme for stopping smoking

A contract procedure is described in which a money deposit provided by cigarette smokers at the time of stopping smoking is returned at set intervals contingent on their having not smoked. Outcome results up to 6 months after the stop smoking date are presented for 33 smokers who used this procedure as a component in a behavioural programme, and for 27 smokers who received the same treatment package but without the deposit component. The results for both groups are encouraging, and in the short term the deposit group did significantly better than the no-deposit group. Reasons for the failure of this difference to be maintained are discussed, and it is suggested that long term results would be improved by holding deposits over a longer interval. Other evidence is presented to show that the deposit procedure had a specific effect on smoking rather than a more general effect on attendance rates. Deposit contracts also appear acceptable to smokers. Urinary nicotine analysis appeared effective in deterring as well as detecting faking.     

Deposit contracts with smokers: Varying frequency and amount of repayments

Predictions concerning the effects of variations in the parameters of deposit contracts with smokers were derived from the operant conditioning literature. The predictions were tested by group comparison studies involving 83 subjects in 12 treatment groups, using three deposit procedures. As predicted, increasing the amount of money returned in each deposit repayment improved short term abstinence rates. Increasing repayment frequency had a similar but not quite significant effect. The predicted relationship between frequency and amount of repayments, with variations in frequency having more effect, was not found. There were no long term differences between groups. The usefulness of the operant framework was therefore partially demonstrated. Some clinical implications of the findings are discussed.     

Schedules of reinforcement as determinants of human causality judgments and response rates

Experiments examined the effect of relationships between a response and an outcome on human judgments of causal effectiveness. In Experiment 1, the time between outcomes obtained on a variable ratio (VR) schedule became the intervals for a yoked variable interval (VI) schedule. Response rates were higher on the VR than on the VI schedule. In Experiment 2, the number of responses required per outcome on a VR schedule were matched to that on a master VI 20-s schedule. Both ratings of causal effectiveness and response rates were higher in the VR schedule. In Experiment 3, tandem VI fixed-ratio (FR) schedules produced higher rates and judgments than equivalent conjunctive VI FR schedule. In Experiment 4, a VI schedule with a reinforcement requirement for a short interresponse time (IRT) produced higher rates and judgments than a simple VI schedule. These results corroborate the view that schedules are a determinant of both response rates and causal judgments. Few current theories of causal judgment predict this pattern of results.     

When 90% confidence intervals are 50% certain: on the credibility of credible intervals

Estimated confidence intervals for general knowledge items are usually too narrow. We report five experiments showing that people have much less confidence in these intervals than dictated by the assigned level of confidence. For instance, 90% intervals can be associated with an estimated confidence of 50% or less (and still lower hit rates). Moreover, interval width appears to remain stable over a wide range of instructions (high and low numeric and verbal confidence levels). This leads to a high degree of overconfidence for 90% intervals, but less for 50% intervals or for free choice intervals (without an assigned degree of confidence). To increase interval width one may have to ask exclusion rather than inclusion questions, for instance by soliciting ‘improbable’ upper and lower values (Experiment 4), or by asking separate ‘more than’ and ‘less than’ questions (Experiment 5). We conclude that interval width and degree of confidence have different determinants, and cannot be regarded as equivalent ways of expressing uncertainty. Copyright © 2005 John Wiley & Sons, Ltd.     

Effect of a signalled delay between an action and outcome on human judgement of causality

Three experiments examined the influence of a stimulus inserted between an action (pressing the space bar of a computer) and an associated delayed outcome (a triangle lighting up on the screen) on ratings of the causal effectiveness of that action. In Experiment 1, subjects rated an action that produced an outcome immediately as more causally effective than an action that produced a delayed outcome. The rating of the causal effectiveness of an action that produced a delayed outcome in which the delay was filled by a stimulus was higher than the rating of actions that produced the outcome after an unsignalled delay. In Experiment 2, the effect of a stimulus presented uncorrelated with the action or the outcome was examined and found not to enhance the rating of causal effectiveness of an action that produced a delayed outcome. In Experiment 3, the degree of correlation between the stimulus and the consequence was examined. Ratings of the causal effectiveness of the action were greater the higher percentage of delay intervals that were signalled.     

DISCRIMINATION ACQUISITION IN CHILDREN WITH DEVELOPMENTAL DISABILITIES UNDER IMMEDIATE AND DELAYED REINFORCEMENT

We evaluated the discrimination acquisition of individuals with developmental disabilities under immediate and delayed reinforcement. In Experiment 1, discrimination between two alternatives was examined when reinforcement was immediate or delayed by 20 s, 30 s, or 40 s. In Experiment 2, discrimination between 2 alternatives was compared across an immediate reinforcement condition and a delayed reinforcement condition in which subjects could respond during the delay. In Experiment 3, discrimination among 4 alternatives was compared across immediate and delayed reinforcement. In Experiment 4, discrimination between 2 alternatives was examined when reinforcement was immediate and 0‐s or 30‐s intertrial intervals (ITI) were programmed. For most subjects, discrimination acquisition occurred under immediate reinforcement. However, for some subjects, introducing delays slowed or prevented discrimination acquisition under some conditions. Results from Experiment 4 suggest that longer ITIs cannot account for the lack of discrimination under delayed reinforcement.     

Choice between reliable and unreliable reinforcement alternatives revisited: Preference for unreliable reinforcement

Pigeons' choices between a reliable alternative that always provided food after a delay (i.e., 100% reinforcement) and an unreliable one that provided food or blackout equally often after a delay (i.e., 50% reinforcement) was studied using a discrete-trials concurrent-chains procedure modified to prevent choice between alternatives following a blackout outcome. Initial links were fixed-ratio 1 schedules, and terminal links were fixed-time schedules. Stimuli presented during the terminal-link delays were correlated with the food and blackout outcomes. In Experiment 1, terminal-link durations were varied. With short terminal links (i.e., 10 s), 6 of 8 subjects showed strong preference for the 50% side. As terminal-link duration increased to 30 s, preference, regardless of direction, became less extreme. In Experiment 2, the side-key location of the 50% and 100% alternatives was reversed for 3 subjects. Preference for the 50% alternative reoccurred following the key reversal. When a 5-s separation was subsequently interposed between the initial and terminal links for both alternatives, all birds reversed to a preference for the 100% side. In general, the strong preference for the 50% side was qualitatively consistent with the expectation that the procedure enhanced the conditioned-reinforcement effectiveness of the food-associated terminal-link stimulus on the 50% side. Implications of the results for various accounts of choice of the 50% alternative are discussed.     

Within-session delay-of-reinforcement gradients

Within-session delay-of-reinforcement gradients were generated with pigeons by progressively increasing delays to reinforcement within each session. In Experiment 1, the effects of imposing progressive delays on variable-interval and fixed-interval schedules were investigated while controlling for simultaneous decreases in reinforcer rate across the session via a within-subject yoked-control procedure. Rate of key pecking decreased as a negatively decelerated function of delay of reinforcement within a session. These rate decreases were greater than those during a yoked-interval session in which the rate of immediate reinforcement decreased at the same rate as it did under the progressive-delay procedure. In Experiment 2, delay-of-reinforcement gradients were shallower when the progressive delay intervals were signaled by a blackout than when they were unsignaled. The delay gradients obtained in each experiment were similar to those generated under conditions in which different delays of reinforcement are imposed across blocks of sessions. The present procedure offers a technique for rapidly generating delay-of-reinforcement gradients that might serve as baselines for assessing the effects of other behavioral and pharmacological variables.     

The repetition effect in judgments of temporal duration across minutes, days, and months.

Three experiments assessed the stability of the repetition effect in time judgment. In Experiment 1, subjects (N = 18) produced intervals ranging from 8 to 31 sec in a two-phase procedure with a five min rest between phases. In Experiment 2, subjects (N = 20) made verbal estimates of intervals ranging from 8 to 20 sec with a 48-hour delay between phases. Experiment 3 involved daily productions by three subjects of intervals ranging from 8 to 54 sec over several months. The slope of the psychophysical function increased across phases in Experimental 1, declined (as expected for estimation) across days in Experiment 2, and increased across months in Experiment 3. It was concluded that the repetition effect is relatively permanent and thus more similar to habituation than to sensory adaptation.     

Technology-based versus in-person deposit contract treatments for promoting physical activity

Deposit contracts involve participants depositing their own money and earning it back contingent on behavior change. Deposit contracts are empirically supported treatments for promoting health behavior, but they have a history of poor uptake. We compared the effectiveness and acceptability of technology-based versus in-person deposit contracts for promoting physical activity with 12 individuals. Participants' daily step counts were monitored using Fitbits across 6 weeks, and treatment preferences were assessed at the end of the study. The 2 types of treatments were equally effective in increasing physical activity, but the technology-based deposit contracts were preferred by most participants. Most participants also reported that their preference was related to convenience. Technology-based implementation may be one way to improve deposit contract uptake, while maintaining similar effectiveness compared to in-person procedures.     

Functional Communication Training and Demand Fading Using Concurrent Schedules of Reinforcement

Demand fading, a schedule thinning procedure for escape-maintained behaviors, typically includes an escape extinction component. The purpose of this study was to examine the effectiveness of demand fading with alternative reinforcement utilizing concurrent reinforcement schedules without extinction. During demand fading, aggression and requests emitted prior to meeting the task completion criterion were reinforced with short, low-quality breaks, but requests emitted following the task completion criterion were reinforced with long, high-quality breaks. Results suggest that concurrent schedules of reinforcement may be an effective alternative to extinction as a component of demand fading.     

Effects of thinning the rate at which the alternative behavior is reinforced on resurgence of an extinguished instrumental response

Three experiments with rats examined the effects of thinning the rate of reinforcement for the alternative behavior in the resurgence paradigm. In all experiments, pressing one lever (L1) was first reinforced and then extinguished while pressing a second alternative lever (L2) was then reinforced. When L2 responding was then extinguished, L1 responses "resurged." Resurgence was always observed when L2 was reinforced on an unchanging reinforcement schedule during Phase 2. However, other rats received systematic decreases in the rate of L2 reinforcement before extinction of L2 began. Such a "thinning" procedure was predicted to reduce final resurgence by associating L1 extinction with longer and longer periods without a reinforcer. The procedure did reduce the resurgence effect observed when L2 was put on extinction (Experiment 3). However, in each experiment, thinned groups also returned to L1 responding, and continued to make L1 responses, while the reinforcement schedule for L2 was being thinned. Fine-grained analysis of behavior in time suggested that this early resurgence was not due to adventitious reinforcement of L1, occasion setting of L1 by reinforcer presentation, or the entrainment of L1 as a schedule-induced interim behavior. The results are overall consistent with the hypothesis that resurgence is a renewal effect in which extinguished L1 responding recovers when the context provided by the L2 reinforcement schedule is changed. Challenges for this view are also discussed.     

Between-subject PREE and within-subject reversed PREE in spaced-trial extinction with pigeons

Three experiments explored the partial reinforcement extinction effect (PREE; greater resistance to extinction after partial, rather than continuous, reinforcement training), in a spaced-trial situation with pigeons. Experiments 1 and 2 report conventional PREEs with 24-h intertrial intervals and between-subject designs. The corresponding outcome (food reinforcement or nonreinforcement) was delivered after satisfaction of a fixed-ratio 10 (Experiment 1) or a fixed-ratio 1 (Experiment 2). Experiment 3 reports a reversed PREE in a within-subject design with a fixed-ratio 10 requirement. Extinction occurred faster for the response paired with 50% partial reinforcement than for the response paired with continuous reinforcement. A third response paired with a small reinforcer (1 pellet/trial) in 100% of the trials extinguished faster than a response paired with a large reinforcer (15 pellets/trial). These results are discussed in the context of spaced-trial instrumental performance (key pecking and running), in pigeons.     

Duration discrimination of empty and filled intervals marked by auditory and visual signals

Experiments 1 and 2 compared, with a single-stimulus procedure, the discrimination of filled and empty intervals in both auditory and visual modalities. In Experiment 1, in which intervals were about 250 msec, the discrimination was superior with empty intervals in both modalities. In Experiment 2, with intervals lasting about 50 msec, empty intervals showed superior performance with visual signals only. In Experiment 3, for the auditory modality at 250 msec, the discrimination was easier with empty intervals than with filled intervals with both the forced-choice (FC) and the single stimulus (SS) modes of presentation, and the discrimination was easier with the FC than with the SS method. Experiment 4, however, showed that at 50 and 250 msec, with a FC-adaptive procedure, there were no differences between filled and empty intervals in the auditory mode; the differences observed with the visual mode in Experiments 1 and 2 remained significant. Finally, Experiment 5 compared differential thresholds for four marker-type conditions, filled and empty intervals in the auditory and visual modes, for durations ranging from .125 to 4 sec. The results showed (1) that the differential threshold differences among marker types are important for short durations but decrease with longer durations, and (2) that a generalized Weber’s law generally holds for these conditions. The results as a whole are discussed in terms of timing mechanisms.     

Repetition of ‘right’ and ‘wrong’ responses with a different number of response alternatives in study and test trial

The reinforcement values of ‘right’ and ‘wrong’ upon subsequent repetition of the response have been explained by the subject's independent memory for his previous response and its outcome ‘right’ or ‘wrong’. Detailed analyses on the data of recent experiments suggest that an increasing number of response alternatives for each stimulus makes the recall of the response and the outcome ‘right’ no longer independent. Therefore it was predicted that for a given number of response alternatives at the Test Trial, the likelihood that a subject will repeat a response called ‘right’ at the study Trial will be a function of the number of response alternatives at the Study Trial. The results were confirmatory. The explanation of these results was based on there being a larger informational value in the outcome ‘right’ with an increasing number of response alternatives.     

The excess choice effect: The role of outcome valence and counterfactual thinking

Contrary to economic theory, psychological research has demonstrated increased choice can undermine satisfaction. When and why this ‘excess choice effect’ (ECE) occurs remains unclear. Building on theories of counterfactual thinking we argue the ECE is more likely to occur when people experience counterfactual thought or emotion and that a key trigger is a negative versus positive task outcome. Participants either selected a drink (Experiment 1) or chocolate (Experiment 2) from a limited (6) versus extensive (24) selection (Experiment 1) or were given no choice versus extensive (24) choice (Experiment 2). In both experiments, however, the choice was illusory: Half the participants tasted a ‘good’ flavour, half a ‘bad’ flavour. As predicted, extensive choice was only detrimental to satisfaction when participants tasted the ‘bad’ drink or chocolate, and this was mediated by the experience of counterfactual thought (Experiment 1) or emotion (Experiment 2). When outcomes were positive, participants were similarly satisfied with limited versus extensive and no choice versus extensive choice. Implications for our theoretical understanding of the ECE and for the construction of choice architectures aimed at promoting individual satisfaction and well‐being are discussed.     

Simultaneous temporal processing

Seven experiments assessed the ability of rats to process temporal information from two internal clocks simultaneously and independently. In the first six experiments a light stimulus signalled an overall interval between the beginning of a trial and the availability of food reinforcement (e.g., a 50-s fixed interval). During the overall interval a sound stimulus was used to signal shorter intervals that divided the overall interval into equal segments. When there was a fixed temporal relation between the final segment signal and the availability of reinforcement, there was a double-scallop pattern of responding throughout the segmented overall interval; the function relating response rate to time during segment intervals was similar to the function relating response rate to time in unsegmented overall intervals; a change in response rate occurred at the time that a normally presented segment signal was omitted. Taken together, the results indicate that rats timed the overall interval and the segment intervals simultaneously and independently without interference. In Experiment 7 a light stimulus was used on some trials, and a sound stimulus was used on other trials to signal a discrete-trial 50-s peak procedure. When these two signals were presented in compound, there was a leftward shift of the response function, which suggests that rats timed both signals simultaneously. For all of the experiments a scalar timing model with specific stimulus integration rules is used to explain the results. The stimulus integration rule used in the first six experiments, in which there were two signals for the same reinforcement, was to respond if both the segment and the overall interval had exceeded a response threshold. The stimulus integration rule used in Experiment 7, in which there were two signals for different reinforcements, was to respond if the response threshold for either interval had been exceeded.     

Effects of contingency violations on the extinction of a conditioned fear inhibitor and a conditioned fear excitor

Rats were used in a conditioned-suppression paradigm to assess the effects of contingency variations on responding to a conditioned inhibitor (CS-) and a conditioned excitor (CS+). In Experiment 1, various unconditioned stimulus (US) frequencies were equated across the presence and absence of a CS- in the context of either background cues (continuous-trial procedure) or an explicit neutral event (discrete-trial procedure). With both procedures, a CS-alone treatment enhanced inhibition, whereas treatments involving 50% or 100% reinforcement for the CS- eliminated inhibition without conditioning excitation to that CS. The latter outcome also occurred in Experiment 2, with discrete-trial training equating considerably reduced US frequencies for the presence and absence of the CS-. In further evidence that inhibition was eliminated without conditioning excitation to the CS-, Experiment 3 showed that a novel CS did not acquire excitation when 25%, 50%, or 100% reinforcement was equated across the presence and absence of that CS in the context of a discrete-trial event. Using the procedures of Experiment 1, Experiment 4 showed that a CS+ was extinguished by a CS-alone treatment but was substantially maintained by treatments involving 50% or 100% uncorrelated reinforcement. These effects for a CS+ and a CS- implicate CS-US contiguity, rather than contingency, as the factor determining the extinction of a CS.     

Resurgence and repeated within-session progressive-interval thinning of alternative reinforcement

Resurgence of a previously suppressed target behavior is common when reinforcement for a more recently reinforced alternative behavior is thinned. To better characterize such resurgence, these experiments examined repeated within-session alternative reinforcement thinning using a progressive-interval (PI) schedule with rats. In Experiment 1, a transition from a high rate of alternative reinforcement to a within-session PI schedule generated robust resurgence, but subsequent complete removal of alternative reinforcement produced no additional resurgence. Experiment 2 replicated these findings and showed similar effects with a fixed-interval (FI) schedule arranging similarly reduced session-wide rates of alternative reinforcement. Thus, the lack of additional resurgence following repeated exposure to the PI schedule was likely due to the low overall obtained rate of alternative reinforcement provided by the PI schedule, rather than to exposure to within-session reinforcement thinning per se. In both experiments, target responding increased at some point in the session during schedule thinning and continued across the rest of the session. Rats exposed to a PI schedule showed resurgence later in the session and after more cumulative alternative reinforcers than those exposed to an FI schedule. The results suggest the potential importance of further exploring how timing and change-detection mechanisms might be involved in resurgence.