Reinforcement uncertainty enhances preference for choice in humans

Under concurrent‐chains schedules of reinforcement, participants often prefer situations that allow selection among alternatives (free choice) to situations that do not (forced choice). The present experiment examined the effects of reinforcement probability on choice preferences. Preferences for free versus forced choice were measured under a condition in which participants' choices were always reinforced (reinforcement probability of 1.0) and a condition in which outcomes were uncertain (reinforcement probability of 0.5). Forty‐four college students participated and preferences were examined under a concurrent‐chains schedule of reinforcement. Participants preferred free choice under uncertain reinforcement, but a bias toward free choice was not observed when reinforcement was certain. These results align with previous findings of preference for free choice under conditions of uncertainty, but suggest that preference may be dependent upon probabilistic reinforcement contingencies in the terminal links of the concurrent‐chains arrangement. Thus, reinforcement probability is an important variable to consider when conducting similar studies on the value of choice.     

Driving speed choice: The role of conscious monitoring and control (reinvestment) when driving

This study aimed to examine the role of reinvestment - the propensity to consciously monitor and control actions (movement specific reinvestment) and to consciously monitor and evaluate decision making processes (Decision specific reinvestment) while driving in everyday risky scenarios. The study also aimed to evaluate the association between reinvestment and previously validated driver attitude measures. Fifty one participants completed a series of questionnaires (Driving Self-Efficacy Scale, Driver Attitude Questionnaire, Movement Specific Reinvestment Scale, Decision Specific Reinvestment Scale) after which they completed a test phase in a driving simulator. In the test phase, driving scenarios included roads with different markings (i.e., double yellow, wide centrelines, wire rope barriers, Audio Tactile Profiled markings) and alerting scenarios (i.e., police car present, high crash risk area sign, reduced speed zone). Results revealed that on risky roads (wide centrelines), participants with a high propensity for decision specific reinvestment drove slower than those with a low propensity. Driver experience, attitudes towards speeding and scores on the Decision Reinvestment subscale of the Decision Specific Reinvestment Scale significantly predicted speed choice. More experienced participants with higher scores on the Decision Reinvestment subscale were more likely to drive slower and participants with worse attitudes towards speeding were likely to drive faster. Participants with a low propensity for movement specific reinvestment (specifically, Movement Self-Consciousness) reduced their speed to a greater extent than those with a high propensity when driving in the police car scenario. There was some evidence to suggest that high decision specific and movement specific reinvesters were more likely to be involved in crashes and receive driving infringements. The current study is the first to demonstrate a significant relationship between reinvestment and driving. The implications of these findings for road safety are discussed.     

The effects of providing access to stimuli following choice making during vocal preference assessments

Two variations of a vocal paired-stimulus preference assessment were evaluated to determine whether the verbal reports of preference, given by individuals with developmental disabilities when no access to the activity was given, matched their verbal reports when access to the activity was given contingent on their choice. The results indicated different outcomes between the two methods for 6 of the 7 participants. Subsequent reinforcer assessments, conducted for 2 participants, showed that activities identified in the preference assessments that provided access contingent on selection resulted in more responding than did activities identified in the preference assessment that did not include access to items following their selection.     

Speed behaviour as a choice between observing and exceeding the speed limit

Despite speed behaviour being defined as a choice between several possible speeds, studies using theory of reasoned action or theory of planned behaviour to predict and understand speed behaviour have focused on exceeding and not on observing the speed limit. This study examines whether the evaluation of exceeding but also of observing the speed limit contributes to improving predictions of self-reported speed behaviour and determining intentions to produce each of these two behavioural options. For a specific driving situation (straight road with 90 km/h speed limit), 238 young male drivers reported the speed at which they would drive at and where asked to assess the theory of planned behaviour key constructs with respect to observing and exceeding the speed limit by at least 20 km/h. Results showed that the amount of explained variance of self-reported speed behaviour, as well as intentions to observe and to exceed the speed limit by at least 20 km/h, increased significantly when the evaluations of the two options were introduced in the same stepwise regression analysis. Theoretical and practical implications of the results are discussed.     

Judgments of mean speed and predictions of route choice

How are driving speeds integrated when speeds vary along a route? In a first study, we examined heuristic processes used in judgments of mean speed when the mean speeds on parts of the trip varied. The judgments deviated systematically from objective mean speeds because the distances driven at different speeds were given more weight than travel time spent on the different distances. The second study showed that when there was a 10–15 min pause during a travel the effect on the mean speed decrease was underestimated for driving speeds of 90 km/h and higher. In the third study, the objective mean speeds and the subjective biased mean speed judgments were used to predict choices between routes with different speed limits. The results showed that subjective judgments predicted decisions to maximize mean speed significantly better than objective mean speeds. Finally, some applied and basic research implications of the results were discussed.     

Effects of a history of differential reinforcement on preference for choice

The effects of a history of differential reinforcement for selecting a free-choice versus a restricted-choice stimulus arrangement on the subsequent responding of 7 undergraduates in a computer-based game of chance were examined using a concurrent-chains arrangement and a multiple-baseline-across-participants design. In the free-choice arrangement, participants selected three numbers, in any order, from an array of eight numbers presented on the computer screen. In the restricted-choice arrangement, participants selected the order of three numbers preselected from the array of eight by a computer program. In initial sessions, all participants demonstrated no consistent preference or preference for restricted choice. Differential reinforcement of free-choice selections resulted in increased preference for free choice immediately and in subsequent sessions in the absence of programmed differential outcomes. For 5 participants, changes in preference for choice were both robust and lasting, suggesting that a history of differential reinforcement for choice may affect preference for choice.     

Effects of experience on preference between forced and free choice

Preference between forced choice and free choice in concurrent-chain schedules of reinforcement was investigated in pigeons after exposure to particular combinations of terminal links. In Experiment 1, in which terminal links always ended with reinforcers, one of three pairs of terminal links was arranged as preexposure: (a) both terminal links had only one key (forced choice), (b) both terminal links had two keys (free choice), or (c) a combination of forced and free choice was arranged across sessions. In test sessions following the preexposure, pigeons' preferences rapidly shifted to the terminal links with which they had no recent experience. In Experiment 2, the same procedure was repeated except that each terminal link ended intermittently with reinforcers with a probability of .5 and there was no terminal-link arrangement with a combination of free and forced choice. Pigeons showed the same preference changes as in Experiment 1, but the preference changes did not appear immediately at the beginning of test sessions. These data suggest that recent previous experience was a more important determinant of preference than the difference between forced-choice and free-choice terminal links.     

Further evaluation of low-ranked items in stimulus-choice preference assessments

The generality of the findings reported by DeLeon, Iwata, and Roscoe (1997) was examined by conducting two stimulus-choice preference assessments, the second of which evaluated low-ranked items from the initial assessment. Results for the 2 participants suggested that supplementary assessments of low-ranked items may be useful for identifying a wider variety of reinforcing stimuli.     

Limits to preference and the sensitivity of choice to rate and amount of food

Studies of choice holding food‐amount ratio constant while varying food‐rate ratio within sessions showed that local changes in preference depend on relative amount of food. The present study investigated whether sensitivity of choice to food‐rate ratio and sensitivity to food‐amount ratio are independent of one another when food‐rate ratios are varied across sessions and food‐amount ratios are varied within sessions. Food deliveries for rats’ presses on the left and right levers were scheduled according to three different food‐rate ratios of 1:1, 9:1, and 1:9; each food‐rate ratio lasted for 106 sessions and was arranged independently of seven food‐amount ratios (7:1, 6:2, 5:3, 4:4, 3:5, 2:6, and 1:7 food pellets) occurring within sessions in random sequence. Each amount ratio lasted for 10 food deliveries and was separated from another by a 60‐s blackout. Sensitivity to rate ratio was high (1.0) across food deliveries. Sensitivity to amount ratio was low when food rates were equal across alternatives, but was high when rate ratio and amount ratio opposed one another. When rate ratio and amount ratio went in the same direction, choice ratio reached an elevenfold limit which reduced sensitivity to approximately zero. We conclude that three factors affect sensitivity to amount: (1) the limit to preference, (2) the equal effect on preference of amounts greater than four pellets, and (3) the absence of differential effects of switches in amount in the equal‐rates (1:1) condition. Taken together, these findings indicate that rate and amount only sometimes combine independently as additive variables to determine preference when amount ratios vary frequently within sessions.     

Determining preschoolers' preferences for choice-making opportunities: choice of task versus choice of consequence

Individuals may prefer contexts with the option to choose between 2 reinforcing stimuli or between 2 tasks relative to contexts in which others select the same events. We evaluated children's preferences for conditions characterized by (a) the opportunity to choose between tasks and (b) the opportunity to choose between putative reinforcers delivered following the completion of a task relative to no-choice and no-reinforcement control conditions. Three of 4 participants preferred the consequence-choice condition; the task-choice condition was no more preferred than the no-choice condition in any case.     

Pigeons' preference for free choice: number of keys versus key area.

In concurrent-chains schedules, pigeons prefer terminal links that provide two keys correlated with reinforcers (free choice) over those that provide only one key (forced choice), terminal-link reinforcement rates being equal. With same-size keys, free choice provides a larger area available for pecking. Preferences were examined using terminal links that differed in key number only (one or two) or key size only (small and medium or medium and large), or that equated the area of the two free-choice keys with that of the forced-choice key. Medium (standard) keys were typically preferred to small keys, but indifference was typically obtained between medium and large keys. The size preference usually overrode free-choice preference with one medium key pitted against two small keys, but free-choice preference was reliably observed with one large key pitted against two medium keys. In other words, preferences were a joint function of key number and key area, implying that free-choice preference is not reducible to preference for larger key areas. Free-choice preference requires separate keys rather than larger areas; the relevant behavioral units are the discriminated operants correlated with each terminal-link key rather than classes defined by topographical features such as area or perimeter.     

Some determinants of changes in preference over time

Results of longitudinal studies suggest that the stability of preferences varies across individuals, although it is unclear what variables account for these differences. We extended this work by conducting periodic assessments of preference for leisure activities over 3 to 6 months with 10 adults with developmental disabilities. Although previous research has collectively shown that preferences identified via repeated assessment are highly variable, our results showed that preferences were relatively stable for the majority (80%) of participants. In an attempt to identify some environmental determinants of shifts in preference, we provided extended daily access to high-preference items (preference-weakening manipulation) and paired access to low-preference items with social and edible putative reinforcers during brief sessions (preference-strengthening manipulation). Preference assessments continued over the course of these manipulations with 2 participants. Results showed that changes in preference across time could be produced systematically and suggest that naturally occurring changes in establishing operations or conditioning histories contribute to temporal shifts in preference. Implications for preference assessments, reinforcer usage, and planned attempts to change preferences are discussed.     

Assessing the value of choice in a token system

Responding of 4 children was assessed under conditions in which (a) no programmed contingencies were arranged for target behavior, (b) responding produced tokens that could be exchanged for a single highly preferred edible item, and (c) responding produced a token that could be exchanged for a variety of preferred edible items. After assessing the effects of these contingencies, the preferences of 3 participants were assessed using a concurrent-chains schedule. Preference for the opportunity to choose from the same or qualitatively different edible items varied across participants, and findings were generally consistent with those of Tiger, Hanley, and Hernandez (2006).     

Assessment of sexual preference using a choice reaction time task

The purpose of this study was to investigate the use of a choice reaction time task, during which slides of sexually explicit and neutral stimuli were used as an interference task, to differentiate between groups of individuals on the basis of their sexual preference. Twenty subjects, in each of the four groups (heterosexual males, heterosexual females, homosexual males, and homosexual females), participated in this study. Sexual orientation was determined by self-report. Subjects were given a choice reaction time with interference task, followed by a recall incidental learning task. A significant higher-order interaction was found among gender, orientation, and stimulus type for all four groups. This interaction indicated a longer reaction time to slides depicting preferred sexual partners than to nonpreferred sexual partners or neutral scenes. These results indicate that sexual arousal does interfere with cognitive processing. A main effect for gender was found for the incidental learning task, with males having the fewest errors.     

On the role of preference in response competition

A duration-based preference assessment identified items that matched and did not match the sensory consequences hypothesized to maintain stereotypy. When evaluated in treatment, these items effectively competed with the occurrence of stereotypy, regardless of their sensory properties. It is suggested that relative preference, as measured in duration-based assessment, can be as significant as type of stimulation produced in interventions that reduce automatically reinforced problem behavior.     

The role of task preference in the effectiveness of response interruption and redirection

Response interruption and redirection (RIRD) is a common treatment for automatically reinforced vocal stereotypy; it involves the contingent presentation of task instructions. Tasks that are included in RIRD are typically selected based on caregiver report, which may affect the efficacy of RIRD. The purpose of the current study was to evaluate the role of task preference in the efficacy of RIRD for four participants who engaged in vocal stereotypy. We conducted task-preference assessments and selected tasks of varying preferences to include in RIRD. For three out of four participants, the results showed that RIRD with higher preference tasks was not effective at reducing vocal stereotypy, whereas RIRD with lower preference tasks was effective for all participants.     

Effects of preference on performing a self-care skill among children with autism spectrum disorder

In this study, four children with autism were assessed to determine their preference choices for toothbrushes and toothpastes included during self-care skills teaching sessions. For two of the children, the presence of high-preference (HP) materials was associated with improved independent tooth brushing when compared to the presence of low-preference (LP) materials. There was no difference in independent tooth brushing between HP/LP conditions for the other two children. These findings suggest that preference and choice of materials alone can be a helpful instructional strategy for care providers serving children who have neurodevelopmental disorders and skill deficits.     

The role of friends in career compromise: Same-gender friendship intensifies gender differences in educational choice

We propose a mechanism of how the desire to maintain friendships can intensify gender differences in educational choice. The required conditions for this mechanism would be that (1) adolescent males and females differ in their overall educational preferences, (2) wanting to stay close to friends motivates some adolescents to adjust their educational choice in line with their friends' choices, and (3) adolescents have a higher share of same-gender, than other-gender, friends. Study 1 confirmed that these criteria were met, and Study 2 found an association between friendship priority and gender typed field of study. In conclusion, adjusting educational choices in order to maintain friendships put adolescents at risk of compromising their true career interests, and also becomes an obstacle to a gender balanced labor market.     

Estimating effectiveness of speed reduction measures for pedestrian crossing treatments using an empirically supported speed choice modeling framework

Pedestrian crossing treatments, such as Pedestrian Hybrid Beacons (PHBs) and Rectangular Rapid-Flashing Beacons (RRFBs), are traffic control devices implemented to help pedestrians safely cross busy or higher-speed roadways at midblock crossings and uncontrolled intersections. This study aims to assess the effectiveness of the PHB and RRFB by analyzing drivers’ speeding behavior under different roadway types with real-life traffic conditions. In order to understand the effect of pedestrian crossing treatments (i.e., PHB and RRFB) have on drivers’ speeding behavior, this paper analyzes four zones (i.e., one upstream zone and three consecutive downstream zones). For the four analysis zones, different indexes were computed which corresponds to the differences in drivers’ speed when encountered with the pedestrian crossing treatments. A grouped random effect hurdle beta regression model is estimated for the indexes, with a fixed effect hurdle beta model used for comparison and validating the importance of considering the grouped random heterogeneity across participants. The proposed analysis framework was validated by the means of an empirical driving simulator study, based on two urban roads in the Central Florida region, North Alafaya Trail (SR-434) and South Orange Blossom Trail (US-441). The results revealed that the proposed modeling framework reflects drivers’ difference in speed for the different pedestrian crossing treatments. The results suggest that with proper understanding of the PHB, the PHB can reduce drivers speed even beyond the location of the PHB. Meanwhile, the RRFB does have some effect in speed reduction beyond the location of the RRFB, however many drivers failed to acknowledge the RRFB. It is suggested that when drivers’ have proper education on the use of the PHB to reduce speed safely and for the installation of RRFB be on roads with two or less lanes and a speed limit less than 40 mph. While the main purpose of the pedestrian crossing treatments is to help pedestrians cross safely, speed reduction can be considered a byproduct as revealed in this study.