Assessing potential reinforcement-like effects of brief stimuli unrelated to food reinforcers

It is widely assumed that reinforcers are biologically relevant stimuli, or stimuli that have been associated with biologically relevant stimuli. However, brief, arbitrary stimuli have also been reported to have reinforcement-like effects, despite being unrelated to biologically relevant stimuli like food. The present study explored the potential reinforcement-like effects of brief stimuli across 5 experiments. In Experiments 1 through 4, pigeon subjects responded for food reinforcement and brief stimulus presentations in a 2-component multiple schedule. Neither baseline response rates nor resistance to change during disruption tests were systematically greater in a component with versus without brief stimulus presentations. Increasing the rate and duration of brief stimulus presentations in Experiment 4 did not reveal reinforcement-like effects when compared directly with food. In Experiment 5, pigeons chose between independent terminal links in a concurrent-chains procedure. Across conditions, varying the location, duration, and rate of brief stimulus presentations in the terminal links had no systematic effects on preference. In contrast, varying rates of food reinforcers resulted in large and reliable shifts in preference. Therefore, the present study found no systematic evidence that brief stimuli unrelated to food reliably increase response rates, resistance to change, or preference. These data demonstrate the value of systematic replication, and a behavioral momentum approach to assessing potential reinforcement-like effects.     

A two-stage incentive mechanism for rebalancing free-floating bike sharing systems: Considering user preference

Free-floating bike sharing (FFBS) provides citizens with a flexible way for traveling. The operational performance of such systems is impacted by the imbalance problem of demand and supply. This paper proposes the first two-stage incentive mechanism to improve the service quality of FFBS. While inspired by the user-based rebalancing approach in station-based bike sharing (SBBS), our work is different from existing studies because location optimization is a new problem in FFBS and user preference is considered for the first time. We propose three mechanisms that are pick-up incentives, drop-off incentives, and two-stage incentives. When modeling users’ behavioral responses to incentive mechanisms, we think users prefer drop-off incentives to pick-up incentives, which is supported by a survey study. Each incentive offer is composed of a location and a price. To decide the suggested origin or destination, we first figure out the supply and demand of all valid locations based on Radiant Service Theory (RST) and then search the most problematic location comparing current inventory and future demand. The pricing scheme is modified Budgeted Procurement using Upper Confidence Bounds (BP-UCB). Simulation experiments validate the effectiveness of incentive mechanisms based on historical data from Capital BikeShare program. Results show that the service level of bike sharing systems can be significantly improved by three incentive mechanisms. The two-stage incentive mechanism unexpectedly shows no advantage over pick-up incentives. Sensitivity analysis further indicates that user preference will influence the ranking of two single-stage incentive mechanisms.     

Discrimination learning in a foraging situation

Rats were allowed to forage in a simulated natural environment made up of eight food sources (patches) each containing a fixed number of pellets. Two of the eight contained an extra supply of peanuts. The peanut patches were signaled by an olfactory/visual cue located at the bottom of the ladder leading to the patch. In successive phases the number of sessions per day, height of the patches, and availability of peanuts were manipulated. Subjects showed evidence of discrimination learning under these conditions, although the degree of discriminatory behavior varied as a function of environmental manipulations. Assessment of behavior within foraging sessions showed that subjects systematically changed their patterns of utilization of patches across time. Sampling or exploration, as well as food reinforcement, seem implicated in these results.     

A reformulation of the general Euclidean model for the external analysis of preference data

This paper discusses least squares methods for fitting a reformulation of the general Euclidean model for the external analysis of preference data. The reformulated subject weights refer to a common set of reference vectors for all subjects and hence are comparable across subjects. If the rotation of the stimulus space is fixed, the subject weight estimates in the model are uniquely determined. Weight estimates can be guaranteed nonnegative. While the reformulation is a metric model for single stimulus data, the paper briefly discusses extensions to nonmetric, pairwise, and logistic models. The reformulated model is less general than Carroll's earlier formulation.The author is grateful to Christopher J. Nachtsheim for his helpful suggestions.     

THE USE OF BEHAVIORAL ASSESSMENT TO PRESCRIBE AND EVALUATE TREATMENTS FOR SEVERELY HANDICAPPED CHILDREN

Behavioral assessment procedures were used to prescribe and evaluate treatments of maladaptive behavior for 2 children with severe multiple handicaps. In Experiment 1, the results of an assessment of reinforcer preference were used in conjunction with a functional analysis of the conditions maintaining self-injurious behavior to prescribe a treatment for a child with severe disabilities. The treatment procedure involved the use of a pressure-sensitive microswitch to activate reinforcing stimuli during two solitary conditions, during which self-injurious behavior had occurred at high rates. The results were evaluated with a multiple baseline across settings design and indicated that self-injury decreased with concomitant increases in microswitch activation. Results were maintained at 6 weeks, 8 weeks, and 6 months. In Experiment 2, the results of behavioral assessments of reinforcer preference and self-injurious behavior were combined to develop a treatment for a second severely handicapped child, who exhibited high rates of self-injury in demand situations. This treatment was evaluated with a multiple baseline across tasks design and resulted in the elimination of self-injury for up to 15 months.     

ASSESSMENT OF STIMULUS PREFERENCE AND REINFORCER VALUE WITH PROFOUNDLY RETARDED INDIVIDUALS

We evaluated a procedure for identifying potential reinforcers with profoundly retarded individuals. In Experiment 1, six persons were repeatedly exposed to 16 stimuli, and approach behaviors to each stimulus were used to identify preferred and nonpreferred stimuli. In Experiment 2, we examined the reinforcing properties of preferred and nonpreferred stimuli by delivering them contingently on the occurrence of arbitrarily selected responses. Results revealed that the preferred stimulus conditions typically produced higher rates of responding than did either the baseline or the nonpreferred stimulus conditions, suggesting that the procedure can be used to assess reinforcer value for individuals with limited behavioral repertoires.     

Three-way metric unfolding via alternating weighted least squares

Three-way unfolding was developed by DeSarbo (1978) and reported in DeSarbo and Carroll (1980, 1981) as a new model to accommodate the analysis of two-mode three-way data (e.g., nonsymmetric proximities for stimulus objects collected over time) and three-mode, three-way data (e.g., subjects rendering preference judgments for various stimuli in different usage occasions or situations). This paper presents a revised objective function and new algorithm which attempt to prevent the common type of degenerate solutions encountered in typical unfolding analysis. We begin with an introduction of the problem and a review of three-way unfolding. The three-way unfolding model, weighted objective function, and new algorithm are presented. Monte Carlo work via a fractional factorial experimental design is described investigating the effect of several data and model factors on overall algorithm performance. Finally, three applications of the methodology are reported illustrating the flexibility and robustness of the procedure.We wish to thank the editor and reviewers for their insightful comments.     

Preference for less segmented fixed-time components in concurrent-chain schedules of reinforcement

A concurrent-chain procedure was used to examine choice between segmented and less segmented response-independent schedules of reinforcement. A pair of independent, concurrent variable-interval 60-s schedules were presented in the initial link, along with a 1.5-s changeover delay. A chained fixed-interval fixed-time and its corresponding tandem schedule constituted the terminal links. The length of the fixed-interval schedule in the terminal link was varied between 5 s and 30 s while that of the fixed-time schedule was kept at 5 s over conditions. The first components of both terminal-link schedules were accompanied by the same stimulus. Except in the baseline condition, the onset of the second component of the terminal-link chained schedule was accompanied by either a localized (key color) or a nonlocalized (dark houselight) stimulus change. Stimulus conditions were constant during the terminal-link tandem schedule. With three exceptions, pigeons demonstrated a slight preference for the tandem over the chained schedule in the terminal link. Furthermore, this preference varied inversely with the length of the first component. In general, these results are consistent with previous studies that reported an adverse effect on choice by segmenting an interval schedule into two or more components, but they are inconsistent with studies that reported preference for signaled over unsignaled delay of reinforcement.     

Evaluating public posting,goal setting,and rewards to increase physical activity in children

In this study, we evaluated several components of a pedometer-based intervention with children in an elementary-school-aged classroom, across 24-h sessions. The intervention included combinations of self-monitoring, goal setting, feedback, and reinforcement, and data were analyzed at both the classroom level (i.e., average daily step totals) and the individual level (i.e., daily step totals), across phases. The highest levels of physical activity were observed when components of self-monitoring, public posting, goal setting, and feedback with reward were applied concurrently.