Assessing potential reinforcement-like effects of brief stimuli unrelated to food reinforcers

It is widely assumed that reinforcers are biologically relevant stimuli, or stimuli that have been associated with biologically relevant stimuli. However, brief, arbitrary stimuli have also been reported to have reinforcement-like effects, despite being unrelated to biologically relevant stimuli like food. The present study explored the potential reinforcement-like effects of brief stimuli across 5 experiments. In Experiments 1 through 4, pigeon subjects responded for food reinforcement and brief stimulus presentations in a 2-component multiple schedule. Neither baseline response rates nor resistance to change during disruption tests were systematically greater in a component with versus without brief stimulus presentations. Increasing the rate and duration of brief stimulus presentations in Experiment 4 did not reveal reinforcement-like effects when compared directly with food. In Experiment 5, pigeons chose between independent terminal links in a concurrent-chains procedure. Across conditions, varying the location, duration, and rate of brief stimulus presentations in the terminal links had no systematic effects on preference. In contrast, varying rates of food reinforcers resulted in large and reliable shifts in preference. Therefore, the present study found no systematic evidence that brief stimuli unrelated to food reliably increase response rates, resistance to change, or preference. These data demonstrate the value of systematic replication, and a behavioral momentum approach to assessing potential reinforcement-like effects.     

A two-stage incentive mechanism for rebalancing free-floating bike sharing systems: Considering user preference

Free-floating bike sharing (FFBS) provides citizens with a flexible way for traveling. The operational performance of such systems is impacted by the imbalance problem of demand and supply. This paper proposes the first two-stage incentive mechanism to improve the service quality of FFBS. While inspired by the user-based rebalancing approach in station-based bike sharing (SBBS), our work is different from existing studies because location optimization is a new problem in FFBS and user preference is considered for the first time. We propose three mechanisms that are pick-up incentives, drop-off incentives, and two-stage incentives. When modeling users’ behavioral responses to incentive mechanisms, we think users prefer drop-off incentives to pick-up incentives, which is supported by a survey study. Each incentive offer is composed of a location and a price. To decide the suggested origin or destination, we first figure out the supply and demand of all valid locations based on Radiant Service Theory (RST) and then search the most problematic location comparing current inventory and future demand. The pricing scheme is modified Budgeted Procurement using Upper Confidence Bounds (BP-UCB). Simulation experiments validate the effectiveness of incentive mechanisms based on historical data from Capital BikeShare program. Results show that the service level of bike sharing systems can be significantly improved by three incentive mechanisms. The two-stage incentive mechanism unexpectedly shows no advantage over pick-up incentives. Sensitivity analysis further indicates that user preference will influence the ranking of two single-stage incentive mechanisms.     

A reformulation of the general Euclidean model for the external analysis of preference data

This paper discusses least squares methods for fitting a reformulation of the general Euclidean model for the external analysis of preference data. The reformulated subject weights refer to a common set of reference vectors for all subjects and hence are comparable across subjects. If the rotation of the stimulus space is fixed, the subject weight estimates in the model are uniquely determined. Weight estimates can be guaranteed nonnegative. While the reformulation is a metric model for single stimulus data, the paper briefly discusses extensions to nonmetric, pairwise, and logistic models. The reformulated model is less general than Carroll's earlier formulation.The author is grateful to Christopher J. Nachtsheim for his helpful suggestions.     

Stimulus effects on concurrent performance in transition

Six experimentally naive pigeons were exposed to concurrent variable-interval variable-interval schedules in a three-key procedure in which food reinforcement followed pecks on the side keys and pecks on the center key served as changeover responses. In Phase 1, 3 birds were exposed to 20 combinations of five variable-interval values, with each variable-interval value consistently associated with a different color on the side keys. Another 3 pigeons were exposed to the same 20 conditions, but with a more standard procedure that used a nondifferential discriminative stimulus on the two side keys throughout all conditions. In Phase 2, the differential and nondifferential stimulus conditions were reversed for each pigeon. Each condition lasted for one 5-hr session and one subsequent 1-hr session. In the last 14 conditions of each phase, the presence of differential discriminative stimuli decreased the time necessary for differential responding to develop and increased the sensitivity of behavior to reinforcement distribution in the 1st hr of training; during the last hours of training in each condition, however, the effects of the differential discriminative stimuli could not be distinguished from the effects of reinforcement distribution per se. These results show the importance of studying transitions in behavior as well as final performance. They may also be relevant to discrepancies in the results of previous experiments that have used nonhuman and human subjects.     

SPELLING AND EMERGENT PICTURE-PRINTED WORD RELATIONS ESTABLISHED WITH DELAYED IDENTITY MATCHING TO COMPLEX SAMPLES

Students with academic deficits learned delayed matching-to-sample tasks that used complex sample stimuli, each consisting of a picture and a printed word. A touch to the sample complex removed it from the computer display and produced either picture comparisons or a choice pool of letters. If the comparisons were pictures, selecting the picture identical to the preceding sample was reinforced. If the letters appeared, letter-by-letter construction of the preceding printed word sample was reinforced. The procedure engendered new constructed-response spelling performances and arbitrary relations among pictures and printed words in matching to sample. The emergence of relations among different sets of printed words (paired with the same pictures) suggested classes of equivalent stimuli. Outcome tests involving spoken words as sample stimuli suggested expansion of subjects' spelling repertoires and stimulus classes.     

USING STIMULUS EQUIVALENCE PROCEDURES TO TEACH NAME-FACE MATCHING TO ADULTS WITH BRAIN INJURIES

On pretests, 3 men with brain injuries matched dictated names of three therapists to written names, but did not match dictated or written names to photos, produce correct names in response to photos, locate offices given written names, or name therapists on sight. Match-to-sample training established conditional relations between dictated names and photos. Posttests showed the emergence of untrained conditional relations involving photos and written names, indicating development of three classes of equivalent stimuli (each containing a dictated name, photo, and written name). For 1 participant, conditional relations involving photos of office nameplates were also examined, but did not emerge pre- or posttraining. Two participants produced names orally when given photos and sorted written names and faces together after training; the 3rd participant was unavailable for these posttests. After training, 1 participant located and named all three therapists in their offices.     

PROMOTING STIMULUS CONTROL WITH TEXTUAL PROMPTS AND PERFORMANCE FEEDBACK FOR PERSONS WITH MILD DISABILITIES

We assessed whether written task analyses would serve as textual prompts for performing functional tasks by persons with mild disabilities. Several variables that could influence the effectiveness of textual prompts to promote stimulus control were examined across four groups. A consistent finding was that written specific task analyses combined with end-of-trial performance feedback were effective for promoting the acquisition and generalization of several tasks. Performance transferred immediately to natural discriminative stimuli when the written task analyses and feedback were withdrawn for most tasks and participants. For 2 participants, transfer of stimulus control was accomplished by prompt fading, using individualized written task analyses either with or without performance feedback (Group 1). When feedback was not provided, the effectiveness of written specific task analyses was inconsistent across groups. In contrast to the controlling effects of written specific task analyses, written generic task analyses, which specified only major task outcomes, when combined with performance feedback (Group 1) did not control responding. Overall, this research demonstrated the effectiveness of written specific task analyses and performance feedback to promote stimulus control for persons with mild disabilities.     

Fixed-ratio pausing: Joint effects of past reinforcer magnitude and stimuli correlated with upcoming magnitude

Pigeons responded on fixed-ratio schedules ending in small or large reinforcers (grain presentations of different duration) interspersed within each session. In mixed-schedule conditions, the response key was lit with a single color throughout the session, and pausing was directly related to the past reinforcer (longer pauses after large reinforcers than after small ones). In multiple-schedule conditions, different colors accompanied the ratios ending in small and large reinforcers, and pausing was affected by the upcoming reinforcer as well as the past one. Pauses were shorter before large reinforcers than before small ones, but they continued to be longer after large reinforcers than after small ones. The influence of the past reinforcer was modulated by the magnitude of the upcoming reinforcer; in the presence of the stimulus before the small reinforcer, the effect of the past reinforcer was enhanced relative to its effect in the stimulus before the large reinforcer. These results show that pausing between ratios is jointly determined by two competing factors: past conditions of reinforcement and stimuli correlated with upcoming conditions.     

Delayed constructed-response identity matching improves the spelling performance of students with mental retardation

We assessed the effects of a computerized matching-to-sample procedure on the spelling performances of three students with mental retardation. Initially, the students could 1) match pictures and printed words to one another, and 2) match pictures and printed words to spoken words. However, they could not construct words to either pictures or spoken words (e.g., touch, in order, the letters s->h->o->e given the spoken-word sample Shoe). Word constructions then improved markedly after exposure to delayed constructed-response identity matching (e.g., touch the letters s->h->o->e given the printed-word sample shoe). One subject's oral and written spelling also improved. The results extend previous research by showing multiple positive effects of a computerized spelling intervention. These effects may have occurred in part because of the formation of stimulus classes among pictures, printed words, and spoken words.     

Effects of relative reinforcer frequency on complex color detection

Pigeons were trained under a discrete-trials detection procedure in which one of a set of color stimuli was presented on the center key and a single response turned off the stimulus and illuminated two side keys. Single responses to one or the other side key produced occasional reinforcers depending on the value of the color stimulus. In Experiment 1, one color-stimulus set comprised 559, 564, 569, and 574 nm, and right-key pecks were occasionally reinforced following presentations of members of this set. The other stimulus set comprised 579, 584, 589, and 594 nm, and left-key pecks were occasionally reinforced following presentations of members of this set. Across seven experimental conditions, the left/(left + right) relative reinforcer frequency was varied from .1 to .9. In Experiment 2, one stimulus set contained only one member, 574 nm, and right-key responses were occasionally reinforced following its presentation. Over 12 experimental conditions, two manipulations were carried out. First, the number of stimuli comprising the other stimulus set was increased from one (579 nm) to two (579 and 584 nm) to three (579, 584, and 589 nm) and to four (579, 584, 589, and 594 nm), and left-key responses were reinforced occasionally following center-key presentations of members of this set. Second, for each stimulus combination, the left/(left + right) relative reinforcer frequency was varied from .1 to .5 to .9 across three experimental conditions. The principal finding of Experiments 1 and 2 was that reinforcers and stimuli interacted in their effects on behavior. In Experiment 3, pairs of adjacent stimuli (5 nm apart) in the range 559 to 594 nm were presented in each experimental condition, and the left/(left + right) relative reinforcer frequency was held constant at .5. The data from all three experiments were analyzed according to a detection model describing performance in multiple-stimulus two-response procedures. This model provided independent measures of stimulus discriminability, contingency discriminability, and bias. The analysis showed that (a) consistent with the color-naming function, pigeons were better able to discriminate between higher nanometer values than lower nanometer values; (b) their ability to discriminate between the stimuli was independent of the number of wavelengths comprising each stimulus set; (c) they allocated delivered reinforcers very accurately to the previously emitted response; and (d) no consistent biases emerged.