A local model of concurrent performance

Concurrent procedures may be conceptualized as consisting of two pairs of schedules with only one pair operating at a time. One schedule of each pair arranges reinforcers for staying in the current alternative, and the other schedule arranges reinforcers for switching to the other alternative. These pairs alternate operation as the animal switches between choices. This analysis of the contingencies suggests that variables operating within an alternative produce behavior that conforms to the generalized matching law. Rats were exposed to one pair of stay and switch schedules in each condition, and the probabilities of reinforcement varied across conditions. Both run length and visit duration were power functions of the ratio of the probabilities of reinforcement for staying and switching. The local model, a model of performance on concurrent procedures, was derived from this power function. Performance on concurrent schedules was synthesized from the performances on the separate pairs. Both the generalized matching law and the local model fitted the synthesized concurrent performances. These results are consistent with the view that the contingencies in the alternative, the probability of stay and switch reinforcement, are responsible for performance consistent with the generalized matching law. These results are compatible with momentary maximizing and molar maximizing accounts of concurrent performance. Models of concurrent performance that posit comparisons among the alternatives are not easily applied to these results.     

EFFECTS OF A SIGNALED DELAY TO REINFORCEMENT IN THE PREVIOUS AND UPCOMING RATIOS ON BETWEEN-RATIO PAUSING IN FIXED-RATIO SCHEDULES

Domestic hens responded under multiple fixed‐ratio fixed‐ratio schedules with equal fixed ratios. One component provided immediate reinforcement and the other provided reinforcement after a delay, signaled by the offset of the key light. The components were presented quasirandomly so that all four possible transitions occurred in each session. The delay was varied over 0, 4, 8, 16, and 32 s with fixed‐ratio 5 schedules, and over 0, 8 and 32 s with fixed‐ratio 1, 15 and 40 schedules. Main effects of fixed‐ratio value and delay duration were detected on between‐ratio pauses. Pauses were longer when the multiple‐schedule stimulus correlated with a delayed‐reinforcer component was presented, with the longest pauses occurring at the transition from a component with an immediate reinforcer to one with a delayed reinforcer. Pause durations were shortest during immediate components. Overall, both the presence or absence of a delay in the upcoming component, and the presence or absence of a delay in the preceding component affected pause length, but the upcoming delay had the larger effect. Thus changes in delay had similar effects to past reports of the effects of changes in response force, response requirement, and reinforcer magnitude in multiple fixed‐ratio fixed‐ratio schedules.     

Some determinants of remote behavioral history effects in humans

Undergraduates were exposed to a series of reinforcement schedules: first, to a fixed-ratio (FR) schedule in the presence of one stimulus and to a differential-reinforcement-of-low-rate (DRL) schedule in the presence of another (multiple FR DRL training), then to a fixed-interval (FI) schedule in the presence of a third stimulus (FI baseline), next to the FI schedule under the stimuli previously correlated with the FR and DRL schedules (multiple FI FI testing), and, finally, to a single session of the multiple FR DRL schedule again (multiple FR DRL testing). Response rates during the multiple FI FI schedule were higher under the former FR stimulus than under the former DRL stimulus. This effect of remote histories was prolonged when either the number of FI-baseline sessions was small or zero, or the time interval between the multiple FR DRL training and the multiple FI FI testing was short. Response rates under these two stimuli converged with continued exposure to the multiple FI FI schedule in most cases, but quickly differentiated when the schedule returned to the multiple FR DRL.     

SAwSu: An Integrated Model of Associative and Reinforcement Learning

Successfully explaining and replicating the complexity and generality of human and animal learning will require the integration of a variety of learning mechanisms. Here, we introduce a computational model which integrates associative learning (AL) and reinforcement learning (RL). We contrast the integrated model with standalone AL and RL models in three simulation studies. First, a synthetic grid‐navigation task is employed to highlight performance advantages for the integrated model in an environment where the reward structure is both diverse and dynamic. The second and third simulations contrast the performances of the three models in behavioral experiments, demonstrating advantages for the integrated model in accounting for behavioral data.     

Making Time Protestant in Early-Modern Glasgow

This article, drawn largely from the under-utilized Kirk session records from late-sixteenth-century Glasgow, by way of example, demonstrates how changing dispositions towards time were at the heart of the Reformation change of religion in Scotland. From the expansion of time obligations of Christians, the alteration of holy days, and the re-definition of basic units of time, alternative understandings of time were among the most tangible effects of the establishment of Protestantism in Scotland. In introducing time as a new way to examine the broad influence of the Reformation on the lives of the Scottish people, the article builds on recent research on the European Reformations while also introducing new perspectives on the uniqueness of the Scottish case.     

Gray’s revised Reinforcement Sensitivity Theory in relation to Attention-Deficit/Hyperactivity and Tourette-like behaviors in the general population

Attention-Deficit/Hyperactivity Disorder (ADHD) and Tourette syndrome (TS) present as distinct conditions clinically; however, they show comorbidity and inhibitory control deficits have been proposed to underlie both. The role of reinforcement sensitivity in ADHD has been studied previously, but no study has addressed this in relation to TS-like behaviors in the general population. The present study examined these associations within the remit of the revised Reinforcement Sensitivity Theory (rRST). One hundred and thirty-eight participants completed psychometric measures of the rRST, and self-report checklists for ADHD- and TS-like behaviors. The results show that whilst ADHD-inattention was only linked to increased anxiety (BIS), ADHD-hyperactivity/impulsivity was linked to increased impulsivity (BAS-fun seeking), anxiety (BIS) and punishment sensitivity (FFFS), and to reduced reward sensitivity (BAS-reward responsiveness), independently of ‘comorbid’ TS-like behaviors. TS-related phonic tics were associated with increased BIS and FFFS, and TS-related obsessive–compulsive behaviors (OCBs) with increased goal-orientation (BAS-drive) and reduced impulsivity (BAS-fun seeking). However, these associations were driven by ADHD-like behaviors or OCB co-occurrence, respectively, suggesting little role of the rRST in pure TS-like behaviors. The results are discussed in light of mixed findings in the literature and the importance of distinguishing between multiple processing models of the rRST in distinct disorder phenotypes.     

An Analysis of Feedback from a Behavior Analytic Perspective

The present paper presents a systematic analysis from a behavior analytic perspective of procedures termed feedback. Although feedback procedures are widely reported in the discipline of psychology, including in the field of behavior analysis, feedback is neither consistently defined nor analyzed. Feedback is frequently treated as a principle of behavior; however, its effects are rarely analyzed in terms of well-established principles of learning and behavior analysis. On the assumption that effectiveness of feedback procedures would be enhanced when their use is informed by these principles, we sought to provide a conceptually systematic account of feedback effects in terms of operant conditioning principles. In the first comprehensive review of this type, we compare feedback procedures with those of well-defined operant procedures. We also compare the functional relations that have been observed between parameters of consequence delivery and behavior under both feedback and operant procedures. The similarities observed in the preceding analyses suggest that processes revealed in operant conditioning procedures are sufficient to explain the phenomena observed in studies on feedback.