An analysis of sequential variables in Pavlovian conditioning employing extended and limited acquisition training

Sequential theory’s memory model of learning has been successfully applied in response contingent instrumental conditioning experiments (Capaldi, 1966, Capaldi, 1967, Capaldi, 1994 and Capaldi and Miller, 2003). However, it has not been systematically tested in nonresponse contingent Pavlovian conditioning experiments. The present experiments attempted to determine if several sequential variables affect responding in Pavlovian situations as they do in instrumental ones. Of primary concern here were the effects on extinction of number of NR transitions (the number of times a nonreinforced trial is followed by a reinforced trial), N-length (the number of successive nonreinforced trials that precede a reinforced trial), and percentage of reinforcement (50 versus 100%) following either extended acquisition training (Experiment 1, 720 trials) or limited acquisition training (Experiment 3, 24 trials). In agreement with a sequential analysis, N-length increased resistance to extinction more than number of NR transitions following extensive training with the opposite occurring following limited training. In Experiment 1, greater resistance to extinction was associated with 50% than with 100% reinforcement, a partial reinforcement extinction effect (PREE). Experiment 2 examined an anomalous finding obtained in Experiment 1. A major theoretical difference between instrumental and Pavlovian conditioning has been held to be the greater ease of producing a PREE in instrumental than in Pavlovian conditioning (Kimble, 1961 and Mackintosh, 1974). However, the findings obtained here suggest that the probability of obtaining a PREE and other Pavlovian extinction effects, as in instrumental conditioning, increases along with the effectiveness of the sequential variables employed.     

A FUNCTIONAL ANALYSIS OF HAIR PULLING

We experimentally assessed the functions of hair pulling and hair manipulation of a 19-year-old woman (Kris) with moderate mental retardation and cerebral palsy. In Phase 1 a functional analysis revealed that Kris pulled and manipulated hair for the greatest amount of time in the alone condition, suggesting that the behaviors were maintained by some form of automatic reinforcement (Vaughan & Michael, 1982). In Phase 2 we assessed the nature of the sensory stimulation that maintained hair pulling by providing continuous access to previously pulled or cut hair and, thereafter, by having Kris wear a rubber glove. The results suggested that hair pulling was maintained by digital-tactile stimulation (automatic positive reinforcement). These findings are discussed, and recommendations for further analyses of automatically reinforced habit behaviors are provided.     

Inferring Learners' Knowledge From Their Actions

Watching another person take actions to complete a goal and making inferences about that person's knowledge is a relatively natural task for people. This ability can be especially important in educational settings, where the inferences can be used for assessment, diagnosing misconceptions, and providing informative feedback. In this paper, we develop a general framework for automatically making such inferences based on observed actions; this framework is particularly relevant for inferring student knowledge in educational games and other interactive virtual environments. Our approach relies on modeling action planning: We formalize the problem as a Markov decision process in which one must choose what actions to take to complete a goal, where choices will be dependent on one's beliefs about how actions affect the environment. We use a variation of inverse reinforcement learning to infer these beliefs. Through two lab experiments, we show that this model can recover people's beliefs in a simple environment, with accuracy comparable to that of human observers. We then demonstrate that the model can be used to provide real‐time feedback and to model data from an existing educational game.     

An evaluation of delay to reinforcement and mand variability during functional communication training

Children with autism spectrum disorder and other developmental disabilities often exhibit invariant responding (i.e., restricted behavioral repertoires), deficits in communication, and challenging behavior. Approaches demonstrated in the basic and applied literature to increase response variability include extinction, lag schedules of reinforcement, and percentile schedules of reinforcement. Results of basic studies have also indicated that delays to reinforcement often produce increases in response variability. The purpose of the current study was to evaluate the effects of a delay to reinforcement on the variability of communication responses during functional communication training with individuals with developmental disabilities and histories of engaging in challenging behavior. Results indicated that delays to reinforcement increased mand variability with all four participants with variable effects on challenging behavior across participants.     

Effects of delay fading and signals on self‐control choices by children

The current study is a systematic replication and extension of work by Schweitzer & Sulzer‐Azaroff (1988). The effects of delay fading alone and in combination with signals on choices between larger, delayed reinforcers and smaller, immediate reinforcers by four children with language deficits were examined. For one of the two children exposed to delay fading alone, larger reinforcers were selected at longer delays relative to the initial self‐control assessment. For all four children, the delay‐fading‐plus‐signal condition resulted in selection of larger reinforcers at considerably longer delays relative to the self‐control assessment.     

A Short Measure of the Revised Reinforcement Sensitivity Theory – RSQ17

The need for a research and practical tool, such as a short, reliable, and valid personality assessment test, suggests researchers to create shortened versions of original instruments. Reinforcement sensitivity questionnaire (RSQ) was created in line with some basic premises of revised Reinforcement sensitivity theory, which proposes three motivational and emotional systems: Behavioral inhibition system (BIS), responsible for scanning environment for potential threats, Behavioral activation system (BAS), responsible for aproaching behavior, and the Fight/Flight/Freeze system (FFFS), responsible for behavior in the present threat. RSQ comprises five scales: BIS, BAS, Fight, Flight, and Freeze. The aim of this study was to develop a short version of RSQ, which would be beneficial to both research and practical purposes. Item response theory analyses were used for item selection. The study comprised two samples of participants, whereby Sample 1 (N = 837, 34.6% male, aged 18 – 82, M = 31.63, SD = 13.54) served as the derivation sample, while Sample 2 (818 participants, 43.6% male, 18?75 years, M = 29.65, SD = 12.52) served as validation sample. Factorial validity of the short RSQ was examined on both Sample 1 and Sample 2. Convergent and divergent validity of the short RSQ was examined using RST-PQ, Jackson-5, BIS/BAS scales, and Big Five Inventory. The results point to satisfactory internal consistency, factorial validity, and construct validity of the short RSQ, suggesting that it is an adequate measure for research settings or other contexts which require the use of short personality questionnaires.     

Delivering alternative reinforcement in a distinct context reduces its counter‐therapeutic effects on relapse

Delivery of alternative reinforcers in the presence of stimuli previously associated with reinforcement for target behavior increases the susceptibility of target behavior to relapse. To explore contingencies that might mitigate this counter‐therapeutic effect, we trained pigeons on a procedure that entailed extinction of previously reinforced target‐key pecking, access to a distinct stimulus context contingently on refraining from target behavior (differential‐reinforcement‐of‐other‐behavior; DRO), and reinforcement of alternative‐key pecks (differential‐reinforcement of alternative behavior; DRA) in that context. This DRO‐DRA treatment was compared with standard DRA in successive conditions, counterbalanced across pigeons. Target behavior extinguished more rapidly in the Standard‐DRA condition. When alternative reinforcement was discontinued, however, there was less resurgence after DRO‐DRA than after Standard DRA. In a third condition, the DRO contingency was suspended so that the former DRA stimuli were not presented (DRO‐NAC), and resurgence was greater than in the Standard‐DRA and DRO‐DRA conditions. Reinstatement produced by response‐independent reinforcers was small and similar across conditions. Subsequent reacquisition of target‐key pecking under baseline reinforcement conditions was faster following DRO‐NAC than Standard‐DRA or DRO‐DRA. These findings suggest that DRO‐DRA might serve as a useful method in clinical settings for reducing problem behavior while minimizing the threat of posttreatment relapse.