The paradox of preference for unreliable reinforcement: The role of context and conditioned reinforcement

We discuss Belke and Spetch's (1994) work on choice between reliable and unreliable reinforcement. The studies by Belke and Spetch extend a line of basic research demonstrating that under certain experimental conditions in a concurrent chains procedure, pigeons prefer an alternative that produces unreliable reinforcement. The authors describe the variables that influence preference for unreliable reinforcement, including the signaling and the duration of the reinforcement schedules, the context in which the signaling stimuli occur, and the effects of conditioned reinforcement. Hypothetical applied examples that address these variables are provided, and their influence on preference for unreliable reinforcement in humans is discussed. We conclude by suggesting a line of applied research to examine the relationship between these variables and a preference for unreliable reinforcement.     

REDUCING ESCAPE BEHAVIOR AND INCREASING TASK COMPLETION WITH FUNCTIONAL COMMUNICATION TRAINING,EXTINCTION AND RESPONSE CHAINING

The effects of functional communication training, extinction, and response chaining on 3 subjects' escape-maintained aberrant behavior were evaluated using a multielement design. Functional communication training consisted of teaching subjects a verbal response that was functionally equivalent to their aberrant behavior. Subjects initially were allowed to escape from a task contingent on the trained verbal response. In subsequent treatment phases, escape was contingent on the trained verbal response plus the completion of the specified number of steps in the task (response chaining). The number of steps was increased until a subject completed the task to obtain a break. Results showed that the treatment reduced rates of aberrant behavior and that the chaining procedure was effective in decreasing the availability of escape.     

Effects of a variable-ratio conditioning history on sensitivity to fixed-interval contingencies in rats.

We investigated the possibility that human-like fixed-interval performances would appear in rats given a variable-ratio history (Wanchisen, Tatham, & Mooney, 1989). Nine rats were trained under single or compound variable-ratio schedules and then under a fixed-interval 30-s schedule. The histories produced high fixed-interval rates that declined slowly over 90 sessions; differences as a function of the particular history were absent. Nine control animals given only fixed-interval training responded at lower levels initially, but rates increased with training. Despite differences in absolute rates, rates within the intervals and postreinforcement pauses indicated equivalent development of the accelerated response patterns suggestive of sensitivity to fixed-interval contingencies. The finding that the histories elevated rates without retarding development of differentiated patterns suggests that the effective response unit was a burst of several lever presses and that the fixed-interval contingencies acted on these units in the same way as for single responses. Regardless of history, the rats did not manifest the persistent, undifferentiated responding reported for humans under comparable schedules. We concluded that the shortcomings of animal models of human fixed-interval performances cannot be easily remedied by including a variable-ratio conditioning history within the model.     

A transformation of self-discrimination response functions in accordance with the arbitrarily applicable relations of sameness, more than, and less than

In Experiment 1, 2 experimental subjects were given pretraining of nonarbitrary relations that brought their responses under the control of four contextual stimuli; same, opposite, more than, and less than. One control subject was not exposed to this pretraining. The 2 pretrained subjects and the 3rd nonpretrained subject then received training in six arbitrary relations, the following four relations being the most critical: same/A1-B1, same/A1-C1, less than/A1-B2, more than/A1-C2. All 3 subjects were then tested for seven derived relations, the following three relations being the most important: same/B1-C1, more than/B1-C2, less than/B1-B2. The 2 pretrained subjects, but not the nonpretrained subject, showed the derived relations. One of the stimuli (B1) from the relational network and two novel stimuli (X1 and X2) were then used to train three different self-discrimination responses on three complex schedules of reinforcement. That is, all 3 subjects were trained to pick X1 if they had not emitted a response, to pick B1 if they had emitted one response only, and to pick X2 if they had emitted two responses only. The 2 pretrained subjects, but not the nonpretrained subject, showed the predicted transformation of self-discrimination response functions in accordance with the relations of sameness, more than, and less than (i.e., no response, pick B2; one response only, pick C1; and two responses only, pick C2). In Experiment 2, 2 new subjects were employed, and the arbitrary relational training and testing phases were modified to control for a procedural artifact that may have contributed to the results of the first experiment. Experiment 2 replicated the findings of Experiment 1. The pattern of results support the utility of a relational frames approach to understanding derived stimulus relations.     

Facial EMG reactions to facial expressions: A case of facial emotional contagion?

The purpose of this study is to explore whether subjects exposed to stimuli of facial expressions respond with facial electromyographic (EMG) reactions consistent with the hypothesis that facial expressions are contagious. This study further examines whether males and females differ in facial EMG intensity. Two experiments demonstrated that subjects responded with facial EMG activity over the corrugator supercilii, the zygomatic major , the lateral frontalis , the depressor supercilii , and the levator labii muscle regions to stimuli of sad, angry, fearful, surprised, disgusted and happy faces, that, to large extent, were consistent with the hypothesis that facial expressions are contagious. Aspects of gender differences reported in earlier studies were found, indicating a tendency for females to respond with more pronounced facial EMG intensity.     

Repetition effects on word fragment completion: The role of competition among responses

Four experiments examined the effect of spaced repetition of study words on completion of word fragments with only one solution and word fragments with multiple solutions. Recognition was used as test of explicit memory in the first two experiments. The study words were presented either once or three times. Repetition was found to increase recognition memory substantially, and to affect fragment completion performance only marginally. This was true for both single- and multiple-solution fragments, showing that competition among responses is not critical for the magnitude of the repetition effect in fragment completion. This finding, that the repetition effect is marginal also when the type of cues provides an occasion for repetition effects to show up, suggests that the real effect of repetition on perceptual priming is borderline. It is proposed that memory from the first presentation eliminates necessary processing of items when they are re-exposed, and that the repetition effect thereby is reduced.     

Converging measures of speech segmentation in preverbal infants

Two studies using novel extensions of the conditioned head-turning method examined contributions of rhythmic and distributional properties of syllable strings to 8-month-old infants' speech segmentation. The two techniques introduced exploit fundamental, but complementary, properties of representational units. The first involved assessment of discriminative response maintenance when simple training stimuli were embedded in more complex speech contexts; the second involved measurement of infants' latencies in detecting extraneous signals superimposed on speech stimuli. A complex pattern of results is predicted if infants succeed in grouping syllables into higher-order units. Across the two studies, the predicted pattern of results emerged, indicating that rhythmic properties of speech play an important role in guiding infants toward potential linguistically relevant units and simultaneously demonstrating that the techniques proposed here provide valid, converging measures of infants' auditory representational units.     

An extension of the partial credit model with an application to the measurement of change

The partial credit model is considered under the assumption of a certain linear decomposition of the item × category parameters _ih into basic parameters _j. This model is referred to as the linear partial credit model. A conditional maximum likelihood algorithm for estimation of the j is presented, based on (a) recurrences for the combinatorial functions involved, and (b) using a quasi-Newton approach, the so-called Broyden-Fletcher-Goldfarb-Shanno (BFGS) method; (a) guarantees numerically stable results, (b) avoids the direct computation of the Hesse matrix, yet produces a sequence of certain positive definite matricesB _k ,k=1, 2, ..., converging to the asymptotic variance-covariance matrix of the . The practicality of these numerical methods is demonstrated both by means of simulations and of an empirical application to the measurement of treatment effects in patients with psychosomatic disorders.The authors thank one anonymous reviewer for his constructive comments. Moreover, they thankfully acknowledge financial support by the Österreichische Nationalbank (Austrian National Bank) under Grant No. 3720.     

Spectral and pattern response in the rabbit retina.

The advantages of presenting sensory data in terms of stimulus variables are stressed. Spectral sensitivity plots of local electroretinograms and ganglion cell discharges from the dark-adapted rabbit retina illustrate the utility of using this kind of procedure. Spectral data agreed with the literature demonstrating two cone and one rod process in this animal. The spectral sensitivities of both the local electroretinogram and ganglion cell spikes were closely similar. Data pertaining to pattern vision may also be subjected to the same type of analysis and described in terms of stimulus variables.