The paradox of preference for unreliable reinforcement: The role of context and conditioned reinforcement

We discuss Belke and Spetch's (1994) work on choice between reliable and unreliable reinforcement. The studies by Belke and Spetch extend a line of basic research demonstrating that under certain experimental conditions in a concurrent chains procedure, pigeons prefer an alternative that produces unreliable reinforcement. The authors describe the variables that influence preference for unreliable reinforcement, including the signaling and the duration of the reinforcement schedules, the context in which the signaling stimuli occur, and the effects of conditioned reinforcement. Hypothetical applied examples that address these variables are provided, and their influence on preference for unreliable reinforcement in humans is discussed. We conclude by suggesting a line of applied research to examine the relationship between these variables and a preference for unreliable reinforcement.     

Effects of a variable-ratio conditioning history on sensitivity to fixed-interval contingencies in rats.

We investigated the possibility that human-like fixed-interval performances would appear in rats given a variable-ratio history (Wanchisen, Tatham, & Mooney, 1989). Nine rats were trained under single or compound variable-ratio schedules and then under a fixed-interval 30-s schedule. The histories produced high fixed-interval rates that declined slowly over 90 sessions; differences as a function of the particular history were absent. Nine control animals given only fixed-interval training responded at lower levels initially, but rates increased with training. Despite differences in absolute rates, rates within the intervals and postreinforcement pauses indicated equivalent development of the accelerated response patterns suggestive of sensitivity to fixed-interval contingencies. The finding that the histories elevated rates without retarding development of differentiated patterns suggests that the effective response unit was a burst of several lever presses and that the fixed-interval contingencies acted on these units in the same way as for single responses. Regardless of history, the rats did not manifest the persistent, undifferentiated responding reported for humans under comparable schedules. We concluded that the shortcomings of animal models of human fixed-interval performances cannot be easily remedied by including a variable-ratio conditioning history within the model.     

Resistance to reinforcement change in multiple and concurrent schedules assessed in transition and at steady state

Behavioral momentum theory relates resistance to change of responding in a multiple-schedule component to the total reinforcement obtained in that component, regardless of how the reinforcers are produced. Four pigeons responded in a series of multiple-schedule conditions in which a variable-interval 40-s schedule arranged reinforcers for pecking in one component and a variable-interval 360-s schedule arranged them in the other. In addition, responses on a second key were reinforced according to variable-interval schedules that were equal in the two components. In different parts of the experiment, responding was disrupted by changing the rate of reinforcement on the second key or by delivering response-independent food during a blackout separating the two components. Consistent with momentum theory, responding on the first key in Part 1 changed more in the component with the lower reinforcement total when it was disrupted by changes in the rate of reinforcement on the second key. However, responding on the second key changed more in the component with the higher reinforcement total. In Parts 2 and 3, responding was disrupted with free food presented during intercomponent blackouts, with extinction (Part 2) or variable-interval 80-s reinforcement (Part 3) arranged on the second key. Here, resistance to change was greater for the component with greater overall reinforcement. Failures of momentum theory to predict short-term differences in resistance to change occurred with disruptors that caused greater change between steady states for the richer component. Consistency of effects across disruptors may yet be found if short-term effects of disruptors are assessed relative to the extent of change observed after prolonged exposure.     

Biasing the pacemaker in the behavioral theory of timing

In the behavioral theory of timing, pacemaker rate is determined by overall rate of reinforcement. A two-alternative free-operant psychophysical procedure was employed to investigate whether pacemaker period was also sensitive to the differential rate of reinforcement. Responding on a left key during the first 25 s and on a right key during the second 25 s of a 50-s trial was reinforced at variable intervals, and variable-interval schedule values during the two halves of the trials were varied systematically. Responding on the right key during the first 25 s and on the left key during the second 25 s was not reinforced. Estimates of pacemaker period were derived from fits of a function predicted by the behavioral theory of timing to right-key response proportions in consecutive 5-s bins of the 50-s trial. Estimates of pacemaker period were shortest when the differential reinforcer rate most strongly favored right-key responses, and were longest when the differential reinforcer rate most strongly favored left-key responses. The results were consistent with the conclusion that pacemaker rate is influenced by relative reinforcer rate.     

An extension of the concept of specific objectivity

Comparisons of subjects are specifically objective if they do not depend on the items involved. Such comparisons are not restricted to the 1-parameter logistic latent trait model, but may also be defined within ordinal independence models and even within the 2-parameter logistic model.     

Content variations and performance on formal operational tasks by gender,social class and ability1

The role of task content, gender, social class and cognitive ability in performance on two formal operational tasks is explored in this paper. The participants were 110 Icelandic 12-year-olds, early and late developers, males and females from all socio-economic groups. Two tasks of variable isolation (the pendulum and three content versions of the “plant” problem) and two measures of volume conservation (three traditional tasks and three tasks formally identical whose content was pictorial social play) were presented individually in a school setting. The results suggest that content variations have differential consequences for the performance of early and late developers at age 12. Both the nature of logical competence and task content affect solutions, as suggested by Overton and collaborators in 1987. Some social class and gender differences were observed on two Piagetian tasks (pendulum and volume), which was reduced by changing the task content in the case of social class but not in that of gender. As the gender difference in volume conservation was not reflected ins chool achievement nor on other cognitive tasks it was interpreted as a gender bias. The findings are discussed in view of recent literature on the development of cognitive theory with increased emphasis on context and meaning in a post-structural intellectual climate.     

Socialization for the democratic personality in modern society

A comprehensive analysis of socialization requires a complex model that both explicates and synthesizes the various subprocesses involved in this phenomenon. Traditional concerns with socialization that have focused almost exclusively on its objective functions, that is, on those which serve society and its institutions, need to be complemented by an equal emphasis on subjective functions in terms of the sociological and psychological development of the individual. Chiefly relevant in this latter respect is the production of basic human needs and the consequences that result from their inadequate gratification in unauthentic and/or unresponsive societies. One such outcome that is particularly crucial to both personal and societal function is that of alienation, which can be assessed specifically in terms of its significance for civic participation. Our model recognizes the limits of both human systems and social systems; and, in terms of the principles of authenticity and responsivity, it articulates the linkage among these systems constituting the essence of socialization. Our model also provides an implicit clarification of the nature and meaning of citizenship in a democracy, which by definition should be a responsive society, and delineates the required sociopsychological images for maximizing the role of political participation.     

Psychological and educational characteristics of instruction for people with severe disabilities: Interacting systems of responding

This paper presents a behavioral model which proposes that operants are organized and regulated into systems of responding. Multi-operant theory proposes that operants are organized into response systems that interact to adapt behavior to the complexities of the environment. The operant is the interaction between behavior and the environment which includes the conditions under which responses may occur, the class of behavior that is likely to be effective in producing outcomes, and the antecedent conditions that define the context of behavior. A central feature of this theory is that operants within a repertoire are organized into regulated systems of responding. The mechanisms of regulation are themselves operants that are learned and controlled by processes that are the same as those that govern more overt behavior. Operants stand in relationship to each other in coordinated response systems with some operants directly affecting and organizing the performance of other operants. An important implication of the systemic nature of behavioral repertoires is that bringing some aspect of a behavior class under control of new variables may demonstrate a spread throughout the entire operant system depending on past histories linking the classes.deceased     

教师评分用语词义赋值特征的分析

本研究运用模糊统计试验方法对教师的六组定性的评分用语词 (符号 )进行了经验赋值。参加赋值的是 2 66名小学教师。结果表明 ,六组评分用语词 (符号 )都是模糊概念 ,其中每种评分方式中处于最高等级的词 (符号 )的模糊度最小 ,处于中间等级的词 (符号 )的模糊度居中 ,处于最低等级的词 (符号 )的模糊度最大。词 (符号 )义的模糊度与评价的把握度呈现负相关 ,即词 (符号 )义越具体 ,模糊度越小 ,赋值的把握度就越大 ;反之 ,词义越含混 ,模糊度越大 ,赋值的把握度就越小。教师对各种评分用语词 (符号 )的赋值受百分制的“及格—不及格”的划分的影响 ,受评分方式中等级数目的影响 ,即增加评分等级会减少评分用语词 (符号 )的模糊度 ,增加赋值的把握度 ,还受评分用语词 (符号 )本身数量特征的影响。在各种评分方式中 ,评语词 (符号 )在心理量表上的距离是不等的。本研究的结果对教育评价的实践具有一定的参考价值。     

年龄、作业难度和训练对成人记忆的影响

采用“联想学习”、“图象自由回忆”和“附加联想”三项目,对９０例成人（分为青年、老年和老老年组各３０例）进行记忆测查和训练,目的为探讨年龄,作业难度和训练对记忆的影响。结果表明：青年组记忆成绩明显高于老年和老老年组,后两组无显著差异;无关联想的年龄差异大于有关联想,作业难度扩大了年龄差异;各年龄组训练后记忆得到明显改善,并且训练扩大了年龄和作业易难的差异。由此可见,记忆受年龄、作业难度和训练三因素的相互作用,也再次证实了老年认知功能具有一定的可塑性。