Duration-reduction of avoidance sessions as negative reinforcement

Five rats were exposed to a shock-postponement procedure in which responses on each of two levers initially had equivalent effects. After an initial training sequence that ensured at least some responding on each lever, an additional consequence was made conjointly operative on the previously less-preferred lever for each animal. Each response on this lever continued to postpone shock, but also reduced the session duration by one minute. The conjoint contingencies were operative until, through session-shortening responses and the passage of time, the session was scheduled to end in two minutes; during the final two minutes the session-shortening contingency was disabled while the shock-postponement contingency continued to be operative on both levers. When responding shifted to a predominance on the session-shortening lever, the conjoint contingency was shifted to the other lever; for four of the five rats this reversal was followed by two additional reversals. Two of the rats' responding showed clear, strong, and unambiguous sensitivity to the session-shortening contingency. The responding of two others was also systematically controlled by that contingency, but the effects were less clearcut. The fifth animal showed an initial shift when session-shortening was introduced, but its subsequent behavior proved insensitive to reversals of procedure. The results clearly indicate a sensitivity of behavior to events on a time scale quite distinct from that of immediate consequences. They also support an interpretation of avoidance sessions, considered in their entirety, as events whose contingent relationship to behavior can affect that behavior—even in the absence of stimuli that delineate those relationships. Finally, these results support an interpretation of aversively based conditioning within a broader context, analogous to the “open versus closed economy” interpretation of appetitively controlled behavior.     

Choice as a function of local versus molar reinforcement contingencies.

Rats were trained on a discrete-trial probability learning task. In Experiment 1, the molar reinforcement probabilities for the two response alternatives were equal, and the local contingencies of reinforcement differentially reinforced a win-stay, lose-shift response pattern. The win-stay portion was learned substantially more easily and appeared from the outset of training, suggesting that its occurrence did not depend upon discrimination of the local contingencies but rather only upon simple strengthening effects of individual reinforcements. Control by both types of local contingencies decreased with increases in the intertrial interval, although some control remained with intertrial intervals as long as 30 s. In Experiment 2, the local contingencies always favored win-shift and lose-shift response patterns but were asymmetrical for the two responses, causing the molar reinforcement rates for the two responses to differ. Some learning of the alternation pattern occurred with short intertrial intervals, although win-stay behavior occurred for some subjects. The local reinforcement contingencies were discriminated poorly with longer intertrial intervals. In the absence of control by the local contingencies, choice proportion was determined by the molar contingencies, as indicated by high exponent values for the generalized matching law with long intertrial intervals, and lower values with short intertrial intervals. The results show that when molar contingencies of reinforcement and local contingencies are in opposition, both may have independent roles. Control by molar contingencies cannot generally be explained by local contingencies.     

Subjective probability and delay.

Human subjects indicated their preference between a hypothetical $1,000 reward available with various probabilities or delays and a certain reward of variable amount available immediately. The function relating the amount of the certain-immediate reward subjectively equivalent to the delayed $1,000 reward had the same general shape (hyperbolic) as the function found by Mazur (1987) to describe pigeons' delay discounting. The function relating the certain-immediate amount of money subjectively equivalent to the probabilistic $1,000 reward was also hyperbolic, provided that the stated probability was transformed to odds against winning. In a second experiment, when human subjects chose between a delayed $1,000 reward and a probabilistic $1,000 reward, delay was proportional to the same odds-against transformation of the probability to which it was subjectively equivalent.     

Violations of stochastic transitivity on concurrent chains: Implications for theories of choice

The concurrent-chains procedure has been used to measure how choice depends on various aspects of reinforcement, such as its delay and its magnitude. Navarick and Fantino (1972, 1974, 1975) have found that choice in this procedure can violate the condition of stochastic transitivity that is required if a unidimensional scale for reinforcements is to be possible. It is shown in this paper that two simple unidimensional models of choice on concurrent chains can produce violations of stochastic transitivity. It is argued that such violations may result from the complex contingencies of the concurrent-chains procedure.     

Essential independence and likelihood-based ability estimation for polytomous items

A definition ofessential independence is proposed for sequences of polytomous items. For items satisfying the reasonable assumption that the expected amount of credit awarded increases with examinee ability, we develop a theory ofessential unidimensionality which closely parallels that of Stout. Essentially unidimensional item sequences can be shown to have a unique (up to change-of-scale) dominant underlying trait, which can be consistently estimated by a monotone transformation of the sum of the item scores. In more general polytomous-response latent trait models (with or without ordered responses), anM-estimator based upon maximum likelihood may be shown to be consistent for under essentially unidimensional violations of local independence and a variety of monotonicity/identifiability conditions. A rigorous proof of this fact is given, and the standard error of the estimator is explored. These results suggest that ability estimation methods that rely on the summation form of the log likelihood under local independence should generally be robust under essential independence, but standard errors may vary greatly from what is usually expected, depending on the degree of departure from local independence. An index of departure from local independence is also proposed.This work was supported in part by Office of Naval Research Grant N00014-87-K-0277 and National Science Foundation Grant NSF-DMS-88-02556. The author is grateful to William F. Stout for many helpful comments, and to an anonymous reviewer for raising the questions addressed in section 2. A preliminary version of section 6 appeared in the author's Ph.D. thesis.     

Pierre de La Ramée et le déclin de la rhétorique

This article provides a basic general introduction to Ramus, and evaluates his role in the history of logic and rhetoric, especially with relation to the study of argumentation. The author agrees with Ong and other historians of logic that Ramus is not to be taken seriously as a logician, and that his undoubted importance in the history of ideas is to be found elsewhere.Ramus advocates a belief in nature, experience and reason, and rejects the reliance on the authority of ancient philosophers, above all Aristotle, though experience does not mean scientific experiment and, paradoxically, includes the example of great philosophers and writers. In the end Ramus is seen as responsible for substituting for ancient classical rhetoric an entirely ornamental rhetoric of figures which was to take over education (with the exception of the Jesuit schools) almost until our own day. This curtailing and diminishing of rhetoric is seen as a degeneration. Ancient five-part rhetoric had been concerned with convincing and persuading: Aristotle distinguished the analytic, scientific reasoning of logic, from dialectic which was based on opinion and probability and had close links with rhetoric; by the time of Cicero and Quintilian, who addressed themselves to jurists and politicians, logic has given way to dialectic. In the Middle Ages and the Renaissance the two become assimilated; the evolution of this is traced here through the thirteenth-century Summulae logicales of Peter of Spain to the fifteenth-century German humanist logician Rudolph Agricola, who influenced Ramus partly through the intermediary of Johann Sturm. Ramus took over their topical theories but restricted them to logic/dialectic, and left rhetoric with little more than tropes and figures. He believed that there was only one method for teaching all the arts, and one dialectic common to them all. The distinction between analytical and dialectical has disappeared, with far-reaching consequences for the study of argumentation. Over the centuries logic has lost its connection with controversy and persuasion. With the development of the post-Cartesian, post-Baconian emphasis on the clarity of scientific discourse, and the mid-nineteenth-century interest in mathematical and formal logic, the process was complete. Argumentation, or the new rhetoric, aims to fill the gap thus created.

     

Confidence depends on level of aggregation

The credible intervals that people set around their point estimates are typically too narrow (cf. Lichtenstein, Fischhoff, & Phillips, 1982). That is, a set of many such intervals does not contain the actual values of the criterion variables as often as it should given the probability assigned to this event for each estimate. The typical interpretation of such data is that people are overconfident about the accuracy of their judgments. This paper presents data from two studies showing the typical levels of overconfidence for individual estimates of unknown quantities. However, data from the same subjects on a different measure of confidence for the same items, their own global assessment for the set of multiple estimates as a whole, showed significantly lower levels of confidence and overconfidence than their average individual assessment for items in the set. It is argued that the event and global assessments of judgment quality are fundamentally different and are affected by unique psychological processes. Finally, we discuss the implications of a difference between confidence in single and multiple estimates for confidence research and theory.     

Sensory superstition on multiple interval schedules.

Pigeons were exposed to multiple schedules in which an irregular repeating sequence of five stimulus components was correlated with the same reinforcement schedule throughout. Stable, idiosyncratic, response-rate differences developed across components. Components were rank-ordered by response rate; an approximately linear relation was found between rank order and the deviation of mean response rate from the overall mean rate. Nonzero slopes of this line were found for multiple fixed-interval and variable-time schedules and for multiple variable-interval schedules both when number of reinforcements was the same in all components and when it varied. The steepest function slopes were found in the variable schedules with relatively long interfood intervals and relatively short component durations. When just one stimulus was correlated with all components of a multiple variable-interval schedule, the slope of the line was close to zero. The results suggest that food-rate differences may be induced initially by different reactions to the stimuli and subsequently maintained by food.     

A note on the investigation of local and global identifiability

In general, nonlinear models such as those commonly employed for the analysis of covariance structures, are not globally identifiable. Any investigation of local identifiability must either yield a mapping of identifiability onto the entire parameter space, which will rarely be feasible in any applications of interest, or confine itself to the neighbourhood of such points of special interest as the maximum likelihood point.The author would like to thank J. Jack McArdle and Colin Fraser for their comments on this paper.     

COLLATERAL GAINS AND SHORT-TERM MAINTENANCE IN READING AND ON-TASK RESPONSES BY INNER-CITY ADOLESCENTS AS A FUNCTION OF THEIR USE OF SOCIAL REINFORCEMENT WHILE TUTORING

Two experiments are reported concerning the effects of the differential use of verbal approval by problematic adolescents serving as tutors in a remedial reading program for an inner-city school. The experiments, each with 3 tutors and 15 tutees, used a combined multiple baseline and ABCBC design. Data showed that tutors' approvals as well as tutors' and tutees' on-task and reading responses were low and stable during baseline. Tutors were trained to use verbal approval for tutees' on-task behavior. Tokens were presented and withdrawn to control the tutors' use of approval. During phases in which tutors' approvals were raised via token dispensation, tutor reading and on-task scores increased in a nonexperimental setting. Tutee reading scores also increased as a function of tutor approvals. The second experiment replicated these findings and, in addition, (a) tested the validity of changes in reading responses via standardized tests, (b) isolated and compared the covariance between variables in all phases, and (c) provided data on tutee attention to tutors as a possible natural reinforcer for the short-term maintenance found in both studies. Data are discussed as evidence that tutors had acquired the ability to recruit reinforcement from the classroom for appropriate behavior.