Impulse control in pigeons

Pigeons were given a small, immediate food reinforcement for pecking a key, and a larger, delayed reinforcement for not pecking this key. Most subjects pecked the key on more than 95% of trials. However, when pecking a differently colored key at an earlier time prevented this option from becoming available, three of 10 subjects consistently pecked it, thereby forcing themselves to wait for the larger reward. They did not peck the earlier key when it did not prevent this option. This is an experimental example of psychological impulse and a learnable device to control it. Although only a minority of the subjects learned it, the fact that such learning is possible at all argues for a theory of delayed reward that can predict change of preference as a function of elapsing time.     

Removal of an obstacle: Problem-solving behavior in pigeons

The importance of a subject's personal history in the solution of an obstruction problem was demonstrated with pigeons. Four birds were trained to peck a key located outside the chamber by poking their heads through an opening in a screen. During tests, a white block was placed in front of the opening, so that it was not possible to peck the key without removing the block. All birds failed to remove the block. However, all birds that were subsequently trained to push the white block around the chamber in the absence of the key and a few of the birds trained similarly but with a black block solved the problem by pushing the block aside and pecking the key. One bird showed the abrupt descent in the learning curve that has been considered a characteristic of “insightful” problem solving. All birds maintained their successful performance after a 1-month interval with no intervening tests.     

Probabilistically reinforced choice behavior in pigeons

A single principle, "momentary maximizing", may account for much of a pigeon's steady-state behavior in both probability learning and concurrent variable interval experiments. The principle states that a pigeon tends to choose the alternative that momentarily has the higher probability of reinforcement. A successive discrimination procedure, which produced matching in an earlier experiment, produced here a tendency to maximize if training were adequately extended. Maximizing was produced also by other procedures, in which no reinforcing event was presented on some trials: one procedure did and two did not provide a bird with information about the availability of reinforcement on a key after an unreinforced response on the other key. The latter two procedures were analogous to concurrent variable interval schedules in two respects: the reinforcement probability on one key increased while a bird responded on the other key; and they produced matching. But sequential statistics suggested that matching resulted from momentary maximizing. Depending on the procedure, the tendency to maximize produced different relative frequencies of pecking a key for a fixed relative frequency of reinforcement. Computer simulation of maximizing behavior in several concurrent variable interval schedules produced matching and sequential statistics similar to those produced by a real bird.     

Suboptimal choice behavior by pigeons

Contrary to the law of effect and optimal foraging theory, pigeons show suboptimal choice behavior by choosing an alternative that provides 20% reinforcement over another that provides 50% reinforcement. They choose the 20% reinforcement alternative—in which 20% of the time, that choice results in a stimulus that always predicts reinforcement, and 80% of the time, it results in another stimulus that predicts its absence—rather than the 50% reinforcement alternative, which results in one of two stimuli, each of which predicts reinforcement 50% of the time. This choice behavior may be related to suboptimal human monetary gambling behavior, because in both cases, the organism overemphasizes the infrequent occurrence of the winning event and underemphasizes the more frequent occurrence of the losing event.     

Motivated comprehension regulation: Vigilant versus eager metacognitive control

The more accurately people assess their comprehension, the more likely they are to engage in study behaviors that precisely target gaps in their learning. However, comprehension regulation involves more than knowing when to implement a new study strategy; it also involves deciding which strategy will most effectively resolve one’s confusion. In two experiments, we explored how people’s motivational orientations influence which study strategies they select to regulate their comprehension. In Experiment 1, people who were motivated to vigilantly protect against potential mistakes (i.e., prevention-focused individuals) were more likely to adopt a rereading strategy than people who were motivated to eagerly pursue new learning opportunities (i.e., promotion-focused individuals). In Experiment 2, this difference in strategy use emerged specifically in response to confusing sentences that had been inserted into the text. Furthermore, by using rereading strategies to resolve their confusion, prevention-focused individuals performed better than promotion-focused individuals on a comprehension test and a transfer task.     

Age related differences in metacognitive control: role of executive functioning

To examine whether aging affects metacognitive control, elderly and young adults carried out a readiness-recall task, in which subjects monitor their own learning procedure, allowing strategy manipulation (study time and rehearsal) to be measured. Age differences were observed in metamemory control performance. Younger adults were found to be better at adjusting study time and rehearsal to the task. Moreover, to determine whether age-related differences in strategy manipulation may mediate age-related differences in memory performance, performance on the readiness-recall task was compared to performance on an experimenter-paced task. Results indicated that younger adults recalled significantly more words in the readiness-recall task than in the experimenter test. This was not the case for older adults. Furthermore, a hierarchical regression analysis revealed that age-related differences in strategy manipulation mediate some age-related differences in memory performance. Our aim was also to determine whether metacognitive control is related to executive functions. Thus, all participants were administered standard neuropsychological tests used to assess executive functioning. Significant partial correlation appeared between metamemory control and executive functioning. Finally, a hierarchical regression analysis indicated that age-related decline in metamemory control may be largely the result of executive limitations associated with aging.     

Generalization of free-operant avoidance behavior in pigeons

Three groups of four pigeons, trained to press a treadle on a free-operant avoidance schedule, were given auditory discrimination training. Alternating 2-min components of avoidance and no shock were paired with either a tone or white noise. The pigeons were subsequently given two types of generalization tests, with and without avoidable shocks scheduled. Two of the groups, trained interdimensionally, produced excitatory and inhibitory generalization gradients along the tone frequency dimension. A predicted post-discrimination gradient was computed from the algebraic summation of these gradients of excitation and inhibition. The predicted gradient was compared with the actual post-discrimination gradient obtained from the third group of pigeons that had been given intradimensional discrimination training on the tone frequency dimension. The predicted postdiscrimination gradient agreed in shape with the empirical postdiscrimination gradient. The results in general support Spence's (1937) gradient interaction theory.     

Operant control of preening in pigeons

Preening in four pigeons was observed and recorded during operant level determinations, continuous and variable interval reinforcement, and extinction. The rate at which preening responses occur seems to be controlled by reinforcement in the same way as other operant behavior. Preening during VI reinforcement and extinction appeared to be similar to preening in many natural situations. With respect to the part of the body preened, considerable stereotypy of responding was shown by all birds, particularly during VI training; there was, however, a conspicuous absence of consistency in the development of stereotypy both within and between individual birds, perhaps due to the nature of the response.     

Aggressive behavior of pigeons: Suppression by archistriatal lesions

The agonistic responses of pigeons to the introduction of a stick and the experimenter's hand into their home cages is described. The effects of lesions of the archistriatum, a presumed homologue of the mammalian amygdala, of lesions of the overlying neostriatum and of control sham operations on this behavior in selected aggressive pigeons are reported. Only archistriatal lesions lead to a persistent depression of the aggressive and a converse increment of the avoidance components of the pigeon's response to both test stimuli. The results are discussed in relation to other evidence on the role of the avian archistriatum and this structure's correspondence with the amygdala.     

Spacing one's study: evidence for a metacognitive control strategy

This article investigated individual control of spacing strategies during study. Three predictions were outlined: The spacing hypothesis suggests that people choose to space their study to improve long-term learning via the spacing effect. The massing hypothesis suggests that people choose to mass their study because of illusions of confidence during study. The metacognitive hypothesis suggests that people control their spacing schedules as a function of their metacognitive judgments of specific to-be-learned items. To test these hypotheses, the authors asked participants to study and make judgments of learning for cue-target pairs. Then, participants were given three choices; they could study the pair again immediately (massed), study the pair again after the entire list had been presented (spaced), or choose not to restudy (done). Results supported a metacognitively controlled spacing strategy-people spaced items that were judged to be relatively easy but massed items that were judged as relatively difficult.     

Framing effects on metacognitive monitoring and control

Three experiments explored the contribution of framing effects on metamemory judgments. In Experiment 1, participants studied word pairs. After each presentation, they made an immediate judgment of learning (JOL), framed in terms of either remembering or forgetting. In the remember frame, participants made judgments about how likely it was that they would remember each pair on the upcoming test. In the forget frame, participants made judgments about how likely it was that they would forget each pair. Confidence differed as a result of the frame. Forget frame JOLs, equated to the remember frame JOL scale by a 1-judgment conversion, were lower and demonstrated a smaller overconfidence bias than did remember frame JOLs. When judgments were made at a delay, framing effects did not occur. In Experiment 2, people chose to restudy more items when choices were made within a forget frame. In Experiment 3, people studied Spanish—English vocabulary pairs ranging in difficulty. The framing effect was replicated with judgments and choices. Moreover, forget frame participants included more easy and medium items to restudy. These results demonstrated the important consequences of framing effects on assessment and control of study.     

Development of complex, stereotyped behavior in pigeons

A pigeon's peck on one key moved a light down one position in a 5×5 matrix of lights, while a peck on another key moved the light across one position. Reinforcement depended upon the occurrence of four pecks on each key (moving the matrix light from the top left to the bottom right), and a fifth peck on either key ended a trial without food. Though there were 70 different sequences that led to reinforcement, each of 12 pigeons developed a particular, stereotyped sequence which dominated its behavior (Experiment 1). Extinction produced substantial increases in sequence variability (Experiment 2). Removal of the matrix cues disrupted performance, though it partially recovered with extended training (Experiment 3). The pigeons did not master a contingency which required a different sequence on the current trial than on the previous one (Experiment 4), though they were able to learn to emit sequences which began with either left-left or left-right response patterns (Experiment 5). The experiments suggest that contingencies of reinforcement may contribute to the creation of complex units of behavior, and that stereotypy may be a likely consequence of contingent reinforcement.     

Stimulus control of delayed matching in pigeons: Directed forgetting

Pigeons were trained in delayed matching-to-sample with two postsample stimuli. A postsample R-cue signaled that a matching choice phase would follow. A postsample F-cue signaled that a matching choice phase would not follow. Previous research found reduced matching accuracy on F-cued probe trials when comparison stimuli were presented in the choice phase. The present four experiments systematically varied the events following an F-cue to determine the conditions under which the F-cue reduces delayed-matching accuracy. When F-cues and R-cues controlled different behavior, matching on probe trials was poor. When both cues controlled the same behavior, matching on probe trials was good. This result is best explained by the theory that comparison stimuli retrieve the sample representation, but only in the behavioral context established by the R-cue. The present research supports the view that response-produced stimuli serve a contextual role in animal short-term memory.     

Updating metacognitive control in response to expected retention intervals

In five experiments, we investigated whether expected retention intervals affect subjects’ encoding strategies. In the first four experiments, our subjects studied paired associates consisting of words from the Graduate Record Exam and a synonym. They were told to expect a test on a word pair after either a short or a longer interval. Subjects were tested on most pairs after the expected retention interval. For some pairs, however, subjects were tested after the other retention interval, allowing for a comparison of performance at a given retention interval conditional upon the expected retention interval. No effect of the expected retention interval was found for 1 min versus 4 min (Exp. 1), 30 s versus 3 min (Exp. 2), and 30 s versus 10 min (Exps. 3 and 4), even when subjects were given complete control over the pacing of study items (Exp. 4). However, when the difference between the expected retention intervals was increased massively (10 min vs. 24 h; Exp. 5), subjects remembered more items that they expected to be tested sooner, an effect consistent with the idea that they traded off efforts to remember items for the later test versus items that were about to be tested. Overall, this set of results accords with much of the test-expectancy literature, revealing that subjects are often reluctant to adjust encoding strategies on an item-by-item basis, and when they do, they usually make quantitative, rather than qualitative, adjustments.     

Temporal control of internal states in pigeons

To understand how animals serially organize complex competing behaviors, we tested pigeons in a sequential task-switching procedure. Daily sessions involved two conditional discrimination tasks that were presented in sequence. In Experiment 1, the first half of a session employed a matching-to-sample task, and the second half tested an oddity-from-sample task. Because the same colors were used for both tasks, these tasks could be solved only by employing a modulating sequential cue. The results of the first experiment revealed that the pigeons could learn this task-switching procedure and that an internal clock was the critical modulator between the tasks. In Experiment 2, we tested a three-alternative choice task. By examining the pattern of errors among choices, the results of this experiment revealed that pigeons learned and used different representations of the choice rules for each half of the experiment. This modulation of the pigeons’ internal states by time has implications for how animals organize their behavior in different settings and holds clues as to the evolution of the serial organization of behavior.     

Information-seeking dialogues: Some of their logical properties

The dialogical games introduced in Jaakko Hintikka, Information-Seeking Dialogues: A Model, (Erkenntnis, vol. 14, 1979) are studied here to answer the question as to what the natural logic or the logic of natural language is. In a natural language certain epistemic elements are not explicitly indicated, but they determine which inference rules are valid. By means of dialogical games, the question is answered: all classical first-order rules have to be modified in the same way in which some of them are modified in the transition to intuitionistic logic. (Furthermore, in some cases quantificational rules have to be modified further.) The rules that are left unmodified by intuitionists are applicable only to the output of certain game rules, but not to others. In. this sense, neither classical nor yet intuitionistic logic is the logic of natural language. We need a new type of nonclassical logic, justified by our information-seeking dialogues.     

Noncriterial recollection influences metacognitive monitoring and control processes

When retrieving information from memory, temporarily irrelevant material may influence future retrieval endeavours. According to an accessibility account, the amount and intensity of this information can be used to predict the availability of related material. A dual-source paradigm was used to investigate whether information that was not relevant (i.e., noncriterial recollection) to the current memory search would influence metacognitive judgements about a relevant, criterial dimension. In two experiments, participants gave higher feelings-of-knowing judgements for a weakly encoded source dimension when they could subsequently recall the other source dimension later. Furthermore, the influence of the noncriterial information appeared to be driven more so by the subjective state of remembering rather than knowing. Thus, strong memorial information that is temporarily irrelevant influences behaviour.     

The development of emergent differential sample behavior in pigeons

Three experiments attempted to replicate Manabe, Kawashima, and Staddon's (1995) finding of emergent differential sample behavior in budgerigars that has been interpreted as evidence of functional equivalence class formation. In Experiments 1 and 2, pigeons initially learned two-sample/ two-alternative matching to sample in which comparison presentation was contingent on pecking one sample on a differential-reinforcement-of-low-rate (DRL) schedule and the other on a fixed-ratio (FR) schedule. Later, two new samples were added to the task. Comparison presentation on these trials occurred after the first sample peck following a predetermined interval (Experiment 1) or after completion of either the DRL or FR requirement, whichever occurred first (Experiment 2). Experiment 1 found no evidence for emergent spaced versus rapid responding to the new samples as they established conditional control over the familiar choices. By contrast, differential responding did emerge for some pigeons in Experiment 2, with responding to each new sample coinciding with the pattern explicitly conditioned to the original sample occasioning the same comparison choice. This emergent effect, however, disappeared for most pigeons with continued training. Experiment 3 systematically replicated Experiment 2 using differential peck location as the sample behavior. Differential location pecking emerged to the new samples for most pigeons and remained intact throughout training. Our findings demonstrate a viable pigeon analogue to the budgerigar emergent calling paradigm and are discussed in terms of equivalence- and non-equivalence-based processes.     

Active avoidance behavior following archistriatal lesions in pigeons.

Experiment 1 examined the performance of 10 pigeons, 5 with bilateral medial archistriatal lesions and 5 sham-operated controls, in the acquisition and maintnenance of a discrete-press avoidance response. The archistriatal subjects had longer response latencies and never attained the level of performance achieved by the controls. In Experiment 2 eight pigeons learned a treadle-press response to avoid or escape shock on a signaled free-operant schedule. After 17 daily sessions four subjects received bilateral lesions in the medial archistriatum, and four received control lesions in the neostriatum. After recovery from surgery, all subjects were returned to the experimental procedure. Avoidance of those subjects with archistriatal lesions was impaired relative to the postoperative level while that of the control group was unchanged. These results are interpreted in the light of earlier experiments showing reduced escape and avoidance behavior both in order avian species and in mammals with lesions in the amygdala, to which the archistriatum is considered homologous.