Choice in a variable environment: effects of blackout duration and extinction between components

Pigeons were trained in a procedure in which sessions included seven four- or 10-reinforcer components, each providing a different reinforcer ratio that ranged from 27:1 to 1:27. The components were arranged in random order, and no signals differentiated the component reinforcer ratios. Each condition lasted 50 sessions, and the data from the last 35 sessions were analyzed. Previous results using 10-s blackouts between components showed some carryover of preference from one component to the next, and this effect was investigated in Experiment 1 by varying blackout duration from 1 s to 120 s. The amount of carryover decreased monotonically as the blackout duration was lengthened. Preference also decreased between reinforcers within components, suggesting that preference change during blackout might follow the same function as preference change between reinforcers. Experiment 2 was designed to measure preference change between components more directly and to relate this to preference change during blackout. In two conditions a 60-s blackout occurred between components, and in two other conditions a 60-s period of unsignaled extinction occurred between components. Preference during the extinction period progressively fell toward indifference, and the level of preference following extinction was much the same as that following blackout. Although these results are consistent with Davison and Baum's (2000) theory of the effects of reinforcers on local preference, other findings suggest that theory is incomplete: After a sequence of reinforcers from one alternative, some residual preference remained after 60 s of extinction or blackout, indicating the possibility of an additional longer term accumulation of reinforcer effects than originally suggested.     

GROUP FORAGING SENSITIVITY TO PREDICTABLE AND UNPREDICTABLE CHANGES IN FOOD DISTRIBUTION: PAST EXPERIENCE OR PRESENT CIRCUMSTANCES?

The ideal free distribution theory (Fretwell & Lucas, 1970) predicts that the ratio of foragers at two patches will equal the ratio of food resources obtained at the two patches. The theory assumes that foragers have "perfect knowledge" of patch profitability and that patch choice maximizes fitness. How foragers assess patch profitability has been debated extensively. One assessment strategy may be the use of past experience with a patch. Under stable environmental conditions, this strategy enhances fitness. However, in a highly unpredictable environment, past experience may provide inaccurate information about current conditions. Thus, in a nonstable environment, a strategy that allows rapid adjustment to present circumstances may be more beneficial. Evidence for this type of strategy has been found in individual choice. In the present experiments, a flock of pigeons foraged at two patches for food items and demonstrated results similar to those found in individual choice. Experiment 1 utilized predictable and unpredictable sequences of resource ratios presented across days or within a single session. Current foraging decisions depended on past experience, but that dependence diminished when the current foraging environment became more unpredictable. Experiment 2 repeated Experiment I with a different flock of pigeons under more controlled circumstances in an indoor coop and produced similar results.     

Rats use a sense of direction to alternate on T-mazes located in adjacent rooms

Lister hooded rats were trained on a forced-sample T-maze alternation task in an environment lacking spatial landmarks. An early study of spontaneous alternation on the T-maze had shown that rats use a "spatial sense" to select alternate maze arms across mazes. As this phenomenon may provide a useful tool for studying the neural substrates of a directional sense, we wished to confirm this finding on a different version of the T-maze task, with well-trained animals. We found that rats successfully selected the appropriate maze arm when the choice phase of the task was presented on a second maze, oriented in the same direction, and located in an adjacent room. However, choice performance fell to chance level when the second maze was oriented 90° relative to the first. This result suggests that the rats do not simply alternate turns across the two environments, but rather that they rely on a sense of direction that is carried across environments. Electronic Publication     

Further evaluation of low-ranked items in stimulus-choice preference assessments

The generality of the findings reported by DeLeon, Iwata, and Roscoe (1997) was examined by conducting two stimulus-choice preference assessments, the second of which evaluated low-ranked items from the initial assessment. Results for the 2 participants suggested that supplementary assessments of low-ranked items may be useful for identifying a wider variety of reinforcing stimuli.     

Frontal-Lobe Involvement in Spatial Memory: Evidence from PET,fMRI, and Lesion Studies

Many studies have identified the prefrontal cortex as the brain area that is critical for spatial memory, both in humans and in other primates. Other studies, however, have failed to establish this relation. Therefore, the aim of this paper was to review the literature regarding the role of the human prefrontal lobe in spatial memory. This was done by examining the evidence obtained from neuropsychological patients and from studies using brain-imaging techniques (PET and fMRI). Evidence supporting the notion that the prefrontal cortex is extensively involved in spatial working memory was found. The majority of these studies, however, suggests that frontal-lobe involvement is not related to the type of material that is being processed (e.g., spatial vs. nonspatial), but to process-specific functions, such as encoding and retrieval. Theoretically, these functions could be linked to the central executive within Baddeley's working-memory model, or to recent theories that emphasize the various processes that play a role in working memory. Also, methodological issues were discussed. Further research is needed to enhance our understanding of the precise interaction of domain-specific and general processes.     

Attachment to the Missing Object: Infidelity and Obsessive Love

In an object relations study on infidelity and obsessive love, the author observes that in relationships marked by chronic, repetitive infidelity and obsession, the lover is enamored with that which they can not have and that the psychological development of such individuals may have been traumatized by early attachment disturbances in the primary dyad. Tenacious, unsatisfying love-attachments as seen in sexual addictions and obsessional love may result from the internalization of an absent or intermittent object relationship—a morbid attachment to the missing object of infancy. Such patients often demonstrate depressive/addictive traits and schizoid defenses and typically have difficulty forming an attachment bond with the analyst, perceiving the analyst as a dangerous, rejecting agent who will recapitulate the original trauma. In the clinical case of Gretchen, the author uses Winnicott's (1960) concept of holding to create a progressive therapeutic bond, as toxic resistant forces are gradually resolved.     

Selection and inhibition in infancy: evidence from the spatial negative priming paradigm

We used a spatial negative priming (SNP) paradigm to examine visual selective attention in infants and adults using eye movements as the motor selection measure. In SNP, when a previously ignored location becomes the target to be selected, responses to it are impaired, providing a measure of inhibitory selection. Each trial consisted of a prime and a probe, separated by 67, 200, or 550 ms interstimulus intervals (ISIs). In the prime, a target was accompanied by a distractor. In the probe, the target appeared either in the location formerly occupied by the distractor (ignored repetition) or in another location (control). Adults exhibited the SNP effect in all three ISI conditions, producing slower saccade latencies on ignored repetition versus control trials. The SNP effect obtained for infants only under 550 and 200 ms ISI conditions. These results suggest that important developments in visual selection are rooted in emerging inhibitory mechanisms.     

Variation, repetition, and choice

Experiment 1 investigated the controlling properties of variability contingencies on choice between repeated and variable responding. Pigeons were exposed to concurrent-chains schedules with two alternatives. In the REPEAT alternative, reinforcers in the terminal link depended on a single sequence of four responses. In the VARY alternative, a response sequence in the terminal link was reinforced only if it differed from the n previous sequences (lag criterion). The REPEAT contingency generated low, constant levels of sequence variation whereas the VARY contingency produced levels of sequence variation that increased with the lag criterion. Preference for the REPEAT alternative tended to increase directly with the degree of variation required for reinforcement. Experiment 2 examined the potential confounding effects in Experiment 1 of immediacy of reinforcement by yoking the interreinforcer intervals in the REPEAT alternative to those in the VARY alternative. Again, preference for REPEAT was a function of the lag criterion. Choice between varying and repeating behavior is discussed with respect to obtained behavioral variability, probability of reinforcement, delay of reinforcement, and switching within a sequence.     

Prefrontal brain activity predicts temporally extended decision-making behavior

Although functional neuroimaging studies of human decision-making processes are increasingly common, most of the research in this area has relied on passive tasks that generate little individual variability. Relatively little attention has been paid to the ability of brain activity to predict overt behavior. Using functional magnetic resonance imaging (fMRI), we investigated the neural mechanisms underlying behavior during a dynamic decision task that required subjects to select smaller, short-term monetary payoffs in order to receive larger, long-term gains. The number of trials over which the longterm gains accrued was manipulated experimentally (2 versus 12). Event-related neural activity in right lateral prefrontal cortex, a region associated with high-level cognitive processing, selectively predicted choice behavior in both conditions, whereas insular cortex responded to fluctuations in amount of reward but did not predict choice behavior. These results demonstrate the utility of a functional neuroimaging approach in behavioral psychology, showing that (a) highly circumscribed brain regions are capable of predicting complex choice behavior, and (b) fMRI has the ability to dissociate the contributions of different neural mechanisms to particular behavioral tasks.     

Orientational manoeuvres in the dark: dissociating allocentric and egocentric influences on spatial memory

Subjects in a darkroom saw an array of five phosphorescent objects on a circular table and, after a short delay, indicated which object had been moved. During the delay the subject, the table or a phosphorescent landmark external to the array was moved (a rotation about the centre of the table) either alone or together. The subject then had to indicate which one of the five objects had been moved. A fully factorial design was used to detect the use of three types of representations of object location: (i) visual snapshots; (ii) egocentric representations updated by self-motion; and (iii) representations relative to the external cue. Improved performance was seen whenever the test array was oriented consistently with any of these stored representations. The influence of representations (i) and (ii) replicates previous work. The influence of representation (iii) is a novel finding which implies that allocentric representations play a role in spatial memory, even over short distances and times. The effect of the external cue was greater when initially experienced as stable. Females out-performed males except when the array was consistent with self-motion but not visual snapshots. These results enable a simple egocentric model of spatial memory to be extended to address large-scale navigation, including the effects of allocentric knowledge, landmark stability and gender.