Effects of food deprivation upon cue utilization as measured by novelty-incentive

A series of three experiments was done to test the hypothesis that high levels of food deprivation would adversely affect cue utilization from a complex stimulus goal as tested by its novelty-incentive value when that goal was later opposed to food for hungry subjects in a T-maze. It was found that the hunger drive level under which the male rats had originally experienced the complex stimulus goal determined its later incentive value, whether the original experience was in a latent learning type II situation (Experiment I, 20 subjects), a drive-shift situation (Experiment II, 40 subjects), or a free exploration situation (Experiment III, 30 subjects). In each experiment, having first experienced the complex goal under low levels of deprivation significantly decreased the frequency of choices of that goal in a later test relative to the performance of the more deprived animals. The data was interpreted as indicating that utilization of cues, in the sense of input and possibly retention of information, was hindered by the higher levels of deprivation.     

Potency of food deprivation intensity cues as discriminative stimuli.

Rats were trained to use stimuli arising from 0 and 24 hr without food as discriminative signals for shock. In Experiment 1, one group was shocked under 0-hr food deprivation and not shocked under 24-hr food deprivation. Another group received the reverse contingency. The groups received only 3 training trials under each deprivation level. Learning was revealed in a test phase when greater extinction of freezing was observed under the nonshocked than under the shocked deprivation level for both groups. A similar pattern of results was obtained in Experiment 2 when auditory cues were also relevant throughout training. Furthermore, prior training with food deprivation cues seemed to reduce learning about auditory cues subsequently trained in compound with deprivation stimuli. The results indicate that food deprivation intensity cues can be potent discriminative stimuli. The idea that deprivation cues function as conditioned modulatory stimuli cues is also discussed.     

Masked stimuli modulate endogenous shifts of spatial attention

Unconscious stimuli can influence participants’ motor behavior but also more complex mental processes. Recent research has gradually extended the limits of effects of unconscious stimuli. One field of research where such limits have been proposed is spatial cueing, where exogenous automatic shifts of attention have been distinguished from endogenous controlled processes which govern voluntary shifts of attention. Previous evidence suggests unconscious effects on mechanisms of exogenous shifts of attention. Here, we applied a cue-priming paradigm to a spatial cueing task with arbitrary cues by centrally presenting a masked symmetrical prime before every cue stimulus. We found priming effects on response times in target discrimination tasks with the typical dynamic of cue-priming effects (Experiments 1 and 2) indicating that central symmetrical stimuli which have been associated with endogenous orienting can modulate shifts of spatial attention even when they are masked. Prime–Cue Congruency effects of perceptual dissimilar prime and cue stimuli (Experiment 3) suggest that these effects cannot be entirely reduced to perceptual repetition priming of cue processing. In addition, priming effects did not differ between participants with good and poor prime recognition performance consistent with the view that unconscious stimulus features have access to processes of endogenous shifts of attention.     

Effects of expectancies of different reward magnitudes in transfer from noncontingent pairings to instrumental performance

In two experiments, rats received noncontingent pairings of two stimuli with food reward, one paired with small reward and the other with large reward, and received bar press training with large reward or with small reward. When the noncontingent stimuli (NS) were presented for test during subsequent rewarded bar pressing and during early extinction of bar pressing, responding for each group was faster in the presence of the NS which was paired with the same reward magnitude that group received in bar press training than to the NS which had been paired with a different reward magnitude. As extinction progressed, all groups responded more slowly in the presence of the NS which had been paired with the large reward than in the presence of the NS which had been paired with small reward. These results were interpreted as indicating that responding in the presence of an NS depends on: (i) whether the reward expectancy elicited by the NS has been conditioned to the instrumental response, and (ii) the relationship between the reward expected in the presence of the NS and that received in test.     

Stimulus-driven and goal-driven effects on Pavlovian associative reward learning

It has been shown that pure Pavlovian associative reward learning can elicit value-driven attentional capture. However, in previous studies, task-irrelevant and response-independent reward-signalling stimuli hardly competed for visual selective attention. Here we put Pavlovian reward learning to the test by manipulating the extent to which bottom-up (Experiment 1) and top-down (Experiment 2) processes were involved in this type of learning. In Experiment 1, the stimulus, the colour of which signalled the magnitude of the reward given, was presented simultaneously with another randomly coloured stimulus, so that it did not capture attention in a stimulus-driven manner. In Experiment 2, observers performed an attentionally demanding RSVP-task at the centre of the screen to largely tax goal-driven attentional resources, while a task-irrelevant and response-independent stimulus in the periphery signalled the magnitude of the reward given. Both experiments showed value-driven attentional capture in a non-reward test phase, indicating that the reward-signalling stimuli were imbued with value during the Pavlovian reward conditioning phases. This suggests that pure Pavlovian reward conditioning can occur even when (1) competition prevents attention being automatically allocated to the reward-signalling stimulus in a stimulus-driven manner, and (2) attention is occupied by a demanding task, leaving little goal-driven attentional resources available to strategically select the reward-signalling stimulus. The observed value-driven attentional capture effects appeared to be similar for observers who could and could not explicitly report the stimulus–reward contingencies. Altogether, this study provides insight in the conditions under which mere stimulus–reward contingencies in the environment can be learned to affect future behaviour.     

Emergent conditional discrimination in children: Matching to compound stimuli

This study reports two experiments that first taught preschool children identity-matching to compound sample and compound comparison stimuli. A compound stimulus consisted of a colour and a form superimposed on one another. Test sessions assessed whether children related the form and colour elements of a particular compound stimulus. The test for this was matching to sample in which an arbitrary conditional discrimination was required. A majority of the children selected the correct colour comparison in the presence of each form sample. The children also showed the reverse sample-comparison relations: they matched form comparisons to the corresponding colour samples, respectively. In the context of these arbitrary relations, new colours were paired with the form elements of the samples (Experiment 1), and new form elements were paired with the colour elements of the comparisons (Experiment 2). Subsequent tests assessed whether the new stimulus elements had control over responding when presented as single samples or comparisons. Test results showed that most subjects were able to relate the new stimulus elements to the corresponding colour and form elements, respectively. The study demonstrated that matching to compound stimuli in training and testing conditionsMaygenerate conditional relations between the individual stimulus elements.     

Differential reinforcement of lever-press durations: Effects of deprivation level and reward magnitude

Three experiments investigated the performance of rats on a task involving differential reinforcement of lever-press durations. Experiment 1, which employed a discrete-trials procedure, manipulated deprivation level between subjects and reward magnitude within subjects. The minimum lever-press duration which would result in reward was varied from .4 to 6.4 sec. It was found that low deprivation resulted in longer mean durations and less response variability at the higher criterial values than did high deprivation. The magnitude of reward was not found to affect performance. Experiment 2 manipulated reward magnitude between subjects while holding deprivation level constant, and used the same general procedures as in Experiment 1. Small reward resulted in longer mean lever-press durations and less variability in responding than did large reward at the higher criterial values. The intertrial intervals were omitted in Experiment 3 in which deprivation level was varied between subjects and reinforcement was delivered only for response durations extending between 6.0 and 7.6 sec. Low deprivation resulted in longer mean lever-press durations and less response variability than did high deprivation, but the probability of a rewarded press duration did not differ between groups. The results overall are consistent with the hypothesis that low deprivation and small reward magnitude lead to weaker goal-approach responses and, hence, to less competition with lever holding. The deprivation and reward magnitude manipulations did not appear to influence lever holding performance by affecting the ability of animals to form temporal discriminations.     

Effects of postresponse visual stimuli on visual discrimination learning in the rhesus monkey

To learn more about the mechanism (or mechanisms) involved with postresponse stimulus processing during discrimination learning, a series of studies was conducted with monkeys to determine why the combined relevant and irrelevant stimuli impair learning more than irrelevant stimuli appearing alone. It was found that: (a) the greater size and complexity of the combination of stimuli were not responsible for the greater deficit, while the presence of the relevant stimuli (S^D and S^Δ) within the stimulus combination apparently was; (b) the more similar the postresponse irrelevant stimuli were to the relevant stimuli the greater the deficit that resulted; and (c) monkeys that had earlier learned to discriminate the relevant and irrelevant features of a combination showed no learning impairment when this same stimulus combination was later presented after the response during a new learning problem. These results were interpreted as evidence that: (1) processes associated with learning a discrimination problem do not end with the execution of a choice response; (2) postresponse stimuli produce greater impairment in discrimination learning when they are distorted versions of the relevant stimuli; and (3) the impairment resulting from postresponse irrelevant stimuli occurs primarily when this misinformation is processed and misperceived as being relevant to learning the discrimination problem.     

Transfer of conditioned appetitive stimuli to conditioned aversive excitatory and inhibitory stimuli

The transfer of Pavlovian appetitive stimuli to Pavlovian aversive stimuli was examined in three experiments. In Experiment 1, rats received appetitive (Ap) conditioning designed to establish a flashing-light stimulus as either a CS+, CSo, or CS? for food, or to maintain it as a novel stimulus for US-alone subjects. Then, the stimulus was employed as a signal for weak shock in conditioned-emotional-response (CER) training. Both acquisition and extinction results showed that the ApCS+ facilitated and the ApCS? retarded aversive excitatory conditioning relative to the ApCSo and US-alone controls. Experiment 2 replicated the findings of Experiment 1 with both a moderate and a severe shock in CER training. In Experiment 3, different groups received the same appetitive conditioning as before, but to a flashing-light stimulus which was then employed as a signal for no shock in CER training. The ApCS? facilitated and the ApCS+ retarded aversive inhibitory conditioning relative to ApCSo and US-alone controls. Collectively, these findings establish that, in Pavlovian conditioning, transfer of an appetitive CS to an aversive excitor or inhibitor is facilitated by maintaining the initial conditioning contingency.     

Interactions between conditioned stimuli for food and water in the rat

In two experiments rats were initially trained with one conditioned stimulus (CS) signalling food and another CS signalling water. The main purpose of the experiments was to examine the effects of presenting these stimuli in compound. Experiment 1 demonstrated that the level of conditioned responding to this compound was equal to that of a group for which the compound was composed of elements that had separately signalled the same reinforcer. Moreover, the level of this responding was greater than for a group that had received only compound conditioning. In the second experiment it was found that after the initial training, repeatedly pairing the compound with a single reinforcer resulted in an equivalent loss of conditioned responding to both elements. These findings suggest that the interaction between conditioned stimuli for food and water is facilitatory rather than inhibitory.     

Summation of response rates to discriminative stimuli associated with qualitatively different reinforcers

In Experiment I, a four-ply multiple schedule was used to study the effects on rate of responding in rats of food, water, and food and/or water reinforcement under different deprivation conditions. Food and water were associated separately with different stimuli, the combination of which was associated with food and water together, or with food or water randomly. Rates in the presence of the combined stimuli were consistently intermediate to the rates generated by the separate stimuli, a result seemingly incompatible with a "summation" hypothesis. Experiment II was a simplified systematic replication of Experiment I, verifying the major findings.     

Blocking the development of stimulus control when stimuli indicate periods of nonreinforcement

To learn whether prior discrimination training based on one stimulus would block learning about a subsequently added stimulus, rats were first trained to press a bar on a variable-interval schedule of food reinforcement. Occasional stimuli were presented during which no reinforcement was available. Responding became suppressed in the presence of these stimuli. Stimuli could be noise, light, or a compound of noise plus light. A group trained with noise in Phase 1, then trained with the compound in Phase 2, showed less suppression to light in a subsequent test than a group that had the same compound training in Phase 2 but only variable-interval training in Phase 1. This showed that prior training with noise blocked the development of control by light during compound training. Two further groups showed that noise training following compound training did not have the same effect on control by light.     

Assessing potential reinforcement-like effects of brief stimuli unrelated to food reinforcers

It is widely assumed that reinforcers are biologically relevant stimuli, or stimuli that have been associated with biologically relevant stimuli. However, brief, arbitrary stimuli have also been reported to have reinforcement-like effects, despite being unrelated to biologically relevant stimuli like food. The present study explored the potential reinforcement-like effects of brief stimuli across 5 experiments. In Experiments 1 through 4, pigeon subjects responded for food reinforcement and brief stimulus presentations in a 2-component multiple schedule. Neither baseline response rates nor resistance to change during disruption tests were systematically greater in a component with versus without brief stimulus presentations. Increasing the rate and duration of brief stimulus presentations in Experiment 4 did not reveal reinforcement-like effects when compared directly with food. In Experiment 5, pigeons chose between independent terminal links in a concurrent-chains procedure. Across conditions, varying the location, duration, and rate of brief stimulus presentations in the terminal links had no systematic effects on preference. In contrast, varying rates of food reinforcers resulted in large and reliable shifts in preference. Therefore, the present study found no systematic evidence that brief stimuli unrelated to food reliably increase response rates, resistance to change, or preference. These data demonstrate the value of systematic replication, and a behavioral momentum approach to assessing potential reinforcement-like effects.     

The processing of affectively valenced stimuli: The role of surprise

Two experiments tested the hypothesis that the surprise mechanism activates a threat detection system that prioritises the processing of threat-related stimuli. In Experiment 1, participants responded to a dot that appeared during the presentation of two words. In the critical trial, one of the two words was either pleasant or unpleasant. In Experiment 2, depending on the condition, the participants had to decide whether at least one of two simultaneously presented pictures depicted either a pleasant or an unpleasant stimulus. In the critical trial, both a pleasant and an unpleasant picture appeared. In both experiments, the stimuli in the critical trial were presented either during routine behaviour or in the context of a surprising event. The results showed that during routine behaviour unpleasant stimuli received more attentive resources than pleasant stimuli only if the affective valence of the stimuli was action-relevant (Experiment 2). In contrast, in the context of surprise, unpleasant words engaged more attentive resources than pleasant words although they were action-irrelevant (Experiment 1). In addition, in the context of surprise, the decision time increase was more pronounced in the pleasant than in the unpleasant experimental group. This finding was interpreted as evidence that the threat detection system of the surprise mechanism initially searches for a threat-related stimulus.     

Eliminating selective stimulus control: a comparison of two procedures for teaching mentally retarded children to respond to compound stimuli

Selective stimulus control occurs when behavior fails to come under control of all characteristics of a compound stimulus after discrimination training. Two different assessment procedures, one used in prior research and the other incorporating incorrect stimuli (S - 's) which differed minimally from the correct stimulus (S+), were used to detect stimulus control deficits characteristic of selective stimulus control. The efficacy of two training procedures in eliminating selective stimulus control observed with three trainable mentally retarded children was evaluated in Experiment 1. A training procedure using S - 's that were minimally different from the S+ was designed to reduce the probability that stimulus discriminations could be based on stimulus characteristics other than experimenter-specified characteristics defining the S+. This procedure proved more effective in preventing and eliminating selective stimulus control as measured by both assessment procedures than an alternate discrimination training procedure that failed to impact the more stringent measures of selective stimulus control. Experiment 2 indicated that these improvements in stimulus control were not a function of varying degrees of difficulty between stimulus sets or of a prior history of discrimination training with the less effective training procedure. The need for better assessment procedures to detect selective stimulus control and suggestions for further improvements in discrimination training procedures are discussed.     

奖赏历史对自上而下注意控制的调节：促进还是干扰？

奖赏能够影响注意控制,但是关于奖赏历史对注意控制的影响还处于争论之中。本研究以大学生为被试,采用点探测范式,操作了奖赏历史和奖赏额度,考察了奖赏历史对自上而下注意控制的调节作用。实验一结果发现,有奖赏-无奖赏条件下前后阶段反应时无显著差异,无奖赏-有奖赏条件下有奖赏阶段的反应时显著短于无奖赏阶段。实验二操作了奖赏额度,结果与实验一一致。整个研究表明,奖赏历史促进自上而下注意控制,先前奖赏对随后自上而下注意控制产生持续促进效应。     

Compounding of pre-aversive stimuli

When two discriminative stimuli, each capable of maintaining a response, are combined, their compound will maintain a frequency of response greater than the frequencies maintained by the individual stimuli. This has been called additive summation. The present experiments extended the investigation of this phenomenon to a converse situation in which two pre-aversive stimuli were combined. Each pre-aversive stimulus was capable of reducing the frequency of an ongoing response. The combination of these stimuli reduced the relative frequency of response below that resulting from either stimulus. Furthermore, the compounding of two highly suppressive stimuli produced more suppression than the compounding of two less-suppressive stimuli. Evidence was also presented to suggest that the compound continued to reduce responding even when the single stimuli were no longer effective. A fourth experiment demonstrated that summation of response tendencies could not be accounted for in terms of stimulus intensity or sensory interaction.     

Rule learning in children: Multiple-set training and intermediate-size transposition

Two experiments were conducted in which the subjects were trained to choose the middle-size stimulus in either a single stimulus set or in each of two nonoverlapping stimulus sets. Following criterion, each subject was presented with a series of 12 test trials involving a new stimulus set. In Experiment 1, kindergarten children tended to choose the middle-size test stimulus if the test set consisted of stimuli intermediate in size to the stimuli in the smaller and larger training sets. When the test stimuli were all larger than any of the training stimuli, the probability of choosing the middle-size stimulus increased as the distance between the two training sets increased. Three groups of children participated in Experiment 2: a kindergarten group, a first-grade group, and a first-grade group that experienced middle-size training a year earlier. The distance between training sets and two training procedures affected the three groups in a similar manner during acquisition, but several interactions were obtained during the test. The findings were discussed in terms of the Lane and Rabinowitz (D. M. Lane & F. M. Rabinowitz, Child Development, 1977, 48, 412–426) rule based theory of intermediate-size transposition and suggestions were made as to how children acquire the concept of middle.     

Differential dependence of Pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling

Here we attempted to clarify the role of dopamine signaling in reward seeking. In Experiment 1, we assessed the effects of the dopamine D(1)/D(2) receptor antagonist flupenthixol (0.5 mg/kg i.p.) on Pavlovian incentive motivation and found that flupenthixol blocked the ability of a conditioned stimulus to enhance both goal approach and instrumental performance (Pavlovian-to-instrumental transfer). In Experiment 2 we assessed the effects of flupenthixol on reward palatability during post-training noncontingent re-exposure to the sucrose reward in either a control 3-h or novel 23-h food-deprived state. Flupenthixol, although effective in blocking the Pavlovian goal approach, was without effect on palatability or the increase in reward palatability induced by the upshift in motivational state. This noncontingent re-exposure provided an opportunity for instrumental incentive learning, the process by which rats encode the value of a reward for use in updating reward-seeking actions. Flupenthixol administered prior to the instrumental incentive learning opportunity did not affect the increase in subsequent off-drug reward-seeking actions induced by that experience. These data suggest that although dopamine signaling is necessary for Pavlovian incentive motivation, it is not necessary for changes in reward experience, or for the instrumental incentive learning process that translates this experience into the incentive value used to drive reward-seeking actions, and provide further evidence that Pavlovian and instrumental incentive learning processes are dissociable.     

Verbal recoding of visual stimuli impairs mentalimagetransformations

Two experiments were carried out to test the hypothesis that verbal recoding of visual stimuli in short-term memory influences long-term memory encoding and impairs subsequent mental image operations. Easy and difficult-to-name stimuli were used. When rotated 90 degrees counterclockwise, each stimulus revealed a new pattern consisting of two capital letters joined together. In both experiments, subjects first learned a short series of stimuli and were then asked to rotate mental images of the stimuli in order to detect the hidden letters. In Experiment 1, articulatory suppression was used to prevent subjects from subvocal rehearsal when learning the stimuli, whereas in Experiment 2, verbal labels were presented with each stimulus during learning to encourage a reliance on the verbal code. As predicted, performance in the imagery task was significantly improved by suppression when the stimuli were easy to name (Experiment 1) but was severely disrupted by labeling when the stimuli were difficult to name (Experiment 2). We concluded that verbal recoding of stimuli in short-term memory during learning disrupts the ability to generate veridical mental images from long-term memory.