Selective Attention in Animal Discrimination Learning

The traditional approach to the study of selective attention in animal discrimination learning has been to ask if animals are capable of the central selective processing of stimuli, such that certain aspects of the discriminative stimuli are partially or wholly ignored while their relationships to each other, or other relevant stimuli, are processed. A notable characteristic of this research has been that procedures involve the acquisition of discriminations, and the issue of concern is whether learning is selectively determined by the stimulus dimension defined by the discriminative stimuli. Although there is support for this kind of selective attention, in many cases, simpler nonattentional accounts are sufficient to explain the results. An alternative approach involves procedures more similar to those used in human information-processing research. When selective attention is studied in humans, it generally involves the steady state performance of tasks for which there is limited time allowed for stimulus input and a relatively large amount of relevant information to be processed; thus, attention must be selective or divided. When this approach is applied to animals and alternative accounts have been ruled out, stronger evidence for selective or divided attention in animals has been found. Similar processes are thought to be involved when animals search more natural environments for targets. Finally, an attempt is made to distinguish these top-down attentional processes from more automatic preattentional processes that have been studied in humans and other animals.     

Sub-Optimal Choice by Pigeons: Failure to Support The Allais Paradox

Pigeons show a preference for an alternative that provides them with discriminative stimuli (sometimes a stimulus that predicts reinforcement and at other times a stimulus that predicts the absence of reinforcement) over an alternative that provides them with nondiscriminative stimuli, even if the nondiscriminative stimulus alternative is associated with 2.5 times as much reinforcement (Stagner & Zentall, 2010). In Experiment 1 we found that the delay to reinforcement associated with the nondiscriminative stimuli could be reduced by almost one half before the pigeons were indifferent between the two alternatives. In Experiment 2 we tested the hypothesis that the preference for the discriminative stimulus alternative resulted from the fact that, like humans, the pigeons were attracted by the stimulus that consistently predicted reinforcement (the Allais paradox). When the probability of reinforcement associated with the discriminative stimulus that predicted reinforcement was reduced from 100% to 80% the pigeons still showed a strong preference for the discriminative stimulus alternative. Thus, under these conditions, the Allais paradox cannot account for the sub-optimal choice behavior shown by pigeons. Instead we propose that sub-optimal choice results from positive contrast between the low expectation of reinforcement associated with the discriminative stimulus alternative and the much higher obtained reinforcement when the stimulus associated with reinforcement appears. We propose that similar processes can account for sub-optimal gambling behavior by humans.     

Assessing control by elements of complex stimuli in delayed matching to sample.

A series of six experiments examined delayed identity matching-to-sample performances of subjects with mental retardation. The stimuli were either one or two simultaneously displayed forms. When the reinforcement contingencies required that only one form exert discriminative control, all subjects achieved high accuracy scores. However, accuracy scores were substantially lower when the contingencies required discriminative control by two forms, suggesting restricted stimulus control. The decline in matching accuracy appeared to reflect selective losses of conditional control by sample stimuli and shifts in control to features of the comparison stimulus displays. The experiments suggest improved techniques for assessing control by complex stimuli and for evaluating the effects of procedures that seek to broaden restricted stimulus control. The results challenge interpretations based on stimulus-generalization decrement or shared attention.     

Induced gamma-band responses in the human EEG are related to attentional information processing

Synchronized neural activity in the frequency range above 20 Hz, the gamma-band, has been proposed as a signature of temporal feature binding. Here we suggest that selective attention facilitates synchronization of neural activity. Selective attention can be guided by bottom-up, stimulus driven, or top-down task-driven processes. Both processes will cause that stimuli are processed preferentially. While bottom-up processes might facilitate synchronization of neurons due to the salience of the stimulus, top-down processes may bias information selection by facilitating synchronization of neurons coding a certain location in space and/or of neurons related to the processing of certain features. Animal as well as human EEG studies support the notion of a link between induced gamma-band responses and attentive, sensory stimulus processing.     

Effects of training condition on the contribution of specific items to relational processing in baboons (Papio papio)

Relational processing involves learning about the relationship between or among stimuli, transcending the individual stimuli, so that abstract knowledge generalizable to novel situations is acquired. Relational processing has been studied in animals as well as in humans, but little attention has been paid to the contribution of specific items to relational thinking or to the factors that may affect that contribution. This study assessed the intertwined effects of item and relational processing in nonhuman primates. Using a procedure that entailed both expanding and contracting sets of pictorial items, we trained 13 baboons on a two-alternative forced-choice task, in which they had to distinguish horizontal from vertical relational patterns. In Experiment 1, monkeys engaged in item-based processing with a small training set size, and they progressively engaged in relation-based processing as training set size was increased. However, in Experiment 2, overtraining with a small stimulus set promoted the processing of item-based information. These findings underscore similarities in how humans and nonhuman primates process higher-order stimulus relations.     

Observing responses in rats: Support for the secondary reinforcement hypothesis

Rats' lever presses on a retractable lever earned brief presentations of discriminative stimuli signalling periods in which responding on an alternative lever was either non-reinforced (extinction) or reinforced on a random ratio schedule. The predictions of two theoretical accounts of this behaviour were tested by studying the effects of omitting either the stimulus signalling the reinforced or that signalling the non-reinforced schedule component. Under these conditions rats' behaviour is determined by the conditioned, affective properties of the stimuli rather than by their purely informational properties.     

Theoretical analysis of the cognitive processing of lexical and pictorial stimuli: reading, naming, and visual and conceptual comparisons

This article reviews the research literature on the differences between word reading and picture naming. A theory for the visual and cognitive processing of pictures and words is then introduced. The theory accounts for slower naming of pictures than reading of words. Reading aloud involves a fast, grapheme-to-phoneme transformation process, whereas picture naming involves two additional processes: (a) determining the meaning of the pictorial stimulus and (b) finding a name for the pictorial stimulus. We conducted a reading-naming experiment, and the time to achieve (a) and (b) was determined to be approximately 160 ms. On the basis of data from a second experiment, we demonstrated that there is no significant difference in time to visually compare two pictures or two words when size of the stimuli is equated. There is no difference in time to make the two types of cross-modality conceptual comparisons (picture first, then word, or word first, then picture). The symmetry of the visual and conceptual comparison results supports the hypothesis that the coding of the mind is neither intrinsically linguistic nor imagistic, but rather it is abstract. There is a potent stimulus size effect, equal for both pictorial and lexical stimuli. Small stimuli take longer to be visually processed than do larger stimuli. For optimal processing, stimuli should not only be equated for size, but should subtend a visual angle of at least 3 degrees. The article ends with the presentation of a mathematical theory that jointly accounts for the data from word-reading, picture-naming visual comparison, and conceptual-comparison experiments.     

Successive matching-to-sample in the pigeon: Variations on a theme by Konorski

In 1959, Konorski proposed a successive matching-to-sample paradigm with which to study short-term memory in animals. Although the technique has been little used, it affords several distinct advantages over more commonly employed matching-to-sample procedures. Konorski’s paradigm involves the successive presentation of a pair of discriminative stimuli with a brief interstimulus interval between them. Reinforcement is scheduled to occur only when the second stimulus of a pair matches the first; otherwise, nonreinforcement follows. An investigation of the pigeon’s food-reinforced keypecking behavior is reported using a variant of Konorski’s technique. Pigeons rapidly learned to differentiate matching and nonmatching stimulus pairs when brief (5-sec) color stimuli were separated by a 1-sec interstimulus interval. No such differentiation arose when control subjects were trained with reinforcement equiprobable on matching and nonmatching trials. No support was found for the notion that correct performance under this successive-matching procedure was due to overt mediating behaviors.     

Separating perceptual processes from decisional processes in identification and categorization

Four observers completed perceptual matching, identification, and categorization tasks using separable-dimension stimuli. A unified quantitative approach relating perceptual matching, identification, and categorization was proposed and tested. The approach derives from general recognition theory (Ashby & Townsend, 1986) and provides a powerful method for quantifying the separate influences of perceptual processes and decisional processes within and across tasks. Good accounts of the identification data were obtained from an initial perceptual representation derived from perceptual matching. The same perceptual representation provided a good account of the categorization data, except when selective attention to one stimulus dimension was required. Selective attention altered the perceptual representation by decreasing the perceptual variance along the attended dimension. These findings suggest that a complete understanding of identification and categorization performance requires an understanding of perceptual and decisional processes. Implications for other psychological tasks are discussed.     

Separating perceptual processes from decisional processes in identification and categorization.

Four observers completed perceptual matching, identification, and categorization tasks using separable-dimension stimuli. A unified quantitative approach relating perceptual matching, identification, and categorization was proposed and tested. The approach derives from general recognition theory (Ashby & Townsend, 1986) and provides a powerful method for quantifying the separate influences of perceptual processes and decisional processes within and across tasks. Good accounts of the identification data were obtained from an initial perceptual representation derived from perceptual matching. The same perceptual representation provided a good account of the categorization data, except when selective attention to one stimulus dimension was required. Selective attention altered the perceptual representation by decreasing the perceptual variance along the attended dimension. These findings suggest that a complete understanding of identification and categorization performance requires an understanding of perceptual and decisional processes. Implications for other psychological tasks are discussed.     

Motivating Operations Affect Stimulus Control: A Largely Overlooked Phenomenon in Discrimination Learning

Several recent studies have explored what Michael (e.g., 1982) termed the value-altering effect and the behavior-altering effect of motivating operations. One aspect of the behavior-altering effect that has garnered no recent attention involves changes in stimulus control produced by motivating operations. To call attention to this aspect of the behavior-altering effect, we herein review 11 studies that are concerned with the influence of varying levels of food or water deprivation on stimulus generalization. These studies suggest that motivating operations influence stimulus control (a) by changing the evocative strength of not just an established discriminative stimulus, but also of stimuli that are physically similar to it; (b) by changing the range of stimuli that evoke the operant in question; and (c) by exerting these effects in a graded fashion. These findings are potentially of conceptual and applied significance, and it appears that further research examining how motivating operations alter stimulus control, including some studies suggested herein, is warranted.     

Matching: its acquisition and generalization

Choice typically is studied by exposing organisms to concurrent variable-interval schedules in which not only responses controlled by stimuli on the key are acquired but also switching responses and likely other operants as well. In the present research, discriminated key-pecking responses in pigeons were first acquired using a multiple schedule that minimized the reinforcement of switching operants. Then, choice was assessed during concurrent-probe periods in which pairs of discriminative stimuli were presented concurrently. Upon initial exposure to concurrently presented stimuli, choice approximated exclusive preference for the alternative associated with the higher reinforcement frequency. Concurrent schedules were then implemented that gave increasingly greater opportunities for switching operants to be conditioned. As these operants were acquired, the relation of relative response frequency to relative reinforcement frequency converged toward a matching relation. An account of matching with concurrent schedules is proposed in which responding exclusively to the discriminative stimulus associated with the higher reinforcement frequency declines as the concurrent stimuli become more similar and other operants-notably switching-are acquired and generalize to stimuli from both alternatives. The concerted effect of these processes fosters an approximate matching relation in commonly used concurrent procedures.     

NONCONTINGENT PRESENTATION OF ATTENTION AND ALTERNATIVE STIMULI IN THE TREATMENT OF ATTENTION-MAINTAINED DESTRUCTIVE BEHAVIOR

Previous research has demonstrated that destructive behavior may be reduced through noncontingent presentation of attention when attention is identified as the stimulus responsible for behavioral maintenance. Because it may not always be possible to deliver attention in all situations, we examined the extent to which alternative stimuli that have been identified through a choice assessment would substitute for attention (the functional analysis—based reinforcer) in a noncontingent reinforcement procedure. Prior to treatment, functional analyses demonstrated that the destructive behavior of 2 clients with mental retardation was maintained by adult attention. Next, a stimulus choice assessment identified highly preferred tangible items for the 2 clients. Finally, we compared the effectiveness of two noncontingent reinforcement procedures: continuous noncontingent access to attention and continuous noncontingent access to the tangible item identified in the choice assessment. For both clients, these noncontingent reinforcement procedures reduced destructive behavior. The results are discussed in terms of the clinical implications for the treatment of destructive behavior using functional and alternative stimuli.     

An integrated model of choices and response times in absolute identification

Recent theoretical developments in the field of absolute identification have stressed differences between relative and absolute processes, that is, whether stimulus magnitudes are judged relative to a shorter term context provided by recently presented stimuli or a longer term context provided by the entire set of stimuli. The authors developed a model (SAMBA: selective attention, mapping, and ballistic accumulation) that integrates shorter and longer term memory processes and accounts for both the choices made and the associated response time distributions, including sequential effects in each. The model's predictions arise as a consequence of its architecture and require estimation of only a few parameters with values that are consistent across numerous data sets. The authors show that SAMBA provides a quantitative account of benchmark choice phenomena in classical absolute identification experiments and in contemporary data involving both choice and response time.     

Separating perceptual and decisional attention processes in the identification and categorization of integral-dimension stimuli

Four observers performed matching, identification, and categorization with stimuli that varied along the integral dimensions: brightness and saturation. General recognition theory (F. G. Ashby & J. T. Townsend, 1986) was applied to quantify the separate influences of perceptual and decisional processes within and across tasks, with a focus on separating perceptual from decisional attention processes. Good accounts of the identification data were obtained from perceptual matching representation. This perceptual representation provided a good account of the categorization data, except when decisional selective attention to 1 stimulus dimension was required. Decisional selective attention reduced the attended-dimension perceptual variance relative to the unattended-dimension perceptual variance, with a larger reduction resulting when brightness, as opposed to saturation was attended. Implications for color vision research are discussed.     

Control by reinforcers across time and space: A review of recent choice research

Reinforcers affect behavior. A fundamental assumption has been that reinforcers strengthen the behavior they follow, and that this strengthening may be context‐specific (stimulus control). Less frequently discussed, but just as evident, is the observation that reinforcers have discriminative properties that also guide behavior. We review findings from recent research that approaches choice using nontraditional procedures, with a particular focus on how choice is affected by reinforcers, by time since reinforcers, and by recent sequences of reinforcers. We also discuss how conclusions about these results are impacted by the choice of measurement level and display. Clearly, reinforcers as traditionally considered are conditionally phylogenetically important to animals. However, their effects on behavior may be solely discriminative, and contingent reinforcers may not strengthen behavior. Rather, phylogenetically important stimuli constitute a part of a correlated compound stimulus context consisting of stimuli arising from the organism, from behavior, and from physiologically detected environmental stimuli. Thus, the three‐term contingency may be seen, along with organismic state, as a correlation of stimuli. We suggest that organisms may be seen as natural stimulus‐correlation detectors so that behavioral change affects the overall correlation and directs the organism toward currently appetitive goals and away from potential aversive goals. As a general conclusion, both historical and recent choice research supports the idea that stimulus control, not reinforcer control, may be fundamental.     

Stimulus control and compounding with ambient odor as a discriminative stimulus on a free-operant baseline

Previous experiments have demonstrated that the simultaneous presentation of independently established discriminative stimuli can control rates of operant responding substantially higher than the rates occasioned by the individual stimuli. This "additive summation" phenomenon has been shown with a variety of different reinforcers (e.g., food, water, shock avoidance, cocaine, and heroin). Discriminative stimuli previously used in such studies have been limited to the visual and auditory sensory modalities. The present experiment sought to (1) establish stimulus control on a free-operant baseline with an ambient olfactory discriminative stimulus, (2) compare olfactory control to that produced with an auditory discriminative stimulus, and (3) determine whether compounding independently established olfactory and auditory discriminative stimuli produces additive summation. Rats lever pressed for food on a variable-interval schedule in the presence of either a tone or an odor, with comparable control developed to each stimulus. In the absence of these stimuli responding was not reinforced. During stimulus compounding tests, the tone-plus-odor compound occasioned more than double the responses occasioned by either the tone or odor presented individually. Thus, the current study (1) established stimulus control with an ambient olfactory discriminative stimulus in a traditional free-operant setting and (2) extended the generality of stimulus-compounding effects by demonstrating additive summation when olfactory and auditory discriminative stimuli were presented simultaneously.     

Stimulus Effects On Behavior Allocation In Three-alternative Choice

Six pigeons were trained on three-alternative concurrent variable-interval schedules that were available through a switching response and were signaled by colored stimuli. The discriminative stimuli for two of the schedules were always 560 nm and 630 nm, but the stimulus signaling the third alternative was varied across conditions over seven levels between these colors. For each third-alternative stimulus condition, the relative frequency of reinforcers was varied over three conditions with 4:1 and 16:1 reinforcer ratios between each pair of alternatives. The distribution of responses between the alternatives was dependent jointly on the third-alternative reinforcer rate and on the disparity between the stimulus signaling the third alternative and those signaling the other alternatives. A generalized matching approach was unable to provide invariant measures of the discriminability between constant stimuli, but a contingency-discriminability approach provided excellent fits and sensible and invariant stimulus discriminability measures.     

Stimulus selection with duration as a relevant cue

To date, research has not explicitly examined how duration competes with other stimulus dimensions for control over responding. The present study investigated some familiar selective mechanisms of stimulus control over key pecking in pigeons, with duration and line tilt as discriminative stimuli in successive discrimination procedures. Specifically, pigeon's key pecking was reinforced with food or extinguished following compound stimuli comprising one of two line orientation stimuli presented for one of two different durations. Traditional experimental designs explored stimulus additivity, overshadowing, blocking, and learned irrelevance. Although stimulus additivity was observed, control by duration was masked by line tilt in extinction testing that followed facilitated acquisition with redundant, relevant cues. In addition, although prior training with duration relevant partially blocked subsequent acquisition of control by line tilt when both stimulus dimensions were relevant, there was a tendency for control by duration to decrease with continued compound training. It was suggested that the greater time required to distinguish duration on a trial—compared to more commonly studied stimulus dimensions, which can be distinguished almost immediately—puts duration at a competitive disadvantage in situations where other relevant dimensions are also available.     

Distinguishing blocking from attenuation in visual selective attention

Sensory information must be processed selectively in order to represent the world and guide behavior. How does such selection occur? Here we consider two alternative classes of selection mechanisms: In blocking, unattended stimuli are blocked entirely from access to downstream processes, and in attenuation, unattended stimuli are reduced in strength but if strong enough can still access downstream processes. Existing evidence as to whether blocking or attenuation is a more accurate model of human performance is mixed. Capitalizing on a general distinction between blocking and attenuation-blocking cannot be overcome by strong stimuli, whereas attenuation can-we measured how attention interacted with the strength of stimuli in two spatial selection paradigms, spatial filtering and spatial monitoring. The evidence was consistent with blocking for the filtering paradigm and with attenuation for the monitoring paradigm. This approach provides a general measure of the fate of unattended stimuli.