Rhesus monkeys (Macaca mulatta) adaptively monitor uncertainty while multi-tasking

As researchers explore animals’ capacity for metacognition and uncertainty monitoring, some paradigms allow the criticism that animal participants—who are always extensively trained in one stimulus domain within which they learn to avoid difficult trials—use task-specific strategies to avoid aversive stimuli instead of responding to a generalized state of uncertainty like that humans might use. We addressed this criticism with an uncertainty-monitoring task environment in which four different task domains were interleaved randomly trial by trial. Four of five macaques (Macaca mulatta) were able to make adaptive uncertainty responses while multi-tasking, suggesting the generality of the psychological signal that occasions these responses. The findings suggest that monkeys may have an uncertainty-monitoring capacity that is like that of humans in transcending task-specific cues and extending simultaneously to multiple domains.     

Global interference and spatial uncertainty in the Sustained Attention to Response Task (SART)

The Sustained Attention to Response Task (SART) is a Go–No-Go signal detection task developed to measure lapses of sustained conscious attention. In this study, we examined the impact global interference and spatial uncertainty has on SART performance. Ten participants performed either a SART (high-Go) or a traditionally formatted (low-Go) version of a global–local stimuli detection task with spatially certain and uncertain signals. Reaction time in the SART was insensitive to global interference and spatial uncertainty, whereas reaction time in the low-Go task was sensitive. Spatial uncertainty increased errors of omission in the SART, which was not expected if the SART measures mindlessness. There was a high correlation between participants’ errors of commission rate and their reaction time in the SART. The results, overall, support the view that the SART is a better measure of response strategy than lapses in sustained attention or mindlessness.     

Decision deadlines and uncertainty monitoring: the effect of time constraints on uncertainty and perceptual responses

The behavioral uncertainty response has grounded the study of animal metacognition and influenced the study of human psychophysics. However, the interpretation of this response is debated—especially whether it is a behavioral index of metacognition. The authors advanced this interpretation using the dissociative technique of response deadlines. Uncertainty responding, if it is higher level or metacognitive, should depend on a slower, more controlled decisional process and be more vulnerable to time constraints. Humans performed sparse–uncertain–dense or sparse–middle–dense discriminations in which, respectively, they could decline difficult trials or positively identify middle stimuli. Uncertainty responses were sharply and selectively reduced under a decision deadline, as compared to primary perceptual responses (i.e., “sparse,” “middle,” and “dense” responses). This dissociation suggests that the uncertainty response does reflect a higher-level, decisional response. It grants the uncertainty response a distinctive psychological role in its task and encourages an interpretation of this response as an elemental behavioral index of uncertainty that deserves continuing research.     

奖惩对行为抑制及程序阶段中自主生理反应的影响

采用停止信号任务探讨奖惩条件对行为抑制和程序阶段中自主生理反应的影响。结果显示：(1)奖惩组的反应时显著高于控制组, 抑制失败率则显著低于控制组; (2)奖励组与其它两组相比表现出心率显著增加和皮肤电活动显著降低; (3)各生理指标在准备、工作和奖惩阶段中的奖惩差异性显著(4)奖惩条件下皮肤电活动呈现出一致性程序阶段变化。结果表明：奖惩条件均对行为具有抑制作用, 但在自主生理反应上则有显著差异; 各生理指标在准备、工作和奖惩阶段的情绪效价显著; 皮肤电活动的程序阶段变化显著, 但其奖惩效价较为稳定, 很少接受程序阶段变化的影响。     

A response-spacing effect: an absence of responding during response-feedback stimuli

In most studies of operant reinforcement a response-feedback stimulus is used which is so brief that the nature of the responding during it is virtually undetectable. The present study investigated the nature of this responding by lengthening an initially brief feedback stimulus. The key-pecking responses of pigeons were maintained by a variable-interval schedule of food reinforcement. Each response produced a brief stimulus light in addition to the usual auditory response feedback. When the duration of the feedback stimulus light was gradually increased, it was found to control a nearly zero rate of responding. The result was a paced, metronomic-like performance in which the pigeon made a single response, paused until the stimulus terminated, and then responded again. As a result, the overall response rate was greatly reduced; the mean interresponse time approximated the stimulus duration. A plausible interpretation is that brief feedback stimuli acquire control over responding because they coincide with few responses and few reinforcers. These findings show that in addition to their known functions as conditioned-reinforcing stimuli and discriminative stimuli, response-feedback stimuli also exert direct stimulus control: responding is reduced during the feedback stimulus itself.     

Causal uncertainty as a chronically accessible construct

Causal uncertainty refers to feelings that one may not understand the causes of events. A number of studies have shown that causal uncertainty has significant effects on people's processing of information and on important life outcomes. Weary and Edwards have postulated that causal uncertainty is, in part, a cognitive construct that can vary in its accessibility. This assumption has allowed for a variety of predictions to be made about the causes and consequences of causal uncertainty. However, this accessibility assumption has never been directly tested. To do this, in Study 1 an emotional Stroop procedure was used. Higher causal uncertainty was associated with longer latencies to name the color in which causal uncertainty‐related words were written compared to uncertainty‐irrelevant words. In Study 2, both manipulated and chronic causal uncertainty led to faster times to respond to causal uncertainty‐related stimuli in an attitude accessibility task. Both studies are consistent with the theoretically predicted chronic accessibility of causal uncertainty beliefs. Copyright © 2008 John Wiley & Sons, Ltd.     

Destructive Criticism Revisited: Appraisals,Task Outcomes,and the Moderating Role of Competitiveness

Destructive criticism is negative feedback that is inconsiderate in style and content, which exists at the intersection of performance feedback and interpersonal mistreatment. The current research integrates these literatures with an investigation of the effects of destructive versus constructive criticism from a co‐worker on recipients' relational appraisals, emotions, and task outcomes. Drawing from theorising about cognitive appraisals after personal affronts, we first propose that those who experience destructive criticism are more likely than those who experience constructive criticism to (a) perceive that the feedback‐giver intended to harm them, (b) blame the feedback‐giver, (c) distrust the feedback‐giver, and (d) feel anger. Second, with regard to task‐related outcomes, we extend research on trait moderators of feedback responses to the study of destructive criticism. We draw from feedback intervention theory ( Kluger & DeNisi, 1996 ) regarding how feedback may alter the locus of attention to be either self‐ or task‐focused, and investigate a trait that may shift one's attention to the self after destructive criticism. Specifically, we proposed that trait competitiveness—i.e. a desire to win over others—interacts with type of criticism to predict task‐related outcomes. The results of two experiments—a scenario study and a behavioral experiment—provide support for our arguments.     

Observing responses and uncertainty reduction. II The effect of varying the probability of reinforcement

The observing response paradigm was used to assess the reinforcing properties of discriminative stimuli by allowing animals either to work for food in the presence of a neutral stimulus or to first make an observing response by pressing a lever. On a progressive ratio schedule this resulted in the appearance of easily discriminable stimuli which marked positive and negative trials. The uncertainty associated with the imposed neutral stimulus was varied by manipulating the proportion of positive and negative trials in the session. The animals switched most often when the probability of reinforcement was low, less often when it was intermediate, and least often when it was high. This was not consistent with an uncertainty reduction hypothesis but could be explained if the uncertainty had to do with response rather than outcome.     

The effects of spatial uncertainty and cue predictability on visual orienting in children

Visual orienting was studied using a task that required participants to respond to stimuli at various locations that were either accurately or inaccurately cued. Orienting abilities of children ages 6 to 8 years, and young adults (21 years) were tested under conditions of spatial uncertainty (i.e., multiple possible target locations), and variable cue predictability (i.e., variable proportion of validly cued targets). The results indicate that children orient their attentional resources automatically to abrupt visual onsets, and do so under conditions when it is not beneficial to overall performance. Adults, on the other hand, are able to control their orienting in such a way that it is limited to conditions where it improves their task efficiency. There appears to be developmental change in the ability to assess the utility of a location cue and/or to moderate responses in accordance with the utility of a cue. This finding is discussed in terms of the development of attentional control and inhibitory processes in children.     

Observing responses and uncertainty reduction

Rhesus monkeys and baboons were placed in an observing response situation where on any trial they could work for food in the presence of an imposed stimulus or make an observing response by pressing a lever to present an alternative stimulus. The reinforcing properties of the alternative stimulus were assessed by placing the observing response on a progressive ratio schedule and were found to vary as a function of the difficulty of the imposed discrimination and the degree to which the imposed discrimination had been learned. The results are consistent with the hypothesis that the reinforcing strength of the alternative stimuli varies with the amount of uncertainty they reduce. Eliminating the response requirement showed that the effect was not simply due to the fact that informative stimuli permitted a saving of responses.     

Developmental change in feedback processing as reflected by phasic heart rate changes

Heart rate was recorded from 3 age groups (8-10, 12, and 20-26 years) while they performed a probabilistic learning task. Stimuli had to be sorted by pressing a left versus right key, followed by positive or negative feedback. Adult heart rate slowed following negative feedback when stimuli were consistently mapped onto the left or right key (response-dependent condition) but not when responses to stimuli were always followed by negative feedback (uninformative condition). Young children's heart rate showed slowing following both response-dependent and uninformative negative feedback. These findings suggest that the ability to assess the relevance of performance feedback improves with age, resulting in improved adjustment to dynamical changes in the task environment.     

Directional uncertainty in visually guided pointing

Studies of the relationship between stimulus-response uncertainty and reaction times indicate three qualitatively different functions: Hick's law, simple-choice step function, or flat curve (no effect at all). The extent of stimulus-response S-R) compatibility appears to interact with the effects of uncertainty on response times. One possible hypothesis regarding these various S-R uncertainty functions is that uncertainty will have an effect whenever the stimuli and their associated responses are not within the same egocentric spatial coordinates. We tested this hypothesis in 5 undergraduate participants (2 men, M age 18.7 yr., range 18-20) by investigating the time-course of pointing to peripherally located visual targets under four different levels of uncertainty (1, 2, 4, or 8 possible locations). Surprisingly, the resulting response function does not match any of those previously reported. Visually guided pointing produced a quadratic reaction time function as S-R uncertainty increases in log2 steps from 1 to 8.     

The effect of trial-to-trial feedback on the error-related negativity and its relationship with anxiety

Individuals with anxiety disorders and related personality traits are characterized by increased error-related brain activity, as measured by the error-related negativity (ERN) in simple speeded response tasks. An absent, or opposite, relation between anxiety and the ERN has been reported in studies that employed reinforcement learning paradigms with trial-to-trial feedback. Understanding the effect of trial-to-trial feedback on the ERN may help clarify these results and can further elucidate the impact of feedback on performance monitoring. In the present study, 30 undergraduate participants performed two versions of the arrowhead version of the flanker task in counterbalanced order: one with trial-to-trial feedback and one without. The participants were slower and more accurate in the task with trial-to-trial feedback; however, the ERN was equivalent between the two tasks. Larger ERNs were related to higher trait anxiety, but only in the version without trial-to-trial feedback. These findings show that although trial-to-trial performance feedback impacts behavioral measures, it does not affect the ERN; moreover, the presence of trial-to-trial feedback moderates the relationship between the ERN and anxiety.     

The transfer of specific and general consequential functions through simple and conditional equivalence relations

The purpose of this study was to examine the transfer of consequential (reinforcement and punishment) functions through equivalence relations. In Experiment 1, 9 subjects acquired three three-member equivalence classes through matching-to-sample training using arbitrary visual forms. Comparison stimuli were then given conditioned reinforcement or punishment functions by pairing them with verbal feedback during a sorting task. For 8 of the 9 subjects, trained consequential functions transferred through their respective equivalence classes without additional training. In Experiment 2, transfer of function was initially tested before equivalence testing per se. Three of 4 subjects showed the transfer without a formal equivalence test. In Experiment 3, 3 subjects were given training that gave rise to six new three-member conditional equivalence classes. For 2 of the subjects, the same stimulus could have either a reinforcement or punishment function on the basis of contextual cues that defined its class membership. Experiment 4 assessed whether equivalence training had established general or specific consequential functions primarily by adding novel stimuli in the transfer test. Subjects treated even novel feedback stimuli in the transfer test as consequences, but the direction of consequential effects depended upon the transfer of specific consequential functions through equivalence relations.     

Effects of stimulus-response uncertainty on watchkeeping performance and choice reactions

The present study was conducted to assess the effects of S-R uncertainty on performance in watchkeeping and typical type-b choice-reaction situations. The assessment was based in part on measurements of S-R compatibility effects in the two performance conditions. Four levels of S-R uncertainty (1, 2, 3 and 4 bits/S-R event) were combined factorially with two levels of S-R compatibility (high and low) and the two kinds of tasks (watchkeeping and choice-reaction); 12 Ss were assigned at random to each of the 16 conditions. A matrix of lights was used as stimuli in the choice-reaction condition; Ss monitored the matrix for a I-h duration in the watchkeeping condition. In both tasks, Ss responded by pressing a corresponding key after the presentation of a stimulus or “critical signal.” Reaction time (RT) was found to be an increas ing linear function of S-R uncertainty in both tasks. and the effects of S-R compatibility were essentially identical in the two. However, choice reactions were significantly faster than watchkeeping responses, and the rate of gain of information in watchkeeping was greater than in the comparable choice-reaction situations. The results are interpreted as supporting the hypothesis that watchkeeping differs from the simpler choice-reaction task principally in presenting an additional source of (temporal) uncertainty for information processing.     

Impaired reward processing by anterior cingulate cortex in children with attention deficit hyperactivity disorder

Decades of research have examined the neurocognitive mechanisms of cognitive control, but the motivational factors underlying task selection and performance remain to be elucidated. We recently proposed that anterior cingulate cortex (ACC) utilizes reward prediction error signals carried by the midbrain dopamine system to learn the value of tasks according to the principles of hierarchical reinforcement learning. According to this position, disruption of the ACC–dopamine interface can disrupt the selection and execution of extended, task-related behaviors. To investigate this issue, we recorded the event-related brain potential (ERP) from children with attention deficit hyperactivity disorder (ADHD), which is strongly associated with ACC–dopamine dysfunction, and from typically developing children while they navigated a simple “virtual T-maze” to find rewards. Depending on the condition, the feedback stimuli on each trial indicated that the children earned or failed to earn either money or points. We found that the reward positivity, an ERP component proposed to index the impact of dopamine-related reward signals on ACC, was significantly larger with money feedback than with points feedback for the children with ADHD, but not for the typically developing children. These results suggest that disruption of the ACC–dopamine interface may underlie the impairments in motivational control observed in childhood ADHD.     

The N2 in go/no-go tasks reflects conflict monitoring not response inhibition

The functional significance of the N2 in go/no-go tasks was investigated by comparing electrophysiological data obtained from two tasks: a go/no-go task involving both response inhibition as well as response conflict monitoring, and a go/GO task associated with conflict monitoring only. No response was required to no-go stimuli, and a response with maximal force to GO stimuli. The relative frequency of the go stimuli (80% vs. 50%) was varied. The N2 peaked on both no-go and GO trials, with larger amplitudes for both signals when presented in a context of frequent (80%) go signals. These results support the idea that the N2 reflects conflict monitoring not response inhibition.     

Antipsychotic dose modulates behavioral and neural responses to feedback during reinforcement learning in schizophrenia

Schizophrenia is characterized by an abnormal dopamine system, and dopamine blockade is the primary mechanism of antipsychotic treatment. Consistent with the known role of dopamine in reward processing, prior research has demonstrated that patients with schizophrenia exhibit impairments in reward-based learning. However, it remains unknown how treatment with antipsychotic medication impacts the behavioral and neural signatures of reinforcement learning in schizophrenia. The goal of this study was to examine whether antipsychotic medication modulates behavioral and neural responses to prediction error coding during reinforcement learning. Patients with schizophrenia completed a reinforcement learning task while undergoing functional magnetic resonance imaging. The task consisted of two separate conditions in which participants accumulated monetary gain or avoided monetary loss. Behavioral results indicated that antipsychotic medication dose was associated with altered behavioral approaches to learning, such that patients taking higher doses of medication showed increased sensitivity to negative reinforcement. Higher doses of antipsychotic medication were also associated with higher learning rates (LRs), suggesting that medication enhanced sensitivity to trial-by-trial feedback. Neuroimaging data demonstrated that antipsychotic dose was related to differences in neural signatures of feedback prediction error during the loss condition. Specifically, patients taking higher doses of medication showed attenuated prediction error responses in the striatum and the medial prefrontal cortex. These findings indicate that antipsychotic medication treatment may influence motivational processes in patients with schizophrenia.     

“Inside out”: Appraisals for achievement emotions from constructive,positive, and negative feedback on writing

Even with the recent surge of research on achievement emotions, few studies have investigated emotions in feedback situations and the appraisals associated with such emotions. The purpose of this study was to examine emotion appraisals of constructive criticism, negative, and positive feedback, to aid us in determining whether these appraisals differed by feedback type. In a task asking them to provide open-ended responses as they imagined receiving feedback on a writing task, undergraduates (N?=?270) gave reasons for why they might experience unpleasant emotions from positive feedback and pleasant emotions from negative feedback along with reasons for both pleasant and unpleasant emotions emanating from constructive feedback. Open coding of responses yielded categories for each emotion-feedback pairing that, across all emotions, were collapsed into five appraisal categories: feedback suggests ways to improve, a mismatch between feedback and task exists, feedback targets the self or one’s ability, feedback says something about the relationship between feedback giver and receiver, and the task is judged for its value. Distributions of appraisal categories distinguished constructive feedback from positive and negative feedback. Implications are drawn for control-value theory and for classroom feedback practices.     

A software tool for auditory and speech perception experimentation

A computer program capable of supporting auditory and speech perception experimentation is described. Given a continuum of acoustic stimuli, the program (Paradigm) allows the user to present those stimuli under different, well-known psychophysical paradigms (simple identification, identification with a rating scale, 2IAX, ABX, AXB, and oddity task). For discrimination tests, both high uncertainty (roving designs) and minimal psychophysical uncertainty (fixed designs) procedures are available. All the relevant time intervals can be precisely specified, and feedback is also available. Response times can be measured as well. Furthermore, the program stores subjects’ responses and provides summaries of experimental results for both individual subjects and groups. The program runs on Microsoft Windows (3.1 or 95) on personal computers equipped with any soundboard.