Decision Making with Uncertain Reinforcement in Children with Attention Deficit/Hyperactivity Disorder (ADHD)

Reward-related processes are impaired in children with ADHD. Whether these deficits can be ascribed to an aversion to delay or to an altered responsiveness to magnitude, frequency, valence, or the probability of rewards still needs to be explored. In the present study, children with ADHD and normal controls aged 7 to 10 years performed a simple probabilistic discounting task. They had to choose between alternatives where the magnitude of rewards was inversely related to the probability of outcomes. As a result, children with ADHD opted more frequently for less likely but larger rewards than normal controls. Shifts of the response category after positive or negative feedback, however, occurred as often in children with ADHD as in control children. In children with ADHD, the frequency of risky choices was correlated with neuropsychological measures of response time variability but unrelated to measures of inhibitory control. It is concluded that the tendency to select less likely but larger rewards possibly represents a separate facet of dysfunctional reward processing, independent of delay aversion or altered responsiveness to feedback.     

Imprecise Epistemic Values and Imprecise Credences

A number of recent arguments purport to show that imprecise credences are incompatible with accuracy-first epistemology. If correct, this conclusion suggests a conflict between evidential and alethic epistemic norms. In the first part of the paper, I claim that these arguments fail if we understand imprecise credences as indeterminate credences. In the second part, I explore why agents with entirely alethic epistemic values can end up in an indeterminate credal state. Following William James, I argue that there are many distinct alethic values that a rational agent can have. Furthermore, such an agent is rationally permitted not to have settled on one fully precise value function. This indeterminacy in value will sometimes result in indeterminacy in epistemic behaviour—that is, because the agent’s values aren’t settled, what she believes might not be.     

Can membership-functions capture the directionality of verbal probabilities?

Verbal probabilities are a common mean for communicating risk and uncertainties in many decision-making settings (e.g., finance, medicine, military). They are considered directional because they elicit a focus on either the outcome occurrence (e.g., there is a chance) or on its non-occurrence (e.g., it is unlikely). According to a quantitative perspective, directionality is dependent on the vague probabilistic meaning conveyed by verbal probabilities—e.g., p(outcome) > .50 = > focus on outcome occurrence. In contrast a more qualitative perspective suggests that directionality depends on contextual factors. The present study tested whether the directionality of verbal probabilities was determined by their vague probabilistic meaning, by contextually manipulated variables (i.e., representativeness and base rate), or by a combination of both. Participants provided their own expressions to describe the guilt of a suspect and then assessed the vague probabilistic meaning and directionality associated with those expressions. Results showed that directionality was mainly determined by the vague probabilistic meaning but also by the base rate of guilt. Although attention focus on the occurrence or the non-occurrence of the target outcome is dependent on vague probabilistic meaning, it cannot be fully accounted for by it.     

The effectiveness of feedback in multiple-cue probability learning

How effective are different types of feedback in helping us to learn multiple contingencies? This article attempts to resolve a paradox whereby, in comparison to simple outcome feedback, additional feedback either fails to enhance or is actually detrimental to performance in nonmetric multiple-cue probability learning (MCPL), while in contrast the majority of studies of metric MCPL reveal improvements at least with some forms of feedback. In three experiments we demonstrate that if feedback assists participants to infer cue polarity then it can in fact be effective in nonmetric MCPL. Participants appeared to use cue polarity information to adopt a linear judgement strategy, even though the environment was nonlinear. The results reconcile the paradoxical contrast between metric and nonmetric MCPL and support previous findings of people's tendency to assume linearity and additivity in probabilistic cue learning.     

Estimating the effect of word predictability on eye movements in Chinese reading using latent semantic analysis and transitional probability

Latent semantic analysis (LSA) and transitional probability (TP), two computational methods used to reflect lexical semantic representation from large text corpora, were employed to examine the effects of word predictability on Chinese reading. Participants' eye movements were monitored, and the influence of word complexity (number of strokes), word frequency, and word predictability on different eye movement measures (first-fixation duration, gaze duration, and total time) were examined. We found influences of TP on first-fixation duration and gaze duration and of LSA on total time. The results suggest that TP reflects an early stage of lexical processing while LSA reflects a later stage.     

A cognitive‐emotional account of the shape of the probability weighting function

Research has shown a tendency of decision makers to overweight small probabilities and to underweight moderate and large probabilities. In standard treatments this is graphically modeled by an inverse S‐shaped probability weighting function. We suggest that emotions play a significant role in the shaping of the probability weighting function. In particular, the weighting function is proposed to be some function of objective probability, expected elation, and expected disappointment. The overweighting of small probabilities results from the anticipated elation after having won, given that winning was very unlikely. The underweighting of large probabilities results from anticipated disappointment after having failed to win, given that winning was very likely. Hence, probability is assumed to influence utility. Three experiments investigate these hypotheses. Experiments 1 and 2 show that a convex function relates probability to surprise. Experiment 3 elicits choice data and further supports the proposed hypotheses. The model adds to the understanding of the cognitive and emotional processes underlying the shape of the probability weighting function. Copyright © 2002 John Wiley & Sons, Ltd.     

Are there degrees of belief?

John Maynard Keynes claimed that not all probabilities were comparable. Frank Ramsey argued that they were, and that Keynes's views to the contrary rested on a confusion of degree of entailment and degree of belief. We will argue that Keynes and Ramsey largely talked past each other, and yet that there are issues of great significance underlying their dispute. In particular, the simple principle of maximizing expected utility may be seen in a new light as one step of a rich and complex process.     

Probability, logic and the cognitive foundations of rational belief

Since Pascal introduced the idea of mathematical probability in the 17th century discussions of uncertainty and “rational” belief have been dogged by philosophical and technical disputes. Furthermore, the last quarter century has seen an explosion of new questions and ideas, stimulated by developments in the computer and cognitive sciences. Competing ideas about probability are often driven by different intuitions about the nature of belief that arise from the needs of different domains (e.g., economics, management theory, engineering, medicine, the life sciences etc). Taking medicine as our focus we develop three lines of argument (historical, practical and cognitive) that suggest that traditional views of probability cannot accommodate all the competing demands and diverse constraints that arise in complex real-world domains. A model of uncertain reasoning based on a form of logical argumentation appears to unify many diverse ideas. The model has precursors in informal discussions of argumentation due to Toulmin, and the notion of logical probability advocated by Keynes, but recent developments in artificial intelligence and cognitive science suggest ways of resolving epistemological and technical issues that they could not address.     

A Reinforcer Pathology perspective on relapse

The Reinforcer Pathology theory proposes conditions under which drugs emerge as excessively preferred reinforcers compared to other available reinforcers among drug users. The theory highlights 2 key variables as important determinants of drug preference: (a) excessive preference for immediate rewards (high discounting of future rewards); and (b) excessive valuation for addictive reinforcers (e.g., drugs). Two iterations of the Reinforcer Pathology theory exist with the latest iteration (i.e., Reinforcer Pathology 2.0) specifying that the temporal window of reinforcer integration (measured by delay discounting) is a determinant of reinforcer value. The 2 iterations of the Reinforcer Pathology theory are described. A novel insight and understanding of abstinence and relapse from a Reinforcer Pathology perspective, limitations, and future directions are discussed. The Reinforcer Pathology theory continues the long-standing efforts to scientifically understand and better define novel concepts and methods to further translational research and improve treatment outcomes. Exploring the complementary relation between the Reinforcer Pathology perspective and other current approaches could have a valuable effect.