Response error and processing biases in confidence judgment

Previous studies showed that random error can explain overconfidence effects typically observed in the literature. One of these studies concluded that, after accounting for random error effects in the data, there is little support for cognitive‐processing biases in confidence elicitation. In this paper, we investigate more closely the random error explanation for overconfidence. We generated data from four models of confidence and then estimated the magnitude of random error in the data. Our results show that, in addition to the true magnitude of random error specified in the simulations, the error estimates are influenced by important cognitive‐processing biases in the confidence elicitation process. We found that random error in the response process can account for the degree of overconfidence found in calibration studies, even when that overconfidence is actually caused by other factors. Thus, the error models say little about whether cognitive biases are present in the confidence elicitation process. Copyright © 2008 John Wiley & Sons, Ltd.     

‘He's got his father's bias’: Parental influence on weight bias in young children

Our aim was to explore the role of parents in the transmission of stereotypical body size attitudes and awareness of weight loss strategies to preschool children. Participants were 279 3‐year‐old children and their parents, who provided data at baseline and 1 year later. Parents completed self‐report body size attitude and dieting measures. Child weight bias and awareness of weight loss strategies were assessed through interview. Over time, negative associations with large bodies and awareness of weight loss strategies increased. Fathers’ attitudes prospectively predicted boys’ weight bias and awareness of weight loss strategies. Among girls, parental attitudes were less predictive. Findings confirm the importance of fathers in the development of boys’ body attitudes and inform prevention programmes.     

How big is this sound? Crossmodal association between pitch and size in infants

We examined 4- and 6-month-old infants’ sensitivity to the perceptual association between pitch and object size. Crossmodal correspondence effects were observed in 6-month-old infants but not in younger infants, suggesting that experience and/or further maturation is needed to fully develop this crossmodal association.     

Individual differences in reverse Hindsight bias: I never thought something like chernobyl would happen. Did I?

Hindsight bias was studied in the context of the accident in the Chernobyl nuclear power plant, which took place on April 26th 1986. An individual difference factor which relates to the motivation to process information, need for cognition, was expected to moderate the occurrence of hindsight bias. Probability estimates of many casualties due to the use of nuclear power in The Netherlands were obtained from 212 individuals two months before the accident in Chernobyl. These estimates were compared with similar estimates made in hindsight by the same individuals five months after the accident. Loglinear Analyses reveal a systematic hindsight bias. However, the direction of the bias was contrary to expectations. In hindsight, individuals gave lower probabilities than they actually did two months before the Chernobyl accident. These results reveal a reverse hindsight bias. As hypothesized, need for cognition moderates hindsight bias: individuals low and medium in need for cognition express a systematic reverse hindsight bias, while individuals high in need for cognition do not. High need for cognition individuals also show higher literal consistency between the two measurements, which supports a memory explanation of the moderating effect of need for cognition.     

Purposive behaviour in cognition and perception: Considerations of awareness in memory

The responses to the original article by Rönnberg (1990a) provoked interesting and thoughtful points of view that are covered by Gärling (1990), Hjelmquist (1990), Montgomery (1991), and Runeson (1990). These articles do not merely present a different outlook but also provide concepts that are certainly worthy of consideration and add more substance to the general topic under discussion. The purpose of this commentary is to seek an understanding of the ideas presented by the above authors within a synthesis of our views of current conceptualizations in cognition and perception. Each of the original criteria (Rönnberg, 1990a) will be treated in turn.     

Effects of relative reinforcer frequency on complex color detection

Pigeons were trained under a discrete-trials detection procedure in which one of a set of color stimuli was presented on the center key and a single response turned off the stimulus and illuminated two side keys. Single responses to one or the other side key produced occasional reinforcers depending on the value of the color stimulus. In Experiment 1, one color-stimulus set comprised 559, 564, 569, and 574 nm, and right-key pecks were occasionally reinforced following presentations of members of this set. The other stimulus set comprised 579, 584, 589, and 594 nm, and left-key pecks were occasionally reinforced following presentations of members of this set. Across seven experimental conditions, the left/(left + right) relative reinforcer frequency was varied from .1 to .9. In Experiment 2, one stimulus set contained only one member, 574 nm, and right-key responses were occasionally reinforced following its presentation. Over 12 experimental conditions, two manipulations were carried out. First, the number of stimuli comprising the other stimulus set was increased from one (579 nm) to two (579 and 584 nm) to three (579, 584, and 589 nm) and to four (579, 584, 589, and 594 nm), and left-key responses were reinforced occasionally following center-key presentations of members of this set. Second, for each stimulus combination, the left/(left + right) relative reinforcer frequency was varied from .1 to .5 to .9 across three experimental conditions. The principal finding of Experiments 1 and 2 was that reinforcers and stimuli interacted in their effects on behavior. In Experiment 3, pairs of adjacent stimuli (5 nm apart) in the range 559 to 594 nm were presented in each experimental condition, and the left/(left + right) relative reinforcer frequency was held constant at .5. The data from all three experiments were analyzed according to a detection model describing performance in multiple-stimulus two-response procedures. This model provided independent measures of stimulus discriminability, contingency discriminability, and bias. The analysis showed that (a) consistent with the color-naming function, pigeons were better able to discriminate between higher nanometer values than lower nanometer values; (b) their ability to discriminate between the stimuli was independent of the number of wavelengths comprising each stimulus set; (c) they allocated delivered reinforcers very accurately to the previously emitted response; and (d) no consistent biases emerged.     

An infrared system for the detection of a pigeon''s pecks at alphanumeric characters on a TV screen: the dependency of letter detection on the predictability of one letter by another.

Three pigeons pecked at letters of the alphabet and at the symbol "?" displayed on a computer-driven cathode ray screen. A 4 by 4 matrix of infrared emitting and detecting diodes and associated circuitry identified the location of a pigeon''s responses to the screen. Responses at the target letter T were probabilistically reinforced with food whenever T appeared in a string of three letters in the middle of the screen. Responses at the symbol "?" appearing below this string were probabilistically reinforced whenever T did not appear. The letter F anywhere in the three-character string either strongly predicted the occurrence of the target letter T, in two conditions, or predicted its nonoccurrence, in a third. This manipulation of the frequency with which the familiar letter F predicted T was shown to change the function relating probability of a correct peck at the symbol "?" to the number of Fs in the string. This effect may be interpreted as an instance of the phenomenon where an organism''s acquired knowledge changes what it sees.     

The interaction of stimulus and reinforcer control in complex temporal discrimination.

Six pigeons were trained in a discrete-trials signal-detection procedure to discriminate between a fixed-duration stimulus (5 s or 20 s) and a set of variable durations ranging from 2.5 s to 57.5 s in steps of 5 s. For each fixed-duration stimulus, the ratio of reinforcer frequencies contingent upon reporting the fixed versus the variable stimulus was systematically manipulated. Detection performance was well controlled by both the stimulus value and the reinforcer ratio. Both the discriminability between the fixed duration and the set of variable durations, and the discriminability between the fixed duration and each of the variable durations, were independent of the reinforcer-frequency ratio when discriminability was measured as log d. The sensitivity of response bias to reinforcement-ratio changes was independent of the value of the fixed duration, but was not independent of the discriminability of the variable durations from the fixed durations. Under current models, discriminability measures in complex temporal discrimination may be independent of biasing manipulations, but bias measures are not independent of stimulus values.     

Self-selection biases in correlational studies based on questionnaires

It is commonly held that even where questionnaire response is poor, correlational studies are affected only by loss of degrees of freedom or precision. We show that this supposition is not true. If the decision to respond is correlated with a substantive variable of interest, then regression or analysis of variance methods based upon the questionnaire results may be adversely affected by self-selection bias. Moreover such bias may arise even where response is 100%. The problem in both cases arises where selection information is passed to the score indirectly via the disturbance or individual effects, rather than entirely via the observable explanatory variables. We suggest tests for the ensuing self-selection bias and possible ways of handling the ensuing problems of inference.The author would like to thank members of the Psychology Department at UWA for references on the illustrative example, namely the effects of sex-stereotyping on achievements in mathematics; thanks are also due to the anonymous reviewers whose comments resulted in material improvements to the paper.