Response error and processing biases in confidence judgment

Previous studies showed that random error can explain overconfidence effects typically observed in the literature. One of these studies concluded that, after accounting for random error effects in the data, there is little support for cognitive‐processing biases in confidence elicitation. In this paper, we investigate more closely the random error explanation for overconfidence. We generated data from four models of confidence and then estimated the magnitude of random error in the data. Our results show that, in addition to the true magnitude of random error specified in the simulations, the error estimates are influenced by important cognitive‐processing biases in the confidence elicitation process. We found that random error in the response process can account for the degree of overconfidence found in calibration studies, even when that overconfidence is actually caused by other factors. Thus, the error models say little about whether cognitive biases are present in the confidence elicitation process. Copyright © 2008 John Wiley & Sons, Ltd.     

‘He's got his father's bias’: Parental influence on weight bias in young children

Our aim was to explore the role of parents in the transmission of stereotypical body size attitudes and awareness of weight loss strategies to preschool children. Participants were 279 3‐year‐old children and their parents, who provided data at baseline and 1 year later. Parents completed self‐report body size attitude and dieting measures. Child weight bias and awareness of weight loss strategies were assessed through interview. Over time, negative associations with large bodies and awareness of weight loss strategies increased. Fathers’ attitudes prospectively predicted boys’ weight bias and awareness of weight loss strategies. Among girls, parental attitudes were less predictive. Findings confirm the importance of fathers in the development of boys’ body attitudes and inform prevention programmes.     

Confidence in judgments based on incomplete information: An investigation using both hypothetical and real gambles

This study assessed how confidence in judgments is affected by the need to make inferences about missing information. Subjects indicated their likelihood of taking each of a series of gambles based on both probability and payoff information or only one of these sources of information. They also rated their confidence in each likelihood judgment. Subjects in the Explicit Inference condition were asked to explicitly estimate the values of missing information before making their responses while subjects in the Implicit Inference condition were not. The manner in which probability information was framed was also manipulated. Experiment 1 employed hypothetical gambles and Experiment 2 employed gambles with real money. Expressed likelihood of taking gambles was higher when probability was phrased in terms of '% chance of winning' rather than '% chance of losing', but this difference was somewhat less with real gambles than with hypothetical gambles. Confidence ratings in each experiment were actually higher on incomplete information trials than on complete information trials in the Explicit Inference condition. Results were related to the general issue of confidence in judgments.     

Individual differences in reverse Hindsight bias: I never thought something like chernobyl would happen. Did I?

Hindsight bias was studied in the context of the accident in the Chernobyl nuclear power plant, which took place on April 26th 1986. An individual difference factor which relates to the motivation to process information, need for cognition, was expected to moderate the occurrence of hindsight bias. Probability estimates of many casualties due to the use of nuclear power in The Netherlands were obtained from 212 individuals two months before the accident in Chernobyl. These estimates were compared with similar estimates made in hindsight by the same individuals five months after the accident. Loglinear Analyses reveal a systematic hindsight bias. However, the direction of the bias was contrary to expectations. In hindsight, individuals gave lower probabilities than they actually did two months before the Chernobyl accident. These results reveal a reverse hindsight bias. As hypothesized, need for cognition moderates hindsight bias: individuals low and medium in need for cognition express a systematic reverse hindsight bias, while individuals high in need for cognition do not. High need for cognition individuals also show higher literal consistency between the two measurements, which supports a memory explanation of the moderating effect of need for cognition.     

Effectiveness of the GOFER course in decision making for high school students

The paper describes and evaluates the GOFER course in decision making for high school students (Mann, Harmoni and Power, 1988). The course was based on principles from the conflict theory of decision making (Janis and Mann, 1977) and was designed to provide adolescents with an understanding of factors that produce good and poor decision making as well as knowledge and practice of sound decision skills. Two evaluation studies were conducted to examine effectiveness of the course. Study 1 was conducted with young adolescents (12 year olds). It found a significant difference between students trained in the course and a control group on measures of self-esteem as a decision maker, self reported decision habits and knowledge of decision strategy. Study 2 was conducted with mid-adolescents (15 year olds). It, too, found a significant difference between students who took the course and a control group on measures of self esteem as a decision maker and self-reported decision habits. It is concluded that while the evaluation study fell short of an ideal test, the GOFER course met the criteria of improving student knowledge, raising confidence in decision making and changing self reported decision habits.     

Minimizing the number of observations: A generalization of the spearman-brown formula

A new method for determining the minimum number of observations per subject needed to achieve a specific generalizability coefficient is presented. This method, which consists of a branch-and-bound algorithm, allows for the employment of constraints specified by the investigator.     

Effects of relative reinforcer frequency on complex color detection

Pigeons were trained under a discrete-trials detection procedure in which one of a set of color stimuli was presented on the center key and a single response turned off the stimulus and illuminated two side keys. Single responses to one or the other side key produced occasional reinforcers depending on the value of the color stimulus. In Experiment 1, one color-stimulus set comprised 559, 564, 569, and 574 nm, and right-key pecks were occasionally reinforced following presentations of members of this set. The other stimulus set comprised 579, 584, 589, and 594 nm, and left-key pecks were occasionally reinforced following presentations of members of this set. Across seven experimental conditions, the left/(left + right) relative reinforcer frequency was varied from .1 to .9. In Experiment 2, one stimulus set contained only one member, 574 nm, and right-key responses were occasionally reinforced following its presentation. Over 12 experimental conditions, two manipulations were carried out. First, the number of stimuli comprising the other stimulus set was increased from one (579 nm) to two (579 and 584 nm) to three (579, 584, and 589 nm) and to four (579, 584, 589, and 594 nm), and left-key responses were reinforced occasionally following center-key presentations of members of this set. Second, for each stimulus combination, the left/(left + right) relative reinforcer frequency was varied from .1 to .5 to .9 across three experimental conditions. The principal finding of Experiments 1 and 2 was that reinforcers and stimuli interacted in their effects on behavior. In Experiment 3, pairs of adjacent stimuli (5 nm apart) in the range 559 to 594 nm were presented in each experimental condition, and the left/(left + right) relative reinforcer frequency was held constant at .5. The data from all three experiments were analyzed according to a detection model describing performance in multiple-stimulus two-response procedures. This model provided independent measures of stimulus discriminability, contingency discriminability, and bias. The analysis showed that (a) consistent with the color-naming function, pigeons were better able to discriminate between higher nanometer values than lower nanometer values; (b) their ability to discriminate between the stimuli was independent of the number of wavelengths comprising each stimulus set; (c) they allocated delivered reinforcers very accurately to the previously emitted response; and (d) no consistent biases emerged.     

The interaction of stimulus and reinforcer control in complex temporal discrimination.

Six pigeons were trained in a discrete-trials signal-detection procedure to discriminate between a fixed-duration stimulus (5 s or 20 s) and a set of variable durations ranging from 2.5 s to 57.5 s in steps of 5 s. For each fixed-duration stimulus, the ratio of reinforcer frequencies contingent upon reporting the fixed versus the variable stimulus was systematically manipulated. Detection performance was well controlled by both the stimulus value and the reinforcer ratio. Both the discriminability between the fixed duration and the set of variable durations, and the discriminability between the fixed duration and each of the variable durations, were independent of the reinforcer-frequency ratio when discriminability was measured as log d. The sensitivity of response bias to reinforcement-ratio changes was independent of the value of the fixed duration, but was not independent of the discriminability of the variable durations from the fixed durations. Under current models, discriminability measures in complex temporal discrimination may be independent of biasing manipulations, but bias measures are not independent of stimulus values.     

Self-selection biases in correlational studies based on questionnaires

It is commonly held that even where questionnaire response is poor, correlational studies are affected only by loss of degrees of freedom or precision. We show that this supposition is not true. If the decision to respond is correlated with a substantive variable of interest, then regression or analysis of variance methods based upon the questionnaire results may be adversely affected by self-selection bias. Moreover such bias may arise even where response is 100%. The problem in both cases arises where selection information is passed to the score indirectly via the disturbance or individual effects, rather than entirely via the observable explanatory variables. We suggest tests for the ensuing self-selection bias and possible ways of handling the ensuing problems of inference.The author would like to thank members of the Psychology Department at UWA for references on the illustrative example, namely the effects of sex-stereotyping on achievements in mathematics; thanks are also due to the anonymous reviewers whose comments resulted in material improvements to the paper.     

Analysis of Religious Bias among Christian Students in Science

Christians are notably underrepresented in science in part due to long-standing public perceptions of science-religion incompatibility and antireligious bias in science. This research explores whether undergraduates at a Christian university perceive and impose anti-Christian cultural stigma in science. Survey results from 126 biology students revealed that though students generally perceived the culture of science to be anti-Christian, they perceived Christians to have equal opportunities for scientific achievement. Results from a quasi-experimental audit study, in which students evaluated one of two profiles for mock prospective Ph.D. applicants (Christian or undisclosed faith) showed that students did not project anti-Christian stereotypes in terms of competence, hireability, or likeability, but showed some evidence of pro-Christian favorability. Together, this study suggests that the affirmational community of a Christian University may alleviate some negative impacts of anti-Christian stereotypes in academic biology, even as students perceive discrimination against Christians in science and atheists as more scientifically competent.