Response error and processing biases in confidence judgment

Previous studies showed that random error can explain overconfidence effects typically observed in the literature. One of these studies concluded that, after accounting for random error effects in the data, there is little support for cognitive‐processing biases in confidence elicitation. In this paper, we investigate more closely the random error explanation for overconfidence. We generated data from four models of confidence and then estimated the magnitude of random error in the data. Our results show that, in addition to the true magnitude of random error specified in the simulations, the error estimates are influenced by important cognitive‐processing biases in the confidence elicitation process. We found that random error in the response process can account for the degree of overconfidence found in calibration studies, even when that overconfidence is actually caused by other factors. Thus, the error models say little about whether cognitive biases are present in the confidence elicitation process. Copyright © 2008 John Wiley & Sons, Ltd.     

Millon Clinical Multiaxial Inventory (MCMI) computer-generated diagnoses: How do they compare to clinician judgment?

During the past several decades, computers have achieved increasing prominence in psychological assessment procedures. This is particularly true for computer-based test interpretation and diagnosis. This study reports on a study designed to compare the accuracy of computer-based diagnoses with clinician-generated diagnoses. The Millon Clinical Multiaxial Inventory (MCMI) was administered to 151 consecutively admitted inpatients at a large private psychiatric hospital. The computer-generated diagnoses were compared with those generated by admitting psychiatrists. The results indicated that the MCMI diagnostic impressions underestimated the severity of depressive disorders when compared with clinician diagnoses on Axis I. Specifically, clinicians diagnosed major depression much more frequently than did the MCMI. In addition, clinicians diagnosed anxiety disorders much less frequently than did the MCMI.     

“均”与“寡”阶段性变动下中国居民公平感的变迁

利用中国综合社会调查和中国社会状况综合调查重复截面数据,通过年龄-时期-队列模型对居民公平感的时代变化进行分析。研究发现公平感在年龄上呈“J”型趋势;从时期效应看, 2008年公平感较高, 2010～2013年在低谷徘徊,2015年以后又开始回升;从队列视角看,建国前出生队列公平感偏低,建国后初期的队列相对较高,“50”后有所下滑,从“60”后开始公平感持续走低,到“80”后跌入低谷,但“90”后又开始升高。从1949年前后“寡且不均”到建国初期阶段的“寡且均”,再到改革开放40年快速经济增长下“不寡但不均”的社会变迁过程影响了居民的公平感。     

An evaluation of the reliability of probability judgments across response modes and over time

Despite the importance of probability assessment methods in behavioral decision theory and decision analysis, little attention has been directed at evaluating their reliability and validity. In fact, no comprehensive study of reliability has been undertaken. Since reliability is a necessary condition for validity, this oversight is significant. The present study was motivated by that oversight. We investigated the reliability of probability measures derived from three response modes: numerical probabilities, pie diagrams, and odds. Unlike previous studies, the experiment was designed to distinguish systematic deviations in probability judgments, such as those due to experience or practice, from random deviations. It was found that subjects assessed probabilities reliably for all three assessment methods regardless of the reliability measures employed. However, a small but statistically significant decrease over time in the magnitudes of assessed probabilities was observed. This effect was linked to a decrease in subjects overconfidence during the course of the experiment.     

A Third Principle of Justice

In this paper I argue that in order to secure the commitment of believers in reasonable comprehensive doctrines to political liberalism a third principle of justice needs to be adopted in the Original Position. Rawls acknowledges that neutral legislation by the liberal state may negatively affect some reasonable comprehensive doctrines, and I offer a third principle of justice to help alleviate this problem. This principle, which I believe is in keeping with the United States constitutional history especially where church-state relations are concerned, maintains that a constitutional regime should, insofar as possible, avoid adopting rules with harmful effects upon those comprehensive doctrines which satisfy the conditions of reasonable pluralism.     

Upward versus Downward Anchoring in Frequency Judgments of Social Facts

Frequency estimation of social facts in two methods of judgment elicitation was investigated. In the “narrow-range” condition, subjects answered questions in the format: “Out of 100 incidents, how many belong to category X?” In the “wide-range” condition, the frequency for the same event was assessed with respect to “Out of 10,000”. Judged frequencies in the wide-range condition were divided by 100, and were compared with the corresponding judgments in the narrow-range condition. Such comparisons were made for low-frequency and high-frequency events. Previous research has shown that, for low-frequency events, judged frequencies are proportionally greater in the narrow-range than in the wide-range condition. These results reflect cognitive processes of implicit anchoring, whereby judged frequencies lie close to small numbers within the response ranges provided. I call this process “downward anchoring,” and predicted that this tendency would be replicated in the present study. Moreover, I predicted that assessments about high-frequency events would evoke similar cognitive processes operating in the opposite direction. By such “upward anchoring,” judged frequencies would lie close to relatively larger numbers within the given response ranges. Consequently, I predicted that judged frequencies for high-frequency events would be proportionally greater in the wide-range condition than in the narrow-range condition. These predictions were confirmed.     

Reflections on segregating and assessing areas of competence

Various complexities that arise in the application of legal and/or clinical criteria to the actual assessment of competence/capacity are discussed, and a particular way of understanding the nature of such criteria is recommended.     

Calibration of sensory and cognitive judgments: A single model for both

In a recent issue of this journal, Winman and Juslin (34 , 135–148, 1993) present a model of the calibration of subjective probability judgments for sensory discrimination tasks. They claim that the model predicts a pervasive underconfidence bias observed in such tasks, and present evidence from a training experiment that they interpret as supporting the notion that different models are needed to describe judgment of confidence in sensory and in cognitive tasks. The model is actually part of the more comprehensive decision variable partition model of subjective probability calibration that was originally proposed in Ferrell and McGoey (Organizational Behavior and Human Performance, 26 , 32–53, 1980). The characteristics of the model are described and it is demonstrated that the model does not predict underconfidence, that it is fully compatible with the overconfidence frequently found in calibration studies with cognitive tasks, and that it well represents experimental results from such studies. It is concluded that only a single model is needed for both types of task.     

小学儿童奖赏公平性的认知发展

采用信息加工研究途径并假设故事情境探索小学儿童对奖赏公平性的社会认知发展,并将儿童的发展与成人作对比。研究结果表明,７,９岁儿童容易将＂均等＂与＂公平＂混淆,还没形成一个稳定的分配模式,而１２岁儿童已能运用＂努力＂、＂成果＂、＂能力＂等规则较为稳定地作出公平奖赏决定或评价,但还没达到对更高层次的社会准则的理解和掌握。儿童这一发展制约于他们的信息加工能力以及获得有关社会价值观的社会化过程。     

时序信息提取机制的探索

对时序信息加工的经典研究是采用新近性判断范型,结果发现其提取机制是以新近性为基础的逆向串行搜索过程。本研究采用新近性判断范型和早远性判断范型对时序信息的提取机制进行了深入的考察,结果表明：（ｌ）提取时序信息既存在逆向串行搜索,又存在顺向串行搜索;（２）早远性判断和新近性判断任务对不同部分时序信息恢复的效应不同,其中早远性判断易化早远部分,新近性判断易化新近部分──表现为对相应部分辨别力的提高和正确反应潜伏期的缩短;（３）在不同的时序信息提取任务中,被试会根据具体条件进行反转反应。