On the evaluation of one-sided evidence

We examine predictions and judgments of confidence based on one-sided evidence. Some subjects saw arguments for only one side of a legal dispute while other subjects (called ‘jurors’) saw arguments for both sides. Subjects predicted the number of jurors who favored the plaintiff in each case. Subjects who saw only one side made predictions that were biased in favor of that side. Furthermore, they were more confident but generally less accurate than subjects who saw both sides. The results indicate that people do not compensate sufficiently for missing information even when it is painfully obvious that the information available to them is incomplete. A simple manipulation that required subjects to evaluate the relative strength of the opponent's side greatly reduced the tendency to underweigh missing evidence.     

Image-size disparity reduces difference detection in face matching

Face matching is the act of deciding whether two facial images depict the same person or different people. The real-world face-matching task of checking photo IDs typically occurs under conditions of image-size disparity: A small picture is compared with a life-size face. We examined the effect of image-size disparity on face-matching accuracy. In three experiments, subjects were presented with pairs of equivalently or disparately sized images that depicted the same person or different people. Subjects made same/different judgments and, in two experiments, also reported confidence. Difference detection was significantly poorer given disparate (versus equivalent) image size. Confidence was significantly higher when responses were correct versus incorrect. These findings held whether viewing and decision time was unlimited or limited. Our results raise the practical concern that image-size disparity may undermine difference detection in ID checking, while also indicating that people have some insight into the accuracy of their face-matching judgments.     

Mechanisms of source confusion and discounting in short-term priming: 1. Effects of prime duration and prime recognition

Huber, Shriffrin, Lyle, and Ruys (2001) measured short-term repetition priming effects in perceptual identification with two-alternative forced-choice testing. There was a preference to choose repeated words following passive viewing of primes and a preference against choosing repeated words following active responding to primes. In this present study, we explored conditions of prime processing that produce this pattern of results. Experiment 1 revealed that increased prime duration under passive viewing instructions produces the active priming pattern. Experiment 2 assessed memory for primes: With poor recognition of primes, there was a strong preference for repeated words; however, with good recognition of primes, this preference was eliminated. These results are modeled by a computational theory of optimal decision making, responding optimally with unknown sources of evidence (ROUSE). In ROUSE, a preference for repeated words results from source confusion between primes and choice words. A reversal in the direction of preference arises from the discounting of words known to have also appeared as primes.     

Mechanisms of source confusion and discounting in short-term priming 2: effects of prime similarity and target duration

D. E. Huber, R. M. Shiffrin, K. B. Lyle, and K. I. Ruys (2001) tested two-alternative, forced-choice (2-AFC) perceptual identification in a short-term priming task. For repetition priming, passive viewing of primes resulted in a preference to choose repeated words, but actively responding to primes resulted in a preference against choosing repeated words. These results were explained with a computational model, responding optimally with unknown sources of evidence (ROUSE), using the offsetting mechanisms of source confusion and discounting. An analysis of ROUSE revealed conditions under which discounting efficacy should diminish, causing a preference for primed words even with active prime processing. Two new studies confirm 2 such conditions: very short target flash durations and very low similarity between primes and primed choice words. These a priori predictions contrast with the a posteriori data fits of a multinomial model developed by R. Ratcliff and G. McKoon (2001).     

Who is exaggerating cognitive impairment and who is not?

This chart review examined the effects of effort on neuropsychological assessment and test performance patterns among genuine and exaggerating patients, with and without neurological findings, as aids to diagnosing symptom exaggeration. The sample consisted of 561 consecutive patients involved in compensation claims. With a flexible neuropsychological test (NPT) battery, the claims were assessed over 2 days. The sample included 303 patients evaluated for traumatic brain injury, 55 patients with neurological disease, and 203 patients assessed for other conditions (eg, depression or chronic pain). An average of 38 ability measures per patient were used to generate an overall NPT domain score. Composite scores were also computed for symptom validity tests, self-report measures of psychiatric symptoms, and memory complaint inventory. Seven NPT cognitive subdomain scores were multiply regressed onto the symptom validity test composite, accounting for 45% of its total variance. Patients were also assigned to Genuine or Exaggerator groups based on symptom validity test performance. The NPT for Exaggerating patients averaged 1.43 standard deviations below that of Genuine patients, suggesting that NPT scores for most Exaggerating patients are underestimates of their true ability. Factor analysis results differed between these groups. As a result, clinicians might avoid falsely identifying genuine patients as exaggerating by incorporating their self-reports of psychiatric symptoms and memory complaints into the diagnostic process.     

The validity of the successive intervals method of psychometric scaling

The degree to which scale values computed by the method of successive intervals diverge from theoretically true values is seen to be due to three types of error: error due to inequalities in variances of the distributions from which the scale values are computed, error due to non-normality of the distributions, and sampling error. The contribution of each type of error to the total error is evaluated; the latter is seen to be surprisingly small under appropriate conditions. Certain aspects of the formal methodology underlying scaling procedures are also briefly considered.This paper reports research undertaken in cooperation with the Quartermaster Food and Container Institute for the Armed Forces, and has been assigned number 475 in the series of papers approved for publication. The views or conclusions contained in this report are those of the authors. They are not to be construed as necessarily reflecting the views or indorsement of the Department of Defense.     

Effects of prolonged work on data entry speed and accuracy

In 2 experiments, participants used a keyboard to enter 4-digit numbers presented on a computer monitor under conditions promoting fatigue. In Experiment 1, accuracy of data entry declined but response times improved over time, reflecting an increasing speed-accuracy trade-off. In Experiment 2, the (largely cognitive) time to enter the initial digit decreased in the 1st half but increased in the 2nd half of the session. Accuracy and time to enter the remaining digits decreased across though not within session halves. The (largely motoric) time to press a concluding keystroke decreased over the session. Thus, through a combination of facilitation and inhibition, prolonged work affects the component cognitive and motoric processes of data entry differentially and at different points in practice.     

Strategy shifts in classification skill acquisition: Does memory retrieval dominate rule use?

In two experiments, we demonstrated two types of strategies (rule-based and memory-based) and strategy transitions within the same binary classification task. The strategy that dominated later in practice depended on the difficulty of the operative classification rule and on the salience of the cue for that rule. Accuracy increased over practice trials, and response times were faster for the dominant strategy, either rule or memory. Rule retention was superior to stimulus item retention, so that, even for participants who preferred a memory-based strategy, a rule-based strategy dominated at least temporarily after a 1-week interval. Strategy use over trials and the retention interval reflected a given task's affordance of a shift between rule- and memory-based processes.     

The effectiveness of creativity training: A quantitative review

Over the course of the last half century, numerous training programs intended to develop creativity capacities have been proposed. In this study, a quantitative meta‐analysis of program evaluation efforts was conducted. Based on 70 prior studies, it was found that well‐designed creativity training programs typically induce gains in performance with these effects generalizing across criteria, settings, and target populations. Moreover, these effects held when internal validity considerations were taken into account. An examination of the factors contributing to the relative effectiveness of these training programs indicated that more successful programs were likely to focus on development of cognitive skills and the heuristics involved in skill application, using realistic exercises appropriate to the domain at hand. The implications of these observations for the development of creativity through educational and training interventions are discussed along with directions for future research.