Indices of response bias in the same-different experiment

Thesame-different experiment is popular for assessing perceptual performance, including the performance of people with neuropsychological deficits. Although the measurement of accuracy with this experiment is now well understood, the measurement of response bias remains problematic. Reformulating the decision space for the experiment can yield new bias indices that are analogous to, but numerically different from, those of the more familiar yesno experiment. Isobias curves that show how hit rate covaries with false alarm rate for constant bias but varying accuracy are presented for eight indices, and best-fitting parameters of the isobias functions are determined for a set of experimental data. The theoretical status of the bias indices and their relation to other formulations are reviewed.     

An assessment of response bias for the same-different task: implications for the single-interval task

Two auditory amplitude discrimination experiments were conducted using the same-different experimental design. Observer bias was manipulated, in the first experiment, by varying payoff matrices and, in the second, by varying prior probabilities of signal presentation. Five levels of bias manipulation and four levels of difficulty were employed in each experiment. Each observer received all combinations of bias manipulation and difficulty, but with only one of these combinations within each block of trials. Nine indices of bias were assessed by simultaneously fitting isosensitivity and isobias functions to the data and by fitting isobias functions only. Although none of the indices tested provided an exceptionally good fit to the data, two indices stood out from the rest. These were c*sd and ci, indices with isobias contours similar in shape to those for the c index derived from the yes-no task.     

Accuracy and Biases in Newlyweds' Perceptions of Each Other: Not Mutually Exclusive but Mutually Beneficial

ABSTRACT— There has been a long-standing debate about whether having accurate self-perceptions or holding positive illusions of self is more adaptive. This debate has recently expanded to consider the role of accuracy and bias of partner perceptions in romantic relationships. In the present study, we hypothesized that because accuracy, positivity bias, and similarity bias are likely to serve distinct functions in relationships, they should all make independent contributions to the prediction of marital satisfaction. In a sample of 288 newlywed couples, we tested this hypothesis by simultaneously modeling the actor effects and partner effects of accuracy, positivity bias, and similarity bias in predicting husbands' and wives' satisfaction. Findings across several perceptual domains suggest that all three perceptual indices independently predicted the perceiver's satisfaction. Accuracy and similarity bias, but not positivity bias, made unique contributions to the target's satisfaction. No sex differences were found.     

Discriminating between changes in bias and changes in accuracy for recognition memory of emotional stimuli

A debate has emerged as to whether recognition of emotional stimuli is more accurate or more biased than recognition of nonemotional stimuli. Teasing apart changes in accuracy versus changes in bias requires a measurement model. However, different models have been adopted by different researchers, and this has contributed to the current debate. In this article, different measurement models are discussed, and the signal detection model that is most appropriate for recognition is adopted to investigate the effects of valence and arousal on recognition memory performance, using receiver operating characteristic analyses. In addition, complementary two-alternative forced choice experiments were conducted in order to generalize the empirical findings and interpret them under a relatively relaxed set of measurement assumptions. Across all experiments, accuracy was greater for highly valenced stimuli and stimuli with high arousal value. In addition, a bias to endorse positively valenced stimuli was observed. These results are discussed within an adaptive memory framework that assumes that emotion plays an important role in the allocation of attentional resources.     

逻辑训练对不同理性思维方式大学生三段论推理的影响

采用理性—经验思维方式量表对105名大学生进行测量,选出高、低理性思维方式各35名大学生进行实验,探讨了逻辑训练对不同理性思维方式大学生三段论推理的影响。结果表明：(1)高理性思维方式个体三段论推理的平均反应时快于低理性思维方式个体;非冲突类型题目推理的平均正确率高于冲突类型题目;逻辑训练可以提高个体三段论推理的平均反应时和正确率;(2)逻辑训练后非冲突任务类型题目的平均正确率高于冲突任务类型题目;(3)逻辑训练对低理性思维方式个体冲突任务类型题目平均正确率的提高效果更明显。这意味着逻辑训练可以显著提升个体的推理成绩,但不能完全消除信念偏差对推理的影响,而且逻辑训练对低理性思维方式个体推理成绩的提升效果更加明显。     

整合后验信息的多分属性认知诊断信效度指标

分类一致性和准确性是认知诊断评估中的重要指标,前者反映信度问题,后者反映效度问题。已有研究提出的指标均是基于二分属性,而多分属性的后验概率分布和属性边际概率分布均不同于二分属性,需要构建新指标来衡量多分属性情景下的信效度。本研究基于二分思想,构建出二元式信息指标用于计算多分属性测验中的信效度,并通过实验设计考察了新指标在多种影响因素中的表现,验证了新指标的有效性。最后,为多分属性诊断测验的编制提供了建议,并提出未来研究方向。     

Acquisition of decision making criteria: reward rate ultimately beats accuracy

Speed-accuracy trade-offs strongly influence the rate of reward that can be earned in many decision-making tasks. Previous reports suggest that human participants often adopt suboptimal speed-accuracy trade-offs in single session, two-alternative forced-choice tasks. We investigated whether humans acquired optimal speed-accuracy trade-offs when extensively trained with multiple signal qualities. When performance was characterized in terms of decision time and accuracy, our participants eventually performed nearly optimally in the case of higher signal qualities. Rather than adopting decision criteria that were individually optimal for each signal quality, participants adopted a single threshold that was nearly optimal for most signal qualities. However, setting a single threshold for different coherence conditions resulted in only negligible decrements in the maximum possible reward rate. Finally, we tested two hypotheses regarding the possible sources of suboptimal performance: (1) favoring accuracy over reward rate and (2) misestimating the reward rate due to timing uncertainty. Our findings provide support for both hypotheses, but also for the hypothesis that participants can learn to approach optimality. We find specifically that an accuracy bias dominates early performance, but diminishes greatly with practice. The residual discrepancy between optimal and observed performance can be explained by an adaptive response to uncertainty in time estimation.     

Separating sensitivity from response bias: implications of comparisons of yes-no and forced-choice tests for models and measures of recognition memory

A fundamental challenge to psychological research is the measurement of cognitive processes uncontaminated by response strategies resulting from different testing procedures. Test-free estimates of ability are vital when comparing the performance of different groups or different conditions. The current study applied several sets of measurement models to both forced-choice and yes-no recognition memory tests and concluded that the traditional signal-detection model resulted in distorted estimates of accuracy. Two-factor models were necessary to separate memory sensitivity from response bias. These models indicated that (a) memory accuracy did not differ across the tests and (b) the tests relied on the same underlying memory processes. The results illustrate the pitfalls of using a single-component model to measure accuracy in tasks that reflect 2 or more underlying processes.     

An assessment of response bias for thesame-different task: Implications for the single-interval task

Two auditory amplitude discrimination experiments were conducted using thesame-different experimental design. Observer bias was manipulated, in the first experiment, by varying payoff matrices and, in the second, by varying prior probabilities of signal presentation. Five levels of bias manipulation and four levels of difficulty were employed in each experiment. Each observer received all combinations of bias manipulation and difficulty, but with only one of these combinations within each block of trials. Nine indices of bias were assessed by simultaneously fitting isosensitivity and isobias functions to the data and by fitting isobias functions only. Although none of the indices tested provided an exceptionally good fit to the data, two indices stood out from the rest. These werec _sd ^* andc _i, indices with isobias contours similar in shape to those for thec index derived from theyes-no task.     

Examining mental health literacy and its correlates using the overclaiming technique

The present study examined mental health literacy among the British general public using the overclaiming technique, where participants rate for familiarity a series of items, some of which are foils resembling real items. In total, 344 Britons rated for familiarity 30 mental health disorders, of which six were foils, and also completed measures of the Big Five personality factors, self-rated intelligence, self-reported knowledge of psychiatry, psychiatric skepticism, and their personal details. Using signal detection analysis, responses on the overclaiming measure were used to compute an accuracy index (accuracy in distinguishing real mental health disorders from foils) and a response bias (the tendency to response affirmatively to both real disorders and foils). Preliminary analysis showed that there were no significant sex differences on either the accuracy or response bias indices. Further analyses showed that greater accuracy was significantly predicted by higher self-rated intelligence, greater knowledge of psychiatry, and lower psychiatric skepticism. These results are discussed in terms of the benefits of using the overclaiming technique and signal detection analysis in the study of mental health literacy.     

The truth and bias model of judgment

We present a new model for the general study of how the truth and biases affect human judgment. In the truth and bias model, judgments about the world are pulled by 2 primary forces, the truth force and the bias force, and these 2 forces are interrelated. The truth and bias model differentiates force and value, where the force is the strength of the attraction and the value is the location toward which the judgment is attracted. The model also makes a formal theoretical distinction between bias and moderator variables. Two major classes of biases are discussed: biases that are measured with variables (e.g., assumed similarity) and directional bias, which refers to the extent to which judgments are pulled toward 1 end of the judgment continuum. Moderator variables are conceptualized as variables that affect the accuracy and bias forces but that do not affect judgments directly. We illustrate the model with 4 examples. We discuss the theoretical, empirical, methodological, measurement, and design implications of the model.     

考试评分缺失数据的概化理论分析

考试评分缺失数据较为常见,如何有效利用现有数据进行统计分析是个关键性问题。在考试评分中,题目与评分者对试卷得分的影响不容忽视。根据概化理论原理,按考试评分规则推导出含有缺失数据双侧面交叉设计（p×i×r）方差分量估计公式,用Matlab7.0软件模拟多组缺失数据,验证此公式的有效性。结果发现：（1）推导出的公式较为可靠,估计缺失数据的方差分量偏差相对较小,即便数据缺失率达到50％以上,公式仍能对方差分量进行较为准确地估计;（2）题目数量对概化理论缺失数据方差分量的估计影响最大,评分者次之,当题目和评价者数量分别为6和5时,公式能够趋于稳定地估计;（3）学生数量对各方差分量的估计影响较小,无论是小规模考试还是大规模考试,概化理论估计缺失数据的多个方差分量结果相差不大。     

定长CD-CAT中两种新的题目曝光控制方法

提出了两种适用于定长CD-CAT的题目曝光控制方法（HIRP、HIRT）,这些方法在保证较高分类准确率的同时还有较合理的题目曝光率,新方法由二分化方法和RP及RT方法进行结合并适当调整而得到。模拟研究比较了其与RP、RT、SM、SMIE、RHA和SDBS的表现,结果表明: （1）HIRP的分类准确率和题目曝光率均好于SM、SMIE和SDBS;（2）HIRT的题目曝光率较RP、SM、SMIE、RHA和SDBS稍差,但分类准确率更高;（3）HIRP的分类准确率低于RT和RP,但题目曝光控制要更好。     

iPhysioMeter: A new approach for measuring heart rate and normalized pulse volume using only a smartphone

Heart rate (HR) and normalized pulse volume (NPV) are physiological indices that have been used in a diversity of psychological studies. However, measuring these indices often requires laborious processes. We therefore developed a new smartphone program, named iPhysioMeter, that makes it possible to measure beat-by-beat HR and ln NPV using only a smartphone. We examined its accuracy against conventional laboratory measures. Mental stress tasks were used to alter HR and ln NPV in 12 participants. Bland–Altman analyses revealed negligible proportional bias for HR and ln NPV or for their change values, expressed as ΔHR and Δln NPV. However, a relatively large fixed bias did emerge for ln NPV, as well as a small one for Δln NPV, although both were within the limits of agreement. These findings suggest that iPhysioMeter can yield valid measures of the absolute level of HR and of relative changes in ln NPV.     

Accuracy and bias in the perception of the partner in a close relationship

Partners in close relationships can be both accurate and biased in their perceptions of each other. Moreover, sometimes a bias can lead to accuracy. The authors describe a paradigm for the simultaneous measurement of accuracy and bias in 2-person relationships. One prevalent bias in close relationships is assumed similarity: Does the person think that his or her partner sees the world as he or she does? In a study of 238 dating and married heterosexual couples, the authors found evidence for both bias and accuracy: the bias effects were considerably stronger, especially when the measure was linked to the relationship. They found little or no evidence for gender differences in accuracy and bias.     

The effects of domain knowledge on metacomprehension accuracy

In the present research, we examined the relationship between readers’ domain knowledge and their ability to judge their comprehension of novel domain-related material. Participants with varying degrees of baseball knowledge read five texts on baseball-related topics and five texts on non-baseball-related topics, predicted their performance, and completed tests for each text. Baseball knowledge was positively related to absolute accuracy within the baseball domain but was unrelated to relative accuracy within the baseball domain. Also, the readers showed a general underconfidence bias, but the bias was less extreme for higher knowledge readers. The results challenge common assumptions that experts’ metacognitive judgments are less accurate than novices’. Results involving topic familiarity ratings and a no-reading control group suggest that higher knowledge readers are not more likely to ignore text-specific cues in favor of a domain familiarity heuristic, but they do appear to make more effective use of domain familiarity in predicting absolute performance levels.     

Pragmatics of measuring recognition memory: applications to dementia and amnesia

This article has two purposes. The first is to describe four theoretical models of yes-no recognition memory and present their associated measures of discrimination and response bias. These models are then applied to a set of data from normal subjects to determine which pairs of discrimination and bias indices show independence between discrimination and bias. The following models demonstrated independence: a two-high-threshold model, a signal detection model with normal distributions using d' and C (rather than beta), and a signal detection model with logistic distributions and a bias measure analogous to C. C is defined as the distance of criterion from the intersection of the two underlying distributions. The second purpose is to use the indices from the acceptable models to characterize recognition memory deficits in dementia and amnesia. Young normal subjects, Alzheimer's disease patients, and parkinsonian dementia patients were tested with picture recognition tasks with repeated study-test trials. Huntington's disease patients, mixed etiology amnesics, and age-matched normals were tested by Butters, Wolfe, Martone, Granholm, and Cermak (1985) using the same paradigm with word stimuli. Demented and amnesic patients produced distinctly different patterns of abnormal memory performance. Both groups of demented patients showed poor discrimination and abnormally liberal response bias for words (Huntington's disease) and pictures (Alzheimer's disease and parkinsonian dementia), whereas the amnesic patients showed the worst discrimination but normal response bias for words. Although both signal detection theory and two-high-threshold discrimination parameters showed identical results, the bias measure from the two-high-threshold model was more sensitive to change than the bias measure (C) from signal detection theory. Three major points are emphasized. First, any index of recognition memory performance assumes an underlying model. Second, even acceptable models can lead to different conclusions about patterns of learning and forgetting. Third, efforts to characterize and ameliorate abnormal memory should address both discrimination and bias deficits.     

An automated eye movement laboratory for on-line electrooculography

This paper describes an automated eye movement laboratory that uses electrooculography (EOG) to study people’s eye movements while they read. An on-line minicomputer processes bioelectric potentials that correspond to saccadic eye movements. Horizontal saccades larger than 1.5 deg of visual angle are detected and analyzed in real-time as they occur. The laboratory is designed for prolonged yet unobtrusive observation of human eye movements during sustained reading periods of minutes or hours. All important functions regarding data collection and data reduction are performed automatically, according to simple procedures that can be applied uniformly and without bias to nearly all subjects that we study. Results from three experiments are cited in order to quantify the performance of the laboratory with respect to four criteria: saccade detection accuracy, measurement accuracy, sensitivity, and the uniformity of these measures over different subjects.     

No special K! A signal detection framework for the strategic regulation of memory accuracy

Two experiments investigated criterion setting and metacognitive processes underlying the strategic regulation of accuracy on the Scholastic Aptitude Test (SAT) using Type-2 signal detection theory (SDT). In Experiment 1, report bias was manipulated by penalizing participants either 0.25 (low incentive) or 4 (high incentive) points for each error. Best guesses to unanswered items were obtained so that Type-2 signal detection indices of discrimination and bias could be calculated. The same incentive manipulation was used in Experiment 2, only the test was computerized, confidence ratings were taken so that receiver operating characteristic (ROC) curves could be generated, and feedback was manipulated. The results of both experiments demonstrated that SDT provides a viable alternative to A. Koriat and M. Goldsmith's (1996c) framework of monitoring and control and reveals information about the regulation of accuracy that their framework does not. For example, ROC analysis indicated that the threshold model implied by formula scoring is inadequate. Instead, performance on the SAT should be modeled with an equal-variance Gaussian, Type-2 signal detection model.