Indices of response bias in the same-different experiment

The same-different experiment is popular for assessing perceptual performance, including the performance of people with neuropsychological deficits. Although the measurement of accuracy with this experiment is now well understood, the measurement of response bias remains problematic. Reformulating the decision space for the experiment can yield new bias indices that are analogous to, but numerically different from, those of the more familiar yes-no experiment. Isobias curves that show how hit rate covaries with false alarm rate for constant bias but varying accuracy are presented for eight indices, and best-fitting parameters of the isobias functions are determined for a set of experimental data. The theoretical status of the bias indices and their relation to other formulations are reviewed.     

An assessment of response bias for thesame-different task: Implications for the single-interval task

Two auditory amplitude discrimination experiments were conducted using thesame-different experimental design. Observer bias was manipulated, in the first experiment, by varying payoff matrices and, in the second, by varying prior probabilities of signal presentation. Five levels of bias manipulation and four levels of difficulty were employed in each experiment. Each observer received all combinations of bias manipulation and difficulty, but with only one of these combinations within each block of trials. Nine indices of bias were assessed by simultaneously fitting isosensitivity and isobias functions to the data and by fitting isobias functions only. Although none of the indices tested provided an exceptionally good fit to the data, two indices stood out from the rest. These werec _sd ^* andc _i, indices with isobias contours similar in shape to those for thec index derived from theyes-no task.     

The role of the standard in an auditory amplitude discrimination experiment

The role of the standard in a fixed-standard experiment of auditory amplitude discrimination was examined by varying the proportion of trials on which it was presented. The results suggest that the Os may use different perceptual strategies, depending on the availability of the standard. While they did better on trials containing a standard regardless of the proportion of such trials, their accuracy on both “standard-present” and “standard-absent” trials was positively related to the probability of the particular type of trial. These results conflict with the claim of advocates of the roving-standard paradigm that the O in the fixed-standard experiment does not use the standard but, rather, compares the variable with a long-term referent built up over many trials. The introduction of a second pair of tones, making it a random-standard experiment,, produced considerable response bias tied to the stimulus level and to an overall deterioration in performance.     

Accuracy and Biases in Newlyweds' Perceptions of Each Other: Not Mutually Exclusive but Mutually Beneficial

ABSTRACT— There has been a long-standing debate about whether having accurate self-perceptions or holding positive illusions of self is more adaptive. This debate has recently expanded to consider the role of accuracy and bias of partner perceptions in romantic relationships. In the present study, we hypothesized that because accuracy, positivity bias, and similarity bias are likely to serve distinct functions in relationships, they should all make independent contributions to the prediction of marital satisfaction. In a sample of 288 newlywed couples, we tested this hypothesis by simultaneously modeling the actor effects and partner effects of accuracy, positivity bias, and similarity bias in predicting husbands' and wives' satisfaction. Findings across several perceptual domains suggest that all three perceptual indices independently predicted the perceiver's satisfaction. Accuracy and similarity bias, but not positivity bias, made unique contributions to the target's satisfaction. No sex differences were found.     

iPhysioMeter: A new approach for measuring heart rate and normalized pulse volume using only a smartphone

Heart rate (HR) and normalized pulse volume (NPV) are physiological indices that have been used in a diversity of psychological studies. However, measuring these indices often requires laborious processes. We therefore developed a new smartphone program, named iPhysioMeter, that makes it possible to measure beat-by-beat HR and ln NPV using only a smartphone. We examined its accuracy against conventional laboratory measures. Mental stress tasks were used to alter HR and ln NPV in 12 participants. Bland–Altman analyses revealed negligible proportional bias for HR and ln NPV or for their change values, expressed as ΔHR and Δln NPV. However, a relatively large fixed bias did emerge for ln NPV, as well as a small one for Δln NPV, although both were within the limits of agreement. These findings suggest that iPhysioMeter can yield valid measures of the absolute level of HR and of relative changes in ln NPV.     

An assessment of response bias for the same-different task: implications for the single-interval task

Two auditory amplitude discrimination experiments were conducted using the same-different experimental design. Observer bias was manipulated, in the first experiment, by varying payoff matrices and, in the second, by varying prior probabilities of signal presentation. Five levels of bias manipulation and four levels of difficulty were employed in each experiment. Each observer received all combinations of bias manipulation and difficulty, but with only one of these combinations within each block of trials. Nine indices of bias were assessed by simultaneously fitting isosensitivity and isobias functions to the data and by fitting isobias functions only. Although none of the indices tested provided an exceptionally good fit to the data, two indices stood out from the rest. These were c*sd and ci, indices with isobias contours similar in shape to those for the c index derived from the yes-no task.     

Discriminating between changes in bias and changes in accuracy for recognition memory of emotional stimuli

A debate has emerged as to whether recognition of emotional stimuli is more accurate or more biased than recognition of nonemotional stimuli. Teasing apart changes in accuracy versus changes in bias requires a measurement model. However, different models have been adopted by different researchers, and this has contributed to the current debate. In this article, different measurement models are discussed, and the signal detection model that is most appropriate for recognition is adopted to investigate the effects of valence and arousal on recognition memory performance, using receiver operating characteristic analyses. In addition, complementary two-alternative forced choice experiments were conducted in order to generalize the empirical findings and interpret them under a relatively relaxed set of measurement assumptions. Across all experiments, accuracy was greater for highly valenced stimuli and stimuli with high arousal value. In addition, a bias to endorse positively valenced stimuli was observed. These results are discussed within an adaptive memory framework that assumes that emotion plays an important role in the allocation of attentional resources.     

A reanalysis of Lord’s statistical treatment of football numbers

Stevens’ theory of admissible statistics [Stevens, S. S. (1946). On the theory of scales of measurement. Science, 103, 677680] states that measurement levels should guide the choice of statistical test, such that the truth value of statements based on a statistical analysis remains invariant under admissible transformations of the data. Lord [Lord, F. M. (1953). On the statistical treatment of football numbers. American Psychologist, 8, 750-751] challenged this theory. In a thought experiment, a parametric test is performed on football numbers (identifying players: a nominal representation) to decide whether a sample from the machine issuing these numbers should be considered non-random. This is an apparently illegal test, since its outcomes are not invariant under admissible transformations for the nominal measurement level. Nevertheless, it results in a sensible conclusion: the number-issuing machine was tampered with. In the ensuing measurement-statistics debate Lord’s contribution has been influential, but has also led to much confusion. The present aim is to show that the thought experiment contains a serious flaw. First it is shown that the implicit assumption that the numbers are nominal is false. This disqualifies Lord’s argument as a valid counterexample to Stevens’ dictum. Second, it is argued that the football numbers do not represent just the nominal property of non-identity of the players; they also represent the amount of bias in the machine. It is a question about this property-not a property that relates to the identity of the football players-that the statistical test is concerned with. Therefore, only this property is relevant to Lord’s argument. We argue that the level of bias in the machine, indicated by the population mean, conforms to a bisymmetric structure, which means that it lies on an interval scale. In this light, Lord’s thought experiment-interpreted by many as a problematic counterexample to Stevens’ theory of admissible statistics-conforms perfectly to Stevens’ dictum.     

Negative priming without reaction time: Effects on identification of masked letters

Responses to an object are often slower and/or less accurate if that object is related to a recently ignored object. Thisnegative priming effect has previously been examined only in reaction time tasks. In the present experiment, target letters and flanking distractor letters were displayed for 33, 100, or 300 msec, followed by a pattern mask. Subjects attempted to identify the target letters, with no demand for speed. Identification accuracy was reduced for targets that matched distractors presented on the immediately preceding trial. However, there was no bias against reporting preceding distractors on catch trials with no presented target. Implications for theories of negative priming are discussed.     

The effects of domain knowledge on metacomprehension accuracy

In the present research, we examined the relationship between readers’ domain knowledge and their ability to judge their comprehension of novel domain-related material. Participants with varying degrees of baseball knowledge read five texts on baseball-related topics and five texts on non-baseball-related topics, predicted their performance, and completed tests for each text. Baseball knowledge was positively related to absolute accuracy within the baseball domain but was unrelated to relative accuracy within the baseball domain. Also, the readers showed a general underconfidence bias, but the bias was less extreme for higher knowledge readers. The results challenge common assumptions that experts’ metacognitive judgments are less accurate than novices’. Results involving topic familiarity ratings and a no-reading control group suggest that higher knowledge readers are not more likely to ignore text-specific cues in favor of a domain familiarity heuristic, but they do appear to make more effective use of domain familiarity in predicting absolute performance levels.     

整合后验信息的多分属性认知诊断信效度指标

分类一致性和准确性是认知诊断评估中的重要指标,前者反映信度问题,后者反映效度问题。已有研究提出的指标均是基于二分属性,而多分属性的后验概率分布和属性边际概率分布均不同于二分属性,需要构建新指标来衡量多分属性情景下的信效度。本研究基于二分思想,构建出二元式信息指标用于计算多分属性测验中的信效度,并通过实验设计考察了新指标在多种影响因素中的表现,验证了新指标的有效性。最后,为多分属性诊断测验的编制提供了建议,并提出未来研究方向。     

“Where is the sun” for hemi-neglect patients?

Human observers use prior constraints to disambiguate a scene; in particular, light is preferentially seen as coming from above but also slightly from the left. One explanation of this lateral bias could be a cerebral hemispheric difference. The aim of the present study was to determine the preferred light source position for neglect patients. For this purpose, we used the ambiguous shaded “Polo Mint” stimulus, a ring divided into eight equal sectors. All sectors but one were the same shape, convex or concave, as determined by the light source position. Participants had to report the side (left or right) of the odd sector or, in a separate experiment, to report its shape (convex or concave). Eight patients with spatial neglect (left neglect N = 7, right neglect N = 1) after a right or left temporo-parietal or thalamic lesion and 14 control participants ran the experiment. Left neglect patients showed a significantly different light bias from the bias observed for controls and for the right neglect patient (i.e., a reduction of the left bias or a right bias rather than a left bias). We conclude that some disabilities presented by patients with spatial neglect may be due to difficulties processing information that is not present in the visual field or imagined in the representational scene.     

Perceptions of daily sacrifice motives: Accuracy,bias, outcomes,and moderators

The current study examined accuracy and bias in perceptions of a partner’s daily approach and avoidance sacrifice motives, associations of bias with daily sacrificer and perceiver relationship quality, and moderators of accuracy (gender, relationship length, daily stress). 94 cohabiting couples completed daily measures of sacrifice (N = 375 days), stress, relationship satisfaction, and closeness. People showed evidence of accuracy for partner sacrifice motives, but accuracy for approach sacrifice depended on relationship length. People underperceived partner sacrifice motives; underperception of approach sacrifice was associated with greater sacrificer closeness, while overperception of approach sacrifice and overperception of avoidance sacrifice was associated with greater perceiver closeness, although these effects were small. Gender and stress did not moderate tracking accuracy or mean-level bias.     

Adaptive working memory training reveals a negligible effect of emotional stimuli over cognitive processing

Here we analyze how performance differences in an adaptive cognitive training regime based on the n-back task interact with emotional stimuli (scenes and faces) varying in their valence (negative, positive, and neutral). One hundred and three participants completed four training sessions across 2 weeks showing remarkable improvements from time to time. Results revealed similar results for faces and scenes regarding accuracy levels across increased complexity levels. However, reaction times (RTs) were sensitive to emotional conditions to some extent. Observed faster RTs to negative faces (disgust) were consistent with the negativity bias phenomenon, but this effect vanished for the highest levels of processing complexity. It is suggested that emotional information contents fail to interact with cognition when there are no cognitive resources left after the primary task is addressed.     

Separating sensitivity from response bias: implications of comparisons of yes-no and forced-choice tests for models and measures of recognition memory

A fundamental challenge to psychological research is the measurement of cognitive processes uncontaminated by response strategies resulting from different testing procedures. Test-free estimates of ability are vital when comparing the performance of different groups or different conditions. The current study applied several sets of measurement models to both forced-choice and yes-no recognition memory tests and concluded that the traditional signal-detection model resulted in distorted estimates of accuracy. Two-factor models were necessary to separate memory sensitivity from response bias. These models indicated that (a) memory accuracy did not differ across the tests and (b) the tests relied on the same underlying memory processes. The results illustrate the pitfalls of using a single-component model to measure accuracy in tasks that reflect 2 or more underlying processes.     

Two experiments on the relation between psychoticism and response uncertainty in normal subjects

Previous studies have suggested that schizophrenics are affected by response uncertainty to a greater degree than normals or other psychiatric groups. Two studies examined whether a similar pattern of performance would be produced in normal Ss scoring high on questionnaire measures presumed to measure psychotic predisposition. The Psychoticism (P) scales from the EPQ and the unpublished PEN Inventory were employed; and response uncertainty was varied using a card-sorting procedure. In Experiment 1 males were more affected by increases in response uncertainty than females, but there was no difference between Ss scoring high and low on the P scales. Experiment 2 included a condition in which guide-cards were randomly reordered between trials. There was a highly significant tendency for Ss scoring high on the PEN P scale to be more affected by response uncertainty in this experiment. Again males were more influenced by uncertainty than females, but this was due largely to their performance under the condition where guide-cards were varied. Ss high on EPQ P also showed decremental performance under this condition. The data provided partial support for the validity of the P scales, particularly the PEN version of the scale, as indices of schizophrenic predisposition.     

Perfectionism and efficiency: Accuracy,response bias,and invested time in proof-reading performance

Investigating problem-solving performance, Ishida, H. (2005). College students’ perfectionism and task-strategy inefficience: Why their efforts go unrewarded? Japanese Journal of Social Psychology, 20, 208–215. Found high levels of perfectionism were associated with lower efficiency. Aiming to replicate and further explore this finding, the present study investigated how two dimensions of perfectionism (high standards, discrepancy between expectations and performance) predicted efficiency in proof-reading performance. N = 96 students completed a proof-reading task involving the detection of spelling, grammar, and format errors. When error-detection performance was subjected to signal detection analysis, high standards correlated positively with the number of incorrectly detected errors (false alarms). Moreover, when task-completion time was taken into account, high standards were negatively correlated with efficiency (accuracy/time). In comparison, discrepancy correlated negatively with the number of correctly detected errors (hits) and positively with a conservative response bias. The findings show that perfectionistic standards are associated with reduced efficiency demonstrating the importance of considering invested time, errors, and response bias when investigating the relationship between perfectionism and performance.     

Focus of attention and placebo utility

The effects of focus of attention and expected drug effects on reactions to a placebo were examined in two experiments. In the first experiment self-aware and non-self-aware subjects were given a placebo that was said to be either performance-facilitating or inhibiting and then they worked on a set of arithmetic problems. It was expected that the non-self-aware subjects, but not the self-aware subjects, would display a self-serving bias in their attributions regarding the effects of the placebo. Specifically, it was predicted that non-self-aware subjects would attribute more arousal to the performance-inhibiting drug than the performance-facilitating drug since such attributions would be more psychologically beneficial or “useful” in the sense that they would make actual performance on the task look more impressive. Consistent with these predictions, there was evidence of a self-serving bias in drug reactions only among the non-self-focused subjects. Those who were made self-aware did not respond differentially to the two types of drug information. Instead, they appeared to respond in line with their actual (aroused) internal states by attributing some arousal to both drugs. In the second experiment arousal was reduced by eliminating the task, and this time self-focused subjects again appeared to be more aware of their actual internal states, as they reported less reaction to the placebo, regardless of the effects ascribed to it. Two conclusions are drawn from these results: (a) perceived drug utility does effect placebo responsiveness, and (b) self-focused attention increases awareness of internal states, but not necessarily the causes of those states.