Feature sampling in detection: implications for the measurement of perceptual independence

The article presents the feature sampling signal detection (FS-SDT) model, an extension of the multivariate signal detection (SDT) model. The FS-SDT model assumes that, because of attentional shifts, different subsets of features are sampled for different presentations of the same multidimensional stimulus. Contrary to the SDT model, the FS-SDT model enables the estimation of pure perceptual effects that are uncontaminated by strategic attention shifts. The consideration of feature sampling in detection and identification opens a new perspective on the problem of measuring, respectively, the separability and integrality of stimulus dimensions. Disregarding feature sampling as a component process in detection and identification usually results in biased estimations of perceptual independence concepts relevant for judgments of whether stimulus dimensions are processed independently.     

Signal detection theory with finite mixture distributions: theoretical developments with applications to recognition memory

An extension of signal detection theory (SDT) that incorporates mixtures of the underlying distributions is presented. The mixtures can be motivated by the idea that a presentation of a signal shifts the location of an underlying distribution only if the observer is attending to the signal; otherwise, the distribution is not shifted or is only partially shifted. Thus, trials with a signal presentation consist of a mixture of 2 (or more) latent classes of trials. Mixture SDT provides a general theoretical framework that offers a new perspective on a number of findings. For example, mixture SDT offers an alternative to the unequal variance signal detection model; it can also account for nonlinear normal receiver operating characteristic curves, as found in recent research.     

Rater Model Using Signal Detection Theory for Latent Differential Rater Functioning

Differential rater functioning (DRF) occurs when raters show evidence of exercising differential severity or leniency when scoring examinees within different subgroups. Previous studies of DRF have examined rater bias using manifest variables (e.g., use of covariates) to determine the subgroups. These manifest variables include gender and the ethnicity of the examinee. For example, a rater may score males more severely. Ideally, each rater’s severity should be invariant across subgroups. This study examines DRF in the context of latent subgroups that classify possible sources of DRF based on raters’ scoring behavior rather than manifest factors. An extension of the latent class signal detection theory (LC-SDT) model for identifying DRF is proposed and examined using real-world data and simulations. Results from real-world data show that the signal detection approach leads to an effective method to identify latent DRF. Simulations with varying sample sizes and conditions of rater precision were shown to recover parameters at an adequate level, supporting its use to identify latent DRF in large-scale data. These findings suggest that the DRF extension of the LC-SDT can be a useful model to examine characteristics of raters and add information that can aid rater training.     

Models of recognition, repetition priming, and fluency: exploring a new framework

We present a new modeling framework for recognition memory and repetition priming based on signal detection theory. We use this framework to specify and test the predictions of 4 models: (a) a single-system (SS) model, in which one continuous memory signal drives recognition and priming; (b) a multiple-systems-1 (MS1) model, in which completely independent memory signals (such as explicit and implicit memory) drive recognition and priming; (c) a multiple-systems-2 (MS2) model, in which there are also 2 memory signals, but some degree of dependence is allowed between these 2 signals (and this model subsumes the SS and MS1 models as special cases); and (d) a dual-process signal detection (DPSD1) model, 1 possible extension of a dual-process theory of recognition (Yonelinas, 1994) to priming, in which a signal detection model is augmented by an independent recollection process. The predictions of the models are tested in a continuous-identification-with-recognition paradigm in both normal adults (Experiments 1-3) and amnesic individuals (using data from Conroy, Hopkins, & Squire, 2005). The SS model predicted numerous results in advance. These were not predicted by the MS1 model, though could be accommodated by the more flexible MS2 model. Importantly, measures of overall model fit favored the SS model over the others. These results illustrate a new, formal approach to testing theories of explicit and implicit memory.     

The latencies of correct and incorrect responses in discrimination and detection tasks: Their interpretation in terms of a model based on simple counting

A model for two-choice discrimination based on a process of simple counting is described, and two experiments are performed to test the predictions of the model concerning the graph of latency as a function of response proportion. Two main forms of this graph are identified and predicted to arise in different circumstances. The experimental results support the model, and its possible extension to other psychophysical situations, especially signal detection, are then discussed. It is compared with a model derived directly from the detection situation, and the usefulness of testing these models is pointed out.     

An application of signal detection theory with finite mixture distributions to source discrimination

A mixture extension of signal detection theory is applied to source discrimination. The basic idea of the approach is that only a portion of the sources (say A or B) of items to be discriminated is encoded or attended to during the study period. As a result, in addition to 2 underlying probability distributions associated with the 2 sources, there is a 3rd distribution that represents items for which sources were not attended to. Thus, over trials, the observed response results from a mixture of an attended (A or B) distribution and a nonattended distribution. The situation differs in an interesting way from detection in that, for detection, there is mixing only on signal trials and not on noise trials, whereas for discrimination, there is mixing on both A and B trials. Predictions of the mixture model are examined for data from several recent studies and in a new experiment.     

A Signal Detection Model for Multiple-Choice Exams

A model for multiple-choice exams is developed from a signal-detection perspective. A correct alternative in a multiple-choice exam can be viewed as being a signal embedded in noise (incorrect alternatives). Examinees are assumed to have perceptions of the plausibility of each alternative, and the decision process is to choose the most plausible alternative. It is also assumed that each examinee either knows or does not know each item. These assumptions together lead to a signal detection choice model for multiple-choice exams. The model can be viewed, statistically, as a mixture extension, with random mixing, of the traditional choice model, or similarly, as a grade-of-membership extension. A version of the model with extreme value distributions is developed, in which case the model simplifies to a mixture multinomial logit model with random mixing. The approach is shown to offer measures of item discrimination and difficulty, along with information about the relative plausibility of each of the alternatives. The model, parameters, and measures derived from the parameters are compared to those obtained with several commonly used item response theory models. An application of the model to an educational data set is presented.     

Detection and recognition of auditory patterns

The detection/recognition theorem (Starr, Metz, Lusted, & Goodenough, 1975) provides a signal detection theory prediction of an observer's ability to identify one of a set of possible signals on the basis of the observer's ability to detect whether any signal is presented. The present findings show that the theorem can be applied to complex auditory stimuli in a fashion that is not merely a trivial extension of the results obtained with simple auditory stimuli.     

On measuring the minimum detection time: A simple reaction time study in the time estimation paradigm

Kornblum's time estimation paradigm, together with the so‐called ‘race model’, provides an appealing alternative for measuring the ‘cut‐off’ which separates ‘true’ reaction times from anticipatory reaction times. However, the model is not precise enough to reveal the relation between the signal intensity and the ‘cut‐off’. Accordingly, Kornblum's model is extended with an emphasis on the measure of the ‘cut‐off’. Another aspect of the extension is to use a parametric method to analyse the data. In particular, it is assumed that the time estimation‐induced latency is gamma distributed and the signal‐induced latency is Weibull distributed, with the latter shifted by the ‘cut‐off’. The rationale behind the parametric assumption is discussed. For illustrative purposes, two pieces of experimental work are presented. Since the core of the race model is the assumption of an independent race between the time estimation process and the detection process, the first experiment tests whether, for the same signal intensity, the signal‐induced latency distribution is invariant across different time intervals; the second experiment tests whether, for the same time interval, the time estimation‐induced latency distribution is invariant across different signal intensity conditions. The data from the second experiment are also used to test various parametric assumptions in the model, which include the signal effect on the ‘cut‐off’. The new model fits the data well.     

A signal detection analysis of gist-based discrimination of genetic breast cancer risk

Pervasive biases in probability judgment render the probability scale a poor response mode for assessing risk judgments. By applying fuzzy trace theory, we used ordinal gist categories as a response mode, coupled with a signal detection model to assess risk judgments. The signal detection model is an extension of the familiar model used in binary choice paradigms. It provides three measures of discriminability—low versus medium risk, medium versus high risk, and low versus high risk—and two measures of response bias. We used the model to assess the effectiveness of BRCA Gist, an intelligent tutoring system designed to improve women’s judgments and understanding of genetic risk for breast cancer. Participants were randomly assigned to the BRCA Gist intelligent tutoring system, the National Cancer Institute (NCI) Web pages, or a control group, and then they rated cases that had been developed using the Pedigree Assessment Tool and also vetted by medical experts. BRCA Gist participants demonstrated increased discriminability for all three risk categories, relative to the control group; the NCI group showed increased discriminability for two of the three levels. This result suggests that BRCA Gist best improved discriminability among genetic risk categories, and both BRCA Gist and the NCI website improved participants’ ability to discriminate, rather than simply shifting their decision criterion. A spreadsheet that fits the model and compares parameters across the conditions can be downloaded from the Behavior Research Methods website and used in any research involving categorical responses.     

The Effect of Practice on Individual Differences when Studied with Measurements Weighted for Difficulty

Signal detection analysis of learning and conditioning data provides for a greater distinction to be made between learning and performance through the use of the two signal detection parameters, d' and B. The use of the two parameters permits alternative interpretation of several types of data sets discussed. This analytic technique may be used with either discrete trial or free-response data. The present article reviews applications of signal detection parameters in the literature, and provides for their extension to other uses.     

On the statistical and theoretical basis of signal detection theory and extensions: Unequal variance, random coefficient, and mixture models

Basic results for conditional means and variances, as well as distributional results, are used to clarify the similarities and differences between various extensions of signal detection theory (SDT). It is shown that a previously presented motivation for the unequal variance SDT model (varying strength) actually leads to a related, yet distinct, model. The distinction has implications for other extensions of SDT, such as models with criteria that vary over trials. It is shown that a mixture extension of SDT is also consistent with unequal variances, but provides a different interpretation of the results; mixture SDT also offers a way to unify results found across several types of studies.     

Impetus for a robust science of behavior: A review of Nevin's Behavioral Momentum: A scientific metaphor

Nevin provides a scientific role model, illustrating momentum in his own research and providing impetus through his effects on the scientific behavior of his students and his colleagues. I discuss his book in the context of a review of the history of the concept of extinction, I cite his introduction of signal‐detection analysis into behavior analysis as a contribution not covered in this book, I briefly consider applications, such as the potential extension to fluency procedures in education, and I critique his concept of momentum, relating it to other metaphors for maintained behavior such as the dynamics of sensory systems and robustness in biological accounts of the stability of phenotypes.     

Using the PLUM procedure of SPSS to fit unequal variance and generalized signal detection models

The recent addition of a procedure in SPSS for the analysis of ordinal regression models offers a simple means for researchers to fit the unequal variance normal signal detection model and other extended signal detection models. The present article shows how to implement the analysis and how to interpret the SPSS output. Examples of fitting the unequal variance normal model and other generalized signal detection models are given. The approach offers a convenient means for applying signal detection theory to a variety of research.     

A dynamic stimulus-driven model of signal detection

Signal detection theory forms the core of many current models of cognition, including memory, choice, and categorization. However, the classic signal detection model presumes the a priori existence of fixed stimulus representations--usually Gaussian distributions--even when the observer has no experience with the task. Furthermore, the classic signal detection model requires the observer to place a response criterion along the axis of stimulus strength, and without theoretical elaboration, this criterion is fixed and independent of the observer's experience. We present a dynamic, adaptive model that addresses these 2 long-standing issues. Our model describes how the stimulus representation can develop from a rough subjective prior and thereby explains changes in signal detection performance over time. The model structure also provides a basis for the signal detection decision that does not require the placement of a criterion along the axis of stimulus strength. We present simulations of the model to examine its behavior and several experiments that provide data to test the model. We also fit the model to recognition memory data and discuss the role that feedback plays in establishing stimulus representations.     

Process dissociation and mixture signal detection theory

The process dissociation procedure was developed in an attempt to separate different processes involved in memory tasks. The procedure naturally lends itself to a formulation within a class of mixture signal detection models. The dual process model is shown to be a special case. The mixture signal detection model is applied to data from a widely analyzed study. The results suggest that a process other than recollection may be involved in the process dissociation procedure.     

A signal detection theory analysis of an unconscious perception effect

The independent observation model (Macmillan & Creelman, 1991)is fitted to detection-identification data collected under conditions of heavy masking. The model accurately predicts a quantitative relationship between stimulus detection and stimulus identification over a wide range of detection performance. This model can also be used to offer a signal detection interpretation of the common finding of above-chance identification following a missed signal. While our finding is not a new one, the stimuli used in this experiment (redundant three-letter strings) differ slightly from those used in traditional signal detection work. Also, the stimuli were presented very briefly and heavily masked, conditions typical in the study of unconscious perception effects.     

A signal detection theory analysis of an unconscious perception effect.

The independent observation model (Macmillan & Creelman, 1991) is fitted to detection-identification data collected under conditions of heavy masking. The model accurately predicts a quantitative relationship between stimulus detection and stimulus identification over a wide range of detection performance. This model can also be used to offer a signal detection interpretation of the common finding of above-chance identification following a missed signal. While our finding is not a new one, the stimuli used in this experiment (redundant three-letter strings) differ slightly from those used in traditional signal detection work. Also, the stimuli were presented very briefly and heavily masked, conditions typical in the study of unconscious perception effects.     

Toward a complete decision model of item and source recognition: A discrete-state approach

In source-monitoring experiments, participants study items from two sources (A and B). At test, they are presented Source A items, Source B items, and new items. They are asked to decide whether a test item is old or new (item memory) and whether it is a Source A or a Source B item (source memory). Hautus, Macmillan, and Rotello (2008) developed models, couched in a bivariate signal detection framework, that account for item and source memory across several data sets collected in a confidence-rating response format. The present article enlarges the set of candidate models with a discrete-state model. The model is a straightforward extension of Bayen, Murnane, and Erdfelder's (1996) multinomial model of source discrimination to confidence ratings. On the basis of the evaluation criteria adopted by Hautus et al., it provides a better account of the data than do Hautus et al.'s models.