Separating perceptual processes from decisional processes in identification and categorization.

Four observers completed perceptual matching, identification, and categorization tasks using separable-dimension stimuli. A unified quantitative approach relating perceptual matching, identification, and categorization was proposed and tested. The approach derives from general recognition theory (Ashby & Townsend, 1986) and provides a powerful method for quantifying the separate influences of perceptual processes and decisional processes within and across tasks. Good accounts of the identification data were obtained from an initial perceptual representation derived from perceptual matching. The same perceptual representation provided a good account of the categorization data, except when selective attention to one stimulus dimension was required. Selective attention altered the perceptual representation by decreasing the perceptual variance along the attended dimension. These findings suggest that a complete understanding of identification and categorization performance requires an understanding of perceptual and decisional processes. Implications for other psychological tasks are discussed.     

Separating perceptual and decisional attention processes in the identification and categorization of integral-dimension stimuli

Four observers performed matching, identification, and categorization with stimuli that varied along the integral dimensions: brightness and saturation. General recognition theory (F. G. Ashby & J. T. Townsend, 1986) was applied to quantify the separate influences of perceptual and decisional processes within and across tasks, with a focus on separating perceptual from decisional attention processes. Good accounts of the identification data were obtained from perceptual matching representation. This perceptual representation provided a good account of the categorization data, except when decisional selective attention to 1 stimulus dimension was required. Decisional selective attention reduced the attended-dimension perceptual variance relative to the unattended-dimension perceptual variance, with a larger reduction resulting when brightness, as opposed to saturation was attended. Implications for color vision research are discussed.     

On the relation between decision rules and perceptual representation in multidimensional perceptual categorization

This article examines the relation between changing categorization decision rules and the nature of the underlying perceptual representation. Observers completed a matching task that required them to adjust the length and orientation of a single line stimulus until they perceived it to "match" a second line stimulus (Alfonso-Reese, 1996, 1997). The same observers then completed four categorization tasks with the same stimuli. Data from the matching task were used to estimate a perceptual representation for each stimulus and observer. Three hypotheses regarding potential interactions between categorization decision rules and perceptual representation were examined. One assumed that there was no interaction between decision rules and perceptual representation. The second assumed that linear categorization rules affect the perceptual representation differently from nonlinear categorization rules. The third assumed that dimensional integration rules affected the perceptual representation differently from decision rules that require the observer to set a criterion along one stimulus dimension while ignoring the other; this is referred to as decisional selective attention. The results suggested that (1) the matching task perceptual representation provided a good account of the categorization data, (2) decisional selective attention affected the perceptual representation differently from decisional integration, and (3) decisional selective attention generally decreased the perceptual variability along the attended dimension.     

Learning and attention in multidimensional identification and categorization: separating low-level perceptual processes and high-level decisional processes

Four observers completed identification and categorization tasks. Learning and attention processes were examined by applying general recognition theory (F. G. Ashby & J. T. Townsend, 1986), which separates perceptual, decisional, and attentional processes. Learning led to decision regions that became more nearly optimal. Learning had little effect on perceptual processes in identification and decisional integration categorization tasks but affected perceptual processes in decisional selective attention categorization tasks, leading to perceptual selective attention. These findings suggest that (a) identification and categorization invoke decision strategies that are localized in the striatum (F. G. Ashby, E. M. Waldron, W. W. Lee, & A. Berkman, 2001) and (b) perceptual and decisional attention systems exist and are mediated by distinct brain structures (M. I. Posner & S. E. Petersen, 1990).     

Multiple attention systems in perceptual categorization

Five observers categorized inverted L-shaped stimuli according to the length of the horizontal line segment. A centrally located spatial cue preceded the stimulus on each trial. On 80% of the trials, the (relevant) horizontal line segment fell within the cued location, and on 20% of the trials the (irrelevant) vertical line segment fell within the cued location. The empirical results provide support for the hypothesis that perceptual attention can focus on the stimulus attribute inside the spatially cued location at the same time that decisional attention is focused on the (relevant) horizontal attribute--that is, the results suggest that perceptual and decisional attention can function independently during categorization. Decision bound models and extended generalized context models that assume separate perceptual and decisional attention systems were fitted to the data. Versions of the models that assume that the spatial cue affected perceptual attention were superior to versions that assume no effect on perceptual attention. These theoretical analyses support the functional independence hypothesis and suggest that formal theories of categorization should model the effects of perceptual and decisional attention separately.     

Attention, similarity, and the identification-categorization relationship

A unified quantitative approach to modeling subjects' identification and categorization of multidimensional perceptual stimuli is proposed and tested. Two subjects identified and categorized the same set of perceptually confusable stimuli varying on separable dimensions. The identification data were modeled using Shepard's (1957) multidimensional scaling-choice framework. This framework was then extended to model the subjects' categorization performance. The categorization model, which generalizes the context theory of classification developed by Medin and Schaffer (1978), assumes that subjects store category exemplars in memory. Classification decisions are based on the similarity of stimuli to the stored exemplars. It is assumed that the same multidimensional perceptual representation underlies performance in both the identification and categorization paradigms. However, because of the influence of selective attention, similarity relationships change systematically across the two paradigms. Some support was gained for the hypothesis that subjects distribute attention among component dimensions so as to optimize categorization performance. Evidence was also obtained that subjects may have augmented their category representations with inferred exemplars. Implications of the results for theories of multidimensional scaling and categorization are discussed.     

Predicting similarity and categorization from identification.

In this article, the relation between the identification, similarity judgment, and categorization of multidimensional perceptual stimuli is studied. The theoretical analysis focused on general recognition theory (GRT), which is a multidimensional generalization of signal detection theory. In one application, 2 Ss first identified a set of confusable stimuli and then made judgments of their pairwise similarity. The second application was to Nosofsky's (1985b, 1986) identification-categorization experiment. In both applications, a GRT model accounted for the identification data better than Luce's (1963) biased-choice model. The identification results were then used to predict performance in the similarity judgment and categorization conditions. The GRT identification model accurately predicted the similarity judgments under the assumption that Ss allocated attention to the 2 stimulus dimensions differently in the 2 tasks. The categorization data were predicted successfully without appealing to the notion of selective attention. Instead, a simpler GRT model that emphasized the different decision rules used in identification and categorization was adequate.     

The prioritization of perceptual processing in categorization

In three experiments, the effects of selective attention on perceptual processes in a complex multidimensional object categorization task were investigated. In each experiment, participants completed a perceptual-matching task to gain estimates of the perceptual salience of each stimulus dimension, then a categorization task using the same stimuli. In Experiments 1 and 2, the perceptual processing of stimulus dimensions was faster when dimensions were more diagnostic of category membership, regardless of their perceptual salience. Experiment 3 demonstrated that this prioritization of perceptual processing was evident even when stimuli were presented in unpredictable locations during categorization, indicating that the physical characteristics of the stimulus guide selective attention to diagnostic stimulus dimensions.     

Recency effects as a window to generalization: separating decisional and perceptual sequential effects in category learning

Accounts of learning and generalization typically focus on factors related to lasting changes in representation (i.e., long-term memory). The authors present evidence that shorter term effects also play a critical role in determining performance and that these recency effects can be subdivided into perceptual and decisional components. Experimental results based on a probabilistic category structure show that the previous stimulus exerts a contrastive effect on the current percept (perceptual recency) and that responses are biased toward or away from the previous feedback, depending on the similarity between successive stimuli (decisional recency). A method for assessing these recency effects is presented that clarifies open questions regarding stimulus generalization and perceptual contrast effects in categorization and in other domains.     

Process-based account for the effects of perceptual attention and executive attention on fluid intelligence: An integrative approach

Perceptual attention and executive attention represent two higher-order types of attention and associate with distinctly different ways of information processing. It is hypothesized that these two types of attention implicate different cognitive processes, which are assumed to account for the differential effects of perceptual attention and executive attention on fluid intelligence. Specifically, an encoding process is assumed to be crucial in completing the tasks of perceptual attention while two executive processes, updating and shifting, are stimulated in completing the tasks of executive attention. The proposed hypothesis was tested by means of an integrative approach combining experimental manipulations and psychometric modeling. In a sample of 210 participants the encoding process has proven indispensable in completing the tasks of perceptual attention, and this process accounted for a considerable part of fluid intelligence that was assessed by two figural reasoning tests. In contrast, the two executive processes, updating and shifting, turned out to be necessary in performance according to the tasks of executive attention and these processes accounted for a larger part of the variance in fluid intelligence than that of the processes underlying perceptual attention.     

Decisional separability, model identification, and statistical inference in the general recognition theory framework

Recent work in the general recognition theory (GRT) framework indicates that there are serious problems with some of the inferential machinery designed to detect perceptual and decisional interactions in multidimensional identification and categorization (Mack, Richler, Gauthier, & Palmeri, 2011). These problems are more extensive than previously recognized, as we show through new analytic and simulation-based results indicating that failure of decisional separability is not identifiable in the Gaussian GRT model with either of two common response selection models. We also describe previously unnoticed formal implicational relationships between seemingly distinct tests of perceptual and decisional interactions. Augmenting these formal results with further simulations, we show that tests based on marginal signal detection parameters produce unacceptably high rates of incorrect statistical significance. We conclude by discussing the scope of the implications of these results, and we offer a brief sketch of a new set of recommendations for testing relationships between dimensions in perception and response selection in the full-factorial identification paradigm.     

General recognition theory extended to include response times: Predictions for a class of parallel systems

General Recognition Theory (GRT; Ashby & Townsend, 1986) is a multidimensional theory of classification. Originally developed to study various types of perceptual independence, it has also been widely employed in diverse cognitive venues, such as categorization. The initial theory and applications have been static, that is, lacking a time variable and focusing on patterns of responses, such as confusion matrices. Ashby proposed a parallel, dynamic stochastic version of GRT with application to perceptual independence based on discrete linear systems theory with imposed noise (Ashby, 1989). The current study again focuses on cognitive/perceptual independence within an identification classification paradigm. We extend stochastic GRT and its implicated methodology for cognitive/perceptual independence, to an entire class of parallel systems. This goal is met in a distribution-free manner and includes all linear and non-linear systems satisfying very general conditions. A number of theorems are proven concerning stochastic forms of independence. However, the theorems all assume the stochastic version of decisional separability. A vital task remains to investigate the consequences of failures of stochastic decisional separability.     

Rehearsal,generative processes,and the activation of underlying stimulus representations

Previous research found that subjects engaged in mental rehearsal could reduce stimulus encoding time in classification and identification tasks by generating an appropriate representation of the probe stimulus prior to its presentation. The present experiment examined the types of representational codes activated by generative processes in character classification. Numerical stimuli were employed which could differ visually, yet have the same name and meaning (e.g., TWO, 2, II, &.). The results indicate that generative processes may activate visual and nonvisual memory codes prior to the encoding of an external stimulus. Effects of generative processes were discussed in terms of an activation model which defines the function of rehearsal in perceptual processing. Attention, through rehearsal, activates stimulus representations which are described by distributions of activation which change continuously over time. The momentary state of each distribution determines the rate of stimulus encoding.     

Similarity and categorization: from vision to touch

Even though human perceptual development relies on combining multiple modalities, most categorization studies so far have focused on the visual modality. To better understand the mechanisms underlying multisensory categorization, we analyzed visual and haptic perceptual spaces and compared them with human categorization behavior. As stimuli we used a three-dimensional object space of complex, parametrically-defined objects. First, we gathered similarity ratings for all objects and analyzed the perceptual spaces of both modalities using multidimensional scaling analysis. Next, we performed three different categorization tasks which are representative of every-day learning scenarios: in a fully unconstrained task, objects were freely categorized, in a semi-constrained task, exactly three groups had to be created, whereas in a constrained task, participants received three prototype objects and had to assign all other objects accordingly. We found that the haptic modality was on par with the visual modality both in recovering the topology of the physical space and in solving the categorization tasks. We also found that within-category similarity was consistently higher than across-category similarity for all categorization tasks and thus show how perceptual spaces based on similarity can explain visual and haptic object categorization. Our results suggest that both modalities employ similar processes in forming categories of complex objects.     

Sex differences in clerical speed: Perceptual encoding vs. verbal encoding

Most interpretations of sex differences on clerical speed tests have emphasized the role of rapid perception of details and shifts in attention. Some have emphasized comparison and decision processes. Sex differences in speeded, successive matching were studied in four experiments with college students. The experimental task involved the successive identification of stimulus items presented in lists by tapping matching items on response cards. Sex differences were found to be related to response-card content and not to stimulus-list content. When the identification response involved tapping words, colors, or directional symbols, females were significantly faster than males; however, when the identification response involved tapping shapes, no significant sex differences were found. Results indicated that sex differences in some aspect of short-term memory may also be involved. Earlier interpretations of sex differences on speeded matching tasks in terms of such global concepts as perceptual speed are believed to be inadequate. An alternative explanation is discussed emphasizing verbal encoding, memory, and evaluation processes.     

Sequence effects in categorization of simple perceptual stimuli

Categorization research typically assumes that the cognitive system has access to a (more or less noisy) representation of the absolute magnitudes of the properties of stimuli and that this information is used in reaching a categorization decision. However, research on identification of simple perceptual stimuli suggests that people have very poor representations of absolute magnitude information and that judgments about absolute magnitude are strongly influenced by preceding material. The experiments presented here investigate such sequence effects in categorization tasks. Strong sequence effects were found. Classification of a borderline stimulus was more accurate when preceded by a distant member of the opposite category than by a distant member of the same category. It is argued that this category contrast effect cannot be accounted for by extant exemplar or decision-bound models of categorization. The effect suggests the use of relative magnitude information in categorization. A memory and contrast model illustrates how relative magnitude information may be used in categorization.     

Response inhibition during perceptual decision making in humans and macaques

Response inhibition in stop signal tasks has been explained as the outcome of a race between GO and STOP processes (e.g., Logan, 1981). Response choice in two-alternative perceptual categorization tasks has been explained as the outcome of an accumulation of evidence for the alternative responses. To begin unifying these two powerful investigation frameworks, we obtained data from humans and macaque monkeys performing a stop signal task with responses guided by perceptual categorization and variable degrees of difficulty, ranging from low to high accuracy. Comparable results across species reinforced the validity of this animal model. Response times and errors increased with categorization difficulty. The probability of failing to inhibit responses on stop signal trials increased with stop signal delay, and the response times for failed stop signal trials were shorter than those for trials with no stop signal. Thus, the Logan race model could be applied to estimate the duration of the stopping process. We found that the duration of the STOP process did not vary across a wide range of discrimination accuracies. This is consistent with the functional, and possibly mechanistic, independence of choice and inhibition mechanisms.     

Global and Functional: Mandler's Perceptual and Conceptual Processes in Infancy

Mandler's distinction between perceptual categorization and conceptual categorization in infancy provides an important reconciliation of the conflicting data and contributes to our theoretical understanding of the development of thought in the early years of life. It is argued, however, that subsequent processes during the word learning period that follows reflect functional differentiations and slot-filler hierarchical organization.     

GLOMOsys: A Systems Account of Global Versus Local Processing

Within GLOMO^sys (the GLObal versus LOcal processing MOdel, a systems account) we examine the functionalities of two processing systems that process information either globally or locally (looking at the forest vs. the trees). GLOMO^sys suggests that (a) global versus local perceptual processing carries over to other tasks; (b) perceptual processing is related to conceptual processing (e.g., creative/analytic tasks; face/verbal recognition; similarity/dissimilarity generation; abstract/concrete construals, distance estimates, inclusive/exclusive categorization; assimilation/contrast in social judgments); (c) perceptual and conceptual processing is elicited by real-world variables (e.g., mood, exteroceptive and interoceptive cues of approach/avoidance, promotion/prevention focus, high/low power, distance, obstacles, novelty/familiarity, love/sex, interdependent/independent selves); (d) regulatory focus, psychological distance, and novelty are driving effects; and (e) the global system (glo-sys) processes novelty and the local system (lo-sys) processes familiarity. We discuss whether glo-sys is responsible for understanding meaning, relate the systems to physiological research, and discuss new research questions.     

Speech perception as categorization

Speech perception (SP) most commonly refers to the perceptual mapping from the highly variable acoustic speech signal to a linguistic representation, whether it be phonemes, diphones, syllables, or words. This is an example of categorization, in that potentially discriminable speech sounds are assigned to functionally equivalent classes. In this tutorial, we present some of the main challenges to our understanding of the categorization of speech sounds and the conceptualization of SP that has resulted from these challenges. We focus here on issues and experiments that define open research questions relevant to phoneme categorization, arguing that SP is best understood as perceptual categorization, a position that places SP in direct contact with research from other areas of perception and cognition.