Extending the ALCOVE model of category learning to featural stimulus domains

The ALCOVE model of category learning, despite its considerable success in accounting for human performance across a wide range of empirical tasks, is limited by its reliance on spatial stimulus representations. Some stimulus domains are better suited to featural representation, characterizing stimuli in terms of the presence or absence of discrete features, rather than as points in a multidimensional space. We report on empirical data measuring human categorization performance across a featural stimulus domain and show that ALCOVE is unable to capture fundamental qualitative aspects of this performance. In response, a featural version of the ALCOVE model is developed, replacing the spatial stimulus representations that are usually generated by multidimensional scaling with featural representations generated by additive clustering. We demonstrate that this featural version of ALCOVE is able to capture human performance where the spatial model failed, explaining the difference in terms of the contrasting representational assumptions made by the two approaches. Finally, we discuss ways in which the ALCOVE categorization model might be extended further to use “hybrid” representational structures combining spatial and featural components.     

Two routes to face perception: evidence from psychophysics and computational modeling

The aim of this study was to separately analyze the role of featural and configural face representations. Stimuli containing only featural information were created by cutting the faces into their parts and scrambling them. Stimuli only containing configural information were created by blurring the faces. Employing an old-new recognition task, the aim of Experiments 1 and 2 was to investigate whether unfamiliar faces (Exp. 1) or familiar faces (Exp. 2) can be recognized if only featural or configural information is provided. Both scrambled and blurred faces could be recognized above chance level. A further aim of Experiments 1 and 2 was to investigate whether our method of creating configural and featural stimuli is valid. Pre-activation of one form of representation did not facilitate recognition of the other, neither for unfamiliar faces (Exp. 1) nor for familiar faces (Exp. 2). This indicates a high internal validity of our method for creating configural and featural face stimuli. Experiment 3 examined whether features placed in their correct categorical relational position but with distorted metrical distances facilitated recognition of unfamiliar faces. These faces were recognized no better than the scrambled faces in Experiment 1, providing further evidence that facial features are stored independently of configural information. From these results we conclude that both featural and configural information are important to recognize a face and argue for a dual-mode hypothesis of face processing. Using the psychophysical results as motivation, we propose a computational framework that implements featural and configural processing routes using an appearance-based representation based on local features and their spatial relations. In three computational experiments (Experiments 4–6) using the same sets of stimuli, we show how this framework is able to model the psychophysical data.     

Categorical perception effects for facial identity in robustly represented familiar and self-faces: the role of configural and featural information

Categorical perception of robustly represented faces (self, friend) and unfamiliar faces is investigated, and the relative roles of configural and featural information are examined. Participants performed identification and discrimination tasks on morph series containing the self-face and a friend's face (self-Friend 1), two friends' faces (Friend 2-Friend 3), and two unfamiliar faces (Unfamiliar 1-Unfamiliar 2), presented in upright and inverted orientations. For upright faces, categorical perception effects were observed for both familiar morph series but not for the unfamiliar morph series, suggesting that robust representation is a requirement for categorical perception in facial identity. For inverted faces, categorical perception was observed for the self-Friend 1 morph series only. This suggests that categorical perception is tied to configural processing for familiar non-self-faces, but can be observed for self-faces during featural processing-consistent with evidence that self-face representations contain strong configural and featural components. Finally, categorical perception is not enhanced by the presence of the self-face relative to other familiar faces when upright, but shows a trend of being enhanced for self-faces when inverted, adding to the debate on the ways in which robustly represented faces can elicit categorical perception.     

The effects of familiarity in a perceptual matching task

Latencies of same-different judgments to pairs of two-digit numerals were recorded for stimuli presented in familiar or unfamiliar (inverted) orientation. Familiar stimuli were responded to more quickly than unfamiliar. For both stimulus types, latencies were correlated with the syllable length of the verbal representation of the numerals, allowing the interpretation that the effect of stimulus orientation is on encoding processes. In two other experiments, it was found that familiarity had no effect on different judgments when the stimuli were relatively simple (e.g., a single digit), but did affect different judgments with more complex stimuli. These results were related to the hypothesis that the complexity of verbal material determines whether different judgments are instigated by visual or by verbal representations of the stimuli.     

What happens to our representation of identity as familiar faces age? Evidence from priming and identity aftereffects

Matching identity in images of unfamiliar faces is error prone, but we can easily recognize highly variable images of familiar faces – even images taken decades apart. Recent theoretical development based on computational modelling can account for how we recognize extremely variable instances of the same identity. We provide complementary behavioural data by examining older adults’ representation of older celebrities who were also famous when young. In Experiment 1, participants completed a long-lag repetition priming task in which primes and test stimuli were the same age or different ages. In Experiment 2, participants completed an identity after effects task in which the adapting stimulus was an older or young photograph of one celebrity and the test stimulus was a morph between the adapting identity and a different celebrity; the adapting stimulus was the same age as the test stimulus on some trials (e.g., both old) or a different age (e.g., adapter young, test stimulus old). The magnitude of priming and identity after effects were not influenced by whether the prime and adapting stimulus were the same age or different age as the test face. Collectively, our findings suggest that humans have one common mental representation for a familiar face (e.g., Paul McCartney) that incorporates visual changes across decades, rather than multiple age-specific representations. These findings make novel predictions for state-of-the-art algorithms (e.g., Deep Convolutional Neural Networks).     

On the relation between decision rules and perceptual representation in multidimensional perceptual categorization

This article examines the relation between changing categorization decision rules and the nature of the underlying perceptual representation. Observers completed a matching task that required them to adjust the length and orientation of a single line stimulus until they perceived it to "match" a second line stimulus (Alfonso-Reese, 1996, 1997). The same observers then completed four categorization tasks with the same stimuli. Data from the matching task were used to estimate a perceptual representation for each stimulus and observer. Three hypotheses regarding potential interactions between categorization decision rules and perceptual representation were examined. One assumed that there was no interaction between decision rules and perceptual representation. The second assumed that linear categorization rules affect the perceptual representation differently from nonlinear categorization rules. The third assumed that dimensional integration rules affected the perceptual representation differently from decision rules that require the observer to set a criterion along one stimulus dimension while ignoring the other; this is referred to as decisional selective attention. The results suggested that (1) the matching task perceptual representation provided a good account of the categorization data, (2) decisional selective attention affected the perceptual representation differently from decisional integration, and (3) decisional selective attention generally decreased the perceptual variability along the attended dimension.     

Similarity effects in visual working memory

Perceptual similarity is an important property of multiple stimuli. Its computation supports a wide range of cognitive functions, including reasoning, categorization, and memory recognition. It is important, therefore, to determine why previous research has found conflicting effects of inter-item similarity on visual working memory. Studies reporting a similarity advantage have used simple stimuli whose similarity varied along a featural continuum. Studies reporting a similarity disadvantage have used complex stimuli from either a single or multiple categories. To elucidate stimulus conditions for similarity effects in visual working memory, we tested memory for complex stimuli (faces) whose similarity varied along a morph continuum. Participants encoded 3 morphs generated from a single face identity in the similar condition, or 3 morphs generated from different face identities in the dissimilar condition. After a brief delay, a test face appeared at one of the encoding locations for participants to make a same/different judgment. Two experiments showed that similarity enhanced memory accuracy without changing the response criterion. These findings support previous computational models that incorporate featural variance as a component of working memory load. They delineate limitations of models that emphasize cortical resources or response decisions.     

Measures of similarity in models of categorization

This paper concerns the use of similarities based on geometric distance in models of categorization. Two problematic implications of such similarities are outlined. First, in a comparison between two stimuli, geometric distance implies that matching features are not taken into account. Second, missing features are assumed not to exist. Only nonmatching features enter into calculations of similarity. A new model is constructed that is based on the ALCOVE model (Kruschke, 1992), but it uses a feature-matching similarity measure (see, e.g., Tversky, 1977) rather than a geometric one. It is an on-line model in the sense that both dimensions and exemplars are constructed during the categorization process. The model accounts better than ALCOVE does for data with missing features (Experiments 1 and 2) and at least as well as ALCOVE for a data set without missing features (Nosofsky, Kruschke, & McKinley, 1992). This suggests that, at least for some stimulus materials, similarity in categorization is more akin to a feature-matching procedure than to geometric distance calculation.     

Repetition effects for words and nonwords as indexed by event-related fMRI: a preliminary study

We have previously shown differential effects of stimulus familiarity on the repetition-related responses in right fusiform cortex to both faces and symbols. Repetition of familiar stimuli produced a response decrease, whereas repetition of unfamiliar stimuli produced a response increase. In the present experiment, we used words and nonwords as the familiar and unfamiliar stimuli respectively. In this case, the only fusiform region showing the familiarity-by-repetition interaction was in anterior left fusiform. This left-lateralisation of the fusiform interaction is consistent with our hypothesis that these repetition-related effects occur in the same regions responsible for perceptual recognition of familiar stimuli.     

Categorical perception occurs in newly learned faces, other-race faces, and inverted faces

On the basis of findings that categorical perception (CP) is possible in complex visual stimuli such as faces, the present study tested for CP on continua between unfamiliar face pairs. Results indicate that CP can be observed for unfamiliar faces, in both familiar (same-race) and unfamiliar (other-race) groups. In addition, significant CP effects were observed in inverted faces. Finally, half-continua were tested where midpoint stimuli became endpoints. This was done to ensure that stimulus artifacts did not account for the observed CP effects. Consistent with the perceptual rescaling associated with CP, half-continua showed a rescaled CP effect. We argue that these CP effects are based on the rapid acquisition of perceptual equivalence classes.     

Sequence effects in the categorization of tones varying in frequency

In contrast to exemplar and decision-bound categorization models, the memory and contrast models described here do not assume that long-term representations of stimulus magnitudes are available. Instead, stimuli are assumed to be categorized using only their differences from a few recent stimuli. To test this alternative, the authors examined sequential effects in a binary categorization of 10 tones varying in frequency. Stimuli up to 2 trials back in the sequence had a significant effect on the response to the current stimulus. The effects of previous stimuli interacted with one another. A memory and contrast model, according to which only ordinal information about the differences between the current stimulus and recent preceding stimuli is used, best accounted for these data.     

Widgets: A new set of parametrically defined 3D objects for use in haptic and visual categorization tasks

IntroductionMost research to date on human categorization ability has concentrated on the visual and auditory domains. However, a limited – but non-negligible – range of studies has also examined the categorization of familiar or unfamiliar (i.e., novel) objects in the haptic (i.e., tactile-kinesthetic) modality.ObjectiveIn this paper, we describe how we developed a new set of parametrically defined objects, called widgets, that can be used as 3D (or 2D) materials for haptic (or visual) categorization purposes.MethodWidgets are unfamiliar complex 3D shapes with an ovoid body and four types of elements attached to it (eyes, tail, crest, and legs). The stimulus set comprises 24 objects divided into four categories of six exemplars each (the files used for 3D printing are provided as Supplementary Material).ResultsWe also assessed and demonstrated the validity of our stimulus set by conducting two separate studies of haptic and visual categorization, involving participants of different ages: young adults (Study 1), and children and adolescents (Study 2). Results showed that humans can categorize our 3D complex shapes on the basis of both haptically and visually perceived similarities in shape attributes.ConclusionWidgets are very useful new experimental stimuli for categorization studies using 3D printing technology.     

Different slopes for different folks: Process analysis of spatial aptitude

Adults differing in spatial ability were tested on problems involving the mental rotation of familiar alphanumeric stimuli and unfamiliar stimuli drawn from the Primary Mental Abilities Space Test. Individual differences in spatial ability were associated with speed rather than accuracy of mental rotation processes. Ability differences were correlated with the time to rotate familiar alphanumerics and the additional time to encode, compare, and rotate unfamiliar stimuli. The results are discussed in terms of differences in elementary information processes associated with the representation and transformation of visual information.     

Featural and configurational processes in the recognition of faces of different familiarity

Previous research suggests that face recognition may involve both configurational and piecemeal (featural) processing. To explore the relationship between these processing modes, we examined the patterns of recognition impairment produced by blurring, inversion, and scrambling, both singly and in various combinations. Two tasks were used: recognition of unfamiliar faces (seen once before) and recognition of highly familiar faces (celebrities). The results provide further support for a configurational-featural distinction. Recognition performance remained well above chance if faces were blurred, scrambled, inverted, or simultaneously inverted and scrambled: each of these manipulations disrupts either configurational or piecemeal processing, leaving the other mode available as a route to recognition. However, blurred/scrambled and blurred/inverted faces were recognised at or near chance levels, presumably because both configurational processing and featural processing were disrupted. Similar patterns of effects were found for both familiar and unfamiliar faces, suggesting that the relationship between configurational and featural processing is qualitatively similar in both cases.     

A tachistoscopic study of hemispheric processing in stuttering and nonstuttering children

Hemispheric processing, expressed as mean reaction time to various visual stimuli presented to the left and right visual fields, was investigated in eighteen stuttering and nonstuttering children. Tachistoscopic procedures were used to present linguistic stimuli (words and nonwords) as well as nonlinguistic stimuli (familiar and unfamiliar geometric figures) to the visual fields. Subjects responded by pressing a telegraph key when they perceived a real word or a familiar geometric figure. They were to make no response when they perceived nonwords or unfamiliar geometric figures. Faster reaction times were taken as an index of the most efficient or dominant hemisphere for a given task. No significant differences were found in mean reaction times for groups, visual fields, type of task, nor any of their interactions. Likewise, the data on accuracy also did not suggest that a larger proportion of stutters responded more accurately when linguistic stimuli were presented to the right hemisphere. Based on mean reaction times and on accuracy data, the stuttering and nonstuttering children performed with similar efficiencies and processing patterns.     

The influence of object familiarity on magnitude estimates of apparent size.

Three magnitude-estimation experiments were used to determine the exponents of the power function relating size judgments and physical size for two-dimensional familiar and unfamiliar stimuli. The exponent of the power function was used to index the effect of familiar size on perceived size under a variety of conditions, from full-cue to reduced-cue viewing conditions. Although the value of the exponents varied across the three experiments, within each experiment the exponent of the familiar stimulus was not significantly different from that of the unfamiliar stimulus, indicating that familiar size does not influence the rate of growth of perceived size. The results of a fourth experiment excluded a possible explanation of the findings of experiments 1-3 in terms of subjects responding to relative angular size as a consequence of the successive presentation of the different-sized representations of the familiar stimulus. Taken together, the present findings are consistent with the hypothesis that the influence of familiar size on estimates of size mainly reflects the intrusion of nonperceptual processes in spatial responses.     

Comparing categorization models

Four experiments are presented that competitively test rule- and exemplar-based models of human categorization behavior. Participants classified stimuli that varied on a unidimensional axis into 2 categories. The stimuli did not consistently belong to a category; instead, they were probabilistically assigned. By manipulating these assignment probabilities, it was possible to produce stimuli for which exemplar- and rule-based explanations made qualitatively different predictions. F. G. Ashby and J. T. Townsend's (1986) rule-based general recognition theory provided a better account of the data than R. M. Nosofsky's (1986) exemplar-based generalized context model in conditions in which the to-be-classified stimuli were relatively confusable. However, generalized context model provided a better account when the stimuli were relatively few and distinct. These findings are consistent with multiple process accounts of categorization and demonstrate that stimulus confusion is a determining factor as 10 which process mediates categorization.     

Separating perceptual processes from decisional processes in identification and categorization

Four observers completed perceptual matching, identification, and categorization tasks using separable-dimension stimuli. A unified quantitative approach relating perceptual matching, identification, and categorization was proposed and tested. The approach derives from general recognition theory (Ashby & Townsend, 1986) and provides a powerful method for quantifying the separate influences of perceptual processes and decisional processes within and across tasks. Good accounts of the identification data were obtained from an initial perceptual representation derived from perceptual matching. The same perceptual representation provided a good account of the categorization data, except when selective attention to one stimulus dimension was required. Selective attention altered the perceptual representation by decreasing the perceptual variance along the attended dimension. These findings suggest that a complete understanding of identification and categorization performance requires an understanding of perceptual and decisional processes. Implications for other psychological tasks are discussed.     

Separating perceptual processes from decisional processes in identification and categorization.

Four observers completed perceptual matching, identification, and categorization tasks using separable-dimension stimuli. A unified quantitative approach relating perceptual matching, identification, and categorization was proposed and tested. The approach derives from general recognition theory (Ashby & Townsend, 1986) and provides a powerful method for quantifying the separate influences of perceptual processes and decisional processes within and across tasks. Good accounts of the identification data were obtained from an initial perceptual representation derived from perceptual matching. The same perceptual representation provided a good account of the categorization data, except when selective attention to one stimulus dimension was required. Selective attention altered the perceptual representation by decreasing the perceptual variance along the attended dimension. These findings suggest that a complete understanding of identification and categorization performance requires an understanding of perceptual and decisional processes. Implications for other psychological tasks are discussed.     

Familiarity effects on categorization levels of faces and objects

It is well established that faces, in contrast to objects, are categorized as fast or faster at the individual level (e.g., Bill Clinton) than at the basic-level (e.g., human face). This subordinate-shift from basic-level categorization has been considered an outcome of visual expertise with processing faces. However, in the present study we found that, similar to familiar faces, categorization of individually-known familiar towers is also faster at the individual level than at the basic-level in naïve participants. In addition, category-verification of familiar stimuli, at basic and superordinate levels, was slower and less accurate compared to unfamiliar stimuli. Thus, the existence of detailed semantic information, regardless of expertise, can induce a shift in the default level of object categorization from basic to individual level. Moreover, the individually-specific knowledge is not only more easily-retrieved from memory but it might also interfere with accessing more general category information.