Shape Integration for Visual Object Recognition and Its Implication in Category-Specific Visual Agnosia

A series of experiments was conducted on a patient (ELM) with bilateral inferior temporal lobe damage and category-specific visual agnosia in order to specify the nature of his functional impairment. In Experiment 1, ELM performed a task of picture/word matching that used line drawings of fruits and vegetables as stimuli. The pattern of confusions exhibited by the patient suggested a failure in processing the full range of shape features necessary for the unique specification of the target relative to other structurally related items. This hypothesis of a shape integration impairment was tested and verified by subsequent visual recognition experiments (Experiments 2-4), which used synthetic stimuli with shapes precisely defined on the dimensions of elongation, curvature, and tapering. Furthermore, it was determined (Experiment 5) that the integration deficit is specific to the retrieval of shape knowledge from memory and does not affect the encoding of the properties of visual stimuli. It is argued that these findings have critical implications for cognitive theories of visual object recognition and for an interpretation of the visual function of the inferior temporal cortex. Finally, it was shown that the patient's deficit for structural knowledge integration is modulated by the semantic properties of the objects (Experiment 6), thereby demonstrating the applicability of the present findings to an explanation of category-specific visual agnosia.     

How children name objects with shoes

Many studies report a shape bias in children's learning of object names. However, one previous study suggests that the shape bias is not the only perceptually based bias displayed by children learning count nouns. Specifically, children attended to texture as well as shape when extending a novel name to novel objects with eyes. Two experiments attempt to extend this finding, asking whether children will also attend to texture in the presence of another cue to animacy—shoes. In Experiment 1, 80 2- and 3-year-olds participated in either a Name generalization or Similarity judgment task. The novel objects were identical except that for half of the children the objects had shoes. In the Similarity condition, children made their judgments by overall similarity. In the Name condition, 2-year-olds extended the novel name by shape across objects both with and without shoes. In contrast, 3-year-olds generalized the novel name by shape when the objects had no shoes but by texture when the objects had shoes. Experiment 2 challenged this finding, using a forced choice procedure and objects that differed from the named exemplar more markedly in shape. Twenty 3-year-olds participated in a Name generalization task, half for objects with shoes, half for objects without shoes. Again, children attended reliably more to texture when the objects had shoes than when they had no shoes. The results are discussed in terms of the development of different perceptually based biases and the relation of such biases to a taxonomic bias in early word learning.     

实物形状的知觉相似性对视觉隐喻加工的影响

视觉隐喻是众多研究者比较关注的领域, 当前多以物体简笔画、漫画及广告等方面的研究为主, 但对与生活密切相关的实物的视觉隐喻研究甚少。因此研究采用掩蔽启动范式、李克特9点量表及语音生成等研究方法, 在物体概念类型(概念相同、概念相异)及形状类型(形状相似、形状相异)条件下, 针对实物图片的形状知觉相似性是否对视觉隐喻加工产生影响进行探讨。结果发现无论物体概念是否相同, 形状相似性对个体的物体识别具有“促进”作用, 并有利于视觉隐喻加工; 在物体识别中, 当两个物体概念不同时, 个体会试图建立一个特设类别来对形状相似的物体进行归类, 从而实现了视觉隐喻的加工。因此研究进一步证明了实物形状的知觉相似性有利于视觉隐喻的加工。     

How do biases in spatial memory change as children and adults are learning locations?

This investigation tracked changes in categorical bias (i.e., placing objects belonging to the same spatial group closer together than they really are) while 7-, 9-, and 11-year-olds and adults were learning a set of locations. Participants learned the locations of 20 objects marked by dots on the floor of an open square box divided into quadrants. At test, participants attempted to place the objects in the correct locations without the dots and boundaries. In Experiment 1, we probed categorical bias during learning by alternating learning and test trials. Categorical bias was high during the first test trial and decreased over the second and third test trials. In Experiment 2, we manipulated opportunities for learning by providing participants with either one, two, three, or four learning trials prior to test. Participants who experienced one or two learning trials exhibited more bias at test than did those who experienced four learning trials. The discussion focuses on how categorical bias emerges through interactions between the cognitive system and task structure.     

Repetition priming is not purely episodic in origin

The sufficiency of similarity among surface attributes of prime-target pairs to account for the pattern of facilitation obtained in the repetition priming paradigm was evaluated. In Experiment 1, morphological primes were singular, inflected case forms of Serbo-Croatian words and visual similarity of prime and target was manipulated by alternating the two alphabets in which the Serbo-Croatian language is written. Results indicated that the magnitude of facilitation in the alphabetically alternating condition was not reduced relative to the nonalternating condition (RUPI-RUPI vs. RUPI-RUPI) which suggested that visual similarity is not a necessary condition for facilitation in the present task. In Experiment 2, related pairs included (a) base forms with diminutives, a class of highly productive and semantically predictable derivations marked in Serbo-Croatian by suffixes and (b) base words with morphologically unrelated monomorphemic words whose orthographic pattern encompassed the target in initial position and a sequence of letters in final position that elsewhere functions as a diminutive suffix. No facilitation of word targets by orthographically similar but morphologically unrelated primes was observed although there was a tendency toward facilitation among structurally similar pseudowords. Collectively, the experiments suggested that structural similarity of prime and target is not a sufficient condition for facilitation in the repetition priming paradigm.     

The spatial mismatch effect is based on global configuration and not on perceptual records within the visual cache

If configurations of objects are presented in a S1-S2 matching task for the identity of objects a spatial mismatch effect occurs. Changing the (irrelevant) spatial layout lengthens response times. We investigated what causes this effect. We observed a reliable mismatch effect that was not influenced by a secondary task during maintenance. Neither articulatory suppression (Experiment 1), nor unattended (Experiments 2 and 6) or attended visual material (Experiment 3) reduced the effect, and this was independent of the length of the retention interval (Experiment 6). The effect was also rather independent of the visual appearance of the local elements. It was of similar size with color patches (Experiment 4) and with completely different surface information when testing was cross modal (Experiment 5), and the name-ability of the global configuration was not relevant (Experiments 6 and 7). In contrast, the figurative similarity of the configurations of S1 and S2 systematically influenced the size of the spatial mismatch effect (Experiment 7). We conclude that the spatial mismatch effect is caused by a mismatch of the global shape of the configuration stored together with the objects of S1 and not by a mismatch of templates of perceptual records maintained in a visual cache.     

Test sample selection by preschool children: Honoring diversity

In a test of an inductive inference, preschool children's selection of objects was examined. In Experiment 1, 4-year-olds selected diverse objects first in sequential selections; in Experiment 2, adults and 4-year-olds, but not 3-year-olds, made similar selections under the same conditions. A defective object led subjects in all age groups to test a similar object. In Experiment 3, 4-year-olds chose to test a pair of dissimilar objects rather than a pair of similar objects, but 3-year-olds did not. Three-year-olds' selections were independent of diversity. In Experiment 4, we attempted to emphasize the diversity of objects for 3-year-olds. Their first task was to select an object that was the same as or different from a target object. The subjects responded correctly in this task but did not prefer to test diverse objects. Experiment 5 showed that neither 3- nor 4-year-olds have a bias to select nondiverse objects in a nontest context. The findings indicate that children as young as 4 years old value diverse evidence in induction.     

The nature of the visual environment induces implicit biases during language-mediated visual search

Four eyetracking experiments examined whether semantic and visual-shape representations are routinely retrieved from printed word displays and used during language-mediated visual search. Participants listened to sentences containing target words that were similar semantically or in shape to concepts invoked by concurrently displayed printed words. In Experiment 1, the displays contained semantic and shape competitors of the targets along with two unrelated words. There were significant shifts in eye gaze as targets were heard toward semantic but not toward shape competitors. In Experiments 2–4, semantic competitors were replaced with unrelated words, semantically richer sentences were presented to encourage visual imagery, or participants rated the shape similarity of the stimuli before doing the eyetracking task. In all cases, there were no immediate shifts in eye gaze to shape competitors, even though, in response to the Experiment 1 spoken materials, participants looked to these competitors when they were presented as pictures (Huettig & McQueen, 2007). There was a late shape-competitor bias (more than 2,500 ms after target onset) in all experiments. These data show that shape information is not used in online search of printed word displays (whereas it is used with picture displays). The nature of the visual environment appears to induce implicit biases toward particular modes of processing during language-mediated visual search.     

Imagery in the congenitally blind: how visual are visual images?

Three experiments compared congenitally blind and sighted adults and children on tasks presumed to involve visual imagery in memory. In all three, the blind subjects' performances were remarkably similar to the sighted. The first two experiments examined Paivio's (1971) modality-specific imagery hypothesis. Experiment 1 used a paired-associate task with words whose referents were high in either visual or auditory imagery. The blind, like the sighted, recalled more high-visual-imagery pairs than any others. Experiment 2 used a free-recall task for words grouped according to modality-specific attributes, such as color and sound. The blind performed as well as the sighted on words grouped by color. In fact, the only consistent deficit in both experiments occurred for the sighted in recall of words whose referents are primarily auditory. These results challenge Paivio's theory and suggest either (a) that the visual imagery used by the sighted is no more facilitating than the abstract semantic representations used by the blind or (b) that the sighted are not using visual imagery. Experiment 3 used Neisser and Kerr's (1973) imaging task. Subjects formed images of scenes in which target objects were described as either visible in the picture plane or concealed by another object and thus not visible. On an incidental recall test for the target objects, the blind, like the sighted, recalled more pictorial than concealed targets. This finding suggests that the haptic images of the blind maintain occlusion just as the visual images of the sighted do.     

Atypical shape bias and categorization in autism: Evidence from children and computational simulations

The shape bias, a preference for mapping new word labels onto the shape rather than the color or texture of referents, has been postulated as a word‐learning mechanism. Previous research has shown deficits in the shape bias in children with autism even though they acquire sizeable lexicons. While previous explanations have suggested the atypical use of color for label extension in individuals with autism, we hypothesize an atypical mapping of novel labels to novel objects, regardless of the physical properties of the objects. In Experiment 1, we demonstrate this phenomenon in some individuals with autism, but the novelty of objects only partially explains their lack of shape bias. In a second experiment, we present a computational model that provides a developmental account of the shape bias in typically developing children and in those with autism. This model is based on theories of neurological dysfunctions in autism, and it integrates theoretical and empirical findings in the literature of categorization, word learning, and the shape bias. The model replicates the pattern of results of our first experiment and shows how individuals with autism are more likely to categorize experimental objects together on the basis of their novelty. It also provides insights into possible mechanisms by which children with autism learn new words, and why their word referents may be idiosyncratic. Our model highlights a developmental approach to autism that emphasizes deficient representations of categories underlying an impaired shape bias.     

Categorical perception of familiar objects

We report three experiments where the categorical perception of familiar, three-dimensional objects was investigated. A continuum of shape change between 15 pairs of objects was created and the images along the continuum were used as stimuli. In Experiment 1 participants were first required to discriminate pairs of images of objects that lay along the shape continuum. Then participants were asked to classify each morph-image into one of two pre-specified classes. We found evidence for categorical perception in some but not all of our object pairs. In Experiment 2 we varied the viewpoint of the objects in the discrimination task and found that effects of categorical perception generalized across changes in view. In Experiment 3 similarity ratings for each object pair were collected. These similarity scores correlated with the degree of perceptual categorization found for the object pairs. Our findings suggest that some familiar objects are perceived categorically and that categorical perception is closely tied to inter-object perceptual similarity.     

Hierarchical forms processing in adults and children

Two experiments examined child and adult processing of hierarchical stimuli composed of geometric forms. Adults (ages 18-23 years) and children (ages 7-10 years) performed a forced-choice task gauging similarity between visual stimuli consisting of large geometric objects (global level) composed of small geometric objects (local level). The stimuli spatial arrangement was manipulated to assess child and adult reaction times and predisposition toward local or global form categorization under two distinct trial conditions, with varied density of the local forms comprising the global forms. In Experiment 1, children and adults were presented with common, simple geometric shape hierarchical forms composed of ovals and rectangles. In Experiment 2, adults were presented with hierarchical forms composed of the simple geometric shapes, ovals and rectangles, and additional novel complex geometric shapes, “posts” and “arches.” Results show a clear increase of global processing bias across the age ranges of the individuals in the study, with children at 10 years performing similarly to adults on the simple stimuli. In addition, adults presented with the novel complex geometric shapes showed a significant reduction in global processing bias, indicating that form novelty and complexity lead to additional attention to local features in categorization tasks.     

Multidimensional shape similarity in the development of visual object classification

The current work examined age differences in the classification of novel object images that vary in continuous dimensions of structural shape. The structural dimensions employed are two that share a privileged status in the visual analysis and representation of objects: the shape of discrete prominent parts and the attachment positions of those parts. Experiment 1 involved a triad classification task in which participants at each of three different ages (5 years, 8 years, and adult) classified object images from two distinct stimulus sets. Across both sets, the youngest children demonstrated a systematic bias toward the shape of discrete parts during their judgments. With increasing age, participants increasingly came to select both the shape and the position of parts when classifying the images. The findings from Experiment 2 indicate that the local shape bias observed in young children's classifications is not merely a consequence of a discrimination advantage for that dimension. Results are discussed in relation to corresponding age-related changes in other functional contexts of visual processing.     

Linguistic labels: Conceptual markers or object features?

Linguistic labels affect inductive generalization; however, the mechanism underlying these effects remains unclear. According to one similarity-based model, SINC (similarity, induction, naming, and categorization), early in development labels are features of objects contributing to the overall similarity of compared entities, with early induction being similarity based. If this is the case, then not only identical but also phonologically similar labels may contribute to the overall similarity and thus to induction. These predictions were tested in a series of experiments with 5-year-olds and adults. In Experiments 1-5 participants performed a label extension task, whereas in Experiment 6 they performed a feature induction task. Results indicate that phonological similarity contributes to early induction and support the notion that for young children labels are features of objects.     

Individual differences in the shape bias in preschool children with specific language impairment and typical language development: theoretical and clinical implications

We investigated whether preschool children with specific language impairment (SLI) exhibit the shape bias in word learning: the bias to generalize based on shape rather than size, color, or texture in an object naming context (‘This is a wek; find another wek’) but not in a non‐naming similarity classification context (‘See this? Which one goes with this one?’). Fifty‐four preschool children (16 with SLI, 16 children with typical language [TL] in an equated control group, and 22 additional children with TL included in individual differences analyses but not group comparisons) completed a battery of linguistic and cognitive assessments and two experiments. In Experiment 1, children made generalization choices in object naming and similarity classification contexts on separate days, from options similar to a target object in shape, color, or texture. On average, TL children exhibited the shape bias in an object naming context, but children with SLI did not. In Experiment 2, we tested whether the failure to exhibit the shape bias might be linked to ability to detect systematicities in the visual domain. Experiment 2 supported this hypothesis, in that children with SLI failed to learn simple paired visual associations that were readily learned by children with TL. Analyses of individual differences in the two studies revealed that visual paired‐associate learning predicted degree of shape bias in children with SLI and TL better than any other measure of nonverbal intelligence or standard assessments of language ability. We discuss theoretical and clinical implications.     

奖赏预期调节局部注意干扰效应

局部注意干扰效应(Localized attentional interference, LAI)是指在视觉搜索任务中同时搜索在空间上分离的两个目标时, 或者目标周围存在一个无关奇异项时, 这两个关键刺激相距较近时产生的干扰现象。本实验采用视觉搜索范式, 探讨了奖赏预期对局部注意干扰效应的影响。实验1采用双目标搜索任务, 要求被试判断搜索画面中两个奇异项刺激的形状是否相同。结果显示奖赏条件和无奖赏条件都表现出显著的距离主效应, 随着目标间距离增大, 被试的正确率提高, 反应时下降。同时, 在远距离时, 奖赏条件下的正确率高于无奖赏条件, 而在近距离时, 奖赏条件下的正确率反而低于无奖赏条件, 即, 奖赏条件下局部注意干扰效应反而增大。高动机状态增强了两个目标的表征, 反而不利于解决局部注意干扰效应。实验2采用单目标搜索任务, 要求被试判断特定目标的方位并忽略另一无关奇异项刺激。与实验1不同的是, 实验2仅在无奖赏条件下观察到显著的距离主效应, 即被试行为表现在远距离时更好; 而在奖赏条件下, 被试在近距离和远距离的表现一样好, 即没有局部注意干扰效应。这说明在奖赏预期条件, 个体可以有效抑制分心物刺激的干扰, 将注意集中于目标刺激的加工, 从而对局部注意干扰效应产生调节。整个研究表明, 奖赏整体上能够提高对任务相关刺激的表征, 并抑制任务无关刺激, 虽然这并不总是能够提高任务表现。     

A PRP-study to determine the locus of target priming effects

Visual stimuli that are made invisible by a following mask can nonetheless affect motor responses. To localize the origin of these target priming effects we used the psychological refractory period paradigm. Participants classified tones as high or low, and responded to the position of a visual target that was preceded by a prime. The stimulus onset asynchrony (SOA) between both tasks varied. In Experiment 1 the tone task was followed by the position task and SOA dependent target priming effects were observed. When the visual position task preceded the tone task in Experiment 2, with short SOA the priming effect propagated entirely to the tone task yielding faster responses to tones on visually congruent trials and delayed responses to tones on visually incongruent trials. Together, results suggest that target priming effects arise from processing before and at the level of the central bottleneck such as sensory analysis and response selection.     

Visual and phonological components of working memory in children

Previous studies have shown that young children's immediate memory for a short series of drawings of objects is mediated by a visual component of working memory, whereas older children rely chiefly upon a phonological component. Three experiments investigated the hypothesis that older children rely also, but to a lesser extent, on visual working memory. Experiment 1 confirmed previous evidence that 11-year-olds' memory is disrupted by phonemic similarity of object names, but is unaffected by visual similarity of the objects themselves. However, when articulatory suppression was used to prevent phonological coding, levels of recall were sensitive to visual rather than phonemic similarity. Experiment 2 compared the effects of interpolating an auditory-verbal or a visual postlist task on memory for drawings viewed either with or without suppression. The visual task had a clear disruptive effect only in the suppression condition, where it interfered selectively with recall of the most recent item. Experiment 3 compared the effects of interpolating an auditory-verbal or a mixed-modality (visual-auditory) postlist task when subjects were not required to suppress. There was greater interference from the mixed-modality task, and this effect was confined to the last item presented. These experiments are taken as confirming the presence of a small but reliable contribution from visual memory in 11-year-old children's recall. As in younger children, visual working memory in 11-year-olds is sensitive to visual similarity and is responsible for a final-item visual recency effect. The results also show that older children's use of visual working memory is usually masked by the more pervasive phonological component of recall. Some implications for the structure of working memory and its development are discussed.     

Spatio-temporal working-memory and short-term object-location tasks use different memory mechanisms

Spatial short-term memory for objects' locations was investigated in a spatial relocation task. During maintenance, dynamic visual noise or spatial tapping were administered as visual or spatial secondary tasks, respectively. Because memory for location should tap the visual component of working memory, a visual but not a spatial secondary task should impair location memory. In fact, neither of the tasks impaired memory (Experiment 1), although the expected dissociation between visual and spatial components was clearly confirmed for a spatio-temporal main task (Corsi test) (Experiment 2). We then contrasted location memory for pictures of objects and of nonsense figures under visual interference. Real objects were relocated much better than nonsense figures, and visual noise was again ineffective (Experiment 3). When spatial tapping was combined with the same material (Experiment 3a), again no influence on memory for locations of objects was observed and only a small influence on remembering nonsense figures. We suggest that the Corsi and the relocation VSWM-tasks use different memory mechanisms. The configuration of objects is reconstructed from perceptual records in an episodic buffer, provided by the same structures that enable visual memory after longer intervals. Rehearsal is not necessary for the persistence of these traces. In contrast, in the Corsi task remembering, a temporal sequence across homogeneous locations needs spatio-temporal marking and therefore active rehearsal of the locations by shifting spatial attention. A spatially demanding secondary task during retention interrupts this rehearsal.     

Infants learn about objects from statistics and people

In laboratory experiments, infants are sensitive to patterns of visual features that co-occur (e.g., Fiser & Aslin, 2002). Once infants learn the statistical regularities, however, what do they do with that knowledge? Moreover, which patterns do infants learn in the cluttered world outside of the laboratory? Across 4 experiments, we show that 9-month-olds use this sensitivity to make inferences about object properties. In Experiment 1, 9-month-old infants expected co-occurring visual features to remain fused (i.e., infants looked longer when co-occurring features split apart than when they stayed together). Forming such expectations can help identify integral object parts for object individuation, recognition, and categorization. In Experiment 2, we increased the task difficulty by presenting the test stimuli simultaneously with a different spatial layout from the familiarization trials to provide a more ecologically valid condition. Infants did not make similar inferences in this more distracting test condition. However, Experiment 3 showed that a social cue did allow inferences in this more difficult test condition, and Experiment 4 showed that social cues helped infants choose patterns among distractor patterns during learning as well as during test. These findings suggest that infants can use feature co-occurrence to learn about objects and that social cues shape such foundational learning in distraction-filled environments.