Visual effects in picture and word categorization

Two experiments are reported in which participants categorized stimuli as belonging or not belonging to the category of fruits. Blocks of pictures and words were used, with items referring to exemplars having either high or low intercategory visual similarity and/or semantic relatedness. For both pictures and words, response time was longer in the semantically related conditions than in the unrelated condition. Furthermore, there was a strong effect of visual similarity for pictures but not for words when semantic relatedness was held constant: Participants took longer to classify pictures of fruits when these were mixed with visually similar vegetables than when they were mixed with visually dissimilar vegetables. Reducing the stimulus visibility by adding a dot pattern had an additive effect for words but an interactive effect for pictures. The results are explained in terms of a unique locus for category decisions about pictures and words.     

An enquiry into the process of categorization of pictures and words

This paper reports a series of experiments conducted to study the categorization of pictures and words. Whereas some studies reported in the past have found a picture advantage in categorization, other studies have yielded no differences between pictures and words. This paper used an experimental paradigm designed to overcome some methodological problems to examine picture-word categorization. The results of one experiment were consistent with an advantage for pictures in categorization. To identify the source of the picture advantage in categorization, two more experiments were conducted. Findings suggest that semantic relatedness may play an important role in the categorization of both pictures and words. We explain these findings by suggesting that pictures simultaneously access both their concept and visually salient features whereas words may initially access their concept and may subsequently activate features. Therefore, pictures have an advantage in categorization by offering multiple routes to semantic processing.     

Faster might not be better: Pictures may not elicit a stronger unconscious priming effect than words when modulated by semantic similarity

It has been suggested that unconscious semantic processing is stimulus-dependent, and that pictures might have privileged access to semantic content. Those findings led to the hypothesis that unconscious semantic priming effect for pictorial stimuli would be stronger as compared to verbal stimuli. This effect was tested on pictures and words by manipulating the semantic similarity between the prime and target stimuli. Participants performed a masked priming categorization task for either words or pictures with three semantic similarity conditions: strongly similar, weakly similar, and non-similar. Significant differences in reaction times were only found between strongly similar and non-similar and between weakly similar and non-similar, for both pictures and words, with faster overall responses for pictures as compared to words. Nevertheless, pictures showed no superior priming effect over words. This could suggest the hypothesis that even though semantic processing is faster for pictures, this does not imply a stronger unconscious priming effect.     

The picture superiority effect in categorization: visual or semantic?

Two experiments are reported whose aim was to replicate and generalize the results presented by Snodgrass and McCullough (1986) on the effect of visual similarity in the categorization process. For pictures, Snodgrass and McCullough's results were replicated because Ss took longer to discriminate elements from 2 categories when they were visually similar than when they were visually dissimilar. However, unlike Snodgrass and McCullough, an analogous increase was also observed for word stimuli. The pattern of results obtained here can be explained most parsimoniously with reference to the effect of semantic similarity, or semantic and visual relatedness, rather than to visual similarity alone.     

Category size effects revisited: frequency and masked priming effects in semantic categorization

Previous work indicates that semantic categorization decisions for nonexemplars (e.g., deciding that TURBAN is not an animal name) are faster for high-frequency words than low-frequency words. However, there is evidence that this result might depend on category size. When narrow categories are used (e.g., Months, Numbers), there is no frequency effect for nonexemplars. This result is confirmed, and is explained in terms of a category search model, which allows a "No" decision to be generated without access to the lexical entry for the target word. This explains the absence of a frequency effect, but not the presence of a strong masked repetition priming effect, which is assumed to have a lexical source. It is shown that this effect may not be lexical, since nonwords also show similar priming. Both of these priming effects disappear when a larger category is used. This pattern of results is explained on the assumption that category search is only possible with small categories, and that tentative category decisions are generated for the unconsciously perceived prime, which leads to a marked response congruence effect.     

Labeling and family resemblance in the discrimination of polymorphous categories by pigeons

Two experiments examined whether pigeons discriminate polymorphous categories on the basis of a single highly predictive feature or overall similarity. In the first experiment, pigeons were trained to discriminate between categories of photographs of complex real objects. Within these pictures, single features had been manipulated to produce a highly salient texture cue. Either the picture or the texture provided a reliable cue for discrimination during training, but in probe tests, the picture and texture cues were put into conflict. Some pigeons showed a significant tendency to discriminate on the basis of the picture cue (overall similarity or family resemblance), whereas others appeared to rely on the manipulated texture cue. The second experiment used artificial polymorphous categories in which one dimension of the stimulus provided a completely reliable cue to category membership, whereas three other dimensions provided cues that were individually unreliable but collectively provided a completely reliable basis for discrimination. Most pigeons came under the control of the reliable cue rather than the unreliable cues. A minority, however, came under the control of single dimensions from the unreliable set. We conclude that cue salience can be more important than cue reliability in determining what features will control behavior when multiple cues are available.     

实物形状的知觉相似性对视觉隐喻加工的影响

视觉隐喻是众多研究者比较关注的领域, 当前多以物体简笔画、漫画及广告等方面的研究为主, 但对与生活密切相关的实物的视觉隐喻研究甚少。因此研究采用掩蔽启动范式、李克特9点量表及语音生成等研究方法, 在物体概念类型(概念相同、概念相异)及形状类型(形状相似、形状相异)条件下, 针对实物图片的形状知觉相似性是否对视觉隐喻加工产生影响进行探讨。结果发现无论物体概念是否相同, 形状相似性对个体的物体识别具有“促进”作用, 并有利于视觉隐喻加工; 在物体识别中, 当两个物体概念不同时, 个体会试图建立一个特设类别来对形状相似的物体进行归类, 从而实现了视觉隐喻的加工。因此研究进一步证明了实物形状的知觉相似性有利于视觉隐喻的加工。     

Learning foreign sounds in an alien world: videogame training improves non-native speech categorization

Although speech categories are defined by multiple acoustic dimensions, some are perceptually weighted more than others and there are residual effects of native-language weightings in non-native speech perception. Recent research on nonlinguistic sound category learning suggests that the distribution characteristics of experienced sounds influence perceptual cue weights: Increasing variability across a dimension leads listeners to rely upon it less in subsequent category learning (Holt & Lotto, 2006). The present experiment investigated the implications of this among native Japanese learning English /r/-/l/ categories. Training was accomplished using a videogame paradigm that emphasizes associations among sound categories, visual information, and players' responses to videogame characters rather than overt categorization or explicit feedback. Subjects who played the game for 2.5h across 5 days exhibited improvements in /r/-/l/ perception on par with 2-4 weeks of explicit categorization training in previous research and exhibited a shift toward more native-like perceptual cue weights.     

The eyes grasp,the hands see: Metric category knowledge transfers between vision and touch

Categorization of seen objects is often determined by the shapes of objects. However, shape is not exclusive to the visual modality: The haptic system also is expert at identifying shapes. Hence, an important question for understanding shape processing is whether humans store separate modality-dependent shape representations, or whether information is integrated into one multisensory representation. To answer this question, we created a metric space of computer-generated novel objects varying in shape. These objects were then printed using a 3-D printer, to generate tangible stimuli. In a categorization experiment, participants first explored the objects visually and haptically. We found that both modalities led to highly similar categorization behavior. Next, participants were trained either visually or haptically on shape categories within the metric space. As expected, visual training increased visual performance, and haptic training increased haptic performance. Importantly, however, we found that visual training also improved haptic performance, and vice versa. Two additional experiments showed that the location of the categorical boundary in the metric space also transferred across modalities, as did heightened discriminability of objects adjacent to the boundary. This observed transfer of metric category knowledge across modalities indicates that visual and haptic forms of shape information are integrated into a shared multisensory representation.     

Object categorization: reversals and explanations of the basic-level advantage

People are generally faster and more accurate to name or categorize objects at the basic level (e.g., dog) relative to more general (animal) or specific (collie) levels, an effect replicated in Experiment 1 for categorization of object pictures. To some, this pattern suggests a dual-process mechanism, in which objects first activate basic-level categories directly and later engage more general or specific categories through the spread of activation in a processing hierarchy. This account is, however, challenged by data from Experiment 2 showing that neuropsychological patients with impairments of conceptual knowledge categorize more accurately at superordinate levels than at the basic level--suggesting that knowledge about an object's general nature does not depend on prior basic-level categorization. The authors consider how a parallel distributed processing theory of conceptual knowledge can reconcile the apparent discrepancy. This theory predicts that if healthy individuals are encouraged to make rapid categorization responses, the usual basic > general advantage should also reverse, a prediction tested and confirmed in Experiment 3. Implications for theories of visual object recognition are discussed.     

Effects of a concurrent memory task on hemispheric asymmetries in categorization

Recent research on the division of processing between the two cerebral hemispheres has often employed two concurrent tasks to investigate the dynamic nature of hemispheric asymmetries. The experiment reported here explored the effects of two concurrent high-level cognitive tasks (memory retention and semantic categorization) on the direction and magnitude of hemispheric differences in the processing of words and pictures. Subjects were required to categorize words and pictures presented to either the left visual field-right hemisphere (LVF-RH) or the right visual field-left hemisphere (RVF-LH). The categorization could be performed while holding either verbal material in memory (digit span), pictorial material in memory (serial nonsense figure recognition), or with no concurrent memory task. The effects produced hemisphere-specific, material-nonspecific interference. The verbal task removed a RVF-LH advantage at word categorization and enhanced a LVF-RH advantage on picture categorization; the pictorial task interfered with picture categorization in the LVF-RH, while enhancing a RVF-LH advantage at word categorization. The results are discussed in terms of multiple resource models of hemisphere function, capacity limitations, and the functional locus of processing required to produce various dynamic hemispheric effects.     

语义相似性与类别大小对图-词干扰范式下语义效应的影响

采用基本水平命名和类别水平命名任务, 通过2个实验, 考察了图-词之间的语义相似性与类别大小对图-词干扰范式下语义效应的影响。实验1发现, 图片命名时间在语义相似性高的干扰词条件下显著快于在语义相似性低的干扰词条件下, 但这种效应只出现在基本水平命名任务中, 未出现在类别水平命名任务中。图-词之间的语义相似性高低对低熟悉图片命名影响大, 对高熟悉图片命名影响小。实验2显示, 语义关联的干扰词对图片的基本水平命名产生了语义干扰效应, 对图片的类别水平命名产生了语义促进效应。类别大小强化了语义效应：类别大, 图片的基本水平命名的语义干扰效应更大, 图片的类别水平命名的语义促进效应更强。整个研究表明, 图-词之间的语义关联的强度影响语义效应的方向, 图-词之间的语义关联的广度影响语义效应的强弱。需要结合多种理论来解释图-词之间的语义相似性和类别大小对图-词干扰范式下语义效应的影响。     

Visual priming effects as a measure of short-term visual memory

On each trial, subjects classified one of four letters as belonging to one of two categories. Visual priming occurs when the classification response is faster to a stimulus visually identical to a previous stimulus than to one identical only in name. Earlier experiments found no visual priming effects between stimuli separated by a stimulus of the same task but from the opposite classification category. Two of the five conditions in the present experiment varied the stimulus-response (S-R) contingencies in such a way that the penultimate but not the immediately preceding trial had the same contingencies. Only these two conditions gave evidence of the above type of visual priming. Visual priming was found, however, in almost all conditions when the intervening stimulus was from the same task and the same classification category. It is argued that a similarity of S-R contingency, and not simply stimulus similarity, is an important component of the visual priming effect.     

Tracing the time course of picture--word processing

A number of independent lines of research have suggested that semantic and articulatory information become available differentially from pictures and words. The first of the experiments reported here sought to clarify the time course by which information about pictures and words becomes available by considering the pattern of interference generated when incongruent pictures and words are presented simultaneously in a Stroop-like situation. Previous investigators report that picture naming is easily disrupted by the presence of a distracting word but that word naming is relatively immune to interference from an incongruent picture. Under the assumption that information available from a completed process may disrupt an ongoing process, these results suggest that words access articulatory information more rapidly than do pictures. Experiment 1 extended this paradigm by requiring subjects to verify the category of the target stimulus. In accordance with the hypothesis that picture access the semantic code more rapidly than words, there was a reversal in the interference pattern: Word categorization suffered considerable disruption, whereas picture categorization was minimally affected by the presence of an incongruent word. Experiment 2 sought to further test the hypothesis that access to semantic and articulatory codes is different for pictures and words by examining memory for those items following naming or categorization. Categorized words were better recognized than named words, whereas the reverse was true for pictures, a result which suggests that picture naming involves more extensive processing than picture categorization. Experiment 3 replicated this result under conditions in which viewing time was held constant. The last experiment extended the investigation of memory differences to a situation in which subjects were required to generate the superordinate category name. Here, memory for categorized pictures was as good as memory for named pictures. Category generation also influenced memory for words, memory performance being superior to that following a yes--no verification of category membership. These experiments suggest a model of information access whereby pictures access semantic information were readily than name information, with the reverse being true for words. Memory for both pictures and words was a function of the amount of processing required to access a particular type of information as well as the extent of response differentiation necessitated by the task.     

汉字词和图片命名与分类的比较

采用命名与分类任务考察了汉字词和图片命名与分类的特点,揭示义符在汉字词和图片命名与分类中的作用。结果表明,汉字词和图片的命名与分类与拼音文字的词和图片的命名和分类既有共性,又有差异。汉字词和图片的命名与分类具有不对称性：汉字词的命名快于汉字词的分类,图片的分类快于图片的命名。义符对于汉字词和图片的命名与分类的影响具有不对称性：对汉字词的加工有重要影响,对图片的加工无影响;对汉字词的分类有重要影响,对汉字词的命名无影响。被试对有标示类别的义符的词的分类显著快于对无标示类别的义符的词的分类,甚至快于对图片的分类。所以如此,与汉字词的结构特点有关。汉字形声字多用义符来标记事物的类别,提供了重要的类别信息。根据上述结果,作者构建了汉字词和图片认知加工的综合模型     

Age-related changes in event-cued visual and auditory prospective memory proper

We rely upon prospective memory proper (ProMP) to bring back to awareness previously formed plans and intentions at the right place and time, and to enable us to act upon those plans and intentions. To examine age-related changes in ProMP, younger and older participants made decisions about simple stimuli (ongoing task) and at the same time were required to respond to a ProM cue, either a picture (visually cued ProM test) or a sound (auditorily cued ProM test), embedded in a simultaneously presented series of similar stimuli (either pictures or sounds). The cue display size or loudness increased across trials until a response was made. The cue size and cue loudness at the time of response indexed ProMP. The main results showed that both visual and auditory ProMP declined with age, and that such declines were mediated by age declines in sensory functions (visual acuity and hearing level), processing resources, working memory, intelligence, and ongoing task resource allocation.     

Similarity effects in visual working memory

Perceptual similarity is an important property of multiple stimuli. Its computation supports a wide range of cognitive functions, including reasoning, categorization, and memory recognition. It is important, therefore, to determine why previous research has found conflicting effects of inter-item similarity on visual working memory. Studies reporting a similarity advantage have used simple stimuli whose similarity varied along a featural continuum. Studies reporting a similarity disadvantage have used complex stimuli from either a single or multiple categories. To elucidate stimulus conditions for similarity effects in visual working memory, we tested memory for complex stimuli (faces) whose similarity varied along a morph continuum. Participants encoded 3 morphs generated from a single face identity in the similar condition, or 3 morphs generated from different face identities in the dissimilar condition. After a brief delay, a test face appeared at one of the encoding locations for participants to make a same/different judgment. Two experiments showed that similarity enhanced memory accuracy without changing the response criterion. These findings support previous computational models that incorporate featural variance as a component of working memory load. They delineate limitations of models that emphasize cortical resources or response decisions.     

Pictorial similarity judgments and the organization of visual memory in the rhesus monkey

The organization of visual memory for pictures was studied in the rhesus monkey. Two monkeys were tested in a same/different task in which sequentially presented pictures were compared to each other in a pair-wise fashion. The resulting confusion matrixes were analyzed using a multidimensional scaling procedure to obtain two- and three-dimensional graphic representations of the stimulus space. In Experiment 1, the monkeys' confusion errors caused pictures of human and rhesus monkey faces to fall in the same region of multidimensional space, which suggested that the monkeys categorized facial stimuli. A similar effect was found for pictures of different types of fruit. Experiment 2 replicated the categorization of faces with a more diverse collection of human and nonhuman primate faces. Experiment 3 explored the fruit category by varying stimulus attributes orthogonally. The results from this experiment showed that both monkeys encoded the pictures in this category by type of fruit (apples or grapes) and color (red or yellow). Taken together, these studies indicate that rhesus monkeys will treat some classes of pictorial stimuli categorically in visual memory.