Categorizing chairs and naming pears: Category differences in object processing as a function of task and priming

Four experiments are reported examining the locus of structural similarity effects in picture recognition and naming with normal subjects. Subjects carried out superordinate categorization and naming tasks with picture and word forms of clothing, furniture, fruit, and vegetable exemplars. The main findings were as follows: (1) Responses to pictures of fruit and vegetables (\ldstructurally similar\rd objects) were slowed relative to pictures of clothing and furniture (\ldstructurally dissimilar\rd objects). This structural similarity difference was greater for picture naming than for superordinate categorization of pictures. (2) Structural similarity effects in picture naming were reduced by repetition priming. Repetition priming effects were equivalent from picture and word naming as prime tasks. (3) However, superordinate categorization of the prime did not produce the structural similarity effects on priming found for picture naming. Furthermore, such priming effects did not arise for picture or word categorization or for reading picture names as target tasks. It is proposed that structural similarity effects on priming object processing are located in processes mapping semantic representations of pictures to name representations required to select names for objects. Visually based competition between fruit and vegetables produces competition in name selection, which is reduced by priming the mappings between semantic and name representations.     

Detecting meaning in RSVP at 13 ms per picture

The visual system is exquisitely adapted to the task of extracting conceptual information from visual input with every new eye fixation, three or four times a second. Here we assess the minimum viewing time needed for visual comprehension, using rapid serial visual presentation (RSVP) of a series of six or 12 pictures presented at between 13 and 80 ms per picture, with no interstimulus interval. Participants were to detect a picture specified by a name (e.g., smiling couple) that was given just before or immediately after the sequence. Detection improved with increasing duration and was better when the name was presented before the sequence, but performance was significantly above chance at all durations, whether the target was named before or only after the sequence. The results are consistent with feedforward models, in which an initial wave of neural activity through the ventral stream is sufficient to allow identification of a complex visual stimulus in a single forward pass. Although we discuss other explanations, the results suggest that neither reentrant processing from higher to lower levels nor advance information about the stimulus is necessary for the conscious detection of rapidly presented, complex visual information.     

影响动作图片命名的因素

图片是研究词汇习得与加工的重要材料, 而名词和动词是最主要的两类实词。然而, 目前较少有研究考察汉语中的动词加工过程, 也没有标准化的动词图片库。本研究通过成人图片命名和评定任务, 获得了265张动词图片的中文名称、命名反应时, 以及H值、命名一致性、熟悉性、视觉复杂性、表象一致性和口语习得年龄等指标, 同时也探索了影响动作图片命名反应时的因素。逐步回归分析结果发现, H值、熟悉性和视觉复杂性这三个变量可解释动词图片命名反应时72.4%的变异。此外, 本研究根据图片命名反应时将动词图片加工难度分成了五个等级。研究发现, 与名词图片相比, 动词图片的视觉复杂性更高、命名一致性更低、命名反应时更长。本研究获得的各项心理语言学指标有望为后续关于动词加工的实验研究提供重要的参考资料。     

Theoretical analysis of the cognitive processing of lexical and pictorial stimuli: reading, naming, and visual and conceptual comparisons

This article reviews the research literature on the differences between word reading and picture naming. A theory for the visual and cognitive processing of pictures and words is then introduced. The theory accounts for slower naming of pictures than reading of words. Reading aloud involves a fast, grapheme-to-phoneme transformation process, whereas picture naming involves two additional processes: (a) determining the meaning of the pictorial stimulus and (b) finding a name for the pictorial stimulus. We conducted a reading-naming experiment, and the time to achieve (a) and (b) was determined to be approximately 160 ms. On the basis of data from a second experiment, we demonstrated that there is no significant difference in time to visually compare two pictures or two words when size of the stimuli is equated. There is no difference in time to make the two types of cross-modality conceptual comparisons (picture first, then word, or word first, then picture). The symmetry of the visual and conceptual comparison results supports the hypothesis that the coding of the mind is neither intrinsically linguistic nor imagistic, but rather it is abstract. There is a potent stimulus size effect, equal for both pictorial and lexical stimuli. Small stimuli take longer to be visually processed than do larger stimuli. For optimal processing, stimuli should not only be equated for size, but should subtend a visual angle of at least 3 degrees. The article ends with the presentation of a mathematical theory that jointly accounts for the data from word-reading, picture-naming visual comparison, and conceptual-comparison experiments.     

图词间隔时间影响口语词汇产生中语义效应的机制：图词干扰范式研究

口语词汇产生过程中存在语义抑制和语义促进效应, 可能发生在概念准备和词汇选择或者后词汇水平阶段。本研究采用图画-词汇干扰实验任务, 变化图画与词汇出现点之间的时间间隔(stimulus onset asynchrony, SOA), 运用脑电技术考察口语词汇产生中语义效应发生的时间进程。结果显示, 当SOA为0 ms时表现出语义抑制效应, 语义效应发生在词汇选择阶段(344~418 ms); 当SOA为-400 ms时, 语义效应发生在概念准备阶段(0~76 ms)和词汇选择阶段(274~390 ms); 460~594 ms时间窗口内的语义效应可能表明讲话者对语义信息的自我监测。词汇产生中存在语义促进效应和抑制效应的权衡, 影响了行为结果中语义效应的方向, 上述发现支持了口语词汇产生的词汇竞争假说。     

Integrating information across eye movements

A series of experiments was conducted in which a word initially appeared in parafoveal vision, followed by the subject's eye movement to the stimulus. During the eye movement, the initially displayed word was replaced by a word which the subject read. Under certain conditions, the prior parafoveal word facilitated naming the foveal word. Three alternative hypotheses were explored concerning the nature of the facilitation. The verbalization hypothesis suggests that information acquired from the parafoveal word permits the subject to begin to form the speech musculature properly for saying the word. The visual features integration hypothesis suggests that visual information obtained from the parafoveal word is integrated with foveal information after the saccade. The preliminary letter identification hypothesis suggests that some abstract code about the letters of the parafoveal word is stored and integrated with information available in the fovea after the saccade. The results of the experiments supported the latter hypothesis in that information about the beginning letters of words was facilitatory in the task. The other two hypotheses were disconfirmed by the results of the experiments.     

Types and tokens in transsaccadic object identification: effects of spatial position and left-right orientation

What types of representations support our ability to integrate information acquired during one eye fixation with information acquired during the next fixation? In Experiment 1, transsaccadic integration was explored by manipulating whether or not the relative position of a picture of an object was maintained across a saccade. In Experiment 2, the degree to which visual details of a picture are coded in a position-specific representational system was explored by manipulating whether or not both the relative position and the left-right orientation of the picture were maintained across a saccade. Position-specific and nonspecific preview benefits were observed in both experiments. Only the position-specific benefits were influenced by the number of task-relevant pictures presented in the preview display (Experiment 1) and the left-right orientation of the picture presented in the preview display (Experiment 2). The results support a model of transsaccadic integration based on two independent representational systems. One system codes abstract, prestored object types, and the other codes episodic tokens consisting of stimulus properties linked to scene- or configuration-based position markers.     

A funny thing happened on the way to articulation: N400 attenuation despite behavioral interference in picture naming

We measured Event-Related Potentials (ERPs) and naming times to picture targets preceded by masked words (stimulus onset asynchrony: 80 ms) that shared one of three different types of relationship with the names of the pictures: (1) Identity related, in which the prime was the name of the picture ("socks" - ), (2) Phonemic Onset related, in which the initial segment of the prime was the same as the name of the picture ("log" - ), and (3) Semantically related in which the prime was a co-category exemplar and associated with the name of the picture ("cake" - ). Each type of related picture target was contrasted with an Unrelated picture target, resulting in a 3×2 design that crossed Relationship Type between the word and the target picture (Identity, Phonemic Onset and Semantic) with Relatedness (Related and Unrelated). Modulation of the N400 component to related (versus unrelated) pictures was taken to reflect semantic processing at the interface between the picture's conceptual features and its lemma, while naming times reflected the end product of all stages of processing. Both attenuation of the N400 and shorter naming times were observed to pictures preceded by Identity related (versus Unrelated) words. No ERP effects within 600 ms, but shorter naming times, were observed to pictures preceded by Phonemic Onset related (versus Unrelated) words. An attenuated N400 (electrophysiological semantic priming) but longer naming times (behavioral semantic interference) were observed to pictures preceded by Semantically related (versus Unrelated) words. These dissociations between ERP modulation and naming times suggest that (a) phonemic onset priming occurred late, during encoding of the articulatory response, and (b) semantic behavioral interference was not driven by competition at the lemma level of representation, but rather occurred at a later stage of production.     

Picture perception: effects of luminance on available information and information-extraction rate

In each of four experiments, complex visual stimuli--pictures and digit arrays--were remembered better when shown at high luminance than when shown at low luminance. Why does this occur? Two possibilities were considered: first that lowering luminance reduces the amount of available information in the stimulus, and second that lowering luminance reduces the rate at which the information is extracted from the stimulus. Evidence was found for both possibilities. When stimuli were presented at durations short enough to permit only a single eye fixation, luminance affected only the rate at which information is extracted: decreasing luminance by a factor of 100 caused information to be extracted more slowly by a factor that ranged, over experiments, from 1.4 to 2.0. When pictures were presented at durations long enough to permit multiple fixations, however, luminance affected the total amount of extractable information. In a fifth experiment, converging evidence was sought for the proposition that within the first eye fixation on a picture, luminance affects the rate of information extraction. If this proposition is correct and, in addition, the first eye fixation lasts until some criterion amount of information is extracted, then fixation duration should increase with decreasing luminance. This prediction was confirmed.     

Picture-name priming in the cerebral hemispheres: evidence for phonological access in the right hemisphere

This study investigated right hemisphere involvement in access to phonology, using a picture-naming priming paradigm where pictures and names of common objects printed in Japanese Kana were presented in succession to the same visual field or different visual fields with a stimulus onset asynchrony of 250 msec. A naming task was used for this purpose. The result showed that, when primes and targets were presented to the same visual field, facilitation for related pairs was observed in each hemisphere, with overall naming latencies being slower in the right hemisphere than in the left hemisphere. This result indicates that the prior access to phonology for a picture in the right hemisphere facilitates phonological activation of a word that names the picture in this hemisphere, suggesting that the right hemisphere is involved in access to phonology. On the other hand, when primes and targets were presented to different visual fields, there was no facilitation for related pairs with inhibition for unrelated pairs, irrespective of prime and target visual fields. It is suggested that this inhibition-dominant pattern of priming may occur due to homotopic inhibition processes proposed by N. D. Cook.     

Eye movements during repeated reading of a text

The facilitation of eye movements was studied in two experiments involving a repeated reading paradigm. A text was read three times. Initial reading was immediately followed by the first repetition; the second repetition took place one week later. Recall task instructions were used to encourage a detailed reading of the text. The data were analysed sentence by sentence from the 'first pass' readings not including returns to earlier test locations. A general facilitation for all eye movement parameters was found. Repetition decreased the summed fixation time, the average fixation duration, the number of progressive fixations, and the number of regressions. Additionally, repetition increased saccade lengths. Experiment 2 further qualified the general facilitory effect. The middle section of the text, being the most dense of information, was devoted the most visual attention by the readers. Moreover, it was also found to produce the largest degree of facilitation due to repetition. This was true with all other eye movement parameters except saccade length and average fixation duration. Average fixation durations were longer in the beginning of a text than in the end. This was true in all the three readings. Similarly, for each reading, highly important sentences received more visual attention than unimportant sentences.     

How lingering representations of abandoned context words affect speech production

Four experiments tested whether and how initially planned but then abandoned speech can influence the production of a subsequent resumption. Participants named initial pictures, which were sometimes suddenly replaced by target pictures that were related in meaning or word form or were unrelated. They then had to stop and resume with the name of the target picture. Target picture naming latencies were measured separately for trials in which the initial speech was skipped, interrupted, or completed. Semantically related initial pictures helped the production of the target word, although the effect dissipated once the utterance of the initial picture name had been completed. In contrast, phonologically related initial pictures hindered the production of the target word, but only for trials in which the name of the initial picture had at least partly been uttered. This semantic facilitation and phonological interference did not depend on the time interval between the initial and target picture, which was either varied between 200 ms and 400 ms (Experiments 1-2) or was kept constant at 300 ms (Experiments 3-4). We discuss the implications of these results for models of speech self-monitoring and for models of problem-free word production.     

Tracing the time course of picture--word processing

A number of independent lines of research have suggested that semantic and articulatory information become available differentially from pictures and words. The first of the experiments reported here sought to clarify the time course by which information about pictures and words becomes available by considering the pattern of interference generated when incongruent pictures and words are presented simultaneously in a Stroop-like situation. Previous investigators report that picture naming is easily disrupted by the presence of a distracting word but that word naming is relatively immune to interference from an incongruent picture. Under the assumption that information available from a completed process may disrupt an ongoing process, these results suggest that words access articulatory information more rapidly than do pictures. Experiment 1 extended this paradigm by requiring subjects to verify the category of the target stimulus. In accordance with the hypothesis that picture access the semantic code more rapidly than words, there was a reversal in the interference pattern: Word categorization suffered considerable disruption, whereas picture categorization was minimally affected by the presence of an incongruent word. Experiment 2 sought to further test the hypothesis that access to semantic and articulatory codes is different for pictures and words by examining memory for those items following naming or categorization. Categorized words were better recognized than named words, whereas the reverse was true for pictures, a result which suggests that picture naming involves more extensive processing than picture categorization. Experiment 3 replicated this result under conditions in which viewing time was held constant. The last experiment extended the investigation of memory differences to a situation in which subjects were required to generate the superordinate category name. Here, memory for categorized pictures was as good as memory for named pictures. Category generation also influenced memory for words, memory performance being superior to that following a yes--no verification of category membership. These experiments suggest a model of information access whereby pictures access semantic information were readily than name information, with the reverse being true for words. Memory for both pictures and words was a function of the amount of processing required to access a particular type of information as well as the extent of response differentiation necessitated by the task.     

Accessing lexical memory: The transfer of word repetition effects across task and modality

Reading by literate adults is generally assumed to represent skill acquired years earlier. However, the present experiments show that aspects of that skill can be readily modified. In two experiments, pronunciation of visually presented common words speeded later recognition of those words. This facilitation of recognition occurred although subjects did not expect word repetition and the task was changed from pronunciation to recognition. In contrast, naming pictures did not facilitate later recognition of visually presented picture names. The occurrence of facilitation when the task was changed and the lack of facilitation when stimulus format was changed suggest that facilitation occurs in the processes of encoding and accessing memory, processes that may change little across tasks but may change substantially with stimulus format changes. This facilitation of recognition occurs automatically without mediation by subjects’ expectations. A third experiment indicates that this facilitation of recognition shows little relation to episodic memory.     

语义相似性与类别大小对图-词干扰范式下语义效应的影响

采用基本水平命名和类别水平命名任务, 通过2个实验, 考察了图-词之间的语义相似性与类别大小对图-词干扰范式下语义效应的影响。实验1发现, 图片命名时间在语义相似性高的干扰词条件下显著快于在语义相似性低的干扰词条件下, 但这种效应只出现在基本水平命名任务中, 未出现在类别水平命名任务中。图-词之间的语义相似性高低对低熟悉图片命名影响大, 对高熟悉图片命名影响小。实验2显示, 语义关联的干扰词对图片的基本水平命名产生了语义干扰效应, 对图片的类别水平命名产生了语义促进效应。类别大小强化了语义效应：类别大, 图片的基本水平命名的语义干扰效应更大, 图片的类别水平命名的语义促进效应更强。整个研究表明, 图-词之间的语义关联的强度影响语义效应的方向, 图-词之间的语义关联的广度影响语义效应的强弱。需要结合多种理论来解释图-词之间的语义相似性和类别大小对图-词干扰范式下语义效应的影响。     

Time course of frequency effects in spoken-word recognition: evidence from eye movements

In two experiments, eye movements were monitored as participants followed spoken instructions to click on and move pictures with a computer mouse. In Experiment 1, a referent picture (e.g., the picture of a bench) was presented along with three pictures, two of which had names that shared the same initial phonemes as the name of the referent (e.g., bed and bell). Participants were more likely to fixate the picture with the higher frequency name (bed) than the picture with the lower frequency name (bell). In Experiment 2, referent pictures were presented with three unrelated distractors. Fixation latencies to referents with high-frequency names were shorter than those to referents with low-frequency names. The proportion of fixations to the referents and distractors were analyzed in 33-ms time slices to provide fine-grained information about the time course of frequency effects. These analyses established that frequency affects the earliest moments of lexical access and rule out a late-acting, decision-bias locus for frequency. Simulations using models in which frequency operates on resting-activation levels, on connection strengths, and as a postactivation decision bias provided further constraints on the locus of frequency effects.     

Tactual picture identification by blind and sighted people: Effects of providing categorical information

Four experiments examined the influence of categorical information and visual experience on the identification of tangible pictures, produced with a raised-line drawing kit. In Experiment 1, prior categorical information aided the accuracy and speed of picture identification. In a second experiment, categorical information helped subjects when given after the examination of each picture, but before any attempt at identification. The benefits of categorical information were also obtained in another group of subjects, when the superordinate categories were named at the start of the experiment. In a third experiment, a multiple-choice picture recognition task was used to eliminate the difficulty of naming from the picture-identification task. The multiple-choice data showed higher accuracy and shorter latencies when compared with identification tasks. A fourth experiment evaluated picture identification in blindfolded sighted, early, and late blind participants. Congenitally blind subjects showed lower performance than did the other groups, despite the availability of prior categorical information. The data were consistent with theories that assume that visual imagery aids tactual perception in naming raised line drawings. It was proposed that part of the difficulty in identification of raised line pictures may derive from problems in locating picture categories or names, and not merely in perception of the patterns.     

返回抑制和情绪信息注意偏向的竞争：来自眼动的证据

返回抑制与情绪注意偏向是研究视觉注意的两个视角,二者的优先性一直存在争议。本研究采用线索—靶子范式,在靶子位置呈现情绪图片,结合眼动技术,对整体反应时进行分解,探讨情绪信息与实验任务相关条件下的返回抑制和情绪注意偏向。结果发现：返回抑制效应出现;情绪信息与实验任务的相关性影响了个体对情绪信息早期的注意捕获;有效线索对情绪信息的加工抑制有限,情绪信息的加工表现出了自动化倾向。     

Episodic effects on picture identification: implications for theories of concept learning and theories of memory

The effects of differences in study processing on free recall of picture names and on generalization in picture identification were investigated. Experience with degraded pictures produced poorer subsequent free recall of picture names than did naming intact pictures. For the test of picture identification, pictures that were identical to a studied picture, pictures that shared a name with a studied picture (same name), and new test pictures were presented, and the amount of clarification required to identify a picture was measured. Experience with degraded pictures produced better subsequent identification of identical test pictures but poorer later identification of same-name test pictures than did naming intact pictures. The importance of these episodic effects for theories of concept learning and theories of memory is discussed. It is argued that distinctions between memory systems (e.g., episodic-semantic) must be couched in terms of a theory of concept learning and that the data are inconsistent with a simple distinction.