Acquiring experiential traces in word-referent learning

In two experiments, we investigated the activation of perceptual representations of referent objects during word processing. In both experiments, participants learned to associate pictures of novel three-dimensional objects with pseudowords. They subsequently performed a recognition task (Experiment 1) or a naming task (Experiment 2) on the object names while being primed with different types of visual stimuli. Only the stimuli that the participants had encountered as referent objects during the training phase facilitated recognition or naming responses. New stimuli did not facilitate the processing of object names, even if they matched a schematic or prototypical representation of the referent object that the participants might have abstracted during word-referent learning. These results suggest that words learned by way of examples of referent objects are associated with experiential traces of encounters with these objects.     

Memory for product sounds: the effect of sound and label type

The (mnemonic) interactions between auditory, visual, and the semantic systems have been investigated using structurally complex auditory stimuli (i.e., product sounds). Six types of product sounds (air, alarm, cyclic, impact, liquid, mechanical) that vary in spectral-temporal structure were presented in four label type conditions: self-generated text, text, image, and pictogram. A memory paradigm that incorporated free recall, recognition, and matching tasks was employed. The results for the sound type suggest that the amount of spectral-temporal structure in a sound can be indicative for memory performance. Findings related to label type suggest that 'self' creates a strong bias for the retrieval and the recognition of sounds that were self-labeled; the density and the complexity of the visual information (i.e., pictograms) hinders the memory performance ('visual' overshadowing effect); and image labeling has an additive effect on the recall and matching tasks (dual coding). Thus, the findings suggest that the memory performances for product sounds are task-dependent.     

Effects of preexposure on stimulus discrimination: An investigation of the mechanisms responsible for human perceptual learning

The effect of preexposure on human perceptual learning was investigated in four experiments. In Experiments 1a and 1b, participants were preexposed to one pair of visual stimuli on an intermixed schedule (AX/BX) and one on a blocked schedule (CX_DX). The ability to discriminate between AX and BX and between CX and DX was then assessed by examining the extent to which key presses assigned to each member of a stimulus pair generalized to the other member (Experiment 1a) and by looking at the accuracy of same–different responses (Experiment 1b). Stimuli were more easily discriminated following intermixed than following blocked preexposure on both the generalization and same–different tasks. This suggests that two stimuli are more perceptually distinct after intermixed preexposure. Experiments 2a and 2b investigated the mechanisms responsible for perceptual learning using same–different tasks. The results support the suggestion that the enhanced discrimination observed after intermixed preexposure is due to increases in the salience of the unique elements.     

Attentional capture of objects referred to by spoken language

Participants saw a small number of objects in a visual display and performed a visual detection or visual-discrimination task in the context of task-irrelevant spoken distractors. In each experiment, a visual cue was presented 400 ms after the onset of a spoken word. In experiments 1 and 2, the cue was an isoluminant color change and participants generated an eye movement to the target object. In experiment 1, responses were slower when the spoken word referred to the distractor object than when it referred to the target object. In experiment 2, responses were slower when the spoken word referred to a distractor object than when it referred to an object not in the display. In experiment 3, the cue was a small shift in location of the target object and participants indicated the direction of the shift. Responses were slowest when the word referred to the distractor object, faster when the word did not have a referent, and fastest when the word referred to the target object. Taken together, the results demonstrate that referents of spoken words capture attention.     

Is anaphoric reference cooperative?

Two experiments investigated whether the choice of anaphoric expression is affected by the presence of an addressee. Following a context sentence and visual scene, participants described a target scene that required anaphoric reference. They described the scene either to an addressee (Experiment 1) or without an addressee (Experiment 2). When an addressee was present in the task, participants used more pronouns and fewer repeated noun phrases when the referent was the grammatical subject in the context sentence than when it was the grammatical object and they used more pronouns when there was no competitor than when there was. They used fewer pronouns and more repeated noun phrases when a visual competitor was present in the scene than when there was no visual competitor. In the absence of an addressee, linguistic context effects were the same as those when an addressee was present, but the visual effect of the competitor disappeared. We conclude that visual salience effects are due to adjustments that speakers make when they produce reference for an addressee, whereas linguistic salience effects appear whether or not speakers have addressees.     

Testing the representation of time in reference memory in the bisection and the generalization task: the utility of a developmental approach

This study examined the effect of the variability of representation of durations in reference memory on temporal discrimination performance in children aged 5 and 8 years as well as in adults using a bisection (Experiment 1) and a generalization task (Experiment 2). In each task, the participants were familiarized before the blocks of tested trials with either the same referent duration values (fixed condition) or a distribution of referent duration values, with a mean equal to the referent durations used in the fixed condition and a .20 coefficient of variation (variable condition). The results showed that the sensitivity to duration was lower in the variable than in the fixed condition in the children and, to a lesser extent, in the adults. The modelling of the data indicated that this effect was due to the increase in the variability of the representation of durations in reference memory, but also to changes in the decisional processes.     

Testing the representation of time in reference memory in the bisection and the generalization task: The utility of a developmental approach

This study examined the effect of the variability of representation of durations in reference memory on temporal discrimination performance in children aged 5 and 8 years as well as in adults using a bisection (Experiment 1) and a generalization task (Experiment 2). In each task, the participants were familiarized before the blocks of tested trials with either the same referent duration values (fixed condition) or a distribution of referent duration values, with a mean equal to the referent durations used in the fixed condition and a .20 coefficient of variation (variable condition). The results showed that the sensitivity to duration was lower in the variable than in the fixed condition in the children and, to a lesser extent, in the adults. The modelling of the data indicated that this effect was due to the increase in the variability of the representation of durations in reference memory, but also to changes in the decisional processes.     

Looking at the rope when looking for the snake: Conceptually mediated eye movements during spoken-word recognition

Participants’ eye movements to four objects displayed on a computer screen were monitored as the participants clicked on the object named in a spoken instruction. The display contained pictures of the referent (e.g., a snake), a competitor that shared features with the visual representation associated with the referent’s concept (e.g., a rope), and two distractor objects (e.g., a couch and an umbrella). As the first sounds of the referent’s name were heard, the participants were more likely to fixate the visual competitor than to fixate either of the distractor objects. Moreover, this effect was not modulated by the visual similarity between the referent and competitor pictures, independently estimated in a visual similarity rating task. Because the name of the visual competitor did not overlap with the phonetic input, eye movements reflected word-object matching at the level of lexically activated perceptual features and not merely at the level of preactivated sound forms.     

Brain potentials associated with recollective processing of spoken words

The neurocognitive foundations of recollection can be explored by recording event-related potentials (ERPs) from the human brain. In the present study, we monitored brain activity while participants heard a series of words, first in a study phase and again, 1-2 min later, in a test phase, when both priming and recognition were measured. Level of processing at study was manipulated within-subjects via instructions either to visualize the referent of each word (the image task) or to detect the presence of target letters (the letter task). Priming of lexical decision response time was observed but did not differ across study task, whereas recognition was better for image- than for letter-task words. Brain potentials recorded at test revealed a task effect, wherein ERPs were more positive for image- than for letter-task words approximately 600-900 msec after word onset. The task effect was restricted to posterior scalp locations and was interpreted as an indication of visual imagery triggered by spoken words. Given that similar potentials were also elicited at study, we speculate that accurate recognition of words from the image task involved the recapitulation of the visual imagery that was initially engaged during the study phase.     

An empirical evaluation of the visual rightness theory of pictorial composition

This research tested the visual rightness theory of pictorial composition's assertion that the induced organizational structure of a visually right (i.e., "good") design is perceptually salient and judged superior by anyone viewing it regardless of his or her training in the visual arts. Stimuli for Experiments 1 and 2 consisted of 16 reproductions of paintings by renowned artists and an experimentally reconstructed less-well-organized version of each art stimulus. It was found that design professionals (Experiment 2) were significantly more successful at detecting the original versions than were participants untrained in the visual arts (Experiment 1) (hit rates = 64% and 55%, respectively). In Experiment 3 participants replaced a major structural element removed from each of six pictures of the stimulus set at the location where they thought it appears in the original. A significant number of untrained participants and those with training in design theory were in agreement as to the location of each element within its pictorial field; the location chosen conformed to its compositional structure but not its actual location in the original. Findings demonstrate that the ability to detect the induced structural skeleton of a painting resulting from a visually right design does not require expert knowledge of design principles whereas the ability to discriminate between several articulation possibilities of the same composition does require formal training.     

Effects of preexposure on stimulus discrimination: an investigation of the mechanisms responsible for human perceptual learning

The effect of preexposure on human perceptual learning was investigated in four experiments. In Experiments 1a and 1b, participants were preexposed to one pair of visual stimuli on an intermixed schedule (AX/BX) and one on a blocked schedule (CX_DX). The ability to discriminate between AX and BX and between CX and DX was then assessed by examining the extent to which key presses assigned to each member of a stimulus pair generalized to the other member (Experiment 1a) and by looking at the accuracy of same-different responses (Experiment 1b). Stimuli were more easily discriminated following intermixed than following blocked preexposure on both the generalization and same-different tasks. This suggests that two stimuli are more perceptually distinct after intermixed preexposure. Experiments 2a and 2b investigated the mechanisms responsible for perceptual learning using same-different tasks. The results support the suggestion that the enhanced discrimination observed after intermixed preexposure is due to increases in the salience of the unique elements.     

编码方式对陌生字形记忆的影响

采用学习-再认范式,分别以韩字、英文假词为实验材料,考察了编码方式对陌生字形记忆的影响。在学习阶段,通过随机呈现整体和部分探测刺激,引导被试分别以整体编码和部分编码方式学习陌生字形,并在学习结束后一小时进行再认记忆测试。结果发现,无论以韩字还是以英文假词为材料,部分编码条件的记忆成绩均显著好于整体编码。该结果说明部分编码相比于整体编码能促进陌生字形记忆,并且这种优势效应具有跨文字系统的一致性。     

Orientation of attention to nonconsciously recognised famous faces

The nonconscious orientation of attention to famous faces was investigated using masked 17 ms stimulus exposure. Each trial presented a simultaneous pair of one famous and one unfamiliar face, matched on physical characteristics, one each in left visual field (LVF) and right visual field (RVF). These were followed by a dot probe in either LVF or RVF to which participants made a speeded two-alternative forced-choice discrimination response. Participants subsequently evaluated the affective valence (good/evil) of the famous persons on a 7-point scale. Higher accuracy of dot probe discrimination in the same visual field (VF) as the famous face suggested that attention was oriented towards faces of persons evaluated “good”, but a reverse orientation effect was observed for those evaluated “evil”. The awareness check presented the same face pairs under the same conditions, and participants were at chance in a task of selecting the famous face in each pair. The results suggest that famous faces can be identified without awareness, and that attention is attracted by the faces of famous persons not regarded as “evil”.     

Naming and equivalence: Response latencies for emergent relations

In an attempt to distinguish between associative network and verbal mediation accounts of equivalence formation, three experiments were carried out in which conditional stimulus relations were established and response latencies assessed during tests for emergent relations. In Experiment 1, three groups of adults were trained with six three-member classes of visual stimuli, using different kinds of stimuli for each group: readily nameable pictograms, which were “preassociated” (Group 1); equally nameable but “non-associated” pictograms (Group 2); or non-associated “abstract” stimuli, designed to discourage the use of verbal mediators (Group 3). For those trained with pictograms, equal response latencies were observed on all tested relations, viz. trained associations, symmetry, transitivity, and transitivity with symmetry, but for subjects given abstract stimuli response latencies were greater on tests requiring transitivity. In Experiment 2 this result was replicated with methodological refinements, using only groups trained with preassociated pictograms or abstract stimuli. In Experiment 3 subjects were pretrained to label abstract stimuli with either individual names or class names. Latencies were longer for tests involving transitivity in the case of those subjects using individual names, but equal response latencies were observed on all four types of test for those using class names. The results suggest that equivalence classesMaybe supported by either an associative network or by verbal mediation, depending on stimulus conditions and the subsequent strategies employed by subjects.     

空间工作记忆负载对真实场景情境提示效应的影响

重复的画面布局能够促进观察者对目标项的搜索 (情境提示效应)。本研究采用双任务范式,分别在视觉搜索任务的学习阶段 (实验2a) 和测验阶段 (实验2b) 加入空间工作记忆任务, 并与单任务基线 (实验1)进行比较, 考察空间工作记忆负载对真实场景搜索中情境线索学习和情境提示效应表达的影响。结果发现: 空间负载会增大学习阶段的情境提示效应量, 同时削弱测验阶段的情境提示效应量, 而不影响情境线索的外显提取。由此可见, 真实场景中情境线索的学习和提示效应的表达均会受到有限的工作记忆资源的影响, 但情境线索提取的外显性不变。     

Constraint on the semantic flexibility in visual statistical learning

We examined whether the expression of visual statistical learning (VSL) is flexible at the superordinate-categorical level. In the familiarization phase, participants viewed a sequence of line drawings. In the test phase, participants observed two test sequences (statistically related triplets versus unrelated foils) that consisted of the same objects as those presented during the familiarization phase (the same condition) or different objects that shared the same categorical information with drawings during the familiarization (the different condition). They then decided whether the first or the second sequence was more familiar. The results of Experiment 1 showed greater familiarity above chance levels for statistically related triplets only in the same condition. In Experiment 2, even where the word stimuli representing each superordinate-level category were included in the test phase (the categorical condition), the results showed VSL only in the same condition. Our findings suggest that the semantic flexibility of VSL is limited to the basic-level category.     

Looking in the wrong direction correlates with more accurate word learning

Previous research on lexical development has aimed to identify the factors that enable accurate initial word-referent mappings based on the assumption that the accuracy of initial word-referent associations is critical for word learning. The present study challenges this assumption. Adult English speakers learned an artificial language within a cross-situational learning paradigm. Visual fixation data were used to assess the direction of visual attention. Participants whose longest fixations in the initial trials fell more often on distracter images performed significantly better at test than participants whose longest fixations fell more often on referent images. Thus, inaccurate initial word-referent mappings may actually benefit learning.     

Visual statistical learning produces implicit and explicit knowledge about temporal order information and scene chunks: Evidence from direct and indirect measures

We examined whether visual statistical learning (VSL) produced implicit and/or explicit knowledge about temporal order information and scene chunks, using a rapid serial visual presentation target detection task and a two-alternative forced-choice (2AFC) familiarity test as indirect and direct measures of VSL, respectively. In the familiarization phase, participants viewed a visual stream of natural scenes consisting of four triplets (i.e., three images that always appeared in the same order). In the subsequent target detection task, participants were required to detect target items embedded in a stream of 12 images or 12 words representing each natural scene. In the final 2AFC familiarity test, participants observed two test sequences (statistically related triplets vs. unrelated foils) and decided whether the first or second sequence was more familiar based on the familiarization phase. In both test phases, we included the same (forward) and reverse (backward) order of scenes as presented during the familiarization phase to examine whether the expression of VSL was based on temporal order of scenes or scene chunks. The results of the target detection task showed a learning effect for both temporal order in the forward condition and chunks in the backward condition, irrespective of whether stimuli were images or words; in contrast, we did not observe a learning effect in the backward condition for scene images in the familiarity test. Our findings are compatible with a learning mechanism that has both implicit and explicit components based on temporal order information and scene chunks.     

序列本体感觉学习获得稳定的自我中心空间表征*

通过同步视觉或者序列本体感觉,被试学习不规则场景。学习完毕之后,在面对学习方向、自主旋转240°、和持续旋转直至迷向3种运动条件下,被试随机指出各个物体的位置。迷向导致同步视觉学习组指向的内部一致性显著变差,而序列本体感觉学习组不受迷向影响。离线的相对位置判断任务表明两组被试的环境中心空间表征没有差异。这证明通过序列本体感觉学习被试也可以形成稳定的自我中心空间表征,支持了空间快照理论的扩展和空间认知的功能等价假说。     

Visual and proprioceptive representations in spatial memory

It has been shown that spatial information can be acquired from both visual and nonvisual modalities. The present study explored how spatial information from vision and proprioception was represented in memory, investigating orientation dependence of spatial memories acquired through visual and proprioceptive spatial learning. Experiment 1 examined whether visual learning alone and proprioceptive learning alone yielded orientation-dependent spatial memory. Results showed that spatial memories from both types of learning were orientation dependent. Experiment 2 explored how different orientations of the same environment were represented when they were learned visually and proprioceptively. Results showed that both visually and proprioceptively learned orientations were represented in spatial memory, suggesting that participants established two different reference systems based on each type of learning experience and interpreted the environment in terms of these two reference systems. The results provide some initial clues to how different modalities make unique contributions to spatial representations.