Visual similarity effects on short-term memory for order: The case of verbally labeled pictorial stimuli

Four experiments examined the effect of visual similarity on immediate memory for order. Experiments 1 and 2 used easily nameable line drawings. Following a sequential presentation in either silent or suppression conditions, participants were presented with the drawings in a new, random order and were required to remember their original serial position. In Experiment 3, participants first learned to associate a verbal label with an abstract matrix pattern. Then they completed an immediate memory task in which they had to name the matrices aloud during presentation. At recall, the task required remembering either the order of the matrices or the order of their names. In Experiment 4, participants learned to associate nonword labels with schematic line drawings of faces; the phonemic similarity of the verbal labels was also manipulated. All four experiments indicate that the representations supporting performance comprise both verbal and visual features. The results are consistent with a multiattribute encoding view.     

Role of verbal encoding in shortand long-term odor recognition

The role of verbal encoding in odor recognition memory was investigated using odors of low familiarity to subjects before the experiment began. The experimental procedure included two phases—odor learning (first phase) and odor memory testing (second phase)—separated by a delay of 7 days. Five experimental conditions were established: three conditions of odor learning with names (labeling conditions), one condition of odor learning without names (sensory familiarization), and one condition of no learning prior to testing (control conditions). The labeling conditions differed from each other regarding label characteristics. The names were those of odor sources (veridical names), those personally generated by subjects (generated names), or those derived from the chemical names of the odorants (chemical names). Subjects were required to learn 20 fixed associations between odors (targets or distractors) and 20 names during two daily sessions. The learning sessions included two identification tests and ended by a verbal memory test in which subjects recalled odor names. The odor memory test was split into two parts separated by a retention interval of either 20 min (short-term memory) or 24 h (long-term memory). Data showed that olfactory recognition memory was enhanced in subjects who associated veridical or generated names to odors during the learning session. Chemical names were not appropriate to facilitate odor recognition. Similarly, the level of odor identification was higher for veridical and generated names than for chemical names, though the level of verbal memory for chemical names was substantial. Recognition response latencies were systematically longer for a target odor implying a positive response than for a distractor odor implying a negative response. Together, these data suggest that odor recognition and identification are sensitive to the semantic content of labels associated with odors. Odor memory was adversively influenced by time, but this influence was less pronounced when the names were endowed with a rich semantic content.     

知识对成人归纳推理标签效应的影响

通过对标签所承载的表层类属知识和深层概念知识进行区分,考察了知识对成人归纳推理中标签效应的影响。实验材料为自然标签和人工标签,任务为亲缘关系判断,结果发现在两种材料中都能观察到标签效应。在自然类别中,当标签承载深层知识时,标签承载的表层类属知识的作用会受其影响而减小;在人工类别中,标签作用的发挥会受到标签自身特征的影响,当标签中含有类别信息的汉字时,标签对归纳推理的促进作用更大。     

Words,shape, visual search and visual working memory in 3‐year‐old children

Do words cue children's visual attention, and if so, what are the relevant mechanisms? Across four experiments, 3‐year‐old children (N = 163) were tested in visual search tasks in which targets were cued with only a visual preview versus a visual preview and a spoken name. The experiments were designed to determine whether labels facilitated search times and to examine one route through which labels could have their effect: By influencing the visual working memory representation of the target. The targets and distractors were pictures of instances of basic‐level known categories and the labels were the common name for the target category. We predicted that the label would enhance the visual working memory representation of the target object, guiding attention to objects that better matched the target representation. Experiments 1 and 2 used conjunctive search tasks, and Experiment 3 varied shape discriminability between targets and distractors. Experiment 4 compared the effects of labels to repeated presentations of the visual target, which should also influence the working memory representation of the target. The overall pattern fits contemporary theories of how the contents of visual working memory interact with visual search and attention, and shows that even in very young children heard words affect the processing of visual information.     

Memory for information about individuals

A semantic network model is structured so that usually there is only one node in the network to represent each individual. A series of experiments were performed to determine under what circumstances subjects would show unitary memory for individuals. The experiments were principally concerned with the speed with which subjects could retrieve the facts and make inferences from them. Subjects learned facts about individuals which could be referred to by two labels. The semantic network model predicted that subjects would integrate facts learned to one label with facts learned to the other. Evidence for such integration was found, but only when considerable effort was taken to encourage the subjects to develop a unitary impression of the individual. The situation was also investigated in which the subjects did not learn of the identity between the two labels until after the facts were learned to each label individually. There was evidence that subjects set up two nodes to represent the. individual, one for each label. There was also evidence that, upon learning of the identity, subjects chose to abandon one of the two nodes and to start a process of copying information from the to-be-abandoned node to the preserved node.     

Linguistic influences on visual memory

The Whorf-Sapir hypothesis has raised considerable controversy in the literatures of psychology and anthropology. Several misconceptions of the hypothesis are reviewed, and the hypothesis was experimentally supported in a visual reproduction paradigm. Subjects were first given label training for a set of figures, and were then asked to recall by drawing the shapes. Training with categorized labels resulted in a 25% improvement in recall when compared to a condition with nonword (paralog) labels. Even stronger evidence of linguistic influence on visual memory was obtained by examining the order of recall. The conceptual relationships among labels strongly influenced the sequence of reproductions.     

Verbal recoding of visual stimuli impairs mentalimagetransformations

Two experiments were carried out to test the hypothesis that verbal recoding of visual stimuli in short-term memory influences long-term memory encoding and impairs subsequent mental image operations. Easy and difficult-to-name stimuli were used. When rotated 90 degrees counterclockwise, each stimulus revealed a new pattern consisting of two capital letters joined together. In both experiments, subjects first learned a short series of stimuli and were then asked to rotate mental images of the stimuli in order to detect the hidden letters. In Experiment 1, articulatory suppression was used to prevent subjects from subvocal rehearsal when learning the stimuli, whereas in Experiment 2, verbal labels were presented with each stimulus during learning to encourage a reliance on the verbal code. As predicted, performance in the imagery task was significantly improved by suppression when the stimuli were easy to name (Experiment 1) but was severely disrupted by labeling when the stimuli were difficult to name (Experiment 2). We concluded that verbal recoding of stimuli in short-term memory during learning disrupts the ability to generate veridical mental images from long-term memory.     

Redundant spoken labels facilitate perception of multiple items

Because of the strong associations between verbal labels and the visual objects that they denote, hearing a word may quickly guide the deployment of visual attention to the named objects. We report six experiments in which we investigated the effect of hearing redundant (noninformative) object labels on the visual processing of multiple objects from the named category. Even though the word cues did not provide additional information to the participants, hearing a label resulted in faster detection of attention probes appearing near the objects denoted by the label. For example, hearing the word chair resulted in more effective visual processing of all of the chairs in a scene relative to trials in which the participants attended to the chairs without actually hearing the label. This facilitation was mediated by stimulus typicality. Transformations of the stimuli that disrupted their association with the label while preserving the low-level visual features eliminated the facilitative effect of the labels. In the final experiment, we show that hearing a label improves the accuracy of locating multiple items matching the label, even when eye movements are restricted. We posit that verbal labels dynamically modulate visual processing via top-down feedback--an instance of linguistic labels greasing the wheels of perception.     

Semantic and visual memory codes in learning disabled readers

Two experiments investigated whether learning disabled readers' impaired recall is due to multiple coding deficiencies. In Experiment 1, learning disabled and skilled readers viewed nonsense pictures without names or with either relevant or irrelevant names with respect to the distinctive characteristics of the picture. Both types of names improved recall of nondisabled readers, while learning disabled readers exhibited better recall for unnamed pictures. No significant difference in recall was found between name training (relevant, irrelevant) conditions within reading groups. In Experiment 2, both reading groups participated in recall training for complex visual forms labeled with unrelated words, hierarchically related words, or without labels. A subsequent reproduction transfer task showed a facilitation in performance in skilled readers due to labeling, with learning disabled readers exhibiting better reproduction for unnamed pictures. Measures of output organization (clustering) indicated that recall is related to the development of superordinate categories. The results suggest that learning disabled children's reading difficulties are due to an inability to activate a semantic representation that interconnects visual and verbal codes.     

Baseline training sequence affects speed of emergent conditional discriminations

We examined the effects of baseline training sequence on the emergence of conditional discriminations in an intraverbal naming task. Thirty‐two college students were randomly assigned to two groups. The tact‐intraverbal (TI) group first learned to vocally tact eight visual stimuli using a unique verbal label for each stimulus, and then to intraverbally relate four pairs of verbal labels. The intraverbal‐tact (IT) group received the same training but in the opposite sequence. Both groups then received a match‐to‐sample test involving the visual stimuli alone. On average, the TI group had significantly shorter reaction times than the IT group throughout all four test blocks, even when controlling for intraverbal retention, which was lower in the IT group. Accuracy on the MTS test did not differ significantly between groups when controlling for intraverbal retention. However, MTS accuracy and intraverbal retention were strongly correlated in the IT group but uncorrelated in the TI group. We suggest the effect of training sequence reflects different sources of stimulus control available to subjects in different groups when confronted with the novel MTS trials.     

The verbal label: Mediator or classifier?

Three experiments on the role of verbal labels and perceptual cues in concept attainment are reported. Ss were kindergarten and second-grade upper-middle-class children. The results indicated that when Ss learned to associate two labels (or two perceptual cues) with each stimulus no positive transfer resulted, despite the fact that one of the labels (or cues) was relevant to solution. When one label only (or one perceptual cue) was associated with each stimulus, substantial positive transfer was observed. The effects of verbal labeling and perceptual cuing were identical.On the basis of these finding the authors reject the hypothesis that labels give rise to representational responses which act as mediators, and instead propose a new hypothesis, that labels and perceptual cues facilitate performance because they facilitate the division of the stimulus set into subsets which are correlated with the response systems the subjects are expected to learn.     

Visual and phonological components of working memory in children

Previous studies have shown that young children's immediate memory for a short series of drawings of objects is mediated by a visual component of working memory, whereas older children rely chiefly upon a phonological component. Three experiments investigated the hypothesis that older children rely also, but to a lesser extent, on visual working memory. Experiment 1 confirmed previous evidence that 11-year-olds' memory is disrupted by phonemic similarity of object names, but is unaffected by visual similarity of the objects themselves. However, when articulatory suppression was used to prevent phonological coding, levels of recall were sensitive to visual rather than phonemic similarity. Experiment 2 compared the effects of interpolating an auditory-verbal or a visual postlist task on memory for drawings viewed either with or without suppression. The visual task had a clear disruptive effect only in the suppression condition, where it interfered selectively with recall of the most recent item. Experiment 3 compared the effects of interpolating an auditory-verbal or a mixed-modality (visual-auditory) postlist task when subjects were not required to suppress. There was greater interference from the mixed-modality task, and this effect was confined to the last item presented. These experiments are taken as confirming the presence of a small but reliable contribution from visual memory in 11-year-old children's recall. As in younger children, visual working memory in 11-year-olds is sensitive to visual similarity and is responsible for a final-item visual recency effect. The results also show that older children's use of visual working memory is usually masked by the more pervasive phonological component of recall. Some implications for the structure of working memory and its development are discussed.     

Effects of encoding the perceptual features of pictures on memory.

Four experiments investigated whether manipulations of type of encoding affects the likelihood of remembering pictures' visual details and their names. Using an incidental learning procedures, subjects were led to make judgments about pictures' colors, spatial orientations, or appropriateness in a scene. The results indicate that the nature of the memory test influences the effectiveness of different encoding conditions. Recall and recognition of pictures' names were best after subjects judged scene encodings, second best after they judged orientation, and poorest after they judged color. However, the results for the recognition of pictures' visual details were quite different. Analyses of d' suggested that type of encoding task had no effect on memory for visual details, whereas analysis of Pr (hit rate minus false-alarm rate) suggested that memory for visual details was impaired by conceptual encoding (judging the appropriateness of a picture in a scene). The results of one experiment demonstrated that these findings were not produced by variation in distinctiveness of the encoding questions. This pattern of findings implies that conceptual encoding facilitates retention of the names of the pictures at the cost of some loss in the ability to retain specific visual details.     

Accentuation and attitude in social judgment

In two experiments four sets of both favorable and unfavorable verbal material were classified as belonging to four labels, two specific labels (politicians) and two less specific labels (classes of people). Ss' attitudes towards one of the politicians were more positive than towards the other. Ss stored these stimuli in their memory under casual, incidental instructions. Then Ss retrieved information by deciding which one of two labels was formerly connected to the given verbal items. Ss were expected to accentuate on two orthogonal dependent variables: (1) Discrimination performance between labels; (2) response preference for labels. Discrimination performance was improved for politician labels compared to classes-of-people labels but was not affected by the favorableness of the verbal material. However, response preference for one politician label occurred when two conditions were fulfilled: (a) Both the verbal material and Ss' attitudes towards the label were unfavorable, and (b) the content of verbal material was characteristic of the label. The accentuation theories of Bruner-Goodman and Tajfel were reformulated and integrated into a two-level model.     

Labeling effects on memory for nonsense pictures

It has been shown that labeling nonsense pictures improves memory for them, but how the label takes effect is uncertain. In this study subjects viewed nonsense pictures with or without labels; in the former case, the labels were either meaningful or nonmeaningful with respect to the pictures. Then the subjects took part in a free recall test, followed by recall in the presence of cues. Only the meaningful labels facilitated free recall of the pictures, but both types of labels facilitated cued recall. The results suggest that a meaningful label affects picture encoding by providing a conceptual interpretation for the picture; a nonmeaningful label, in contrast, appears to provide only an ad hoc associative cue.     

The effects of verbal labelling on recognition memory for schematic faces

Four experiments investigated the effects of labelling on the encoding and recognition of schematic faces. In Experiments I and II, hard-to-label (H) faces were recognized better after labelling than after observing, whereas easy-to-label (E) faces were not significantly affected. However, E faces were recognized better after labelling when subjects were instructed to attend carefully to all features of the faces during viewing. In Experiments III and IV, which dealt with each kind of face separately, both E and H faces were recognized better after labelling than after observing. An additional improvement in recognition all of faces was found when labelling subjects knew which label was relevant on each recognition trial and were instructed to use it. It was concluded that (a) a verbal label functions mainly to direct attention to specific facial features during viewing, (b)the effect of the label on recognition is positive or negative depending on whether or not it directs attention to features which are functional for the recognition test, (c) the label also forms part of the representation of the face in memory, and (d) a label may serve as a mediator at the time of testing, but only in the presence of specific cues.     

Meet The Simpsons: top-down effects in face learning

We examined whether prior knowledge of a person affects the visual processes involved in learning a face. In two experiments, subjects were taught to associate human faces with characters they knew (from the TV show The Simpsons) or characters they did not (novel names). In each experiment, knowledge of the character predicted performance in a recognition memory test, relying only on old/new confidence ratings. In experiment 1, we established the technique and showed that there is a face-learning advantage for known people, even when face items are counterbalanced for familiarity across the experiment. In experiment 2 we replicated the effect in a setting which discouraged subjects from attending more to known than unknown people, and eliminated any visual association between face stimuli and a character from The Simpsons. We conclude that prior knowledge about a person can enhance learning of a new face.     

自然场景与身体动作对面孔表情识别的影响

本研究以消极情绪间感知相似性较低的厌恶、恐惧面孔表情为材料,提供5个情绪性语言标签减少文字背景对面孔识别的促进作用,通过2个实验对自然场景以及身体动作对面孔表情识别的影响进行了研究,旨在考察面孔表情与自然场景间的情绪一致性对情绪面孔识别和自然场景加工的影响,以及加入与自然场景情绪相冲突的身体动作对面孔表情识别可能产生的影响。研究结果表明:(1)尽管增加了情绪性语言标签选项数量,自然场景的情绪对面孔表情识别的影响依旧显著;(2)当面孔表情与自然场景情绪不一致时,面孔识别需要更多依赖对自然场景的加工,因此对自然场景的加工程度更高;(3)身体动作会在一定程度上干扰自然场景对面孔表情识别的影响,但自然场景依然对情绪面孔的表情识别有重要作用。     

The effects of humor on memory for non-sensical pictures

Two experiments investigated the effects of humor on memory for non-sensical pictures. Each picture was given three labels that differed in the degree of humor: high, low, and no humor labels. In Experiment 1, the humor of the picture labels was manipulated between participants. Participants were shown 30 pictures for 10 s each and were asked to rate the degree of humor of each picture. After the rating task, participants were asked to draw the pictures in an unexpected memory test. Performance in the memory test was best in the high humor label group, followed by the low and the no humor label groups. In Experiment 2, intention to learn (incidental versus intentional encoding tasks) as well as humor label was manipulated between the participants. In the incidental learning condition, the high humor group performed better than the low humor group, but in the intentional learning condition, there was no humor effect. The effects of humor on picture memory were discussed in terms of appraisal processing within a distinctiveness framework.