Short-term recognition memory for serial order and timing

Recent evidence suggests that a common temporal representation underlies memory for serial order of items in a sequence, and the timing of items in a sequence. This stands in contrast to other data suggesting a reliance on only ordinal information in short-term memory tasks. An experiment is reported here in which participants were post cued to perform a comparison between a probe and study list of items irregularly spaced in time, on the basis of order or temporal information.Participants' performance on theserial recognition task was notaffected by the temporal proximity of items, although participants were able to use temporal information to perform a temporal recognition task. Application of a temporal matching model of serial and temporal recognition suggests that although participants were able to remember the timing of items, this memory for timing was unlikely to determine serial recognition performance. The results suggest a dissociation between ordinal and temporal information in short-term memory.     

Semantic memory disorders

Semantic memory encompasses knowledge of objects, facts and words. A number of brain regions are probably involved, but the left infero-lateral temporal lobe appears to play a key role. The separability of semantic memory from episodic (or autobiographical) memory is a focus of current debate. Impaired semantic memory is a common feature of Alzheimer's disease but is invariably overshadowed by a profound deficit in episodic memory. In semantic dementia, a rarer disorder associated with focal temporal-lobe atrophy, there is selective loss of semantic memory, characterized by preservation of superordinate knowledge of words, and objects, but loss of finer-grained information. This pattern can be interpreted as a degradation of features from a distributed network of semantic representations. Following Herpes simplex encephalitis, patients sometimes show disproportionate loss of knowledge for natural kinds (e.g. animals) with relative preservation of knowledge about artefacts, this may reflect differential damage to neural systems critical for perceptual as opposed to functional features, perceptual properties being more salient in knowledge about natural kinds.     

Distinct and common cortical activations for multimodal semantic categories

If semantic representations are based on particular types of perceptual features, then category knowledge that arises from multimodal sensory experiences should rely on distinct and common sensory brain regions depending on the features involved. Using a similarity-based generation-andcomparison task, we found that semantic categories activated cortical areas associated with taste and smell, biological motion, and visual processing. Fruit names specifically activated medial orbitofrontal regions associated with taste and smell. Labels for body parts and clothing activated lateral temporal occipitoparietal areas associated with perceiving the human body. More generally, visually biased categories activated ventral temporal regions typically ascribed to visual object recognition, whereas functional categories activated lateral frontotemporal areas previously associated with the representation of usage properties. These results indicate that semantic categories that are distinguished by particular perceptual properties rely on distinct cortical regions, whereas semantic categories that rely on similar types of features depend on common brain areas.     

Stimulus exposure time and perceptual memory

The recent explosion of research on implicit memory has facilitated the examination of perceptual and conceptual processes in the encoding of information. Nevertheless, stimulus exposure time—the amount of time that a stimulus is physically available to a perceiver’s scrutiny—has received little attention. In the present paper, we examine the effect of stimulus exposure time on three implicit memory measures (word-fragment completion, perceptual identification, and general knowledge) and two explicit memory measures (graphemic cued recall and semantic cued recall). In Experiment 1, we demonstrated that increases in exposure time lead to increases in implicit perceptual memory, but not to implicit conceptual memory, when the encoding task focuses on perceptual features of the stimulus. We replicated this effect in Experiment 2 and demonstrated that increases in exposure time lead to increases in perceptualand conceptual memory when the measures are explicit. Thus, the current experiments demonstrate that manipulations of exposure time lead to dissociations in implicit, but not explicit, memory.     

A hierarchical model of temporal perception

Temporal perception comprises subjective phenomena such as simultaneity, successiveness, temporal order, subjective present, temporal continuity and subjective duration. These elementary temporal experiences are hierarchically related to each other. Functional system states with a duration of 30 ms are implemented by neuronal oscillations and they provide a mechanism to define successiveness. These system states are also responsible for the identification of basic events. For a sequential representation of several events time tags are allocated, resulting in an ordinal representation of such events. A mechanism of temporal integration binds successive events into perceptual units of 3 s duration. Such temporal integration, which is automatic and presemantic, is also operative in movement control and other cognitive activities. Because of the omnipresence of this integration mechanism it is used for a pragmatic definition of the subjective present. Temporal continuity is the result of a semantic connection between successive integration intervals. Subjective duration is known to depend on mental load and attentional demand, high load resulting in long time estimates. In the hierarchical model proposed, system states of 30 ms and integration intervals of 3 s, together with a memory store, provide an explanatory neuro-cognitive machinery for differential subjective duration.     

No evidence for qualitative differences in the processing of short and long temporal intervals

Several lines of research suggest that two distinct timing mechanisms are involved in temporal information processing: a sensory mechanism for processing of durations in the range of milliseconds and a cognitively controlled mechanism for processing of longer durations. The present study employed a dual-task approach and a sensory interference paradigm to further elucidate the distinct timing hypothesis. Experiment 1 used mental arithmetic as a nontemporal secondary task, Experiment 2 a memory search task, and Experiment 3 a visuospatial memory task. In Experiment 4, a loudness manipulation was applied. Mental arithmetic and loudness manipulation affected temporal discrimination of both brief and long intervals, whereas the two remaining tasks did not influence timing performance. Observed differences in interference patterns may be explained by some tasks being more difficult than others. The overall pattern of results argues against two qualitatively distinct timing mechanisms, but is consistent with attention-based cognitive models of human timing.     

Discriminations among perceptual and symbolic stimuli

This research compares the time required for perceptual discriminations among pairs of physically present objects (circles) with the time required to discriminate pairs of symbols Inonsense syllables) that subjects learned to associate uniquely with each of the circles. Four experiments show very large differences between symbolic and perceptual discriminations. Discrimination times for the perceptual stimuli declined systematically as their size ratio increased, but discriminations among the associated nonsense syllables showed only a strictly ordinal effect of position in the series. Discriminations among the symbolic stimuli showed a large semantic congruity effect, but the perceptual stimuli showed none. The research does not replicate previous results showing similarities between perceptual and symbolic processing suggestive of image processing. We conclude that in the symbolic task subjects use only ordinal information rather than images or analog representations of the associated circles. We propose that perceptual discriminations show a semantic congruity effect only when they are processed as if the perceptual stimuli were symbolic.     

感觉记忆中含语义对象的视觉表征

感觉记忆能够以特征形式构建对视觉对象表面信息的表征, 然而对于具有重要意义的潜在抽象信息, 尚未有研究考察其是否影响感觉记忆的视觉表征。结合掩蔽技术与部分报告法范式考察了感觉记忆的视觉表征中是否包含语义信息。以阿拉伯数字作为目标, 实验1与实验2分别采用正立与倒置的汉字大写数字作为掩蔽刺激, 比较其与白噪音刺激的掩蔽效应。结果显示, 汉字大写数字的掩蔽效应均强于白噪音刺激, 且正立汉字大写数字的掩蔽效果较倒置汉字大写数字更强。实验3采用汉字大写数字与汉字常用字分别作为掩蔽刺激, 结果显示汉字大写数字的掩蔽效果强于汉字常用字。上述结果显示, 刺激间的语义相似性带来了视觉表征冲突, 表明感觉记忆的视觉表征中包含了刺激的语义信息。     

Evidence for working memory storage operations in perceptual cortex

Isolating the short-term storage component of working memory (WM) from the myriad of associated executive processes has been an enduring challenge. Recent efforts have identified patterns of activity in visual regions that contain information about items being held in WM. However, it remains unclear (1) whether these representations withstand intervening sensory input and (2) how communication between multimodal association cortex and the unimodal perceptual regions supporting WM representations is involved in WM storage. We present evidence that the features of a face held in WM are stored within face-processing regions, that these representations persist across subsequent sensory input, and that information about the match between sensory input and a memory representation is relayed forward from perceptual to prefrontal regions. Participants were presented with a series of probe faces and indicated whether each probe matched a target face held in WM. We parametrically varied the feature similarity between the probe and target faces. Activity within face-processing regions scaled linearly with the degree of feature similarity between the probe face and the features of the target face, suggesting that the features of the target face were stored in these regions. Furthermore, directed connectivity measures revealed that the direction of information flow that was optimal for performance was from sensory regions that stored the features of the target face to dorsal prefrontal regions, supporting the notion that sensory input is compared to representations stored within perceptual regions and is subsequently relayed forward. Together, these findings indicate that WM storage operations are carried out within perceptual cortex.     

Priming of semantic autobiographical knowledge: a case study of retrograde amnesia

The case of a 36-year-old man who suffers dense retrograde and anterograde amnesia as a result of closed-head injury that caused extensive damage to his left frontal-parietal and right parieto-occipital lobes is described. Patient K.C. has normal intelligence and relatively well-preserved perceptual, linguistic, short-term memory, and reasoning abilities. He possesses some fragmentary general knowledge about his autobiographical past, but he does not remember a single personal event or happening from any time of his life. He has some preserved expert knowledge related to the work he did for 3 years before the onset of amnesia, although he has no personal recollections from that period. Some features of K.C.'s retrograde amnesia can be interpreted in terms of the distinction between episodic and semantic memory, and in terms of the distinction between episodic and semantic autobiographical knowledge. K.C.'s semantic knowledge, but not his episodic knowledge, showed progressive improvement, or priming, in the course of the investigation.     

On the locus of the semantic satiation effect: Evidence from event-related brain potentials

The present study sought to determine whether semantic satiation is merely a by-product of adaptation or satiation of upstream, nonsemantic perceptual processes or whether the effect can have a locus in semantic memory. This was done by measuring event-related brain potentials (ERPs) in a semantic word-detection task involving multiple presentations of primes and critical related and unrelated words in three experiments involving visual (Experiment 1) and auditory (Experiments 2A and 2B) stimuli. Primes varied in their type case (Experiment 1) or pitch (Experiment 2B) in order to discourage sensory adaptation. Prime satiation and relatedness of the primes to the critical word had interacting effects on ERP amplitude to critical words, particularly within the time-window of the N400 component. Because numerous studies have indicated a role for the N400 in semantic processing, modulation of the N400 relatedness effect by prime satiation (with little or no contribution from perceptual adaptation) suggests that semantic memory can be directly satiated, rather than the cost to semantic processing necessarily resulting from impoverishment of perceptual inputs.     

Conceptual structure and the structure of concepts: a distributed account of category-specific deficits

We present a new account of the fine-grained structure of semantic categories derived from neuropsychological, behavioral, and developmental data. The account places theoretical emphasis on the functions of the referents of concepts. We claim (i) that the distinctiveness of functional features correlated with perceptual features varies across semantic domains; and (ii) that category structure emerges from the complex interaction of these variables. The representational assumptions that follow from these claims make strong predictions about what types of semantic information are preserved in patients showing category-specific deficits following brain damage. These claims are illustrated with a connectionist simulation which, when damaged, shows patterns of preservation of distinctive and shared functional and perceptual information which varies across semantic domains. The data model both dissociations between knowledge for artifacts and for living things and recent neuropsychological evidence concerning the robustness of functional information in the representation of concepts.     

The selective impairment of semantic memory

The selective impairment of semantic memory is described in three patients with diffuse cerebrallesions. These patients, selected on the basis of a failure to recognize or identify common objects (agnosia for objects), were investigated in detail. In particular, their perceptual, language and memory functions were assessed, and the limits and properties of their recognition difficulties explored.

It was found that knowledge of pictorial representations of objects, and of words, was impaired or impoverished, and in both instances knowledge of subordinate categories was more vulnerable than superordinate categories. Evidence is presented that this impairment of semantic memory cannot be accounted for by intellectual impairment, sensory or perceptual deficits, or expressive language disorder. The implications of damage to the semantic memory system for the operation of other cognitive systems, in particular short and long-term memory functions, are considered. Some tentative evidence for the structural basis for a hierarchically organized modality-specific semantic memory system is discussed.     

Boundaries of the relation between conscious recollection and source memory for perceptual details

The relation between conscious recollection and source memory for perceptual details was investigated in three experiments that combined the remember-know paradigm with a multidimensional source monitoring test. Experiment 1 replicated that source memory for perceptual details is better in the case of "remember" than "know" judgments. Experiment 2 showed that the relation between "remember" judgments and source memory for perceptual details is diminished by a semantic orienting task during encoding. Experiment 3 demonstrated that "remember" judgments are related to enhanced source memory for specific and unique kinds of perceptual source information, whereas memory for incomplete and global perceptual source information does not differentiate between "remember" and "know" judgments. The results show that the attentional focus during encoding and the specificity of retrieved source information form boundary conditions for the use of source memory for perceptual details as a basis of "remember" judgments.     

Temporal compression in episodic memory for real-life events

Remembering an event typically takes less time than experiencing it, suggesting that episodic memory represents past experience in a temporally compressed way. Little is known, however, about how the continuous flow of real-life events is summarised in memory. Here we investigated the nature and determinants of temporal compression by directly comparing memory contents with the objective timing of events as measured by a wearable camera. We found that episodic memories consist of a succession of moments of prior experience that represent events with varying compression rates, such that the density of retrieved information is modulated by goal processing and perceptual changes. Furthermore, the results showed that temporal compression rates remain relatively stable over one week and increase after a one-month delay, particularly for goal-related events. These data shed new light on temporal compression in episodic memory and suggest that compression rates are adaptively modulated to maintain current goal-relevant information.     

Is a picture worth a thousand words? Evidence from concept definitions by patients with semantic dementia

Nine patients with semantic dementia (the temporal lobe variant of frontotemporal dementia) were asked to define concrete concepts either from presentation of a picture of the object or from its spoken name. As expected, the patients with the most severe semantic impairment produced the least detailed definitions, and the quality of the definitions overall was significantly related to concept familiarity. Further analyses of the definitions were designed to assess two key theoretical aspects of semantic organization. (i) Do objects and their corresponding names activate conceptual information in two neuroanatomically separable (modality-specific) semantic systems? If so, then-apart from any expected commonality in performance attributable to factors such as concept familiarity-one would not predict striking item-specific similarities in a patient's picture- and word-elicited definitions. (ii) Do sensory/perceptual features and more associative/functional attributes of conceptual knowledge form two neuroanatomically separable subsystems? If so, then one would predict significant dissociations in the prominence of these two types of information in the patients' definitions. The results lead us to favor a model of the semantic system that is divided by attribute type but not by modality.     

Using movement and intentions to understand simple events

In order to understand ongoing activity, observers segment it into meaningful temporal parts. Segmentation can be based on bottom-up processing of distinctive sensory characteristics, such as movement features. Segmentation may also be affected by top-down effects of knowledge structures, including information about actors’ intentions. Three experiments investigated the role of movement features and intentions in perceptual event segmentation, using simple animations. In all conditions, movement features significantly predicted where participants segmented. This relationship was stronger when participants identified larger units than when they identified smaller units, and stronger when the animations were generated randomly than when they were generated by goal-directed human activity. This pattern suggests that bottom-up processing played an important role in segmentation of these stimuli, but that this was modulated by top-down influence of knowledge structures. To describe accurately how observers perceive ongoing activity, one must account for the effects of distinctive sensory characteristics, the effects of knowledge structures, and their interactions.     

Remembering the levels of information in words

The qualitative nature of the incidental memory trace produced by perceptual and conceptual processing within a speeded inference task was examined. Performance on recall and auditory recognition tests replicated the general finding that semantic processing leads to better retention of words than does nonsemantic processing. This pattern of results was reversed on a visual recognition test designed to measure the amount of perceptual information remembered. These data suggest that different types of processing result in different aspects of the stimulus being encoded, with conceptual processing resulting primarily in the encoding of semantic information and perceptual processing resulting primarily in the encoding of physical information. Thus, the effectiveness of a particular kind of processing for good memory performance depends on the kind of information being tested.     

Elaborative rehearsal of nontemporal information interferes with temporal processing of durations in the range of seconds but not milliseconds

The distinct timing hypothesis suggests a sensory mechanism for processing of durations in the range of milliseconds and a cognitively controlled mechanism for processing of longer durations. To test this hypothesis, we employed a dual-task approach to investigate the effects of maintenance and elaborative rehearsal on temporal processing of brief and long durations. Unlike mere maintenance rehearsal, elaborative rehearsal as a secondary task involved transfer of information from working to long-term memory and elaboration of information to enhance storage in long-term memory. Duration discrimination of brief intervals was not affected by a secondary cognitive task that required either maintenance or elaborative rehearsal. Concurrent elaborative rehearsal, however, impaired discrimination of longer durations as compared to maintenance rehearsal and a control condition with no secondary task. These findings endorse the distinct timing hypothesis and are in line with the notion that executive functions, such as continuous memory updating and active transfer of information into long-term memory interfere with temporal processing of durations in the second, but not in the millisecond range.     

Temporal expectation weights visual signals over auditory signals

Temporal expectation is a process by which people use temporally structured sensory information to explicitly or implicitly predict the onset and/or the duration of future events. Because timing plays a critical role in crossmodal interactions, we investigated how temporal expectation influenced auditory–visual interaction, using an auditory–visual crossmodal congruity effect as a measure of crossmodal interaction. For auditory identification, an incongruent visual stimulus produced stronger interference when the crossmodal stimulus was presented with an expected rather than an unexpected timing. In contrast, for visual identification, an incongruent auditory stimulus produced weaker interference when the crossmodal stimulus was presented with an expected rather than an unexpected timing. The fact that temporal expectation made visual distractors more potent and visual targets less susceptible to auditory interference suggests that temporal expectation increases the perceptual weight of visual signals.