Embodied representation of the body contains veridical spatial information

In two experiments, the extent to which mental body representations contain spatial information was examined. Participants were asked to compare distances between various body parts. Similar to what happens when people compare distances on a real visual stimulus, they were faster as the distance differences between body parts became larger (Experiment 1), and this effect could not (only) be explained by the crossing of major bodily categories (umbilicus to knee vs. knee to ankle; Experiment 2). In addition, participants also performed simple animate/inanimate verification on a set of nouns. The nouns describing animate items were names of body parts. A spatial priming effect was found: Verification was faster for body part items preceded by body parts in close spatial proximity. This suggests automatic activation of spatial body information. Taken together, results from the distance comparison task and the property verification task showed that mental body representations contain both categorical and more metric spatial information. These findings are further discussed in terms of recent embodied cognition theories.     

Adaptive memory: enhanced source memory for animate entities

ABSTRACT

The animacy effect refers to enhanced memory for animate over inanimate items. In two studies, we examined whether this memory advantage generalises to source memory. A multinomial processing tree model was used to disentangle item recognition, source memory, and guessing processes. In Study 1, animate and inanimate words were presented at different spatial locations on the screen. Animacy was associated with enhanced source memory for the spatial locations of the items. In Study 2, pseudowords were associated with animate and inanimate properties. Replicating previous results, the pseudowords were better remembered when they were associated with animate properties than when they were associated with inanimate properties. What is more, participants had enhanced source memory for the association between the pseudowords and the animate properties. The results strengthen the idea that animate items are associated with richer mnemonic representations than inanimate items.     

Why is a verb like an inanimate object? Grammatical category and semantic category deficits

Semantic category effects, such as difficulties in naming animate things relative to inanimate objects, have been explained in terms of the relative weightings of perceptual and functional features within the semantic representations of these concepts. We argue that grammatical category deficits, such as difficulties in naming nouns relative to verbs, can be explained within the same framework. We hypothesize that verb concepts are richer in functional than sensory features and present a model of the semantic representations of animate nouns, inanimate nouns, and verbs. The model demonstrates that sensory feature damage results in a deficit for naming living things but spares verb naming, and functional feature damage results in a deficit for naming inanimate objects and verbs. We then report the assessment results of two patient groups. In accordance with the model's predictions, the "verb spared" patients were consistently worse at naming living things than inanimate objects, and their definitions of both living and nonliving items were lacking in sensory information. We conclude that damage to sensory features in semantic representations causes difficulties in naming concrete nouns relative to action verbs, and within the grammatical category of nouns, animate items will be more severely affected. Imageability was shown to be a strong predictor of naming performance in the "verb deficit" patients, and when this variable was controlled no class effect remained. Production of definitions revealed no differential damage to sensory or functional features, and no consistent effect of animacy in naming was shown. While the model suggests that verb deficits might occur in patients for whom functional features are damaged relative to sensory features, we conclude that the "verb deficit" shown in our patients (and potentially in many previously reported cases) was an artifact of the lower imageability of verbs in confrontation naming tasks.     

The relation between body semantics and spatial body representations

The present study addressed the relation between body semantics (i.e. semantic knowledge about the human body) and spatial body representations, by presenting participants with word pairs, one below the other, referring to body parts. The spatial position of the word pairs could be congruent (e.g. EYE / MOUTH) or incongruent (MOUTH / EYE) with respect to the spatial position of the words’ referents. In addition, the spatial distance between the words’ referents was varied, resulting in word pairs referring to body parts that are close (e.g. EYE / MOUTH) or far in space (e.g. EYE / FOOT). A spatial congruency effect was observed when subjects made an iconicity judgment (Experiments 2 and 3) but not when making a semantic relatedness judgment (Experiment 1). In addition, when making a semantic relatedness judgment (Experiment 1) reaction times increased with increased distance between the body parts but when making an iconicity judgment (Experiments 2 and 3) reaction times decreased with increased distance. These findings suggest that the processing of body-semantics results in the activation of a detailed visuo-spatial body representation that is modulated by the specific task requirements. We discuss these new data with respect to theories of embodied cognition and body semantics.     

Hierarchical coding in the perception and memory of spatial layouts

Two experiments were performed to investigate the organization of spatial information in perception and memory. Participants were confronted with map-like configurations of objects which were grouped by color (Experiment 1) or shape (Experiment 2) so as to induce cognitive clustering. Two tasks were administered: speeded verification of spatial relations between objects and unspeeded estimation of the Euclidean distance between object pairs. In both experiments, verification times, but not distance estimations, were affected by group membership. Spatial relations of objects belonging to the same color or shape group were verified faster than those of objects from different groups, even if the spatial distance was identical. These results did not depend on whether judgments were based on perceptually available or memorized information, suggesting that perceptual, not memory processes were responsible for the formation of cognitive clusters. Received: 7 October 1999 / Accepted: 17 February 2000     

Preserved spatial memory over brief intervals in older adults

Two studies compared young and older adults' memory for location information after brief intervals. Experiment 1 found that accuracy of intentional spatial memory for individual locations was similar in young and older participants for set sizes of 3 and 6. Both groups also encoded individual locations in relation to the larger configuration of locations. Experiment 2 showed that like young adults, older adults' latency to respond to a test probe in a letter working memory task was negatively influenced by spatial information that was irrelevant to the task. This interference effect indicated preserved incidental memory for spatial information in older adults. Together, these data suggest that initial encoding of spatial information for relatively small numbers of items is largely preserved in healthy older adults and that representations of spatial information persist over short intervals.     

The construction of spatial situation models during reading

Psycholinguistic research faces a major challenge in describing the mental representations readers construct from a text. It is now widely accepted that readers end with a representation of the situation described in the text. However, it is unclear whether this representation allows the activation of elements in accordance with their situation proximity. To answer this question, two experiments were conducted. Participants read texts, sentence by sentence, which gave them instructions about how to arrange items in a layout; they then performed a recognition task. By manipulating the spatial proximity between prime and probe items, this task allowed the measurement of a spatial priming effect. In the first experiment, a larger priming effect was observed for closer items on the spatial layout. The second experiment replicated these findings and showed that the priming effects are better explained by categorical distance than by Euclidean distance.     

空间-时间关联的中介共同表征结构:来自反转STEARC效应的证据

通过3个双任务实验(诱导任务和特征任务)探讨空间-时间联合编码(STEARC)效应的加工机制。实验1采用时间信息作为诱导任务材料,实验2采用空间信息作为诱导任务材料,在特征任务中都发现映射不一致组被试(看到过去/左侧刺激时按右键反应,看到未来/右侧刺激时按左键反应)出现反转STEARC效应,映射一致组被试表现出常规的STEARC效应,表明从时间信息加工到空间反应过程符合中介共同表征结构。实验3分离两种任务的反应方式(手动和眼动),发现不一致映射规则下,被试仍然表现出常规的STEARC效应,表明这种中介共同表征结构存在特定联结效应,即在不同反应器中出现时间和空间相互独立的表征结构。总体而言,研究支持空间-时间关联符合中介共同表征结构,并且这种关联中存在反应器特定联结效应。     

The representation of pitch in auditory imagery: Evidence from S-R compatibility and distance effects

In three experiments we explored the nature of representations constructed during the perception and imagination of pitch. We employed a same–different task to eliminate the influence of nonauditory information and to minimise use of cognitive strategies on auditory imagery. A reference tone of frequency 1000, 1500, or 2000 Hz, or an imagined tone of a pitch indicated by a visual cue, was followed by a comparison tone (1000, 1500, or 2000 Hz) to which either a speeded same or different response was required. In separate experiments, same–different judgements were mapped to vertically (Experiments 1 and 2) and horizontally arranged responses (Experiment 3). Judgements of tones closer in pitch yielded longer reaction times and higher error rates than more distant tones, indicating a pitch distance effect for perceptual and imagery tasks alike. In addition, in the imagery task, same–different responses were faster when low-pitched tones demanded a bottom or left key response and high-pitched tones a top or right response than vice versa, suggesting that pitch is coded spatially. Together, these behavioural effects support the assumption that both perceived and imagined pitch are translated into an analogical representation in the spatial domain.     

Spatial distance effects on incremental semantic interpretation of abstract sentences: Evidence from eye tracking

A large body of evidence has shown that visual context information can rapidly modulate language comprehension for concrete sentences and when it is mediated by a referential or a lexical-semantic link. What has not yet been examined is whether visual context can also modulate comprehension of abstract sentences incrementally when it is neither referenced by, nor lexically associated with, the sentence. Three eye-tracking reading experiments examined the effects of spatial distance between words (Experiment 1) and objects (Experiment 2 and 3) on participants’ reading times for sentences that convey similarity or difference between two abstract nouns (e.g., ‘Peace and war are certainly different...’). Before reading the sentence, participants inspected a visual context with two playing cards that moved either far apart or close together. In Experiment 1, the cards turned and showed the first two nouns of the sentence (e.g., ‘peace’, ‘war’). In Experiments 2 and 3, they turned but remained blank. Participants’ reading times at the adjective (Experiment 1: first-pass reading time; Experiment 2: total times) and at the second noun phrase (Experiment 3: first-pass times) were faster for sentences that expressed similarity when the preceding words/objects were close together (vs. far apart) and for sentences that expressed dissimilarity when the preceding words/objects were far apart (vs. close together). Thus, spatial distance between words or entirely unrelated objects can rapidly and incrementally modulate the semantic interpretation of abstract sentences.     

Individual differences in spatial mental imagery

In this article, we report a new image-scanning paradigm that allowed us to measure objectively individual differences in spatial mental imagery—specifically, imagery for location. Participants were asked to determine whether an arrow was pointing at a dot using a visual mental image of an array of dots. The degree of precision required to discriminate “yes” from “no” trials was varied. In Experiment 1, the time to scan increasing distances, as well as the number of errors, increased when greater precision was required to make a judgement. The results in Experiment 2 replicated those results while controlling for possible biases. When greater precision is required, the accuracy of the spatial image becomes increasingly important—and hence the effect of precision in the task reflects the accuracy of the image. In Experiment 3, this measure was shown to be related to scores on the Paper Folding test, on the Paper Form Board test, and on the visuospatial items on Raven's Advanced Progressive Matrices—but not to scores on questionnaires measuring object–based mental imagery. Thus, we provide evidence that classical standardized spatial tests rely on spatial mental imagery but not object mental imagery.     

Spatial congruency between stimulus presentation and response key arrangements in arithmetic fact retrieval

It is known that number and space representations are connected to one another in numerical and arithmetic abilities. Numbers are represented using the metaphor of a mental number line, oriented along horizontal and vertical space. This number line also seems to be linked to mental arithmetic, which is based partly on arithmetic fact retrieval. It seems that number representation and mental arithmetic are linked together. The present study tested the effect of spatial contextual congruency between stimulus presentation and response key arrangements in arithmetic fact retrieval, using number-matching and addition verification tasks. For both tasks in Experiment 1, a contextual congruency effect was present horizontally (i.e., horizontal presentation of stimuli and horizontal response key alignments) but not vertically (i.e., vertical presentation of stimuli but horizontal response key alignments). In Experiment 2, both tasks showed a contextual congruency effect for both spatial conditions. Experiment 1 showed that the interference and distance effects were found in the horizontal condition, probably because of the spatial congruency between stimulus presentation and response key arrangements. This spatial congruency could be related to the activation of the horizontal number line. Experiment 2 showed similar interference and distance effects for both spatial conditions, suggesting that the congruency between stimulus presentation and response alignment could facilitate the retrieval of arithmetic facts. This facilitation could be related to the activation of both horizontal and vertical number lines. The results are discussed in light of the possible role of a mental number line in arithmetic fact retrieval.     

The role of color diagnosticity in object recognition and representation

The role of color diagnosticity in object recognition and representation was assessed in three Experiments. In Experiment 1a, participants named pictured objects that were strongly associated with a particular color (e.g., pumpkin and orange). Stimuli were presented in a congruent color, incongruent color, or grayscale. Results indicated that congruent color facilitated naming time, incongruent color impeded naming time, and naming times for grayscale items were situated between the congruent and incongruent conditions. Experiment 1b replicated Experiment 1a using a verification task. Experiment 2 employed a picture rebus paradigm in which participants read sentences one word at a time that included pictures of color diagnostic objects (i.e., pictures were substituted for critical nouns). Results indicated that the “reading” times of these pictures mirrored the pattern found in Experiment 1. In Experiment 3, an attempt was made to override color diagnosticity using linguistic context (e.g., a pumpkin was described as painted green). Linguistic context did not override color diagnosticity. Collectively, the results demonstrate that color information is regularly utilized in object recognition and representation for highly color diagnostic items.     

Phonological Regularities and Grammatical Gender Retrieval in Spoken Word Recognition and Word Production

Two experiments investigate whether native speakers of French can use a noun’s phonological ending to retrieve its gender and that of a gender-marked element. In Experiment 1, participants performed a gender decision task on the noun’s gender-marked determiner for auditorily presented nouns. Noun endings with high predictive values were selected. The noun stimuli could either belong to the gender class predicted by their ending (congruent) or they could belong to the gender class that was different from the predicted gender (incongruent). Gender decisions were made significantly faster for congruent nouns than for incongruent nouns, relative to a (lexical decision) baseline task. In Experiment 2, participants named pictures of the same materials as used in Experiment 1 with noun phrases consisting of a gender-marked determiner, a gender-marked adjective and a noun. In this Experiment, no effect of congruency, relative to a (bare noun naming) baseline task, was observed. Thus, the results show an effect of phonological information on the retrieval of gender-marked elements in spoken word recognition, but not in word production.     

Structural properties of spatial representations in blind people: Scanning images constructed from haptic exploration or from locomotion in a 3-D audio virtual environment

When people scan mental images, their response times increase linearly with increases in the distance to be scanned, which is generally taken as reflecting the fact that their internal representations incorporate the metric properties of the corresponding objects. In view of this finding, we investigated the structural properties of spatial mental images created from nonvisual sources in three groups (blindfolded sighted, late blind, and congenitally blind). In Experiment 1, blindfolded sighted and late blind participants created metrically accurate spatial representations of a small-scale spatial configuration under both verbal and haptic learning conditions. In Experiment 2, late and congenitally blind participants generated accurate spatial mental images after both verbal and locomotor learning of a full-scale navigable space (created by an immersive audio virtual reality system), whereas blindfolded sighted participants were selectively impaired in their ability to generate precise spatial representations from locomotor experience. These results attest that in the context of a permanent lack of sight, encoding spatial information on the basis of the most reliable currently functional system (the sensorimotor system) is crucial for building a metrically accurate representation of a spatial environment. The results also highlight the potential of spatialized audio-rendering technology for exploring the spatial representations of visually impaired participants.     

Linguistic and Perceptual Mapping in Spatial Representations: An Attentional Account

Building on evidence for embodied representations, we investigated whether Spanish spatial terms map onto the NEAR/FAR perceptual division of space. Using a long horizontal display, we measured congruency effects during the processing of spatial terms presented in NEAR or FAR space. Across three experiments, we manipulated the task demands in order to investigate the role of endogenous attention in linguistic and perceptual space mapping. We predicted congruency effects only when spatial properties were relevant for the task (reaching estimation task, Experiment 1) but not when attention was allocated to other features (lexical decision, Experiment 2; and color, Experiment 3). Results showed faster responses for words presented in Near‐space in all experiments. Consistent with our hypothesis, congruency effects were observed only when a reaching estimate was requested. Our results add important evidence for the role of top‐down processing in congruency effects from embodied representations of spatial terms.