Putting action in perspective

Embodied approaches to cognition propose that our own actions influence our understanding of the world. Do other people's actions also have this influence? The present studies show that perceiving another person's actions changes the way people think about objects in a scene. In Study 1, participants viewed a photograph and answered a question about the location of one object relative to another. The question either did or did not call attention to an action being performed in the scene. Studies 2 and 3 focused on whether depicting an action in a scene influenced perspective choice. Across all studies, drawing attention to action, whether verbally or pictorially, led observers to encode object locations from the actor's spatial perspective. Study 4 demonstrated that the tendency to adopt the actor's perspective might be mediated by motor experience.     

一般人工智能概述(英文)

AGI是为解决传统人工智能存在的问题而产生的,更注重通用智能的基础问题和人工实现,与认知科学、心灵哲学也密切相关。本文通过介绍AGI的发展历史、AGI的定义及其与传统AI的关系以及一些有代表性的AGI方案等对AGI进行介绍。     

From demonstration to theory in embodied language comprehension: A review

Recent findings in psychology, psycholinguistics, and neuroscience present a challenge to current amodal theories by suggesting that cognitive states are not disembodied in language comprehension. Accumulating behavioral evidence supporting this view is reviewed from research on processing of language describing concrete and abstract concepts. The extant embodied theories that support either a strong or a moderate embodied view are then presented, as are the perspectives that define how the researchers discuss the role of sensory-motor grounding in language processing. The article concludes by discussing several lines of research that might help distinguish between various theoretical approaches and resolve some of the fundamental issues that fuel much of the debate in the field.     

The Fabric of Thought: Priming Tactile Properties During Reading Influences Direct Tactile Perception

The present studies examined whether implied tactile properties during language comprehension influence subsequent direct tactile perception, and the specificity of any such effects. Participants read sentences that implicitly conveyed information regarding tactile properties (e.g., Grace tried on a pair of thick corduroy pants while shopping) that were either related or unrelated to fabrics and varied in implied texture (smooth, medium, rough). After reading each sentence, participants then performed an unrelated rating task during which they felt and rated the texture of a presented fabric. Results demonstrated that the texture properties implied in sentences influence direct tactile perception. Specifically, after reading about a smooth or rough texture, subsequent fabric ratings became notably smoother or rougher, respectively. However, we also show that there was some specificity to these effects: Fabric‐related sentences elicited more specific and interactive effects on subsequent ratings. Together, we demonstrate that under certain circumstances, language comprehension can prime tactile representations and affect direct tactile perception. Results are discussed with regard to the nature and scope of multimodal mental simulation during reading.     

Lending a hand to signed language acquisition: Enactment and iconicity enhance sign recall in hearing adult American Sign Language learners

Abstract

Evidence over the last 15 years has suggested that dual (imagery and verbal) coding explanations of concreteness effects in memory for word lists do not generalise well to memory for sentences and paragraphs. In contrast, an alternative framework based on relative differences in relational and distinctive processing has been shown to account for the effects of imagery and concreteness in these contexts and others. This paper describes recent research on free and cued recall of word lists and evaluates it with respect to the two models. The evidence suggests that whereas dual processing systems may be involved in the encoding of verbal materials, dual memory codes are insufficient to explain concreteness effects in recall. Better memory for high-as compared to low-imagery words depends on the use of paradigms that facilitate inter-item relational processing, independent of whether or not imagery is involved.     

The role of embodied intention in early lexical acquisition

We examine the influence of inferring interlocutors' referential intentions from their body movements at the early stage of lexical acquisition. By testing human participants and comparing their performances in different learning conditions, we find that those embodied intentions facilitate both word discovery and word-meaning association. In light of empirical findings, the main part of this article presents a computational model that can identify the sound patterns of individual words from continuous speech, using nonlinguistic contextual information, and employ body movements as deictic references to discover word-meaning associations. To our knowledge, this work is the first model of word learning that not only learns lexical items from raw multisensory signals to closely resemble infant language development from natural environments, but also explores the computational role of social cognitive skills in lexical acquisition.     

A computational analysis of general intelligence tests for evaluating cognitive development

The progression in several cognitive tests for the same subjects at different ages provides valuable information about their cognitive development. One question that has caught recent interest is whether the same approach can be used to assess the cognitive development of artificial systems. In particular, can we assess whether the ‘fluid’ or ‘crystallised’ intelligence of an artificial cognitive system is changing during its cognitive development as a result of acquiring more concepts? In this paper, we address several IQ tests problems (odd-one-out problems, Raven’s Progressive Matrices and Thurstone’s letter series) with a general learning system that is not particularly designed on purpose to solve intelligence tests. The goal is to better understand the role of the basic cognitive operational constructs (such as identity, difference, order, counting, logic, etc.) that are needed to solve these intelligence test problems and serve as a proof-of-concept for evaluation in other developmental problems. From here, we gain some insights into the characteristics and usefulness of these tests and how careful we need to be when applying human test problems to assess the abilities and cognitive development of robots and other artificial cognitive systems.     

Understanding spatial relations: flexible infants,lexical adults

Concepts of containment, support, and degree of fit were investigated using nonverbal, preferential-looking tasks with 9- to 14-month-old infants and adults who were fluent in either English or Korean. Two contrasts were tested: tight containment vs. loose support (grammaticized as 'in' and 'on' in English by spatial prepositions and 'kkita' and 'nohta' in Korean by spatial verbs) and tight containment vs. loose containment (both grammaticized as 'in' in English but separately as 'kkita' and 'nehta' in Korean). Infants categorized both contrasts, suggesting conceptual readiness for learning such spatial semantics in either language. English-speaking adults categorized tight containment vs. loose support, but not tight vs. loose containment. However, Korean-speaking adults were successful at this latter contrast, which is lexicalized in their language. The adult data suggest that some spatial relations that are salient during the preverbal stage become less salient if language does not systematically encode them.     

Neural evidence for the interplay between language, gesture, and action: a review

Co-speech gestures embody a form of manual action that is tightly coupled to the language system. As such, the co-occurrence of speech and co-speech gestures is an excellent example of the interplay between language and action. There are, however, other ways in which language and action can be thought of as closely related. In this paper we will give an overview of studies in cognitive neuroscience that examine the neural underpinnings of links between language and action. Topics include neurocognitive studies of motor representations of speech sounds, action-related language, sign language and co-speech gestures. It will be concluded that there is strong evidence on the interaction between speech and gestures in the brain. This interaction however shares general properties with other domains in which there is interplay between language and action.     

Planet Braitenberg: Experiments in virtual psychology

Braitenberg vehicles are simple robotic platforms, equipped with rudimentary sensor and motor components. Such vehicles have typically featured as part of thought experiments that are intended to show how complex behaviours are apt to emerge from the interaction of inner control mechanisms with aspects of bodily structure and features of the wider (extra-agential) environment. The present paper describes a framework for creating Braitenberg-like vehicles, which is built on top of a widely used and freely available game engine, namely, the Unity game engine. The framework can be used to study the behaviour of virtual vehicles within a multiplicity of virtual environments. All aspects of the vehicle’s design, as well as the wider virtual environment in which the vehicle is situated, can be modified during the design phase, as well as at runtime. The result is a general-purpose simulation capability that is intended to provide the foundation for studies in so-called computational situated cognition—a field of study whose primary objective is to support the computational modelling of cognitive processes associated with the physically-embodied, environmentally-embedded, and materially-extended mind.     

Moving words: dynamic representations in language comprehension

Eighty-two participants listened to sentences and then judged whether two sequentially presented visual objects were the same. On critical trials, participants heard a sentence describe the motion of a ball toward or away from the observer (e.g., “The pitcher hurled the softball to you”). Seven hundred and fifty milliseconds after the offset of the sentence, a picture of an object was presented for 500 ms, followed by another picture. On critical trials, the two pictures depicted the kind of ball mentioned in the sentence. The second picture was displayed 175 ms after the first. Crucially, it was either slightly larger or smaller than the first picture, thus suggesting movement of the ball toward or away from the observer. Participants responded more quickly when the implied movement of the balls matched the movement described in the sentence. This result provides support for the view that language comprehension involves dynamic perceptual simulations.     

Being seaward-handed: a computational model of the acquisition of language-specific spatial references

Empirical findings of cross-linguistic studies reveal three different frames of spatial reference: intrinsic, relative, and absolute. Of special interest are relative and absolute systems because they have antagonistic logical implications concerning the dependence on standpoint and orientation of the speaker/hearer. On the background of these findings it becomes crucial to show how an agent can form such language-specific spatial representations. In this paper, the system Locator is introduced as a model of concept formation in the spatial domain. It is assumed that an agent creates necessary discriminative features in processes of self-organization and selection and cannot just discover or find them in its environment. A number of simulations show that agents successfully create concepts of either a relative system (German) or an absolute system (Marquesan), relying solely on multimodal input (visual and linguistic).

Embodied communication: Speakers’ gestures affect listeners’ actions

We explored how speakers and listeners use hand gestures as a source of perceptual-motor information during naturalistic communication. After solving the Tower of Hanoi task either with real objects or on a computer, speakers explained the task to listeners. Speakers’ hand gestures, but not their speech, reflected properties of the particular objects and the actions that they had previously used to solve the task. Speakers who solved the problem with real objects used more grasping handshapes and produced more curved trajectories during the explanation. Listeners who observed explanations from speakers who had previously solved the problem with real objects subsequently treated computer objects more like real objects; their mouse trajectories revealed that they lifted the objects in conjunction with moving them sideways, and this behavior was related to the particular gestures that were observed. These findings demonstrate that hand gestures are a reliable source of perceptual-motor information during human communication.     

Facing the sunrise: cultural worldview underlying intrinsic-based encoding of absolute frames of reference in aymara

The Aymara of the Andes use absolute (cardinal) frames of reference for describing the relative position of ordinary objects. However, rather than encoding them in available absolute lexemes, they do it in lexemes that are intrinsic to the body: nayra (“front”) and qhipa (“back”), denoting east and west, respectively. Why? We use different but complementary ethnographic methods to investigate the nature of this encoding: (a) linguistic expressions and speech–gesture co‐production, (b) linguistic patterns in the distinct regional Spanish‐based variety Castellano Andino (CA), (c) metaphorical extensions of CA’s spatial patterns to temporal ones, and (d) layouts of traditional houses. Findings indicate that, following fundamental principles of Aymara cosmology, people, objects, and land—as a whole—are conceived as having an implicit canonical orientation facing east, a primary landmark determined by the sunrise. The above bodily based lexicalizations are thus linguistic manifestations of a broader macro‐cultural worldview and its psycho‐cognitive reality.     

An embodied model for sensorimotor grounding and grounding transfer: experiments with epigenetic robots

The grounding of symbols in computational models of linguistic abilities is one of the fundamental properties of psychologically plausible cognitive models. In this article, we present an embodied model for the grounding of language in action based on epigenetic robots. Epigenetic robotics is one of the new cognitive modeling approaches to modeling autonomous mental development. The robot model is based on an integrative vision of language in which linguistic abilities are strictly dependent on and grounded in other behaviors and skills. It uses simulated robots that learn through imitation the names of basic actions. Robots also learn higher order action concepts through the process of grounding transfer. The simulation demonstrates how new, higher order behavioral abilities can be autonomously built on previously grounded basic action categories following linguistic interaction with human users.     

When global structure "Explains Away" local grammar: a Bayesian account of rule-induction in tone sequences

While many constraints on learning must be relatively experience-independent, past experience provides a rich source of guidance for subsequent learning. Discovering structure in some domain can inform a learner’s future hypotheses about that domain. If a general property accounts for particular sub-patterns, a rational learner should not stipulate separate explanations for each detail without additional evidence, as the general structure has “explained away” the original evidence. In a grammar-learning experiment using tone sequences, manipulating learners’ prior exposure to a tone environment affects their sensitivity to the grammar-defining feature, in this case consecutive repeated tones. Grammar-learning performance is worse if context melodies are “smooth” — when small intervals occur more than large ones — as Smoothness is a general property accounting for a high rate of repetition. We present an idealized Bayesian model as a “best case” benchmark for learning repetition grammars. When context melodies are Smooth, the model places greater weight on the small-interval constraint, and does not learn the repetition rule as well as when context melodies are not Smooth, paralleling the human learners. These findings support an account of abstract grammar-induction in which learners rationally assess the statistical evidence for underlying structure based on a generative model of the environment.     

Rotating With Rotated Text: A Natural Behavior Approach to Investigating Cognitive Offloading

Determining how we use our body to support cognition represents an important part of understanding the embodied and embedded nature of cognition. In the present investigation, we pursue this question in the context of a common perceptual task. Specifically, we report a series of experiments investigating head tilt (i.e., external normalization) as a strategy in letter naming and reading stimuli that are upright or rotated. We demonstrate that the frequency of this natural behavior is modulated by the cost of stimulus rotation on performance. In addition, we demonstrate that external normalization can benefit performance. All of the results are consistent with the notion that external normalization represents a form of cognitive offloading and that effort is an important factor in the decision to adopt an internal or external strategy.     

Revise and resubmit: How real-time parsing limitations influence grammar acquisition

We present the results from a three-day artificial language learning study on adults. The study examined whether sentence-parsing limitations, in particular, difficulties revising initial syntactic/semantic commitments during comprehension, shape learners’ ability to acquire a language. Findings show that both comprehension and production of morphology pertaining to sentence argument structure are delayed when this morphology consistently appears at the end, rather than at the beginning, of sentences in otherwise identical grammatical systems. This suggests that real-time processing constraints impact acquisition; morphological cues that tend to guide linguistic analyses are easier to learn than cues that revise these analyses. Parallel performance in production and comprehension indicates that parsing constraints affect grammatical acquisition, not just real-time commitments. Properties of the linguistic system (e.g., ordering of cues within a sentence) interact with the properties of the cognitive system (cognitive control and conflict-resolution abilities) and together affect language acquisition.     

社会网络视角的团队情绪智力

据估计, 60%的团队都没有达到它们的目标, 这给学术界提出了重要且具有挑战性的研究课题。情绪智力(emotional intelligence)是在人际关系基础上发展起来的重要概念。研究发现, 基于微观个体或宏观整体的团队情绪智力在团队成功达到目标过程中起到重要作用。然而, 当前尚无研究探讨基于团队局部成员间情绪智力行为交换而产生的团队情绪智力对团队的影响。为此, 本课题从配对层次(一对一关系中两个人, 即actor-target)这一新角度探讨团队情绪智力, 通过把它看做团队过程中一种产生的状态(emergent state), 在整合团队成员交换理论和社会网络方法基础上对它进行研究。具体围绕团队内配对单元存在的交换关系(指目标者感受到行动者对其实施的情绪智力行为)在团队中形成的网络所代表的团队情绪智力开展实证研究, 以期从理论上揭示团队内情绪智力行为交换的特征, 情绪智力自下而上(bottom-up)由个体发展到团队的过程, 以及配对基础的团队情绪智力的影响效应, 从而为团队管理实践提供具体的改善建议。