The role of the brain's frontal eye fields in constructing frame of reference

Establishing contextual reference during discourse is a vital part of language function. Personal pronouns (e.g., he/she/it) are used to refer to previously experienced objects, utterances and events. These items, however, are often no longer present in the environment and have to be maintained and manipulated in working memory (WM). One aspect of this is the construction of a spatial frame of reference (e.g., "He was in front of it" where "he" is established as figure and "it" is the ground). The WM processes underlying this function may be different from those involved in establishing a non-spatial relation (e.g., "He was older than her"). The brain's frontal eye fields (FEFs), responsible for eye movement control, are known to be involved in processing spatial WM. This paper reviews both functional magnetic resonance imaging experiments and a subsequent behavioral interference study demonstrating a specific role for the FEFs and the brain's eye movement control system in manipulation of WM content for establishing object-centered spatial reference frames during verbally cued recall of recent visual and linguistic experiences.     

The paradox of moral focus

When we evaluate moral agents, we consider many factors, including whether the agent acted freely, or under duress or coercion. In turn, moral evaluations have been shown to influence our (non-moral) evaluations of these same factors. For example, when we judge an agent to have acted immorally, we are subsequently more likely to judge the agent to have acted freely, not under force. Here, we investigate the cognitive signatures of this effect in interpersonal situations, in which one agent (“forcer”) forces another agent (“forcee”) to act either immorally or morally. The structure of this relationship allowed us to ask questions about both the “forcer” and the “forcee.” Paradoxically, participants judged that the “forcer” forced the “forcee” to act immorally (i.e. X forced Y), but that the “forcee” was not forced to act immorally (i.e. Y was not forced by X). This pattern obtained only for human agents who acted intentionally. Directly changing participants’ focus from one agent to another (forcer versus forcee) also changed the target of moral evaluation and therefore force attributions. The full pattern of judgments may provide a window into motivated moral reasoning and focusing bias more generally; participants may have been motivated to attribute greater force to the immoral forcer and greater freedom to the immoral forcee.     

Distinguishing non-spatial from spatial biases in visual selection: neuropsychological evidence

Recently, it has been shown that patients with visual extinction can show enhanced awareness of contralesional stimuli that match the contents of working memory [Soto, D., & Humphreys, G.W. (2006). Proceedings of the National Academy of Sciences, USA, 103, 4789–4792]. Here we investigate whether these effects extend to cases where the working memory cue is verbal rather than visual (Study 1), and we show that non-spatial cues can overcome problems in spatial disengagement in patients, and this can affect the first eye movement made in search (Study 2). We discuss the implications of the data for understanding the relations between the cueing of attention from visual and conceptual information held in working memory and the cueing of spatial attention, and for understanding the relations between non-spatial and spatial biases in selection.     

颜色和形状工作记忆对非空间返回抑制效应的影响

为进一步考察非空间返回抑制效应是否受工作记忆内容的影响,分别采用颜色和形状工作记忆内容,通过两个实验考察了工作记忆对非空间返回抑制效应的影响。实验结果表明,在颜色和形状工作记忆条件下,均产生了颜色或形状返回抑制效应,并且颜色或形状返回抑制效应量之间均无显著差异,颜色和形状工作记忆内容只增加了判断靶刺激的反应时。研究结论对进一步认识工作记忆内容与非空间返回抑制效应之间的关系有重要参考价值。     

Testing the role of response repetition in spatial priming in visual search

In common “attention” tasks, which require stimulus-identity processing prior to the formation of a speeded key-press response, spatial priming effects depend on response repetition. Typically, the repetition of a stimulus location is advantageous when the prior response repeats, but disadvantageous or inconsequential when the prior response changes. This link between responding and space makes it difficult to draw inferences about attentional bias from two-choice key-press tasks. Instead, the findings are accounted for by episodic retrieval theories, which argue that the response associated with a prior stimulus location is retrieved when a later stimulus occupies its space. This retrieval operation is advantageous if the prior response is needed but not otherwise, which explains typical patterns. This perspective motivated us to evaluate whether spatial priming effects in the visual-search literature depend critically on response repetition. To assess this, we reevaluated a series of experiments recently published by Tower-Richardi, Leber, and Golomb (Attention, Perception, & Psychophysics, 78(1), 114–132, 2016). Their goal was to determine the reference frame of spatial priming across visual search displays. Reassessment reveals that spatial priming was strongly dependent on response repetition when spatiotopic, retinotopic, and object-centered reference frames were perfectly confounded. However, when eye movements were made to dissociate the spatiotopic and object-centered reference frame from the retinotopic reference frame, spatial priming was positive and unaffected by response repetition. The findings demonstrate that at least two distinct processes factor into spatial priming across visual searches, which occur at different levels of representation.     

Oculocentric coding of inhibited eye movements to recently attended locations

Results are reported for experiments that examined eye movements directed toward recently cued objects. In 1 experiment participants were slower to initiate saccades toward the earlier location of an object that had been cued, even though the cued object had subsequently moved away from that location. Other experiments involved exploring the reference frame within which the inhibited eye movements are encoded. These experiments revealed that the eye movement that is inhibited is encoded in an oculocentric-rather than an environmental-reference frame. However, simple detection as indexed by manual keypress responses is encoded in an environmental reference frame. The results have implications for inhibition of return, for the link between eye movements and attention, and for the nature of the spatial reference frames in which both covert and overt movements of attention are encoded.     

Language can mediate eye movement control within 100 milliseconds, regardless of whether there is anything to move the eyes to

The delay between the signal to move the eyes, and the execution of the corresponding eye movement, is variable, and skewed; with an early peak followed by a considerable tail. This skewed distribution renders the answer to the question “What is the delay between language input and saccade execution?” problematic; for a given task, there is no single number, only a distribution of numbers. Here, two previously published studies are reanalysed, whose designs enable us to answer, instead, the question: How long does it take, as the language unfolds, for the oculomotor system to demonstrate sensitivity to the distinction between “signal” (eye movements due to the unfolding language) and “noise” (eye movements due to extraneous factors)? In two studies, participants heard either ‘the man…’ or ‘the girl…’, and the distribution of launch times towards the concurrently, or previously, depicted man in response to these two inputs was calculated. In both cases, the earliest discrimination between signal and noise occurred at around 100 ms. This rapid interplay between language and oculomotor control is most likely due to cancellation of about-to-be executed saccades towards objects (or their episodic trace) that mismatch the earliest phonological moments of the unfolding word.     

Playing on the typewriter, typing on the piano: manipulation knowledge of objects

Two experiments investigated sensory/motor-based functional knowledge of man-made objects: manipulation features associated with the actual usage of objects. In Experiment 1, a series of prime-target pairs was presented auditorily, and participants were asked to make a lexical decision on the target word. Participants made a significantly faster decision about the target word (e.g. ‘typewriter’) following a related prime that shared manipulation features with the target (e.g. ‘piano’) than an unrelated prime (e.g. ‘blanket’). In Experiment 2, participants' eye movements were monitored when they viewed a visual display on a computer screen while listening to a concurrent auditory input. Participants were instructed to simply identify the auditory input and touch the corresponding object on the computer display. Participants fixated an object picture (e.g. “typewriter”) related to a target word (e.g. ‘piano’) significantly more often than an unrelated object picture (e.g. “bucket”) as well as a visually matched control (e.g. “couch”). Results of the two experiments suggest that manipulation knowledge of words is retrieved without conscious effort and that manipulation knowledge constitutes a part of the lexical-semantic representation of objects.     

Effects of the global and local attention on the processing of categorical and coordinate spatial relations

Participants made categorical or coordinate spatial judgments on the global or local elements of shapes. Stimuli were composed of a horizontal line and two dots. In the Categorical task, participants judged whether the line was above or below the dots. In the Coordinate task, they judged whether the line would fit between the dots. Stimuli were made hierarchical so that the global patterns composed of a “global line” made of local dots-and-line units, and “global dot” made of a single dots-and-line unit. The results indicated that the categorical task was better performed when participants attended to the local level of the hierarchical stimuli. On the other hand, the coordinate task was better performed when they attended to the global level. These findings are consistent with computer simulation models of the attentional modulation of neuronal receptive fields’ size suggesting that (1) coordinate spatial relations are more efficiently encoded when one attends to a relatively large region of space, whereas (2) categorical spatial relations are more efficiently encoded when one attends to a relatively small region of space.     

Cognitive effects of language on human navigation

Language has been linked to spatial representation and behavior in humans, but the nature of this effect is debated. Here, we test whether simple verbal expressions improve 4-year-old children’s performance in a disoriented search task in a small rectangular room with a single red landmark wall. Disoriented children’s landmark-guided search for a hidden object was dramatically enhanced when the experimenter used certain verbal expressions to designate the landmark during the hiding event. Both a spatial expression (“I’m hiding the sticker at the red/white wall”) and a non-spatial but task-relevant expression (“The red/white wall can help you get the sticker”) enhanced children’s search, relative to uncued controls. By contrast, a verbal expression that drew attention to the landmark in a task-irrelevant manner (“Look at this pretty red/white wall”) produced no such enhancement. These findings provide further evidence that language changes spatial behavior in children and illuminate one mechanism through which language exerts its effect: by helping children understand the relevance of landmarks for encoding locations.     

The embodied cognition theory and the motor component of “yes” and “no” verbal responses

Most of the experiments which give theories of embodied cognition their empirical anchorage only take into consideration the motor responses induced by the task or the motor component of the visual stimulus. And yet, these motor responses are often associated with a linguistic answer. Our hypothesis is that “YES” and “NO” verbal responses have a motor component. In a first experiment we showed that producing a verbal response (YES vs. NO) involves motor planning (pushing vs. pulling): participants push a lever more quickly when they have to answer “yes” than “no”, and conversely, they pull a lever more quickly when they have to answer “no” than “yes”. Moreover, in a second experiment, we showed that perceiving the words “YES” and “NO”, on its own, leads to the same motor planning than when “yes” and “no” answers actually have to be produced. Participants detect the word “YES” faster when they have to push a lever than when they have to pull it and conversely they detect the word “NO” faster when they have to pull the lever than when they have to push it down. These results are discussed in reference to “online” and “offline embodiment” concepts and to the cognitive linguistic theories.     

A left cerebral hemisphere’s superiority in processing spatial-categorical information in a non-verbal semantic format

It has been shown that the left and right cerebral hemispheres (LH and RH) respectively process qualitative or “categorical” spatial relations and metric or “coordinate” spatial relations. However, categorical spatial information could be thought as divided into two types: semantically-coded and visuospatially-coded categorical information. We examined whether a LH’s advantage in processing semantic-categorical information is observed in a non-verbal format, and also whether semantic- and visuospatial-categorical processing are differentially lateralized. We manipulated the colors and positions of the standard traffic light sign as semantic- and visuospatial-categorical information respectively, and tested performance with the divided visual field method. In the semantic-categorical matching task, in which the participants judged if the semantic-categorical information of a successive cue and target was the same, a right visual field advantage was observed, suggesting a LH’s preference for processing semantic-categorical information in a non-verbal format. In the visuospatial-categorical matching task, in which the participants judged if the visuospatial-categorical information of a successive cue and target was identical, a left visual field advantage was obtained. These results suggest that the processing of semantic-categorical information is lateralized in LH, and we discuss the dissociation between the two types of categorical information.     

公正世界信念对记忆偏差的影响

公正世界信念指人们需要相信他们所处的世界是一个公正有序的世界。本研究考察的是公正世界信念是否影响人们的记忆,让人产生记忆偏差。实验一中,被试首先阅读一则彩票中奖的新闻,然后阅读关于中奖者人品的描述,最后被试需要回忆中奖金额。结果发现,中奖者的个性品质影响对奖金数额的记忆。实验二中,两组被试分别阅读一则维护公正世界信念或威胁公正世界信念的无关故事,接下来程序与实验一相同。结果发现,预先激活的公正世界信念状态与中奖者个性品质在记忆结果上存在显著的交互效应。结果表明,公正世界信念能够导致记忆偏差。     

No effects of eye movements on the encoding of the visuospatial sketchpad and the phonological loop in healthy participants: Possible implications for eye movement desensitization and reprocessing therapy

Horizontal eye movement is an essential component of the psychological intervention “eye movement desensitization and reprocessing” (EMDR) used in posttraumatic stress disorder. A hypothesized mechanism of action is an overload of the visuospatial sketchpad and/or the phonological loop of the working memory.     

Learning melodies from non-adjacent tones

Language acquisition might heavily rely on statistical learning mechanisms. This has led many researchers to investigate the computational constraints that limit such learning. In particular, it has been argued that statistical relations among non-adjacent items cannot be tracked, as this might lead to a “computational explosion” making statistical learning intractable. In line with this view, previous research suggests that listeners cannot track relations among non-adjacent musical tones (Creel, Newport, & Aslin, 2004). Here I show that participants readily track non-adjacent tone relations when these are implemented in a musically meaningful way. Specifically, participants readily track non-adjacent tone relations in tonal melodies, but find it more difficult to track non-adjacent tone relations in random melodies, suggesting that non-adjacent relations are easier to track when listeners face “ecological”, musically meaningful stimuli.     

Do you see what I’m singing? Visuospatial movement biases pitch perception

The nature of the connection between musical and spatial processing is controversial. While pitch may be described in spatial terms such as “high” or “low”, it is unclear whether pitch and space are associated but separate dimensions or whether they share representational and processing resources. In the present study, we asked participants to judge whether a target vocal note was the same as (or different from) a preceding cue note. Importantly, target trials were presented as video clips where a singer sometimes gestured upward or downward while singing that target note, thus providing an alternative, concurrent source of spatial information. Our results show that pitch discrimination was significantly biased by the spatial movement in gesture, such that downward gestures made notes seem lower in pitch than they really were, and upward gestures made notes seem higher in pitch. These effects were eliminated by spatial memory load but preserved under verbal memory load conditions. Together, our findings suggest that pitch and space have a shared representation such that the mental representation of pitch is audiospatial in nature.     

The influence of eye movements and illumination on auditory localization

A critical analysis of a recent paper by Shelton and Searle (1980) on the visual facilitation of auditory localization is presented. The author claims that Shelton and Searle fail to make the relevant distinction between Warren’s (1970) frame of reference hypothesis and Jones’s (1975) spatial memory hypothesis. Shelton and Searle’s claim that they have demonstrated the existence of two distinct forms of visual facilitation is questioned. Data from an experiment in which auditory localization was tested under two levels of illumination (light and dark) and with two kinds of eye movement instructions (fixed and movement) are presented. The results show that facilitation occurs only when eye movements take place in a lighted environment. This is interpreted as supporting Warren’s frame of reference hypothesis.     

The extent of working memory deficits associated with Williams syndrome: exploration of verbal and spatial domains and executively controlled processes

The present study investigated verbal and spatial working memory (WM) functioning in individuals with the neuro-developmental disorder Williams syndrome (WS) using WM component tasks. While there is strong evidence of WM impairments in WS, previous research has focused on short-term memory and has neglected assessment of executive components of WM. There is a particular lack of consensus concerning the profile of verbal WM functioning in WS. Here, WS participants were compared to typically developing participants matched for (1) verbal ability and (2) spatial ability (N = 14 in each of the 3 groups). Individuals with WS were impaired on verbal WM tasks, both those involving short-term maintenance of information and executive manipulation, in comparison to verbal-matched controls. Surprisingly, individuals with WS were not impaired on a spatial task assessing short-term maintenance of information in memory (remembering spatial locations) compared to spatial-matched controls. They were, however, impaired on a spatial executive WM task requiring the manipulation of spatial information in memory. The present study suggests that individuals with WS show WM impairments that extend to both verbal and spatial domains, although spatial deficits are selective to executive aspects of WM function.     

Factors Affecting the Use of Dimensional Prepositions in German and American English: Object Orientation, Social Context, and Prepositional Pattern

Spatial language and the use of spatial prepositions has recently been intensively investigated. We add two novel aspects to the question of which frame of reference, i.e., the deictic or the intrinsic frame, is used when communicating about dimensional relations between objects. We restrict ourselves to the use of prepositions that refer to the first horizontal axis, i.e., in front of and behind in English, and vor and hinter in German, respectively, and report on a series of 16 experiments on the connection between the use of these prepositions and the indication of particular subspaces adjacent to reference objects in a traffic environment. First, we will show that an interaction between the intrinsic orientation of the reference object, the type of social situation in which spatial communication occurs, and the used language's pattern of prepositional word forms for temporal and spatiodimensional relations contributes to the proper prediction of the use of spatial prepositions. Second, we systematically consider production as well as interpretation of prepositions in two different languages in the same experimental setting, which allows for the estimation of communicative success. Here, it turns out that in German as well as in American English there are conditions in which speakers and listeners either agree or disagree on the chosen frame of reference; however, these conditions are different in the two languages investigated.     

Effects of ownership expressed by the first-person possessive pronoun

The present study examined the behavioral effects of the first-person possessive pronoun. In each trial, a noun (e.g. cup or bread) was presented to participants after visual presentation of a possessive pronoun “wo de” (Chinese for “my”) or “ta de” (Chinese for “his”), which formed ownership. Half participants were assigned to contextual encoding (CE) condition in which they were required to judge whether they liked the item expressed by a noun from the first or third-person perspective. The rest were assigned to perceptual encoding (PE) condition in which they were asked to judge what color the noun was. A subsequent recall test was performed. The results showed that there were significant memory and response advantages for nouns in “my” ownership under both conditions. The results were discussed with reference to self-specificity and other effects in the current study.