Symbolic control of visual attention: Semantic constraints on the spatial distribution of attention

Humans routinely use spatial language to control the spatial distribution of attention. In so doing, spatial information may be communicated from one individual to another across opposing frames of reference, which in turn can lead to inconsistent mappings between symbols and directions (or locations). These inconsistencies may have important implications for the symbolic control of attention because they can be translated into differences in cue validity, a manipulation that is known to influence the focus of attention. This differential validity hypothesis was tested in Experiment 1 by comparing spatial word cues that were predicted to have high learned spatial validity (“above/below”) and low learned spatial validity (“left/right”). Consistent with this prediction, when two measures of selective attention were used, the results indicated that attention was less focused in response to “left/right” cues than in response to “above/below” cues, even when the actual validity of each of the cues was equal. In addition, Experiment 2 predicted that spatial words such as “left/right” would have lower spatial validity than would other directional symbols that specify direction along the horizontal axis, such as “←/→” cues. The results were also consistent with this hypothesis. Altogether, the present findings demonstrate important semantic-based constraints on the spatial distribution of attention.     

Space in Hand and Mind: Gesture and Spatial Frames of Reference in Bilingual Mexico

Speakers of many languages prefer allocentric frames of reference (FoRs) when talking about small-scale space, using words like “east” or “downhill.” Ethnographic work has suggested that this preference is also reflected in how such speakers gesture. Here, we investigate this possibility with a field experiment in Juchitán, Mexico. In Juchitán, a preferentially allocentric language (Isthmus Zapotec) coexists with a preferentially egocentric one (Spanish). Using a novel task, we elicited spontaneous co-speech gestures about small-scale motion events (e.g., toppling blocks) in Zapotec-dominant speakers and in balanced Zapotec-Spanish bilinguals. Consistent with prior claims, speakers’ spontaneous gestures reliably reflected either an egocentric or allocentric FoR. The use of the egocentric FoR was predicted—not by speakers’ dominant language or the language they used in the task—but by mastery of words for “right” and “left,” as well as by properties of the event they were describing. Additionally, use of the egocentric FoR in gesture predicted its use in a separate nonlinguistic memory task, suggesting a cohesive cognitive style. Our results show that the use of spatial FoRs in gesture is pervasive, systematic, and shaped by several factors. Spatial gestures, like other forms of spatial conceptualization, are thus best understood within broader ecologies of communication and cognition.     

The privileging of ‘Support-From-Below’ in early spatial language acquisition

Spatial terms that encode support (e.g., “on”, in English) are among the first to be understood by children across languages (e.g., Bloom, 1973; Johnston & Slobin, 1979). Such terms apply to a wide variety of support configurations, including Support-From-Below (SFB; cup on table) and Mechanical Support, such as stamps on envelopes, coats on hooks, etc. Research has yet to delineate infants’ semantic space for the term “on” when considering its full range of usage. Do infants initially map “on” to a very broad, highly abstract category – one including cups on tables, stamps on envelopes, etc.? Or do infants begin with a much more restricted interpretation - mapping “on” to certain configurations over others? Much infant cognition research suggests that SFB is an event category that infants learn about early - by five months of age (Baillargeon & DeJong, 2017) - raising the possibility that they may also begin by interpreting the word “on” as referring to configurations like cups on tables, rather than stamps on envelopes. Further, studies examining language production suggests that children and adults map the basic locative expression (BE on, in English) to SFB over Mechanical Support (Landau et al., 2016). We tested the hypothesis that this ‘privileging’ of SFB in early infant cognition and child and adult language also characterizes infants’ language comprehension. Using the Intermodal-Preferential-Looking-Paradigm in combination with infant eye-tracking, 20-month-olds were presented with two support configurations: SFB and Mechanical, Support-Via-Adhesion (henceforth, SVA). Infants preferentially mapped “is on” to SFB (rather than SVA) suggesting that infants differentiate between two quite different kinds of support configurations when mapping spatial language to these two configurations and more so, that SFB is privileged in early language understanding of the English spatial term “on”.     

A probabilistic computational model of cross-situational word learning

Words are the essence of communication: They are the building blocks of any language. Learning the meaning of words is thus one of the most important aspects of language acquisition: Children must first learn words before they can combine them into complex utterances. Many theories have been developed to explain the impressive efficiency of young children in acquiring the vocabulary of their language, as well as the developmental patterns observed in the course of lexical acquisition. A major source of disagreement among the different theories is whether children are equipped with special mechanisms and biases for word learning, or their general cognitive abilities are adequate for the task. We present a novel computational model of early word learning to shed light on the mechanisms that might be at work in this process. The model learns word meanings as probabilistic associations between words and semantic elements, using an incremental and probabilistic learning mechanism, and drawing only on general cognitive abilities. The results presented here demonstrate that much about word meanings can be learned from naturally occurring child-directed utterances (paired with meaning representations), without using any special biases or constraints, and without any explicit developmental changes in the underlying learning mechanism. Furthermore, our model provides explanations for the occasionally contradictory child experimental data, and offers predictions for the behavior of young word learners in novel situations.     

The impact of object type on the spatial analogies in Korean preschoolers

We tested young children’s spatial reasoning in a match-to-sample task, manipulating the objects in the task (abstract geometric shapes, line drawings of realistic objects, or both). Korean 4- and 5-year-old children (N = 161) generalized the target spatial configuration (i.e., on, in, above) more easily when the sample used geometric shapes and the choices used realistic objects than the reverse (i.e., realistic-object sample to geometric-shape choices). With within-type stimuli (i.e., sample and choices were both geometric shapes or both realistic objects), 5-year-old, but not 4-year-old, children generalized the spatial relations more easily with geometric shapes than realistic objects. In addition, children who knew more locative terms (e.g., “in”, “on”) performed better on the task, suggesting a link to children’s spatial vocabulary. The results demonstrate an advantage of geometric shapes over realistic objects in facilitating young children’s performance on a match-to-sample spatial reasoning task.     

Young children’s talk about learning events

In order to understand children’s conception of knowledge acquisition better, everyday uses of the terms “learn” and “teach” were examined. Longitudinal data obtained from CHILDES (MacWhinney & Snow, 1990) included 329 target term uses and related references by children (N=5, aged 2;4–7;3) and 431 by adults talking with them. Each reference was coded for mention of what was learned, when, how, and where learning occurred, who learned, and who taught/told, among other topics. Children and adults referred most frequently to what was learned and who learned/taught, and less frequently to when, how, and where learning occurred, a pattern that did not change as children aged. Consistent with earlier experimental reports, children talked mostly about their own learning, rarely mentioning sources of knowledge besides other people (e.g., teachers). Behavior learning was mentioned more than fact learning. Implications for characterizations of children’s developing conceptions of knowledge acquisition, for past and future experimental research, and for education were discussed.     

Why children learn color and size words so differently: evidence from adults' learning of artificial terms.

An adult simulation study examined why children's learning of color and size terms follow different developmental patterns, one in which word comprehension precedes success in nonlinguistic matching tasks versus one in which matching precedes word comprehension. In 4 experiments, adults learned artificial labels for values on novel dimensions. Training mimicked that characteristic for children learning either color words or size words. The results suggest that the learning trajectories arise from the different frames in which different dimensions are trained: Using a comparison (size-like) training regimen helps learners pick out the relevant dimension, and using a categorization (color-like) training regimen helps the learner correctly comprehend and produce dimension terms. The results indicate that the training regimen, not the meanings of the terms or the specific dimensions, determines the pattern of learning.     

Transitivity,Space, and Hand: The Spatial Grounding of Syntax

Previous research has linked the concept of number and other ordinal series to space via a spatially oriented mental number line. In addition, it has been shown that in visual scene recognition and production, speakers of a language with a left‐to‐right orthography respond faster to and tend to draw images in which the agent of an action is located to the left of the patient. In this study, we aim to bridge these two lines of research by employing a novel method that measures the spatial bias produced by transitive sentences that use a wide variety of abstract and concrete verbs. Across four experiments, participants read sentences and then responded to probe words appearing on either the left or right sides of the screen. Probe words consisted of agents, patients, other words in the sentence, or newly encountered words. We found consistent lateral biases to responding to agents and patients, which appears to be independent of order of mention in the sentence but which does reflect a correspondence between position in the sentence and role in the causal sequence of the action. Our results also show that this spatial bias is driven by the use of the hands in two different ways: The left hand shows a greater sensitivity to the spatial effect than the right hand, and vocal responses produce no spatial effect.     

Visuospatial cueing by self-caused features: Orienting of attention and action–outcome associative learning

The effect of a salient visual feature in orienting spatial attention was examined as a function of the learned association between the visual feature and the observer’s action. During an initial acquisition phase, participants learned that two keypress actions consistently produced red and green visual cues. Next, in a test phase, participants’ actions continued to result in singletons, but their color could be either congruent or incongruent with the learned action–color associations. Furthermore, the color singletons now functioned as valid or invalid spatial cues in a visual search, in which participants looked for a tilted line (“/” or “\”) among distractors (“X”s). The results showed that an action-congruent color was more effective as a valid cue in the search task (increased benefit), but less effective as an invalid cue (reduced cost). We discuss our findings in terms of both an inhibition account and a preactivation account of action-driven sensory bias, and argue in favor of the preactivation account.     

发展性阅读障碍儿童阅读中的眼跳定位缺陷：基于新词学习的实验证据

通过与生理年龄匹配儿童比较新词重复学习中眼跳定位模式变化的异同, 探讨发展性阅读障碍儿童在新词学习中的眼跳定位是否存在缺陷。以发展性阅读障碍儿童和生理年龄匹配儿童为被试, 采用重复学习新词范式, 结果发现：(1)与生理年龄匹配组相比, 发展性阅读障碍儿童跳入新词的眼跳距离较短、首次注视落点位置更靠近词首; (2)生理年龄匹配组儿童利用学习次数调节新词眼跳定位模式的能力高于发展性阅读障碍儿童, 即随着新词学习次数的增加, 生理年龄匹配组儿童跳入和跳出新词的眼跳距离随之增长, 首次注视落点位置更靠近词中心; 相比之下, 发展性阅读障碍儿童仅在跳出新词的眼跳距离上有所增长, 但增加幅度也显著小于生理年龄匹配组。结果表明, 发展性阅读障碍儿童在新词学习中的眼跳定位, 及利用学习次数对眼跳定位的调节上均表现出一定缺陷。     

TEACHING CHILDREN WITH AUTISM TO SEEK INFORMATION-ACQUISITION OF NOVEL INFORMATION AND GENERALIZATION OF RESPONDING

A time delay procedure was used to teach 3 children with autism to ask the question “What's that?” when novel stimuli were presented during an instructional task. Once the ability to ask the question was acquired, the children's ability to learn novel information by asking the question was assessed. The children were then taught to ask the question within a less structured context. All three studies used a multiple baseline across participants. Generalization was assessed in a different room, to a new person, and to novel stimuli. All of the children learned to ask the question within the instructional context, while on a walk in the school building, and to request information about three-dimensional objects. The acquisition of novel information was consistent for receptive and expressive tests for 2 of the children, with varied results for the 3rd. These studies indicate that children with autism can be taught to ask questions that lead to the acquisition of new information.     

Stepping Into a Map: Initial Heading Direction Influences Spatial Memory Flexibility

Learning a novel environment involves integrating first‐person perceptual and motoric experiences with developing knowledge about the overall structure of the surroundings. The present experiments provide insights into the parallel development of these egocentric and allocentric memories by intentionally conflicting body‐ and world‐centered frames of reference during learning, and measuring outcomes via online and offline measures. Results of two experiments demonstrate faster learning and increased memory flexibility following route perspective reading (Experiment 1) and virtual navigation (Experiment 2) when participants begin exploring the environment on a northward (vs. any other direction) allocentric heading. We suggest that learning advantages due to aligning body‐centered (left/right/forward/back) with world‐centered (NSEW) reference frames are indicative of three features of spatial memory development and representation. First, memories for egocentric and allocentric information develop in parallel during novel environment learning. Second, cognitive maps have a preferred orientation relative to world‐centered coordinates. Finally, this preferred orientation corresponds to traditional orientation of physical maps (i.e., north is upward), suggesting strong associations between daily perceptual and motor experiences and the manner in which we preferentially represent spatial knowledge.     

Bad–good constraints on a polarity correspondence account for the spatial–numerical association of response codes (SNARC) and markedness association of response codes (MARC) effects

Performance in numerical classification tasks involving either parity or magnitude judgements is quicker when small numbers are mapped onto a left-sided response and large numbers onto a right-sided response than for the opposite mapping (i.e., the spatial–numerical association of response codes or SNARC effect). Recent research by Gevers et al. [Gevers, W., Santens, S., Dhooge, E., Chen, Q., Van den Bossche, L., Fias, W., & Verguts, T. (2010). Verbal-spatial and visuospatial coding of number–space interactions. Journal of Experimental Psychology: General, 139, 180–190] suggests that this effect also arises for vocal “left” and “right” responding, indicating that verbal–spatial coding has a role to play in determining it. Another presumably verbal-based, spatial–numerical mapping phenomenon is the linguistic markedness association of response codes (MARC) effect whereby responding in parity tasks is quicker when odd numbers are mapped onto left-sided responses and even numbers onto right-sided responses. A recent account of both the SNARC and MARC effects is based on the polarity correspondence principle [Proctor, R. W., & Cho, Y. S. (2006). Polarity correspondence: A general principle for performance of speeded binary classification tasks. Psychological Bulletin, 132, 416–442]. This account assumes that stimulus and response alternatives are coded along any number of dimensions in terms of – and + polarities with quicker responding when the polarity codes for the stimulus and the response correspond. In the present study, even–odd parity judgements were made using either “left” and “right” or “bad” and “good” vocal responses. Results indicated that a SNARC effect was indeed present for the former type of vocal responding, providing further evidence for the sufficiency of the verbal–spatial coding account for this effect. However, the decided lack of an analogous SNARC-like effect in the results for the latter type of vocal responding provides an important constraint on the presumed generality of the polarity correspondence account. On the other hand, the presence of robust MARC effects for “bad” and “good” but not “left” and “right” vocal responses is consistent with the view that such effects are due to conceptual associations between semantic codes for odd–even and bad–good (but not necessarily left–right).     

Inhibition within a reference frame during the interpretation of spatial language

Spatial terms such as right are potentially ambiguous because they can refer to different regions of space when defined by competing reference frames (e.g., my right within a relative reference frame versus an object's right within an intrinsic reference frame). In such situations, previous research has suggested that multiple reference frames are initially activated, followed by inhibition of the reference frame that is not ultimately selected to define the spatial term. Reference frames are complex multi-component representations, raising the question of exactly which components of the non-selected frame are inhibited. It is possible that the whole frame may be inhibited, including all axes and endpoints, or that only select endpoints and axes may be inhibited. Three experiments conducted using a negative priming paradigm revealed that only certain components of the non-selected reference frame were inhibited, consistent with the idea that some axes are privileged. These results also suggest that the components of a reference frame can be independently accessed. Implications for representing and accessing spatial information are discussed.     

言语编码和视空编码在时间—空间联结中的作用

时间和空间存在反应编码联合效应（spatial—temporal association of response codes effect, STEARC）,该效应的编码是视觉空间性还是言语性还存在争议。本研究借鉴Georges（2015）的研究方式,以2秒内的时距为刺激,实验1采用言语反应和空间反应,词语和空间与时距的关系分为一致和不一致。结果发现言语反应时,短时距用“左边”反应快,长时距用“右边”反应快,空间反应时,时距和空间的一致性效应消失,表明言语编码参与两种反应形式的STEARC效应。实验2将词语改为箭头朝向（视觉编码条件）,发现视觉编码和空间编码存在于相对应的反应形式中。研究表明时空关系的编码形式与具体任务要求有关。