Discourse-mediation of the mapping between language and the visual world: Eye movements and mental representation

Two experiments explored the mapping between language and mental representations of visual scenes. In both experiments, participants viewed, for example, a scene depicting a woman, a wine glass and bottle on the floor, an empty table, and various other objects. In Experiment 1, participants concurrently heard either ‘The woman will put the glass on the table’ or ‘The woman is too lazy to put the glass on the table’. Subsequently, with the scene unchanged, participants heard that the woman ‘will pick up the bottle, and pour the wine carefully into the glass.’ Experiment 2 was identical except that the scene was removed before the onset of the spoken language. In both cases, eye movements after ‘pour’ (anticipating the glass) and at ‘glass’ reflected the language-determined position of the glass, as either on the floor, or moved onto the table, even though the concurrent (Experiment 1) or prior (Experiment 2) scene showed the glass in its unmoved position on the floor. Language-mediated eye movements thus reflect the real-time mapping of language onto dynamically updateable event-based representations of concurrently or previously seen objects (and their locations).     

What exactly is a yait anyway: The role of semantics in orthographic learning

This study investigated whether semantic information presented along with novel printed nonwords facilitates orthographic learning and examined predictors of individual differences in this important literacy skill. A sample of 35 fourth graders was tested on a variety of language and literacy tests, and participants were then exposed to 10 target nonwords, 5 of which were presented with semantic information. Children were tested 1 and 4 days later on their ability to correctly recognize and spell the target nonwords. Results revealed a significant main effect on the recognition task, where items presented with semantic information were identified correctly more often than were words presented in isolation. No significant effect of training condition was found for the spelling posttests. Furthermore, multiple regression analyses revealed that both phonological and semantic factors were significant predictors of orthographic learning. The findings support the view that orthographic learning, as measured through visual recognition, involves the integration of phonological, orthographic, and semantic representations.     

Processing spatial relations with different apertures of attention

Neuropsychological studies suggest the existence of lateralized networks that represent categorical and coordinate types of spatial information. In addition, studies with neural networks have shown that they encode more effectively categorical spatial judgments or coordinate spatial judgments, if their input is based, respectively, on units with relatively small, nonoverlapping receptive fields, as opposed to units with relatively large, overlapping receptive fields. These findings leave open the question of whether interactive processes between spatial detectors and types of spatial relations can be modulated by spatial attention. We hypothesized that spreading the attention window to encompass an area that includes two objects promotes coordinate spatial relations, based on coarse coding by large, overlapping, receptive fields. In contrast, narrowing attention to encompass an area that includes only one of the objects benefits categorical spatial relations, by effectively parsing space. By use of a cueing procedure, the spatial attention window was manipulated to select regions of differing areas. As predicted, when the attention window was large, coordinate spatial transformations were noticed faster than categorical transformations; in contrast, when the attention window was relatively smaller, categorical spatial transformations were noticed faster than coordinate transformations. Another novel finding was that coordinate changes were noticed faster when cueing an area that included both objects as well as the empty space between them than when simultaneously cueing both areas including the objects while leaving the gap between them uncued.     

Parts and wholes in person recognition: developmental trends

This study's aim is the investigation of short-term visual person recognition in 8- and 10-year-olds and adults, within the part-whole paradigm introduced by. Natural unfamiliar whole persons were contrasted with natural unfamiliar faces to test for differences between person processing and face processing. Two experiments showed advantages of whole face recognition over isolated face feature recognition. Also, these was a complete over part probe advantage (CPA, ) for person recognition in all age groups. Thus, recognition became more accurate between 8 years and adulthood, but no developmental shift in visual information processing was observable with face and whole person recognition. I conclude that person recognition does not rely on processes completely different from those of face recognition and that this holds for 8- and 10-year-olds as well as for adults.     

Anisotropic tracking: evidence for automatic synergy formation in a bimanual task

Investigation of interlimb synergy has become synonymous with the study of coordination dynamics and is largely confined to periodic movement. Based on a computational approach this paper demonstrates a method of investigating the formation of a novel synergy in the context of stochastic, spatially asymmetric movements. Nine right-handed participants performed a two degrees of freedom (2D) "etch-a-sketch" tracking task where the right hand controlled the horizontal position of the response cursor on the display while the left hand controlled the vertical position. In a pre-practice 2D tracking task, measures of phase lag between the irregularly moving target and the response showed that participants controlled left and right hands independently, performance of the right hand being slightly superior to the left. Participants then undertook 4 h 16 min distributed practice of a one degree of freedom etch-a-sketch task where the target was constrained to move irregularly in only the 45 degrees direction on the display. To track such a target accurately participants had to make in-phase coupled stochastic movements of the hands. In a post-practice 2D task, measures of phase lag showed anisotropic improvement in performance, the amount of improvement depending on the direction of motion on the display. Improvement was greatest in the practised 45 degrees and least in the orthogonal 135 degrees direction. Best and worst performances were no longer in the directions associated with right and left hands independently, but in directions requiring coupled movements of the two hands. These data support the proposal that the nervous system can establish a model of novel coupling between the hands and thereby form a task-dependent bimanual synergy for controlling the stochastic coupled movements as an entity.     

Children's working memory: investigating performance limitations in complex span tasks

Three experiments investigated the roles of resource-sharing and intrinsic memory demands in complex working memory span performance in 7- and 9-year-olds. In Experiment 1, the processing complexity of arithmetic operations was varied under conditions in which processing times were equivalent. Memory span did not differ as a function of processing complexity. In Experiment 2, complex memory span was assessed under three conditions designed to vary both processing and intrinsic storage demands: mental arithmetic (significant attentional demands-requires storage), odd/even judgments (significant attentional demands-no storage required), and articulatory suppression (minimal attentional demands--no storage required). The highest memory spans were found in the articulatory suppression task. Span was at an intermediate level with arithmetic processing and was lowest for processing involving odd/even judgments. This difference in memory span for processing tasks involving arithmetic processing and odd/even judgments was eliminated in Experiment 3 when the pacing requirements of the arithmetic and odd/even processing tasks were equated. The results are consistent with the view that complex memory span performance is disrupted by processing activities that divert attentional resources from storage.     

Semantic asymmetries are modulated by phonological asymmetries: Evidence from the disambiguation of homophonic versus heterophonic homographs

The present study investigated cerebral asymmetries in accessing multiple meanings of two types of homographs: homophonic homographs (e.g., bank) and heterophonic homographs (e.g., tear). Participants read homographs preceded by either a biasing or a non-biasing sentential context and performed a lexical decision on lateralized targets presented 150 ms after onset of the sentence-final ambiguous prime. Targets were either related to the dominant or the subordinate meaning of the preceding homograph or were unrelated to it. In the case of homophonic homographs – our results converge with previous findings: both activation and selection processes are faster in the LH than in the RH. Importantly, however, in the case of heterophonic homographs – opposite asymmetries were found. These results suggest that semantic asymmetries are modulated by phonology. They are discussed in the context of a model of functional architecture of reading in the two hemispheres in which orthography, phonology and semantics are fully interconnected in the LH, whereas in the RH, orthography and phonology are not directly connected, such that phonological processes are mediated by semantics.     

Is anyone looking at me? Direct gaze detection in children with and without autism

Atypical processing of eye contact is one of the significant characteristics of individuals with autism, but the mechanism underlying atypical direct gaze processing is still unclear. This study used a visual search paradigm to examine whether the facial context would affect direct gaze detection in children with autism. Participants were asked to detect target gazes presented among distracters with different gaze directions. The target gazes were either direct gaze or averted gaze, which were either presented alone (Experiment 1) or within facial context (Experiment 2). As with the typically developing children, the children with autism, were faster and more efficient to detect direct gaze than averted gaze, whether or not the eyes were presented alone or within faces. In addition, face inversion distorted efficient direct gaze detection in typically developing children, but not in children with autism. These results suggest that children with autism use featural information to detect direct gaze, whereas typically developing children use configural information to detect direct gaze.     

Right hemisphere specialization for color detection

Three experiments were carried out to investigate hemispheric asymmetry in color processing among normal participants. In Experiment 1, it was shown that the reaction times (RTs) of the dominant and non-dominant hands assessed using a visual target presented at the central visual field, were not significantly different. In Experiment 2, RTs of ipsilateral hands to lateralized chromatic stimuli revealed that the processing time was 17 ms shorter in the right hemisphere (RH) than that in the left hemisphere among the right-handed participants, whereas no significant difference was found among the left-handed participants. On the other hand, RTs to lateralized achromatic stimuli showed no such asymmetry among both the right- and left-handed participants (Experiment 3). These findings strongly suggest RH superiority for detection of color among right-handed individuals.