The influence of environmental context in interpersonal observation–execution

Cyclical upper-limb movements involuntarily deviate from a primary movement direction when the actor concurrently observes incongruent biological motion. We examined whether environmental context influences such motor interference during interpersonal observation–execution. Participants executed continuous horizontal arm movements while observing congruent horizontal or incongruent curvilinear biological movements with or without the presence of an object positioned as an obstacle or distractor. When participants were observing a curvilinear movement, an object located within the movement space became an obstacle, and, thus, the curvilinear trajectory was essential to reach into horizontal space. When acting as a distractor, or with no object, the curvilinear trajectory was no longer essential. For observing horizontal movements, objects were located at the same relative locations as in the curvilinear movement condition. We found greater involuntary movement deviation when observing curvilinear than horizontal movements. Also, there was an influence of context only when observing horizontal movements, with greater deviation exhibited in the presence of a large obstacle. These findings suggest that the influence of environmental context is underpinned by the (mis-)matching of observed and executed actions as incongruent biological motion is primarily coded via bottom-up sensorimotor processes, whilst the congruent condition incorporates surrounding environmental features to modulate the bottom-up sensorimotor processes.     

Reading action word affects the visual perception of biological motion

In the present study, we investigate whether reading an action-word can influence subsequent visual perception of biological motion. The participant's task was to perceptually judge whether a human action identifiable in the biological motion of a point-light display embedded in a high density mask was present or not in the visual sequence, which lasted for 633 ms on average. Prior to the judgement task, participants were exposed to an abstract verb or an action verb for 500 ms, which was related to the human action according to a congruent or incongruent semantic relation. Data analysis showed that correct judgements were not affected by action verbs, whereas a facilitation effect on response time (49 ms on average) was observed when a congruent action verb primed the judgement of biological movements. In relation with the existing literature, this finding suggests that the perception, the planning and the linguistic coding of motor action are subtended by common motor representations.     

Perceptually specific and perceptually non-specific influences on rereading benefits for spatially transformed text: Evidence from eye movements

The present study used eye tracking methodology to examine rereading benefits for spatially transformed text. Eye movements were monitored while participants read the same target word twice, in two different low-constraint sentence frames. The congruency of perceptual processing was manipulated by either applying the same type of transformation to the word during the first and second presentations (i.e., the congruent condition), or employing two different types of transformations across the two presentations of the word (i.e., the incongruent condition). Perceptual specificity effects were demonstrated such that fixation times for the second presentation of the target word were shorter for the congruent condition compared to the incongruent condition. Moreover, we demonstrated an additional perceptually non-specific effect such that second reading fixation times were shorter for the incongruent condition relative to a baseline condition that employed a normal typography (i.e., non-transformed) during the first presentation and a transformation during the second presentation. Both of these effects (i.e., perceptually specific and perceptually non-specific) were similar in magnitude for high and low frequency words, and both effects persisted across a 1 week lag between the first and second readings. We discuss the present findings in the context of the distinction between conscious and unconscious memory, and the distinction between perceptually versus conceptually driven processing.     

Semantic context effects and priming in word association

Two experiments investigated priming in word association, an implicit memory task. In the study phase of Experiment 1, semantically ambiguous target words were presented in sentences that biased their interpretation. The appropriate interpretation of the target was either congruent or incongruent with the cue presented in a subsequent word association task. Priming (i.e., a higher proportion of target responses relative to a nonstudied baseline) was obtained for the congruent condition, but not for the incongruent condition. In Experiment 2, study sentences emphasized particular meaning aspects of nonambiguous targets. The word association task showed a higher proportion of target responses for targets studied in the more congruent sentence context than for targets studied in the less congruent sentence context. These results indicate that priming in word association depends largely on the storage of information relating the cue and target.     

Word recognition and syntactic attachment in reading: evidence for a staged architecture

In 3 experiments, the author examined how readers' eye movements are influenced by joint manipulations of a word's frequency and the syntactic fit of the word in its context. In the critical conditions of the first 2 experiments, a high- or low-frequency verb was used to disambiguate a garden-path sentence, while in the last experiment, a high- or low-frequency verb constituted a phrase structure violation. The frequency manipulation always influenced the early eye movement measures of first-fixation duration and gaze duration. The context manipulation had a delayed effect in Experiment 1, influencing only the probability of a regressive eye movement from later in the sentence. However, the context manipulation influenced the same early eye movement measures as the frequency effect in Experiments 2 and 3, though there was no statistical interaction between the effects of these variables. The context manipulation also influenced the probability of a regressive eye movement from the verb, though the frequency manipulation did not. These results are shown to confirm predictions emerging from the serial, staged architecture for lexical and integrative processing of the E-Z Reader 10 model of eye movement control in reading (Reichle, Warren, & McConnell, 2009). It is argued, more generally, that the results provide an important constraint on how the relationship between visual word recognition and syntactic attachment is treated in processing models.     

The time course of semantic and syntactic processing in Chinese sentence comprehension: Evidence from eye movements

In the present study, we examined the time course of semantic and syntactic processing when Chinese is read. Readers’ eye movements were monitored, and the relation between a single-character critical word and the sentence context was manipulated such that three kinds of sentences were developed: (1) congruent, (2) those with a semantic violation, and (3) those with both a semantic and a syntactic violation. The eye movement data showed that the first-pass reading times were significantly longer for the target region in the two violation conditions than in the congruent condition. Moreover, the semantic + syntactic violation caused more severe disruption than did the pure semantic violation, as reflected by longer first-pass reading times for the target region and by longer go-past times for the target region and posttarget region in the former than in the latter condition. These results suggest that the effects of, at least, a semantic violation can be detected immediately by Chinese readers and that the processing of syntactic and semantic information is distinct in both first-pass and second-pass reading.     

Behavioral speed contagion: automatic modulation of movement timing by observation of body movements

To coordinate our actions with those of others, it is crucial to not only choose an appropriate category of action but also to execute it at an appropriate timing. It is widely documented that people tend to unconsciously mimic others' behavior. The present study show that people also tend to modify their movement timing according to others' movements even when the observed and the to-be-executed movements are unrelated. Observers viewed either point-light biological motion, scrambled biological motion, or solid object motion. The stimulus sequence was presented at three different (half, normal, and double) rates. After a 300-2400-ms blank period, the observers performed a simple choice reaction-time task that was unrelated to the presented stimulus sequence. The observation of the biological motion produced a negative correlation between reaction time and stimulus speed, whereas no such trend was observed with the scrambled or solid object motion. Furthermore, speed-dependent modulation occurred only when the task was imposed within approximately 1s after the offset of the biological motion. These results suggest that behavioral tempo may be contagious; the speed of others' movements may automatically influence the timing of movement execution by the observer.     

Human biological and nonbiological point-light movements: Creation and validation of the dataset

Human action perception is so powerful that people can identify movement efficiently in the absence of pictorial information, such as in point-light displays. Interest is growing in this type of stimulus for research in neuroscience. This interest stems from the advantage of separating the component of pure human action kinematics from other pictorial information, such as facial expression and muscle contraction. Although several groups have previously developed datasets of human point-light actions, due to the lack of datasets composed of daily actions with short durations, we developed 20 biological and 40 control (scrambled) point-light movements by using the technique of recording people wearing reflector patches. The videos are about 1 s long. Subsequently, we performed a judgment task in which 100 participants (50 male and 50 female) evaluated each video according to three categories: human action resemblance, performed action, and gender of actor. We present the mean scores of each evaluation for each video, and further propose a selection of the most suitable videos to be used as human point-light action displays and scrambled point-light displays for control. Finally, we discuss our findings on the gender attributions of the point-light displays.     

Perceiving minimal distinctions in ASL under normal and point-light display conditions

Perceptual confusions within 36 formationally minimal pairs of signs were assessed for native signers under two conditions of video presentation: (1) normally lighted black-and-white displays and (2) point-light displays constructed by affixing 26 points of retroreflective tape on the fingertips, back knuckles, and wrists and 1 point on the nose of the signer. Nine pairs were selected for each of the formational parameters of handshape, location, movement, and orientation. For each minimal pair, a native signer constructed and signed an ASL sentence that was syntactically and semantically appropriate for both members of the pair. Fourteen highly fluent ASL users responded by selecting a picture appropriate to the viewed sentence, thus avoiding contamination by English. For both viewing conditions, subjects discriminated the minimal pairs significantly better than chance. Performance was better (1) when location or orientation differentiated the signs than when movement or handshape did and (2) in normal lighting than in the point-light displays. With the point/light displays, discrimination of location, movement, and orientation was poorer and handshape discrimination was at chance. The discussion considers (1) the confusion of signs in the absence of linguistic redundancy, (2) the effectivenese of the point-light configurations as “minimal cues” for the contrasts, and (3) the efficacy of using these point-light configurations to reduce the information in ASL to a narrow bandwidth.     

A contingent speech technique in eye movement research on reading

A novel eye-movement-contingent method is presented. It builds on and extends established eye-movement-contingent visual display change methods in that it uses movements of the eyes to control the presentation of acoustic information during sentence reading. In one implementation, an irrelevant spoken word is presented when the eyes cross a predetermined spatial boundary before they move on to a selected visual target word. The relationship between the spoken word and the visual target is manipulated, and the pattern of interference, caused by the presentation of the spoken word, is used to determine the nature and time course of activated representations. Results from three recently completed experiments in which the technique was used show that a word’s phonological code remains active after it has been read and that the activated code has speech-like properties.     

The influence of lexical and conceptual constraints on reading mixed-language sentences: Evidence from eye fixations and naming times

In two experiments, we explored the degree to which sentence context effects operate at a lexical or conceptual level by examining the processing of mixed-language sentences by fluent Spanish-English bilinguals. In Experiment 1, subjects’ eye movements were monitored while they read English sentences in which sentence constraint, word frequency, and language of target word were manipulated. A frequency × constraint interaction was found when target words appeared in Spanish, but not in English. First fixation durations were longer for high-frequency Spanish words when these were embedded in high-constraint sentences than in low-constraint sentences. This result suggests that the conceptual restrictions produced by the sentence context were met, but that the lexical restrictions were not. The same result did not occur for low-frequency Spanish words, presumably because the slower access of low-frequency words provided more processing time for the resolution of this conflict. Similar results were found in Experiment 2 using rapid serial visual presentation when subjects named the target words aloud. It appears that sentence context effects are influenced by both semantic/conceptual and lexical information.     

Word shape,orthographic regularity,and contextual interactions in a reading task

In an investigation of the interaction between three sources of information about a printed word, skilled readers performed a simple naming task. The naming latency was observed as a function of case of presentation, orthographic regularity, and the congruency of context supplied in a previously presented sentence. Differences between regular and irregular words were observed for upper case presentations only, suggesting that lexical access can proceed via a direct visual route only when the distinctive features of the global word envelope are available. Incongruent sentences inhibited word naming, and congruent sentences facilitated naming, but this effect was more apparent for upper case than for lower case words. These results suggest an interaction of information during word recognition, with the removal of the word envelope leading to a greater dependence upon other intrinsic and extrinsic information.     

中文阅读中副中央凹语义信息的提取：来自ERPs的证据

书面语言阅读过程中, 关于读者能否提取预视词汇的语义信息, 以往的研究仍有争议。鉴于边界技术在研究该问题时具有无法严格控制预视词呈现时间等一些局限性, 近年来有研究者利用ERPs技术结合伴侧RSVP范式对拼音语言中的语义预视效应进行研究。本研究首次将这一方法应用到中文句子阅读中, 并对实验材料进行了更严格的控制, 保证关键屏(目标名词位于右侧副中央凹处)内容在实验条件间完全相同, 避免以往类似研究中关键词自身属性信息对实验结果产生干扰。ERPs数据分析发现, 在关键屏呈现后, 语义违背相比合理条件诱发了更大的N400成分, 而关键后屏(目标名词位于中央凹处)呈现后, 两种条件间的N400成分无显著差异。该结果支持中文句子阅读中预视词汇语义信息可以得到提取, 并参与随后的语义整合过程。     

Sentence and word outline shape as co-primes for target words presented to the two visual hemifields

A lexical decision experiment tested visual field stimulation of word targets after priming the central visual field by the target word outline shape and/or an incomplete sentence. In general, RT was shorter and accuracy better for target words presented to the RVF. Responses were quicker and more accurate to target words presented to either visual hemifield after priming by either a congruent incomplete sentence or a congruent word outline shape (WOS). However, the joint effect of WOS and an incomplete sentence as co-primes was different when the succeeding word target appeared in the RVF than when it appeared in the LVF. While a congruent WOS and incomplete sentence acting as co-primes reduced RT to LVF targets orthogonally. the two variables operated interactively as co-primes on target words presented to the RVF.     

Eye movements may cause motor contagion effects

When a person executes a movement, the movement is more errorful while observing another person’s actions that are incongruent rather than congruent with the executed action. This effect is known as “motor contagion”. Accounts of this effect are often grounded in simulation mechanisms: increased movement error emerges because the motor codes associated with observed actions compete with motor codes of the goal action. It is also possible, however, that the increased movement error is linked to eye movements that are executed simultaneously with the hand movement because oculomotor and manual-motor systems are highly interconnected. In the present study, participants performed a motor contagion task in which they executed horizontal arm movements while observing a model making either vertical (incongruent) or horizontal (congruent) movements under three conditions: no instruction, maintain central fixation, or track the model’s hand with the eyes. A significant motor contagion-like effect was only found in the ‘track’ condition. Thus, ‘motor contagion’ in the present task may be an artifact of simultaneously executed incongruent eye movements. These data are discussed in the context of stimulation and associative learning theories, and raise eye movements as a critical methodological consideration for future work on motor contagion.     

Context length and reading novel words: An eye‐movement investigation

The current study investigated the effects of context length on the processing of novel words. Participants read real adjectives or novel words embedded in either sentence or paragraph contexts while their eye movements were recorded. The results extend the literature on novel word reading by exploring the time‐course of word processing using realistic contexts derived from existing sources. Eye‐movement measures demonstrated that readers were very sensitive to the presence of novel words. Novel words were more likely to be fixated and had longer reading times than real words. In addition, words in sentence contexts had longer gaze durations than words in paragraphs. The effect of novelty on reading the target word did not vary as a function of the context length. While performance on the surprise post‐test did not demonstrate significant word learning, participants did report higher confidence in correct responses than incorrect, suggesting that some learning took place.     

Examining age-related movement representations for sequential (fine-motor) finger movements

Theory suggests that imagined and executed movement planning relies on internal models for action. Using a chronometry paradigm to compare the movement duration of imagined and executed movements, we tested children aged 7-11 years and adults on their ability to perform sequential finger movements. Underscoring this tactic was our desire to gain a better understanding of the age-related ability to create internal models for action requiring fine-motor movements. The task required number recognition and ordering and was presented in three levels of complexity. Results for movement duration indicated that 7-year-olds and adults were different from the other groups with no statistical distinction between 9- and 11-year-olds. Correlation analysis indicated a significant relationship between imagined and executed actions. These results are the first to document the increasing convergence between imagined and executed movements in the context of fine-motor behavior; a finding that adds to our understanding of action representation in children.     

Sentence context modifies compound word recognition: Evidence from eye movements

Two eye movement experiments are reported that examine the influence of sentence context on morphological processing. English compound words which vary in beginning lexeme frequency (Experiment 1) and ending lexeme frequency (Experiment 2) were embedded into sentence contexts that were either predictive of the compound word or were neutral with respect to the compound. A predictable sentence context reduced the effect of beginning lexeme frequency on first fixation and single fixation durations. However, sentence context did not modify effects of beginning and ending lexeme frequency in later fixation measures. These results further support the theoretical position that morphology plays a role at multiple levels within readers' mental lexicons. In addition, these results suggest that access to early morpho-orthographic processes can be influenced by sentence context, a finding that suggests an interactive relationship between sentence context and word recognition.     

Sentence context modulates visual word recognition and translation in bilinguals

The influence of sentence context constraint on subsequent processing of concrete and abstract cognates and noncognates was tested in three experiments. Target words were preceded by a predictive, high constraint sentence context, by a congruent, low constraint sentence context, or were presented in isolation. Dutch-English bilinguals performed lexical decision in their second language (L2), or translated target words in forward (from L1 to L2) or in backward (from L2 to L1) direction. After reading a high constraint sentence context, cognate and concreteness effects disappeared in lexical decision and strongly decreased in both translation tasks. In contrast, low constraint sentences did not influence cognate and concreteness effects. These results suggest that semantically rich sentences modulate cross-language interaction during word recognition and word translation.     

Emotion perception from dynamic and static body expressions in point-light and full-light displays

Research on emotion recognition has been dominated by studies of photographs of facial expressions. A full understanding of emotion perception and its neural substrate will require investigations that employ dynamic displays and means of expression other than the face. Our aims were: (i) to develop a set of dynamic and static whole-body expressions of basic emotions for systematic investigations of clinical populations, and for use in functional-imaging studies; (ii) to assess forced-choice emotion-classification performance with these stimuli relative to the results of previous studies; and (iii) to test the hypotheses that more exaggerated whole-body movements would produce (a) more accurate emotion classification and (b) higher ratings of emotional intensity. Ten actors portrayed 5 emotions (anger, disgust, fear, happiness, and sadness) at 3 levels of exaggeration, with their faces covered. Two identical sets of 150 emotion portrayals (full-light and point-light) were created from the same digital footage, along with corresponding static images of the 'peak' of each emotion portrayal. Recognition tasks confirmed previous findings that basic emotions are readily identifiable from body movements, even when static form information is minimised by use of point-light displays, and that full-light and even point-light displays can convey identifiable emotions, though rather less efficiently than dynamic displays. Recognition success differed for individual emotions, corroborating earlier results about the importance of distinguishing differences in movement characteristics for different emotional expressions. The patterns of misclassifications were in keeping with earlier findings on emotional clustering. Exaggeration of body movement (a) enhanced recognition accuracy, especially for the dynamic point-light displays, but notably not for sadness, and (b) produced higher emotional-intensity ratings, regardless of lighting condition, for movies but to a lesser extent for stills, indicating that intensity judgments of body gestures rely more on movement (or form-from-movement) than static form information.