Perceptual congruency of audio-visual speech affects ventriloquism with bilateral visual stimuli

Many studies on multisensory processes have focused on performance in simplified experimental situations, with a single stimulus in each sensory modality. However, these results cannot necessarily be applied to explain our perceptual behavior in natural scenes where various signals exist within one sensory modality. We investigated the role of audio-visual syllable congruency on participants' auditory localization bias or the ventriloquism effect using spoken utterances and two videos of a talking face. Salience of facial movements was also manipulated. Results indicated that more salient visual utterances attracted participants' auditory localization. Congruent pairing of audio-visual utterances elicited greater localization bias than incongruent pairing, while previous studies have reported little dependency on the reality of stimuli in ventriloquism. Moreover, audio-visual illusory congruency, owing to the McGurk effect, caused substantial visual interference on auditory localization. Multisensory performance appears more flexible and adaptive in this complex environment than in previous studies.     

Sleeping pattern of kindergartners and nursery school children: function of daytime nap

With a questionnaire answered by parents this study investigated the sleeping pattern of children attending kindergartens or nursery schools and the function of an afternoon nap. Sleeping pattern was investigated by a questionnaire with 441 young children (229 boys and 212 girls) attending kindergartens or nursery schools at the ages of 3 to 6 years old. Nighttime sleep did not show any significant change, while daytime naps decreased drastically and almost disappeared by the age of 6. Nursery school children went to bed later at night, so nighttime sleep was shorter than that of kindergartners. They also reported having more 'difficulty to fall asleep', more frequent 'staying-up at late night', less 'not getting enough sleep', worse 'mood at rising', and more 'unwillingness to go to their schools'. To investigate whether afternoon naps, which are routine at Japanese nursery schools, can compensate for sleep insufficiency on the previous night and whether they have the effect of delaying the onset of the subsequent nighttime sleep, we compared sleep duration on the previous night and the sleep onset time between the days with and without an afternoon nap. The afternoon nap appeared to cause delayed sleep onset but was not a result of sleep deficiency.     

Visual and auditory accessory stimulus offset and the Simon effect

We investigated the effect on the right and left responses of the disappearance of a task-irrelevant stimulus located on the right or left side. Participants pressed a right or left response key on the basis of the color of a centrally located visual target. Visual (Experiment 1) or auditory (Experiment 2) task-irrelevant accessory stimuli appeared or disappeared at locations to the right or left of the central target. In Experiment 1, responses were faster when onset or offset of the visual accessory stimulus was spatially congruent with the response. In Experiment 2, responses were again faster when onset of the auditory accessory stimulus and the response were on the same side. However, responses were slightly slower when offset of the auditory accessory stimulus and the response were on the same side than when they were on opposite sides. These findings indicate that transient change information is crucial for a visual Simon effect, whereas sustained stimulation from an ongoing stimulus also contributes to an auditory Simon effect.     

Synesthetic colors are elicited by sound quality in Japanese synesthetes

Determinants of synesthetic color choice for Japanese phonetic characters were studied in six Japanese synesthetes. The study used Hiragana and Katakana characters, which represent the same set of syllables although their visual forms are dissimilar. From a palette of 138 colors, synesthetes selected a color corresponding to each character. Results revealed that synesthetic color choices for Hiragana characters and those for their Katakana counterparts were remarkably consistent, indicating that color selection depended on character-related sounds and not visual form. This Hiragana–Katakana invariance cannot be regarded as the same phenomenon as letter case invariance, usually reported for English grapheme-color synesthesia, because Hiragana and Katakana characters have different identities whereas upper and lower case letters have the same identity. This involvement of phonology suggests that cross-activation between an inducer (i.e., letter/character) brain region and that of the concurrent (i.e., color) area in grapheme-color synesthesia is mediated by higher order cortical processing areas.     

Effects of visual cue and response assignment on spatial stimulus coding in stimulus-response compatibility

Tlauka and McKenna ( 2000 ) reported a reversal of the traditional stimulus-response compatibility (SRC) effect (faster responding to a stimulus presented on the same side than to one on the opposite side) when the stimulus appearing on one side of a display is a member of a superordinate unit that is largely on the opposite side. We investigated the effects of a visual cue that explicitly shows a superordinate unit, and of assignment of multiple stimuli within each superordinate unit to one response, on the SRC effect based on superordinate unit position. Three experiments revealed that stimulus-response assignment is critical, while the visual cue plays a minor role, in eliciting the SRC effect based on the superordinate unit position. Findings suggest bidirectional interaction between perception and action and simultaneous spatial stimulus coding according to multiple frames of reference, with contribution of each coding to the SRC effect flexibly varying with task situations.     

Visual search in divided areas: Dividers initially interfere with and later facilitate visual search

A common search paradigm requires observers to search for a target among undivided spatial arrays of many items. Yet our visual environment is populated with items that are typically arranged within smaller (subdivided) spatial areas outlined by dividers (e.g., frames). It remains unclear how dividers impact visual search performance. In this study, we manipulated the presence and absence of frames and the number of frames subdividing search displays. Observers searched for a target O among Cs, a typically inefficient search task, and for a target C among Os, a typically efficient search. The results indicated that the presence of divider frames in a search display initially interferes with visual search tasks when targets are quickly detected (i.e., efficient search), leading to early interference; conversely, frames later facilitate visual search in tasks in which targets take longer to detect (i.e., inefficient search), leading to late facilitation. Such interference and facilitation appear only for conditions with a specific number of frames. Relative to previous studies of grouping (due to item proximity or similarity), these findings suggest that frame enclosures of multiple items may induce a grouping effect that influences search performance.     

Attentional set for axis of symmetry in symmetry-defined visual search

Olivers and van der Helm (1998) showed that symmetry-defined visual search (for both symmetry and asymmetry) requires selective spatial attention. We hypothesize that an attentional set for the orientation of a symmetry axis also is involved in symmetry-defined visual search. We conducted three symmetry-defined visual search experiments with manipulations of the axis of symmetry orientations, and performance was better when the axis orientations within the search array were uniform, rather than a mixture of two orientations, and the attentional set for the axis orientation could be kept. In addition, search performance when the target was defined by the presence of symmetry was equivalent to that when the target was defined by a difference of symmetry axis orientation. These results suggest that attentional set for axis orientation plays a fundamental role in symmetry-defined visual search.     

Orthogonal stimulus-response compatibility effects emerge even when the stimulus position is task irrelevant

The above-right/below-left mapping advantage with vertical stimuli and horizontal responses is known as the orthogonal stimulus-response compatibility (SRC) effect. We investigated whether the orthogonal SRC effect emerges with irrelevant stimulus dimensions. In Experiment 1, participants responded with a right or left key press to the colour of the stimulus presented above or below the fixation. We observed an above-right/below-left advantage (orthogonal Simon effect). In Experiment 2, we manipulated the polarity in the response dimension by varying the horizontal location of the response set. The orthogonal Simon effect decreased and even reversed as the left response code became more positive. This result provides evidence for the automatic activation of the positive and negative response codes by the corresponding positive and negative stimulus codes. These findings extended the orthogonal SRC effect based on coding asymmetry to an irrelevant stimulus dimension.