Perceptual exploration and intersensory merging in a visual–haptic Necker cube

Background

Perceiving the three-dimensional structure of an object often involves merging vision and haptics over extended periods of exploration. An interesting feature of this process is that as exploration progresses, new information may require changing how the two sensory signals are treated.

Aims

We tested whether (1) bimodal interactions during extended observation can adjust to changes in the quality of unimodal sensory signals; and (2) there are specific temporal constraints on these adjustments.

Methods

When viewing a three-dimensional Necker cube with one eye, participants experience illusory reversals even while they feel the cube with their hands. This surprising property makes the visual–haptic Necker cube an excellent model to investigate bimodal processes when previously consistent bimodal signals change in quality over time or begin to conflict. Our participants reported reversals while they viewed the cube and, at the same time, they either held it with two-finger grips, felt it with while their hands remained stationary, or actively explored it by moving one hand.

Results

Consistent with a multisensory approach to three-dimensional form perception, touch had a clear effect on both the number and the duration of illusory percepts. Additionally, when observers alternated between stationary and moving periods during exploration, transitions from stationary to moving-hand haptics played a crucial role in inhibiting illusory reversals. A temporal analysis of the probability of first reversals occurring after different types of motor transition revealed a “vetoing window” initiating approximately 2 s after the transition and lasting at least another 1–2 s.

Conclusions

These results suggest that intersensory merging is sensitive to changes in the quality of unimodal signals during exploration, and that adjustments caused by these changes are characterized by specific temporal dynamics.

     

Auditory word identification in dyslexic and normally achieving readers

The integrity of phonological representation/processing in dyslexic children was explored with a gating task in which children listened to successively longer segments (gates) of a word. At each gate, the task was to decide what the entire word was. Responses were scored for overall accuracy as well as the children's sensitivity to coarticulation from the final consonant. As a group, dyslexic children were less able than normally achieving readers to detect coarticulation present in the vowel portion of the word, particularly on the most difficult items, namely those ending in a nasal sound. Hierarchical regression and path analyses indicated that phonological awareness mediated the relation of gating and general language ability to word and pseudoword reading ability.     

'Change of Mind' within and between nonconscious (masked) and conscious (unmasked) visual processing

We examined the updating of decisions made during visuo-motor processing when two sequentially presented stimuli, Prime1 and Prime2, primed discriminative responses to a following probe. In Experiment 1, the visibility of the two primes was suppressed or left intact by varying the stimulus onset asynchrony (SOA) of the stimuli immediately following them. In Experiment 2, the visibility of Prime2 was suppressed or left intact by varying its spatial separation from the following probe. We found (1) that Prime2 dominated the effects of Prime1; (2) that Prime2's updating was stronger when the Prime2-probe SOA was 200 as compared to 53 ms; and (3) that Prime2's updating was weaker when the Prime2-probe spatial separation was 58 as compared to 0 minarc. We conclude that these effects are due to an interaction of spatial attention and the state (conscious vs. nonconscious) of processing of Prime2.     

Face inversion disproportionately impairs the perception of vertical but not horizontal relations between features

Upside-down inversion disrupts the processing of spatial relations between the features of a face, while largely preserving local feature analysis. However, recent studies on face inversion failed to observe a clear dissociation between relational and featural processing. To resolve these discrepancies and clarify how inversion affects face perception, the authors monitored inversion effects separately for vertical and horizontal distances between features. Inversion dramatically declined performance in the vertical-relational condition, but it impaired featural and horizontal-relational performance only moderately. Identical observations were made whether upright and inverted trials were blocked or randomly interleaved. The largest performance decrement was found for vertical relations even when faces were rotated by 90 degrees. Evidence that inversion dramatically disrupts the ability to extract vertical but not horizontal feature relations supports the view that inversion qualitatively changes face perception by rendering some of the processes activated by upright faces largely ineffective.     

Unconscious, stimulus-dependent priming and conscious, percept-dependent priming with chromatic stimuli

Using metacontrast masking to suppress the conscious registration of a prime stimulus, Breitmeyer, Ro, and Singhal (2004) showed that color priming produced by a masked prime disk occurs at unconscious stimulus-dependent rather than at percept-dependent levels of visual processing. The current set of experiments compares this type of unconscious stimulus-dependent priming to conscious priming produced by a prime that, in two separate ways, is rendered visible and thus activates percept-dependent visual processes. The results indicate that while the masked prime again acts at a stimulus-dependent level of processing, the unmasked, visible primes additionally act at a later percept-dependent level of processing.     

Tracking Reading: Dual Task Costs of Oral Reading for Young Versus Older Adults

A digital pursuit rotor was used to monitor oral reading costs by time-locking tracking performance to the auditory wave form produced as young and older adults were reading out short paragraphs. Multilevel modeling was used to determine how paragraph-level predictors of length, grammatical complexity, and readability and person-level predictors such as speaker age or working memory capacity predicted reading and tracking performance. In addition, sentence-by-sentence variation in tracking performance was examined during the production of individual sentences and during the pauses before upcoming sentences. The results suggest that dual tasking has a greater impact on older adults’ reading comprehension and tracking performance. At the level of individual sentences, young and older adults adopt different strategies to deal with grammatically complex and propositionally dense sentences.     

Scrutinizing visual images: The role of gaze in mental imagery and memory

Gaze was monitored by use of an infrared remote eye-tracker during perception and imagery of geometric forms and figures of animals. Based on the idea that gaze prioritizes locations where features with high information content are visible, we hypothesized that eye fixations should focus on regions that contain one or more local features that are relevant for object recognition. Most importantly, we predicted that when observers looked at an empty screen and at the same time generated a detailed visual image of what they had previously seen, their gaze would probabilistically dwell within regions corresponding to the original positions of salient features or parts. Correlation analyses showed positive relations between gaze’s dwell time within locations visited during perception and those in which gaze dwelled during the imagery generation task. Moreover, the more faithful an observer’s gaze enactment, the more accurate was the observer’s memory, in a separate test, of the dimension or size in which the forms had been perceived. In another experiment, observers saw a series of pictures of animals and were requested to memorize them. They were then asked later, in a recall phase, to answer a question about a property of one of the encoded forms; it was found that, when retrieving from long-term memory a previously seen picture, gaze returned to the location of the part probed by the question. In another experimental condition, the observers were asked to maintain fixation away from the original location of the shape while thinking about the answer, so as to interfere with the gaze enactment process; such a manipulation resulted in measurable costs in the quality of memory. We conclude that the generation of mental images relies upon a process of enactment of gaze that can be beneficial to visual memory.     

Failure to loose fear: The impact of cognitive load and trait anxiety on extinction

Exposure therapy is an effective technique for fear reduction. However, whether effective exposure requires attentional allocation to the feared situation remains a debated clinical issue. In the present study, the impact of attention allocation in extinction was investigated in an experimental conditioning study. Through a between-subjects manipulation of cognitive load, we created a condition in which participants could allocate their attention to the feared stimulus during extinction (low load condition), and a condition in which attentional allocation was impaired (high load condition). The influence of cognitive load on extinction was examined by comparing electrodermal responses and verbal ratings for the conditioned stimuli in the two extinction load conditions. The results show less successful extinction in the high load condition than in the low load condition. However, this effect was found only in low anxious participants, and it was prominent only on the skin conductance responses. The present results suggest that extinction is not automatic but requires cognitive resources.     

Searching through synaesthetic colors

Synaesthesia can be characterized by illusory colors being elicited automatically when one reads an alphanumeric symbol. These colors can affect attention; synaesthetes can show advantages in visual search of achromatic symbols that normally cause slow searches. However, some studies have failed to find these advantages, challenging the conclusion that synaesthetic colors influence attention in a manner similar to the influence of perceptual colors. In the present study, we investigated 2 synaesthetes who reported colors localized in space over alphanumeric symbols’ shapes. The Euclidian distance in CIE xyY color space between two synaesthetic colors was computed for each specific visual search, so that the relationship between color distance (CD) and efficiency of search could be explored with simple regression analyses. Target-to-distractors color salience systematically predicted the speed of search, but the CD between a target or distractors and the physically presented achromatic color did not. When the synaesthetic colors of a target and distractors were nearly complementary, searches resembled popout performance with real colors. Control participants who performed searches for the same symbols (which were colored according to the synaesthetic colors) showed search functions very similar to those shown by the synaesthetes for the physically achromatic symbols.     

Observation and discrimination learning in the rat: Effects of stimulus substitution

Effects of prior observation of modeling performances upon learning simultaneous visual discriminations were studied in nine groups of rats. Stimulus patterns which had been positive (“Cued”) or negative (“Uncued”) for the model animal and novel stimuli were presented. Observers learned faster if discriminations required approach to, rather than avoidance of, the previously positive stimulus. Approach to the negative stimulus was acquired more rapidly only if the second stimulus was novel. Approaches to a substituted new stimulus combined with either of the previously viewed stimulus patterns required nearly twice the training needed for a similar response attachment when both stimuli were novel. Attentional changes appear to underlie the stimulus control exerted over the observer rat in instrumental learning situations.