Integration of information in visual search

Two experiments studied how information about the nontarget items in a visual search task is used for the control of the search. The first experiment used the detection of “hurdle” stimuli to demonstrate that efficient memory representations of the context items can be established within each particular trial. This finding is explained by a model for the short-term integration of context information. The second experiment which varied the complexity of the local but not the global context provided some information about the nature of the integration operations involved. In its final version the model postulates two stages of processing with independent mechanisms of integration. Spatial integration at the first stage deletes repetitions within small samples. Temporal integration at the second stage stores and primes the memory representations of the context items over larger intervals. It is assumed that transient temporal integration within trials is mediated by the same mechanism that underlies permanent temporal integration between trials.     

Redundant visual signals boost saccade execution

The redundant signal effect (RSE) refers to the fact that human beings react more quickly to a pair of stimuli than to only one stimulus. In previous studies of the RSE in the oculomotor system, bimodal signals have been used as the goal of the saccade. In consistency with studies using manual response times (RTs), saccadic RTs have been shown to be shorter for redundant multimodal stimuli than for single unimodal stimuli. In the present experiments, we extended these findings by demonstrating an RSE in the saccadic system elicited only by unimodal visual stimuli. In addition, we found that shorter saccadic RTs were accompanied by an increased saccadic peak velocity. The present results are of relevance for neurophysiological models of saccade execution, since the boost of saccades was elicited by two visual transients (acting as a “go” signal) that were presented not at the goal of the saccade but at various other locations.     

Effects of visual training on saccade control in dyslexia

This study reports the effects of daily practice of three visual tasks on the saccadic performance of 85 dyslexic children in the age range of 8 to 15 years. The children were selected from among other dyslexics because they showed deficits in their eye-movement control, especially in fixation stability and/or voluntary saccade control. Their eye movements were measured in an overlap prosaccade and a gap antisaccade task before and after the training. The three tasks used for the training included a fixation, a saccade, and a distractor condition. In any of these tasks, the subject had to detect the last orientation of a small pattern which rapidly changed its orientation between up, down, right, and left, before it disappeared after some time. The task was to press one of four keys corresponding to the last orientation. The visual pattern was presented on an LCD display of a small hand-held instrument given to the children for daily use at home. The results indicate that daily practice improved not only the perceptual capacity, but also the voluntary saccade control, within 3 to 8 weeks. After the training, the group of dyslexics was no longer statistically different from the control group.     

Integration of audio‐visual information for spatial decisions in children and adults

In adults, decisions based on multisensory information can be faster and/or more accurate than those relying on a single sense. However, this finding varies significantly across development. Here we studied speeded responding to audio‐visual targets, a key multisensory function whose development remains unclear. We found that when judging the locations of targets, children aged 4 to 12 years and adults had faster and less variable response times given auditory and visual information together compared with either alone. Comparison of response time distributions with model predictions indicated that children at all ages were integrating (pooling) sensory information to make decisions but that both the overall speed and the efficiency of sensory integration improved with age. The evidence for pooling comes from comparison with the predictions of Miller's seminal ‘race model’, as well as with a major recent extension of this model and a comparable ‘pooling’ (coactivation) model. The findings and analyses can reconcile results from previous audio‐visual studies, in which infants showed speed gains exceeding race model predictions in a spatial orienting task (Neil et al., 2006) but children below 7 years did not in speeded reaction time tasks (e.g. Barutchu et al., 2009). Our results provide new evidence for early and sustained abilities to integrate visual and auditory signals for spatial localization from a young age.     

Delay of stimulus presentation after the saccade in visual search

Delay of stimulus onset after each saccade in visual search decreased oculomotor and manual reaction times, with a greater effect occurring for the oculomotor response. The saccadic oculomotor reaction might have been facilitated in three ways: by the facilitation of reaction with a foreperiod warning stimulus, by the attenuation of saccadic suppression effects due to the stimulus onset delay, or by the use of a strategy of preprogramming fixation durations. The results support a model of visual search using preprogrammed control of visual fixation durations.     

Intermittency of visual information and the frequency of rhythmical force production

The authors examined the influence of intermittent (40-5,000 ms) visual information on the control of rhythmical isometric force output (0.5, 2.0, and 4.0 Hz) in 10 participants. Force variability decreased as a function of less intermittent visual information only in the 0.5- and 2.0-Hz tasks. Vision influenced the frequency structure of force output through 0-12 Hz in the 0.5-Hz task, but in only the 10.0- to 12.0-Hz range in the 2.0-Hz task and not in the 4.0-Hz task. The effective use of intermittent visual information in force output was mediated by task frequency, and that mediation was reflected in the differential emphasis of feedback and feedforward processes over multiple timescales of control.     

Intermittent visual information and the multiple time scales of visual motor control of continuous isometric force production

In an experiment, we examined the effect of intermittency (from 25.6 Hz to 0.2 Hz) of visual information on continuous isometric force production as a function of force level (5%, 10%, 25%, and 50% of maximal voluntary contraction [MVC]). The amount of force variability decreased and the irregularity of force output increased as a function of increased visual intermittency rate. Vision was found to have an influence on the frequency structure of force output up to 12 Hz, and the 25% MVC force level had more high-frequency modulations with higher rates of visual information. The effective use of intermittent visual information is mediated nonlinearly by force level, and there are multiple time scales of visual control (range, approximately 0 - 12 Hz) that are postulated to be a function of both feedback and feedforward control processes.     

Integration of verbal and visual information as evidenced by distortions in picture memory.

Subjects were presented with a series of pictures, some of which were general (girl walking down the path) and others specific (girl hiking down the path). These pictures were matched with sentences which were either general or specific ("The girl is walking [hiking] down the path.") Subsequently, a forced-choice picture recognition test was administered in which subjects saw pairs of pictures and indicated which member of each pair they had seen before. It was found that labelling the picture with a sentence containing a specific verb substantially increased the likelihood that the specific picture corresponding to that verb would subsequently be falsely recognized. The results are discussed in terms of current theories of memorial representation.     

Dynamic visual noise reduces confidence in short-term memory for visual information

Previous research has shown effects of the visual interference technique, dynamic visual noise (DVN), on visual imagery, but not on visual short-term memory, unless retention of precise visual detail is required. This study tested the prediction that DVN does also affect retention of gross visual information, specifically by reducing confidence. Participants performed a matrix pattern memory task with three retention interval interference conditions (DVN, static visual noise and no interference control) that varied from trial to trial. At recall, participants indicated whether or not they were sure of their responses. As in previous research, DVN did not impair recall accuracy or latency on the task, but it did reduce recall confidence relative to static visual noise and no interference. We conclude that DVN does distort visual representations in short-term memory, but standard coarse-grained recall measures are insensitive to these distortions.     

Evidence for the persistence of visual guidance information

An earlier study from our laboratory provided initial support for the hypothesis that information facilitating visual guidance persists in the absence of retinal stimulation. The present study supports and extends this hypothesis with three experiments in which visually occluded subjects positioned a point of light at the location of a previously viewed target and also walked in the direction of a previously viewed path. In both tasks, performance was possible following occlusion, and in all cases, performance slowly and significantly decreased with longer durations of occlusion. This decay in performance was gradual and had a “half-life” of greater than 15 sec. Absolute performance was correlated across tasks. The effect of occlusion on absolute error in the localization performance was relatively stable within individuals over a 3-week period. The biological utility of guidance information persistence is discussed along with implications for space constancy, illusions of motion, and problems of disorientation.     

Eye movements and visual memory: detecting changes to saccade targets in scenes

Saccade-contingent change detection provides a powerful tool for investigating scene representation and scene memory. In the present study, critical objects presented within color images of naturalistic scenes were changed during a saccade toward or away from the target. During the saccade,the critical object was changed to another object type, to a visually different token of the same object type, or was deleted from the scene. There were three main results. First, the deletion of a saccade target was special: Detection performance for saccade target deletions was very good, and this level of performance did not decline with the amplitude of the saccade. In contrast, detection of type and token changes at the saccade target, and of all changes including deletions at a location that had just been fixated but was not the saccade target, decreased as the amplitude of the saccade increased. Second, detection performance for type and token changes, both when the changing object was the target of the saccade and when the object had just been fixated but was not the saccade target, was well above chance. Third, mean gaze durations were reliably elevated for those trials in which the change was not overtly detected. The results suggest that the presence of the saccade target plays a special role in trassaccadic integration, and together with other recent findings, suggest more generally that a relatively rich scene representation is retained across saccades and stored in visual memory.     

词边界信息对读者阅读歧义短语时眼跳策略的影响

采用Eye Link 2000眼动仪,选取60个歧义短语,要求大学生被试阅读包含有歧义短语的句子。句子的呈现设置了四种条件:正常无阴影、词间阴影、歧义阴影和字间阴影,以探讨词边界信息是否影响读者阅读歧义短语时的注视位置效应。结果发现:读者对歧义短语的首次注视位置在四种条件下基本一致;词边界信息影响读者对歧义短语的再注视概率。结果表明,词边界信息对歧义短语的影响主要体现在眼跳行动(即"where")的晚期阶段。     

Depth of visual information processing

The depth of visual information processing is identified with the longest randomly-generated binary-encoded spatial pattern whose partial repetitions can be detected. In contrast with the auditory detection of sequentially-presented constraints, the depth of perceptible visual encoding of spatially-presented constraints is sharply limited. Depths of about 35 were achieved for one-dimensional constraints; depths of perhaps 3 or 4 were achieved for two-dimensional constraints imposed in only one direction and depths of perhaps 2 for two-dimensional constraints imposed in two directions. With one-dimensional constraints, it is shown that the inferred depth of processing is partially determined by the number of pattern representations and by the spatial distance between successive representation for visual displays of fixed size.     

Processing of unattended visual information

A visual analog of auditory selective attention paradigms is described. Using that analog, we examined the amount of processing required to monitor unattended information. With the materials used, there was no evidence that any processing capacity was required to monitor the unattended information. Memory for the unattended information and the recognition of one’s name were examined to provide additional evidence concerning the fate of the unattended information.     

State-trace analysis of the effects of a visual illusion on saccade amplitudes and perceptual judgments

Visual illusions often appear to have a larger influence on subjective judgments than on visuomotor behavior. Although this effect has been taken as evidence for multiple estimates of stimulus size in the visual brain, dissociations between subjective judgments and visuomotor measures can frequently be reconciled with a singleestimate model. To circumvent this difficulty, we used state-trace analysis in a pair of experiments to examine the effects of the Müller-Lyer illusion on subjective length estimates, voluntary saccade amplitudes, and reflexive saccade amplitudes. All dependent measures were affected by the illusion. However, state-trace analyses revealed nonmonotonic relationships among all three variables, a pattern inconsistent with the possibility of a single underlying estimate of stimulus size.     

Insensitivity of visual short-term memory to irrelevant visual information

Several authors have hypothesized that visuo-spatial working memory is functionally analogous to verbal working memory. Irrelevant background speech impairs verbal short-term memory. We investigated whether irrelevant visual information has an analogous effect on visual short-term memory, using a dynamic visual noise (DVN) technique known to disrupt visual imagery (Quinn & McConnell, 1996b). Experiment 1 replicated the effect of DVN on pegword imagery. Experiments 2 and 3 showed no effect of DVN on recall of static matrix patterns, despite a significant effect of a concurrent spatial tapping task. Experiment 4 showed no effect of DVN on encoding or maintenance of arrays of matrix patterns, despite testing memory by a recognition procedure to encourage visual rather than spatial processing. Serial position curves showed a one-item recency effect typical of visual short-term memory. Experiment 5 showed no effect of DVN on short-term recognition of Chinese characters, despite effects of visual similarity and a concurrent colour memory task that confirmed visual processing of the characters. We conclude that irrelevant visual noise does not impair visual short-term memory. Visual working memory may not be functionally analogous to verbal working memory, and different cognitive processes may underlie visual short-term memory and visual imagery.     

Alignment to visual speech information

Speech alignment is the tendency for interlocutors to unconsciously imitate one another’s speaking style. Alignment also occurs when a talker is asked to shadow recorded words (e.g., Shockley, Sabadini, & Fowler, 2004). In two experiments, we examined whether alignment could be induced with visual (lipread) speech and with auditory speech. In Experiment 1, we asked subjects to lipread and shadow out loud a model silently uttering words. The results indicate that shadowed utterances sounded more similar to the model’s utterances than did subjects’ nonshadowed read utterances. This suggests that speech alignment can be based on visual speech. In Experiment 2, we tested whether raters could perceive alignment across modalities. Raters were asked to judge the relative similarity between a model’s visual (silent video) utterance and subjects’ audio utterances. The subjects’ shadowed utterances were again judged as more similar to the model’s than were read utterances, suggesting that raters are sensitive to cross-modal similarity between aligned words.