Action-feature integration blinds to feature-overlapping perceptual events: evidence from manual and vocal actions

Previous studies showed that the identification of a left- or right-pointing arrowhead is impaired when it appears while planning and executing a spatially compatible left or right keypress (Müsseler & Hommel, 1997a). We attribute this effect to stimulus processing and action control operating on the same feature codes so that, once a code is integrated in an action plan, it is less available for perceptual processing. In three pairs of experiments we tested the generality of this account by using stimulus-response combinations other than arrows and manual keypresses. Planning manual left-right keypressing actions impaired the identification of spatially corresponding arrows but not of words with congruent meaning. On the contrary, planning to say "left" or "right" impaired the identification of corresponding spatial words but not of congruent arrows. Thus, as the feature-integration approach suggests, stimulus identification is impaired only with overlap of perceptual or perceptually derived stimulus and response features while mere semantic congruence is insufficient.     

Evidence of vocal and manual event files in auditory negative priming

Negative priming with auditory as well as with visual stimuli has been shown to involve the retrieval of prime response information as evidenced by an increase of prime response errors to the probes of ignored repetition trials compared to control trials. We investigated whether prime response retrieval processes were also present for response modalities other than manual responding. In an auditory four alternative forced choice task participants either vocally or manually identified a target sound while ignoring a distractor sound. Negative priming was of equal size in both response modalities. What is more, for both response modalities, there was evidence of increased prime response errors in ignored repetition trials compared to control trials. The findings suggest that retrieval of event files of the prime episode including prime response information is a general mechanism underlying the negative priming phenomenon irrespective of stimulus or response modality.     

Erratum to: Evaluating perceptual integration: uniting response-time and accuracy-based methodologies

Attention, Perception, & Psychophysics -     

Using eye-tracking to study audio-visual perceptual integration

Perceptual integration of audio-visual stimuli is fundamental to our everyday conscious experience. Eye-movement analysis may be a suitable tool for studying such integration, since eye movements respond to auditory as well as visual input. Previous studies have shown that additional auditory cues in visual-search tasks can guide eye movements more efficiently and reduce their latency. However, these auditory cues were task-relevant since they indicated the target position and onset time. Therefore, the observed effects may have been due to subjects using the cues as additional information to maximize their performance, without perceptually integrating them with the visual displays. Here, we combine a visual-tracking task with a continuous, task-irrelevant sound from a stationary source to demonstrate that audio-visual perceptual integration affects low-level oculomotor mechanisms. Auditory stimuli of constant, increasing, or decreasing pitch were presented. All sound categories induced more smooth-pursuit eye movement than silence, with the greatest effect occurring with stimuli of increasing pitch. A possible explanation is that integration of the visual scene with continuous sound creates the perception of continuous visual motion. Increasing pitch may amplify this effect through its common association with accelerating motion.     

Neural events and perceptual awareness

Neural correlates of perceptual awareness, until very recently an elusive quarry, are now almost commonplace findings. This article first describes a variety of neural correlates of perceptual awareness based on fMRI, ERPs, and single-unit recordings. It is then argued that our quest should ultimately focus not on mere correlates of awareness, but rather on the neural events that are both necessary and sufficient for perceptual awareness. Indeed, preliminary evidence suggests that although many of the neural correlates already reported may be necessary for the corresponding state of awareness, it is unlikely that they are sufficient for it. The final section considers three hypotheses concerning the possible sufficiency conditions for perceptual awareness.     

Temporal preparation decreases perceptual latency: Evidence from a clock paradigm

A clock paradigm was employed to assess whether temporal preparation decreases the time to detect the onset of a stimulus—that is, perceptual latency. In four experiments participants watched a revolving clock hand while listening to soft or loud target tones under high or low temporal preparation. At the end of each trial, participants reported the clock hand position at the onset of the target tone. The deviation of the reported clock hand position from the actual position indexed perceptual latency. As expected, perceptual latency decreased with target tone intensity. Most importantly, however, greater temporal preparation decreased perceptual latency in all four experiments, especially for soft tones, which supports rather directly the idea that temporal preparation diminishes the duration of perceptual processing.     

Reading direction and the central perceptual span: Evidence from Arabic and English

In English and other alphabetic languages read from left to right, useful information acquired during each fixational pause is generally reported to extend much further to the right of each fixation than to the left. However, the asymmetry of the perceptual span for alphabetic languages read in the opposite direction (i.e., from right to left) has received very little attention in empirical research. Accordingly, we investigated the perceptual span for Arabic, which is one of the world’s most widely read languages and is read from right to left, using a gaze-contingent window paradigm in which a region of text was displayed normally around each point of fixation, while text outside this region was obscured. Skilled Arabic readers who were bilingual in Arabic and English read Arabic and English sentences while a window of normal text extended symmetrically 0.5^o to the left and right of fixation or asymmetrically, by increasing this window to 1.5^o or 2.5^o to either the left or the right. When English was read, performance across window conditions was superior when windows extended rightward. However, when Arabic was read, performance was superior when windows extended leftward and was essentially the reverse of that observed for English. These findings show for the first time that a leftward asymmetry in the central perceptual span occurs when Arabic is read and, for the first time in over 30 years, provide a new indication that the perceptual span for alphabetic languages is modified by the overall direction of reading.     

Evidence for the integration of audiovisual emotional information at the perceptual level of processing

The present aim was to investigate how emotional expressions presented on an unattended channel affect the recognition of the attended emotional expressions. In Experiments 1 and 2, facial and vocal expressions were simultaneously presented as stimulus combinations. The emotions (happiness, anger, or emotional neutrality) expressed by the face and voice were either congruent or incongruent. Subjects were asked to attend either to the visual (Experiment 1) or auditory (Experiment 2) channel and recognise the emotional expression. The result showed that the ignored emotional expressions significantly affected the processing of attended signals as measured by recognition accuracy and response speed. In general, attended signals were recognised more accurately and faster in congruent than in incongruent combinations. In Experiment 3, possibility for a perceptual-level integration was eliminated by presenting the response-relevant and response-irrelevant signals separated in time. In this situation, emotional information presented on the nonattended channel ceased to affect the processing of emotional signals on the attended channel. The present results are interpreted to provide evidence for the view that facial and vocal emotional signals are integrated at the perceptual level of information processing and not at the later response-selection stages.     

Differential components of the manual and vocal Stroop tasks

In this study, four components of the Stroop effect were examined for manual word and vocal responses. The components were lexical, semantic relatedness, semantic relevance, and response set membership. The results showed that all four components were present in the vocal response task. However, in the manual word response task, the only component that produced significant interference on its own was response set membership. These results do not support predictions made by recent translation models (see W. R. Glaser & M. O. Glaser [1989] and Sugg & McDonald [1994]). A possible solution was suggested that located two sites for Stroop interference. The lexical, semantic relatedness, and semantic relevance effects were located in the lexical system, whereas the response set membership effect was located at a response selection stage.     

Comparing the sensitivity of manual pursuit and perceptual judgments to pictorial depth effects

Abstract - We examined whether a pictorial depth illusion influences the manual pursuit of a moving dot to the same extent that it influences the dot's apparent displacement. Fourteen subjects performed two tasks. In one case, they used their unseen hand to track a dot that moved on an elliptical path. In the other, they first watched the dot move on the same path, and then set an ellipse to match the shape of the dot's path. The illusion influenced the two tasks to the same extent, suggesting that the visual information processing is the same for the two tasks.     

Visual-auditory events: cross-modal perceptual priming and recognition memory.

Modality specificity in priming is taken as evidence for independent perceptual systems. However, Easton, Greene, and Srinivas (1997) showed that visual and haptic cross-modal priming is comparable in magnitude to within-modal priming. Where appropriate, perceptual systems might share like information. To test this, we assessed priming and recognition for visual and auditory events, within- and across- modalities. On the visual test, auditory study resulted in no priming. On the auditory priming test, visual study resulted in priming that was only marginally less than within-modal priming. The priming results show that visual study facilitates identification on both visual and auditory tests, but auditory study only facilitates performance on the auditory test. For both recognition tests, within-modal recognition exceeded cross-modal recognition. The results have two novel implications for the understanding of perceptual priming: First, we introduce visual and auditory priming for spatio-temporal events as a new priming paradigm chosen for its ecological validity and potential for information exchange. Second, we propose that the asymmetry of the cross-modal priming observed here may reflect the capacity of these perceptual modalities to provide cross-modal constraints on ambiguity. We argue that visual perception might inform and constrain auditory processing, while auditory perception corresponds to too many potential visual events to usefully inform and constrain visual perception.     

The perceptual aspect of skilled performance in chess: Evidence from eye movements

Expert and intermediate chess players attempted to choose the best move in five chess positions while their eye movements were monitored. Experts were faster and more accurate than intermediates in choosing the best move. Experts made fewer fixations per trial and greater amplitude saccades than did intermediates, but there was no difference in fixation duration across skill groups. Examining the spatial distribution of the first five fixations for each position by skill group revealed that experts produced more fixations on empty squares than did intermediates. When fixating pieces, experts produced a greater proportion of fixations on relevant pieces than did intermediates. It is argued that expert chess players perceptually encode chess configurations, rather than individual pieces, and, consequently, parafoveal or peripheral processing guides their eye movements, producing a pattern of saccadic selectivity by piece saliency.     

早期视听整合加工——来自MMN的证据

视听整合是指当呈现的视觉和听觉信号在时间、空间上大致接近时,视觉和听觉系统倾向于整合的加工过程。失匹配负波(Mismatch Negativity,MMN)作为反映大脑早期加工的成分,表征偏差的信息输入与感觉记忆痕迹之间的神经失匹配。以MMN作为探测指标的视听整合加工研究,主要包括MMN在阅读理解中字母和语音、韵律信息、麦格克效应等方面的视听整合加工,以及分析跨通道视听整合相互竞争、相互补充的关系。未来研究需聚焦于其他通道的跨通道整合加工,同时应拓展MMN的诱发范式。     

Sticky rules: integration between abstract rules and specific actions

The authors manipulated repetitions and/or changes of abstract response rules and the specific stimulus- response (S-R) associations used under these rules. Experiments 1 and 2, assessing trial-to-trial priming effects, showed that repetition of complete S-R couplings produced only benefits when the rule also repeated (i.e., rule-S-R conjunctions) but costs when identical S-R couplings repeated while rules changed. In Experiments 3 and 4, the authors manipulated amount of experience with specific rule-S-R conjunctions and demonstrated integration between rules and S-R couplings in terms of cumulative practice effects. However, unlike short-term priming effects, cumulative practice supported generalization of experience with specific S-R couplings across rule boundaries (Experiment 4). Results are discussed in terms of constraints on models of hierarchical control and in terms of qualitatively different ways in which people profit from very recent experiences (i.e., all-or-none access to working memory representations) versus cumulative experience (i.e., similarity-based retrieval from long-term memory).     

Individual differences in perceptual sensitivity and response bias in anxiety: Evidence from emotional faces

We investigated the perception of emotional stimuli in anxious individuals and non-anxious cohorts. Signal detection theory analysis was applied to the discrimination of emotionally charged faces at several points along a continuum of emotional intensity. This design permitted the derivation of multiple measures of sensitivity and response bias for fearful and for happy faces. Anxious individuals lacked a conservative bias in judging fearful stimuli and a liberal bias in judging positive stimuli compared with non-anxious individuals. In addition, anxious participants had lower perceptual sensitivity (d′) than non-anxious participants for mildly threatening stimuli, as well as a trend towards lower perceptual sensitivity for moderately positive stimuli. These results suggest that the processing of threat information in anxiety is affected by sensitivity and bias differently at different levels of affective intensity.     

Evidence of a transition from perceptual to category induction in 3- to 9-year-old children

We examined whether inductive reasoning development is better characterized by accounts assuming an early category bias versus an early perceptual bias. We trained 264 children aged 3 to 9 years to categorize novel insects using a rule that directly pitted category membership against appearance. This was followed by an induction task with perceptual distractors at different levels of featural similarity. An additional 52 children were given the same training followed by an induction task with alternative stimuli. Categorization performance was consistently high; however, we found a gradual transition from a perceptual bias in our youngest children to a category bias around 6 or 7 years of age. In addition, children of all ages were equally distracted by higher levels of featural similarity. The transition is unlikely to be due to an increased ability to inhibit perceptual distractors. Instead, we argue that the transition is driven by a fundamental change in children's understanding of category membership.     

The contents of perceptual hypotheses: Evidence from rapid resumption of interrupted visual search

Observers can resume a previously interrupted visual search trial significantly more quickly than they can start a new search trial (Lleras, Rensink, & Enns, 2005). This rapid resumption of search is possible because evidence accumulated during the previous exposure, a perceptual hypothesis, can carry over to a subsequent presentation. We present four interrupted visual search experiments in which the content of the perceptual hypotheses used during visual search trials was characterized. These experiments suggest that prior to explicit target identification, observers have accumulated evidence about the locations, but not the identities, of local, task-relevant distractors, as well as preliminary evidence for the identity of the target. Our results characterize the content of perceptual search hypotheses and highlight the utility of interrupted search for studying online search processing prior to target identification.