Crossmodal attention switching: Auditory dominance in temporal discrimination tasks

Visual stimuli are often processed more efficiently than accompanying stimuli in another modality. In line with this “visual dominance”, earlier studies on attentional switching showed a clear benefit for visual stimuli in a bimodal visual–auditory modality-switch paradigm that required spatial stimulus localization in the relevant modality. The present study aimed to examine the generality of this visual dominance effect. The modality appropriateness hypothesis proposes that stimuli in different modalities are differentially effectively processed depending on the task dimension, so that processing of visual stimuli is favored in the dimension of space, whereas processing auditory stimuli is favored in the dimension of time. In the present study, we examined this proposition by using a temporal duration judgment in a bimodal visual–auditory switching paradigm. Two experiments demonstrated that crossmodal interference (i.e., temporal stimulus congruence) was larger for visual stimuli than for auditory stimuli, suggesting auditory dominance when performing temporal judgment tasks. However, attention switch costs were larger for the auditory modality than for visual modality, indicating a dissociation of the mechanisms underlying crossmodal competition in stimulus processing and modality-specific biasing of attentional set.     

A Dissociation Between Attention and Selection

It is widely assumed that the allocation of spatial attention results in the "selection" of attended objects or regions of space. That is, once a stimulus is attended, all its feature dimensions are processed irrespective of their relevance to behavioral goals. This assumption is based in part on experiments showing significant interference for attended stimuli when the response to an irrelevant dimension conflicts with the response to the relevant dimension (e.g., the Stroop effect). Here we show that such interference is not due to attending per se. In two spatial cuing experiments, we found that it was possible to restrict processing of attended stimuli to task-relevant dimensions. This new evidence supports two novel conclusions: (a) Selection involves more than the focusing of attention per se; and (b) task expectations play a key role in determining the depth of processing of the elementary feature dimensions of attended stimuli.     

The role of attention for context-context binding of intrinsic and extrinsic features

There is converging evidence that the feeling of conscious recollection is usually accompanied by the bound retrieval of context features of the encoding episode (e.g., Meiser, Sattler, & Weiβer, 2008). Recently, however, important limiting conditions have been identified for the binding between context features in memory. For example, focusing on the semantics of the stimuli during encoding eliminates binding between perceptual context features (Meiser & Sattler, 2007). In the present research, we investigated the interplay of the focus of attention during encoding and stimulus characteristics in context-context binding. In particular, it has been suggested that context features differ in the degree to which they can be regarded as intrinsic or extrinsic to the items and that intrinsic features might be given more attentional processing during encoding than extrinsic features (e.g., Ecker, Zimmer, & Groh-Bordin, 2007a). In two experiments, we manipulated the "intrinsicality" of context features to investigate whether context-context binding might be limited to features that are in the focus of processing. Multinomial modeling analyses revealed that while context-context binding was eliminated for incidentally processed extrinsic context features (Experiment 1), it was preserved for intentionally processed extrinsic context features (Experiment 2).     

Self-generated cognitive fluency as an alternative route to preference formation

People tend to prefer fluently processed over harder to process information. In this study we examine two issues concerning fluency and preference. First, previous research has pre-selected fluent and non-fluent materials. We did not take this approach yet show that the fluency of individuals’ idiosyncratic on-line interactions with a given stimulus can influence preference formation. Second, while processing fluency influences preference, the opposite also may be true: preferred stimuli could be processed more fluently than non-preferred. Participants performed a visual search task either before or after indicating their preferred images from an array of either paintings by Kandinsky or decorated coffee mugs. Preferred stimuli were associated with fluent processing, reflected in facilitated search times. Critically, this was only the case for participants who gave their preferences after completing the visual search task, not for those stating preferences prior to the visual search task. Our results suggest that the spontaneous and idiosyncratic experience of processing fluency plays a role in forming preference judgments and conversely that our first impressions of preference do not drive response fluency.     

Why is it difficult to see in the fog? How stimulus contrast affects visual perception and visual memory

Processing visually degraded stimuli is a common experience. We struggle to find house keys on dim front porches, to decipher slides projected in overly bright seminar rooms, and to read 10th-generation photocopies. In this research, we focus specifically on stimuli that are degraded via reduction of stimuluscontrast and address two questions. First, why is it difficult to process low-contrast, as compared with high-contrast, stimuli? Second, is the effect of contrastfundamental in that its effect is independent of the stimulus being processed and the reason for processing the stimulus? We formally address and answer these questions within the context of a series of nested theories, each providing a successively stronger definition of what it means for contrast to affect perception and memory. To evaluate the theories, we carried out six experiments. Experiments 1 and 2 involved simple stimuli (randomly generated forms and digit strings), whereas Experiments 3–6 involved naturalistic pictures (faces, houses, and cityscapes). The stimuli were presented at two contrast levels and at varying exposure durations. The data from all the experiments allow the conclusion that some function of stimulus contrast combines multiplicatively with stimulus duration at a stage prior to that at which the nature of the stimulus and the reason for processing it are determined, and it is the result of this multiplicative combination that determines eventual memory performance. We describe a stronger version of this theory— the sensory response, information acquisition theory—which has at its core, the strong Bloch’s-law-like assumption of a fundamental visual system response that is proportional to the product of stimulus contrast and stimulus duration. This theory was, as it has been in the past, highly successful in accounting for memory for simple stimuli shown at short (i.e., shorter than an eye fixation) durations. However, it was less successful in accounting for data from short-duration naturalistic pictures and was entirely unsuccessful in accounting for data from naturalistic pictures shown at longer durations. We discuss (1) processing differences between short- and long-duration stimuli, (2) processing differences between simple stimuli, such as digits, and complex stimuli, such as pictures, (3) processing differences between biluminant stimuli (such as line drawings with only two luminance levels) and multiluminant stimuli (such as grayscale pictures with multiple luminance levels), and (4) Bloch’s law and a proposed generalization of the concept ofmetamers.     

The influence of stimulus properties on multisensory processing in the awake primate superior colliculus.

Multisensory integration is a process whereby information converges from different sensory modalities to produce a response that is different from that elicited by the individual modalities presented alone. A neural basis for multisensory integration has been identified within a variety of brain regions, but the most thoroughly examined model has been that of the superior colliculus (SC). Multisensory processing in the SC of anaesthetized animals has been shown to be dependent on the physical parameters of the individual stimuli presented (e.g., intensity, direction, velocity) as well as their spatial relationship. However, it is unknown whether these stimulus features are important, or evident, in the awake behaving animal. To address this question, we evaluated the influence of physical properties of sensory stimuli (visual intensity, direction, and velocity; auditory intensity and location) on sensory activity and multisensory integration of SC neurons in awake, behaving primates. Monkeys were trained to fixate a central visual fixation point while visual and/or auditory stimuli were presented in the periphery. Visual stimuli were always presented within the contralateral receptive field of the neuron whereas auditory stimuli were presented at either ipsi- or contralateral locations. Many of the SC neurons responsive to these sensory stimuli (n = 66/84; 76%) had stronger responses when the visual and auditory stimuli were combined at contralateral locations than when the auditory stimulus was located on the ipsilateral side. This trend was significant across the population of auditory-responsive neurons. In addition, some SC neurons (n = 31) were presented a battery of tests in which the quality of one stimulus of a pair was systematically manipulated. A small proportion of these neurons (n = 8/31; 26%) showed preferential responses to stimuli with specific physical properties, and these preferences were not significantly altered when multisensory stimulus combinations were presented. These data demonstrate that multisensory processing in the awake behaving primate is influenced by the spatial congruency of the stimuli as well as their individual physical properties.     

Parts of me: Identity-relevance moderates self-prioritization

Recent research has revealed a pervasive bias for self-relevant information during decision-making, a phenomenon termed the self-prioritization effect. Focusing almost exclusively on between-target (e.g., self vs. friend) differences in task performance, however, this work has overlooked the influence stimulus factors potentially exert during decisional processing. Accordingly, based on pertinent social-psychological theorizing (i.e., Identity-Based Motivation Theory), here we explored the possibility that self-prioritization is sensitive to the identity-based relevance of stimuli. The results of three experiments supported this hypothesis. In a perceptual-matching task, stimulus enhancement was greatest when geometric shapes were associated with identity-related information that was important (vs. unimportant) to participants. In addition, hierarchical drift-diffusion modeling revealed this effect was underpinned by differences in the efficiency of visual processing. Specifically, evidence was extracted more rapidly from stimuli paired with consequential compared to inconsequential identity-related components. These findings demonstrate how identity-relevance moderates self-prioritization.     

The evaluative connotation of processing fluency: Inherently positive or moderated by motivational context?

A fundamental question for evaluation research is whether cues can impact evaluative responses directly or only in combination with contextual information. Focusing on the experience of processing fluency, the current work tested whether manipulating this cue’s motivational context would moderate its evaluative impact. Because fluently processed stimuli can be assumed to communicate safety, owing to implicit signals of either familiarity (through processes monitoring perception-memory coordination), we reasoned that motivation to avoid negative events should heighten preferences for fluently processed stimuli. Following a motivation manipulation, prevention-focused, but not promotion-focused, participants preferred stimuli that they were able to process quickly (Experiment 2) and that were preceded by concordant primes (Experiment 1). These findings suggest that the value of fluent processing reflects its relation to contextual features, such as one’s current motivational state.     

Distinguishing the effects of action relations and scene context on object perception

Objects are rarely viewed in isolation, and so how they are perceived is influenced by the context in which they are viewed and their interaction with other objects (e.g., whether objects are colocated for action). We investigated the combined effects of action relations and scene context on an object decision task. Experiment 1 investigated whether the benefit for positioning objects so that they interact is enhanced when objects are viewed within contextually congruent scenes. The results indicated that scene context influenced perception of nonaction-related objects (e.g., monitor and keyboard), but had no effect on responses to action-related objects (e.g., bottle and glass) that were processed more rapidly. In Experiment 2, we reduced the saliency of the object stimuli and found that, under these circumstances, scene context influenced responses to action-related objects. We discuss the data in terms of relatively late effects of scene processing on object perception.     

The effects of familiarity in a perceptual matching task

Latencies of same-different judgments to pairs of two-digit numerals were recorded for stimuli presented in familiar or unfamiliar (inverted) orientation. Familiar stimuli were responded to more quickly than unfamiliar. For both stimulus types, latencies were correlated with the syllable length of the verbal representation of the numerals, allowing the interpretation that the effect of stimulus orientation is on encoding processes. In two other experiments, it was found that familiarity had no effect on different judgments when the stimuli were relatively simple (e.g., a single digit), but did affect different judgments with more complex stimuli. These results were related to the hypothesis that the complexity of verbal material determines whether different judgments are instigated by visual or by verbal representations of the stimuli.     

Stimulus–response bindings code both abstract and specific representations of stimuli: evidence from a classification priming design that reverses multiple levels of response representation

Repetition priming can be caused by the rapid retrieval of previously encoded stimulus–response (S–R) bindings. S–R bindings have recently been shown to simultaneously code multiple levels of response representation, from specific Motor-actions to more abstract Decisions (“yes”/”no”) and Classifications (e.g., “man-made”/”natural”). Using an experimental design that reverses responses at all of these levels, we assessed whether S–R bindings also code multiple levels of stimulus representation. Across two experiments, we found effects of response reversal on priming when switching between object pictures and object names, consistent with S–R bindings that code stimuli at an abstract level. Nonetheless, the size of this reversal effect was smaller for such across-format (e.g., word–picture) repetition than for within-format (e.g., picture–picture) repetition, suggesting additional coding of format-specific stimulus representations. We conclude that S–R bindings simultaneously represent both stimuli and responses at multiple levels of abstraction.     

Processing visual words with numbers: Electrophysiological evidence for semantic activation

Perea, Duñabeitia, and Carreiras (Journal of Experimental Psychology: Human Perception and Performance 34:237–241, 2008) found that LEET stimuli, formed by a mixture of digits and letters (e.g., T4BL3 instead of TABLE), produced priming effects similar to those for regular words. This finding led them to conclude that LEET stimuli automatically activate lexical information. In the present study, we examined whether semantic activation occurs for LEET stimuli by using an electrophysiological measure called the N400 effect. The N400 effect, also known as the mismatch negativity, reflects detection of a mismatch between a word and the current semantic context. This N400 effect could occur only if the LEET stimulus had been identified and processed semantically. Participants determined whether a stimulus (word or LEET) was related to a given category (e.g., APPLE or 4PPL3 belongs to the category “fruit,” but TABLE or T4BL3 does not). We found that LEET stimuli produced an N400 effect similar in magnitude to that for regular uppercase words, suggesting that LEET stimuli can access meaning in a manner similar to words presented in consistent uppercase letters.     

Global-local interference modulated by communication between the hemispheres.

Three experiments examined whether interhemispheric interaction modulates selective attention in a same-different version of D. Navon's (1977) global-local paradigm. In Experiments 1 and 2, interhemispheric interaction reduced interstimulus interference produced when two stimuli matched at a preassigned level (e.g., local) but differed at the irrelevant level (e.g., global). This effect was greater for stimuli made of a few large elements than for those made of many small elements. Experiment 3 demonstrated that (a) the ability of interhemispheric interaction to reduce interstimulus interference is not constrained by hemispheric differences for global and local processing and (b) interhemispheric interaction does not strongly modulate intrastimulus interference produced when the forms at the preassigned (e.g., local) and irrelevant (e.g., global) levels differ within an individual stimulus. These findings indicate that interaction between the hemispheres is a neural mechanism that may aid selective attention.     

Attentional bias toward low-intensity stimuli: an explanation for the intensity dissociation between reaction time and temporal order judgment?

If two stimuli need different times to be processed, this difference should in principle be reflected both by response times (RT) and by judgments of their temporal order (TOJ). However, several dissociations have been reported between RT and TOJ, e.g., RT is more affected than TOJ when stimulus intensity decreases. One account for these dissociations is to assume differences in the allocation of attention induced by the two tasks. To test this hypothesis, different distributions of attention were induced in the present study between two stimulus positions (above and below fixation). Only bright stimuli appeared in one position and either bright or dim stimuli in the other. In the two RT experiments, participants had to respond to every stimulus appearing in one of the two positions. Reaction times to bright stimuli were faster when they appeared in the position where dim stimuli were likely to occur. This finding suggests that the allocation of attention was adapted to the asymmetrical arrangement of stimuli, not suggested by explicit instruction. In the two TOJ experiments, the temporal order of stimuli appearing in the two positions had to be judged. Although bright stimuli appearing at the bright-and-dim location were judged to be earlier, this effect was small and insignificant. Further, the intensity dissociation between RT and TOJ was insensitive to random vs blockwise presentations of intensities, therefore was not modified by attentional preferences. Thus, asymmetrical arrangement of stimuli has an impact on the allocation of attention, but only in the RT task. Therefore dissociations between TOJ and response times cannot be accounted for by an attentional bias in the TOJ task but probably by different use of temporal information in the two tasks.     

Bias in self-motion perceived speed can enhance episodic memory

Prior experiences of a stimulus facilitate reprocessing of that stimulus on a subsequent occasion. This relative ease and speed with which information is processed is defined as fluency and can constitute a basis for memory judgment. Fluency can also be manipulated on line by perceptual bias (e.g., levels of noise), leading to an increase in recognition for items processed more fluently (e.g., items with less noise). Previous experiments using Remember-Know paradigm have shown an impact of perceptual fluency only on familiarity and not on recollection. Recent episodic memory models have postulated a strong link between episodic memory and spatial processes, especially with egocentric updating (Gomez et al. in Acta Psychol 132(3):221-227, 2009). The present experiment was conducted to determine whether self-motion fluency affects recognition performance and particularly has an impact on "Remember" responses. Thirty participants learned a 4-min path movie and then had to recognize among short paths if they were part of the learned path, followed by a Remember-Know procedure for recognized items. Self-motion fluency was manipulated with the presence of nimble acceleration applied on a small part of the recognition paths. Results show that the presence of a self-motion fluency increases significantly the proportion of remember responses solely on learned paths. This study spotlights for the first time a specific fluency effect on recollection and indicates an implication of egocentric-updating processing in episodic memory retrieval.     

Stimulus-specific processing consequences of pattern goodness

Two issues concerning the effects of visual pattern goodness on information processing time were investigated: the role of memory vs. encoding and the role of individual stimulus goodness vs. stimulus similarity. A sequential “same-different” task was used to provide differentiation of target item or memory effects from display item or encoding effects. Experiment 1 used four alternative stimuli in each block of trials. The results showed that good patterns were processed faster than poor patterns for both “same” and “different” responses. Furthermore, the goodness of the target item had a greater effect on reaction time than did the goodness of the display item, indicating that memory is more important than encoding in producing faster processing of good stimuli. Effects of interstimulus similarity on processing time were minimal, although isolation of good stimuli in a similarity space could explain many of the results. Experiment 2 replicated the results of Experiment 1, despite the fact that differences in similarity space had been minimized by using only two alternative stimuli in each block. In addition, the speed of processing a “same” pair was essentially independent of the particular alternative stimulus in a block. These results suggest that in this task, there is a processing advantage for good stimuli that is stimulus specific, with the effect operating primarily in memory.     

Space, object, and task selection

Within the field of selective attention, two separate literatures have developed, one examining the effect of selection of objects and another examining the effect of selection of features. The present study bridged these two traditions by examining the compatibility effects generated by two features of attended and unattended nontarget (foil) stimuli. On each trial, participants determined either the identity or the orientation of a visual stimulus. Spatial attention was controlled using cues (presented prior to the target frame) designed to involuntarily capture attention. We independently manipulated the stimulus dimension the participants prepared for and the stimulus dimension on which they actually executed the task. Preparation had little influence on the magnitude of compatibility effects from foil stimuli. For attended stimuli, the stimulus dimension used in executing the task produced large compatibility effects, regardless of whether that dimension was prepared. These and other compatibility effects (e.g., Stroop effects) are discussed in relation to an integrative model of attentional selection. The key assumptions are that (1) selection occurs at three distinct levels (space, object, and task), (2) spatial attention leads to semantic processing of all dimensions, and (3) features do not automatically activate responses unless that object is selected for action.     

Changes in background impair fluency-triggered positive affect: a cross-cultural test using a mere-exposure paradigm

This study examined whether repeated exposure would enhance positive evaluations when only a part of a stimulus (e.g., the central object) was identical to a previously presented stimulus. Japanese and American participants were exposed to photographs of animals with scenery, then asked their preferences for each of four types of photographs of animals (photographs of animals with the original scenery, photographs of animals without scenery, photographs of animals with novel scenery, and photographs of animals not depicted previously). Finally, their recognition of the animals presented in the exposure phase was tested. Members of both groups showed the mere-exposure effect for the first two types of stimuli, irrespective of stimulus recognition accuracy, whereas this effect was not observed for animals presented with novel scenery. This suggests that changes in background impair positive affect as a result of repeated exposure.     

Not just another face in the crowd: Detecting emotional schematic faces during continuous flash suppression

To test whether threatening visual information receives prioritized processing, many studies have examined visual search for emotional schematic faces. Still, it has remained unclear whether negative or positive schematic faces are processed more efficiently. We used continuous flash suppression, a variant of binocular rivalry, to render single emotional schematic faces invisible and measured whether negative or positive faces have an advantage in accessing awareness. Across three experiments, positive faces were detected more quickly than negative faces. A fourth experiment indicated that this positive face advantage was unrelated to the valence of the face stimuli but due to the relative orientation of the mouth curvature and the face contour. These findings demonstrate the impact of configural stimulus properties on perceptual suppression during binocular rivalry and point to a perceptual confound present in emotional schematic faces that might account for some ambiguous results obtained with schematic face stimuli in previous studies. (PsycINFO Database Record (c) 2012 APA, all rights reserved).     

两种任务下情绪韵律的加工进程

采用ERP技术分别考察了情绪判断和性别判断任务下情绪韵律的加工进程。结果显示：在175-275ms时间段,情绪韵律的加工受实验任务的调节,情绪判断任务下存在效价主效应及负性偏向,愤怒比高兴和中性诱发了更正的P2成分,而性别判断任务则无效价效应。在后期评价加工及反应准备阶段（400-800ms）,两种任务下,愤怒都比高兴和中性诱发了更正的晚成分。上述结果说明,不同情绪韵律的识别存在不同的认知机制,并在一定程度上会受加工任务的调节。