Interference in visual perception by verbal and spatial cognitive activity

In two experiments we tested the hypothesis that cognitive processing based on spatial imagery produces more deterioration of visual perception than cognitive processing based on verbal codes. So, we studied the effect on visual perception of two cognitive tasks, one of spatial imagery and the other a verbal task. In the first one, with 30 participants, we analyzed the mental load and ocular behaviors in both cognitive tasks. In the second experiment, with 29 participants, we studied the effect of both tasks on a visual search task, using a dual-task experimental paradigm. The verbal task presented higher mental load than the imagery task when both tasks were carried out with visual search task, and there was more deterioration in stimulus detection with the verbal task. We can conclude that: (1) cognitive tasks produce important deterioration in the capacities of visual search and identification of stimuli; (2) this deterioration has two components: (a) an inefficient search, associated with alterations of the gaze patterns while performing cognitive tasks, and (b) a general interference, nonspecific to spatial codes, in the process of identification of looked-at stimuli; (3) this cognitive interference is related to the mental load or effort required by the cognitive task.     

Similar effects of visual perception and imagery on simple reaction time

A longstanding issue is whether perception and mental imagery share similar cognitive and neural mechanisms. To cast further light on this problem, we compared the effects of real and mentally generated visual stimuli on simple reaction time (RT). In five experiments, we tested the effects of difference in luminance, contrast, spatial frequency, motion, and orientation. With the intriguing exception of spatial frequency, in all other tasks perception and imagery showed qualitatively similar effects. An increase in luminance, contrast, and visual motion yielded a decrease in RT for both visually presented and imagined stimuli. In contrast, gratings of low spatial frequency were responded to more quickly than those of higher spatial frequency only for visually presented stimuli. Thus, the present study shows that basic dependent variables exert similar effects on visual RT either when retinally presented or when imagined. Of course, this evidence does not necessarily imply analogous mechanisms for perception and imagery, and a note of caution in such respect is suggested by the large difference in RT between the two operations. However, the present results undoubtedly provide support for some overlap between the structural representation of perception and imagery.     

Similar effects of visual perception and imagery on simple reaction time

A longstanding issue is whether perception and mental imagery share similar cognitive and neural mechanisms. To cast further light on this problem, we compared the effects of real and mentally generated visual stimuli on simple reaction time (RT). In five experiments, we tested the effects of difference in luminance, contrast, spatial frequency, motion, and orientation. With the intriguing exception of spatial frequency, in all other tasks perception and imagery showed qualitatively similar effects. An increase in luminance, contrast, and visual motion yielded a decrease in RT for both visually presented and imagined stimuli. In contrast, gratings of low spatial frequency were responded to more quickly than those of higher spatial frequency only for visually presented stimuli. Thus, the present study shows that basic dependent variables exert similar effects on visual RT either when retinally presented or when imagined. Of course, this evidence does not necessarily imply analogous mechanisms for perception and imagery, and a note of caution in such respect is suggested by the large difference in RT between the two operations. However, the present results undoubtedly provide support for some overlap between the structural representation of perception and imagery.     

Effects of spatial and selective attention on basic multisensory integration

When participants respond to auditory and visual stimuli, responses to audiovisual stimuli are substantially faster than to unimodal stimuli (redundant signals effect, RSE). In such tasks, the RSE is usually higher than probability summation predicts, suggestive of specific integration mechanisms underlying the RSE. We investigated the role of spatial and selective attention on the RSE in audiovisual redundant signals tasks. In Experiment 1, stimuli were presented either centrally (narrow attentional focus) or at 1 of 3 unpredictable locations (wide focus). The RSE was accurately described by a coactivation model assuming linear superposition of modality-specific activation. Effects of spatial attention were explained by a shift of the evidence criterion. In Experiment 2, stimuli were presented at 3 locations; participants had to respond either to all signals regardless of location (simple response task) or to central stimuli only (selective attention task). The RSE was consistent with task-specific coactivation models; accumulation of evidence, however, differed between the 2 tasks.     

Expectancy and visual-spatial attention: effects on perceptual quality

When we expect important stimuli at a particular spatial location, how does our perceptual sensitivity change over space? Subjects were cued to expect a target stimulus at one location and then required to perform one of the following tasks at that and three other locations: luminance detection, brightness discrimination, orientation discrimination, or form discrimination. The analysis of subjects' performance according to signal detection theory revealed changes in both sensitivity and bias for each of these tasks. Sensitivity was maximally enhanced at the location where a target stimulus was expected and generally decreased with distance from that location. Factors that influenced the gradient of sensitivity were (a) the type of task performed and (b) the spatial distribution of the stimuli. Sensitivity fell off more steeply over distance for orientation and form discrimination than for luminance detection and brightness discrimination. In addition, it fell off more steeply when stimuli were near each other than when they were farther apart.     

Squinting with the mind’s eye: Effects of stimulus resolution on imaginal and perceptual comparisons

Subjects either viewed or visualized arrays that were divided into four quadrants, with each quadrant containing a set of stripes. In two experiments, one array contained only relatively narrow (high-resolution) stripes, and one contained only relatively thick (low-resolution) stripes. The subjects compared sets of stripes in different quadrants according to their length, spacing, orientation, or width. When the subjects visualized the arrays, they required much more time to compare high-resolution patterns than low-resolution patterns; when the subjects saw the arrays, they evaluated both types of arrays equally easily. In addition, the results from the third experiment provide strong evidence that people use imagery in this task; in one condition, the subjects evaluated oblique sets of stripes, and in another condition, they evaluated vertical and horizontal stripes. In both imagery and perception, the subjects made more errors when evaluating oblique stimuli; in imagery, they also required more time to evaluate oblique stimuli. The results suggest that additional effort is required in imagery to represent visual patterns with high resolution. This finding demonstrates that, although imagery and perception may activate common brain regions, it is more difficult to represent high-resolution information in imagery than in perception.     

Examining the Relation Between Visual Imagery and Spatial Ability Tests

Research evidence indicates that self-report imagery ability is psychometrically distinct from objective, spatial test measures. One hypothesis put forward in the literature to explain this finding is that the nature of the stimulus is important. The aim of this article was to examine the relation between spatial abilities and measures of visual imagery obtained using different types of stimulus material. The main finding was that imagery tasks that required the mental synthesis or transformation of visual forms, such as alphanumeric characters and simple geometric shapes, correlated strongly with tests of spatial ability. In contrast, images of familiar items retrieved from long-term memory did not correlate with spatial test performance. It is argued that tasks that better control the stimuli imagined and the standards used to rate the quality of the image provide more objective measures of imagery ability. The implications of these findings are discussed.     

Distractor-response bindings in dual task scenarios

If a response is executed in reaction to a target stimulus, accompanying distractor stimuli can be integrated with and later on retrieve this response, an effect called distractor-response binding. There has been some debate as to whether S-R binding is generally influenced by attentional processes and in particular the role of attentional processes for the binding of irrelevant stimuli and responses is unclear. We therefore analyze the impact of spatial input attention while engaging central attention in an additional task. In particular, participants worked in dual task situations that induced load on central attention while the distribution of spatial attention was manipulated by varying the location of the different tasks. Distractor-response binding occurred only if both tasks were presented in the same spatial location. In contrast, binding effects within one task were prevented if spatial attention was withdrawn from the task by presenting a second task in a separate area. It is concluded that input but no central attention is required for the integration of distractor stimuli and responses. Theoretical and practical implications of these findings are discussed.     

Mental rotation is not easily cognitively penetrable

When participants take part in mental imagery experiments, are they using their “tacit knowledge” of perception to mimic what they believe should occur in the corresponding perceptual task? Two experiments were conducted to examine whether such an account can be applied to mental imagery in general. These experiments both examined tasks that required participants to “mentally rotate” stimuli. In Experiment 1, instructions led participants to believe that they could reorient shapes in one step or avoid reorienting the shapes altogether. Regardless of instruction type, response times increased linearly with increasing rotation angles. In Experiment 2, participants first observed novel objects rotating at different speeds, and then performed a mental rotation task with those objects. The speed of perceptually demonstrated rotation did not affect the speed of mental rotation. We argue that tacit knowledge cannot explain mental imagery results in general, and that in particular the mental rotation effect reflects the nature of the underlying internal representation and processes that transform it, rather than participants’ pre-existing knowledge.     

Unconscious priming of task sets: The role of spatial attention

Unconscious stimuli activate task sets, mental programs that orchestrate performance of complex tasks, but the role of attention in such effects has not been addressed. In previous studies, unconscious prime stimuli appeared at attended locations and were explicitly specified in the task instructions; spatial attention to the prime and/or a specific conscious attentional set may thus be required for such unconscious activation to arise. In the present experiments, a learning phase established associations between unconscious prime stimuli and performance of two tasks. These associations influenced task performance in a subsequent test phase, even though the primes were not specified in current task instructions. This is the first demonstration that unconscious stimuli can prime task sets independently of a current attentional set that specifies stimulus-task mappings. Such priming was not influenced by spatial attention cues, in contrast to clear attention influences in comparison trials that mimicked conditions employed by previous studies.     

Spatial versus object visualizers: A new characterization of visual cognitive style

The visual system processes object properties (such as shape and color) and spatial properties (such as location and spatial relations) in distinct systems, and neuropsychological evidence reveals that mental imagery respects this distinction. The findings reported in this article demonstrate that verbalizers typically perform at an intermediate level on imagery tasks, whereas visualizers can be divided into two groups. Specifically, scores on spatial and object imagery tasks, along with a visualizer-verbalizer cognitive style questionnaire, identified a group of visualizers who scored poorly on spatial imagery tasks but excelled on object imagery tasks. In contrast, a second group of visualizers scored high on spatial imagery tasks but poorly on object imagery tasks. The results also indicate that object visualizers encode and process images holistically, as a single perceptual unit, whereas spatial visualizers generate and process images analytically, part by part. In addition, we found that scientists and engineers excel in spatial imagery and prefer spatial strategies, whereas visual artists excel in object imagery and prefer object-based strategies.     

What clocks tell us about the neural correlates of spatial imagery

We review a series of experimental studies aimed at answering some critical questions about the neural basis of spatial imagery. Our group used functional magnetic resonance imaging (fMRI) to explore the neural correlates of an online behaviourally controlled spatial imagery task without need for visual presentation—the mental clock task. Subjects are asked to imagine pairs of times that are presented acoustically and to judge at which of the two times the clock hands form the greater angle. The cortical activation elicited by this task was contrasted with that obtained during other visual, perceptual, verbal, and spatial imagery tasks in several block design studies. Moreover, our group performed an event‐related fMRI study on the clock task to investigate the representation of component cognitive processes in spatial imagery. The bulk of our findings demonstrates that cortical areas in the posterior parietal cortex (PPC), along the intraparietal sulcus, are robustly involved in spatial mental imagery and in other tasks requiring spatial transformations. PPC is bilaterally involved in different kinds of spatial judgement. Yet the degree to which right and left PPC are activated in different tasks is a function of task requirements. From event‐related fMRI data we obtained evidence that left and right PPC are activated asynchronously during the clock task and this could reflect their different functional role in subserving cognitive components of visuospatial imagery.     

The locus of spatial attention during the temporal integration of visual memories and visual percepts

Temporal integration is a process by which two serially presented visual stimuli are mentally integrated to form a composite representation. In the present research, we explored how spatial selective attention is used during the delay separating stimuli, in order to determine the contents of spatial working memory in this task. A two-task situation was created. On the primary task, two dot arrays were serially presented within a grid, leaving one space empty, which subjects identified. On the secondary task, instead of the second array, a discrimination probe was presented. Integration accuracy increased through delays of 1,500 msec, revealing an estimate of the time required to form an optimal memory trace for integration. Once the memory trace was formed (but not before), response time to the probe was faster if it was presented in a location previously occupied by a dot from Array 1. This indicates that during the delay separating the arrays, the subjects assigned spatial attention to the locations occupied by the first array and actively maintained the leading array in working memory. Implications for theories of visual processing and memory are discussed.     

Two kinds of bias in visual comparison illustrate the role of location and holistic/analytic processing differences

A number of studies have shown that two stimuli appearing successively at the same spatial location are more likely to be perceived as the same, even though location is irrelevant to the task. This bias to respond “same” when stimuli are at the same location is termed spatial congruency bias. The experiments reported here demonstrate that the spatial congruency bias extends to letter strings: Participants tend to respond “same” when comparing two strings appearing successively at the same location. This bias may arise because successive stimuli at the same location are more likely to be perceived as a single object. Bias is also affected by the nature of the comparison task. We show that if letters must be compared individually (analytical comparison), there is a bias to respond “different,” but if letter strings are compared as unified wholes (holistic comparison), there is no bias or a bias to respond “same.” This analytical bias is apparently separate from the spatial congruency bias. It appears whether the task requires localization of differences between strings, or counting the number of differences, or ignoring differences in some parts of the stimuli while attending to others. All of these analytical comparison tasks require that letters be selected individually, and the analytical bias may reflect difficulty in preventing interference from neighboring letters in this selection process. Each type of bias reflects a different aspect of visual processing, and both can be measured to probe how processing changes across different tasks.     

初级视觉皮层在表象表征方式研究中的作用

表象的信息表征方式一直是心理学研究的热点问题,脑成像技术在该问题的研究中发挥了巨大作用。本文以初级视觉皮层(V1)在表象表征方式研究中的作用为主线,系统梳理了基于脑成像技术开展的表象实质争论的核心问题,归纳分析了相关争论问题演绎发展的内在逻辑脉络,在此基础上指出了表象研究中需要进一步解决的关键问题,以期能够促进相关研究问题的进一步开展。     

Identification and location tasks rely on different mental processes: a diffusion model account of validity effects in spatial cueing paradigms with emotional stimuli

Spatial cueing paradigms are popular tools to assess human attention to emotional stimuli, but different variants of these paradigms differ in what participants’ primary task is. In one variant, participants indicate the location of the target (location task), whereas in the other they indicate the shape of the target (identification task). In the present paper we test the idea that although these two variants produce seemingly comparable cue validity effects on response times, they rest on different underlying processes. Across four studies (total N?=?397; two in the supplement) using both variants and manipulating the motivational relevance of cue content, diffusion model analyses revealed that cue validity effects in location tasks are primarily driven by response biases, whereas the same effect rests on delay due to attention to the cue in identification tasks. Based on this, we predict and empirically support that a symmetrical distribution of valid and invalid cues would reduce cue validity effects in location tasks to a greater extent than in identification tasks. Across all variants of the task, we fail to replicate the effect of greater cue validity effects for arousing (vs. neutral) stimuli. We discuss the implications of these findings for best practice in spatial cueing research.     

习得性空间联结的迁移依赖于语义工作记忆

采用练习迁移范式与双任务范式相结合的设计来探讨练习所习得的空间联结在工作记忆中如何表征。被试先进行不一致空间的刺激—反应映射练习任务, 五分钟后, 随机迁移到单任务(Simon任务)或者双任务(Simon任务+语义工作记忆负荷任务或空间工作记忆负荷任务)。结果发现：不一致的练习能使单任务出现反转的Simon效应, 但语义工作记忆负荷会使反转的Simon效应消失, 而空间工作记忆负荷却对反转的Simon效应没有影响。实验结果表明练习产生的空间联结依赖于语义工作记忆。     

Locational representation in imagery: The third dimension

Six experiments were conducted to test the relative processing characteristics of picture-plane and three-dimensional imagery as indexed by tasks that required subjects to keep track of successive locations in multiunit visual displays. Subjects were shown symmetrical displays either drawn on cardboard or constructed with three-dimensional blocks. They then were required to imagine these matrices and follow pathways through a series of adjacent squares (blocks) within the matrices. The pathways were described by a series of verbal terms that indicated the direction of the next square (block) in the pathway. Subjects experienced difficulty in performing the task with picture-plane displays composed of as few as 16 squares (4×4), but they rarely made errors with a three-dimensional matrix of 27 blocks (3×3×3). Performance with the three-dimensional task dropped dramatically when the matrix size was increased to 4×4×4. The results replicated previous findings that the image processing capacity for location in two-dimensional imagery is about three units in each direction, and they indicate that adding the depth dimension increases the capacity for representation of spatial location in imagery.