When two actions are easier than one: How inhibitory control demands affect response processing

Numerous studies showed that the simultaneous execution of multiple actions is associated with performance costs. Here, we demonstrate that when highly automatic responses are involved, performance in single-response conditions can actually be worse than in dual-response conditions. Participants responded to peripheral visual stimuli with an eye movement (saccade), a manual key press, or both. To manipulate saccade automaticity, a central fixation cross either remained present throughout the trial (overlap condition, lower automaticity) or disappeared 200 ms before visual target onset (gap condition, greater automaticity). Crucially, single-response conditions yielded more performance errors than dual-response conditions (i.e., dual-response benefit), especially in gap trials. This was due to difficulties associated with inhibiting saccades when only manual responses were required, suggesting that response inhibition (remaining fixated) can be even more resource-demanding than overt response execution (saccade to peripheral target).     

Smiling faces and cash bonuses: Exploring common affective coding across positive and negative emotional and motivational stimuli using fMRI

Although it is clear that emotional and motivational manipulations yield a strong influence on cognition and behaviour, these domains have mostly been investigated in independent research lines. Therefore, it remains poorly understood how far these affective manipulations overlap in terms of their underlying neural activations, especially in light of previous findings that suggest a shared valence mechanism across multiple affective processing domains (e.g., monetary incentives, primary rewards, emotional events). This is particularly interesting considering the commonality between emotional and motivational constructs in terms of their basic affective nature (positive vs. negative), but dissociations in terms of instrumentality, in that only reward-related stimuli are typically associated with performance-contingent outcomes. Here, we aimed to examine potential common neural processes triggered by emotional and motivational stimuli in matched tasks within participants using functional magnetic resonance imaging (fMRI). Across tasks, we found shared valence effects in the ventromedial prefrontal cortex and left inferior frontal gyrus (part of dorsolateral prefrontal cortex), with increased activity for positive and negative stimuli, respectively. Despite this commonality, emotion and reward tasks featured differential behavioural patterns in that negative valence effects (performance costs) were exclusive to emotional stimuli, while positive valence effects (performance benefits) were only observed for reward-related stimuli. Overall, our data suggest a common affective coding mechanism across different task domains and support the idea that monetary incentives entail signed basic valence signals, above and beyond the instruction to perform both gain and loss trials as accurately as possible to maximise the outcome.     

Reading spoken words: orthographic effects in auditory priming

Three experiments examined the involvement of orthography in spoken word processing using a task - unimodal auditory priming with offset overlap - taken to reflect activation of prelexical representations. Two types of prime-target relationship were compared; both involved phonological overlap, but only one had a strong orthographic overlap (e.g., dream-gleam vs. scheme-gleam). In Experiment 1, which used lexical decision, phonological overlap facilitated target responses in comparison with an unrelated condition (e.g., stove-gleam). More importantly, facilitation was modulated by degree of orthographic overlap. Experiment 2 employed the same design as Experiment 1, but with a modified procedure aimed at eliciting swifter responses. Again, the phonological priming effect was sensitive to the degree of orthographic overlap between prime and target. Finally, to test whether this orthographic boost was caused by congruency between response type and valence of the prime-target overlap, Experiment 3 used a pseudoword detection task, in which participants responded "yes" to novel words and "no" to known words. Once again phonological priming was observed, with a significant boost in the orthographic overlap condition. These results indicate a surprising level of orthographic involvement in speech perception, and provide clear evidence for mandatory orthographic activation during spoken word recognition.     

Dissecting the symbolic distance effect: Comparison and priming effects in numerical and nonnumerical orders

When participants are asked to compare two stimuli, responses are slower for stimuli close to each other on the relevant dimension than for stimuli further apart. Previously, it has been proposed that this comparison distance effect originates from overlap in the representation of the stimuli. This idea is generally accepted in numerical cognition, where it is assumed that representational overlap of numbers on a mental number line accounts for the effect (e.g., Cohen Kadosh et al., 2005). In contrast, others have emphasized the role of response-related processes to explain the comparison distance effect (e.g., Banks, 1977). In the present study, numbers and letters are used to show that the comparison distance effect can be dissociated from a more direct behavioral signature of representational overlap, the priming distance effect. The implication is that a comparison distance effect does not imply representational overlap. An interpretation is given in terms of a recently proposed model of quantity comparison (Verguts, Fias, & Stevens, 2005).     

Common spatial organization of number and emotional expression: a mental magnitude line

Converging behavioral and neural evidence suggests that numerical representations are mentally organized in left-to-right orientation. Here we show that this format of spatial organization extends to emotional expression. In Experiment 1, right-side responses became increasingly faster as number (represented by Arabic numerals) or happiness (depicted in facial stimuli) increased, for judgments completely unrelated to magnitude. Additional experiments suggest that magnitude (i.e., more/less relations), not valence (i.e., positive/negative), underlies left-to-right orientation of emotional expression (Experiment 2), and that this orientation accommodates to the context-relevant emotion (e.g., happier faces are more rightward when judged on happiness, but more leftward when judged on angriness; Experiment 3). These findings show that people automatically extract magnitude from a variety of stimuli, representing such information in common left-to-right format, perhaps reflecting a mental magnitude line. We suggest that number is but one dimension in a hyper-general representational system uniting disparate dimensions of magnitude and likely subserved by common neural mechanisms in posterior parietal cortex.     

Integration of parafoveal orthographic information during foveal word reading: beyond the sub-lexical level?

Prior research has shown that processing of a given target word is facilitated by the simultaneous presentation of orthographically related stimuli in the parafovea. Here we investigate the nature of such spatial integration processes by presenting orthographic neighbours of target words in the parafovea, considering that neighbours have been shown to inhibit, rather than facilitate, recognition of target words in foveal masked priming research. In Experiment 1, we used the gaze-contingent boundary paradigm to manipulate the parafoveal information subjects received while they fixated a target word within a sentence. In Experiment 2, we used the Flanking Letters Lexical Decision paradigm to manipulate parafoveal information while subjects read isolated words. Parafoveal words were either a higher-frequency orthographic neighbour of targets words (e.g., blue-blur) or a high-frequency unrelated word (e.g., hand-blur). We found that parafoveal orthographic neighbours facilitated, rather than inhibited, processing of the target. Thus, the present findings provide further evidence that orthographic information is integrated across multiple words and suggest that either the integration process does not enable simultaneous access to those words’ lexical representations, or that lexical representations activated by spatially distinct stimuli do not compete for recognition.     

Implicit response-irrelevant number information triggers the SNARC effect: Evidence using a neural overlap paradigm

There is evidence from the SNARC (spatial–numerical association of response codes) effect and NDE (numerical distance effect) that number activates spatial representations. Most of this evidence comes from tasks with explicit reference to number, whether through presentation of Arabic digits (SNARC) or through magnitude decisions to nonsymbolic representations (NDE). Here, we report four studies that use the neural overlap paradigm developed by Fias, Lauwereyns, and Lammertyn (2001) to examine whether the presentation of implicit and task-irrelevant numerosity information (nonsymbolic arrays and auditory numbers) is enough to activate a spatial representation of number. Participants were presented with either numerosity arrays (1–9 circles or triangles) to which they made colour (Experiment 1) or orientation (Experiment 2) judgements, or auditory numbers coupled with an on-screen stimulus to which they made a colour (Experiment 3) or orientation (Experiment 4) judgement. SNARC effects were observed only for the orientation tasks. Following the logic of Fias et al., we argue that this SNARC effect occurs as a result of overlap in parietal processing for number and orientation judgements irrespective of modality. Furthermore, we found stronger SNARC effects in the small number range (1–4) than in the larger number range (6–9) for both nonsymbolic displays and auditory numbers. These results suggest that quantity is extracted (and interferes with responses in the orientation task) but this is not exact for the entire number range. We discuss a number of alternative models and mechanisms of numerical processing that may account for such effects.     

From eyes to hands: Transfer of learning in the Simon task across motor effectors

Inhibition of irrelevant and conflicting information and responses is crucial for goal-directed behaviour and adaptive functioning. In the Simon task, for example, responses are slowed if their mappings are spatially incongruent with stimuli that must be discriminated on a nonspatial dimension. Previous work has shown that practice with incongruent spatial mappings can reduce or even reverse the Simon effect. We asked whether such practice transfers between the manual and oculomotor systems and if so to what extent this occurs across a range of behavioural tasks. In two experiments, one cohort of participants underwent anti-saccade training, during which they repeatedly inhibited the reflexive impulse to look toward a briefly presented target. Additionally, two active-control training groups were included, in which participants either trained on Pro-saccade or Fixation training regimens. In Experiment 1, we probed whether the Simon effect and another inhibitory paradigm, the Stroop task, showed differential effects after training. In Experiment 2, we included a larger battery of inhibitory tasks (Simon, Stroop, flanker and stop-signal) and noninhibitory control measures (multitasking and visual search) to assess the limits of transfer. All three training regimens led to behavioural improvements in the trained-upon task, but only the anti-saccade training group displayed benefits that transferred to the manual response modality. This transfer of training benefit replicated across the two experiments but was restricted to the Simon effect. Evidence for transfer of inhibition training across motor systems offers important insights into the nature of stimulus-response representations and their malleability.     

Egocentric metric representations in peripersonal space: A bridge between motor resources and spatial memory

Research on visuospatial memory has shown that egocentric (subject-to-object) and allocentric (object-to-object) reference frames are connected to categorical (non-metric) and coordinate (metric) spatial relations, and that motor resources are recruited especially when processing spatial information in peripersonal (within arm reaching) than extrapersonal (outside arm reaching) space. In order to perform our daily-life activities, these spatial components cooperate along a continuum from recognition-related (e.g., recognizing stimuli) to action-related (e.g., reaching stimuli) purposes. Therefore, it is possible that some types of spatial representations rely more on action/motor processes than others. Here, we explored the role of motor resources in the combinations of these visuospatial memory components. A motor interference paradigm was adopted in which participants had their arms bent behind their back or free during a spatial memory task. This task consisted in memorizing triads of objects and then verbally judging what was the object: (1) closest to/farthest from the participant (egocentric coordinate); (2) to the right/left of the participant (egocentric categorical); (3) closest to/farthest from a target object (allocentric coordinate); and (4) on the right/left of a target object (allocentric categorical). The triads appeared in participants' peripersonal (Experiment 1) or extrapersonal (Experiment 2) space. The results of Experiment 1 showed that motor interference selectively damaged egocentric-coordinate judgements but not the other spatial combinations. The results of Experiment 2 showed that the interference effect disappeared when the objects were in the extrapersonal space. A third follow-up study using a within-subject design confirmed the overall pattern of results. Our findings provide evidence that motor resources play an important role in the combination of coordinate spatial relations and egocentric representations in peripersonal space.     

Time in the mind: using space to think about time

How do we construct abstract ideas like justice, mathematics, or time-travel? In this paper we investigate whether mental representations that result from physical experience underlie people's more abstract mental representations, using the domains of space and time as a testbed. People often talk about time using spatial language (e.g., a long vacation, a short concert). Do people also think about time using spatial representations, even when they are not using language? Results of six psychophysical experiments revealed that people are unable to ignore irrelevant spatial information when making judgments about duration, but not the converse. This pattern, which is predicted by the asymmetry between space and time in linguistic metaphors, was demonstrated here in tasks that do not involve any linguistic stimuli or responses. These findings provide evidence that the metaphorical relationship between space and time observed in language also exists in our more basic representations of distance and duration. Results suggest that our mental representations of things we can never see or touch may be built, in part, out of representations of physical experiences in perception and motor action.     

Implicit response-irrelevant number information triggers the SNARC effect: Evidence using a neural overlap paradigm

There is evidence from the SNARC (spatial-numerical association of response codes) effect and NDE (numerical distance effect) that number activates spatial representations. Most of this evidence comes from tasks with explicit reference to number, whether through presentation of Arabic digits (SNARC) or through magnitude decisions to nonsymbolic representations (NDE). Here, we report four studies that use the neural overlap paradigm developed by Fias, Lauwereyns, and Lammertyn (2001) to examine whether the presentation of implicit and task-irrelevant numerosity information (nonsymbolic arrays and auditory numbers) is enough to activate a spatial representation of number. Participants were presented with either numerosity arrays (1-9 circles or triangles) to which they made colour (Experiment 1) or orientation (Experiment 2) judgements, or auditory numbers coupled with an on-screen stimulus to which they made a colour (Experiment 3) or orientation (Experiment 4) judgement. SNARC effects were observed only for the orientation tasks. Following the logic of Fias et al., we argue that this SNARC effect occurs as a result of overlap in parietal processing for number and orientation judgements irrespective of modality. Furthermore, we found stronger SNARC effects in the small number range (1-4) than in the larger number range (6-9) for both nonsymbolic displays and auditory numbers. These results suggest that quantity is extracted (and interferes with responses in the orientation task) but this is not exact for the entire number range. We discuss a number of alternative models and mechanisms of numerical processing that may account for such effects.     

Embodied representation of the body contains veridical spatial information

In two experiments, the extent to which mental body representations contain spatial information was examined. Participants were asked to compare distances between various body parts. Similar to what happens when people compare distances on a real visual stimulus, they were faster as the distance differences between body parts became larger (Experiment 1), and this effect could not (only) be explained by the crossing of major bodily categories (umbilicus to knee vs. knee to ankle; Experiment 2). In addition, participants also performed simple animate/inanimate verification on a set of nouns. The nouns describing animate items were names of body parts. A spatial priming effect was found: Verification was faster for body part items preceded by body parts in close spatial proximity. This suggests automatic activation of spatial body information. Taken together, results from the distance comparison task and the property verification task showed that mental body representations contain both categorical and more metric spatial information. These findings are further discussed in terms of recent embodied cognition theories.     

Embodied representation of the body contains veridical spatial information

In two experiments, the extent to which mental body representations contain spatial information was examined. Participants were asked to compare distances between various body parts. Similar to what happens when people compare distances on a real visual stimulus, they were faster as the distance differences between body parts became larger (Experiment 1), and this effect could not (only) be explained by the crossing of major bodily categories (umbilicus to knee vs. knee to ankle; Experiment 2). In addition, participants also performed simple animate/inanimate verification on a set of nouns. The nouns describing animate items were names of body parts. A spatial priming effect was found: Verification was faster for body part items preceded by body parts in close spatial proximity. This suggests automatic activation of spatial body information. Taken together, results from the distance comparison task and the property verification task showed that mental body representations contain both categorical and more metric spatial information. These findings are further discussed in terms of recent embodied cognition theories.     

Stroop interference is affected in inhibition of return

In previous research, we have shown that the processing of targets that are presented to locations subject to inhibition of return (IOR) is affected by an inhibitory tagging mechanism. This mechanism acts by disconnecting activated representations of stimuli at inhibited locations from their associated responses. In two experiments, we assessed whether this inhibitory tagging mechanism of visual attention is also applied to task-irrelevant but prepotent dimensions of target stimuli, such as words in the Stroop task. To test this hypothesis, we examined the Stroop effect in an IOR procedure. The results showed that (1) IOR can be found in a color discrimination task, (2) the Stroop interference was reduced (Experiment 1) or eliminated (Experiment 2) when stimuli appeared at cued locations, as compared with cases in which they were presented at uncued locations, and (3) the effect of inhibitory tagging was limited to the shortest stimulus onset asynchrony value, replicating previous findings. These results agree with the idea that inhibitory tagging, occurring in IOR, affects the efficiency with which color words compete for responses in Stroop-like situations.     

Linguistic and Perceptual Mapping in Spatial Representations: An Attentional Account

Building on evidence for embodied representations, we investigated whether Spanish spatial terms map onto the NEAR/FAR perceptual division of space. Using a long horizontal display, we measured congruency effects during the processing of spatial terms presented in NEAR or FAR space. Across three experiments, we manipulated the task demands in order to investigate the role of endogenous attention in linguistic and perceptual space mapping. We predicted congruency effects only when spatial properties were relevant for the task (reaching estimation task, Experiment 1) but not when attention was allocated to other features (lexical decision, Experiment 2; and color, Experiment 3). Results showed faster responses for words presented in Near‐space in all experiments. Consistent with our hypothesis, congruency effects were observed only when a reaching estimate was requested. Our results add important evidence for the role of top‐down processing in congruency effects from embodied representations of spatial terms.     

Modes of spatial coding in the Simon task*

Many models of the Simon effect assume that categorical spatial representations underlie the phenomenon. The present study tested this assumption explicitly in two experiments, both of which involved eight possible spatial positions of imperative stimuli arranged horizontally on the screen. In Experiment 1, the eight stimulus locations were marked with eight square boxes that appeared at the same time during a trial. Results showed gradually increasing Simon effects from the central locations to the outer locations. In Experiment 2, the eight stimulus locations consisted of a combination of three frames of spatial reference (hemispace, hemifield, and position relative to the fixation), with each frame appearing in different timings. In contrast to Experiment 1, results showed an oscillating pattern of the Simon effect across the horizontal positions. These findings are discussed in terms of grouping factors involved in the Simon task. The locations seem to be coded as a single continuous dimension when all are visible at once as in Experiment 1, but they are represented as a combination of the lateral categories (“left” vs. “right”) with multiple frames of reference when the reference frames are presented successively as in Experiment 2.     

The role of crossmodal competition and dimensional overlap in crossmodal attention switching

Crossmodal selective attention was investigated in a cued task switching paradigm using bimodal visual and auditory stimulation. A cue indicated the imperative modality. Three levels of spatial S–R associations were established following perceptual (location), structural (numerical), and conceptual (verbal) set-level compatibility. In Experiment 1, participants switched attention between the auditory and visual modality either with a spatial-location or spatial-numerical stimulus set. In the spatial-location set, participants performed a localization judgment on left vs. right presented stimuli, whereas the spatial-numerical set required a magnitude judgment about a visually or auditorily presented number word. Single-modality blocks with unimodal stimuli were included as a control condition. In Experiment 2, the spatial-numerical stimulus set was replaced by a spatial-verbal stimulus set using direction words (e.g., “left”). RT data showed modality switch costs, which were asymmetric across modalities in the spatial-numerical and spatial-verbal stimulus set (i.e., larger for auditory than for visual stimuli), and congruency effects, which were asymmetric primarily in the spatial-location stimulus set (i.e., larger for auditory than for visual stimuli). This pattern of effects suggests task-dependent visual dominance.     

Perceiving while acting: action affects perception

In two experiments we studied how motor responses affect stimulus encoding when stimuli and responses are functionally unrelated and merely overlap in time. Such R-S effects across S-R assignments have been reported by Schubö, Aschersleben, and Prinz (2001), who found that stimulus encoding was affected by concurrent response execution in the sense of a contrast (i.e., emphasizing differences). The present study aimed at elucidating the mechanisms underlying this effect. Experiment 1 studied the time course of the R-S effect. Contrast was only obtained for short intertrial intervals (ITIs). With long ITIs contrast turned into assimilation (i.e., emphasizing similarities). Experiment 2 excluded an interpretation of the assimilation effect in terms of motor repetition. Our findings support the notion of a shared representational domain for perception and action control, and suggest that contrast between stimulus and response codes emerges when two S-R assignments compete with each other in perception. When perceptual competition is over, assimilation emerges in memory.     

Perceptual reference points for form and orientation in young infants: anchors or magnets?

In some domains, certain stimuli are especially salient and efficiently encoded and are referred to as reference points. One current issue concerns whether reference points are associated with regions of increased or decreased discriminability and function as either perceptual anchors or magnets. In two experiments utilizing the familiarization/novelty-preference procedure, the question of whether 3- to 4-month-old infants' representations of form and orientation information are structured by perceptual reference points and whether such reference points serve as anchors or magnets is examined. In Experiment 1, infants displayed above-chance discrimination performance for pairs of form stimuli that were equivalently distinct on a physical basis, but only when one member of each pair was a "good" form (i.e., diamond, square, or triangle). In Experiment 2, infants displayed above-chance discrimination performance for pairs of stimuli differing by 7.5 degrees of orientation, but only when one member of each pair was either horizontal or vertical. The combined results from the two experiments suggest that "simple" gestalts and main axes (i.e., horizontal and vertical) serve as perceptual anchors in young infants' representations of form and orientation information.     

Priming the mental time-line: effects of modality and processing mode

The notion of a mental time-line (i.e., past corresponds to left and future corresponds to right) supports the conceptual metaphor view assuming that abstract concepts like “time” are grounded in cognitively more accessible concepts like “space.” In five experiments, we further investigated the relationship between temporal and spatial representations and examined whether or not the spatial correspondents of time are unintentionally activated. We employed a priming paradigm, in which visual or auditory prime words (i.e., temporal adverbs such as yesterday, tomorrow) preceded a colored square. In all experiments, participants discriminated the color of this square by responding with the left or the right hand. Although the temporal reference of the priming adverb was task irrelevant in Experiment 1, visually presented primes facilitated responses to the square in correspondence with the direction of the mental time-line. This priming effect was absent in Experiments 2, 3, and 5, in which the primes were presented auditorily and the temporal reference of the words could be ignored. The effect, however, emerged when attention was oriented to the temporal content of the auditory prime words in Experiment 4. The results suggest that task demands differentially modulate the activation of the mental time-line within the visual and auditory modality and support a flexible association between conceptual codes.