Traditional response interference effects from anticipated action outcomes: a response-effect compatibility paradigm

An act as simple as pressing a button involves various stages of processing. Each stage of action production is susceptible to interference from competing representations/processes. For example, in the Simon Effect, interference arises from an incongruence between incidental spatial information and the spatial properties of intended action; in the flanker task, interference arises when visual targets and distracters are associated with different responses (response interference [RI]). Less interference arises in the flanker task when targets and distracters are different in appearance but associated with the same response (perceptual interference [PI]). Interference also stems from the automatic activation of representations associated with the anticipated effects of an action, response-effect (R–E) compatibility (e.g., the presence of a left-pointing arrow after one presses a button on the right will increase interference in future trials). This has been explained by ideomotor theory—that the mental representation of anticipated action-effects are activated automatically by voluntary action and that such representations can cause facilitation or interference by automatically priming their associated action plans. To illuminate the nature of action production and provide additional support for ideomotor theory, we examined for the first time the effects of PI and RI in a new R–E compatibility paradigm.     

Differential dynamics of spatial and non-spatial stimulus-response compatibility effects: a dual task LRP study

Choice reaction times are shorter when stimulus and response features are compatible rather than incompatible. Recent studies revealed that spatial compatibility effects in Simon tasks are strongly attenuated when there is temporal overlap with a different high-priority task. In contrast, non-spatial variants of the Simon task appear to be unaffected by task overlap. The present study used the lateralized readiness potential (LRP) within a dual task design to elucidate the dynamics underlying these differential effects for a color and a spatial variant of the Simon task. In the color version there was no sign of early response priming by irrelevant stimulus features in the LRP. The color compatibility effect was independent of task overlap and reflected in the LRP onset latency. In contrast, in the spatial version, priming by irrelevant stimulus location showed up and was mirrored by early LRP activation. Response priming and the corresponding Simon effect, however, were present only in case of little temporal overlap with the primary task. The absence of spatial compatibility effects at strong temporal overlap suggests that response conflicts due to stimulus-related priming depend on the availability of processing resources.     

Sex differences in unfamiliar face identification: evidence from matching tasks

Research on sex differences in face recognition has reported mixed results, on balance suggesting an advantage for female observers. However, it is not clear whether this advantage is specific to face processing or reflects a more general superiority effect in episodic memory. The current study therefore examined sex differences with a face-matching task that eliminates memory demands. Across two experiments, female but not male observers showed an own-sex advantage on match trials, in which two pictures have to be identified as the same person. This advantage was present for whole faces and when only the internal or external facial features were shown. Female observers were also more accurate in these three conditions on mismatch encounters, in which two photographs have to be identified as different people, but this reflects a more general effect that is present for male and female faces. These findings converge with claims of a female advantage in face recognition and demonstrate that this effect persists when memory demands are eliminated.     

Perceptual and motor contributions to the negative compatibility effect

The current study focused on contributions to the negative compatibility effect (NCE) from object-updating at the perceptual level and self-inhibition (i.e., automatic motor inhibition) at the response (motor) level. We hypothesized that contributions to the NCE from these two levels were moderated by the strength of stimulus and reaction (S–R) link: object-updating should have greater impact on the NCE with weak S–R links, but both object-updating and self-inhibition should impact on the NCE when the S–R links became strong. To test this hypothesis, in two experiments we used a novel type of stimuli and manipulated mask relevance (relevant versus irrelevant mask) and prime/target compatibility. Participants performed two tasks over three successive days. Results showed that under equivalent masking effectiveness between the two conditions of mask, a significant NCE was observed only in the relevant mask condition when the S–R links were weak, but both close to equal NCE sizes were observed in the two mask conditions when the S–R links were acquired through practice. The results indicated that perceptual and motor contributions to the NCE were moderated by the strength of S–R links, if the strength of the links was too weak to trigger the following inhibition, the NCE primarily originated from object-updating at the perceptual level; if the strength of the links was reinforced by practice, which exceeded the inhibitory threshold, the NCE originated from both object-updating and self-inhibition, but the latter was primarily responsible.     

Costs and benefits of tool-use on the perception of reachable space

Previous studies have shown that using a tool modifies in a short time-scale both near-body space perception and arm-length representation in the body schema. However, to date no research has specifically investigated the effect of tool-use on an action-related perceptual task. We report here a study assessing the effect of tool-use on the perception of reachable space for perceptual estimates made in reference to either the tool or the hand. Using the tool on distal objects resulted in an extension of perceived reachable space with the tool and reduced the variability of reachability estimates. Tool use also extended perceived reachable space with the hand, but with a concomitant increase of the variability of reachability estimates. These findings suggest that tool incorporation into the represented arm following tool-use improves the anticipation of action possibilities with the tool, while hand representation becomes less accurate.     

Influence of head orientation on visually and memory-guided arm movements

In the absence of visual supervision, tilting the head sideways gives rise to deviations in spatially defined arm movements. The purpose of this study was to determine whether these deviations are restricted to situations with impoverished visual information. Two experiments were conducted in which participants were positioned supine and reproduced with their unseen index finger a 2 dimensional figure either under visual supervision or from memory (eyes closed). In the former condition, the figure remained visible (using a mirror). In the latter condition, the figure was first observed and then reproduced from memory. Participants' head was either aligned with the trunk or tilted 30° towards the left or right shoulder. In experiment 1, participants observed first the figure with the head straight and then reproduced it with the head either aligned or tilted sideways. In Experiment 2, participants observed the figure with the head in the position in which the figure was later reproduced. Results of Experiment 1 and 2 showed deviations of the motor reproduction in the direction opposite to the head in both the memory and visually-guided conditions. However, the deviations decreased significantly under visual supervision when the head was tilted left. In Experiment 1, the perceptual visual bias induced by head tilt was evaluated. Participants were required to align the figure parallel to their median trunk axis. Results revealed that the figure was perceived as parallel with the trunk when it was actually tilted in the direction of the head. Perceptual and motor responses did not correlate. Therefore, as long as visual feedback of the arm is prevented, an internal bias, likely originating from head/trunk representation, alters hand-motor production irrespectively of whether visual feedback of the figure is available or not.     

Integration of disparity and velocity information for haptic and perceptual judgments of object depth

Do reach-to-grasp (prehension) movements require a metric representation of three-dimensional (3D) layouts and objects? We propose a model relying only on direct sensory information to account for the planning and execution of prehension movements in the absence of haptic feedback and when the hand is not visible. In the present investigation, we isolate relative motion and binocular disparity information from other depth cues and we study their efficacy for reach-to-grasp movements and visual judgments. We show that (i) the amplitude of the grasp increases when relative motion is added to binocular disparity information, even if depth from disparity information is already veridical, and (ii) similar distortions of derived depth are found for haptic tasks and perceptual judgments. With a quantitative test, we demonstrate that our results are consistent with the Intrinsic Constraint model and do not require 3D metric inferences (Domini, Caudek, & Tassinari, 2006). By contrast, the linear cue integration model (Landy, Maloney, Johnston, & Young, 1995) cannot explain the present results, even if the flatness cues are taken into account.     

The whole is indeed more than the sum of its parts: perceptual averaging in the absence of individual item representation

We tested Ariely's (2001) proposal that the visual system represents the overall statistical properties of sets of objects against alternative accounts of rapid averaging involving sub-sampling strategies. In four experiments, observers could rapidly extract the mean size of a set of circles presented in an RSVP sequence, but could not reliably identify individual members. Experiment 1 contrasted performance on a member identification task with performance on a mean judgment task, and showed that the tasks could be dissociated based on whether the test probe was presented before or after the sequence, suggesting that member identification and mean judgment are subserved by different mechanisms. In Experiment 2, we confirmed that when given a choice between a probe corresponding to the mean size of the set and a foil corresponding to the mean of the smallest and largest items only, the former is preferred to the latter, even when observers are explicitly instructed to average only the smallest and largest items. Experiment 3 showed that a test item corresponding to the mean size of the set could be reliably discriminated from a foil but the largest item in the set, differing by an equivalent amount, could not. In Experiment 4, observers rejected test items dissimilar to the mean size of the set in a member identification task, favoring test items that corresponded to the mean of the set over items that were actually shown. These findings suggest that mean representation is accomplished without explicitly encoding individual items.     

Visualizing the temporal dynamics of spatial information processing responsible for the Simon effect and its amplification by inhibition of return

Research has shown that the Simon effect is larger for targets suffering from inhibition of return (IOR). We used speed–accuracy trade-off (SAT) methodology to explore the temporal dynamics underlying this interaction. In Experiment 1, a new method for sorting the data was used to reveal a monotonic decay in the impact of task-irrelevant location information that is responsible for the Simon effect. In Experiment 2, we show that IOR delays both task-relevant identity and task-irrelevant location codes; a relatively longer delay for location than identity codes accounts for the effect of IOR on the Simon effect. When location information was made task-relevant in Experiment 3, IOR delayed the accumulation of this information by about the same amount as when location was irrelevant. The results suggest that IOR, therefore, has a greater effect on location than identity information.     

Temporal-range estimation of multiple objects: evidence for an early bottleneck

When making parallel time-to-contact (TTC) estimates of two approaching objects, the two respective TTC estimates interfere with one another in an asymmetric fashion. The TTC of the later-arriving object is systematically overestimated, while the estimated TTC for the first-arriving object is as accurate as in a condition presenting only a single object. This asymmetric interference points to a processing bottleneck that could be due to early (e.g., during the estimation of the TTC from the optic flow) or late (e.g., during the timing of the response or the motor execution) constraints in the TTC estimation process. We used a Sperling-like prediction-motion task to differentiate between these two possibilities. Participants produced an absolute estimate of the TTC of only one of two objects approaching a target line. The target object to which the response was to be made was indicated by an auditory cue that occurred either at motion-onset or at the instant at which the two objects disappeared from the screen (occlusion-onset). The cue at motion-onset should disengage visual processing of the irrelevant stimulus. The cue at occlusion-onset, in contrast, requires visual processing of both relevant and irrelevant stimulus until occlusion. A single-object condition was introduced as a control condition. Results show symmetric interference in the motion-onset condition. In the occlusion-onset condition however, the results were congruent with asymmetric interference. Thus, the processing bottleneck in TTC estimation is originating at the earlier stages.     

Evidence for a response preparation bottleneck during dual-task performance: Effect of a startling acoustic stimulus on the psychological refractory period

The present study was designed to investigate the mechanism associated with dual-task interference in a psychological refractory period (PRP) paradigm. We used a simple reaction time paradigm consisting of a vocal response (R1) and key-lift task (R2) with a stimulus onset asynchrony (SOA) between 100 ms and 1500 ms. On selected trials we implemented a startling acoustic stimulus concurrent with the second stimulus to determine if we could involuntarily trigger the second response. Our results indicated that the PRP delay in the second response was present for both control and startle trials at short SOAs, suggesting the second response was not prepared in advance. These results support a response preparation bottleneck and can be explained via a neural activation model of preparation. In addition, we found that the reflexive startle activation was reduced in the dual-task condition for all SOAs, a result we attribute to prepulse inhibition associated with dual-task processing.     

How verbs can activate things: cross-language activation across word classes

The present study explored whether language-nonselective access in bilinguals occurs across word classes in a sentence context. Dutch–English bilinguals were auditorily presented with English (L2) sentences while looking at a visual world. The sentences contained interlingual homophones from distinct lexical categories (e.g., the English verb spoke, which overlaps phonologically with the Dutch noun for ghost, spook). Eye movement recordings showed that depictions of referents of the Dutch (L1) nouns attracted more visual attention than unrelated distractor pictures in sentences containing homophones. This finding shows that native language objects are activated during second language verb processing despite the structural information provided by the sentence context.     

The components of visual attention and the ubiquitous Simon effect

Spatial responding is influenced by the degree of correspondence between the stimulus–response (S–R) code activated by the target's task-irrelevant location and the S–R code activated by the target's non-spatial, task-relevant feature. A generally accepted explanation of this “Simon effect,” named after its discoverer, is that there is a natural tendency to respond towards the source of stimulation. First we will review the ubiquity of the Simon effect. Then we will review the literature, including our own studies when appropriate, that has explored the relationship between the Simon effect and the components of attention: alertness, orienting and executive control, with an emphasis on visual orienting. The Simon effect is reduced when participants are not alert and when executive control is effective in filtering out the irrelevant location information. When attention is oriented endogenously, or is captured exogenously by uninformative peripheral stimulation, the Simon effect is additive with attentional facilitation (i.e., the Simon effect is the same magnitude for targets presented at attended and unattended locations). Yet, some forms of orienting, such as orienting directed by gaze and biased by inhibition of return, modulate the Simon effect. We will explore the implications of these patterns of additivity and interaction for our understanding of both the Simon effect and spatial attention.     

Exploring cross-task compatibility in perceiving and producing facial expressions using electromyography

Using a dual-task methodology we examined the interaction of perceiving and producing facial expressions. In one task, participants were asked to produce a smile or a frown (Task 2) in response to a tone stimulus. This auditory-facial task was embedded in a dual-task context, where the other task (Task 1) required a manual response to visual face stimuli (visual-manual task). These face stimuli showed facial expressions that were either compatible or incompatible to the to-be-produced facial expression. Both reaction times and error rates (measured by facial electromyography) revealed a robust stimulus–response compatibility effect across tasks, suggesting that perceived social actions automatically activate corresponding actions even if perceived and produced actions belong to different tasks. The dual-task nature of this compatibility effect further testifies that encoding of facial expressions is highly automatic.     

How do visual and postural cues combine for self-tilt perception during slow pitch rotations?

Self-orientation perception relies on the integration of multiple sensory inputs which convey spatially-related visual and postural cues. In the present study, an experimental set-up was used to tilt the body and/or the visual scene to investigate how these postural and visual cues are integrated for self-tilt perception (the subjective sensation of being tilted). Participants were required to repeatedly rate a confidence level for self-tilt perception during slow (0.05°·s^− 1) body and/or visual scene pitch tilts up to 19° relative to vertical. Concurrently, subjects also had to perform arm reaching movements toward a body-fixed target at certain specific angles of tilt. While performance of a concurrent motor task did not influence the main perceptual task, self-tilt detection did vary according to the visuo-postural stimuli. Slow forward or backward tilts of the visual scene alone did not induce a marked sensation of self-tilt contrary to actual body tilt. However, combined body and visual scene tilt influenced self-tilt perception more strongly, although this effect was dependent on the direction of visual scene tilt: only a forward visual scene tilt combined with a forward body tilt facilitated self-tilt detection. In such a case, visual scene tilt did not seem to induce vection but rather may have produced a deviation of the perceived orientation of the longitudinal body axis in the forward direction, which may have lowered the self-tilt detection threshold during actual forward body tilt.     

Parallel averaging of size is possible but range-limited: A reply to Marchant,Simons, and De Fockert

In their recent paper, Marchant, Simons, and De Fockert (2013) claimed that the ability to average between multiple items of different sizes is limited by small samples of arbitrarily attended members of a set. This claim is based on a finding that observers are good at representing the average when an ensemble includes only two sizes distributed among all items (regular sets), but their performance gets worse when the number of sizes increases with the number of items (irregular sets). We argue that an important factor not considered by Marchant et al. (2013) is the range of size variation that was much bigger in their irregular sets. We manipulated this factor across our experiments and found almost the same efficiency of averaging for both regular and irregular sets when the range was stabilized. Moreover, highly regular sets consisting only of small and large items (two-peaks distributions) were averaged with greater error than sets with small, large, and intermediate items, suggesting a segmentation threshold determining whether all variable items are perceived as a single ensemble or distinct subsets. Our results demonstrate that averaging can actually be parallel but the visual system has some difficulties with it when some items differ too much from others.     

When two actions are easier than one: How inhibitory control demands affect response processing

Numerous studies showed that the simultaneous execution of multiple actions is associated with performance costs. Here, we demonstrate that when highly automatic responses are involved, performance in single-response conditions can actually be worse than in dual-response conditions. Participants responded to peripheral visual stimuli with an eye movement (saccade), a manual key press, or both. To manipulate saccade automaticity, a central fixation cross either remained present throughout the trial (overlap condition, lower automaticity) or disappeared 200 ms before visual target onset (gap condition, greater automaticity). Crucially, single-response conditions yielded more performance errors than dual-response conditions (i.e., dual-response benefit), especially in gap trials. This was due to difficulties associated with inhibiting saccades when only manual responses were required, suggesting that response inhibition (remaining fixated) can be even more resource-demanding than overt response execution (saccade to peripheral target).     

Simultaneous attentional guidance by working-memory and selection history reveals two distinct sources of attention

Recent theories of attention have proposed that selection history is a separate, dissociable source of information that influences attention. The current study sought to investigate the simultaneous involvement of selection history and working-memory on attention during visual search. Experiments 1 and 2 used target feature probability to manipulate selection history and found significant effects of both working-memory and selection history, although working-memory dominated selection history when they cued different locations. Experiment 3 eliminated the contribution of voluntary refreshing of working-memory and replicated the main effects, although selection history became dominant. Using the same methodology, but with reduced probability cue validity, both effects were present in Experiment 4 and did not significantly differ in their contribution to attention. Effects of selection history and working-memory never interacted. These results suggest that selection history and working-memory are separate influences on attention and have little impact on each other. Theoretical implications for models of attention are discussed.     

The influence of motor simulations on language comprehension

This study investigates the influence of activating specific motor codes on the comprehension of passages that describe the use of an object requiring similar motor manipulations. In three experiments, participants either imagined or pantomimed performing an action involving a common object. Participants then held the action in memory while reading a brief story, which described another object that required similar or different motor behaviors. Reading times were collected on the complementary actions. Finally, participants acted out the original action. In Exp. 1 and 2, reading slowed to the verbs. Exp. 2 revealed the slowing to be true interference, which disappeared in Exp. 3 when the action did not need to be recalled. The results suggest that readers activate motor codes when reading story actions, which supports an embodied view. The results also indicate that activated codes bound to an action will, at least briefly, impair reading about a complementary action requiring the same codes, consistent with Hommel's (2009) theory of event coding.     

Grasping of extrafoveal targets: A robotic model

We present a computational model of grasping of non-fixated (extrafoveal) target objects which is implemented on a robot setup, consisting of a robot arm with cameras and gripper. This model is based on the premotor theory of attention (Rizzolatti et al., 1994) which states that spatial attention is a consequence of the preparation of goal-directed, spatially coded movements (especially saccadic eye movements). In our model, we add the hypothesis that saccade planning is accompanied by the prediction of the retinal images after the saccade. The foveal region of these predicted images can be used to determine the orientation and shape of objects at the target location of the attention shift. This information is necessary for precise grasping. Our model consists of a saccade controller for target fixation, a visual forward model for the prediction of retinal images, and an arm controller which generates arm postures for grasping. We compare the precision of the robotic model in different task conditions, among them grasping (1) towards fixated target objects using the actual retinal images, (2) towards non-fixated target objects using visual prediction, and (3) towards non-fixated target objects without visual prediction. The first and second setting result in good grasping performance, while the third setting causes considerable errors of the gripper orientation, demonstrating that visual prediction might be an important component of eye–hand coordination. Finally, based on the present study we argue that the use of robots is a valuable research methodology within psychology.