The premotor theory of attention and the Simon effect

In the paper by Hommel (2011-this issue), the roles of the theory of event coding (TEC) and the premotor theory of attention (PMTA) for the Simon effect were considered. PMTA was treated by Hommel in terms of the proposal that attentional orienting can be viewed as the preparation of a saccade towards a certain location, and was dismissed as providing no useful contribution for an attentional explanation of the Simon effect. Here we considered a more recent and broader conception of the PMTA, compared this approach with TEC, and confronted both approaches with a few studies focusing on the role of spatial attention for the Simon effect. It was argued that PMTA may account more easily for various studies examining the influence of spatial attention on the Simon effect. We concluded our paper by listing some elements that an overall encompassing theory on the Simon effect should contain.     

Playing the Simon game: Use of the Simon task for investigating human information processing

A little more than 40 years ago, J. R. Simon and colleagues introduced what is now called the Simon task, which yielded a correspondence effect known as the Simon effect. In this paper, I set Simon's contribution in the context of research on stimulus-response compatibility. The novel contribution of the Simon task is described, along with foundational findings using the task that Simon and colleagues reported. I acknowledge the significance of Simon's (1990) review chapter in generating my own interests in the Simon task and describe four selected lines of research from my lab that have been a result of those interests. The article concludes with a brief tribute to Simon and his contribution to experimental psychology.     

Mind-wandering: phenomenology and function as assessed with a novel experience sampling method

Mind-wandering refers to the occurrence of thoughts whose content is both decoupled from stimuli present in the current environment and unrelated to the task being carried out at the moment of their occurrence. The core of this phenomenon is therefore stimulus-independent and task-unrelated thoughts (SITUTs). In the present study, we designed a novel experience sampling method which permitted to isolate SITUTs from other kinds of distractions (i.e., irrelevant interoceptive/exteroceptive sensory perceptions and interfering thoughts related to the appraisal of the current task). In Experiment 1, we examined the impact of SITUTs on the performance of the Sustained Attention to Response Task (SART; a Go/No-Go task). Analyses demonstrated that SITUTs impair SART performance to the same extent as irrelevant sensory perceptions. In Experiment 2, we further examined SITUTs in order to assess the possible functions of mind-wandering. We observed that the content of most of reported SITUTs refers to the anticipation and planning of future events. Furthermore, this “prospective bias” was increased when participants' attention had been oriented toward their personal goals before performing the SART. These data support the view that an important function of mind-wandering relates to the anticipation and planning of the future.     

The components of visual attention and the ubiquitous Simon effect

Spatial responding is influenced by the degree of correspondence between the stimulus–response (S–R) code activated by the target's task-irrelevant location and the S–R code activated by the target's non-spatial, task-relevant feature. A generally accepted explanation of this “Simon effect,” named after its discoverer, is that there is a natural tendency to respond towards the source of stimulation. First we will review the ubiquity of the Simon effect. Then we will review the literature, including our own studies when appropriate, that has explored the relationship between the Simon effect and the components of attention: alertness, orienting and executive control, with an emphasis on visual orienting. The Simon effect is reduced when participants are not alert and when executive control is effective in filtering out the irrelevant location information. When attention is oriented endogenously, or is captured exogenously by uninformative peripheral stimulation, the Simon effect is additive with attentional facilitation (i.e., the Simon effect is the same magnitude for targets presented at attended and unattended locations). Yet, some forms of orienting, such as orienting directed by gaze and biased by inhibition of return, modulate the Simon effect. We will explore the implications of these patterns of additivity and interaction for our understanding of both the Simon effect and spatial attention.     

Visualizing the temporal dynamics of spatial information processing responsible for the Simon effect and its amplification by inhibition of return

Research has shown that the Simon effect is larger for targets suffering from inhibition of return (IOR). We used speed–accuracy trade-off (SAT) methodology to explore the temporal dynamics underlying this interaction. In Experiment 1, a new method for sorting the data was used to reveal a monotonic decay in the impact of task-irrelevant location information that is responsible for the Simon effect. In Experiment 2, we show that IOR delays both task-relevant identity and task-irrelevant location codes; a relatively longer delay for location than identity codes accounts for the effect of IOR on the Simon effect. When location information was made task-relevant in Experiment 3, IOR delayed the accumulation of this information by about the same amount as when location was irrelevant. The results suggest that IOR, therefore, has a greater effect on location than identity information.     

Individual differences in face memory and eye fixation patterns during face learning

This study examined the relationship between individual differences in face memory and eye fixation patterns during face learning. Participants watched short movies of 20 faces and were divided into high and low face memory groups based on their performance in a recognition memory test. No qualitative difference was observed in the eye fixation distribution between high and low groups. Both groups mostly fixed on the internal region of faces, especially the eyes. A difference in the eye fixation pattern by groups was observed in the number of fixations and total fixation time on the eyes, which reflected high face memory participants moving their eyes between the left and right eyes more frequently than low face memory participants. These findings suggest that fixation on the eyes has a functional role in face memory and is related to individual differences in face memory.     

Cognitive control in number processing: evidence from the unit-decade compatibility effect

In this study we evaluated whether the reverse compatibility effect observed when participants compare two-digit Spanish number words might be modulated as a function of the percentage of filler trials (within-decade comparisons). The participants performed a comparison task with two-digit Spanish number words while the unit–decade compatibility in between decade comparison trials was manipulated. We biased the relevance of units by increasing the intra/inter decade comparison ratio (20%, 50%, and 70%). The compatibility effect shifted from reverse to regular depending on the unit relevance which indicates that the relative emphasis on the unit processing in two-digit number word can be modulated by the stimulus list. These results are discussed in terms of cognitive control in number processing.     

Efficiency and interactions of alerting,orienting and executive networks: The impact of imperative stimulus type

The Attention Network Test (ANT) generates measures of three attention networks: alerting, orienting and executive control. Arrows have been generally used as imperative stimuli in the different versions of this paradigm. However, it is unknown whether the directional nature of these stimuli can modulate the efficiency of the executive control and its interaction with alerting and orienting. We developed three ANT variants to examine attentional effects in response to directional and non-directional stimuli. Arrows (ANTI-A), colored fruits (ANTI-F) and black geometrical-shape (ANTI-G) were used as imperative stimuli (i.e., flanker stimuli). Data collected from fifty-two university students, in two experiments, showed that arrows stimuli produced a greater interference effect and a greater orienting effect as compared to the other stimuli. Moreover, only arrows modulated the interaction between executive control and orienting: a reduced flanker effect in spatially cued trials was only observed in ANTI-A. These results suggest that the directional value of the stimuli increases the conflict and modulates the efficiency of executive control and its interaction with orienting network.     

Unintentional and intentional learning of noncorresponding stimulus-response associations in the Simon task

The Simon effect is a robust phenomenon that persists after extensive practice. However, several studies using a transfer paradigm have shown that the Simon effect is eliminated after practicing a location-relevant task with an incompatible spatial mapping. The present study examined whether this transfer effect is a result of implicit, procedural knowledge developed through repeated execution of noncorresponding responses in the practice session or a consequence of explicitly learning and reinstating a noncorresponding mapping rule. Results from two experiments show that, although a small part of the transfer effect may be due to residual activation of noncorresponding S-R associations from the prior task, the larger and more stable part is likely due to response-selection strategies performed intentionally in the practice task.     

The Simon effect in cognitive electrophysiology: A short review

In the Simon task, stimuli are presented laterally and typically a non-spatial stimulus dimension demands a lateralized choice response. Responses are faster when the task-irrelevant stimulus location and the response location correspond than when they do not correspond. The present paper explores the impact of the Simon task on cognitive electrophysiological research as well as the insights gained from event-related brain potentials (ERPs) in the attempt to uncover the hidden mechanisms underlying the Simon effect.     

Attention on our mind: The role of spatial attention in visual working memory

The current study shows that spatial visual attention is used to retrieve information from visual working memory. Participants had to keep four colored circles in visual working memory. While keeping this information in memory we asked whether one of the colors was present in the array. While retrieving this information, on some trials a probe dot was presented. When this probe dot was presented at the location of the color that had to be retrieved, participants responded faster than when it was presented at another location. Our findings further elaborate the role of visual attention in working memory: not only is attention the mechanism by which information is stored into working memory, it is also the mechanism by which information is retrieved from visual working memory.     

Similarity and categorization: from vision to touch

Even though human perceptual development relies on combining multiple modalities, most categorization studies so far have focused on the visual modality. To better understand the mechanisms underlying multisensory categorization, we analyzed visual and haptic perceptual spaces and compared them with human categorization behavior. As stimuli we used a three-dimensional object space of complex, parametrically-defined objects. First, we gathered similarity ratings for all objects and analyzed the perceptual spaces of both modalities using multidimensional scaling analysis. Next, we performed three different categorization tasks which are representative of every-day learning scenarios: in a fully unconstrained task, objects were freely categorized, in a semi-constrained task, exactly three groups had to be created, whereas in a constrained task, participants received three prototype objects and had to assign all other objects accordingly. We found that the haptic modality was on par with the visual modality both in recovering the topology of the physical space and in solving the categorization tasks. We also found that within-category similarity was consistently higher than across-category similarity for all categorization tasks and thus show how perceptual spaces based on similarity can explain visual and haptic object categorization. Our results suggest that both modalities employ similar processes in forming categories of complex objects.     

Using the visual world paradigm to study language processing: a review and critical evaluation

We describe the key features of the visual world paradigm and review the main research areas where it has been used. In our discussion we highlight that the paradigm provides information about the way language users integrate linguistic information with information derived from the visual environment. Therefore the paradigm is well suited to study one of the key issues of current cognitive psychology, namely the interplay between linguistic and visual information processing. However, conclusions about linguistic processing (e.g., about activation, competition, and timing of access of linguistic representations) in the absence of relevant visual information must be drawn with caution.     

The role of color information on object recognition: a review and meta-analysis

In this study, we systematically review the scientific literature on the effect of color on object recognition. Thirty-five independent experiments, comprising 1535 participants, were included in a meta-analysis. We found a moderate effect of color on object recognition (d = 0.28). Specific effects of moderator variables were analyzed and we found that color diagnosticity is the factor with the greatest moderator effect on the influence of color in object recognition; studies using color diagnostic objects showed a significant color effect (d = 0.43), whereas a marginal color effect was found in studies that used non-color diagnostic objects (d = 0.18). The present study did not permit the drawing of specific conclusions about the moderator effect of the object recognition task; while the meta-analytic review showed that color information improves object recognition mainly in studies using naming tasks (d = 0.36), the literature review revealed a large body of evidence showing positive effects of color information on object recognition in studies using a large variety of visual recognition tasks. We also found that color is important for the ability to recognize artifacts and natural objects, to recognize objects presented as types (line-drawings) or as tokens (photographs), and to recognize objects that are presented without surface details, such as texture or shadow. Taken together, the results of the meta-analysis strongly support the contention that color plays a role in object recognition. This suggests that the role of color should be taken into account in models of visual object recognition.     

Volume completion in 4.5-month-old infants

In this study, we examined 4.5-month-old infants' visual completion of self-occluding three-dimensional objects. A previous study on this topic reported that 6-month-old, but not 4-month-old infants extrapolate a convex, symmetric prism from a limited view of its surfaces (Soska & Johnson, 2008). As of yet, studies on the development of amodal completion of three-dimensional, self-occluding objects are scarce. Given 4-month-old infants' abilities to derive three-dimensional shape from a variety of visual cues, three-dimensional amodal completion may well depend on the perceptual strength of three-dimensionality in the stimulus displays. The first experiments (1A and 1B) tested this hypothesis by means of a habituation paradigm and showed that 4.5-month-old infants are indeed able to amodally complete the back of a self-occluding object when sufficient three-dimensional cues are available. Further support for volume completion in 4.5-month-old infants was found in a second experiment, again using a habituation paradigm, that measured perceived connectedness between two visually separated, self-occluding, three-dimensional objects.     

Effects of luminance change in preview search: Offsets and onsets can be concurrently prioritized but not in isolation

Two experiments are performed to investigate how luminance change contributes to prioritized selection of new over old elements. Experiment 1 demonstrates that observers prioritize items that undergo a luminance change irrespective of the direction of that change. Experiment 2 shows that foreknowledge concerning the direction of luminance change signaling the target does not allow observers to prioritize the selection of luminance onsets over offsets and vice versa. The results suggest that prioritized selection of new over old elements is mediated by a general mechanism that is sensitive to luminance change, irrespective of its direction.     

Attention and spatial stimulus coding in the Simon task: a rejoinder to van der Lubbe and Abrahamse (2010)

Hommel (2011-this issue) has reviewed the major lines of research and ongoing controversies on and around the Simon effect. Van der Lubbe and Abrahamse (2010) take issue with Hommel's assessment of the role of attention shifting in the Simon effect. This rejoinder argues that van der Lubbe and Abrahamse's criticism is off target because it (a) fails to distinguish between the attention-shifting account of (spatial stimulus coding in) the Simon effect—which Hommel discusses and criticizes—and the premotor theory of attention—which Hommel does not discuss; (b) confuses the relationship between the attention-shifting account and the referential-coding account of spatial stimulus coding in the Simon effect—the actual topic of Hommel's discussion—with the relationship between the premotor theory and the theory of event coding—which the criticism focuses on; and (c) confuses the uncontroversial role of attention in stimulus selection with the controversial role of attention in the generation of location codes.     

Orthographic neighborhood size effect in Chinese character naming: orthographic and phonological activations

The present study examined the effects of orthographic neighborhood (N) size on the cognitive processes underlying Chinese character reading. Previous research has shown increasing N size facilitates word naming and recognition performance in alphabetic languages. Experiment 1 revealed that a large N size was associated with a general inhibition of processes underlying character reading, in contrast to previous findings with alphabetic languages. This inhibitory effect was influenced by regularity and consistency. Experiment 2 sought to assess the effects of higher-frequency neighbors on character naming performance. The results revealed that higher-frequency neighbors with different pronunciation to the target interfered with the phonological retrieval of targets. We propose that this type of interference may have caused the N size effect observed in Experiment 1. The results of Experiment 3 revealed that a large N size facilitated target naming in the absence of higher-frequency neighbors. The current results shed light on the processes underlying character naming, and we propose possible cognitive mechanisms of the N size effect on Chinese character naming.     

Now you see it, now you don't: controlling for contingencies and stimulus repetitions eliminates the Gratton effect

The Gratton (or sequential congruency) effect is the finding that conflict effects (e.g., Stroop and Eriksen flanker effects) are larger following congruent trials relative to incongruent trials. The standard account given for this is that a cognitive control mechanism detects conflict when it occurs and adapts to this conflict on the following trial. Others, however, have questioned the conflict adaptation account and suggested that sequential biases might account for the Gratton effect. In two experiments, contingency biases were removed from the task and stimulus repetitions were deleted to control for stimulus bindings. This eliminated the Gratton effect in the response times in both experiments, supporting a non-conflict explanation of the Gratton effect. A Gratton effect did persist in the errors of Experiment 1; however, this effect was not produced by the type of errors (word reading errors) that a conflict adaptation account should predict. Instead, tentative support was found for a congruency switch cost hypothesis. In all, the conflict adaptation account failed to account for any of the reported data. Implications for future work on cognitive control are discussed.