Frequency effects in spoken and visual word recognition: evidence from dual-task methodologies

The authors report 3 dual-task experiments concerning the locus of frequency effects in word recognition. In all experiments, Task 1 entailed a simple perceptual choice and Task 2 involved lexical decision. In Experiment 1, an underadditive effect of word frequency arose for spoken words. Experiment 2 also showed underadditivity for visual lexical decision. It was concluded that word frequency exerts an influence prior to any dual-task bottleneck. A related finding in similar dual-task experiments is Task 2 response postponement at short stimulus onset asynchronies. This was explored in Experiment 3, and it was shown that response postponement was equivalent for both spoken and visual word recognition. These results imply that frequency-sensitive processes operate early and automatically.     

Cross-modal attentional deficits in processing tactile stimulation

In order to substantiate recent theorization on the possible links between the causes of the attentional blink and the psychological refractory period phenomena (e.g., Jolicoeur, 1999a), four experiments are reported in which two target stimuli, T1 and T2, were presented in different modalities at varying stimulus onset asynchronies (SOAs), with each stimulus being associated with a distinct task, Task1 and Task2. In Experiment 1, T1 was a tone, and Task1 was a speeded vocal response based on pitch. T2 was a brief press applied to either of two distal fingerpads, and Task2 was a speeded manual response based on tactile stimulus location. In Experiment 2, the same T1 as that used in Experiment 1 was presented, and in Task1 the subject either made a speeded vocal response based on pitch or ignored T1. T2 was a masked tactile stimulation, and Task2 was an unspeeded manual discrimination of the tactile stimulation location. This Task2 was maintained in Experiments 3 and 4. The auditory T1 was replaced with a white digit embedded in a rapid serial visualization presentation of a stream of black letters, and in Task1 the subject either made an unspeeded decision based on T1 identity or ignored T1. In all the experiments, the results showed an SOA-locked impairment in Task2. As SOA was decreased, reaction times in the speeded Task2 of Experiment 1 increased, and accuracy in the unspeeded Task2 of Experiments 2-4 decreased. The SOA-locked impairment was almost eliminated when T1 could be ignored or was absent. The results are discussed in terms of central processing limitations as the cause of such effects.     

Multiple spatial correspondence effects on dual-task performance

Three dual-task experiments were conducted to examine whether the underadditive interaction of the Simon effect and stimulus onset asynchrony (SOA) on Task 2 performance is due to decay. The experiments tested whether the reverse Simon effect obtained with an incompatible stimulus-response (S-R) mapping would show an overadditive interaction with SOA, as predicted by R. De Jong, C.-C. Liang, and E. Lauber's (1994) dual-process model. Tone or letter identification tasks with vocal or keypress responses were used as Task 1. Task 2 was keypresses to arrow direction (or letter identity in Experiment 1). For all experiments, the normal Simon effect showed an underadditive interaction with SOA, but the reverse Simon effect did not show an overadditive interaction. The results imply that the dual-process model is not applicable to the dual-task context. Multiple correspondence effects across tasks implicate an explanation in terms of automatic S-R translation.     

Concurrent deployment of visual attention and response selection bottleneck in a dual-task: Electrophysiological and behavioural evidence

Visual attention and response selection are limited in capacity. Here, we investigated whether visual attention requires the same bottleneck mechanism as response selection in a dual-task of the psychological refractory period (PRP) paradigm. The dual-task consisted of an auditory two-choice discrimination Task 1 and a conjunction search Task 2, which were presented at variable temporal intervals (stimulus onset asynchrony, SOA). In conjunction search, visual attention is required to select items and to bind their features resulting in a serial search process around the items in the search display (i.e., set size). We measured the reaction time of the visual search task (RT2) and the N2pc, an event-related potential (ERP), which reflects lateralized visual attention processes. If the response selection processes in Task 1 influence the visual attention processes in Task 2, N2pc latency and amplitude would be delayed and attenuated at short SOA compared to long SOA. The results, however, showed that latency and amplitude were independent of SOA, indicating that visual attention was concurrently deployed to response selection. Moreover, the RT2 analysis revealed an underadditive interaction of SOA and set size. We concluded that visual attention does not require the same bottleneck mechanism as response selection in dual-tasks.     

Nonautomatic emotion perception in a dual-task situation

Are emotions perceived automatically? Two psychological refractory period experiments were conducted to ascertain whether emotion perception requires central attentional resources. Task 1 required an auditory discrimination (tone vs. noise), whereas Task 2 required a discrimination between happy and angry faces. The difficulty of Task 2 was manipulated by varying the degree of emotional expression. The stimulus onset asynchrony (SOA) between Task 1 and Task 2 was also varied. Experiment 1 revealed additive effects of SOA and Task 2 emotion-perception difficulty. Experiment 2 replicated the additive relationship with a stronger manipulation of emotion-perception difficulty. According to locus-of-slack logic, our participants did not process emotional expressions while central resources were devoted to Task 1. We conclude that emotion perception is not fully automatic.     

Concurrent learning of temporal and spatial sequences

In a serial reaction time task, stimulus events simultaneously defined spatial and temporal sequences. Responses were based on the spatial dimension. The temporal sequence was incidental to the task, defined by the response-to-stimulus intervals in Experiment 1 and stimulus onset asynchronies in Experiment 2. The two sequences were either of equal length and correlated or of unequal length. In both experiments, spatial learning occurred regardless of sequence length condition. In contrast, temporal learning occurred only in the correlated condition. These results suggest that timing is an integrated part of action representations and that incidental learning for a temporal pattern does not occur independently from the action. Interestingly, sequence learning was enhanced in the correlated condition, reflecting the integration of spatial-temporal information.     

Reading aloud is not automatic: processing capacity is required to generate a phonological code from print

The present experiments tested the claim that phonological recoding occurs "automatically" by assessing whether it uses central attention in the context of the psychological refractory period paradigm. Task 1 was a tone discrimination task and Task 2 was reading aloud. The joint effects of long-lag word repetition priming and stimulus onset asynchrony (SOA) were underadditive in Experiment 1, suggesting that an early component of lexical processing does not use central attention. In contrast, nonword letter length and grapheme-phoneme complexity yielded additive effects with SOA in Experiments 2, 3, and 4, suggesting that assembled phonology uses central attention. Further, orthographic neighborhood density also yielded additive effects with SOA in Experiments 5, 6, and 7, suggesting that lexical contributions to phonological recoding use central attention. Taken together, the results of these experiments are inconsistent with the widespread claim that phonological codes are assembled and/or addressed automatically. It is suggested that "automaticity" should be replaced by accounts that make more specific claims about how processing unfolds.     

On the nature of the affective priming effect: Effects of stimulus onset asynchrony and congruency proportion in naming and evaluative categorization

In line with the hypothesis that affective priming of evaluative categorization responses is based on processes that operate at a response selection stage, it has been observed that increasing the proportion of congruent trials brings about increased affective priming effects at short stimulus onset asynchronies (SOAs) in the evaluative categorization task. In the present study, we orthogonally manipulated the congruency proportion (.25, .50, and .75) and the SOA (0, 200, and 1,000 msec) in the evaluative categorization task and a naming task. Results showed that at both short and long SOAs, the affective priming effect in the evaluative categorization task was influenced by the congruency proportion. In contrast, affective priming effects in the naming task were unaffected by the congruency proportion at short SOAs. This pattern of results provides corroborating evidence for the hypotheses (1) that different processes underlie the affective priming effect in the evaluative categorization task and the naming task and (2) that valenced stimuli can automatically preactivate the memory representations of other, affectively related stimuli.     

Audio-visual simultaneity judgments

The relative spatiotemporal correspondence between sensory events affects multisensory integration across a variety of species; integration is maximal when stimuli in different sensory modalities are presented from approximately the same position at about the same time. In the present study, we investigated the influence of spatial and temporal factors on audio-visual simultaneity perception in humans. Participants made unspeeded simultaneous versus successive discrimination responses to pairs of auditory and visual stimuli presented at varying stimulus onset asynchronies from either the same or different spatial positions using either the method of constant stimuli (Experiments 1 and 2) or psychophysical staircases (Experiment 3). The participants in all three experiments were more likely to report the stimuli as being simultaneous when they originated from the same spatial position than when they came from different positions, demonstrating that the apparent perception of multisensory simultaneity is dependent on the relative spatial position from which stimuli are presented.     

Ideomotor compatibility in the psychological refractory period effect: 29 years of oversimplification

Four experiments examined whether the psychological refractory period (PRP) effect can be eliminated with ideomotor compatible (IM) but not stimulus-response compatible (SR) tasks, as reported by A. G. Greenwald and H. G. Shulman (1973). Their tasks were used: a left or right movement to a left- or right-pointing arrow (IM) or to the word left or right (SR) for Task 1; saying "A" or "B" (IM) or "1" or "2" (SR) to an auditory A or B for Task 2. The stimulus onset asynchronies were 0, 100, 200, 300, 500, and 1,000 ms in Experiment 1, and only 0, 100, 200, and 1,000 ms in Experiments 2-4. The arrow was in the center of the screen in Experiments 1-3 and to the left or right in Experiment 4. As in Greenwald and Shulman's Experiment 2, the instructions stated that most often the 2 stimuli would be presented simultaneously. A PRP effect was obtained in all conditions, most likely because response-selection decisions are required even for IM tasks.     

Location cuing and response time distributions in visual attention

The allocation of visual attention was investigated in two experiments. In Experiment 1 (n = 24), a peripheral cue was presented, and in Experiment 2 (n = 24), a central cue was used. In both experiments, cue validity was 90%, and the task was four-choice target identification. Response time distributions were collected for valid trials over five cue-target stimulus onset asynchronies (SOAs), and ex-Gaussian parameters were extracted. In both experiments, only the mean of the Gaussian component decreased as a function of cue-target SOA, which implied a strict time axis translation of the distributions. The results were consistent with sequential sampling models featuring a variable delay in the onset of information uptake.     

Viewer perspective affects central bottleneck requirements in spatial translation tasks

A psychological refractory period (PRP) approach and the locus of slack logic were applied to examine the novel question of whether spatial translation processes can begin before the central bottleneck when effector or noneffector stimuli are processed from an egocentric (viewer-centered) perspective. In single tasks, trials requiring spatial translations were considerably slower than trials without translations (Experiment 1). Dual tasks consisted of tone discriminations (Task 1) and spatial translations (Task 2) using PRP methods with different manipulations on perceptual and response demands. When a viewer-centered perspective was used, the effect of spatial translation was reduced at short compared with long stimulus onset asynchronies (SOAs) when the potential for code overlap between tasks was removed (Experiments 2, 3, and 4); this finding supports the view that translation processes can begin before the central bottleneck. When an allocentric (non-viewer-centered) perspective was used (Experiment 5), the slowing associated with spatial translation was additive with SOA, suggesting that the processes of spatial translation cannot begin before the bottleneck. These findings highlight the importance of viewer perspective on central bottleneck requirements. Findings are further discussed in relation to the dorsal-ventral model of action and perception.     

Bimanual response grouping in dual-task paradigms

In three experiments we measured response time (RT) and peak force (PF) to investigate the grouping of left- and right-hand key press responses in a dual-task paradigm involving two independent go/no-go tasks. Within each task, a go stimulus within one of two modalities (i.e., visual versus auditory) required a response by one hand. In Experiment 1 with simultaneous go stimuli in the two tasks, responses appeared to be grouped in approximately 75-80% of trials, compared with nearly 100% grouping in a single-task condition requiring bimanual responses to the onset of any stimulus in either modality. In Experiment 2 with stimulus onset asynchronies (SOAs) of 0-400 ms between the two go stimuli, response grouping clearly declined as SOA increased, although some grouping was still evident even at the longest SOA. The same pattern was observed in Experiment 3 with the same range of SOAs but unpredictable stimulus order, suggesting that grouping is not strongly dependent on prior knowledge of the likely response order. These results emphasize the pervasiveness of response grouping in bimanual dual-task RT paradigms and provide useful clues as to its nature.     

Task switching and response correspondence in the psychological refractory period paradigm

Three experiments examined the effects of task switching and response correspondence in a psychological refractory period paradigm. A letter task (vowel-consonant) and a digit task (odd-even) were combined to form 4 possible dual-task pairs in each trial: letter-letter, letter-digit, digit-digit, and digit-letter. Foreknowledge of task transition (repeat or switch) and task identity (letter or digit) was varied across experiments: no foreknowledge in Experiment 1, partial foreknowledge (task transition only) in Experiment 2, and full foreknowledge in Experiment 3. For all experiments, the switch cost for Task 2 was additive with stimulus onset asynchrony, and the response-correspondence effect for Task 2 was numerically smaller in the switch condition than in the repeat condition. These outcomes suggest that reconfiguration for Task 2 takes place after the central processing of Task 1 and that the crosstalk correspondence effect is due to response activation by way of stimulus-response associations.     

Bimanual response grouping in dual-task paradigms

In three experiments we measured response time (RT) and peak force (PF) to investigate the grouping of left- and right-hand key press responses in a dual-task paradigm involving two independent go/no-go tasks. Within each task, a go stimulus within one of two modalities (i.e., visual versus auditory) required a response by one hand. In Experiment 1 with simultaneous go stimuli in the two tasks, responses appeared to be grouped in approximately 75–80% of trials, compared with nearly 100% grouping in a single-task condition requiring bimanual responses to the onset of any stimulus in either modality. In Experiment 2 with stimulus onset asynchronies (SOAs) of 0–400 ms between the two go stimuli, response grouping clearly declined as SOA increased, although some grouping was still evident even at the longest SOA. The same pattern was observed in Experiment 3 with the same range of SOAs but unpredictable stimulus order, suggesting that grouping is not strongly dependent on prior knowledge of the likely response order. These results emphasize the pervasiveness of response grouping in bimanual dual-task RT paradigms and provide useful clues as to its nature.     

Attentional modulation of masked repetition and categorical priming in young and older adults

Three experiments examined the effects of temporal attention and aging on masked repetition and categorical priming for numbers and words. Participants' temporal attention was manipulated by varying the stimulus onset asynchrony (i.e., constant or variable SOA). In Experiment 1, participants performed a parity judgment task and a lexical decision task in which categorical priming and repetition priming were, respectively, tested. Experiment 2 used a semantic categorization task testing categorical priming. In Experiment 3, repetition and categorical priming were tested in the same semantic categorization task with the same stimuli. The results of the three experiments showed that masked repetition priming is insensitive to manipulations of temporal attention whereas categorical priming is. Furthermore, no differences were found between young and older adults in repetition priming effects, again contrasting with the categorical priming results for which older adults were more sensitive to attentional manipulations than young adults.     

Can practice eliminate the psychological refractory period effect?

Can people learn to perform two tasks at the same time without interference? To answer this question, the authors trained 6 participants for 36 sessions in a Psychological Refractory Period (PRP) experiment, where Task 1 required a speeded vocal response to an auditory stimulus and Task 2 required a speeded manual response to a visual stimulus. The large PRP effect found initially (353 ms in Session 1) shrank to only about 40 ms over the course of practice, disappearing entirely for 1 of the 6 participants. This reduction in the PRP effect with practice is considerably larger than has been previously reported. The obtained pattern of factor interactions between stimulus onset asynchrony and each of three task difficulty manipulations (Task 1 judgment difficulty, Task 2 stimulus contrast, and Task 2 mapping compatibility) supports a postponement (bottleneck) account of dual-task interference, both before and after practice.     

Nonstrategic subjective threshold effects in phonemic masking

Three backward-masking experiments demonstrated that the magnitude of the phonemic mask reduction effect (MRE) is a function of subjective threshold and that the magnitude is also independent of stimulus-based response strategies. In all three experiments, a target word (e.g., bake) was backward masked by a graphemically similar nonword (e.g., BAWK), a phonemically similar nonword (e.g., BAIK), or an unrelated control (e.g., CRUG). Experiments 1 and 2 had a low percentage (9%) of trials with phonemic masks and differed only in baseline identification rate. Experiment 3 controlled baseline identification rate at below and above subjective threshold levels, with 9% phonemic trials. The results were that identification rates were higher with phonemic masks than with graphemic masks, irrespective of the low percentage of phonemic trials. However, the magnitude of the phonemic MRE became large only when the baseline identification rate was below subjective threshold. The pattern of the phonemic MRE was interpreted as a result of rapid automatic phonological activation, independent of stimulus-based processing strategies.     

The processing of spatial frequency and orientation information

Three identification experiments were completed to disambiguate the associations between spatial frequency and orientation information at the sensory, decisional, and response levels. The stimuli were gratings generated by crossing four levels each of spatial frequency and orientation. In Experiment 1, the subjects made a single identification response to the stimuli. In Experiment 2, two identification responses were made, one for the spatial frequency component and the other for the orientation component. In Experiment 3, the subjects identified either the spatial frequency or the orientation component in any block of trials. The data were confusion matrices, and an information-transmission approach was used to investigate the interactions in the system. The results show that although there were sensory associations, there were no interactions at the decisional level. Performance parity was found: there was no significant difference between the single- and double-judgment paradigms in terms of information transmitted. Overall, the results suggest that although spatial frequency and orientation information is coded jointly at the sensory level, subsequent processing is independent, with each dimension drawing upon different attentional resources.     

Presenting two incongruent color words on a single trial does not alter Stroop interference

Two experiments showed that having two incongruent words present on a single Stroop trial (e.g., bothred andgreen in blue, say “blue”) did not alter interference relative to having only one incongruent word. This was true whether the two incongruent words were presented successively at several stimulus onset asynchronies (Experiment 1) or simultaneously in adjacent positions (Experiment 2). We argue that the first word captures attention and “locks out” others, preventing additional interference.