Cross-modal attentional deficits in processing tactile stimulation

In order to substantiate recent theorization on the possible links between the causes of the attentional blink and the psychological refractory period phenomena (e.g., Jolicoeur, 1999a), four experiments are reported in which two target stimuli, T1 and T2, were presented in different modalities at varying stimulus onset asynchronies (SOAs), with each stimulus being associated with a distinct task, Task1 and Task2. In Experiment 1, T1 was a tone, and Task1 was a speeded vocal response based on pitch. T2 was a brief press applied to either of two distal fingerpads, and Task2 was a speeded manual response based on tactile stimulus location. In Experiment 2, the same T1 as that used in Experiment 1 was presented, and in Task1 the subject either made a speeded vocal response based on pitch or ignored T1. T2 was a masked tactile stimulation, and Task2 was an unspeeded manual discrimination of the tactile stimulation location. This Task2 was maintained in Experiments 3 and 4. The auditory T1 was replaced with a white digit embedded in a rapid serial visualization presentation of a stream of black letters, and in Task1 the subject either made an unspeeded decision based on T1 identity or ignored T1. In all the experiments, the results showed an SOA-locked impairment in Task2. As SOA was decreased, reaction times in the speeded Task2 of Experiment 1 increased, and accuracy in the unspeeded Task2 of Experiments 2-4 decreased. The SOA-locked impairment was almost eliminated when T1 could be ignored or was absent. The results are discussed in terms of central processing limitations as the cause of such effects.     

Modulation of the attentional blink by on-line response selection: Evidence from speeded and unspeeded Task1 decisions

Two critical target stimuli (T₁ and T₂) were embedded in a stream of white letters shown on a black background, using a rapid serial visual presentation paradigm (RSVP, 100 msec/item). T₁ was a red H or S; T₂ was an X or a Y. Performance in a two-alternative discrimination on T₂ was impaired when processing of T₁ was required—a result often called an attentional blink (AB). In previous work, the response in Task₁ has been an unspeeded and delayed response at the end of the trial. Three experiments compared performances in Task₂ that depended on whether Task₁ required an unspeeded delayed response or a speeded immediate response. A larger AB was found when a speeded response was required. Furthermore, in the speeded conditions, faster responses in Task₁ were associated with a smaller and shorter AB effect than were slower responses. The results show that manipulations affecting a relatively late stage of processing—response selection—affect the magnitude and duration of the AB phenomenon. A new central inhibition theory is proposed to account for these results. According to this theory, the AB is similar to the psychological refractory period effect and is caused by central postponement of short-term consolidation of T₂.     

Selective influence of second target exposure duration and Task1 load effects in the attentional blink phenomenon

The purpose of the experiments was to constrain the locus of interference in the attentional blink (AB) paradigm. Two visual stimuli, T₁ and T₂, were shown 300 msec apart, and each was followed by a mask. T₁ was an “H,” an “S,” an “ &, ” or a blank field; T₂ consisted of five letters. In Task₁, blank fields and & characters could be ignored, whereas Hs and Ss had to be identified and reported. Task₂ was always to report as many letters as possible from T₂. Task₂ performance was lower when T₁ had to be reported, as expected from the attentional blink phenomenon (AB). The exposure duration of T₂ was also manipulated. More letters could be reported as exposure duration was increased. However, this effect was additive with manipulations of Task₁ processing load that produced the AB effect. Log-linear analyses assuming that effects of T₂ exposure duration and Task₁ load effects occur at functionally distinct stages of processing provided satisfactory fits to the results, suggesting that none of the AB effect occurs as early as those of T₂ exposure duration. The results suggest that the locus of the AB effect is later than the stage(s) of processing affected by exposure duration.     

Are Speedy Brains Needed when Divergent Thinking is Speeded—or Unspeeded?

In this study, we focus on mental speed and divergent thinking, examining their relationship and the influence of task speededness. Participants (N = 109) completed a set of processing speed tasks and a test battery measuring divergent thinking. We used two speeded divergent-thinking tasks of 2 minutes and two unspeeded tasks of 8 minutes to test the influence of task speededness on creative quality and their relation to mental speed. Before each task, participants were instructed to be creative in order to optimally measure creative quality. We found a large main effect of task speededness: less creative ideas were generated when tasks were speeded as compared to unspeeded (Cohen's d = −1.64). We could also replicate a positive relationship of mental speed with speeded divergent thinking (r = .21) and mental speed with unspeeded divergent thinking (r = .25). Our hypothesis that the relation is higher for the speeded divergent-thinking tasks was not confirmed. Importantly, variation in creative quality scores under speeded conditions was not explained by mental speed beyond the predictive power of unspeeded creative quality. The latter finding implies that measurement of creative quality under speeded conditions is not confounded by mental speed.     

Does perceptual analysis continue during selection and production of a speeded response?

This study asked whether perceptual analysis of a stimulus can continue while a response to this stimulus is being generated. In Experiment 1, subjects rapidly named a word that was visually degraded with superimposed pixels. Near the time of response, degradation was removed for a short time and then followed by a mask. Subjects then made a second, unspeeded judgment about the identity of the word. Unspeeded judgments were more accurate, showing that the degradation-free stimulus exposure was processed. In Experiment 2, the task was the same, but the degradation was gradually faded out for an individually adjusted duration. Comparison of unspeeded-response accuracy on trials with and without a speeded response showed that stimulus analysis continued at full efficiency during speeded-response generation. The results support conclusions of Rabbitt and Vyas (1981) that perceptual analysis continues during response stages. This form of continuous processing does not necessarily contradict discrete stage models of human information processing, however.     

Vocal fundamental and formant frequencies affect perceptions of speaker cooperativeness

In recent years, the perception of social traits in faces and voices has received much attention. Facial and vocal masculinity are linked to perceptions of trustworthiness; however, while feminine faces are generally considered to be trustworthy, vocal trustworthiness is associated with masculinized vocal features. Vocal traits such as pitch and formants have previously been associated with perceived social traits such as trustworthiness and dominance, but the link between these measurements and perceptions of cooperativeness have yet to be examined. In Experiment 1, cooperativeness ratings of male and female voices were examined against four vocal measurements: fundamental frequency (F₀), pitch variation (F₀?SD), formant dispersion (D_f), and formant position (P_f). Feminine pitch traits (F₀ and F₀?SD) and masculine formant traits (D_f and P_f) were associated with higher cooperativeness ratings. In Experiment 2, manipulated voices with feminized F₀ were found to be more cooperative than voices with masculinized F₀^, among both male and female speakers, confirming our results from Experiment 1. Feminine pitch qualities may indicate an individual who is friendly and non-threatening, while masculine formant qualities may reflect an individual that is socially dominant or prestigious, and the perception of these associated traits may influence the perceived cooperativeness of the speakers.     

Decision and Response in Dual-Task Interference

Experiments with two stimuli (S₁and S₂) and two responses suggest the existence of a stage of processing that cannot be shared between two concurrent tasks. Widespread support has been found for the hypothesis that response selection for Task₂is postponed when the S₁to S₂stimulus onset asynchrony (SOA) is short (Pashler, 1994a). At short SOAs, manipulations which impact Task₂processing prior to response selection (e.g., degradation of stimulus quality) have little effect on Task₂response times (RTs). On the other hand, manipulations which are thought to impact response selection or execution (e.g., Stroop interference) always impact Task₂RTs. There is, however, one particularly compelling demonstration that appears to be inconsistent with the response selection bottleneck hypothesis: Karlin and Kestenbaum (1968) report that the RT difference between detection (i.e., 1-choice) and 2-choice discrimination dramatically decreases with decreasing SOA. Given that the primary difference between detection and discrimination is believed to be at response selection, their result may indicate a processing bottleneck at response execution (Keele, 1973). We fail to replicate the Karlin and Kestenbaum result in two substantive replications of Karlin and Kestenbaum's tasks and procedures. In the single experiment in which Karlin and Kestenbaum's result is replicated, a simple response execution bottleneck account is ruled out by the stability of the difference between 2-choice and 3-choice discrimination times across SOA. Two additional experiments demonstrate that response preparation and task strategy do not substantially contribute to the attenuation of response selection-level effects with decreasing SOA.     

Holding a manual response sequence in memory can disrupt vocal responses that share semantic features with the manual response

Holding an action plan in memory for later execution can delay execution of another action if the actions share a similar (compatible) feature. This compatibility interference (CI) occurs for actions that share the same response modality (e.g., manual response). We investigated whether CI can generalize to actions that utilize different response modalities (manual and vocal). In three experiments, participants planned and withheld a sequence of key-presses with the left- or right-hand based on the visual identity of the first stimulus, and then immediately executed a speeded, vocal response (‘left’ or ‘right’) to a second visual stimulus. The vocal response was based on discriminating stimulus color (Experiment 1), reading a written word (Experiment 2), or reporting the antonym of a written word (Experiment 3). Results showed that CI occurred when the manual response hand (e.g., left) was compatible with the identity of the vocal response (e.g., ‘left’) in Experiment 1 and 3, but not in Experiment 2. This suggests that partial overlap of semantic codes is sufficient to obtain CI unless the intervening action can be accessed automatically (Experiment 2). These findings are consistent with the code occupation hypothesis and the general framework of the theory of event coding (Behav Brain Sci 24:849–878, 2001a; Behav Brain Sci 24:910–937, 2001b).     

Selection and consolidation of objects and actions

Response selection bottleneck models attribute performance costs under dual-task conditions to the human inability to select more than one response at a time. Consistent with this claim Pashler (1991) found that carrying out a speeded manual choice reaction time (RT) task does not impair the unspeeded report of a cued visual target from a masked display. In contrast, Jolicoeur and DellAcqua (1999, Experiment 2) observed pronounced interference between a speeded manual choice RT task and the unspeeded report of a small number of visually presented letters, a finding they attributed to resource sharing between response selection and stimulus consolidation. We demonstrate that comparable costs are obtained with the same task combination used by Pashler (1991) if only task order is reversed—a manipulation that is likely to increase the necessity of consolidating the target stimulus into working memory. We also found that these costs are not diminished if the location of the target to be reported is cued in advance (reducing demands on spatial focusing) and that they do not vary with the number of target features to be reported. These findings support a consolidation account of costs in dual-task performance.     

Primacy of dimensions in vibrotactile perception: an evaluation of early holistic models.

Early holistic models of perception presume that stimuli composed of interacting dimensions can be experienced initially as undifferentiated. This view, formalized through recourse to a Euclidean geometry of perceptual space, predicts that the orientation of axes used to create stimulus sets is unimportant to performance in speeded classification. We tested this idea by using the interacting vibrotactile dimensions of pitch and loudness. Despite perceivers' relatively poor experience with these dimensions, we showed that the orientation corresponding to pitch and loudness was unique in vibrotactile perceptual space; subjects classified stimuli more efficiently at this orientation than at other orientations. Certain holistic models also claim that when stimulus differences are small, perceivers can recognize change without distinguishing the kind of change. We tested this idea by using a signal detection analysis of unspeeded same-different decisions. We found that subjects' ability to notice the kind of change equaled their ability to notice the change alone. In view of these results, which indicate that pitch and loudness are primary in vibrotactile perception, we detail a new conception of dimensional interaction.     

Retention of a Time Pressure Heuristic in a Target Identification Task

S. Rice and D. Keller (2009) previously reported that participants who were put under time pressure tended to comply more with a diagnostic aid than participants who were not put under time pressure. The present study investigates whether or not learning the benefits of this time pressure heuristic carries over to a second session. Seventy-two New Mexico State University students performed a simulated target-detection task, assisted by a 95% reliable diagnostic aid. Participants were exposed to the following conditions, which were composed of two sessions: speeded–speeded, unspeeded–speeded, speeded–unspeeded, or unspeeded–unspeeded. Results showed that participants who completed the speeded condition for Session 1 performed just as well in the 2nd session regardless of whether or not they were put under time pressure. Participants found that complying with the aid was beneficial to overall performance and continued to comply in a 2nd session even when allowed more time to overrule the aid.     

On the control of visual spatial attention: evidence from human electrophysiology

We used electrophysiological methods to track the deployment of visual spatial attention while observers were engaged in concurrent central attentional processing, using a variant of the attentional blink paradigm. Two visual targets (T₁, T₂) were presented at a stimulus onset asynchrony of either 200 ms or 800 ms. T₁ was a white digit among white letters presented on a dark background using rapid serial visual presentation at fixation. T₂ was another digit that was presented to the left or right of fixation simultaneously with a distractor digit in the opposite visual field, each followed by a pattern mask. In each T₂ display, one digit was red and one was green. Half of the subjects reported the red digit and ignored the green one, whereas the other half reported the green digit and ignored the red one. T₁ and T₂ were reported in one block of trials, and only T₂ in another block (order counterbalanced across subjects). Accuracy of report of T₂ was lower at short SOA than at long SOA when both T₁ and T₂ were reported, but was similar across SOA when only T₂ was reported. The electrophysiological results focused on the N2pc component, which was used as an index of the locus of spatial attention. N2pc was reduced in amplitude when subjects reported T₁, and particularly so at the short SOA. The results suggest that attention to T₁ interfered with the deployment of visual spatial attention to T₂.     

Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision

Three experiments investigated cross-modal links between touch, audition, and vision in the control of covert exogenous orienting. In the first two experiments, participants made speeded discrimination responses (continuous vs. pulsed) for tactile targets presented randomly to the index finger of either hand. Targets were preceded at a variable stimulus onset asynchrony (150,200, or 300 msec) by a spatially uninformative cue that was either auditory (Experiment 1) or visual (Experiment 2) on the same or opposite side as the tactile target. Tactile discriminations were more rapid and accurate when cue and target occurred on the same side, revealing cross-modal covert orienting. In Experiment 3, spatially uninformative tactile cues were presented prior to randomly intermingled auditory and visual targets requiring an elevation discrimination response (up vs. down). Responses were significantly faster for targets in both modalities when presented ipsilateral to the tactile cue. These findings demonstrate that the peripheral presentation of spatially uninforrnative auditory and visual cues produces cross-modal orienting that affects touch, and that tactile cues can also produce cross-modal covert orienting that affects audition and vision.     

The control of stimulus-driven saccades is subject not to central, but to visual attention limitations

In three experiments, we investigated whether the control of reflexive saccades is subject to central attention limitations. In a dual-task procedure, Task 1 required either unspeeded reporting or ignoring of briefly presented masked stimuli, whereas Task 2 required a speeded saccade toward a visual target. The stimulus onset asynchrony (SOA) between the two tasks was varied. In Experiments 1 and 2, the Task 1 stimulus was one or three letters, and we asked how saccade target selection is influenced by the number of items. We found (1) longer saccade latencies at short than at long SOAs in the report condition, (2) a substantially larger latency increase for three letters than for one letter, and (3) a latency difference between SOAs in the ignore condition. Broadly, these results match the central interference theory. However, in Experiment 3, an auditory stimulus was used as the Task 1 stimulus, to test whether the interference effects in Experiments 1 and 2 were due to visual instead of central interference. Although there was a small saccade latency increase from short to long SOAs, this difference did not increase from the ignore to the report condition. To explain visual interference effects between letter encoding and stimulus-driven saccade control, we propose an extended theory of visual attention.     

Converging evidence that visuospatial cognition is more age-sensitive than verbal cognition

In 3 separate experiments, the same samples of young and older adults were tested on verbal and visuospatial processing speed tasks, verbal and visuospatial working memory tasks, and verbal and visuospatial paired-associates learning tasks. In Experiment 1, older adults were generally slower than young adults on all speeded tasks, but age-related slowing was much more pronounced on visuospatial tasks than on verbal tasks. In Experiment 2, older adults showed smaller memory spans than young adults in general, but memory for locations showed a greater age difference than memory for letters. In Experiment 3, older adults had greater difficulty learning novel information than young adults overall, but older adults showed greater deficits learning visuospatial than verbal information. Taken together, the differential deficits observed on both speeded and unspeeded tasks strongly suggest that visuospatial cognition is generally more affected by aging than verbal cognition.     

Audiotactile temporal order judgments

We report a series of three experiments in which participants made unspeeded 'Which modality came first?' temporal order judgments (TOJs) to pairs of auditory and tactile stimuli presented at varying stimulus onset asynchronies (SOAs) using the method of constant stimuli. The stimuli were presented from either the same or different locations in order to explore the potential effect of redundant spatial information on audiotactile temporal perception. In Experiment 1, the auditory and tactile stimuli had to be separated by nearly 80 ms for inexperienced participants to be able to judge their temporal order accurately (i.e., for the just noticeable difference (JND) to be achieved), no matter whether the stimuli were presented from the same or different spatial positions. More experienced psychophysical observers (Experiment 2) also failed to show any effect of relative spatial position on audiotactile TOJ performance, despite having much lower JNDs (40 ms) overall. A similar pattern of results was found in Experiment 3 when silent electrocutaneous stimulation was used rather than vibrotactile stimulation. Thus, relative spatial position seems to be a less important factor in determining performance for audiotactile TOJ than for other modality pairings (e.g., audiovisual and visuotactile).     

Binding time: Evidence for integration of temporal stimulus features

Several lines of evidence suggest that during processing of events, the features of these events become connected via episodic bindings. Such bindings have been demonstrated for a large number of visual and auditory stimulus features, like color and orientation, or pitch and loudness. Importantly, most visual and auditory events typically also involve temporal features, like onset time or duration. So far, however, whether temporal stimulus features are also bound into event representations has never been tested directly. The aim of the present study was to investigate possible binding between stimulus duration and other features of auditory events. In Experiment 1, participants had to respond with two keys to a low or high pitch sinus tone. Critically, the tones were presented with two different presentation durations. Sequential analysis of RT data indicated binding of stimulus duration into the event representation: at pitch repetitions, performance was better when both pitch and duration repeated, relative to when only pitch repeated and duration switched. This finding was replicated with loudness as relevant stimulus feature in Experiment 2. In sum, the results demonstrate that temporal features are bound into auditory event representations. This finding is an important advancement for binding theory in general, and raises several new questions for future research.     

Spatial patterns in tactile perception: is there a tactile field?

Previous studies of tactile spatial perception focussed either on a single point of stimulation, on local patterns within a single skin region such as the fingertip, on tactile motion, or on active touch. It remains unclear whether we should speak of a tactile field, analogous to the visual field, and supporting spatial relations between stimulus locations. Here we investigate this question by studying perception of large-scale tactile spatial patterns on the hand, arm and back. Experiment 1 investigated the relation between perception of tactile patterns and the identification of subsets of those patterns. The results suggest that perception of tactile spatial patterns is based on representing the spatial relations between locations of individual stimuli. Experiment 2 investigated the spatial and temporal organising principles underlying these relations. Experiment 3 showed that tactile pattern perception makes reference to structural representations of the body, such as body parts separated by joints. Experiment 4 found that precision of pattern perception is poorer for tactile patterns that extend across the midline, compared to unilateral patterns. Overall, the results suggest that the human sense of touch involves a tactile field, analogous to the visual field. The tactile field supports computation of spatial relations between individual stimulus locations, and thus underlies tactile pattern perception.     

Separate and shared sources of dual-task cost in stimulus identification and response selection

There is often strong interference if a second target stimulus (T2) is presented before processing of a prior target stimulus (T1) is complete. In the "Psychological Refractory Period" (PRP) paradigm, responses are speeded and interference manifests as increased response time for T2. In the "Attentional Blink" (AB) paradigm, stimuli are masked and responses unspeeded; interference manifests as reduced T2 accuracy. While different causes have usually been considered for PRP and AB phenomena, recent evidence has supported a unified account based on a single, shared restriction on concurrent processing. Here we show that a full assessment of separate and shared resource limitations requires direct comparison of hybrid PRP/AB trials with corresponding pure PRP and AB cases. Randomizing trial types in such a comparison also brings substantial benefit in addressing possible changes in task preparation or readiness. The data from two such experiments--combining speeded auditory (SA) and unspeeded visual (UV) task events--provide clear evidence for both separate and shared resource limitations. Often interference is strongest for T1 and T2 events of the same type, reflecting predominantly different limitations in SA and UV processing. With modest increases in demand, however, interference between different event types can also be made arbitrarily large, reflecting arbitrarily important shared limitations. For even such simple tasks as these, T--T2 interference reflects a combination of relatively local and relatively global sources.