Processing redundant signals: coactivation, divided attention, or what?

The evidence for and against a redundancy gain in reaction time (RT) when the target is repeated in the visual display is reviewed. We consider the relevance of redundancy gains under these circumstances to the question of whether attention can be simultaneously directed to separate locations in the visual field. In the present experiments, two capital letters were the target stimuli in a two-alternative forced-choice RT paradigm. In addition to the usual conditions of single-target trials, trials on which the target is repeated in the display, and trials on which the target occurs with a noise letter, we introduced the innovation of a condition in which both targets occur in the display. In our two experiments, RT was fastest with single-target displays and slowest with displays containing a target and a noise letter. There was no significant difference in RT to displays in which the target was repeated and displays in which both targets were presented. Both conditions showed a redundancy gain when compared with displays containing a target and a noise letter. The lack of response competition in the both-targets condition and the overall pattern of the results were well explained by a unitary attentional focus that serially processed the letters in the display. Analyses of minima and maxima RTs were consistent with this interpretation.     

Parallel scanning of auditory and visual information

Two experiments involving memory retrieval of auditorilv and visually presented materials were performed. In Experiment I, subjects were presented with memory sets of 1, 2, or 4 stimuli and then with a test item to be classified as belonging or not belonging to the memory set. In Condition 1, each memory stimulus was a single, auditorily presented letter. In Condition 2, each memory stimulus was a visually presented letter. In Conditions 3 and 4, each memory stimulus was a pair of letters, one presented visually and the other auditorily. Mean reaction time (RT) for the classification task increased as a function of number of memory stimuli at equal rates for all four conditions. This was interpreted as evidence for a parallel scanning process in Conditions 3 and 4 where the auditory item and visual item of each memory stimulus pair can be scanned simultaneously. Experiment II compared memory retrieval for a simultaneous condition in which auditory and visual memory items were presented as pairs with a sequential condition in which mixed auditory-visual memory sets were presented one item at a time. RTs were shorter for the simultaneous condition. This was interpreted as evidence that parallel scanning may depend upon memory input parameters.     

Using visual codes for comparisons of pictures

In two experiments, Ss indicated for a series of trials whether or not two pictures of common objects had the same name (a positive or negative response, respectively). The pictures were separated by one of three interstimulus intervals (ISis), and reaction time (RT) was recorded. In Experiment I, positive trials involved pictures that were identical (identity match), mirror images (mirror match), or physically different but had the same name (name match). The stimuli came from either an S set, in which name-match pairs were physically similar, or a D set, in which name-match pairs were physically dissimilar. The mean RTs for mirror and identity matches were virtually the same but faster than name-match RTs, an advantage that decreased with increasing ISI. It was expected that name-match RT for the S set would be less than for the D set, indicating a facilitative effect of physical similarity; however, the identity-match RTs showed the expected difference. These results were extended in Experiment II, which involved only the identity and name matches, in pure sessions (which included positive trials of just one type) or mixed sessions (which included both types of positive trials). For mixed sessions, name- as well as identity-match RTs differed between the S and D sets. These results provide evidence for the use of visual codes in comparing nonidentical pictures, codes that apparently vary with experimental context and task demands.     

Short-term retention of visually presented stimuli: some evidence of visual encoding.

Subjects saw two visual stimuli on each trial, separated by an interval ranging from 0 to 8 sec. Each stimulus was composed of a subset of the dots of a 7 × 5 dot matrix. In particular, it was a composite of two patterns, one of which formed a capital English letter and the other of which was an arrangement formed by 8 randomly selected dots. The task was to decide as quickly as possible whether the two stimuli contained the same letter. Under one condition (correlated noise) the same noise pattern was used with both letters; thus the decision as to whether the letters were the same could be based on a test of congruence of the two stimuli, noise and all. Under another condition (uncorrelated noise) the noise patterns differed, assuring that the composite patterns differed, and thus precluding congruence testing as an adequate way to determine whether the two letters were the same. Performance was better (RTs and error rates were smaller) with the correlated noise than with the uncorrelated noise. The result was taken as evidence that visual information was retained in memory, and used to advantage, when the situation clearly warranted the direct comparison of visual patterns.     

Visual similarity effects on masked priming

We investigated the role of the visual similarity of masked primes to targets in a lexical decision experiment. In the primes, some letters in the target (e.g., A in ABANDON) had either visually similar letters (e.g., H), dissimilar letters (D), visually similar digits (4), or dissimilar digits (6) substituted for them. The similarities of the digits and letters to the base letter were equated and verified in a two-alternative forced choice (2AFC) perceptual identification task. Using targets presented in lowercase (e.g., abandon) and primes presented in uppercase, visually similar digit primes (e.g., 484NDON) produced more priming than did visually dissimilar digit primes (676NDON), but little difference was found between the visually similar and dissimilar letter primes (HRHNDON vs. DWDNDON). These results were explained in terms of task-driven competition between the target letter and the visually similar letter.     

Wholistic and analytic stimulus processing: The development of selective perceptual strategies

This experiment reports an investigation of the development of selective processing strategies as subjects become increasingly more practised at a serial self-paced RT task. It demonstrates the effect a preceding stimulus can have on the analysis of a current signal and the development of active analytic strategies in favour of passive wholistic processing, with practice. The stimuli used were letters with irrelevant visual noise dot patterns superimposed on them. The letter, or the dot pattern, or both, could be repeated on successive trials. Early in practice repetition of both stimulus components simultaneously produced short reponse latencies relative to repetition of the letter alone. The number of noise dots markedly affected RT. Late in practice, however, letter repetition RTs were small, irrespective of whether or not the noise dot pattern was repeated. Furthermore, the number of noise dots no longer had an effect on the RT to these stimulus transitions. The results suggest that subjects appear to be able to select relevant information to process as they become progressively more practised, even though there is evidence that they compare the current stimulus with an iconic representation of the immediately preceding one.     

Evidence for direct visual access to letter identities

Subjects were presented with two letters from the set BCDFGHLNPORTVZ, one in upper case and one in lower case. Subjects were required to decide, as quickly as possible, whether the two letters on each trial were the same (e.g., Bb) or different (e.g., Bd). Because letters were always physically different, subjects presumably must name the letters in order to respond. Reaction times were predicted by the visual similarity of the letters, and not by their phonemic distinctive feature similarity. Consistent with previous work showing that a word's meaning can be assessed directly from visual information, the findings suggest that visual analysis of a capital or small letter can result in knowing the latter name without further linguistic processing. These results were interpreted as an example of automatic detection as described by Schneider and Shiffrin (1977).     

Attention and size in a global/local task

Two-letter stimuli, consisting of one small letter inside a much larger one (in Experiments 1A, 1B, and 2) or inside a "blob" (in Experiment 3), were used to examine the role of size difference in global/local tasks. The small letter was placed at locations that avoided contour interactions. The results showed no identity interference, in that the specific identity of the large letter did not differentially affect identification of the small one. However, there was evidence of global advantage, in that the presence of a large letter hindered identification of the small one. The magnitude of the global advantage effect, as measured by the difference in performance between the small-single and small-embedded conditions, was largest (about 200 ms reaction time (RT) difference) when the large letters were the same as the small ones, lower (a 63 ms difference in Experiment IB, and 89 ms in Experiment 2) when the large letters were unrelated to the small ones, and lowest (a 25 ms difference) when the large stimuli were blobs. It is proposed that the amount of interference depends on the overlap between the features of the large stimuli, as a set, and those of the small ones, also as a set.     

Coactivation in the perception of redundant targets

Reaction time (RT) to redundant stimuli was investigated while controlling for distraction effects and response competition. In Experiment 1, a redundancy gain was found for 2 target letters with identical features (redundant) compared to trials in which 2 different targets shared the same response assignment (compatible) indicating coactivation of stimulus inputs. No difference in RTs was found between compatible displays and displays containing 2 targets with different responses (incompatible), suggesting (with other evidence) that letters were serially processed. In Experiment 2, a redundancy gain was again found. Unlike in Experiment 1, incompatible displays produced response competition, indicating a redundancy gain with parallel processing. Three forms of redundancy gains operating under specific conditions are discussed.     

Visual similarity effects in immediate verbal serial recall

The role of visual working memory in temporary serial retention of verbal information was examined in four experiments on immediate serial recall of words that varied in visual similarity and letters that varied in the visual consistency between upper and lower case. Experiments 1 and 2 involved words that were either visually similar (e.g. fly, cry, dry; hew, new, few ) or were visually distinct (e.g. guy, sigh, lie; who, blue, ewe ). Experiments 3 and 4 involved serial recall of both letter and case from sequences of letters chosen such that the upper- and lower-case versions were visually similar, for example Kk, Cc, Zz, Ww , or were visually dissimilar, for example Dd, Hh, Rr, Qq . Hence in the latter set, case informationwas encoded interms of both the shape and the size of the letters. With both words and letters, the visually similar items resulted in poorer recall both with and without concurrent articulatory suppression. This visual similarity effect was robust and was replicated across the four experiments. The effect was not restricted to any particular serial position and was particularly salient in the recall of letter case. These data suggest the presence of a visual code for retention of visually presented verbal sequences in addition to a phonological code, and they are consistent with the use of a visual temporary memory, or visual "cache", in verbal serial recall tasks.     

Memory of a speaker's voice: Reaction time to same- or different-voiced letters

Subjects were presented with a sequence of two letters, each letter spoken in either a male or female voice. On each trial, the subject was required to indicate, as quickly as possible, whether the two letters had the same name. Reaction times (RTs) were faster for letters spoken in the same voice for both “same” and “different” responses, even when letters were separated by 8 s. These results are incompatible with the notion of physical and name codes in auditory memory since a “different” response should always be based on a comparison of letter names and should not be influenced by voice quality. It was also found that RTs were not influenced by the phonemic distinctive feature similarity of the letters.     

Reaction time and temporal serial judgment: corroboration or dissociation?]

Dissociations between a motor response and the subject's verbal report have been reported from various experiments that investigated special experimental effects (e.g., metacontrast or induced motion). To examine whether similar dissociations can also be observed under standard experimental conditions, we compared reaction times (RT) and temporal order judgments (TOJ) to visual and auditory stimuli of three intensity levels. Data were collected from six subjects, each of which served for nine sessions. The results showed a strong, highly significant modality dissociation: While RTs to auditory stimuli were shorter than RTs to visual stimuli, the TOJ data indicated longer processing times for auditory than for visual stimuli. This pattern was found over the whole range of intensities investigated. Light intensity had similar effects on RT and TOJ, while there was a marginally significant tendency of tone intensity to affect RT more strongly than TOJ. It is concluded that modality dissociation is an example of "direct parameter specification", where the pathway from stimulus to response in the simple RT experiment is (at least partially) separate from the pathway that leads to a conscious, reportable representation. Two variants of this notion and alternatives to it are discussed.     

Evidence for Mixed Processes in Normal/Mirror Discrimination of Rotated Letters: A Bayesian Model Comparison Between Single- and Mixed-Distribution Models1

When determining whether a rotated letter is normal or mirrored, an observer mentally rotates the letter to its canonical orientation. To account for patterns of response times (RTs) for the normal/mirror discrimination of rotated letters, previous research formulated a model that postulated a mixture of trials with and without mental rotation. While this model could explain the curvilinear relationship that has been found between averaged RT and letter orientations, the curved RT function is still open to alternative explanations without assuming mixed processes. To address this issue and test the mixed-process hypothesis more directly, we analyzed trial-by-trial RT data instead of averaged RTs by employing a Bayesian model comparison technique. If rotation and non-rotation trials are mixed, trial-by-trial RTs for letters in a particular orientation should not follow a single distribution but a mixed one formed from the superposition of two separate distributions, one for rotation and one for non-rotation trials. In the present study, we compared single- and mixed-distribution models. Bayes-factor analysis showed decisive support for the mixed-distribution model over the single-distribution model. In addition, using the widely applicable information criterion (WAIC), the predictive accuracy of the mixed-distribution model was found to be as high as that of the single-distribution model. These results indicated the involvement of mixed processes in normal/mirror discrimination of rotated letters. The usefulness of statistical modeling in psychological study and necessary precautions to take in the interpretation of the parameters of unconfirmed models are also discussed.     

Visual similarity effects in detecting letter rhymes

Previous demonstrations of "visual" effects in auditory tasks have been largely restricted to orthographic effects with word stimuli. As a result, explanations of such effects have centered around a shared orthography--the similarity of the spelling patterns at the ends of the words. In the present study, these effects were extended to single-letter stimuli. Subjects made rhyming decisions about pairs of letters presented auditorily. Visually similar letter pairs facilitated responses to rhyming pairs and inhibited responses to nonrhyming pairs. The results indicate that visual effects are not restricted to word stimuli and suggest that additive effects of visual similarity and shared orthography may be responsible for these findings.     

Serial position effects in the identification of letters, digits, symbols, and shapes in peripheral vision

Three experiments measured serial position functions for character-in-string identification in peripheral vision. In Experiment 1, random strings of five letters (e.g., P F H T M) or five symbols (e.g., λ Б Þ Ψ ¥) were briefly presented to the left or to the right of fixation, and identification accuracy was measured at each position in the string using a post-cued two-alternative forced-choice task (e.g., was there a T or a B at the 4th position). In Experiment 2 the performance to letter stimuli was compared with familiar two-dimensional shapes (e.g., square, triangle, circle), and in Experiment 3 we compared digit strings (e.g., 6 3 7 9 2) with a set of keyboard symbols (e.g., % 4 @ < ?). Eye-movements were monitored to ensure central fixation. The results revealed a triple interaction between the nature of the stimulus (letters/digits vs. symbols/shapes), eccentricity, and visual field. In all experiments this interaction reflected a selective left visual field advantage for letter or digit stimuli compared with symbol or shape stimuli for targets presented at the greatest eccentricity. The results are in line with the predictions of the modified receptive field hypothesis proposed by Tydgat and Grainger (2009), and the predictions of the SERIOL2 model of letter string encoding.     

Redundancy phenomena are affected by response requirements

Results are reported for two go/no-go reaction time (RT) experiments, in which the redundant targets advantage was investigated. These experiments were replications of two earlier choice reaction time (CRT) experiments, in which letter stimuli were used. Important differences between the go/no-go RT experiments and the CRT experiments were obtained. Equal and significant redundancy advantages were obtained whether redundant targets were compared with a single target presented with a noise letter or without noise. In the CRT experiments, the advantage was not obtained in the comparison with a single target presented alone. Noise letters did not slow the RTs to single targets with which they were presented as was the case with CRT. Since the differing results of the two procedures depend on the response requirements, explanation of differing CRT data in terms of perceptual or attentional concepts is probably inappropriate. The presence and absence of response competition in the two situations may be the best interpretation. The results tend to support a conclusion of the parallel processing of two letter stimuli separated spatially by as much as 3 degrees.     

Effect of orientation on visual and vibrotactile letter identification

The effect of stimulus orientation of letters presented either visually or vibrotactually was examined to obtain basic information on sensory substitution using the tactile sense. The reaction time (RT) to identify the letters F and R presented in normal or mirror-image form at four orientations each was measured. In addition, conditions of 0 degree and 270 degrees of head rotation from vertical and arm rotation from the midline axis were employed. Data from 5 trained subjects showed that vibrotactile RTs were always longer than visual RTs. Stimulus rotation away from normal orientation increased visual RTs significantly but not vibrotactile RTs. Visual orientation effect then seemed to be determined by the body-coordinate system but not the vibrotactile orientation. Although further studies are warranted, from the results of this experiment, any convenient and constant stimulus orientation could be used with a wearable vibrotactile display system to exploit passive touch.     

Mental rotation performance in primary school age children: Are there gender differences in chronometric tests?

In contrast to the well documented male advantage in psychometric mental rotation tests, gender differences in chronometric experimental designs are still under dispute. Therefore, a systematic investigation of gender differences in mental rotation performance in primary-school children is presented in this paper. A chronometric mental rotation task was used to test 449 second and fourth graders. The children were tested in three separate groups each with different stimulus material (animal drawings, letters, or cube figures). The results show that chronometric mental rotation tasks with cube figures – even rotated in picture plane only – were too difficult for children in both age groups. Further analyses with animal drawings and letters as stimuli revealed an overall gender difference in response time (RT) favoring males, an increasing RT with increasing angular disparity for all children, and faster RTs for fourth graders compared to second graders. This is the first study which has shown consistent gender differences in chronometric mental rotation with primary school aged children regarding reaction time and accuracy while considering appropriate stimuli.     

Visual image analysis by square wavelets: empirical evidence supporting a theoretical agreement between wavelet analysis and receptive field organization of visual cortical neurons

It was proposed that the human visual system analyzes images into square wavelets. To test this view, comparisons were made between the perceived similarity-dissimilarity of alphabet letters and the wavelet analyses of those same letters. For the proposal to be considered tenable, the coefficients of the wavelet analysis of similar letters must be similar, and the coefficients of the wavelet analysis of dissimilar letters must be dissimilar. From a selection of 12 letters, four pairs of letters had been reported by Van der Heijden, Mathas, and Van den Roovaart as very similar, and four other pairs of letters dissimilar. Each of the 12 letters was separately depicted in 8 x 8 matrices, and the signal represented by each of the matrices was analyzed into square wavelets using a new and original procedure which yielded a single set of coefficients for each matrix. Correlations between sets of coefficients were high (r ranged from .88 to .58) for those letter pairs judged high in similarity; correlations were low (r ranged from -.02 to .29) for those letter pairs judged low in similarity. When the correlations between the coefficients of wavelets of all eight-letter pairs were compared with the judged similarity-dissimilarity of all eight-letter pairs, the linear agreement was statistically significant. Agreement was found between the neurophysiological mapping of receptive fields of visual cortical neurons and the vectors or the pattern of pluses and minuses which characterized the wavelet analysis. Furthermore, regeneration of the visual image, or the pattern of neural activity representing the image, could be described by a tree-like flow of information among visual cortical neurons which received response data from visual receptive fields, the response data being wavelet coefficients. Results indicate the analysis accurately produces reliable transformations of visual patterns and may be a process used by the visual system.     

Investigating letter recognition in the brain by varying typeface: An event-related potential study

We aimed to investigate the contributions of visual letter form and abstract letter identity to the time course of letter recognition, by manipulating the typeface (i.e. font) in which letters were presented. Twenty-six adult participants completed a modified one-back task, where letters where presented in easy-to-read typefaces (“fluent” letter stimuli) or difficult-to-read typefaces (“disfluent” letter stimuli). Task instructions necessitated that participant’s focus on letter identity not visual letter form. Electroencephalography was collected and event-related potentials (ERPs) were calculated relative to letter stimuli. It was found that typeface affected both early-mid (N1 amplitude and P2–N2 amplitude and latency) and late processing (450–600 ms), thereby including time points whereby it is theorised that abstract identity is extracted from visual letter form (that is, 300 ms post-stimulus). Visual features of the letter therefore affect its processing well beyond the currently theorised point at which abstract information is extracted; which could be explained by a feedback loop between abstract letter representations and lower-level visual form processing units, which is not included in current cognitive reading models.