Critical influence of particular experiences in the perception of letters,words, and phrases

Letters are generally easier to identify in regular words or pseudowords than alone or in irregular items. This advantage seems to imply that word perception depends on knowledge of general structure. We found, however, that the perceptual advantage of letters in pseudowords over single letters could be increased by preexposing the pseudowords, or reversed by preexposing the single letters. Similarly, preexposure of words alone or in phrases resulted in a perceptual advantage for whichever display had been experienced. The success of identification also depended on the type of task previously performed on test items, and on the reinstatement of prior processing and perceptual context, rather than on only the test items and task themselves. We concluded that memory preserves information about the details of particular perceptual experiences, and that identification depends critically on the similarity of current demands and processing context to the demands and contexts of particular previous experiences.     

The QWERTY Effect: How typing shapes the meanings of words.

The QWERTY keyboard mediates communication for millions of language users. Here, we investigated whether differences in the way words are typed correspond to differences in their meanings. Some words are spelled with more letters on the right side of the keyboard and others with more letters on the left. In three experiments, we tested whether asymmetries in the way people interact with keys on the right and left of the keyboard influence their evaluations of the emotional valence of the words. We found the predicted relationship between emotional valence and QWERTY key position across three languages (English, Spanish, and Dutch). Words with more right-side letters were rated as more positive in valence, on average, than words with more left-side letters: the QWERTY effect. This effect was strongest in new words coined after QWERTY was invented and was also found in pseudowords. Although these data are correlational, the discovery of a similar pattern across languages, which was strongest in neologisms, suggests that the QWERTY keyboard is shaping the meanings of words as people filter language through their fingers. Widespread typing introduces a new mechanism by which semantic changes in language can arise.     

Positional uncertainty in lateral masking and the perceptual superiority of words

The possible role of positional uncertainty as a basis for lateral masking and the perceptual superiority of words was examined. The stimuli were five-letter strings, of which the middle three letters were the targets and the end letters were distracting flankers which were positioned either adjacent to the target or separated from it. The trigram targets were of three types (words, pseudowords, and nonwords). The positional uncertainty of individual letters was varied through the use of two response modes, with 18 college students participating in each mode. One group used a response mode which did not allow transpositions of letter sequence, while the other group had no such restriction. The results showed that positional uncertainty affected the magnitude of lateral masking but not that of the word superiority effect, suggesting that different processes underlie these two phenomena. Error analyses within response mode as well as response bias comparisons further confirmed this conclusion.     

Identification and pronunciation effects in a verbal reaction time task for words,pseudowords, and letters

The question addressed in this investigation was whether faster reading and pronunciation of words than orthographically regular pseudowords is due to faster identification or to faster programming and execution of the motor response. In Experiment I, three different response conditions (naming, threechoice signaled responding, and one-choice signaled responding) were employed to separate the identification and articulation processes in a verbal reaction time task. It was found that, for all intents and purposes, single, isolated letters are processed as if they were very short words. Words are read and pronounced 72 msec faster than pseudowords. Words are also pronounced 30 msec faster than pseudowords even if the reader has longer than 1 sec to identify the stimulus (three-choice condition) or to both identify the stimulus and preprogram the response (one-choice condition). The data indicate that words are identified about 52 msec faster and articulated about 30 msec faster than pseudowords. Since the number of response alternatives (one or three) does not interact with stimulus type (letter, word, or pseudoword) in the signaled response control condition, the 30-msec difference is due to response execution and not to differential response programming. Response programming takes in the neighborhood of 236 msec. Experiment 2 investigated the effect of local orthographic context upon the identification of the first letter of a string of letters. No difference was found in identifying the initial letter of words and pseudowords, but the initial letter of these orthographically regular letter strings was identified and named 10 msec faster than the initial letter of orthographically anomalous strings of letters (anagrams). The data from the two experiments are supportive of theories of reading that assume (1) that the letters of visually presented words are processed simultaneously, in parallel, (2) that there is a relatively direct access and retrieval of the phonological memory codes for the names of words, and (3) that orthographically regular pseudowords having no representation in the phonological lexicon undergo a grapheme-to-phoneme transformation that takes longer to finish than the direct spelling-to-sound process used for words.     

The role of familiar units in perception of words and nonwords

This paper investigates the effects of familiarity with whole-word units and letter-cluster units in perceptual encoding of letter strings. Subjects viewed brief, masked presentations of words and pronounceable pseudowords differing in letter cluster frequency. Identification of both display types was compared to control single letters. Perceptual accuracy was indexed by probe forced-choice responses and full verbal reports of the displays. Evidence that familiarity of whole-word units facilitated encoding was mixed but, on balance, favorable. Evidence that familiarity of letter-cluster units facilitated encoding was completely absent. This negative finding is surprising in view of the fact that we did obtain a large advantage of letters in pseudo-words as well as words over single letters. The discussion section considers an alternative to the view that perceivers use detectors for familiar letter-cluster units in the process of forming representations of pronounceable, orthographically regular letter strings.     

A test of the Sophisticated Guessing Theory of word perception

Under difficult viewing conditions, a letter in a familiar word can be perceived more accurately than the same letter alone or in a string of unrelated letters. Sophisticated Guessing Theory asserts that perception is more accurate when a letter appears in a word because its identity is constrained by the identity of neighboring context letters. Experiment 1 tested the following prediction: A letter in a word should be perceived more accurately in strongly constraining word contexts than in weakly constraining word contexts. No such trend was found using a number of different measures of contextual constraint and perceptual accuracy. Experiment 2 verified that, with the same conditions used in Experiment 1 to test Sophisticated Guessing Theory, a strong perceptual advantage could be obtained for letters in words vs. letters alone or in unrelated-letter strings. Several alternative theories of word perception are discussed. The most attractive asserts that for words an additional higher-level perceptual code is formed that is more resistant to degradation than the code formed for letters.     

Perceptual and response components in repetition priming of spoken words and pseudowords

Two experiments explored repetition priming effects for spoken words and pseudowords in order to investigate abstractionist and episodic accounts of spoken word recognition and repetition priming. In Experiment 1, lexical decisions were made on spoken words and pseudowords with half of the items presented twice (～12 intervening items). Half of all repetitions were spoken in a “different voice” from the first presentations. Experiment 2 used the same procedure but with stimuli embedded in noise to slow responses. Results showed greater priming for words than for pseudowords and no effect of voice change in both normal and effortful processing conditions. Additional analyses showed that for slower participants, priming is more equivalent for words and pseudowords, suggesting episodic stimulus–response associations that suppress familiarity-based mechanisms that ordinarily enhance word priming. By relating behavioural priming to the time-course of pseudoword identification we showed that under normal listening conditions (Experiment 1) priming reflects facilitation of both perceptual and decision components, whereas in effortful listening conditions (Experiment 2) priming effects primarily reflect enhanced decision/response generation processes. Both stimulus–response associations and enhanced processing of sensory input seem to be voice independent, providing novel evidence concerning the degree of perceptual abstraction in the recognition of spoken words and pseudowords.     

Isolating visual units in the perception of words and nonwords

In three experiments, reaction times for same-different judgments were obtained for pairs of words, pronounceable nonwords (pseudowords), and unpronounceable nonwords. The stimulus strings were printed either in a single letter case or in one of several mixtures of upper- and lowercase letters. In Experiment 1, the stimuli were common one- and two-syllable words; in Experiment 2, the stimuli included both words and pseudowords; and in Experiment 3, words, pseudowords, and nonwords were used. The functional visual units for each string type were inferred from the effects that the number and placement of letter case transitions had onsame reaction time judgments. The evidence indicated a preference to encode strings in terms of multiletter perceptual units if they are present in the string. The data .also suggested that whole words can be used as functional visual units, although the extent of their use depends on contextual parameters such as knowledge that a word will be presented.     

Functional MRI evidence for an abstract, not perceptual, word-form area

Previous studies have found an area in left ventral visual cortex that responds more to words and pseudowords than to consonant strings. Does this area respond to the perceptual form of wordlike stimuli, or is it responding to some more abstract, linguistic property, such as orthographic regularity (i.e., conformity with the spelling rules of the language)? During a functional magnetic resonance imaging experiment, participants read alternating-case words and pseudowords, which are orthographically regular but are perceptually unfamiliar. These stimuli activated the same area that was activated by pure-case words and pseudowords. These results suggest that the response of the so-called word-form area is not based on perceptual familiarity but rather on some more abstract feature such as orthographic regularity.     

A systematic, large-scale study of synaesthesia: implications for the role of early experience in lexical-colour associations

For individuals with synaesthesia, stimuli in one sensory modality elicit anomalous experiences in another modality. For example, the sound of a particular piano note may be 'seen' as a unique colour, or the taste of a familiar food may be 'felt' as a distinct bodily sensation. We report a study of 192 adult synaesthetes, in which we administered a structured questionnaire to determine the relative frequency and characteristics of different types of synaesthetic experience. Our data suggest the prevalence of synaesthesia in the adult population is approximately 1 in 1150 females and 1 in 7150 males. The incidence of left-handedness in our sample was within the normal range, contrary to previous claims. We did, however, find that synaesthetes are more likely to be involved in artistic pursuits, consistent with anecdotal reports. We also examined responses from a subset of 150 synaesthetes for whom letters, digits and words induce colour experiences ('lexical-colour' synaesthesia). There was a striking consistency in the colours induced by certain letters and digits in these individuals. For example, 'R' elicited red for 36% of the sample, 'Y' elicited yellow for 45%, and 'D' elicited brown for 47%. Similar trends were apparent for a group of non-synaesthetic controls who were asked to associate colours with letters and digits. Based on these findings, we suggest that the development of lexical-colour synaesthesia in many cases incorporates early learning experiences common to all individuals. Moreover, many of our synaesthetes experienced colours only for days of the week, letters or digits, suggesting that inducers that are part of a conventional sequence (e.g. Monday, Tuesday, Wednesday...; A, B, C...; 1, 2, 3...) may be particularly important in the development of synaesthetic inducer-colour pairs. We speculate that the learning of such sequences during an early critical period determines the particular pattern of lexical-colour links, and that this pattern then generalises to other words.     

Cognitive and linguistic factors affect visual feature integration

Five experiments investigated the influence of cognitive and linguistic factors on the integration of color and letter-shape information. Subjects were briefly presented strings of colored letters that varied in pronounceability and familiarity. Detection and search tasks required subjects to identify the color of predesignated target letters. It was proposed that errors in integrating color and shape would be less likely with items from different perceptual units than from items within the same perceptual unit. If words, at some level of perceptual analysis, are processed as units whereas nonwords are processed by individual letters, then there should be more letter-shape and color feature integration errors with words than with nonwords. The first two experiments tested this prediction by comparing feature integration errors with words and nonwords. The remaining experiments manipulated letter-string pronounceability, familiarity, and the presence of vowels to isolate the factors that may influence feature integration. The results demonstrate that cognitive and linguistic factors, such as familiarity and pronounceability, can influence the combination of colors and shapes in perception.     

Building permanent memory codes: codification and repetition effects in word identification

The studies presented in this article investigate the memory processes that underlie two phenomena in threshold identification: word superiority over pseudowords and the repetition effect (a prior presentation of an item facilitates later identification of that item). Codification (i.e., the development of a single memory code that can be triggered even by fragmented input information) explains the faster and more accurate identification of words than pseudowords. Our studies trace the development and retention of such codes for repeated pseudowords and examine the growth and loss of the repetition effect for both pseudowords and words. After approximately five prior occurrences, words and pseudowords are identified equally accurately in two types of threshold identification tasks, suggesting codification has been completed for pseudowords. Although the initial word advantage disappears, the accuracy of identification still increases with repetitions. The facilitation caused by repetition is not affected much by spacing within a session, but drops from one day to the next, and after a delay of one year has disappeared (new and old words were identified equally well). These results suggest an episodic basis for the repetition effect. Most important, after one year, performance is equal for old pseudowords and new and old words: all these levels are superior to that for new pseudowords, suggesting that the learned codes for pseudowords are as strong and permanent as the codes for words. A model of identification is presented in which feedback from codes and episodic images in memory facilitates letter processing. An instantiation of the model accounts for the major features of the data.     

Whole-word units are used before orthographic knowledge in perceptual development

A visual search task for target letters in multiletter displays was used to investigate information-processing differences between college students and presecond-grade children (mean age = 7 years, 4 months). The stimulus displays consisted of single words, pronounceable pseudowords, and unpronounceable nonwords varying in length from three to five letters. The mean response times for indicating whether or not a target letter occurred in the display increased with the number of display letters for both groups, although there were apparent differences between groups in the rate of search and type of search strategy used. Pre-second-grade children responded faster to word displays than to pseudoword and nonword displays, indicating that familiar letter strings could be processed faster than unfamiliar strings regardless of whether or not the latter were consistent with rules of English orthography. In contrast, college students processed words and pseudowords about equally well, and both resulted in faster responses than nonwords. As reading skills develop, children apparently come to process familiar words differently from other letter strings. Only after a significant sightword vocabulary is established do children seem to recognize the regularities of standard English orthography and make use of this knowledge to facilitate perceptual processes.     

Can “words” be processed as integrated units?

Three experiments examined the information processing of letters embedded within one-syllable words and similar unpronounceable sequences. A speeded discrimination task was used to detect processing differences between words and nonwords in a situation where both the identity and position of critical display information was known to subjects before stimulus presentation. Results indicated that word pairs differing by two letters were more quickly discriminated than two words differing in a single letter, while nonword pairs differing in two letters were discriminated no faster than two nonwords differing in a single letter. A further comparison showed a performance advantage for words over nonwords in a condensation task that forced a scan of stimulus letters for correct responding. These results suggest that familiarity affects information processing at a perceptual level, and are incompatible with theories suggesting that familiarity effects are due to inferential factors following letter feature analysis.     

Identity without form: Abstract representations of letters

Subjects viewed single letters and orthographically regular pseudowords in a tachistoscope at threshold duration. The pseudowords were either all of one case (upper or lower) or they were of mixed case. Letter identity (“A”) and case judgments were required for one letter on each trial. It was found that letter identity was often reported correctly when case was reported incorrectly, even for letters whose upper- and lowercase forms are physically dissimilar (e.g., G-g). This “case effect” was stronger for letters in pseudowords than for letters presented alone. It held across different type fonts, and it occurred even when the upper-and lowercase letters were of different sizes (gEaT) and when the instructions to the subjects stressed the greater importance of case reports over identity reports. The results are consistent with the view that letter identification is an automatic process, the product of which is an abstract representation containing no information about physical form.     

The frequency effect for pseudowords in the lexical decision task

Four experiments were designed to investigate whether the frequency of words used to create pseudowords plays an important role in lexical decision. Computational models of the lexical decision task (e.g., the dual route cascaded model and the multiple read-out model) predict that latencies to low-frequency pseudowords should be faster than latencies to high-frequency pseudowords. Consistent with this prediction, results showed that when the pseudowords were created by replacing one internal letter of the base word (Experiments 1 and 3), high-frequency pseudowords yielded slower latencies than low-frequency pseudowords. However, this effect occurred only in the leading edge of the response time (RT) distributions. When the pseudowords were created by transposing two adjacent internal letters (Experiment 2), high-frequency pseudowords produced slower latencies in the leading edge and in the bulk of the RT distributions. These results suggest that transposed-letter pseudowords may be more similar to their base words than replacement-letter pseudowords. Finally, when participants performed a go/no-go lexical decision task with one-letter different pseudowords (Experiment 4), high-frequency pseudowords yielded substantially faster latencies than low-frequency pseudowords, which suggests that the lexical entries of high-frequency words can be verified earlier than the lexical entries of low-frequency words. The implications of these results for models of word recognition and lexical decision are discussed.     

Differential backward masking of words and letters by masks of varying orthographic structure

The effects of structural relationships between targets and masks were investigated using a backward-masking paradigm. Specifically, the masking of single letters, common fiveletter words, and five-letter pseudowords masked by a blank flash, strings of overlapped letters, pseudowords, and words was investigated. Target duration was varied from 2 to 32 msec, with mask duration held constant at 25 msec. The dependent measure was the critical interstimulus interval for correct target identification. Letters were more effectively masked than words and pseudowords. A blank mask caused the least amount of masking, followed by the overlapped letter strings, and then the word and pseudoword masks. In addition to the overall greater masking effectiveness for the three patterned masks, overlapped letter strings masked letters more effectively than they did words. The implications of current theories of masking for these results and the implications of these results for theories of word recognition were discussed.     

Bright sneezes and dark coughs, loud sunlight and soft moonlight

Synesthetic metaphors (such as "the dawn comes up like thunder") are expressions in which words or phrases describing experiences proper to one sense modality transfer their meanings to another modality. In a series of four experiments, subjects used scales of loudness, pitch, and brightness to evaluate the meanings of a variety of synesthetic (auditory-visual) metaphors. Loudness and pitch expressed themselves metaphorically as greater brightness; in turn, brightness expressed itself as greater loudness and as higher pitch. Although loudness thus shared with brightness a metaphorical connection, pitch and brightness showed a connection that was closer and that applied more generally to different kinds of visual brightness. The ways that people evaluate synesthetic metaphors emulate the characteristics of synesthetic perception, thereby suggesting that synesthesia in perception and synesthesia in language both may emenate from the same source-from a phenomenological similarity in the makeup of sensory experiences of different modalities.     

Stimulus Parameters Underlying Sound-Symbolic Mapping of Auditory Pseudowords to Visual Shapes

Sound symbolism refers to non-arbitrary mappings between the sounds of words and their meanings and is often studied by pairing auditory pseudowords such as “maluma” and “takete” with rounded and pointed visual shapes, respectively. However, it is unclear what auditory properties of pseudowords contribute to their perception as rounded or pointed. Here, we compared perceptual ratings of the roundedness/pointedness of large sets of pseudowords and shapes to their acoustic and visual properties using a novel application of representational similarity analysis (RSA). Representational dissimilarity matrices (RDMs) of the auditory and visual ratings of roundedness/pointedness were significantly correlated crossmodally. The auditory perceptual RDM correlated significantly with RDMs of spectral tilt, the temporal fast Fourier transform (FFT), and the speech envelope. Conventional correlational analyses showed that ratings of pseudowords transitioned from rounded to pointed as vocal roughness (as measured by the harmonics-to-noise ratio, pulse number, fraction of unvoiced frames, mean autocorrelation, shimmer, and jitter) increased. The visual perceptual RDM correlated significantly with RDMs of global indices of visual shape (the simple matching coefficient, image silhouette, image outlines, and Jaccard distance). Crossmodally, the RDMs of the auditory spectral parameters correlated weakly but significantly with those of the global indices of visual shape. Our work establishes the utility of RSA for analysis of large stimulus sets and offers novel insights into the stimulus parameters underlying sound symbolism, showing that sound-to-shape mapping is driven by acoustic properties of pseudowords and suggesting audiovisual cross-modal correspondence as a basis for language users' sensitivity to this type of sound symbolism.