A contingent speech technique in eye movement research on reading

A novel eye-movement-contingent method is presented. It builds on and extends established eye-movement-contingent visual display change methods in that it uses movements of the eyes to control the presentation of acoustic information during sentence reading. In one implementation, an irrelevant spoken word is presented when the eyes cross a predetermined spatial boundary before they move on to a selected visual target word. The relationship between the spoken word and the visual target is manipulated, and the pattern of interference, caused by the presentation of the spoken word, is used to determine the nature and time course of activated representations. Results from three recently completed experiments in which the technique was used show that a word’s phonological code remains active after it has been read and that the activated code has speech-like properties.     

Inhibitory neighbor priming effects in eye movements during reading

We report an eye movement experiment investigating whether prior processing of a word’s orthographic neighbor in a sentence influences subsequent word processing during reading. There was greater difficulty in early word processing when a target word’s neighbor rather than a control word appeared earlier in a sentence; this effect was uninfluenced by the relative lexical frequency of the word and its neighbor. We discuss this inhibitory neighbor priming effect in terms of competitive network models of word recognition and the process of lexical identification in the E-Z Reader model of oculomotor control (e.g., Reichle, Pollatsek, Fisher, & Rayner, 1998).     

Testing the Role of Phonology in Reading: Focus on Sentence Processing

Most reading research investigating the role of phonology in word recognition has focused on studies employing an individual word as the sole stimulus. The bulk of such research has offered support for the phonological recoding hypothesis, the conjecture that access to a printed word’s meaning requires activation of the word’s phonology (i.e., meaning is not typically activated via orthography alone). A criticism of such studies is that by presenting participants with only a single word on each experimental trial (a nonecological manipulation), participants may alter their typical strategy of reading in such a way as to artificially favor the phonological recoding hypothesis. The present study avoided a focus on single words by requiring participants to read sentences and paragraphs for comprehension. Experiment 1 showed that, in reading a paragraph of connected sentences, eliminating a letter in a word that altered the phonology was more deleterious than eliminating a letter that did. Experiment 2 focused on the reading of each sentence itself rather than on the paragraph and provided additional control conditions. The results were similar to those of Experiment 1, consistent with the phonological recoding hypothesis.     

The contribution of orthography to spoken word production: Evidence from Mandarin Chinese

A recent debate in the language production literature concerns the influence of a word’s orthographic information on spoken word production and the extent to which this influence is modulated by task context. In the present study, Mandarin Chinese participants produced sets of words that shared orthography (O+P−), phonology (O−P+), or orthography and phonology (O+P+), or were unrelated (O−P−), in the context of a reading, associative naming, or picture naming task. Shared phonology yielded facilitation effects in all three tasks, but only in the reading task was this phonological effect modulated by shared orthography. Shared orthography by itself (O+P−) revealed inhibitory effects in reading, but not in associative naming or in picture naming. These results suggest that a word’s orthography information influences spoken word production only in tasks that rely heavily on orthographic information.     

The interaction of meaning and sound in spoken word recognition

Models of spoken word recognition vary in the ways in which they capture the relationship between speech input and meaning. Modular accounts prohibit a word’s meaning from affecting the computation of its form-based representation, whereas interactive models allow activation at the semantic level to affect phonological processing. We tested these competing hypotheses by manipulating word familiarity and imageability, using lexical decision and repetition tasks. Responses to high-imageability words were significantly faster than those to low-imageability words. Repetition latencies were also analyzed as a function of cohort variables, revealing a significant imageability effect only for words that were members of large cohorts, suggesting that when the mapping from phonology to semantics is difficult, semantic information can help the discrimination process. Thus, these data support interactive models of spoken word recognition.     

Phonological codes are used in integrating information across saccades in word identification and reading.

A major issue in reading is the extent to which phonological information is used in visual word perception. The present experiments demonstrated that phonological information acquired on 1 fixation from a word in the parafovea is used to help identify that word when it is later fixated. A homophone of a target word, when presented as a preview in the parafovea, facilitated processing of the target word seen on the next fixation more than a preview of a word matched with the homophone in visual similarity to the target word. This facilitation was observed both in the time to name an isolated target word and in the fixation time on the target word while silently reading a sentence; the preview was virtually never consciously identified in either task. Because the visual similarity of the preview to the target also plays a part in the facilitative effect on the preview, however, codes other than phonological codes are preserved across saccades.     

Orthographically Influenced Abstract Phonological Representation: Evidence from Non-rhotic Speakers

It is typically assumed that when orthography is translated silently into phonology (i.e., when reading silently), the phonological representation is equivalent to the spoken form or, at least, the surface phonemic form. The research presented here demonstrates that the phonological representation is likely to be more abstract than this, and is orthographically influenced. For example, the claim is made that the word corn has an underlying /r/ in its phonological representation, even in non-rhotic dialects. The evidence comes from difficulties observed in judgements about the homophony with a target word of a pseudohomophone whose phonology does not match the putative abstract representation of that word. For example, it is hard to say that the pseudohomophone cawn is homophonic with corn. The conclusion that orthography can shape phonological representation is antithetical to both computational models of the conversion of print to sound and linguistic accounts of phonology.The research reported in this paper was supported by a grant awarded to the author by the Australian Research Council.     

Visual word recognition is accompanied by covert articulation: evidence for a speech-like phonological representation

Two lexical decision task (LDT) experiments examined whether visual word recognition involves the use of a speech-like phonological code that may be generated via covert articulation. In Experiment 1, each visual item was presented with an irrelevant spoken word (ISW) that was either phonologically identical, similar, or dissimilar to it. An ISW delayed classification of a visual word when the two were phonologically similar, and it delayed the classification of a pseudoword when it was identical to the base word from which the pseudoword was derived. In Experiment 2, a LDT was performed with and without articulatory suppression, and pseudowords consisted of regular pseudowords and pseudohomophones. Articulatory suppression decreased sound-specific ISW effects for words and regular pseudowords but not for pseudohomophones. These findings indicate that the processing of an orthographically legal letter sequence generally involves the specification of more than one sound code, one of which involves covert articulation.     

PHONOLOGICAL CODES ARE AUTOMATICALLY ACTIVATED DURING READING:

Abstract— Subjects read sentences containing target words that were homophones (words with a single pronunciation but different spellings) while their eye movements were recorded A prime word was presented briefly at the onset of fixation on the target region The prime for a given target (e g, beach) was either identical to the target (beach, a phonologically similar word (the homophone beech), a visually similar nonhomophone (bench), or a dissimilar word (noise) Phonological priming effects were assessed by comparing fixation times on the target when It was preceded by the homophone versus the visually similar word Results suggest that phonological codes are automatically activated during eye fixations in reading     

Phonological and conceptual activation in speech comprehension

We propose that speech comprehension involves the activation of token representations of the phonological forms of current lexical hypotheses, separately from the ongoing construction of a conceptual interpretation of the current utterance. In a series of cross-modal priming experiments, facilitation of lexical decision responses to visual target words (e.g., time) was found for targets that were semantic associates of auditory prime words (e.g., date) when the primes were isolated words, but not when the same primes appeared in sentence contexts. Identity priming (e.g., faster lexical decisions to visual date after spoken date than after an unrelated prime) appeared, however, both with isolated primes and with primes in prosodically neutral sentences. Associative priming in sentence contexts only emerged when sentence prosody involved contrastive accents, or when sentences were terminated immediately after the prime. Associative priming is therefore not an automatic consequence of speech processing. In no experiment was there associative priming from embedded words (e.g., sedate-time), but there was inhibitory identity priming (e.g., sedate-date) from embedded primes in sentence contexts. Speech comprehension therefore appears to involve separate distinct activation both of token phonological word representations and of conceptual word representations. Furthermore, both of these types of representation are distinct from the long-term memory representations of word form and meaning.     

Phonological codes are assembled before word fixation: evidence from boundary paradigm in sentence reading

This experiment employed the boundary paradigm during sentence reading to explore the nature of early phonological coding in reading. Fixation durations were shorter when the parafoveal preview was the correct word than when it was a spelling control pseudoword. In contrast, there was no significant difference between correct word and pseudohomophone previews. These results suggest that the phonological codes are assembled before word fixation and are used for lexical access. Moreover, there was evidence that orthographic codes influence the activation of word meaning. We found that fixation durations were shorter for orthographically similar parafoveal previews, and this orthographic priming effect is limited to pseudohomophones. Thus, it seems that both the orthographic and the phonological similarities of the parafoveal preview to the target play a part in the facilitative effects of the preview.     

Repetition and form priming interact with neighborhood density at a brief stimulus onset asynchrony

The relationships between repetition- and form-priming effects and neighborhood density were analyzed in two masked priming experiments with the lexical decision task. Given that form-priming effects appear to be influenced by a word’s orthographic neighborhood, it is theoretically important to find out whether repetition priming also differs as a function of the word’s orthographic neighborhood. Within an activation framework, repetition- and form-priming effects are just quantitatively different phenomena, whereas the two effects are qualitatively different in a serial-ordered model of lexical access (theentry-opening model). The results show that repetition- and form-priming effects were stronger forhermit words than for words with many neighbors. These results pose some problems for both activation and serial-ordered models. The implications of these results for determining how neighbors affect the identification of a word are discussed.     

The influence of word frequency on the transposed-phoneme priming effect

Speech input like [byt] has been shown to facilitate not only the subsequent processing of an identical target word /byt/ but also that of a target word /tyb/ that contains the same phonemes in a different order. Using the short-term phonological priming paradigm, we examined the role of lexical representations in driving the transposed-phoneme priming effect by manipulating lexical frequency. Results showed that the transposed-phoneme priming effect occurs when targets have a higher frequency than primes, but not when they have a lower frequency. Our findings thus support the view that the transposed-phoneme priming effect results from partial activation of the target word’s lexical representation during prime processing. More generally, our study provides further evidence for a role for position-independent phonemes in spoken word recognition.

     

Effects of increased letter spacing on word identification and eye guidance during reading

The effect of increasing the space between the letters in words on eye movements during reading was investigated under various word-spacing conditions. Participants read sentences that included a high- or low-frequency target word, letters were displayed normally or with an additional space between adjacent letters, and one, two, or three spaces were present between each word. The spacing manipulations were found to modulate the effect of word frequency on the number and duration of fixations on target words, indicating, more specifically, that letter spacing affected actual word identification under various word-spacing conditions. In addition, whereas initial fixations landed at the preferred viewing position (i.e., to the left of a word’s center) for sentences presented normally, landing positions were nearer the beginnings of words when letter spacing was increased, and even nearer the beginnings of words when word boundary information was lacking. Findings are discussed in terms of the influence of textual spacing on eye movement control.     

Automatic phonological priming in visual word recognition

Theories of visual word recognition have proposed that a word’s phonological properties can be involved in reading visually presented words. Further, it is commonly supposed that this phonological information can be arrived at in at least two ways: (1) by looking it up after identifying the word visually (a lexical route) or (2) by rule-governed translating of the word’s orthographic code (a nonlexical route), Four experiments were conducted to examine whether phonological information is automatically accessed in visual word recognition, and, if so, how this occurs. A priming technique was used with a display sequence of mask, prime, target, mask. Subjects were asked to make written responses to any words that they thought were present, and prime identification was minimal. A facilitatory effect of phonological priming on target identification occurred when primes were homophones of targets. However, no similar facilitation occurred when the prime was a nonword homophone of the target. Further, the homophone priming effect was found irrespective of whether targets followed the spelling-to-sound rules of English. The results suggest that automatic access to phonology can occur in visual word recognition and that it operates by means of a lexical route.     

The On-line Study of Sentence Comprehension: An Examination of Dual Task Paradigms

This paper presents three studies which examine the susceptibility of sentence comprehension to intrusion by extra-sentential probe words in two on-line dual-task techniques commonly used to study sentence processing: the cross-modal lexical priming paradigm and the unimodal all-visual lexical priming paradigm. It provides both a general review and a direct empirical examination of the effects of task-demand in the on-line study of sentence comprehension. In all three studies, sentential materials were presented to participants together with a target probe word which constituted either a better or a worse continuation of the sentence at a point at which it was presented. Materials were identical for all three studies. The manner of presentation of the sentence materials was, however, manipulated; presentation was either visual, auditory (normal rate) or auditory (slow rate). The results demonstrate that a technique in which a visual target probe interrupts ongoing sentence processing (such as occurs in unimodal visual presentation and in very slow auditory sentence presentation) encourages the integration of the probe word into the on-going sentence. Thus, when using such ‘sentence interrupting’ techniques, additional care to equate probes is necessary. Importantly, however, the results provide strong evidence that the standard use of fluent cross-modality sentence investigation methods are immune from such external probe word intrusions into ongoing sentence processing and are thus accurately reflect underlying comprehension processes.     

Prosodic structure and wh-questions

This study examines the influence of wh-gaps on the prosodic contour of spoken utterances. A previous study (Nagel, Shapiro, & Nawy, 1994) claimed that the phonological representation of a sentence containing a filler-gap dependency explicitly encodes the location of the syntactic gap. In support of this hypothesis, Nagel et al. presented evidence that the word immediately preceding a gap is lengthened and that there is a reliable increase in pitch excursion across the gap location. Our study challenges Nagel et al.'s claim. We argue that their materials confounded the presence/absence of a gap with other factors that are known to affect intonational phrasing independently. We show that, when these factors are separated, the evidence that syntactic gaps are explicitly encoded in the phonological representation of a sentence disappears.     

What are effective phonological units in Cantonese spoken word planning?

Two picture—word interference experiments were conducted to investigate the nature of effective phonological units in Cantonese spoken word production. The names of the pictures were Cantonese monosyllables with a consonant 1 vowel 1 consonant (CVC) structure. Participants’ picture-naming responses were faster when the target (e.g., “star” /sing1/) and the distractor shared the same CVC component (e.g., /sing4/, meaning “city”), the same CV component (e.g., /sik6/, “eat”), or the same VC component (e.g., /ging2/, “region”), as opposed to when they were unrelated, and the facilitation effects observed were comparable in size. Also, similar facilitation effects were obtained across the CV1tone-related and the VC1tone-related conditions, whereas no reliable effect was found in the V1tone-related condition. These results indicate that an effective phonological unit in spoken word planning is neither a syllable (without tone) nor a segmental unit, and that the possible candidates lie between the two, at least in Cantonese.     

How reading acquisition changes children’s spoken language network

To examine the influence of age and reading proficiency on the development of the spoken language network, we tested 6- and 9-years-old children listening to native and foreign sentences in a slow event-related fMRI paradigm. We observed a stable organization of the peri-sylvian areas during this time period with a left dominance in the superior temporal sulcus and inferior frontal region. A year of reading instruction was nevertheless sufficient to increase activation in regions involved in phonological representations (posterior superior temporal region) and sentence integration (temporal pole and pars orbitalis). A top-down activation of the left inferior temporal cortex surrounding the visual word form area, was also observed but only in 9 year-olds (3 years of reading practice) listening to their native language. These results emphasize how a successful cultural practice, reading, slots in the biological constraints of the innate spoken language network.     

Proactive interference effects on sentence production

Proactive interference refers to recall difficulties caused by prior similar memory-related processing. Information-processing approaches to sentence production predict that retrievability affects sentence form: Speakers may word sentences so that material that is difficult to retrieve is spoken later. In this experiment, speakers produced sentence structures that could include an optionalthat, thereby delaying the mention of a subsequent noun phrase. This subsequent noun phrase was either (1) conceptually similar to three previous noun phrases in the same sentence, leading to greater proactive interference, or (2) conceptually dissimilar, leading to less proactive interference. Speakers produced morethats (and were more disfluencies) before conceptually similar noun phrases, suggesting that retrieval difficulties during sentence production affect the syntactic structures of sentences that speakers produce.