Cloze probability and completion norms for 498 sentences: Behavioral and neural validation using event-related potentials

Three decades after their publication, Bloom and Fischler’s (1980) sentence completion norms continue to demonstrate widespread utility. The aim of the present study was to extend this contribution by expanding the existing database of high-constraint, high cloze probability sentences. Using the criteria established by Bloom and Fischler, we constructed 398 new sentences and presented these along with 100 sentences from their original list to be normed using a sample of 400 participants. Of the 498 sentences presented, 400 met criteria for high cloze probability—that is, .67 or higher probability of being completed by a specific single word. Of these, 321 sentences were from the new set and an additional 79 were from Bloom and Fischler’s set. A high degree of correspondence was observed between responses obtained by Bloom and Fischler for their high-constraint set. A second experiment utilized an N400 event-related potential paradigm to provide further validation of the contextual constraint for the newly generated set. As expected, N400 amplitude was greater for sentences that violated contextual expectancy by ending in a word other than the newly established completion norm. Sentence completion norms are frequently used in cognitive research, and this larger database of high cloze probability sentences is expected to be of benefit to the research community for many years to come. The full set of stimuli and sentence completion norms from this study may be downloaded from http://brm.psychonomic-journals.org/ content/supplemental.     

Rapid processing of the meaning of sentences

It has been shown (Fischler & Bloom, 1979) that sentence contexts facilitate a lexical decision task for words that are highly likely sentence completions and inhibit the decision for words that are semantically anomalous sentence completions. In the present experiment, the sentence contexts were presented 1 word at a time, at rates from 4 to 28 words/sec. The facilitation for words that were likely sentence completions was marginal at the slower rates and absent at higher rates. In contrast, the inhibitory effects of semantic anomaly were apparent at all presentation rates. Several analyses suggested that the sentence contexts were becoming ineffective at the very highest presentation rates, but the high rates at which the sentence contexts still affected word recognition were taken as evidence that semantic information accrues at an early stage of sentence processing. Implications for Posner and Snyder’s (1975) theory of attention and for models of reading were discussed.     

A set of 150 pictures with morphologically complex English compound names: Norms for name agreement,familiarity, image agreement,and visual complexity

We present a set of 150 pictures with morphologically complex English compound names. The pictures were collected from various sources and were standardized to appear as grayscale line drawings of a fixed size. All the compounds had two constituents and were primarily of the noun–noun type. Following previous studies, we collected name agreement (percentage and H), familiarity, image agreement, and visual complexity norms, as well as frequency estimates for the whole compound word and its first and second constituents. These pictures and their corresponding norms (available from the Psychonomic Society's supplemental archive) are a valuable tool in the study of the morphological representation of complex words in language processing.     

Bilingualism influences inhibitory control in auditory comprehension

Bilinguals have been shown to outperform monolinguals at suppressing task-irrelevant information. The present study aimed to identify how processing linguistic ambiguity during auditory comprehension may be associated with inhibitory control. Monolinguals and bilinguals listened to words in their native language (English) and identified them among four pictures while their eye-movements were tracked. Each target picture (e.g., hamper) appeared together with a similar-sounding within-language competitor picture (e.g., hammer) and two neutral pictures. Following each eye-tracking trial, priming probe trials indexed residual activation of target words, and residual inhibition of competitor words. Eye-tracking showed similar within-language competition across groups; priming showed stronger competitor inhibition in monolinguals than in bilinguals, suggesting differences in how inhibitory control was used to resolve within-language competition. Notably, correlation analyses revealed that inhibition performance on a nonlinguistic Stroop task was related to linguistic competition resolution in bilinguals but not in monolinguals. Together, monolingual-bilingual comparisons suggest that cognitive control mechanisms can be shaped by linguistic experience.     

The adaptation of the Affective Norms for English Words (ANEW) for Italian

We developed affective norms for 1,121 Italian words in order to provide researchers with a highly controlled tool for the study of verbal processing. This database was developed from translations of the 1,034 English words present in the Affective Norms for English Words (ANEW; Bradley & Lang, 1999) and from words taken from Italian semantic norms (Montefinese, Ambrosini, Fairfield, & Mammarella, Behavior Research Methods, 45, 440–461, 2013). Participants evaluated valence, arousal, and dominance using the Self-Assessment Manikin (SAM) in a Web survey procedure. Participants also provided evaluations of three subjective psycholinguistic indexes (familiarity, imageability, and concreteness), and five objective psycholinguistic indexes (e.g., word frequency) were also included in the resulting database in order to further characterize the Italian words. We obtained a typical quadratic relation between valence and arousal, in line with previous findings. We also tested the reliability of the present ANEW adaptation for Italian by comparing it to previous affective databases and performing split-half correlations for each variable. We found high split-half correlations within our sample and high correlations between our ratings and those of previous studies, confirming the validity of the adaptation of ANEW for Italian. This database of affective norms provides a tool for future research about the effects of emotion on human cognition.     

Children’s emotional norms for 600 French words

The present study provides a French child database containing a large corpus of words (N=600) that were rated on emotional valence (positive, neutral, and negative) by French children differing in both age (5, 7, and 9 years old) and sex (girls and boys). Good response reliability was observed in each of the three age groups. The results showed some age differences in the children’s ratings. With increasing age, the percentage of words rated positive decreased, whereas the percentage of neutral words increased and the percentage of negative words remained stable. Our study did not reveal marked differences across sex groups. The database compiled here should become a useful tool for experimental studies in which verbal material is used with children. It would be worthwhile in future research to study how children process emotional words and also to control the emotional variable in the same way as other linguistic variables in the experimental design. The norms from this study may be downloaded from brm.psychonomic-journals.org/content/supplemental.     

Not all disfluencies are are equal: The effects of disfluent repetitions on language comprehension

Disfluencies can affect language comprehension, but to date, most studies have focused on disfluent pauses such as er. We investigated whether disfluent repetitions in speech have discernible effects on listeners during language comprehension, and whether repetitions affect the linguistic processing of subsequent words in speech in ways which have been previously observed with ers. We used event-related potentials (ERPs) to measure participants’ neural responses to disfluent repetitions of words relative to acoustically identical words in fluent contexts, as well as to unpredictable and predictable words that occurred immediately post-disfluency and in fluent utterances. We additionally measured participants’ recognition memories for the predictable and unpredictable words. Repetitions elicited an early onsetting relative positivity (100–400 ms post-stimulus), clearly demonstrating listeners’ sensitivity to the presence of disfluent repetitions. Unpredictable words elicited an N400 effect. Importantly, there was no evidence that this effect, thought to reflect the difficulty of semantically integrating unpredictable compared to predictable words, differed quantitatively between fluent and disfluent utterances. Furthermore there was no evidence that the memorability of words was affected by the presence of a preceding repetition. These findings contrast with previous research which demonstrated an N400 attenuation of, and an increase in memorability for, words that were preceded by an er. However, in a later (600–900 ms) time window, unpredictable words following a repetition elicited a relative positivity. Reanalysis of previous data confirmed the presence of a similar effect following an er. The effect may reflect difficulties in resuming linguistic processing following any disruption to speech.     

Modality exclusivity norms for 423 object properties

Recent work has shown that people routinely use perceptual information during language comprehension and conceptual processing, from single-word recognition to modality-switching costs in property verification. In investigating such links between perceptual and conceptual representations, the use of modality-specific stimuli plays a central role. To aid researchers working in this area, we provide a set of norms for 423 adjectives, each describing an object property, with mean ratings of how strongly that property is experienced through each of five perceptual modalities (visual, haptic, auditory, olfactory, and gustatory). The data set also contains estimates of modality exclusivity—that is, a measure of the extent to which a particular property may be considered unimodal (i.e., perceived through one sense alone). Although there already exists a number of sets of word and object norms, we provide the first set to categorize words describing object properties along the dimensions of the five perceptual modalities. We hope that the norms will be of use to researchers working at the interface between linguistic, conceptual, and perceptual systems. The modality exclusivity norms may be downloaded as supplemental materials for this article from brm.psychonomic-journals.org/ content/supplemental.     

Number-of-translation norms for Dutch—English translation pairs: A new tool for examining language production

We collected number-of-translation norms on 562 Dutch-English translation pairs from several previous studies of cross-language processing. Participants were highly proficient Dutch—English bilinguals. Form and semantic similarity ratings were collected on the 1,003 possible translation pairs. Approximately 40% of the translations were rated as being similar across languages with respect to spelling/sound (i.e., they were cognates). Approximately 45% of the translations were rated as being highly semantically similar across languages. At least 25% of the words in each direction of translation had more than one translation. The form similarity ratings were found to be highly reliable even when obtained with different bilinguals and modified rating procedures. Number of translations and meaning factors significantly predicted the semantic similarity of translation pairs. In future research, these norms may be used to determine the number of translations of words to control for or study this factor. These norms are available at http://www.talkbank.org/norms/tokowicz/.     

The Bristol norms for age of acquisition, imageability, and familiarity

Ratings of age of acquisition (AoA), imageability, and familiarity were collected for 1,526 words. The methodology made use of a modular approach, in which the full sample of words was divided into five separate blocks. Within each block, each word was rated on each of the three variables by 20 participants (undergraduate students from the University of Bristol). Analyses comparing these ratings to existing norm databases demonstrated that this methodology resulted in high reliability (assessed by Cronbach’s α) and validity. The ratings were also transformed to be compatible with the Gilhooly and Logie (1980) norms. This transformation resulted in a set of norms for 3,394 words, which is by far the largest database of ratings for AoA, imageability, and familiarity to date. The resulting database should be useful for researchers interested in manipulating or controlling these factors in word recognition, neuropsychological, or memory studies. These norms can be downloaded from language.psy.bris .ac.uk/bristol_norms.html.     

Linguistic features of dysfluencies in Parkinson Disease

PurposeThe purpose of this study was to examine dysfluency characteristics of individuals with Parkinson Disease (PD) relative to linguistic features of grammatical class and position within word. Few studies have reported dysfluency characteristics of PD relative to these characteristics. Those that do report on these characteristics include one case study and a study of six individuals with PD. No previous research is known to have examined dysfluency related to grammatical class and position within words for a large sample of individuals with PD.MethodDysfluencies from 32 individuals with PD were analyzed according to position within a word and grammatical class.ResultsParticipants produced significantly more dysfluencies in the initial position of words compared to medial or final positions, and a significantly higher percent dysfluency for content words versus function words.ConclusionEffects of linguistic features of grammatical class and position within a word on dysfluencies are present within a population with PD and are similar to the linguistic features associated with developmental stuttering. Clinical implications of the effect of linguistic features on speech dysfluencies in PD are discussed.     

Talker-specific learning in speech perception

The effects of perceptual learning of talker identity on the recognition of spoken words and sentences were investigated in three experiments. In each experiment, listeners were trained to learn a set of 10 talkers’ voices and were then given an intelligibility test to assess the influence of learning the voices on the processing of the linguistic content of speech. In the first experiment, listeners learned voices from isolated words and were then tested with novel isolated words mixed in noise. The results showed that listeners who were given words produced by familiar talkers at test showed better identification performance than did listeners who were given words produced by unfamiliar talkers. In the second experiment, listeners learned novel voices from sentence-length utterances and were then presented with isolated words. The results showed that learning a talker’s voice from sentences did not generalize well to identification of novel isolated words. In the third experiment, listeners learned voices from sentence-length utterances and were then given sentence-length utterances produced by familiar and unfamiliar talkers at test. We found that perceptual learning of novel voices from sentence-length utterances improved speech intelligibility for words in sentences. Generalization and transfer from voice learning to linguistic processing was found to be sensitive to the talker-specific information available during learning and test. These findings demonstrate that increased sensitivity to talker-specific information affects the perception of the linguistic properties of speech in isolated words and sentences.     

Words Get in the Way: Linguistic Effects on Talker Discrimination

A speech perception experiment provides evidence that the linguistic relationship between words affects the discrimination of their talkers. Listeners discriminated two talkers' voices with various linguistic relationships between their spoken words. Listeners were asked whether two words were spoken by the same person or not. Word pairs varied with respect to the linguistic relationship between the component words, forming either: phonological rhymes, lexical compounds, reversed compounds, or unrelated pairs. The degree of linguistic relationship between the words affected talker discrimination in a graded fashion, revealing biases listeners have regarding the nature of words and the talkers that speak them. These results indicate that listeners expect a talker's words to be linguistically related, and more generally, indexical processing is affected by linguistic information in a top‐down fashion even when listeners are not told to attend to it.     

Semantic classification of pictures and words

We provide new behavioural norms for semantic classification of pictures and words. The picture stimuli are 288 black and white line drawings from the International Picture Naming Project ([Székely, A., Jacobsen, T., D'Amico, S., Devescovi, A., Andonova, E., Herron, D., et al. (2004). A new on-line resource for psycholinguistic studies. Journal of Memory & Language, 51, 247–250]). We presented these pictures for classification in a living/nonliving decision, and in a separate version of the task presented the corresponding word labels for classification. We analyzed behavioural responses to a subset of the stimuli in order to explore questions about semantic processing. We found multiple semantic richness effects for both picture and word classification. Further, while lexical-level factors were related to semantic classification of words, they were not related to semantic classification of pictures. We argue that these results are consistent with privileged semantic access for pictures, and point to ways in which these data could be used to address other questions about picture processing and semantic memory.     

Linguistic Convergence to Observed Versus Expected Behavior in an Alien-Language Map Task

Individuals shift their language to converge with interlocutors. Recent work has suggested that convergence can target not only observed but also expected linguistic behavior, cued by social information. However, it remains uncertain how expectations and observed behavior interact, particularly when they contradict each other. We investigated this using a cooperative map task experiment, in which pairs of participants communicated online by typing messages to each other in a miniature “alien” language that exhibited variation between alien species. The overall task comprised three phases, in each of which participants were told that they would be paired with a different partner. One member of the pair was given explicit linguistic expectations in each phase, while the software controlled whether or not observed behavior from their partner would be consistent or inconsistent with these expectations. The other participant was given no such expectations, allowing us to control for the role of expectation. Participants converged to both observed and expected linguistic behavior, and convergence was boosted when observation and expectation were aligned. When expected and observed behavior were misaligned, participants updated their expectations, though convergence levels did not drop. Furthermore, participants generalized what they learned about one partner to apparent novel partners of the same alien species. We also discuss individual variation in convergence patterns and the lack of a relationship between linguistic convergence and success at the map task. Findings are consistent with observations outside the laboratory that language users converge toward expected linguistic behavior. They also have broader implications for understanding linguistic accommodation and the influence of social information on linguistic processing and production.     

Expanded norms for 400 experimental pictures in an Argentinean Spanish-speaking population

The study of the cognitive processes in the production of language demands careful selection of stimuli and requires normative databases. The main goal of the present research was to collect normative data for the set of 400 figures taken from Cycowicz, Friedman, Rothstein, and Snodgrass (1997; including the 260 figures of Snodgrass & Vanderwart, 1980) using a sample of native Argentinean Spanish speakers. The pictures have been standardized on the following variables: name agreement, image agreement, familiarity, visual complexity, image variability, age of acquisition, and word association. The obtained norms were compared with the normative data of other studies in Spanish, English, and French. This comparison highlights the variability of some of the measures (e.g., name agreement in naming and verbal association) across the different studies and confirms the necessity of elaborating specific norms that are adapted to the studied population’s linguistic and sociocultural context. The norms described may be downloaded as supplemental materials for this article from http://brm.psychonomic-journals.org/content/supplemental.     

Priming and the effects of sentence and lexical contexts on naming time: Evidence for autonomous lexical processing

Models of language processing which stress the autonomy of processing at each level predict that the semantic properties of an incomplete sentence context should have no influence on lexical processing, either facilitatory or inhibitory. An experiment similar to those reported by Fischler and Bloom (1979) and Stanovich and West (1979, 1981) was conducted using naming time as an index of lexical access time. No facilitatory effects of context were observed for either highly predictable or semantically appropriate (but unpredictable) completions, whereas strong inhibitory effects were obtained for inappropriate completions. When lexical decision time was the dependent measure, the same results were obtained, except that predictable completions now produced strong facilitation. In a further experiment the inhibitory effects of context on lexical decision times for inappropriate targets were maintained, even though unfocussed contexts were used, in which no clear expectancy for a particular completion was involved. These results were interpreted in terms of a two-factor theory which attributes the facilitation observed with the lexical decision task to postaccess decision processes which are not involved in the naming task. The inhibitory effects were attributed to interference resulting from semantic integration. In contrast to the results for sentence contexts, lexical contexts of the doctor-nurse variety produced clear facilitation effects on naming time (but no inhibitory effects). It was also shown that relatively minor variations in the type of neutral context could completely alter the relative importance of facilitation and inhibition.     

The effects of aging on selectivity and control in short-term recall

The ability to control encoding and retrieval processing strategically is critical for the efficient use of memory. We examined the ability of younger and older adults to selectively remember words on the basis of their arbitrary point values by using a technique developed by Watkins and Bloom (1999). In the first three experiments, younger subjects recalled more words than did older subjects, but an independent index of recall selectivity showed that older subjects were apparently more successful in selecting higher valued words. However, a fourth experiment showed that this superior selectivity on the part of older adults was attributable to their greater proportional reliance on primary memory recall. Overall, the data suggest that although older adults recall fewer words than do younger adults, they exert as much control over some aspects of encoding.     

Speech event related potentials reflect linguistic content and processing level

Amplitude changes in the auditory event related response reflect differences in linguistic content and the level of processing of spoken sentences. Thus, the neurophysiology of the cognitive processes underlying speech perception can be evaluated by noninvasive techniques. Semantically correct, semantically incorrect, and grammatically incorrect sentences were processed either semantically or syntactically by 25 subjects while their EEGs were recorded. The amplitude of the P250 component to each word varied with processing level. A slow positive wave appeared after semantically correct sentences regardless of the linguistic processing level. N480 and P780 components were observed following words which made the sentences incorrect.