Norms of valence, arousal, dominance, and age of acquisition for 4,300 Dutch words

This article presents norms of valence/pleasantness, activity/arousal, power/dominance, and age of acquisition for 4,300 Dutch words, mainly nouns, adjectives, adverbs, and verbs. The norms are based on ratings with a 7-point Likert scale by independent groups of students from two Belgian (Ghent and Leuven) and two Dutch (Rotterdam and Leiden-Amsterdam) samples. For each variable, we obtained high split-half reliabilities within each sample and high correlations between samples. In addition, the valence ratings of a previous, more limited study (Hermans & De Houwer, Psychologica Belgica, 34:115-139, 1994) correlated highly with those of the present study. Therefore, the new norms are a valuable source of information for affective research in the Dutch language.     

Norms of valence, arousal, and dominance for 13,915 English lemmas

Information about the affective meanings of words is used by researchers working on emotions and moods, word recognition and memory, and text-based sentiment analysis. Three components of emotions are traditionally distinguished: valence (the pleasantness of a stimulus), arousal (the intensity of emotion provoked by a stimulus), and dominance (the degree of control exerted by a stimulus). Thus far, nearly all research has been based on the ANEW norms collected by Bradley and Lang (1999) for 1,034 words. We extended that database to nearly 14,000 English lemmas, providing researchers with a much richer source of information, including gender, age, and educational differences in emotion norms. As an example of the new possibilities, we included stimuli from nearly all of the category norms (e.g., types of diseases, occupations, and taboo words) collected by Van Overschelde, Rawson, and Dunlosky (Journal of Memory and Language 50:289-335, 2004), making it possible to include affect in studies of semantic memory.     

Norms of valence,arousal, concreteness,familiarity, imageability,and context availability for 1,100 Chinese words

In the present study, we collected valence, arousal, concreteness, familiarity, imageability, and context availability ratings for a total of 1,100 Chinese words. The ratings for all variables were collected with 9-point Likert scales. We tested the reliability of the present database by comparing it to the extant Chinese Affective Word System, and performed split-half correlations for all six variables. We then evaluated the relationships between all variables. Regarding the affective variables, we found a typical quadratic relation between valence and arousal, in line with previous findings. Likewise, significant correlations were found between the semantic variables. Importantly, we explored the relationships between ratings for the affective variables (i.e., valence and arousal) and concreteness ratings, suggesting that valence and arousal ratings can predict concreteness ratings. This database of affective norms will be a valuable source of information for emotion research that makes use of Chinese words, and will enable researchers to use highly controlled Chinese verbal stimuli to more reliably investigate the relation between cognition and emotion.     

When is best-worst best? A comparison of best-worst scaling,numeric estimation,and rating scales for collection of semantic norms

Large-scale semantic norms have become both prevalent and influential in recent psycholinguistic research. However, little attention has been directed towards understanding the methodological best practices of such norm collection efforts. We compared the quality of semantic norms obtained through rating scales, numeric estimation, and a less commonly used judgment format called best-worst scaling. We found that best-worst scaling usually produces norms with higher predictive validities than other response formats, and does so requiring less data to be collected overall. We also found evidence that the various response formats may be producing qualitatively, rather than just quantitatively, different data. This raises the issue of potential response format bias, which has not been addressed by previous efforts to collect semantic norms, likely because of previous reliance on a single type of response format for a single type of semantic judgment. We have made available software for creating best-worst stimuli and scoring best-worst data. We also made available new norms for age of acquisition, valence, arousal, and concreteness collected using best-worst scaling. These norms include entries for 1,040 words, of which 1,034 are also contained in the ANEW norms (Bradley & Lang, Affective norms for English words (ANEW): Instruction manual and affective ratings (pp. 1-45). Technical report C-1, the center for research in psychophysiology, University of Florida, 1999).     

The Spanish adaptation of ANEW (Affective Norms for English Words)

This article presents the Spanish adaptation of the Affective Norms for English Words (ANEW; Bradley & Lang, 1999). The norms are based on 720 participants' assessments of the translation into Spanish of the 1,034 words included in the ANEW. The evaluations were done in the dimensions of valence, arousal and dominance using the Self-Assessment Manikin (SAM). Apart from these dimensions, five objective (number of letters, number of syllables, grammatical class, frequency and number of orthographic neighbors) and three subjective (familiarity, concreteness and imageability) psycholinguistic indexes are included. The Spanish adaptation of ANEW can be downloaded at www.psychonomic.org.     

Cross-modal validation of the Leipzig Affective Norms for German (LANG)

Affective stimuli are increasingly used in emotion research. Typically, stimuli are selected from databases providing affective norms. The validity of these norms is a critical factor with regard to the applicability of the stimuli for emotion research. We therefore probed the validity of the Leipzig Affective Norms for German (LANG) by correlating valence and arousal ratings across different sensory modalities. A sample of 120 words was selected from the LANG database, and auditory recordings of these words were obtained from two professional actors. The auditory stimuli were then rated again for valence and arousal. This cross-modal validation approach yielded very high correlations between auditory and visual ratings (>.95). These data confirm the strong validity of the Leipzig Affective Norms for German and encourage their use in emotion research.     

Dutch taboo norms

This article provides norms for general taboo, personal taboo, insult, valence, and arousal for 672 Dutch words, including 202 taboo words. Norms were collected using a 7-point Likert scale and based on ratings by psychology students from the Erasmus University Rotterdam in The Netherlands. The sample consisted of 87 psychology students (58 females, 29 males). We obtained high reliability based on split-half analyses. Our norms show high correlations with arousal and valence ratings collected by another Dutch word-norms study (Moors et al.,, Behavior Research Methods, 45, 169–177, 2013). Our results show that the previously found quadratic relation (i.e., U-shaped pattern) between valence and arousal also holds when only taboo words are considered. Additionally, words rated high on taboo tended to be rated low on valence, but some words related to sex rated high on both taboo and valence. Words that rated high on taboo rated high on insult, again with the exception of words related to sex many of which rated low on insult. Finally, words rated high on taboo and insult rated high on arousal. The Dutch Taboo Norms (DTN) database is a useful tool for researchers interested in the effects of taboo words on cognitive processing. The data associated with this paper can be accessed via the Open Science Framework (https://osf.io/vk782/).     

The adaptation of the Affective Norms for English Words (ANEW) for European Portuguese

This study presents the adaptation of the Affective Norms for English Words (ANEW; Bradley & Lang, 1999a) for European Portuguese (EP). The EP adaptation of the ANEW was based on the affective ratings made by 958 college students who were EP native speakers. Subjects assessed about 60 words by considering the affective dimensions of valence, arousal, and dominance, using the Self-Assessment Manikin (SAM) in either a paper-and-pencil or a Web survey procedure. Results of the adaptation of the ANEW for EP are presented. Furthermore, the differences between EP, American (Bradley & Lang, 1999a), and Spanish (Redondo, Fraga, Padrón, & Comesa?a, Behavior Research Methods, 39, 600–605, 2007) standardizations were explored. Results showed that the ANEW words were understood in a similar way by EP, American, and Spanish subjects, although some sex and cross-cultural differences were observed. The EP adaptation of the ANEW is shown to be a valid and useful tool that will allow researchers to control and/or manipulate the affective properties of stimuli, as well as to develop cross-linguistic studies. The normative values of EP adaptation of the ANEW can be downloaded at .     

Reproducing affective norms with lexical co-occurrence statistics: Predicting valence,arousal, and dominance

Human ratings of valence, arousal, and dominance are frequently used to study the cognitive mechanisms of emotional attention, word recognition, and numerous other phenomena in which emotions are hypothesized to play an important role. Collecting such norms from human raters is expensive and time consuming. As a result, affective norms are available for only a small number of English words, are not available for proper nouns in English, and are sparse in other languages. This paper investigated whether affective ratings can be predicted from length, contextual diversity, co-occurrences with words of known valence, and orthographic similarity to words of known valence, providing an algorithm for estimating affective ratings for larger and different datasets. Our bootstrapped ratings achieved correlations with human ratings on valence, arousal, and dominance that are on par with previously reported correlations across gender, age, education and language boundaries. We release these bootstrapped norms for 23,495 English words.     

English semantic word-pair norms and a searchable Web portal for experimental stimulus creation

As researchers explore the complexity of memory and language hierarchies, the need to expand normed stimulus databases is growing. Therefore, we present 1,808 words, paired with their features and concept–concept information, that were collected using previously established norming methods (McRae, Cree, Seidenberg, & McNorgan Behavior Research Methods 37:547–559, 2005). This database supplements existing stimuli and complements the Semantic Priming Project (Hutchison, Balota, Cortese, Neely, Niemeyer, Bengson, & Cohen-Shikora 2010). The data set includes many types of words (including nouns, verbs, adjectives, etc.), expanding on previous collections of nouns and verbs (Vinson & Vigliocco Journal of Neurolinguistics 15:317–351, 2008). We describe the relation between our and other semantic norms, as well as giving a short review of word-pair norms. The stimuli are provided in conjunction with a searchable Web portal that allows researchers to create a set of experimental stimuli without prior programming knowledge. When researchers use this new database in tandem with previous norming efforts, precise stimuli sets can be created for future research endeavors.     

Affective auditory stimuli: Adaptation of the International Affective Digitized Sounds (IADS-2) for European Portuguese

In this study, we present the normative values of the adaptation of the International Affective Digitized Sounds (IADS-2; Bradley & Lang, 2007a) for European Portuguese (EP). The IADS-2 is a standardized database of 167 naturally occurring sounds that is widely used in the study of emotions. The sounds were rated by 300 college students who were native speakers of EP, in the three affective dimensions of valence, arousal, and dominance, by using the Self-Assessment Manikin (SAM). The aims of this adaptation were threefold: (1)?to provide researchers with standardized and normatively rated affective sounds to be used with an EP population; (2)?to investigate sex and cultural differences in the ratings of affective dimensions of auditory stimuli between EP and the American (Bradley & Lang, 2007a) and Spanish (Fernández-Abascal et al., Psicothema 20:104–113 2008; Redondo, Fraga, Padrón, & Piñeiro, Behavior Research Methods 40:784–790 2008) standardizations; and (3)?to promote research on auditory affective processing in Portugal. Our results indicated that the IADS-2 is a valid and useful database of digitized sounds for the study of emotions in a Portuguese context, allowing for comparisons of its results with those of other international studies that have used the same database for stimulus selection. The normative values of the EP adaptation of the IADS-2 database can be downloaded along with the online version of this article.     

Leipzig Affective Norms for German: A reliability study

To facilitate investigations of verbal emotional processing, we introduce the Leipzig Affective Norms for German (LANG), a list of 1,000 German nouns that have been rated for emotional valence, arousal, and concreteness. A critical factor regarding the quality of normative word data is their reliability. We therefore acquired ratings from a sample that was tested twice, with an interval of 2 years, to calculate test—retest reliability. Furthermore, we recruited a second sample to test reliability across independent samples. The results show (1) the typical quadratic relation of valence and arousal, replicating previous data, (2) very high test—retest reliability (>.95), and (3) high correlations between the two samples (>.85). Because the range of ratings was also very high, we provide a comprehensive set of words with reliable affective norms, which makes it possible to select highly controlled subsamples varying in emotional status. The database is available as a supplement for this article at http://brm.psychonomic-journals.org/content/supplemental.     

EMOVAL : évaluation automatique de la valence et de l’activation émotionnelles des textes à l’aide d’une méta-norme de 5656 mots-racines

EMOVAL: automatic evaluation the emotional valence and arousal of texts using a 5656 root-words metanorm. EMOVAL is an emotional valence and arousal analysis model of texts. EMOVAL draws from linguistic tradition the hypothesis that every word has a denotative aspect (“meaning”) and a connotative aspect (“affective halo”). It uses a meta-analysis of seven French norms and one English norm with the objective to characterize the emotional valence of texts, paragraphs, or sentences in a pleasant or unpleasant way. The meta-analysis indicates that the seven French norms data are highly correlated in between (0.82 to 0.99), and highly correlated with the Affectiv Norm for English Words (Bradley et Lang, 1999) (0.81 to 0.97). Arousal values taken from Affective Norm for English Words (ANEW) (Bradley et Lang, 1999) and the Leleu (1987) norm are significately correlated (0.55). The metanorm has 5656 words (nouns, verbs, adjectives, adverbs) characterized in valence (−1 to +1), and 3265 words characterized in arousal. These items are used by EMOVAL for valence judgments of texts. Two types of texts are proposed: the evaluation of the whole (702) or of extracts (110) of a corpus of sentences judged in a seven-point scale (−3 very unpleasant to +3 very pleasant) (Bestgen et al., 2004), and of 12 texts positively valenced (happiness and good surprise) and negatively valenced (fear, anger, disgust, sadness, and bad surprise). These two types of tests confirm the psychological pertinence of EMOVAL. Limits regarding the arousal dimension are discussed. The metanorm presented in this article can be obtained from the authors.     

Affective norms for 210 British English and Finnish nouns

This article presents affective ratings for 210 British English and Finnish nouns, including taboo words. The norms were collected with 135 native British English and 304 native Finnish speakers, who rated the words according to their emotional valence, emotional charge, offensiveness, concreteness, and familiarity. The ratings between the two languages were found to be strongly correlated. The present ratings were also strongly correlated with the American English emotional valence and arousal ratings available in the Affective Norms for English Words database (Bradley & Lang, 1999) and the Janschewitz (2008) database for taboo words. These ratings will help researchers to select stimulus materials for a wide range of experiments involving both monolingual and bilingual processing of British English and Finnish emotional words. Materials associated with this article may be accessed as an online supplement from http://brm.psychonomic-journals.org/content/supplemental.     

Concreteness norms for 1,659 French words: Relationships with other psycholinguistic variables and word recognition times

Words that correspond to a potential sensory experience—concrete words—have long been found to possess a processing advantage over abstract words in various lexical tasks. We collected norms of concreteness for a set of 1,659 French words, together with other psycholinguistic norms that were not available for these words—context availability, emotional valence, and arousal—but which are important if we are to achieve a better understanding of the meaning of concreteness effects. We then investigated the relationships of concreteness with these newly collected variables, together with other psycholinguistic variables that were already available for this set of words (e.g., imageability, age of acquisition, and sensory experience ratings). Finally, thanks to the variety of psychological norms available for this set of words, we decided to test further the embodied account of concreteness effects in visual-word recognition, championed by Kousta, Vigliocco, Vinson, Andrews, and Del Campo (Journal of Experimental Psychology: General, 140, 14–34, 2011). Similarly, we investigated the influences of concreteness in three word recognition tasks—lexical decision, progressive demasking, and word naming—using a multiple regression approach, based on the reaction times available in Chronolex (Ferrand, Brysbaert, Keuleers, New, Bonin, Méot, Pallier, Frontiers in Psychology, 2; 306, 2011). The norms can be downloaded as supplementary material provided with this article.     

Humor norms for 4,997 English words

Humor ratings are provided for 4,997 English words collected from 821 participants using an online crowd-sourcing platform. Each participant rated 211 words on a scale from 1 (humorless) to 5 (humorous). To provide for comparisons across norms, words were chosen from a set common to a number of previously collected norms (e.g., arousal, valence, dominance, concreteness, age of acquisition, and reaction time). The complete dataset provides researchers with a list of humor ratings and includes information on gender, age, and educational differences. Results of analyses show that the ratings have reliability on a par with previous ratings and are not well predicted by existing norms.     

Affective norms for 380 Spanish words belonging to three different semantic categories

Emotional words are increasingly used in the study of word processing. To elucidate whether the experimental effects obtained with these words are due either to their affective content or to other semantic characteristics, it is necessary to conduct experiments with affectively valenced words obtained from different semantic categories. In the present article, we present affective ratings for 380 Spanish words belonging to three semantic categories: animals, people, and objects. The norms are based on the assessments made by 504 participants, who rated about 47 words either in valence and arousal, by using the Self-Assessment Manikin (Bradley & Lang, Journal of Behavioral Therapy and Experimental Psychiatry, 25, 49-59. 1994), or in concreteness and familiarity. These ratings will help researchers select stimuli for experiments in which both the affective properties of words and their membership to a given semantic category have to be taken into account. The database is available as an online supplement for this article.     

Moved by words: Affective ratings for a set of 2,266 Spanish words in five discrete emotion categories

The two main theoretical accounts of the human affective space are the dimensional perspective and the discrete-emotion approach. In recent years, several affective norms have been developed from a dimensional perspective, including ratings for valence and arousal. In contrast, the number of published datasets relying on the discrete-emotion approach is much lower. There is a need to fill this gap, considering that discrete emotions have an effect on word processing above and beyond those of valence and arousal. In the present study, we present ratings from 1,380 participants for a set of 2,266 Spanish words in five discrete emotion categories: happiness, anger, fear, disgust, and sadness. This will be the largest dataset published to date containing ratings for discrete emotions. We also present, for the first time, a fine-grained analysis of the distribution of words into the five emotion categories. This analysis reveals that happiness words are the most consistently related to a single, discrete emotion category. In contrast, there is a tendency for many negative words to belong to more than one discrete emotion. The only exception is disgust words, which overlap least with the other negative emotions. Normative valence and arousal data already exist for all of the words included in this corpus. Thus, the present database will allow researchers to design studies to contrast the predictions of the two most influential theoretical perspectives in this field. These studies will undoubtedly contribute to a deeper understanding of the effects of emotion on word processing.     

No grammatical gender effect on affective ratings: evidence from Italian and German languages

In this study, we tested the linguistic relativity hypothesis by studying the effect of grammatical gender (feminine vs. masculine) on affective judgments of conceptual representation in Italian and German. In particular, we examined the within- and cross-language grammatical gender effect and its interaction with participants’ demographic characteristics (such as, the raters’ age and sex) on semantic differential scales (affective ratings of valence, arousal and dominance) in Italian and German speakers. We selected the stimuli and the relative affective measures from Italian and German adaptations of the ANEW (Affective Norms for English Words). Bayesian and frequentist analyses yielded evidence for the absence of within- and cross-languages effects of grammatical gender and sex- and age-dependent interactions. These results suggest that grammatical gender does not affect judgments of affective features of semantic representation in Italian and German speakers, since an overt coding of word grammar is not required. Although further research is recommended to refine the impact of the grammatical gender on properties of semantic representation, these results have implications for any strong view of the linguistic relativity hypothesis.