Exploring What Is Encoded in Distributional Word Vectors: A Neurobiologically Motivated Analysis

The pervasive use of distributional semantic models or word embeddings for both cognitive modeling and practical application is because of their remarkable ability to represent the meanings of words. However, relatively little effort has been made to explore what types of information are encoded in distributional word vectors. Knowing the internal knowledge embedded in word vectors is important for cognitive modeling using distributional semantic models. Therefore, in this paper, we attempt to identify the knowledge encoded in word vectors by conducting a computational experiment using Binder et al.'s (2016) featural conceptual representations based on neurobiologically motivated attributes. In an experiment, these conceptual vectors are predicted from text-based word vectors using a neural network and linear transformation, and prediction performance is compared among various types of information. The analysis demonstrates that abstract information is generally predicted more accurately by word vectors than perceptual and spatiotemporal information, and specifically, the prediction accuracy of cognitive and social information is higher. Emotional information is also found to be successfully predicted for abstract words. These results indicate that language can be a major source of knowledge about abstract attributes, and they support the recent view that emphasizes the importance of language for abstract concepts. Furthermore, we show that word vectors can capture some types of perceptual and spatiotemporal information about concrete concepts and some relevant word categories. This suggests that language statistics can encode more perceptual knowledge than often expected.     

The Role of Attention in Word Recognition: Results from OB1-Reader

When reading, orthographic information is extracted not only from the word the reader is looking at, but also from adjacent words in the parafovea. Here we examined, using the recently introduced OB1-reader computational model, how orthographic information can be processed in parallel across multiple words and how orthographic information can be integrated across time and space. Although OB1-reader is a model of text reading, here we used it to simulate single-word recognition experiments in which parallel processing has been shown to play a role by manipulating the surrounding context in flanker and priming paradigms. In flanker paradigms, observers recognize a central word flanked by other letter strings located left and right of the target and separated from the target by a space. The model successfully accounts for the finding that such flankers can aid word recognition when they contain bigrams of the target word, independent of where those flankers are in the visual field. In priming experiments, in which the target word is preceded by a masked prime, the model accounts for the finding that priming occurs independent of whether the prime and target word are in the same location or not. Crucial to these successes is the key role that spatial attention plays within OB1-reader, as it allows the model to receive visual input from multiple locations in parallel, while limiting the kinds of errors that can potentially occur under such spatial pooling of orthographic information.     

A Principled Approach to Feature Selection in Models of Sentence Processing

Among theories of human language comprehension, cue-based memory retrieval has proven to be a useful framework for understanding when and how processing difficulty arises in the resolution of long-distance dependencies. Most previous work in this area has assumed that very general retrieval cues like [+subject] or [+singular] do the work of identifying (and sometimes misidentifying) a retrieval target in order to establish a dependency between words. However, recent work suggests that general, handpicked retrieval cues like these may not be enough to explain illusions of plausibility (Cunnings & Sturt, 2018), which can arise in sentences like The letter next to the porcelain plate shattered. Capturing such retrieval interference effects requires lexically specific features and retrieval cues, but handpicking the features is hard to do in a principled way and greatly increases modeler degrees of freedom. To remedy this, we use well-established word embedding methods for creating distributed lexical feature representations that encode information relevant for retrieval using distributed retrieval cue vectors. We show that the similarity between the feature and cue vectors (a measure of plausibility) predicts total reading times in Cunnings and Sturt’s eye-tracking data. The features can easily be plugged into existing parsing models (including cue-based retrieval and self-organized parsing), putting very different models on more equal footing and facilitating future quantitative comparisons.     

The role of attentional slippage in Stroop dilution

The present study examined the cognitive locus of Stroop dilution using a psychological refractory period (PRP) paradigm. Participants were asked to perform a tone discrimination task via a bimanual keypress response and a modified Stroop task via a vocal response serially as Task 1 and Task 2, respectively. In Task 2, a neutral word was added on half of the trials and no neutral word on the other half of the trials to observe the Stroop dilution effect. The amount of Stroop dilution, as well as the Stroop effect, was relatively constant across different stimulus-onset asynchronies (SOAs), which implies that Stroop dilution occurs due to the competition between a neutral word and a color word after a target color bar is selected to be processed further. These results indicate that focused attention plays an important role in the modulation of Stroop interference by the presence of a neutral word.     

A study of student assessment of the lexical and emotional characteristics of cancer-related words

IntroductionThe aim of this study was to clarify students’ knowledge and emotional feelings about words used in the announcement of cancer diagnoses.MethodA total of 465 students registered in a higher education institution rated familiarity, valence and arousal, and responded to questions about the definition and the contextual use of 20 cancer-related target words.ResultsThe words were estimated as being unfamiliar and negative, and were poorly defined by the majority of students. Many of these indicators varied according to whether the students reported having a relative diagnosed with cancer, and to their level of vocabulary.DiscussionThis study provides explanatory leads that should help to shed light on the nature of the difficulties students have in understanding medical messages.     

空间频率影响恐惧面孔表情加工的神经通路

恐惧情绪由于其具有威胁性而优先得到有效的加工。其中空间频率作为处理面孔信息的基础成分, 通过不同的神经通路影响恐惧面孔表情的加工。双通路观点认为在皮层下通路上, 低空间频率的恐惧面孔表情存在优先传递性, 高空间频率则主要通过皮层通路对恐惧面孔表情进行精细化加工; 而多通路则能够更加灵活地处理空间频率对情绪加工的影响。未来研究应明确脑区及其子区域在多条通路上的作用, 从而进一步验证视觉信息是如何影响情绪加工的。     

It's what's on the outside that matters: an advantage for external features in children's word recognition

The relative importance of internal and external letter features of words in children's developing reading was investigated to clarify further the nature of early featural analysis. In Experiment 1, 72 6-, 8-, and 10-year-olds read aloud words displayed as wholes, external features only (central features missing, thereby preserving word shape information), or internal features only (central features preserved). There was an improvement in the processing of external features compared with internal features as reading experience increased. Experiment 2 examined the processing of the internal and external features of words employing a forward priming paradigm with 60 8-, 10-, and 12-year-olds. Reaction times to internal feature primes were equivalent to a nonprime blank condition, whereas responses to external feature primes were faster than those to the other two prime types. This advantage for the external features of words is discussed in terms of an early and enduring role for processing the external visual features in words during reading development.     

Stimulus affectivity of the Danish Word Association Test as measured by response heterogeneity and Rasch scaled number of prolonged reaction times

With the purpose of increasing the knowledge of the psychometric properties of the 70-item Danish Word Association Test, data from three samples of non-patients and psychiatric patients (N = 326) were used to provide two measures of affectivity of the stimulus words, response heterogeneity and reaction time prolongation. It was possible to fit an item response theory one-parameter measurement (Rasch) model to the number of reaction time prolongations (> or =3 seconds) for 54 of the stimulus words. Correlation between Rasch-model item parameters and response heterogeneity was high (r = 0.86), while no correlation was found between either of these measures and frequency of the stimulus words in the Danish language. Both measures of stimulus affectivity supported a theoretically based classification of stimulus words as emotional or neutral. Response heterogeneity measures and Rasch measurement item and person parameters for reaction time prolongations are provided.     

Implicit and explicit processing in deep dyslexia: Semantic blocking as a test for failure of inhibition in the phonological output lexicon

The failure of inhibition hypothesis posits a theoretical distinction between implicit and explicit access in deep dyslexia. Specifically, the effects of failure of inhibition are assumed only in conditions that have an explicit selection requirement in the context of production (i.e., aloud reading). In contrast, the failure of inhibition hypothesis proposes that implicit processing and explicit access to semantic information without production demands are intact in deep dyslexia. Evidence for intact implicit and explicit access requires that performance in deep dyslexia parallels that observed in neurologically intact participants on tasks based on implicit and explicit processes. In other words, deep dyslexics should produce normal effects in conditions with implicit task demands (i.e., lexical decision) and on tasks based on explicit access without production (i.e., forced choice semantic decisions) because failure of inhibition does not impact the availability of lexical information, only explicit retrieval in the context of production. This research examined the distinction between implicit and explicit processes in deep dyslexia using semantic blocking in lexical decision and forced choice semantic decisions as a test for the failure of inhibition hypothesis. The results of the semantic blocking paradigm support the distinction between implicit and explicit processing and provide evidence for failure of inhibition as an explanation for semantic errors in deep dyslexia.     

Comparison of hemispheric activation during mental word and rhyme generation using transcranial Doppler sonography

The Wada test is at present the method of choice for preoperative assessment of patients who require surgery close to cortical language areas. It is, however, an invasive test with an attached morbidity risk. By now, an alternative to the Wada test is to combine a lexical word generation paradigm with non-invasive imaging techniques. However, results of this approach are still not in complete agreement with the findings of the Wada test (r = .92; Knecht, Deppe, Ebner et al., 1998). We attempted to obtain a more distinct language lateralization with the development of a phonological rhyme generation paradigm based on pseudoword stimuli. To examine the predictive value of both paradigms we performed simultaneous bilateral functional transcranial Doppler ultrasonography on 19 right-handed male native German subjects. The rhyme generation condition produced a significantly stronger lateralization to the supposed hemisphere of language dominance than the classical word generation condition. The observed differences suggest that the rhyme generation paradigm is more robust in detecting hemispheric language dominance than other neuropsychological paradigms and might be most valuable for preoperative assessment of cortical language areas.