Semantic Memory Search and Retrieval in a Novel Cooperative Word Game: A Comparison of Associative and Distributional Semantic Models

Considerable work during the past two decades has focused on modeling the structure of semantic memory, although the performance of these models in complex and unconstrained semantic tasks remains relatively understudied. We introduce a two-player cooperative word game, Connector (based on the boardgame Codenames), and investigate whether similarity metrics derived from two large databases of human free association norms, the University of South Florida norms and the Small World of Words norms, and two distributional semantic models based on large language corpora (word2vec and GloVe) predict performance in this game. Participant dyads were presented with 20-item word boards with word pairs of varying relatedness. The speaker received a word pair from the board (e.g., exam-algebra) and generated a one-word semantic clue (e.g., math), which was used by the guesser to identify the word pair on the board across three attempts. Response times to generate the clue, as well as accuracy and latencies for the guessed word pair, were strongly predicted by the cosine similarity between word pairs and clues in random walk-based associative models, and to a lesser degree by the distributional models, suggesting that conceptual representations activated during free association were better able to capture search and retrieval processes in the game. Further, the speaker adjusted subsequent clues based on the first attempt by the guesser, who in turn benefited from the adjustment in clues, suggesting a cooperative influence in the game that was effectively captured by both associative and distributional models. These results indicate that both associative and distributional models can capture relatively unconstrained search processes in a cooperative game setting, and Connector is particularly suited to examine communication and semantic search processes.     

Probing Lexical Ambiguity: Word Vectors Encode Number and Relatedness of Senses

Lexical ambiguity—the phenomenon of a single word having multiple, distinguishable senses—is pervasive in language. Both the degree of ambiguity of a word (roughly, its number of senses) and the relatedness of those senses have been found to have widespread effects on language acquisition and processing. Recently, distributional approaches to semantics, in which a word's meaning is determined by its contexts, have led to successful research quantifying the degree of ambiguity, but these measures have not distinguished between the ambiguity of words with multiple related senses versus multiple unrelated meanings. In this work, we present the first assessment of whether distributional meaning representations can capture the ambiguity structure of a word, including both the number and relatedness of senses. On a very large sample of English words, we find that some, but not all, distributional semantic representations that we test exhibit detectable differences between sets of monosemes (unambiguous words; N = 964), polysemes (with multiple related senses; N = 4,096), and homonyms (with multiple unrelated senses; N = 355). Our findings begin to answer open questions from earlier work regarding whether distributional semantic representations of words, which successfully capture various semantic relationships, also reflect fine-grained aspects of meaning structure that influence human behavior. Our findings emphasize the importance of measuring whether proposed lexical representations capture such distinctions: In addition to standard benchmarks that test the similarity structure of distributional semantic models, we need to also consider whether they have cognitively plausible ambiguity structure.     

Similarity Judgment Within and Across Categories: A Comprehensive Model Comparison

Similarity is one of the most important relations humans perceive, arguably subserving category learning and categorization, generalization and discrimination, judgment and decision making, and other cognitive functions. Researchers have proposed a wide range of representations and metrics that could be at play in similarity judgment, yet have not comprehensively compared the power of these representations and metrics for predicting similarity within and across different semantic categories. We performed such a comparison by pairing nine prominent vector semantic representations with seven established similarity metrics that could operate on these representations, as well as supervised methods for dimensional weighting in the similarity function. This approach yields a factorial model structure with 126 distinct representation-metric pairs, which we tested on a novel dataset of similarity judgments between pairs of cohyponymic words in eight categories. We found that cosine similarity and Pearson correlation were the overall best performing unweighted similarity functions, and that word vectors derived from free association norms often outperformed word vectors derived from text (including those specialized for similarity). Importantly, models that used human similarity judgments to learn category-specific weights on dimensions yielded substantially better predictions than all unweighted approaches across all types of similarity functions and representations, although dimension weights did not generalize well across semantic categories, suggesting strong category context effects in similarity judgment. We discuss implications of these results for cognitive modeling and natural language processing, as well as for theories of the representations and metrics involved in similarity.     

The Challenges of Large-Scale,Web-Based Language Datasets: Word Length and Predictability Revisited

Language research has come to rely heavily on large-scale, web-based datasets. These datasets can present significant methodological challenges, requiring researchers to make a number of decisions about how they are collected, represented, and analyzed. These decisions often concern long-standing challenges in corpus-based language research, including determining what counts as a word, deciding which words should be analyzed, and matching sets of words across languages. We illustrate these challenges by revisiting “Word lengths are optimized for efficient communication” (Piantadosi, Tily, & Gibson, 2011), which found that word lengths in 11 languages are more strongly correlated with their average predictability (or average information content) than their frequency. Using what we argue to be best practices for large-scale corpus analyses, we find significantly attenuated support for this result and demonstrate that a stronger relationship obtains between word frequency and length for a majority of the languages in the sample. We consider the implications of the results for language research more broadly and provide several recommendations to researchers regarding best practices.     

Robust Bayesian growth curve modelling using conditional medians

Growth curve models have been widely used to analyse longitudinal data in social and behavioural sciences. Although growth curve models with normality assumptions are relatively easy to estimate, practical data are rarely normal. Failing to account for non-normal data may lead to unreliable model estimation and misleading statistical inference. In this work, we propose a robust approach for growth curve modelling using conditional medians that are less sensitive to outlying observations. Bayesian methods are applied for model estimation and inference. Based on the existing work on Bayesian quantile regression using asymmetric Laplace distributions, we use asymmetric Laplace distributions to convert the problem of estimating a median growth curve model into a problem of obtaining the maximum likelihood estimator for a transformed model. Monte Carlo simulation studies have been conducted to evaluate the numerical performance of the proposed approach with data containing outliers or leverage observations. The results show that the proposed approach yields more accurate and efficient parameter estimates than traditional growth curve modelling. We illustrate the application of our robust approach using conditional medians based on a real data set from the Virginia Cognitive Aging Project.     

Factor copula models for mixed data

We develop factor copula models to analyse the dependence among mixed continuous and discrete responses. Factor copula models are canonical vine copulas that involve both observed and latent variables, hence they allow tail, asymmetric and nonlinear dependence. They can be explained as conditional independence models with latent variables that do not necessarily have an additive latent structure. We focus on important issues of interest to the social data analyst, such as model selection and goodness of fit. Our general methodology is demonstrated with an extensive simulation study and illustrated by reanalysing three mixed response data sets. Our studies suggest that there can be a substantial improvement over the standard factor model for mixed data and make the argument for moving to factor copula models.     

Evaluating evidence for a global mindset factor across multiple ability domains

The current studies help to clarify the nature of growth mindsets by evaluating how strongly people hold a global belief that generalizes across multiple ability domains (e.g., math, writing). Study 1 (N = 651) showed that a bifactor model, consisting of a common global belief and beliefs specific to each domain, fit the data reasonably well. Global mindset beliefs and domain-specific mindset beliefs predicted domain-specific outcomes, whereas global mindset more strongly predicted global outcomes than domain-specific factors. Study 2 (N = 1,422) used an augmented bifactor model with newly developed global mindset items that only served as indicators of the global factor. Results showed high convergence between the new global mindset items and the global factor from a bifactor model.     

家人情感卷入对老年自我刻板印象的影响：基于潜变量增长模型的分析

本研究使用问卷法对257名老年人进行了历时1年的3次追踪测试, 采用潜变量增长模型与交叉滞后回归分析考察了家人情感卷入与老年自我刻板印象的变化趋势, 家人情感卷入发展与老年自我刻板印象发展的关系, 以及家人情感卷入对老年自我刻板印象的时序效应。结果发现：(1)老年人感知到的家人情感卷入在1年内呈线性递减, 而老年自我刻板印象呈线性增长; (2)家人情感卷入的初始水平负向预测老年自我刻板印象的初始水平与增长速率; (3)家人情感卷入的下降速率也显著预测了老年自我刻板印象的增长速率; (4)交叉滞后回归分析进一步支持了老年人家人情感卷入对老年自我刻板印象的总体负向预测作用。本研究为老年刻板印象内化的家庭过程提供了理论支持, 并对减少老年刻板印象内化、改善消极老年自我刻板印象的干预具有一定的实践价值。     

多变量追踪研究的模型整合与拓展：考察往复式影响与增长趋势

追踪研究当中, 交叉滞后模型可以探究多变量之间往复式影响, 潜增长模型可以探究个体增长趋势。对两类模型进行整合, 例如同时关注往复式影响与个体增长趋势, 同时可以定义测量误差、随机截距等变异成分, 衍生出随机截距交叉滞后模型、特质-状态-误差模型、自回归潜增长模型、结构化残差潜增长模型等。以交叉滞后模型和潜增长模型分别作为基础模型, 从个体间/个体内变异分解的角度对上述各类模型梳理, 整合出此类模型的分析框架, 并拓展建立“因子结构化潜增长模型(factor latent curve model with structured reciprocals)”作为统合框架。通过实证研究(早期儿童的追踪研究-幼儿园版, ECLS-K), 建立21049名儿童的阅读和数学能力的往复式影响与增长趋势。研究发现, 分离了稳定特质的模型拟合最优。研究也对模型建模思路和模型选择提供了建议。