Computational exploration of metaphor comprehension processes using a semantic space model

Recent metaphor research has revealed that metaphor comprehension involves both categorization and comparison processes. This finding has triggered the following central question: Which property determines the choice between these two processes for metaphor comprehension? Three competing views have been proposed to answer this question: the conventionality view ( Bowdle & Gentner, 2005 ), aptness view ( Glucksberg & Haught, 2006b ), and interpretive diversity view ( Utsumi, 2007 ); these views, respectively, argue that vehicle conventionality, metaphor aptness, and interpretive diversity determine the choice between the categorization and comparison processes. This article attempts to answer the question regarding which views are plausible by using cognitive modeling and computer simulation based on a semantic space model. In the simulation experiment, categorization and comparison processes are modeled in a semantic space constructed by latent semantic analysis. These two models receive word vectors for the constituent words of a metaphor and compute a vector for the metaphorical meaning. The resulting vectors can be evaluated according to the degree to which they mimic the human interpretation of the same metaphor; the maximum likelihood estimation determines which of the two models better explains the human interpretation. The result of the model selection is then predicted by three metaphor properties (i.e., vehicle conventionality, aptness, and interpretive diversity) to test the three views. The simulation experiment for Japanese metaphors demonstrates that both interpretive diversity and vehicle conventionality affect the choice between the two processes. On the other hand, it is found that metaphor aptness does not affect this choice. This result can be treated as computational evidence supporting the interpretive diversity and conventionality views.     

Impulse processing: a dynamical systems model of incremental eye movements in the visual world paradigm

The Visual World Paradigm (VWP) presents listeners with a challenging problem: They must integrate two disparate signals, the spoken language and the visual context, in support of action (e.g., complex movements of the eyes across a scene). We present Impulse Processing, a dynamical systems approach to incremental eye movements in the visual world that suggests a framework for integrating language, vision, and action generally. Our approach assumes that impulses driven by the language and the visual context impinge minutely on a dynamical landscape of attractors corresponding to the potential eye-movement behaviors of the system. We test three unique predictions of our approach in an empirical study in the VWP, and describe an implementation in an artificial neural network. We discuss the Impulse Processing framework in relation to other models of the VWP.     

Three ideal observer models for rule learning in simple languages

Children learning the inflections of their native language show the ability to generalize beyond the perceptual particulars of the examples they are exposed to. The phenomenon of “rule learning”—quick learning of abstract regularities from exposure to a limited set of stimuli—has become an important model system for understanding generalization in infancy. Experiments with adults and children have revealed differences in performance across domains and types of rules. To understand the representational and inferential assumptions necessary to capture this broad set of results, we introduce three ideal observer models for rule learning. Each model builds on the next, allowing us to test the consequences of individual assumptions. Model 1 learns a single rule, Model 2 learns a single rule from noisy input, and Model 3 learns multiple rules from noisy input. These models capture a wide range of experimental results—including several that have been used to argue for domain-specificity or limits on the kinds of generalizations learners can make—suggesting that these ideal observers may be a useful baseline for future work on rule learning.     

Number versus continuous quantity in numerosity judgments by fish

A fundamental question in human cognition is how people reason about space. We use a computational model to explore cross-cultural commonalities and differences in spatial cognition. Our model is based upon two hypotheses: (1) the structure-mapping model of analogy can explain the visual comparisons used in spatial reasoning; and (2) qualitative, structural representations are computed by people’s visual systems and used in these comparisons. We apply our model to a visual oddity task, in which individuals are shown an array of two-dimensional images and asked to the pick the one that does not belong. This task was previously used to evaluate understanding of geometric concepts in two disparate populations: North Americans, and the Mundurukú, a South American indigenous group. Our model automatically generates representations of each hand-segmented image and compares them to solve the task. The model achieves human-level performance on this task, and problems that are hard for the model are also difficult for people in both cultures. Furthermore, ablation studies on the model suggest explanations for cross-cultural differences in terms of differences in spatial representations.     

Restructuring partitioned knowledge: the role of recoordination in category learning

Knowledge restructuring refers to changes in the strategy with which people solve a given problem. Two types of knowledge restructuring are supported by existing category learning models. The first is a relearning process, which involves incremental updating of knowledge as learning progresses. The second is a recoordination process, which involves novel changes in the way existing knowledge is applied to the task. Whereas relearning is supported by both single- and multiple-module models of category learning, only multiple-module models support recoordination. To date, only relearning has been directly supported empirically. We report two category learning experiments that provide direct evidence of recoordination. People can fluidly alternate between different categorization strategies, and moreover, can reinstate an old strategy even after prolonged use of an alternative. The knowledge restructuring data are not well fit by a single-module model (ALCOVE). By contrast, a multiple-module model (ATRIUM) quantitatively accounts for recoordination. Low-level changes in the distribution of dimensional attention are shown to subsequently affect how ATRIUM coordinates its modular knowledge. We argue that learning about complex tasks occurs at the level of the partial knowledge elements used to generate a response strategy.     

A memory-based model of Hick's law

We propose and evaluate a memory-based model of Hick’s law, the approximately linear increase in choice reaction time with the logarithm of set size (the number of stimulus–response alternatives). According to the model, Hick’s law reflects a combination of associative interference during retrieval from declarative memory and occasional savings for stimulus–response repetitions due to non-retrieval. Fits to existing data sets show that the model accounts for the basic set-size effect, changes in the set-size effect with practice, and stimulus–response-repetition effects that challenge the information-theoretic view of Hick’s law. We derive the model’s prediction of an interaction between set size, stimulus fan (the number of responses associated with a particular stimulus), and stimulus–response transition, which is subsequently tested and confirmed in two experiments. Collectively, the results support the core structure of the model and its explanation of Hick’s law in terms of basic memory effects.     

Behavioral intervention to treat selective mutism across multiple social situations and community settings

We evaluated a behavioral intervention for a 9-year-old girl with selective mutism. The intervention consisted of role play and video self-modeling. The frequency of spoken initiations, responses to questions, and communication breakdowns was measured during three social situations (i.e., ordering in a restaurant, meeting new adults, and playing with new children) and in three community settings. Results demonstrated increases in spoken initiations and responses and decreases in communication breakdowns across all situations and settings.     

Using multiple-exemplar training to teach a generalized repertoire of sharing to children with autism

The current study examined the utility of multiple-exemplar training to teach children with autism to share. Stimuli from 3 of 4 categories were trained using a treatment package of video modeling, prompting, and reinforcement. Offers to share increased for all 3 children following the introduction of treatment, with evidence of skill maintenance. In addition, within-stimulus-category generalization of sharing was evident for all participants, although only 1 participant demonstrated across-category generalization of sharing. Offers to share occurred in a novel setting, with familiar and novel stimuli, and in the presence of novel adults and peers for all participants during posttreatment probes.     

Strategic adaptation to performance objectives in a dual-task setting

How do people interleave attention when multitasking? One dominant account is that the completion of a subtask serves as a cue to switch tasks. But what happens if switching solely at subtask boundaries led to poor performance? We report a study in which participants manually dialed a UK‐style telephone number while driving a simulated vehicle. If the driver were to exclusively return his or her attention to driving after completing a subtask (i.e., using the single break in the xxxxx‐xxxxxx representational structure of the number), then we would expect to see a relatively poor driving performance. In contrast, our results show that drivers choose to return attention to steering control before the natural subtask boundary. A computational modeling analysis shows that drivers had to adopt this strategy to meet the required performance objective of maintaining an acceptable lateral position in the road while dialing. Taken together these results support the idea that people can strategically control the allocation of attention in multitask settings to meet specific performance criteria.