A Computational Model of Linguistic Humor in Puns

Humor plays an essential role in human interactions. Precisely what makes something funny, however, remains elusive. While research on natural language understanding has made significant advancements in recent years, there has been little direct integration of humor research with computational models of language understanding. In this paper, we propose two information‐theoretic measures—ambiguity and distinctiveness—derived from a simple model of sentence processing. We test these measures on a set of puns and regular sentences and show that they correlate significantly with human judgments of funniness. Moreover, within a set of puns, the distinctiveness measure distinguishes exceptionally funny puns from mediocre ones. Our work is the first, to our knowledge, to integrate a computational model of general language understanding and humor theory to quantitatively predict humor at a fine‐grained level. We present it as an example of a framework for applying models of language processing to understand higher level linguistic and cognitive phenomena.     

Estimation of trade‐off between costs of preprocessing and primary processing

When people engage in a task, they often take preliminary actions (preprocessing) to simplify primary processing. Usually, a trade‐off is made between the costs of preprocessing and primary processing. We conducted three experiments to find out whether people could adaptively estimate the utility of preprocessing depending on the task situation. The result demonstrated that in performing a high‐complexity task, almost all the participants reduced their overall task performance cost by conducting cost‐adaptive preprocessing. However, for a low‐complexity task, participants tended to conduct preprocessing even though this increased overall task performance cost. Based on these results, we discuss human nature from the viewpoint of the influence of cognitive effort.     

Watching Eyes effects: When others meet the self

The perception of direct gaze—that is, of another individual’s gaze directed at the observer—is known to influence a wide range of cognitive processes and behaviors. We present a new theoretical proposal to provide a unified account of these effects. We argue that direct gaze first captures the beholder’s attention and then triggers self-referential processing, i.e., a heightened processing of stimuli in relation with the self. Self-referential processing modulates incoming information processing and leads to the Watching Eyes effects, which we classify into four main categories: the enhancement of self-awareness, memory effects, the activation of pro-social behavior, and positive appraisals of others. We advance that the belief to be the object of another’s attention is embedded in direct gaze perception and gives direct gaze its self-referential power. Finally, we stress that the Watching Eyes effects reflect a positive impact on human cognition; therefore, they may have a therapeutic potential, which future research should delineate.     

The minimum principle and the perception of absolute,common, and relative motions

Wheel-generated motions have served as a touchstone for discussion of the perception of wholes and parts since the beginning of Gestalt psychology. The reason is that perceived common motions of the whole and the perceived relative motions of the parts are not obviously found in the absolute motion paths of points on a rolling wheel. In general, two types of theories have been proposed as to how common and relative motions are derived from absolute motions: one is that the common motions are extracted from the display first, leaving relative motions as the residual; the other is that relative motions are extracted first leaving common motions as the residual. A minimum principle can be used to defend both positions, but application of the principle seems contingent on the particular class of stimuli chosen. We propose a third view. It seems that there are at least two simultaneous processes—one for common motions and one for relative motions—involved in the perception of these and other stimuli and that a minimum principle is involved in both. However, for stimuli in many domains the minimization of relative motion dominates the perception. In general, we propose that any given stimulus can be organized to minimize the complexity of either its common motions or its relative motions; that which component is minimized depends on which of two processes reaches completion first (that for common or that for relative motions); and that the similarity of any two displays depends on whether common or relative motions are minimized.     

语言能力的老化机制：语言特异性与非特异性因素的共同作用

语言能力的衰退是由于一般认知能力衰退引起的, 还是由于语言加工系统的衰退引起的, 抑或是两者的共同作用?研究中测量了青年组和老年组的一般认知能力(加工速度、工作记忆和抑制能力), 以及在词汇、句子和语篇三个水平上的语言理解能力和语言产生能力。结果发现, 一般认知能力、语言理解和语言产生能力都存在年老化现象。分层回归分析表明, 一般认知能力对语言能力的贡献, 以及语言理解能力和产生能力之间的相互贡献在青年组和老年组中是不同的, 且存在词汇、句子和语篇水平上的差异。在词汇水平上, 青年人的成绩能够被一般认知能力和另一种语言能力所显著预测, 而老年人的成绩却不受一般认知因素影响; 在句子水平上, 青年人的成绩仍能被一般认知能力或另一种语言能力所解释, 但这两类变量都无法预测老年人的任务成绩; 在语篇水平上, 青年人理解任务的成绩显著地受到产生能力影响, 而老年人的理解和产生任务成绩则分别可以被一般认知能力和语言理解能力所解释。对组间差异的回归分析表明, 一般认知能力和另一种语言能力对组间差异都有显著贡献, 且前者的贡献大于后者。上述研究结果表明, 语言能力的老化是语言特异性因素和非特异性因素共同作用的结果。     

The effects of being categorised: The interplay between internal and external social identities

In this chapter, we consider the independent and interactive effects of internal categorisations (how people see themselves) and external categorisations (how they are categorised by others) on social behaviour. Our point of departure is that people do not necessarily accept external categorisations that are imposed upon them (regardless of whether these refer to artificially constructed or naturally occurring groups) and that this affects their willingness to invest in the group. We first outline different reasons people may have to behave in line with externally imposed group memberships. Subsequently, we examine how self-presentation motives may interfere with identity expression, as people consider different social norms, different audiences, and the psychological costs associated with the management of their social identities. We conclude by delineating the conditions under which external categorisations can be internalised by targets, depending on the interplay of multiple identities as well as the way people are treated by others.     

Contextual interference processing during fast categorisations of facial expressions

We examined interference effects of emotionally associated background colours during fast valence categorisations of negative, neutral and positive expressions. According to implicitly learned colour-emotion associations, facial expressions were presented with colours that either matched the valence of these expressions or not. Experiment 1 included infrequent non-matching trials and Experiment 2 a balanced ratio of matching and non-matching trials. Besides general modulatory effects of contextual features on the processing of facial expressions, we found differential effects depending on the valance of target facial expressions. Whereas performance accuracy was mainly affected for neutral expressions, performance speed was specifically modulated by emotional expressions indicating some susceptibility of emotional expressions to contextual features. Experiment 3 used two further colour-emotion combinations, but revealed only marginal interference effects most likely due to missing colour-emotion associations. The results are discussed with respect to inherent processing demands of emotional and neutral expressions and their susceptibility to contextual interference.     

The advantage of first mention in Spanish

An advantage of first mention—that is, faster access to participants mentioned first in a sentence—has previously been demonstrated only in English. We report three experiments demonstrating that the advantage of first mention occurs also in Spanish sentences, regardless of whether the first-mentioned participants are syntactic subjects, and regardless, too, of whether they are proper names or inanimate objects. Because greater word-order flexibility is allowed in Spanish than in English (e.g., nonpassive object-verb-subject constructions exist in Spanish), these findings provide additional evidence that the advantage of first mention is a general cognitive phenomenon.     

Interference in visual perception by verbal and spatial cognitive activity

In two experiments we tested the hypothesis that cognitive processing based on spatial imagery produces more deterioration of visual perception than cognitive processing based on verbal codes. So, we studied the effect on visual perception of two cognitive tasks, one of spatial imagery and the other a verbal task. In the first one, with 30 participants, we analyzed the mental load and ocular behaviors in both cognitive tasks. In the second experiment, with 29 participants, we studied the effect of both tasks on a visual search task, using a dual-task experimental paradigm. The verbal task presented higher mental load than the imagery task when both tasks were carried out with visual search task, and there was more deterioration in stimulus detection with the verbal task. We can conclude that: (1) cognitive tasks produce important deterioration in the capacities of visual search and identification of stimuli; (2) this deterioration has two components: (a) an inefficient search, associated with alterations of the gaze patterns while performing cognitive tasks, and (b) a general interference, nonspecific to spatial codes, in the process of identification of looked-at stimuli; (3) this cognitive interference is related to the mental load or effort required by the cognitive task.     

Modeling the Covariance Structure of Complex Datasets Using Cognitive Models: An Application to Individual Differences and the Heritability of Cognitive Ability

Understanding individual differences in cognitive performance is an important part of understanding how variations in underlying cognitive processes can result in variations in task performance. However, the exploration of individual differences in the components of the decision process—such as cognitive processing speed, response caution, and motor execution speed—in previous research has been limited. Here, we assess the heritability of the components of the decision process, with heritability having been a common aspect of individual differences research within other areas of cognition. Importantly, a limitation of previous work on cognitive heritability is the underlying assumption that variability in response times solely reflects variability in the speed of cognitive processing. This assumption has been problematic in other domains, due to the confounding effects of caution and motor execution speed on observed response times. We extend a cognitive model of decision‐making to account for relatedness structure in a twin study paradigm. This approach can separately quantify different contributions to the heritability of response time. Using data from the Human Connectome Project, we find strong evidence for the heritability of response caution, and more ambiguous evidence for the heritability of cognitive processing speed and motor execution speed. Our study suggests that the assumption made in previous studies—that the heritability of cognitive ability is based on cognitive processing speed—may be incorrect. More generally, our methodology provides a useful avenue for future research in complex data that aims to analyze cognitive traits across different sources of related data, whether the relation is between people, tasks, experimental phases, or methods of measurement.     

Differential activation patterns of occipital and prefrontal cortices during motion processing: Evidence from normal and schizophrenic brains

Visual motion perception is normally mediated by neural processing in the posterior cortex. Focal damage to the middle temporal area (MT), a posterior extrastriate region, induces motion perception impairment. It is unclear, however, how more broadly distributed cortical dysfunction affects this visual behavior and its neural substrates. Schizophrenia manifests itself in a variety of behavioral and perceptual abnormalities that have proved difficult to understand through a dysfunction of any single brain system. One of these perceptual abnormalities involves impaired motion perception. Motion processing provides an opportunity to clarify the roles of multiple cortical networks in both healthy and schizophrenic brains. Using fMRI, we measured cortical activation while participants performed two visual motion tasks (direction discrimination and speed discrimination) and one nonmotion task (contrast discrimination). Normal controls showed robust cortical activation (BOLD signal changes) in MT during the direction and speed discrimination tasks, documenting primary processing of sensory input in this posterior region. In patients with schizophrenia, cortical activation was significantly reduced in MT and significantly increased in the inferior convexity of the prefrontal cortex, an area that is normally involved in higher level cognitive processing. This shift in cortical responses from posterior to prefrontal regions suggests that motion perception in schizophrenia is associated with both deficient sensory processing and compensatory cognitive processing. Furthermore, this result provides evidence that in the context of broadly distributed cortical dysfunction, the usual functional specificity of the cortex becomes modified, even across the domains of sensory and cognitive processing.     

音乐句法加工的认知机制与音乐结构的影响模式

音乐和语言是人类最重要的两种交流系统。与语言一样, 音符的排列和组织也是建立在一定的句法规则之上。尽管现有研究发现听众具有感知音乐句法的能力, 音乐句法加工的认知机制以及影响因素仍不清楚。基于此, 拟深入探究预期和整合在音乐音高句法加工中的作用, 以及音乐层级结构和时间结构对音高句法加工的影响。以期进一步揭示音乐句法加工的本质, 为音乐和语言的比较以及探索人类更一般的交流机制提供实证依据。     

Handling complex real-world data with two cognitive engineering tools: COGENT and MacSHAPA

The ultimate concern of cognitive engineering is how complex sociotechnical systems might be designed so that humans can work within them and control them safely and effectively. Because of this, large amounts of observational data analysis and knowledge elicitation are incorporated in cognitive engineering. At many points, these two methodologies coalesce. In this paper, we describe two complementary cognitive engineering software tools—MacSHAPA and COGENT—that are being developed alongside each other. MacSHAPA is designed for observational data analysis, and COGENT is designed for knowledge elicitation and cognitive engineering, but both sup-port requirements gathering. We first outline current trends in cognitive engineering that have given rise to the need for tools like MacSHAPA and COGENT. We then describe the two tools in more detail, and point to their similarities and differences. Finally, we show how the two tools are complementary, and how they can be used together in engineering psychology research.     

Contextual interference processing during fast categorisations of facial expressions

We examined interference effects of emotionally associated background colours during fast valence categorisations of negative, neutral and positive expressions. According to implicitly learned colour–emotion associations, facial expressions were presented with colours that either matched the valence of these expressions or not. Experiment 1 included infrequent non-matching trials and Experiment 2 a balanced ratio of matching and non-matching trials. Besides general modulatory effects of contextual features on the processing of facial expressions, we found differential effects depending on the valance of target facial expressions. Whereas performance accuracy was mainly affected for neutral expressions, performance speed was specifically modulated by emotional expressions indicating some susceptibility of emotional expressions to contextual features. Experiment 3 used two further colour–emotion combinations, but revealed only marginal interference effects most likely due to missing colour–emotion associations. The results are discussed with respect to inherent processing demands of emotional and neutral expressions and their susceptibility to contextual interference.     

On the perception of shape from shading

The extraction of three-dimensional shape from shading is one of the most perceptually compelling, yet poorly understood, aspects of visual perception. In this paper, we report several new experiments on the manner in which the perception of shape from shading interacts with other visual processes such as perceptual grouping, preattentive search (“pop-out”), and motion perception. Our specific findings are as follows: (1) The extraction of shape from shading information incorporates at least two “assumptions” or constraints—first,that there is a single light source illuminating the whole scene, and second, that the light is shining from “above” in relation to retinal coordinates. (2) Tokens defined by shading can serve as a basis for perceptual grouping and segregation. (3) Reaction time for detecting a single convex shape does not increase with the number of items in the display. This “pop-out” effect must be based on shading rather than on differences in luminance polarity, since neither left-right differences nor step changes in luminance resulted in pop-out. (4) When the subjects were experienced, there were no search asymmetries for convex as opposed to concave tokens, but when the subjects were naive, cavities were much easier to detect than convex shapes. (5) The extraction of shape from shading can also provide an input to motion perception. And finally, (6) the assumption of “overhead illumination” that leads to perceptual grouping depends primarily on retinal rather than on “phenomenal” or gravitational coordinates. Taken collectively, these findings imply that the extraction of shape from shading is an “early” visual process that occurs prior to perceptual grouping, motion perception, and vestibular (as well as “cognitive”) correction for head tilt. Hence, there may be neural elements very early in visual processing that are specialized for the extraction of shape from shading.     

Color perception involves color representations firstly at a semantic level and then at a lexical level

Studies and models have suggested that color perception first involves access to semantic representations of color. This result leads to two questions: (1) is knowledge able to influence the perception of color when associated with a color? and (2) can the perception of color really involve only semantic representations? We developed an experiment where participants have to discriminate the color of a patch (yellow vs. green). The target patch is preceded either by a black-and-white line drawing or by a word representing a natural object associated with the same or a different color (banana vs. frog). We expected a priming effect for pictures because, with a 350-ms SOA, they only involve access to semantic representations of color, whereas words seem only elicit an access to lexical representations. As expected, we found a priming effect for pictures, but also for words. Moreover, we found a general slowdown of response times in the word-prime-condition suggesting the need of an additional processing step to produce priming. In a second experiment, we manipulated the SOA in order to preclude a semantic access in the word-prime-condition that could explain the additional step of processing. We also found a priming effect, suggesting that interaction with perception occurs at a lexical level and the additional step occurs at a color perception level. In the discussion, we develop a new model of color perception assuming that color perception involves access to semantic representations and then access to lexical representations.