Counting distinctions: on the conceptual foundations of Shannon’s information theory

Categorical logic has shown that modern logic is essentially the logic of subsets (or “subobjects”). In “subset logic,” predicates are modeled as subsets of a universe and a predicate applies to an individual if the individual is in the subset. Partitions are dual to subsets so there is a dual logic of partitions where a “distinction” [an ordered pair of distinct elements (u, u′) from the universe U] is dual to an “element”. A predicate modeled by a partition π on U would apply to a distinction if the pair of elements was distinguished by the partition π, i.e., if u and u′ were in different blocks of π. Subset logic leads to finite probability theory by taking the (Laplacian) probability as the normalized size of each subset-event of a finite universe. The analogous step in the logic of partitions is to assign to a partition the number of distinctions made by a partition normalized by the total number of ordered |U|² pairs from the finite universe. That yields a notion of “logical entropy” for partitions and a “logical information theory.” The logical theory directly counts the (normalized) number of distinctions in a partition while Shannon’s theory gives the average number of binary partitions needed to make those same distinctions. Thus the logical theory is seen as providing a conceptual underpinning for Shannon’s theory based on the logical notion of “distinctions.” This paper is dedicated to the memory of Gian-Carlo Rota—mathematician, philosopher, mentor, and friend.     

The role of visual perspective in information processing

Social events can be described from the perspective of either a person in the situation in which the event occurs (e.g., “John came into…”) or that of an outside observer (“John went into…”). We find that when individuals are disposed to form visual images, they have difficulty comprehending both verbal statements and pictures when the perspective from which the event is described differs from the perspective from which they have encountered similar events in daily life. Furthermore, the disposition to form visual images increases the intensity of emotional reactions to an event when the event is described from the perspective of someone in the situation in which it occurs. These effects are not evident, however, among individuals who typically process information semantically without forming visual images.     

Voters, Emotions, and Memory

In this paper we argue that emotional response to information encountered in campaigns has implications for the likelihood of remembering that information at the time of the vote. Most voting models are built on what voters remember—whether it is the placement of candidates on issues, or opened ended responses to prompts. That recall of memory is biased is well-known, but the extent to which those biases are driven by affective response to candidate information has not been studied. Using dynamic process tracing, we examine voters' emotional responses, information search, and candidate evaluations during a simulated presidential primary campaign. By manipulating anxiety and the amount of incongruent information that voters encounter, we can detect the direct influence of affect in information processing. We find evidence that voters are more likely to remember information that generates any affective reaction as opposed to information for which the subjects report no emotional response. However, we find little evidence that anxiety has a special role, compared to enthusiasm or anger, in increasing the likelihood that an individual item is remembered. This challenges a primary contention of the theory of Affective Intelligence that anxiety leads to more memories for campaign information.     

The Limitations of Heuristics for Political Elites

Despite the extensive literature on citizens' use of cognitive heuristics in political settings, far less is known about how political elites use these shortcuts. Legislative elites benefit from the efficiency of the accessibility heuristic, but their judgments can also be flawed if accessible information is incomplete or unrepresentative. Using personal interviews and a quasi-experimental design, this paper examines the use of the accessibility heuristic by professional legislative staff when assessing the importance of natural resources issues to their constituents. Staff members recall only a small subset of the relevant constituents in the district, and this subset is biased in favor of active and resource-rich constituents over other, equally relevant constituents. This paper provides a new application of cognitive psychology to political elites and addresses important normative questions about the importance of information processing for political representation. By drawing on the psychology literature on heuristics, this paper identifies the cognitive mechanisms of congressional representation and provides new evidence of old biases.     

Depressive symptoms and parenting competence: An analysis of 13 regulatory processes

Mechanisms that lead depressive symptoms to undermine parenting are poorly understood. This review examines cognitive, affective, and motivational processes thought to be responsible for the impact of depressive symptoms on parenting. We present a five-step, action-control model and review 152 studies relevant to 13 regulatory processes. Evidence suggests that depressive symptoms undermine parenting because they reduce child-oriented goals, undermine attention to child input, increase negative appraisals of children and parenting competence, activate low-positive and high-negative emotion, and increase positive evaluations of coercive parenting. Yet, this review reveals significant limitations in knowledge of these processes. Evidence that they mediate depression-parenting relations is scare; important processes remain unstudied; conceptions of regulation are undifferentiated; children’s contributions are largely unexamined; moderating variables are largely unexplored; and methods fail to capture the dynamics of processing input from children. Rigorous testing of such process models holds promise for clarifying the basis of depression-related parenting problems.     

Does inequity aversion depend on a frustration effect? A test with capuchin monkeys (Cebus apella)

Brosnan and de Waal (Nature 425:297–299, 2003) reported that if a witness monkey saw a model monkey receive a high-value food, the witness was more inclined to reject a previously acceptable, but low-value food. Later work demonstrated that this alleged inequity aversion might be due to frustration induced by switching subjects from their role as models receiving a high-value food to the role of witnesses receiving a low-value food. In the present study, pairs of female capuchins exchanged a token for either a high- or a low-value food without switching their model–witness roles. Witnesses could exchange a token for a low-value food after an adjacent model had exchanged a token for the same food (Equity Condition) or for a high-value food (Inequity Condition). Failure- and latency-to-exchange measures showed that witnesses were unaffected by the food type offered to models (no inequity aversion). Moreover, models were unaffected by their history of food type offered (no frustration). These results join earlier work suggesting that alleged inequity effects depend on frustration-induction procedures. Furthermore, inequity effects sometimes fail to emerge because frustration induction in nonhuman primates is labile. This study complied with protocols approved by the Italian Health Ministry and all procedures were performed in full accordance with the European law on humane care and use of laboratory animals.     

Answer comparison in automated question answering

In the context of Question Answering (QA) on free text, we assess the value of answer comparison and information fusion in handling multiple answers. We report improvements in answer re-ranking using fusion on a set of location questions and show the advantages of considering candidates as allies rather than competitors. We conclude with some observations about answer modeling and evaluation methodology, arising from a more recent experiment with a larger set of questions and a greater diversity of question types and candidates.     

文本检索模型综述

文本检索是信息检索一个重要的分支。随着互联网信息的迅速膨胀,如何检索到用户最需要的信息变得越来越关键。文本检索模型是文本检索中的核心技术,其性能直接影响到搜索引擎的检索质量。本文对当前的经典检索模型及其研究进展进行介绍,并分析各个模型之间的优缺点。     

领导-部属交换（LMX）的回顾与展望

领导-部属交换理论从领导和部属的对偶关系中考察领导行为及其对下属的绩效、组织承诺等结果变量的影响。文章回顾了领导-部属交换的文献,对于它的概念、理论基础、结构、测量工具等进行了综合介绍,对不同测量工具的各自的特点以及它们之间的关系做了分析,接着总结了影响领导-部属关系的影响因素和结果变量以及与变革型领导的关系,最后提出未来研究应该加强从领导部属交换的发展阶段以及从部属或领导的角度来分析领导-部属交换理论     

What Determines Visual Statistical Learning Performance? Insights From Information Theory

In order to extract the regularities underlying a continuous sensory input, the individual elements constituting the stream have to be encoded and their transitional probabilities (TPs) should be learned. This suggests that variance in statistical learning (SL) performance reflects efficiency in encoding representations as well as efficiency in detecting their statistical properties. These processes have been taken to be independent and temporally modular, where first, elements in the stream are encoded into internal representations, and then the co‐occurrences between them are computed and registered. Here, we entertain a novel hypothesis that one unifying construct—the rate of information in the sensory input—explains learning performance. This theoretical approach merges processes related to encoding of events and those related to learning their regularities into a single computational principle. We present data from two large‐scale experiments with over 800 participants tested in support for this hypothesis, showing that rate of information in a visual stream clearly predicts SL performance, and that similar rate of information values leads to similar SL performance. We discuss the implications for SL theory and its relation to regularity learning.