Logical probability,mathematical statistics,and the problem of induction

Summary In this paper I want to discuss some basic problems of inductive logic, i.e. of the attempt to solve the problem of induction by means of a calculus of logical probability. I shall try to throw some light upon these problems by contrasting inductive logic, based on logical probability, and working with undefined samples of observations, with mathematical statistics, based on statistical probability, and working with representative random samples.     

The nature of probability

The thesis of this article is that the nature of probability is centered on its formal properties, not on any of its standard interpretations. Section 2 is a survey of Bayesian applications. Section 3 focuses on two examples from physics that seem as completely objective as other physical concepts. Section 4 compares the conflict between subjective Bayesians and objectivists about probability to the earlier strident conflict in physics about the nature of force. Section 5 outlines a pragmatic approach to the various interpretations of probability. Finally, Sect. 6 argues that the essential formal nature of probability is expressed in the standard axioms, but more explicit attention should be given to the concept of randomness.     

The theory of nomic probability

This article sketches a theory of objective probability focusing on nomic probability, which is supposed to be the kind of probability figuring in statistical laws of nature. The theory is based upon a strengthened probability calculus and some epistemological principles that formulate a precise version of the statistical syllogism. It is shown that from this rather minimal basis it is possible to derive theorems comprising (1) a theory of direct inference, and (2) a theory of induction. The theory of induction is not of the familiar Bayesian variety, but consists of a precise version of the traditional Nicod Principle and its statistical analogues.     

The foundations of epistemological probability

Epistemological probability is the kind of probability relative to a body of evidence. Many philosophers, including Henry Kyburg and Roderick Chisholm, hold that all epistemological probabilities reflect a relation between an evidential body of propositions and other propositions. But this article argues that some epistemological probabilities for empirical propositions must be relative to non-propositional evidence, specifically the contents of non-propositional perceptual states. In doing so, the article distinguishes between internalism and externalism regarding epistemological probability, and argues for a version of awareness internalism. The article draws three main concluding lessons. First, epistemological probability is not to be identified with the sort of objective, experience-independent probability that is familiar from statistical and propensity interpretations of probability. Second, it is doubtful that epistemological probability is measurable, in any useful way, by real numbers, even if it admits of comparative assessments. Third, contrary to the familiar claim of C. I. Lewis, epistemological probability should not be viewed as requiring a basis of certainty.     

The probability of causal conditionals

Conditionals in natural language are central to reasoning and decision making. A theoretical proposal called the Ramsey test implies the conditional probability hypothesis: that the subjective probability of a natural language conditional, P(if p then q), is the conditional subjective probability, P(q/p). We report three experiments on causal indicative conditionals and related counterfactuals that support this hypothesis. We measured the probabilities people assigned to truth table cases, P(pq), P(p notq), P( notpq) and P( notp notq). From these ratings, we computed three independent predictors, P(p), P(q/p) and P(q/ notp), that we then entered into a regression equation with judged P(if p then q) as the dependent variable. In line with the conditional probability hypothesis, P(q/p) was by far the strongest predictor in our experiments. This result is inconsistent with the claim that causal conditionals are the material conditionals of elementary logic. Instead, it supports the Ramsey test hypothesis, implying that common processes underlie the use of conditionals in reasoning and judgments of conditional probability in decision making.     

The cognitive substrate of subjective probability

The prominent cognitive theories of probability judgment were primarily developed to explain cognitive biases rather than to account for the cognitive processes in probability judgment. In this article the authors compare 3 major theories of the processes and representations in probability judgment: the representativeness heuristic, implemented as prototype similarity, relative likelihood, or evidential support accumulation (ESAM; D. J. Koehler, C. M. White, & R. Grondin, 2003); cue-based relative frequency; and exemplar memory, implemented by probabilities from exemplars (PROBEX; P. Juslin & M. Persson, 2002). Three experiments with different task structures consistently demonstrate that exemplar memory is the best account of the data whereas the results are inconsistent with extant formulations of the representativeness heuristic and cue-based relative frequency.     

The probability heuristics model of syllogistic reasoning

A probability heuristic model (PHM) for syllogistic reasoning is proposed. An informational ordering over quantified statements suggests simple probability based heuristics for syllogistic reasoning. The most important is the "min-heuristic": choose the type of the least informative premise as the type of the conclusion. The rationality of this heuristic is confirmed by an analysis of the probabilistic validity of syllogistic reasoning which treats logical inference as a limiting case of probabilistic inference. A meta-analysis of past experiments reveals close fits with PHM. PHM also compares favorably with alternative accounts, including mental logics, mental models, and deduction as verbal reasoning. Crucially, PHM extends naturally to generalized quantifiers, such as Most and Few, which have not been characterized logically and are, consequently, beyond the scope of current mental logic and mental model theories. Two experiments confirm the novel predictions of PHM when generalized quantifiers are used in syllogistic arguments. PHM suggests that syllogistic reasoning performance may be determined by simple but rational informational strategies justified by probability theory rather than by logic.     

The foundations of probability and quantum mechanics

Taking as starting point two familiar interpretations of probability, we develop these in a perhaps unfamiliar way to arrive ultimately at an improbable claim concerning the proper axiomatization of probability theory: the domain of definition of a point-valued probability distribution is an orthomodular partially ordered set. Similar claims have been made in the light of quantum mechanics but here the motivation is intrinsically probabilistic. This being so the main task is to investigate what light, if any, this sheds on quantum mechanics. In particular it is important to know under what conditions these point-valued distributions can be thought of as derived from distribution-pairs of upper and lower probabilities on boolean algebras. Generalising known results this investigation unsurprisingly proves unrewarding. In the light of this failure the next topic investigated is how these generalized probability distributions are to be interpreted.     

The trajectory of the target probability effect

The effect of target probability on detection times is well-established: Even when detection accuracy is high, lower probability targets are detected more slowly than higher probability ones. Although this target probability effect on detection times has been well-studied, one aspect of it has remained largely unexamined: How the effect develops over the span of an experiment. Here, we investigated this issue with two detection experiments that assessed different target probability ratios. Conventional block segment analysis and linear mixed-effects modeling converged on two key findings. First, we found that the magnitude of the target probability effect increases as one progresses through a block of trials. Second, we found, by examining the trajectories of the low- and high-probability targets, that this increase in effect magnitude was driven by the low-probability targets. Specifically, we found that low-probability targets were detected more slowly as a block of trials progressed. Performance to high-probability targets, on the other hand, was largely invariant across the block. The latter finding is of particular interest because it cannot be reconciled with accounts that propose that the target probability effect is driven by the high-probability targets.     

The base-rate fallacy in probability judgments

The base-rate fallacy is people's tendency to ignore base rates in favor of, e.g., individuating information (when such is available), rather than integrate the two. This tendency has important implications for understanding judgment phenomena in many clinical, legal, and social-psychological settings. An explanation of this phenomenon is offered, according to which people order information by its perceived degree of relevance, and let high-relevance information dominate low-relevance information. Information is deemed more relevant when it relates more specifically to a judged target case. Specificity is achieved either by providing information on a smaller set than the overall population, of which the target case is a member, or when information can be coded, via causality, as information about the specific members of a given population. The base-rate fallacy is thus the result of pitting what seem to be merely coincidental, therefore low-relevance, base rates against more specific, or causal, information. A series of probabilistic inference problems is presented in which relevance was manipulated with the means described above, and the empirical results confirm the above account. In particular, base rates will be combined with other information when the two kinds of information are perceived as being equally relevant to the judged case.