Coherent psychometric modelling with Bayesian nonparametrics

In this paper we argue that model selection, as commonly practised in psychometrics, violates certain principles of coherence. On the other hand, we show that Bayesian nonparametrics provides a coherent basis for model selection, through the use of a ‘nonparametric’ prior distribution that has a large support on the space of sampling distributions. We illustrate model selection under the Bayesian nonparametric approach, through the analysis of real questionnaire data. Also, we present ways to use the Bayesian nonparametric framework to define very flexible psychometric models, through the specification of a nonparametric prior distribution that supports all distribution functions for the inverse link, including the standard logistic distribution functions. The Bayesian nonparametric approach provides a coherent method for model selection that can be applied to any statistical model, including psychometric models. Moreover, under a ‘non‐informative’ choice of nonparametric prior, the Bayesian nonparametric approach is easy to apply, and selects the model that maximizes the log likelihood. Thus, under this choice of prior, the approach can be extended to non‐Bayesian settings where the parameters of the competing models are estimated by likelihood maximization, and it can be used with any psychometric software package that routinely reports the model log likelihood.     

The transmission of support: a Bayesian re-analysis

Crispin Wright’s discussion of the notion of ‘transmission-failure’ promises to have important philosophical ramifications, both in epistemology and beyond. This paper offers a precise, formal characterisation of the concept within a Bayesian framework. The interpretation given avoids the serious shortcomings of a recent alternative proposal due to Samir Okasha.     

An Introduction to Model Selection

This paper is an introduction to model selection intended for nonspecialists who have knowledge of the statistical concepts covered in a typical first (occasionally second) statistics course. The intention is to explain the ideas that generate frequentist methodology for model selection, for example the Akaike information criterion, bootstrap criteria, and cross-validation criteria. Bayesian methods, including the Bayesian information criterion, are also mentioned in the context of the framework outlined in the paper. The ideas are illustrated using an example in which observations are available for the entire population of interest. This enables us to examine and to measure effects that are usually invisible, because in practical applications only a sample from the population is observed. The problem of selection bias, a hazard of which one needs to be aware in the context of model selection, is also discussed. Copyright 2000 Academic Press.     

Theory change in immunology part I: Extended theories and scientific progress

This two-part article examines the competition between the clonal selection theory and the instructive theory of the immune response from 1957–1967. In Part I the concept of a temporally ‘extended theory’ is introduced, which requires attention to the hitherto largely ignored issue of theory individuation. Factors which influence the acceptability of such an extended theory at different temporal points are also embedded in a Bayesian framework, which is shown to provide a rational account of belief change in science. In Part II these factors, as elaborated in the Bayesian framework, are applied to the case of the success of the clonal selection theory and the failure of the instructive theory.     

Bayesian Factor Analysis as a Variable-Selection Problem: Alternative Priors and Consequences

Factor analysis is a popular statistical technique for multivariate data analysis. Developments in the structural equation modeling framework have enabled the use of hybrid confirmatory/exploratory approaches in which factor-loading structures can be explored relatively flexibly within a confirmatory factor analysis (CFA) framework. Recently, Muthén & Asparouhov proposed a Bayesian structural equation modeling (BSEM) approach to explore the presence of cross loadings in CFA models. We show that the issue of determining factor-loading patterns may be formulated as a Bayesian variable selection problem in which Muthén and Asparouhov's approach can be regarded as a BSEM approach with ridge regression prior (BSEM-RP). We propose another Bayesian approach, denoted herein as the Bayesian structural equation modeling with spike-and-slab prior (BSEM-SSP), which serves as a one-stage alternative to the BSEM-RP. We review the theoretical advantages and disadvantages of both approaches and compare their empirical performance relative to two modification indices-based approaches and exploratory factor analysis with target rotation. A teacher stress scale data set is used to demonstrate our approach.     

Using priors to formalize theory: Optimal attention and the generalized context model

Formal models in psychology are used to make theoretical ideas precise and allow them to be evaluated quantitatively against data. We focus on one important??but under-used and incorrectly maligned??method for building theoretical assumptions into formal models, offered by the Bayesian statistical approach. This method involves capturing theoretical assumptions about the psychological variables in models by placing informative prior distributions on the parameters representing those variables. We demonstrate this approach of casting basic theoretical assumptions in an informative prior by considering a case study that involves the generalized context model (GCM) of category learning. We capture existing theorizing about the optimal allocation of attention in an informative prior distribution to yield a model that is higher in psychological content and lower in complexity than the standard implementation. We also highlight that formalizing psychological theory within an informative prior distribution allows standard Bayesian model selection methods to be applied without concerns about the sensitivity of results to the prior. We then use Bayesian model selection to test the theoretical assumptions about optimal allocation formalized in the prior. We argue that the general approach of using psychological theory to guide the specification of informative prior distributions is widely applicable and should be routinely used in psychological modeling.     

The mathematics of geographic profiling

We begin by describing some of the mathematical foundations of the geographic profiling problem. We then present a new mathematical framework for the geographic profiling problem based on Bayesian statistical methods that makes explicit connections between assumptions on offender behaviour and the components of the mathematical model. It also can take into account local geographic features that either influence the selection of a crime site or influence the selection of an offender's anchor point. Copyright © 2009 John Wiley & Sons, Ltd.     

Theory change in immunology part II: The clonal selection theory

This two-part article examines the competition between the clonal selection theory and the instructive theory of the immune response from 1957–1967. In Part I the concept of a temporally extended theory is introduced, which requires attention to the hitherto largely ignored issue of theory individuation. Factors which influence the acceptability of such an extended theory at different temporal points are also embedded in a Bayesian framework, which is shown to provide a rational account of belief change in science. In Part II these factors, as elaborated in the Bayesian framework, are applied to the case of the success of the clonal selection theory and the failure of the instructive theory.     

Teaching Bayesian reasoning in less than two hours

The authors present and test a new method of teaching Bayesian reasoning, something about which previous teaching studies reported little success. Based on G. Gigerenzer and U. Hoffrage's (1995) ecological framework, the authors wrote a computerized tutorial program to train people to construct frequency representations (representation training) rather than to insert probabilities into Bayes's rule (rule training). Bayesian computations are simpler to perform with natural frequencies than with probabilities, and there are evolutionary reasons for assuming that cognitive algorithms have been developed to deal with natural frequencies. In 2 studies, the authors compared representation training with rule training; the criteria were an immediate learning effect, transfer to new problems, and long-term temporal stability. Rule training was as good in transfer as representation training, but representation training had a higher immediate learning effect and greater temporal stability.     

Bayesian tests of measurement invariance

Random item effects models provide a natural framework for the exploration of violations of measurement invariance without the need for anchor items. Within the random item effects modelling framework, Bayesian tests (Bayes factor, deviance information criterion) are proposed which enable multiple marginal invariance hypotheses to be tested simultaneously. The performance of the tests is evaluated with a simulation study which shows that the tests have high power and low Type I error rate. Data from the European Social Survey are used to test for measurement invariance of attitude towards immigrant items and to show that background information can be used to explain cross‐national variation in item functioning.     

Modeling Dependence Structures for Response Times in a Bayesian Framework

A multivariate generalization of the log-normal model for response times is proposed within an innovative Bayesian modeling framework. A novel Bayesian Covariance Structure Model (BCSM) is proposed, where the inclusion of random-effect variables is avoided, while their implied dependencies are modeled directly through an additive covariance structure. This makes it possible to jointly model complex dependencies due to for instance the test format (e.g., testlets, complex constructs), time limits, or features of digitally based assessments. A class of conjugate priors is proposed for the random-effect variance parameters in the BCSM framework. They give support to testing the presence of random effects, reduce boundary effects by allowing non-positive (co)variance parameters, and support accurate estimation even for very small true variance parameters. The conjugate priors under the BCSM lead to efficient posterior computation. Bayes factors and the Bayesian Information Criterion are discussed for the purpose of model selection in the new framework. In two simulation studies, a satisfying performance of the MCMC algorithm and of the Bayes factor is shown. In comparison with parameter expansion through a half-Cauchy prior, estimates of variance parameters close to zero show no bias and undercoverage of credible intervals is avoided. An empirical example showcases the utility of the BCSM for response times to test the influence of item presentation formats on the test performance of students in a Latin square experimental design.

     

V—Vagueness, Realism, Language and Thought

The problem of vagueness and the sorites paradox arise because we try to treat natural language as if it were a unitary formal system. In fact, natural language contains a large variety of representational ontologies that serve different purposes and which cannot be united formally, but which can intuitively be taken as ways of seeing a common basic ontology. Using this framework, we can save classical logic from vagueness and avoid the sorites.     

Representation recovers information

Early agreement within cognitive science on the topic of representation has now given way to a combination of positions. Some question the significance of representation in cognition. Others continue to argue in favor, but the case has not been demonstrated in any formal way. The present paper sets out a framework in which the value of representation use can be mathematically measured, albeit in a broadly sensory context rather than a specifically cognitive one. Key to the approach is the use of Bayesian networks for modeling the distal dimension of sensory processes. More relevant to cognitive science is the theoretical result obtained, which is that a certain type of representational architecture is necessary for achievement of sensory efficiency. While exhibiting few of the characteristics of traditional, symbolic encoding, this architecture corresponds quite closely to the forms of embedded representation now being explored in some embedded/embodied approaches. It becomes meaningful to view that type of representation use as a form of information recovery. A formal basis then exists for viewing representation not so much as the substrate of reasoning and thought, but rather as a general medium for efficient, interpretive processing.     

The form of the forgetting curve and the fate of memories

Psychologists have debated the form of the forgetting curve for over a century. We focus on resolving three problems that have blocked a clear answer on this issue. First, we analyzed data from a longitudinal experiment measuring cued recall and stem completion from 1 min to 28 days after study, with more observations per interval per participant than in previous studies. Second, we analyzed the data using hierarchical models, avoiding distortions due to averaging over participants. Third, we implemented the models in a Bayesian framework, enabling our analysis to account for the ability of candidate forgetting functions to imitate each other. An exponential function provided the best fit to individual participant data collected under both explicit and implicit retrieval instructions, but Bayesian model selection favored a power function. All analysis supported above chance asymptotic retention, suggesting that, despite quite brief study, storage of some memories was effectively permanent.     

Exploring Perspectives on the Hiring of School Counsellors: from Directive to Direction

Currently, there is no national framework or standardized procedure for the selection and recruitment of counsellors for schools in India. Hiring as a practice aids the selection of a professional counsellor in alignment with the needs of the school. In order to bring this area into research focus, the present study employs a qualitative design to explore perspectives of five school principals and five school counsellors on the hiring of prospective school counsellors. In-depth interviews were conducted with the participants, and data collected were subjected to thematic analysis. Findings describe reasons underlying the hiring of school counsellors, the criteria that are used to guide selection, the process of hiring itself and issues currently encountered during selection. They indicate a need for structured formal guidelines for selection and recruitment of school counsellors at the school and policy level. On the basis of findings, a checklist is presented to serve as an initial guide in the hiring process in the absence of a defined system of selection and recruitment.     

Picturing classical and quantum Bayesian inference

We introduce a graphical framework for Bayesian inference that is sufficiently general to accommodate not just the standard case but also recent proposals for a theory of quantum Bayesian inference wherein one considers density operators rather than probability distributions as representative of degrees of belief. The diagrammatic framework is stated in the graphical language of symmetric monoidal categories and of compact structures and Frobenius structures therein, in which Bayesian inversion boils down to transposition with respect to an appropriate compact structure. We characterize classical Bayesian inference in terms of a graphical property and demonstrate that our approach eliminates some purely conventional elements that appear in common representations thereof, such as whether degrees of belief are represented by probabilities or entropic quantities. We also introduce a quantum-like calculus wherein the Frobenius structure is noncommutative and show that it can accommodate Leifer??s calculus of ??conditional density operators??. The notion of conditional independence is also generalized to our graphical setting and we make some preliminary connections to the theory of Bayesian networks. Finally, we demonstrate how to construct a graphical Bayesian calculus within any dagger compact category.     

Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search

Many experiments have shown that the human visual system makes extensive use of contextual information for facilitating object search in natural scenes. However, the question of how to formally model contextual influences is still open. On the basis of a Bayesian framework, the authors present an original approach of attentional guidance by global scene context. The model comprises 2 parallel pathways; one pathway computes local features (saliency) and the other computes global (scene-centered) features. The contextual guidance model of attention combines bottom-up saliency, scene context, and top-down mechanisms at an early stage of visual processing and predicts the image regions likely to be fixated by human observers performing natural search tasks in real-world scenes.     

Towards a Theory of Limited Indeterminism in Branching Space-times

Branching space-times (BST; Belnap, Synthese 92:385–434, 1992) is the most advanced formal framework for representing indeterminism. BST is however based on continuous partial orderings, while our natural way of describing indeterministic scenarios may be called discrete. This paper establishes a theorem providing a discrete data format for BST: it is proved that a discrete representation of indeterministic scenarios leading to BST models is possible in an important subclass of cases. This result enables the representation of limited indeterminism in BST and hopefully paves the way for the representation of substances with capacities in that framework.