Modeling Motivated Misreports to Sensitive Survey Questions

Asking sensitive or personal questions in surveys or experimental studies can both lower response rates and increase item non-response and misreports. Although non-response is easily diagnosed, misreports are not. However, misreports cannot be ignored because they give rise to systematic bias. The purpose of this paper is to present a modeling approach that identifies misreports and corrects for them. Misreports are conceptualized as a motivated process under which respondents edit their answers before they report them. For example, systematic bias introduced by overreports of socially desirable behaviors or underreports of less socially desirable ones can be modeled, leading to more-valid inferences. The proposed approach is applied to a large-scale experimental study and shows that respondents who feel powerful tend to overclaim their knowledge.     

Searching for inhibition of return in the rat using the covert orienting of attention task

Inhibition of return (IOR) is an important psychological construct describing inhibited responses to previously attended locations. In humans, it is investigated using Posner’s cueing paradigm. This paradigm requires central visual fixation and detection of cued stimuli to the left or right of the fixation point. Stimuli can be validly or invalidly cued, appearing in the same or opposite location to the cue. Although a rat version of the spatial cueing paradigm (the covert orienting of attention task) does exist, IOR has so far not been demonstrated. We therefore investigated whether IOR could be robustly demonstrated in adult male rats using the covert orienting of attention task. This task is conducted in holed wall operant chambers with the central three holes mimicking the set-up for Posner cueing. Across four samples of rats (overall n = 84), we manipulated the following task parameters: stimulus onset asynchronies (Experiments 1–3), cue brightness (Experiment 1b) and the presence of a central reorienting event (Experiment 4). In Experiment 1, we also investigated strain differences by comparing Lister Hooded rats to Sprague–Dawley rats. Although Lister Hooded rats briefly showed evidence of IOR (Experiment 1a, and see Online Resource 1 data), we were unable to replicate this finding in our other experiments using different samples of this strain. Taken together, our findings suggest that IOR cannot be robustly demonstrated in the rat using the covert orienting of attention task conducted in holed wall operant chambers.     

Beliefs about factors affecting the Reliability of eyewitness testimony: A Comparison of judges,jurors and the general public

We surveyed 164 members of the juror pool of the Court of Appeal and a representative sample of 1000 adult Norwegians without juror experience, about their knowledge and beliefs about eyewitness testimony, and compared their answers to a prior survey of Norwegian judges. Although the judges were somewhat more knowledgeable than jurors and the general public, all groups had limited knowledge of eyewitness testimony. Juror experience, in terms of number of times serving as juror, did not correlate with eyewitness knowledge. Consistent with this finding, the knowledge scores of the jurors were similar to the scores of the general public, tested with an abridged seven‐item version of the questionnaire. Comparisons with the results of surveys conducted in the US, indicate similar levels of knowledge among law professionals and jurors in the two countries. Increasing the knowledge of eyewitness testimony among the principal participants in the judiciary system may be an important component of the solution to eyewitness error. Copyright © 2009 John Wiley & Sons, Ltd.     

On the importance of distinguishing between within- and between-subject effects in intransitive intertemporal choice

Most probabilistic paired comparison models treat inconsistent choices as caused by independent and random errors in the pairwise judgments. In this paper, we argue that this assumption is too restrictive for the analysis of paired comparison data obtained from multiple judges when transitivity violations are systematic. We present a new framework that contains the random error assumption as a special case but also allows for systematic changes in an option's utility assessments over the pairwise comparisons. Accounting for both between- and within-judge sources of variability, we demonstrate in an application on intertemporal choice that the proposed framework can capture systematic transitivity violations as well as individual taste differences.     

Thurstonian-Based Analyses: Past, Present, and Future Utilities

Current psychometric models of choice behavior are strongly influenced by Thurstone’s (1927, 1931) experimental and statistical work on measuring and scaling preferences. Aided by advances in computational techniques, choice models can now accommodate a wide range of different data types and sources of preference variability among respondents induced by such diverse factors as person-specific choice sets or different functional forms for the underlying utility representations. At the same time, these models are increasingly challenged by behavioral work demonstrating the prevalence of choice behavior that is not consistent with the underlying assumptions of these models. I discuss new modeling avenues that can account for such seemingly inconsistent choice behavior and conclude by emphasizing the interdisciplinary frontiers in the study of choice behavior and the resulting challenges for psychometricians. The author would like to thank R. Darrell Bock whose work inspired many of the ideas presented here. The paper benefitted from helpful comments by Albert Maydeu-Olivares and Rung-Ching Tsai. The reported research was supported in parts by the Social Sciences and Humanities Research Council of Canada.     

Bayesian Estimation of Circumplex Models Subject to Prior Theory Constraints and Scale-Usage Bias

This paper presents a hierarchical Bayes circumplex model for ordinal ratings data. The circumplex model was proposed to represent the circular ordering of items in psychological testing by imposing inequalities on the correlations of the items. We provide a specification of the circumplex, propose identifying constraints and conjugate priors for the angular parameters, and accommodate theory-driven constraints in the form of inequalities. We investigate the performance of the proposed MCMC algorithm and apply the model to the analysis of value priorities data obtained from a representative sample of Dutch citizens. We wish to thank Michael Browne and two anonymous reviewers for their comments. The data for this study were collected as part of the project AIR2-CT94-1066, sponsored by the European Commission.     

Modelling intransitive preferences: A random-effects approach

Current models for individual-level paired comparison data are based on the three assumptions that (1) pairwise judgments are independent, (2) the utility of an item remains invariant across trials, and (3) pair-specific variability can account for intransitive choice behaviour. All three assumptions seem strong and likely to be violated in empirical applications. This paper introduces a new framework for the analysis of paired comparison data which relaxes these three assumptions and considers the utilities associated with the same item across trials to be neither independent nor identical, but related. The proposed approach provides new insights about the reliability and consistency of paired comparison judgments and can account for systematic violations of transitivity. An application, based on a replication of Tversky's [(1969). Intransitivity of preference. Psychological Review, 76, 31-48] gamble study, illustrates the usefulness of the new approach in modelling both transitive and intransitive preferences.     

Pupillometry reveals communication‐induced object expectations in 12‐ but not 8‐month‐old infants

Several interaction‐based and looking‐time studies suggest that 1‐year‐old infants understand the referential nature of deictic gestures. However, these studies have not unequivocally established that referential gestures induce object expectations in infants prior to encountering a referent object, and have thus remained amenable to simpler attentional highlighting interpretations. The current study tested whether nonlinguistic referential communication induces object expectations in infants by using a novel pupil dilation paradigm. In Experiment 1, 12‐month‐olds watched videos of a protagonist who either pointed communicatively toward an occluder in front of her or remained still. At test, the occluder opened to reveal one of two outcomes: an empty surface or a toy. Results showed that infants’ pupils were larger for the unexpected outcome of an empty surface following a point compared to the control condition (an empty surface following no point). These differences were not caused by differences in looking times or directions. In Experiment 2, an attention‐directing nonsocial control cue replaced the referential communication. The cue did direct 12‐month‐olds’ attention to the occluder, but it did not induce an object expectation. In Experiment 3, we tested 8‐month‐olds in the setting of Experiment 1. In contrast to 12‐month‐olds, 8‐month‐olds did not reveal object expectations following communication. Findings demonstrate that communicative pointing acts induce object expectations at 12 months of age, but not at 8 months of age, and that these expectations are specific to a referential‐communicative as opposed to an attention‐directing nonsocial cue.     

Assessing item-feature effects with item response tree models

Recent applications of item response tree models demonstrate that this model class is well suited to detect midpoint and extremity response style effects in both attitudinal and personality measurements. This paper proposes an extension of this approach that goes beyond measuring response styles and allows us to examine item-feature effects. In a reanalysis of three published data sets, it is shown that the proposed extension captures item-feature effects across affirmative and reverse-worded items in a psychological test. These effects are found to affect directional responses but not midpoint and extremity preferences. Moreover, accounting for item-feature effects substantially improves model fit and interpretation of the construct measurement. The proposed extension can be implemented readily with current software programs that facilitate maximum likelihood estimation of item response models with missing data.     

Contextual Responses to Affirmative and/or Reversed-Worded Items

Psychometrika - This paper presents a systematic investigation of how affirmative and polar-opposite items presented either jointly or separately affect yea-saying tendencies. We measure these...