The decision to check in multialternative choices and limited sensitivity to default

Given the rapid proliferation of smartphone applications and data aggregation websites, in many situations people can use decision aids to guide their choices. For example, they may consider whether to use a navigation device to check the fastest route or whether to use a price comparison website to find the cheapest deal. In what circumstances will subjects use a costly comparison decision aid (which I refer to as “checking”) to choose for them? In six studies, I investigate the impact of the number of available alternatives and checking's attractiveness on the decision to check. While at first increasing the attractiveness of checking led to higher checking rates, a further increase in the number of available alternatives (and thus checking's attractiveness) did not increase the checking rate. Surprisingly, even when checking had a 40% higher expected value compared with not checking, the observed checking rate was below 45%, contrary to risk and ambiguity aversion predictions. Furthermore, labeling the checking alternative as the default had no impact on its choice rate. I find large individual differences in decisions to check. Surprisingly, subjects' initial decisions had high predictive power over their subsequent checking rates, even after 100 trials with full feedback. I propose two simple learning models that capture well the aggregated results.     

Aggregate item response analysis

A stochastic postulate is given for the multiple-item, successive-intervals scaling of populations. The logistic equivalent of this postulate provides an aggregate item response model in which a unidimensional submodel may be nested. This reduction provides a subtractive conjoint measurement of several items and stimuli on the same latent scale. Generalized-least-squares methods are used to estimate and test the multiple-item model, and its unidimensional reduction, on aggregate survey responses. The entire procedure is illustrated with an analysis of semantic-differential attitude data. This analysis exhibits an item selection procedure that is applicable to various social constructs.The authors dedicate this paper to the memory and contributions of Clyde Coombs.The programming and data analyses for the present paper were carried out by José Ventura of the Department of Industrial and Systems Engineering, and Jerry Meiten of the Department of Statistics, University of Florida.The study was also supported by the College of Business Administration, University of Florida, and the Faculty of Social Sciences, Hebrew University of Jerusalem.     

Test theory without an answer key

A general model is presented for homogeneous, dichotomous items when the answer key is not known a priori. The model is structurally related to the two-class latent structure model with the roles of respondents and items interchanged. For very small sets of respondents, iterative maximum likelihood estimates of the parameters can be obtained by existing methods. For other situations, new estimation methods are developed and assessed with Monte Carlo data. The answer key can be accurately reconstructed with relatively small sets of respondents. The model is useful when a researcher wants to study objectively the knowledge possessed by members of a culturally coherent group that the researcher is not a member of.This research was supported by NSF Grant No. SES-8320173 to the authors. We gratefully acknowledge comments and suggestions from John Boyd, Tarow Indow, and Kathy Maher as well as the editor and several anonymous referees.     

Setting the sales budget: An exploratory study

This article explores how the sales budget is set in a business organization. Findings from a longitudinal participant observation study revealed that the sales budget is considered of great importance to the organization as sales estimates serve as premises for planning of production and supply and new product developments. It was observed that the sales budget was based on a narrow, inner-directed perspective, almost looking away from important environmental driving forces such as competitors and customers. The findings also showed that individuals involved in the sales budgeting process behaved opportunistically, influencing the budgetary process and outcomes. Theoretical and normative implications are highlighted.     

Examining differential item functioning due to item difficulty and alternative attractiveness

A method for analyzing test item responses is proposed to examine differential item functioning (DIF) in multiple-choice items through a combination of the usual notion of DIF, for correct/incorrect responses and information about DIF contained in each of the alternatives. The proposed method uses incomplete latent class models to examine whether DIF is caused by the attractiveness of the alternatives, difficulty of the item, or both. DIF with respect to either known or unknown subgroups can be tested by a likelihood ratio test that is asymptotically distributed as a chi-square random variable.     

An automated test development of parallel tests from a seed test

Binary programming models are presented to generate parallel tests from an itembank. The parallel tests are created to match item for item an existing seed test and match user supplied taxonomic specifications. The taxonomic specifications may be either obtained from the seed test or from some other user requirement. An algorithm is presented along with computational results to indicate the overall efficiency of the process. Empirical findings based on an itembank for the Arithmetic Reasoning section of the Armed Services Vocational Aptitude Battery are given.The Office of Naval Research, Program in Cognitive Science, N00014-87-C-0696 partially supported the work of Douglas H. Jones. The Rutgers Research Resource Committee of the Graduate School of Management partially supported the work of Douglas H. Jones and Ing-Long Wu. A Thomas and Betts research fellowship partially supported the work of Ing-Long Wu. The Human Resources Laboratory, United States Air Force, partially supported the work of Ronald Armstrong. The authors benefited from conversations with Dr. Wayne Shore, Operational Technologies, San Antonio, Texas. The order of authors' names is alphabetical and denotes equal authorship.     

记忆训练对改善少年、青年和老年人认知功能的作用

本工作采用“位置法”(method of loci)对24例少年、24例青年和22例老年被试进行了记忆训练研究。以毕生发展的观点比较认知训练对改善不同年龄人记忆的作用,进而探讨发展的认知功能储备能量的年龄差异和训练的迁移效应。结果表明认知干预措施可在一定程度上改善老年人的记忆,同时也显示了在发展的储能和对图形的迁移效应方面,老年人明显不如青、少年,而青年与少年则彼此相近。     

Criterion-related construct validity

Established results on latent variable models are applied to the study of the validity of a psychological test. When the test predicts a criterion by measuring a unidimensional latent construct, not only must the total score predict the criterion, but the joint distribution of criterion scores and item responses must exhibit a certain pattern. The presence of this population pattern may be tested with sample data using the stratified Wilcoxon rank sum test. Often, criterion information is available only for selected examinees, for instance, those who are admitted or hired. Three cases are discussed: (i) selection at random, (ii) selection based on the current test, and (iii) selection based on other measures of the latent construct. Discriminant validity is also discussed.This work was supported in part by Grant SES-87-01890 from the Measurement Methods and Data Improvement Program of the U.S. National Science Foundation.     

Influential observations in principal factor analysis

We propose a method for detecting influential observations in iterative principal factor analysis. For this purpose we derive the influence functionsI(x; LL ^T ) andI(x; ) for the common variance matrixT =LL ^T and the unique variance matrix , respectively, in the common factor decomposition =LL ^T + . A numerical example is given for illustration.The authors are grateful to Tomoyuki Tarumi and Atsuhiro Hayashi for their kind permission to use their software Seto/B for drawing Figures 1 and 2 and to anonymous reviewers for comments on the paper.