Data‐driven approaches to information access

This paper summarizes three lines of research that are motivated by the practical problem of helping users find information from external data sources, most notably computers. The application areas include information retrieval, text categorization, and question answering. A common theme in these applications is that practical information access problems can be solved by analyzing the statistical properties of words in large volumes of real world texts. The same statistical properties constrain human performance, thus we believe that solutions to practical information access problems can shed light on human knowledge representation and reasoning.     

What Can the Systems Community Contribute to Ensure the Survival of Civilization

Much of what we need to plan for our survival is already known, but what we know, how we know, and who knows is divided up between disciplines. Thus much of the problem of ensuring our survival is a matter of learning across the disciplines. We identify four modes through which we bring disciplinary knowledge together: the unity of science, integrated assessment, heuristic models, and distributed learning networks. Although none of them are perfect, we can learn how to put our knowledge together across the disciplines much better than we do.     

Functional measurement approach to self-estimation in multiattribute evaluation

Multiattribute analysis depends on measurement of values and weights. Unless these measures reflect the decision maker's true values and weights, the multiattribute formula may put a less-preferred alternative in first place. To avoid such disordinality requires stringent measurement conditions: First, the values and weights must be on linear (equal interval) or ratio (known zero) scales. Second, these scales must satisfy a condition of common unit across disparate attribute dimensions. Most methods of range adjustment beg both of these measurement questions. Functional measurement theory can solve both problems and so can be useful in multiattribute analysis. Past work has established the operation of a general cognitive algebra as an empirical reality. The averaging model, in particular, makes possible the definition and estimation of weights and values as distinct psychological parameters. It can also solve the problem of common unit. Cognitive algebra thus provides a grounded theoretical foundation on which to develop self-estimation methodology, in which decision makers provide direct estimates of their values and weights. The logic is straightforward. Functional measurement can analyze global judgments to obtain validated psychological scales. These scales may then be used as validational criteria for the self-estimates. Procedures to eliminate biases in the self-estimates can thus be tested and refined in well-learned multiattribute tasks, such as judgments of meals, in which global judgments are trustworthy. Once developed, such self-estimation procedures may be used with some confidence for general multiattribute analysis. A number of studies from 20-odd years of work on the theory of information integration are summarized to show good, although not unmixed promise for self-estimation.     

Incorporating prior theory in covariance structure analysis: A bayesian approach

A Bayesian approach to the testing of competing covariance structures is developed. The method provides approximate posterior probablities for each model under consideration without prior specification of individual parameter distributions. The method is based on ayesian updating using cross-validated pseudo-likelihoods. Given that the observed variables are the samefor all competing models, the approximate posterior probabilities may be obtained easily from the chi square values and other known constants, using only a hand calculator. The approach is illustrated using and example which illustrates how the prior probabilities can alter the results concerning which model specification is preferred.     

A maximum likelihood hierarchical disaggregate model for predicting choices of individuals

The absence of operational disaggregate lexicographic decision models and Tversky's observation that choice behavior is often inconsistent, hierarchical, and context dependent motivate the development of a maximum likelihood hierarchical (MLH) choice model. This new disaggregate choice model requires few assumptions and accommodates the three aspects of choice behavior noted by A. Tversky (1972, Journal of Mathematical Psychology, 9, 341–367). The model has its foundation in a prototype model developed by the authors. Unlike the deterministic prototype, however, MLH is a probabilistic model which generates maximum likelihood estimators of the aggregate “cutoff values.” The model is formulated as a concave programming problem whose solutions are therefore globally optimal. Finally, the model is applied to data from three separate studies where it is demonstrated to have superior performance over the prototype model in its predictive performance.     

Multiple information sources in interceptive timing

This study was designed to explore the limitations of tau (τ) as an explanatory construct for the timing of interceptive action. This was achieved by examining the effects of environmental structure and binocular vision on the timing of the grasp in a simple one-handed catch. In two experiments, subjects were required to catch luminous balls of different diameters (4, 6, 8 and 10 cm) in a completely darkened room. In the first experiment the influence of the presence vs. absence of an environmental background structure (both under monocular viewing) was tested, and in the second experiment the influence of monocular vs. binocular vision was examined. It was found that irrespective of the presence of environmental structure, an effect of ball size occurred in the monocular viewing conditions. That is, in monocular viewing conditions the grasp was initiated and completed earlier for the larger balls as compared to the smaller ones, while in the binocular viewing condition subjects behaved in accordance with a constant time to contact strategy: no effects of ball size were found. It is concluded that under binocular viewing a binocular information source is used, while in the monocular viewing condition a lower order information source like image size or image velocity is probably involved.     

On optimal smoothing and derivative estimation from noisy displacement data in biomechanics

Estimating derivatives from noisy displacement data is a notoriously ill-posed problem in signal processing and biomechanics. Following the work of Wood and Jennings (1978) and Hatze (1979, 1981), the present paper describes the use of optimally regularized, natural quintic splines for estimating smoothed positions, velocities, and accelerations from equidistantly sampled, noisy position measurements. It appears that the nature of the boundary conditions of the data is of some importance, since various algorithms used hitherto result in artefacts throughout the data if the true derivatives at the record ends differ significantly from zero. Natural quintic splines do not suffer from this disadvantage below the third derivative.The ill-posed character of movement analysis has some interesting implications for movement synthesis and optimization, similar to the indeterminacy of muscular co-contraction from merely external, biomechanical measurements.     

New assessment systems for residential treatment,management, research,and evaluation: A symposium

An introduction and overview are presented to new observational assessment systems for ongoing assessment and monitoring of both staff and resident (client or patient) functioning in residential treatment programs for emotionally disturbed and mentally retarded adults.Preparation of articles and the research and development on which the articles are based was supported, in part, by Public Health Service Grants MH-15553 and MH-25464 from the National Institute of Mental Health, and by grants from the Joyce Foundation and the Illinois Department of Mental Health and Developmental Disabilities.A symposium presented at the 87th Annual Meetings of the American Psychological Association, New York City, September 1979.     

Systems use to objectify program evaluation,clinical, and management decisions

The utility of the observational assessment systems at different levels — from local clinical to systemwide management — is outlined. An overview is provided of TSBC information applied to individualized problem identification and programming/monitoring, discharge and competency determinations, and both absolute and comparative program evaluation. The utility of SRIC information for prgoramming/monitoring and for staff training and evaluation is outlined in addition to the applied uses of the information of the assessment systems in combination. Once implemented, the continuous data from the systems allow for empirically based self-corrective improvements in the quality of mental health services while automatically providing a basis for legal documentation and accurate cost/effectiveness comparisons of mental health programs.Preparation of this article and the research and development on which the article is based were supported, in part, by Public Health Service Grants MH-15553 and MH-25464 from the National Institute of Mental Health, and by grants from The Joyce Foundation and the Illinois Department of Mental Health and Developmental Disabilities.Presented at the 87th Annual Meetings of the American Psychological Association, New York City, September 1979, as part of a symposium on New assessment systems for residential treatment, management, research, and evaluation.