INTERVIEWER DECISION PROCESSES AND EFFECTIVENESS: AN EXPERIMENTAL POLICY-CAPTURING INVESTIGATION

Using a policy-capturing approach, 29 corporate interviewers evaluated 64 hypothetical candidates for a position in a financial services organization. Six selection criteria were manipulated in a balanced factorial design. Interviewers evaluated candidates' qualifications and made hiring recommendations. The results revealed substantial individual differences in interviewers' decision strategies, as well as their insight into their own decision processes. Data on the effectiveness of the 29 interviewers were collected from 427 hiring managers and the decision processes of effective and ineffective interviewers were compared. The findings indicated that the decision strategies used by effective interviewers were quite similar to one another and relied heavily on two selection criteria. Also, effective interviewers were more likely than ineffective interviewers to use selection criteria in a manner that mirrored their self-reports of the importance of these criteria. Effective interviewers were more aware of their decision processes than ineffective interviewers.     

Extracting thresholds from noisy psychophysical data.

Psychophysical studies with infants or with patients often are unable to use pilot data, training, or large numbers of trials. To evaluate threshold estimates under these conditions, computer simulations of experiments with small numbers of trials were performed by using psychometric functions based on a model of two types of noise: stimulus-related noise (affecting slope) and extraneous noise (affecting upper asymptote). Threshold estimates were biased and imprecise when extraneous noise was high, as were the estimates of extraneous noise. Strategies were developed for rejecting data sets as too noisy for unbiased and precise threshold estimation; these strategies were most successful when extraneous noise was low for most of the data sets. An analysis of 1,026 data sets from visual function tests of infants and toddlers showed that extraneous noise is often considerable, that experimental paradigms can be developed that minimize extraneous noise, and that data analysis that does not consider the effects of extraneous noise may underestimate test-retest reliability and overestimate interocular differences.     

A novel contact-lens system to assess visual hemispheric asymmetries.

A soft contact-lens system for achieving unilateral visual stimulation in a free vision format is described. Initial testing with light transmittance and visual perimetry indicated that the lenses created artificial visual-field deficits. The efficacy of the lenses as a technique for lateralizing visual input was evaluated by examining within-subject differences in performance on two visuospatial tasks. Speed and accuracy of performance were greater with visual input directed to the right hemisphere. These data support the lens design as a useful alternative to tachistoscopic procedures and previous lens systems.     

Effects of color of paper on which the Profile of Mood States is printed on the psychological states it measures.

The Profile of Mood States was printed on four different colors of paper (yellow, red, green, blue) and white to test whether the color of paper would influence mood state scores of 246 college students. Univariate analyses of variance identified color effects only on the Fatigue scale.     

Imputation of missing categorical data by maximizing internal consistency

This paper suggests a method to supplant missing categorical data by reasonable replacements. These replacements will maximize the consistency of the completed data as measured by Guttman's squared correlation ratio. The text outlines a solution of the optimization problem, describes relationships with the relevant psychometric theory, and studies some properties of the method in detail. The main result is that the average correlation should be at least 0.50 before the method becomes practical. At that point, the technique gives reasonable results up to 10–15% missing data.We thank Anneke Bloemhoff of NIPG-TNO for compiling and making the Dutch Life Style Survey data available to use, and Chantal Houée and Thérèse Bardaine, IUT, Vannes, France, exchange students under the COMETT program of the EC, for computational assistance. We also thank Donald Rubin, the Editors and several anonymous reviewers for constructive suggestions.     

Did Pearson reject the Neyman-Pearson philosophy of statistics?

I document some of the main evidence showing that E. S. Pearson rejected the key features of the behavioral-decision philosophy that became associated with the Neyman-Pearson Theory of statistics (NPT). I argue that NPT principles arose not out of behavioral aims, where the concern is solely with behaving correctly sufficiently often in some long run, but out of the epistemological aim of learning about causes of experimental results (e.g., distinguishing genuine from spurious effects). The view Pearson did hold gives a deeper understanding of NPT tests than their typical formulation as accept-reject routines, against which criticisms of NPT are really directed. The Pearsonian view that emerges suggests how NPT tests may avoid these criticisms while still retaining what is central to these methods: the control of error probabilities.A portion of this research was carried out during tenure of a National Endowment for the Humanities Summer Stipend Fellowship; I gratefully acknowledge that support. A version of this paper was presented at the 1987 meeting of the Society for Exact Philosophy. This paper benefited from discussions and communications with George Barnard and Isaac Levi. I thank Harlan Miller for helpful comments on earlier drafts.     

An automated test development of parallel tests from a seed test

Binary programming models are presented to generate parallel tests from an itembank. The parallel tests are created to match item for item an existing seed test and match user supplied taxonomic specifications. The taxonomic specifications may be either obtained from the seed test or from some other user requirement. An algorithm is presented along with computational results to indicate the overall efficiency of the process. Empirical findings based on an itembank for the Arithmetic Reasoning section of the Armed Services Vocational Aptitude Battery are given.The Office of Naval Research, Program in Cognitive Science, N00014-87-C-0696 partially supported the work of Douglas H. Jones. The Rutgers Research Resource Committee of the Graduate School of Management partially supported the work of Douglas H. Jones and Ing-Long Wu. A Thomas and Betts research fellowship partially supported the work of Ing-Long Wu. The Human Resources Laboratory, United States Air Force, partially supported the work of Ronald Armstrong. The authors benefited from conversations with Dr. Wayne Shore, Operational Technologies, San Antonio, Texas. The order of authors' names is alphabetical and denotes equal authorship.     

Degree of learning,interpolated tests,and rate of forgetting

The purpose of the two experiments reported here was to observe the effects of degree of learning, interpolated tests, and retention interval, primarily on the rate of forgetting of a list of words, and secondarily on hypermnesia for those words. In the first experiment, all the subjects had one study trial on a list of 20 common words, followed by two tests of recall. Half of the subjects had further study and test trials until they had learned the words to a criterion of three correct consecutive recalls. Two days later, half of the subjects under each learning condition returned for four retention tests, and 16 days later, all the subjects returned for four tests. Experiment 2 was similar, except that all the subjects had at least three study trials followed by four recall tests on Day 1, intermediate tests were given 2 or 7 days later, and they all had final tests 14 days later. The results showed that rate of forgetting was attenuated by an additional intermediate set of tests but not by criterion learning. Hypermnesia was generally found over the tests that were given after a retention interval of 2 or more days. The best predictor of the amount of hypermnesia over a set of tests was the difference between overall cumulative recall and net recall on the first test of the set.