An automated test development of parallel tests from a seed test

Binary programming models are presented to generate parallel tests from an itembank. The parallel tests are created to match item for item an existing seed test and match user supplied taxonomic specifications. The taxonomic specifications may be either obtained from the seed test or from some other user requirement. An algorithm is presented along with computational results to indicate the overall efficiency of the process. Empirical findings based on an itembank for the Arithmetic Reasoning section of the Armed Services Vocational Aptitude Battery are given.The Office of Naval Research, Program in Cognitive Science, N00014-87-C-0696 partially supported the work of Douglas H. Jones. The Rutgers Research Resource Committee of the Graduate School of Management partially supported the work of Douglas H. Jones and Ing-Long Wu. A Thomas and Betts research fellowship partially supported the work of Ing-Long Wu. The Human Resources Laboratory, United States Air Force, partially supported the work of Ronald Armstrong. The authors benefited from conversations with Dr. Wayne Shore, Operational Technologies, San Antonio, Texas. The order of authors' names is alphabetical and denotes equal authorship.     

Theory change in immunology part II: The clonal selection theory

This two-part article examines the competition between the clonal selection theory and the instructive theory of the immune response from 1957–1967. In Part I the concept of a temporally extended theory is introduced, which requires attention to the hitherto largely ignored issue of theory individuation. Factors which influence the acceptability of such an extended theory at different temporal points are also embedded in a Bayesian framework, which is shown to provide a rational account of belief change in science. In Part II these factors, as elaborated in the Bayesian framework, are applied to the case of the success of the clonal selection theory and the failure of the instructive theory.     

Hypnotizability, imaginative involvement, and anxiety

Forty-five undergraduate students were investigated to determine the relationship between hypnotizability, imaginative involvement (absorption), and anxiety responses. Hypnotizability was measured independently with the Creative Imagination Scale (CIS), and imaginative involvement was measured with the Absorption Scale (ABS). The results indicated moderate significant correlations between CIS, ABS, and several of the anxiety measures. In particular self-reported physiological aspects of anxiety/activation were associated with the CIS and the ABS. Three of the subjects reported having panic attacks. These subjects also exhibited high hypnotic responsiveness, and their scores on the ABS and several of the anxiety scales were considerably elevated as compared with the group mean level.     

Ordinal consistency and ordinal true scores

This paper argues that test data are ordinal, that latent trait scores are only determined ordinally, and that test data are used largely for ordinal purposes. Therefore it is desirable to develop a test theory based only on ordinal assumptions. A set of ordinal assumptions is presented, including an ordinal version of local independence. From these assumptions it is first shown that the gamma-correlation between two tests is the product of their gamma-correlations with the true latent order. The theory is generalized to allow for heterogeneous tests by defining a weighted average local independence. The tau-correlations between total score and the latent order can be found in both homogeneous and heterogeneous cases, and a system of differential item weighting to maximize the tau-correlation between weighted items and the latent order is provided. Thus a purely ordinal test theory seems possible.Part of this work was done while the author was a Visiting Fellow at Macquarrie University. The paper has benefitted from discussions with Professors Thomas J. Reynolds and Roderick P. McDonald and from the comments of several anonymous reviewers.     

Criterion-related construct validity

Established results on latent variable models are applied to the study of the validity of a psychological test. When the test predicts a criterion by measuring a unidimensional latent construct, not only must the total score predict the criterion, but the joint distribution of criterion scores and item responses must exhibit a certain pattern. The presence of this population pattern may be tested with sample data using the stratified Wilcoxon rank sum test. Often, criterion information is available only for selected examinees, for instance, those who are admitted or hired. Three cases are discussed: (i) selection at random, (ii) selection based on the current test, and (iii) selection based on other measures of the latent construct. Discriminant validity is also discussed.This work was supported in part by Grant SES-87-01890 from the Measurement Methods and Data Improvement Program of the U.S. National Science Foundation.     

Influential observations in principal factor analysis

We propose a method for detecting influential observations in iterative principal factor analysis. For this purpose we derive the influence functionsI(x; LL ^T ) andI(x; ) for the common variance matrixT =LL ^T and the unique variance matrix , respectively, in the common factor decomposition =LL ^T + . A numerical example is given for illustration.The authors are grateful to Tomoyuki Tarumi and Atsuhiro Hayashi for their kind permission to use their software Seto/B for drawing Figures 1 and 2 and to anonymous reviewers for comments on the paper.     

Using item-specific instructional information in achievement modeling

The problem of detecting instructional sensitivity (item basis) in test items is considered. An illustration is given which shows that for tests with many biased items, traditional item bias detection schemes give a very poor assessment of bias. A new method is proposed instead. This method extends item response theory (IRT) by including item-specific auxiliary measurement information related to opportunity-to-learn. Item-specific variation in measurement relations across students with varying opportunity-to-learn is allowed for.This paper was presented at the 1987 AERA meeting in Washington, DC. This research was supported by grant OERI-G-86-003 from the Office of Educational Research and Improvement, Department of Education. The author thanks Michael Hollis and Chih-fen Kao for valuable research assistance, and appreciates valuable comments made by an anonymous reviewer.     

Chest pain without coronary artery disease: An exploratory comparison with panic disorder

Recent reports have indicated similarities between patients with persistent chest pain of nonorganic origin and patients with panic disorder. In order to explore this association further, we administered a structured interview and three self-report measures (State-Trait Inventory, Beck Depression Inventory, and SCL90-R) to three subject groups: (1) a sample with persistent chest pain (CP; n=14) who had been screened and found to have normal coronary arteries, (2) a sample of patients with panic disorder (PD; n=14), and (3) a sample of matched normals (n=14). CP patients were considered to be free of coronary artery disease (CAD) following normal cardiac catheterization and/or normal thallium stress tests and were not diagnosed initially with panic disorder. PD patients were diagnosed with a standardized psychiatric interview and were free of organic causes of panic. Using an exploratory data analytic approach, the results indicated that both CP and PD samples reported increased levels of state and trait anxiety (p <.0001), depression (p <.01), and somatization (p <.0001) compared with normals. CP patients differed from PD patients in their less frequent use of anxiolytic medication (p <.01) and lower levels of reported panic anxiety and phobic avoidance (p <.0001). These data suggest that persistent chest pain in the absence of CAD shares some features with panic disorder, yet differs from panic in key ways as well. The results are discussed in light of the role of anxiety in contributing to symptom labeling.This research was supported by Grant 86G-491 from the American Heart Association, Texas Affiliate, to J.G.B. H.T. is the recipient of USPHS Research Career Development Award K04-HL-0122246.