An automated test development of parallel tests from a seed test

Binary programming models are presented to generate parallel tests from an itembank. The parallel tests are created to match item for item an existing seed test and match user supplied taxonomic specifications. The taxonomic specifications may be either obtained from the seed test or from some other user requirement. An algorithm is presented along with computational results to indicate the overall efficiency of the process. Empirical findings based on an itembank for the Arithmetic Reasoning section of the Armed Services Vocational Aptitude Battery are given.The Office of Naval Research, Program in Cognitive Science, N00014-87-C-0696 partially supported the work of Douglas H. Jones. The Rutgers Research Resource Committee of the Graduate School of Management partially supported the work of Douglas H. Jones and Ing-Long Wu. A Thomas and Betts research fellowship partially supported the work of Ing-Long Wu. The Human Resources Laboratory, United States Air Force, partially supported the work of Ronald Armstrong. The authors benefited from conversations with Dr. Wayne Shore, Operational Technologies, San Antonio, Texas. The order of authors' names is alphabetical and denotes equal authorship.     

Theory change in immunology part II: The clonal selection theory

This two-part article examines the competition between the clonal selection theory and the instructive theory of the immune response from 1957–1967. In Part I the concept of a temporally extended theory is introduced, which requires attention to the hitherto largely ignored issue of theory individuation. Factors which influence the acceptability of such an extended theory at different temporal points are also embedded in a Bayesian framework, which is shown to provide a rational account of belief change in science. In Part II these factors, as elaborated in the Bayesian framework, are applied to the case of the success of the clonal selection theory and the failure of the instructive theory.     

Criterion-related construct validity

Established results on latent variable models are applied to the study of the validity of a psychological test. When the test predicts a criterion by measuring a unidimensional latent construct, not only must the total score predict the criterion, but the joint distribution of criterion scores and item responses must exhibit a certain pattern. The presence of this population pattern may be tested with sample data using the stratified Wilcoxon rank sum test. Often, criterion information is available only for selected examinees, for instance, those who are admitted or hired. Three cases are discussed: (i) selection at random, (ii) selection based on the current test, and (iii) selection based on other measures of the latent construct. Discriminant validity is also discussed.This work was supported in part by Grant SES-87-01890 from the Measurement Methods and Data Improvement Program of the U.S. National Science Foundation.     

Using item-specific instructional information in achievement modeling

The problem of detecting instructional sensitivity (item basis) in test items is considered. An illustration is given which shows that for tests with many biased items, traditional item bias detection schemes give a very poor assessment of bias. A new method is proposed instead. This method extends item response theory (IRT) by including item-specific auxiliary measurement information related to opportunity-to-learn. Item-specific variation in measurement relations across students with varying opportunity-to-learn is allowed for.This paper was presented at the 1987 AERA meeting in Washington, DC. This research was supported by grant OERI-G-86-003 from the Office of Educational Research and Improvement, Department of Education. The author thanks Michael Hollis and Chih-fen Kao for valuable research assistance, and appreciates valuable comments made by an anonymous reviewer.     

A quantitative analysis of chain-schedule performance

Six pigeons were trained with a chain variable-interval variable-interval schedule on the left key and with reinforcers available on the right key on a single variable-interval schedule arranged concurrently with both links of the chain. All three schedules were separately and systematically varied over a wide range of mean intervals. During these manipulations, the obtained reinforcer rates on constant arranged schedules also frequently changed systematically. Increasing reinforcer rates in Link 2 of the chain increased response rates in both links and decreased response rates in the variable-interval schedule concurrently available with Link 2. Increasing Link-1 reinforcer rates increased Link-1 response rates and decreased Link-2 response rates. Increasing reinforcer rates on the right-key schedule decreased response rates in Link 1 of the chain but did not affect the rate in Link 2. The results extend and amplify previous analyses of chain-schedule performance and help define the effects that a quantitative model must describe. However, the complexity of the results, and the fact that constant arranged reinforcer schedules did not necessarily lead to constant obtained reinforcer rates, precluded a quantitative analysis.     

Concurrent access to two concentrations of orally delivered phencyclidine: effects of feeding conditions.

Two experiments addressed the effects of food satiation and deprivation on oral self-administration of two concurrently available phencyclidine concentrations. In the first experiment, 8 rhesus monkeys self-administered either of two concentrations of phencyclidine ("PCP, angel dust") and water under concurrent fixed-ratio 16 schedules. One concentration was always held constant (0.25 mg/mL) while a series of other phencyclidine concentrations, ranging from 0 (water) to 1.0 mg/mL, was presented in a nonsystematic order. Initially the monkeys were tested while food satiated, and the procedure was then repeated during food deprivation. The monkeys usually selected the higher concentration within the first few minutes of the session, indicating that taste and/or other immediate postingestional effects were important factors. Contrary to a number of previous reports, there were no consistent differences across subjects in the mean number of liquid deliveries or mean drug intake (mg/kg) during food satiation and deprivation. However, for all monkeys the within-session time course of responding during food satiation consistently differed from that during deprivation. A second experiment assessed whether the failure to find consistent differences in drug intake during food satiation and deprivation had been due to the history of concurrent access to different phencyclidine concentrations or to the extended experience with phencyclidine under food-satiation conditions. Six additional monkeys (Group 2) were exposed to the phencyclidine self-administration procedure (during food satiation and deprivation) for the same length of time as the monkeys in Experiment 1 (Group 1), except they received only concurrent access to phencyclidine (0.25 mg/mL) and water. Both groups then received concurrent access to phencyclidine and water during five repeated cycles of food deprivation and satiation. There were also marked individual differences in Group 2: During food satiation, 2 of the monkeys' responding increased, 1 showed no change, and 3 decreased. Examination of a number of historical variables indicated that the greater the percentage of total sessions spent during food satiation with phencyclidine available (before these experiments began), the greater the amounts of phencyclidine consumed during food satiation and the smaller the differences in phencyclidine intake when the two feeding conditions were compared.     

Observing responses maintained by conditional discriminative stimuli.

In a conditional discrimination procedure, pigeons' observing responses were analyzed to examine whether two color stimuli (blue or red), conditionally related to whether each of two line stimuli (vertical or horizontal) accompanied reinforcement or nonreinforcement, functioned as conditioned reinforcers. If a variable-interval (VI) 10-s requirement was fulfilled, an observing response produced onset of a color stimulus. A little later, a line stimulus was presented independently of responding, added to the color stimulus to form a compound stimulus. If 55 s elapsed with a response not having occurred either through 55 s or after the variable-interval 10-s had timed out, one of the color-line compound stimuli was presented independently of responding. To control for sensory reinforcement effects and for earlier entrance to the later link, a simple discrimination procedure also was conducted in which reinforcement was not correlated with the color stimuli but with the line stimuli only. As in the conditional discrimination, the observing response also could produce earlier presentation of blue or red. The observing response occurred more frequently during the conditional discrimination than during the simple discrimination. The results were related to different theoretical accounts of conditioned reinforcement, particularly the information hypothesis.     

The operant conditioning of response variability: Free-operant versus discrete-response procedures

The operant conditioning of response variability under free-operant and discrete-response procedures was investigated. Two pigeons received food only if their pattern of four pecks on two response keys differed from the patterns emitted on the two immediately preceding trials. Under the free-operant procedure, the keys remained illuminated and operative throughout each trial. There was little variability in the response patterns that resulted, and the pigeons received fewer than one third of the available reinforcers. Under the discrete-response procedure, a brief timeout period followed each response. Variability increased under this procedure, and the pigeons obtained three fourths of the available reinforcers. Previous successes and failures to produce response variability may have been due to the use or failure to use, respectively, a discrete-response procedure. Respondent effects inherent in the free-operant procedure may encourage the development of response stereotypy and, in turn, prevent the development of response variability.     

Delayed temporal discrimination in pigeons: A comparison of two procedures

A within-subjects comparison was made of pigeons' performance on two temporal discrimination procedures that were signaled by differently colored keylight samples. During stimulus trials, a peck on the key displaying a slanted line was reinforced following short keylight samples, and a peck on the key displaying a horizontal line was reinforced following long keylight samples, regardless of the location of the stimuli on those two choice keys. During position trials, a peck on the left key was reinforced following short keylight samples and a peck on the right key was reinforced following long keylight samples, regardless of which line stimulus appeared on the correct key. Thus, on stimulus trials, the correct choice key could not be discriminated prior to the presentation of the test stimuli, whereas on position trials, the correct choice key could be discriminated during the presentation of the sample stimulus. During Phase 1, with a 0-s delay between sample and choice stimuli, discrimination learning was faster on position trials than on stimulus trials for all 4 birds. During Phase 2, 0-, 0.5-, and 1.0-s delays produced differential loss of stimulus control under the two tasks for 2 birds. Response patterns during the delay intervals provided some evidence for differential mediation of the two delayed discriminations. These between-task differences suggest that the same processes may not mediate performance in each.     

Competitive fixed-interval performance in humans

Two persons responded in the same session in separate cubicles, but under a single schedule of reinforcement. Each time reinforcement was programmed, only the first response to occur, that is, the response of only one of the subjects, was reinforced. “Competitive” behavior that developed under these conditions was examined in three experiments. In Experiment 1 subjects responded under fixed-interval (FI) 30-s, 60-s, and 90-s schedules of reinforcement. Under the competition condition, relative to baseline conditions, the response rates were higher and the pattern was “break-and-run.” In Experiment 2, subjects were exposed first to a conventional FI schedule and then to an FI competition schedule. Next, they were trained to respond under either a differential-reinforcement-of-low-rate (DRL) or fixed-ratio (FR) schedule, and finally, the initial FI competition condition was reinstated. In this second exposure to the FI competition procedure, DRL subjects responded at lower rates than were emitted during the initial exposure to that condition and FR subjects responded at higher rates. For all subjects, however, responding gradually returned to the break-and-run pattern that had occurred during the first FI competition condition. Experiment 3 assessed potential variables contributing to the effects of the competitive FI contingencies during Experiments 1 and 2. Subjects were exposed to FI schedules where (a) probability of reinforcement at completion of each fixed interval was varied, or (b) a limited hold was in effect for reinforcement. Only under the limited hold was responding similar to that observed in previous experiments.