Exploring the evolved concept of NEWCOMER: Experimental tests of a cognitive model

Enduring human coalitions face the adaptive problem of integrating new members. Although newcomers can provide benefits (e.g., additional labor), newcomers can also create costs (e.g., by free riding). Due to the unique adaptive problems they pose, we hypothesize that the mind contains an evolved concept of NEWCOMER. We test the design of this concept experimentally and show that the activation of the NEWCOMER concept elicits a variety of anti-free rider responses (e.g., a decrease in trust) with adaptively-targeted exceptions (e.g., a minimal increase in exclusion sentiment). These results support the hypothesis that the mind contains specialized concepts for understanding, creating, and sustaining intergenerational coalitions.     

Nonparametric goodness-of-fit tests for the rasch model

A Monte Carlo algorithm realizing a family of nonparametric tests for the Rasch model is introduced which are conditional on the item and subject marginals. The algorithm is based on random changes of elements of data matrices without changing the marginals; most powerful tests against all alternative hypotheses are given for which a monotone characteristic may be computed from the data matrix; alternatives may also be composed. Computation times are long, but exactp-values are approximated with the quality of approximation only depending on calculation time, but not on the number of persons. The power and the flexibility of the procedure is demonstrated by means of an empirical example where, among others, indicators for increased item similarities, the existence of subscales, violations of sufficiency of the raw score as well as learning processes were found. Many of the features described are implemented in the program T-Rasch 1.0 by Ponocny and Ponocny-Seliger (1999).The author wishes to thank Alexander Kaba, Birgit Bukasa, and Ulrike Wenninger of Österreichisches Kuratorium für Verkehrssicherheit (Austrian Traffic Safety Board) for allowing a data set to be used for the empirical example, and Elisabeth Ponocny-Seliger and the reviewers for many helpful comments. The menu-driven program T-Rasch 1.0 by Ponocny and Ponocny-Seliger (1999) can be obtained from Assessment Systems Corporation (http: //www.assess.com) or from the authors. (Note that it also performs exact person fit tests.)     

Personnel selection tests for computer professionals and support technicians

This article discusses the use of achievement and aptitude tests for the assessment of various computer professionals. Specific tests and their validation are discussed. Tests for computer professionals are shown to be valid predictors of job performance and they yield a substantial return on investment to companies that use them. Comparisons are made with other types of tests and suggestions for use are provided.Copies of this article are available from: Dr. George Neuman, Director of SRA Research, London House/SRA, 1550 Northwest Highway, Park Ridge, IL: 60068.     

Some tests of the interactive-activation model for word identification

Summary The interactive-activation model postulates (a) that activation at the letter level leads automatically to activation at the word level, (b) that the word-superiority effect reflects reactivation of letters by the word they spell, and (c) that subjects identify words on the basis of information obtained from separate letter-position channels. In the first two experiments, we showed words in upper, lower, or mixed case: the word-superiority effect was reduced when words were presented in mixed-case letters, presumably because extra-letter information is lost with mixed-case presentation; i.e., postulate (c) is wrong. The third experiment showed that when the letters of a word are rotated 180° subjects can identify the letters without producing a word-superiority effect; i.e., one of postulates (a) and (b) is wrong. In Experiments 4 and 5, we trained subjects to name words presented in inverted letters; training was more effective when subjects could exploit bigram information in addition to letter-channel information; i.e., reading inverted text is based on extra-letter-feature information, not on a general skill in rotating letters. Taken together, our data deny three of the interactive-activation model's major postulates. We offer some suggestions for future versions of the model. Electronic mail: Userid: MEWHORTD; Nodeid: QUCDN; Domain: BITNET     

A model for repeat trial product tests

A non-forced choice model is developed that describes subject behavior on repeat trial discrimination tests of the pick 1 ofk form. The model is developed from the Dirichlet distribution, and it allows for the derivation of individual true scores and of sampling properties for various constructs of interest. These results permit the analysis and comparison of test designs. The model is applied to issues such as forced vs. non-forced choice formats, the best number of alternatives at a choice point, and the selection of expert panels.     

Exact tests for the rasch model via sequential importance sampling

Rasch proposed an exact conditional inference approach to testing his model but never implemented it because it involves the calculation of a complicated probability. This paper furthers Rasch’s approach by (1) providing an efficient Monte Carlo methodology for accurately approximating the required probability and (2) illustrating the usefulness of Rasch’s approach for several important testing problems through simulation studies. Our Monte Carlo methodology is shown to compare favorably to other Monte Carlo methods proposed for this problem in two respects: it is considerably faster and it provides more reliable estimates of the Monte Carlo standard error.This Research was supported in part by National Science Foundation grant DMS-0203762 and a University of Pennsylvania Research Foundation grant.The authors are grateful to Don Burdick for helpful comments. In addition, the authors wish to thank the editor, the associate editor, and the referees for their helpful suggestions.This revised article was published online in August 2005 with the PDF paginated correctly.     

The linear utility model for optimal selection

A linear utility model is introduced for optimal selection when several subpopulations of applicants are to be distinguished. Using this model, procedures are described for obtaining optimal cutting scores in subpopulations in quota-free as well as quota-restricted selection situations. The cutting scores are optimal in the sense that they maximize the overall expected utility of the selection process. The procedures are demonstrated with empirical data.     

A latent trait model for response times on tests employing the proportional hazards model

For computer-administered tests, response times can be recorded conjointly with the corresponding responses. This broadens the scope of potential modelling approaches because response times can be analysed in addition to analysing the responses themselves. For this purpose, we present a new latent trait model for response times on tests. This model is based on the Cox proportional hazards model. According to this model, latent variables alter a baseline hazard function. Two different approaches to item parameter estimation are described: the first approach uses a variant of the Cox model for discrete time, whereas the second approach is based on a profile likelihood function. Properties of each estimator will be compared in a simulation study. Compared to the estimator for discrete time, the profile likelihood estimator is more efficient, that is, has smaller variance. Additionally, we show how the fit of the model can be evaluated and how the latent traits can be estimated. Finally, the applicability of the model to an empirical data set is demonstrated.     

A model for repeat paired comparison preference tests

A model is proposed that describes subject behavior on repeat paired comparison preference tests. The model extends prior work in this area in that it explicitly allows for abstentions and permits the derivation of individual true scores for discrimination ability as well as conditional estimates of proportionate preference. With these results, the properties of a paired comparison test can be thoroughly explored. An empirical example is presented, and test design issues are considered. In particular, repeat paired comparison preference tests are shown to be inherently less efficient discrimination tests than are pick 1 of 2 tests.     

Loglinear Rasch model tests

Existing statistical tests for the fit of the Rasch model have been criticized, because they are only sensitive to specific violations of its assumptions. Contingency table methods using loglinear models have been used to test various psychometric models. In this paper, the assumptions of the Rasch model are discussed and the Rasch model is reformulated as a quasi-independence model. The model is a quasi-loglinear model for the incomplete subgroup × score × item 1 × item 2 × ... × itemk contingency table. Using ordinary contingency table methods the Rasch model can be tested generally or against less restrictive quasi-loglinear models to investigate specific violations of its assumptions.     

Comparison of optimal cutoff points for single and multiple tests in personnel selection

This paper compares the determination of optimal cutoff points for single and multiple tests in the field of personnel selection. Decisional skills of predictor tests composing the multiple test are assumed to be endogenous variables that depend on the cutting points to be set. It is shown how the predictor cutoffs and the collective decision rule are determined dependently by maximizing the multiple test's common expected utility. Our main result specifies the condition that determines the relationship between the optimal cutoff points for single and multiple tests, given the number of predictor tests, the collective decision rule (aggregation procedure of predictor tests' recommendations) and the function relating the tests' decisional skills to the predictor cutoff points. The proposed dichotomous decision-making method is illustrated by an empirical example of selecting trainees by means of the Assessment Center method.     

The derivation of some tests for the rasch model from the multinomial distribution

The present paper is concerned with testing the fit of the Rasch model. It is shown that this can be achieved by constructing functions of the data, on which model tests can be based that have power against specific model violations. It is shown that the asymptotic distribution of these tests can be derived by using the theoretical framework of testing model fit in general multinomial and product-multinomial models. The model tests are presented in two versions: one that can be used in the context of marginal maximum likelihood estimation and one that can be applied in the context of conditional maximum likelihood estimation.I am indebted to Norman Verhelst and Niels Veldhuijzen for their helpful comments. Requests for reprints should be sent to Cees A. W. Glas, Cito, PO Box 1034, 6801 MG Arnhem, THE NETHERLANDS.     

Eye movements as direct tests of the GO model for the missing-letter effect

When asked to detect target letters while reading a text, participants miss more letters in frequently occurring function words than in less frequent content words. To account for this pattern of results, known as the missing-letter effect, Greenberg, Healy, Koriat, and Kreiner proposed the guidance-organization (GO) model, which integrates the two leading models of the missing-letter effect while incorporating innovative assumptions based on the literature on eye movements during reading. The GO model was evaluated by monitoring the eye movements of participants while they searched for a target letter in a continuous text display. Results revealed the usual missing-letter effect, and many empirical benchmark effects in eye movement literature were observed. However, contrary to the predictions of the GO model, response latencies were longer for function words than for content words. Alternative models are discussed that can accommodate both error and response latency data for the missing-letter effect.     

Testing the efficacy of a new procedure for reducing faking on personality tests within selection contexts

The authors propose a new procedure for reducing faking on personality tests within selection contexts. This computer-based procedure attempts to identify and warn potential fakers early on during the testing process and then give them a chance for recourse. Two field studies were conducted to test the efficacy of the proposed procedure. Study 1 participants were 157 applicants competing for 10 staff positions at a large university located in a southern city in the People's Republic of China. In Study 1, potential fakers received a warning message, whereas nonfakers received a nonwarning (control) message. Study 2 participants were 386 Chinese college students applying for membership of a popular student organization at the same university where Study 1 was conducted. In Study 2, the warning and control messages were randomly assigned to all applicants. Results showed some promise for the proposed procedure, but several practical issues need to be considered.