ON THE NEED FOR QUALITY CONTROL IN VALIDATION RESEARCH

The aptitude tests used to help make personnel decisions about military recruits were validated against hands-on tests of job performance in two Marine Corps occupational specialties, radio repairers and automotive mechanics. The tests were administered by Marine Corps noncommissioned officers. Marine Corps units provided the test administrators, testing facilities, and examinees. Data collected under such conditions are filled with errors that reduce the accuracy of validity coefficients. This paper shows how validity coefficients can be made more accurate by exercising quality control during the statistical analysis.     

Test theory without an answer key

A general model is presented for homogeneous, dichotomous items when the answer key is not known a priori. The model is structurally related to the two-class latent structure model with the roles of respondents and items interchanged. For very small sets of respondents, iterative maximum likelihood estimates of the parameters can be obtained by existing methods. For other situations, new estimation methods are developed and assessed with Monte Carlo data. The answer key can be accurately reconstructed with relatively small sets of respondents. The model is useful when a researcher wants to study objectively the knowledge possessed by members of a culturally coherent group that the researcher is not a member of.This research was supported by NSF Grant No. SES-8320173 to the authors. We gratefully acknowledge comments and suggestions from John Boyd, Tarow Indow, and Kathy Maher as well as the editor and several anonymous referees.     

Sample size determinations for the two rater kappa statistic

This paper gives a method for determining a sample size that will achieve a prespecified bound on confidence interval width for the interrater agreement measure,. The same results can be used when a prespecified power is desired for testing hypotheses about the value of kappa. An example from the literature is used to illustrate the methods proposed here.     

A representation theorem for languages with generalized quantifiers through back-and-forth methods

We obtain in this paper a representation of the formulae of extensions ofL by generalized quantifiers through functors between categories of first-order structures and partial isomorphisms. The main tool in the proofs is the back-and-forth technique. As a corollary we obtain the Caicedo's version of Fraïssés theorem characterizing elementary equivalence for such languages. We also discuss informally some geometrical interpretations of our results.     

Stress in time

The goals of this research were to determine whether speakers adjust the stress patterns of words within sentences to create an alternation between strong and weak beats and to explore whether this rhythmic alternation contributes to the characteristics stress differences between two major lexical categories of English. Two experiments suggested that speakers do alter lexical stress in accordance with rhythmic biases. When speakers produced disyllabic pseudowords in sentence contexts, they were more likely to place stress on the first syllable when the pseudoword was preceded by a weak stress and followed by a strong one than when the strong stress preceded and the weak followed. This occurred both when the pseudowords served as nouns and when they served as verbs. Text analyses further revealed that weakly stressed elements precede nouns more often than verbs, whereas such elements follow verbs more often than nouns. Thus, disyllabic nouns are more likely than disyllabic verbs to occupy contexts biased toward trochaic rhythm, a finding consistent with leftward dominant stress in disyllabic English nouns. The history of stress changes in English nouns and verbs also conforms with the view that rhythmic context may have contributed to the evolution of stress differences. Together, the findings suggest that the citation stress patterns of words may to some degree reflect adaptations of lexical knowledge to conditions of language performance.     

Perception of translational heading from optical flow

Radial patterns of optical flow produced by observer translation could be used to perceive the direction of self-movement during locomotion, and a number of formal analyses of such patterns have recently appeared. However, there is comparatively little empirical research on the perception of heading from optical flow, and what data there are indicate surprisingly poor performance, with heading errors on the order of 5 degrees-10 degrees. We examined heading judgments during translation parallel, perpendicular, and at oblique angles to a random-dot plane, varying observer speed and dot density. Using a discrimination task, we found that heading accuracy improved by an order of magnitude, with 75%-correct thresholds of 0.66 degrees in the highest speed and density condition and 1.2 degrees generally. Performance remained high with displays of 63-10 dots, but it dropped significantly with only 2 dots; there was no consistent speed effect and no effect of angle of approach to the surface. The results are inconsistent with theories based on the local focus of outflow, local motion parallax, multiple fixations, differential motion parallax, and the local maximum of divergence. But they are consistent with Gibson's (1950) original global radial outflow hypothesis for perception of heading during translation.     

Problem structure and the use of base-rate information from experience

This article is concerned with the use of base-rate information that is derived from experience in classifying examples of a category. The basic task involved simulated medical decision making in which participants learned to diagnose hypothetical diseases on the basis of symptom information. Alternative diseases differed in their relative frequency or base rates of occurrence. In five experiments initial learning was followed by a series of transfer tests designed to index the use of base-rate information. On these tests, patterns of symptoms were presented that suggested more than one disease and were therefore ambiguous. The alternative or candidate diseases on such tests could differ in their relative frequency of occurrence during learning. For example, a symptom might be presented that had appeared with both a relatively common and a relatively rare disease. If participants are using base-rate information appropriately (according to Bayes' theorem), then they should be more likely to predict that the common disease is present than that the rare disease is present on such ambiguous tests. Current classification models differ in their predictions concerning the use of base-rate information. For example, most prototype models imply an insensitivity to base-rate information, whereas many exemplar-based classification models predict appropriate use of base-rate information. The results reveal a consistent but complex pattern. Depending on the category structure and the nature of the ambiguous tests, participants use base-rate information appropriately, ignore base-rate information, or use base-rate information inappropriately (predict that the rare disease is more likely to be present). To our knowledge, no current categorization model predicts this pattern of results. To account for these results, a new model is described incorporating the ideas of property or symptom competition and context-sensitive retrieval.     

Nonverbal communication as a compensative strategy for severely nonfluent aphasics? A quantitative approach

Seven severely nonfluent aphasics and one relative or close friend were investigated in an interview situation. The conversation was videotaped and analyzed for the use of nonverbal communication between aphasic and partner. The results indicate that the group of aphasics used significantly more frequently and for a significantly longer period of time nonverbal channels of communication than their healthy partners. The aphasic patients also used significantly fewer speech-focused movements and significantly more codified gestures. Nonverbal elements were more frequently used as speech substitutes by the group of aphasics.     

The role of the right hemisphere in the production of linguistic stress

Recent research has proposed a general prosodic disturbance associated with right hemisphere damage (RHD), one encompassing both affective and linguistic functions. The present study attempted to explore whether the ability to produce linguistic prosody was impaired in this patient population. Productions of phonemic stress tokens (e.g., Re'dcoat vs. red coa't) as well as examples of contrastive stress, or sentential emphasis (e.g., Sam hated the movie), were elicited from eight male speakers with unilateral right hemisphere CVAs and seven male control subjects. Two types of analyses were conducted on these utterances. Acoustic analysis focused on the correlates associated with word stress, namely changes in amplitude, duration, and fundamental frequency. The perceptual saliency of emerging cues to stress was also examined by presentation of test tokens to phonetically trained listeners for identification of stress placement. The patients as a group produced fewer acoustic cues to stress compared to the normal subjects, but no statistical differences were found between groups for either stress at the phrase level or at the sentence level. In the perceptual analysis, stress produced by the patient group was judged to be less salient than that for the normal group, although a high degree of variability was evident in both populations. The data suggest a spared processing mechanism for linguistic prosody in RHD speakers, thus mitigating against the view of a general dysprosody tied to RHD.