Measuring nominal scale agreement between a judge and a known standard

Two designs for comparing a judge's ratings with a known standard are presented and compared. Design A pertains to the situation where the judge is asked to categorize each ofN subjects into one ofr (known) classes with no knowledge of the actual number in each class. Design B is employed when the judge is given the actual number in each class and is asked to categorize the individuals subject to these constraints. The probability distribution of the total number of correct choices is developed in each case. A power comparison of the two procedures is undertaken.     

Root nonfinite and finite utterances in child language and agrammatic speech

Root nonfinite structures are frequent in both child language and agrammatic speech. Moreover, root nonfinites seem to have quite similar properties in both types of speech. Although many accounts are available for child language this is not the case for agrammatic speech. I present data of a Dutch agrammatic patient in this paper. The properties of her root nonfinites are best accounted for by the assumption of an underspecified Tense Phrase licensed by an empty element. In her finite sentences a dummy Tense element shows up. The use of either an empty or a dummy Tense element is a way of reducing the processing load of the utterance. The speech of this patient shows a dissociation between the verbal and the nominal domain.     

Over-specified referring expressions impair comprehension: an ERP study

Speakers often include extra information when producing referring expressions, which is inconsistent with the Maxim of Quantity (Grice, 1975). In this study, we investigated how comprehension is affected by unnecessary information. The literature is mixed: some studies have found that extra information facilitates comprehension and others reported impairments. We used an attentional-cueing paradigm to assess how quickly participants could orient attention to an object upon hearing a referring expression, such as the red square. If there are two squares differing in color, then the modifier is required. However, if there is only one (red) square, then the modifier is unnecessary. We also recorded event-related potentials (ERPs) in order to investigate online processing. Reaction times were significantly longer for referring expressions that contained extra information, and ERPs revealed a centroparietal negativity (N400) that emerged approximately 200–300 ms after modifier onset. We conclude that referring expressions with an unnecessary pre-nominal modifier impair comprehension performance.     

Modification indices for the 2-PL and the nominal response model

In this paper, it is shown that various violations of the 2-PL model and the nominal response model can be evaluated using the Lagrange multiplier test or the equivalent efficient score test. The tests presented here focus on violation of local stochastic independence and insufficient capture of the form of the item characteristic curves. Primarily, the tests are item-oriented diagnostic tools, but taken together, they also serve the purpose of evaluation of global model fit. A useful feature of Lagrange multiplier statistics is that they are evaluated using maximum likelihood estimates of the null-model only, that is, the parameters of alternative models need not be estimated. As numerical examples, an application to real data and some power studies are presented.     

Some exact conditional tests of independence forR ×C cross-classification tables

Exact conditional tests of independence in cross-classification tables are formulated based on the ² statistic and statistics with stronger operational interpretations, such as some nominal and ordinal measures of association. Guidelines for the table dimensions and sample sizes for which the tests are economically implemented on a computer are given. Some selected sample sizes and marginal distributions are used in a numerical comparison between the significance levels of the approximate and exact conditional tests based on the ² statistic.The authors are grateful for the suggestions of the referees and for computer funding provided by the Northeast Regional Data Center at the University of Florida.     

Matching models in the analysis of cross-classifications

Inference models motivated by the combinatorial chance literature and the concept of object matching may be used in the analysis of a contingency table if the conditional assumption of fixed row and column totals is imposed. More specifically, by developing a matching reinterpretation for several problems of interest in the prediction analysis of cross-classifications—as defined by Hildebrand, Laing and Rosenthal, appropriate significance tests can be given that may differ from those justified by the more common multinomial models. In the course of the paper the distinction between a degree-1 statistic (based on the relationship between single objects) and a degree-2 statistic (based on the relationship between object pairs) is reviewed in some detail. Also, several specializations are presented to topics of current methodological importance in psychology; for instance, a number of references are made to the measurement of nominal scale response agreement between two raters.Partial support for this research was provided by the National Science Foundation through GSOC-77-28227.     

Loose and Tight: Creative Formation but Rigid Use of Nominal Compounds in Conspiracist Texts

Conspiracy theories (CTs) are spectacular narratives, widely spread, that pose societal threats. We test whether CTs might be linguistically creative products, which would facilitate their transmission and thereby account for their widespread popularity. We analyzed nominal compounds (e.g., mind control, carbon dioxide; N = 1,713,568) from a large corpus of conspiracist and mainstream texts matched by topic. In conspiracist texts, compounds showed greater originality, divergence, and sophistication, but they were used with lower frequency and were more often repeated in different contexts. This pattern suggests a creative aspect in the generation of compounds, coupled with rigidity in their use. We interpret these findings as an effect of loosely defined conceptual boundaries among conspiracist writers, in conjunction with social functions like status or group signaling. Our findings not only contribute to the discourse on creativity in CTs but also provide insights into the communicative advantage of CTs.     

建议的表面采纳的测量方法

前人研究建议采纳多集中于决策者初始决策和最终决策的区别,未曾考虑过决策者的内隐态度。本研究关注决策者的内隐态度,将建议采纳分成表面采纳与真实采纳,创新地提出用内隐联想测验法和重测法测量表面采纳。比较两种方法,它们各有利弊,内隐联想测验法理论基础较扎实但灵敏度不及重测法, 重测法操作较简便但更容易出现被试脱落等问题。     

Grounding by Attention Simulation in Peripersonal Space: Pupils Dilate to Pinch Grip But Not Big Size Nominal Classifier

Grammatical categories represent implicit knowledge, and it is not known if such abstract linguistic knowledge can be continuously grounded in real‐life experiences, nor is it known what types of mental states can be simulated. A former study showed that attention bias in peripersonal space (PPS) affects reaction times in grammatical congruency judgments of nominal classifiers, suggesting that simulated semantics may include reenactment of attention. In this study, we contrasted a Chinese nominal classifier used with nouns denoting pinch grip objects with a classifier for nouns with big object referents in a pupil dilation experiment. Twenty Chinese native speakers read grammatical and ungrammatical classifier‐noun combinations and made grammaticality judgment while their pupillary responses were measured. It was found that their pupils dilated significantly more to the pinch grip classifier than to the big object classifier, indicating attention simulation in PPS. Pupil dilations were also significantly larger with congruent trials on the whole than in incongruent trials, but crucially, congruency and classifier semantics were independent of each other. No such effects were found in controls.     

Using the conditional grade-of-membership model to assess judgment accuracy

Consider the case whereJ instruments are used to classify each ofI objects relative toK nominal categories. The conditional grade-of-membership (GoM) model provides a method of estimating the classification probabilities of each instrument (or judge) when the objects being classified consist of both pure types that lie exclusively in one ofK nominal categories, and mixtures that lie in more than one category. Classification probabilities are identifiable whenever the sample of GoM vectors includes pure types from each category. When additional, relatively mild, assumptions are made about judgment accuracy, the identifiable correct classification probabilities are the greatest lower bounds among all solutions that might correspond to the observed multinomial process, even when the unobserved GoM vectors do not include pure types from each category. Estimation using the conditional GoM model is illustrated on a simulated data set. Further simulations show that the estimates of the classification probabilities are relatively accurate, even when the sample contains only a small percentage of approximately pure objects.The authors thank Max A. Woodbury, Kenneth G. Manton and H. Dennis Tolley for their help and four anonymous Psychometrika reviewers (including an associate editor) for their beneficial expository and technical suggestions. This work was supported by the Dean's Fund for Summer Research, Owen Graduate School of Management, Vanderbilt University.