Axiomatic and numerical conjoint measurement: An evaluation of diagnostic efficacy

Synthetic data are used to examine how well axiomatic and numerical conjoint measurement methods, individually and comparatively, recover simple polynomial generators in three dimensions. The study illustrates extensions of numerical conjoint measurement (NCM) to identify and model distributive and dual-distributive, in addition to the usual additive, data structures. It was found that while minimum STRESS was the criterion of fit, another statistic, predictive capability, provided a better diagnosis of the known generating model. That NCM methods were able to better identify generating models conflicts with Krantz and Tversky's assertion that, in general, the direct axiom tests provide a more powerful diagnostic test between alternative composition rules than does evaluation of numerical correspondence. For all methods, dual-distributive models are most difficult to recover, while consistent with past studies, the additive model is the most robust of the fitted models.Douglas Emery is now at the Krannert Graduate School of Management, Purdue University, West Lafayette, IN, on leave from the University of Calgary.     

Frequency,complexity, and clarity as covariates of observer reliability

Factors affecting interobserver agreement (reliability) with a comprehensive coding system in the naturalistic observation of children were examined. Data from 117 pairs of observations on 35 children and their families were examined with respect to reliability and three possible covariates: response frequency, observation complexity, and code definition clarity. Analysis of results strongly supported response frequency as a positive covariate of interobserver agreement. Complexity was found to negatively covary with interobserver agreement. The relationship between code clarity and reliability was in the predicted direction but failed to obtain statistical significance. Implications for observer training and data collection in observational studies are discussed.An earlier version of this article was prepared for presentation at The Association for the Advancement of Behavior Therapy, Atlanta, Georgia, December 1977.     

A further note on freeman's measure of association

This note extends and elaborates Hubert's attempt to provide an interpretation of Freeman's measure of association,. The measure is used in a a contingency table when observations are ordered on one variable and unordered on the other. No attempt is made explore the distribution of.     

Hubert's multi-rater kappa revisited

There is a frequent need to measure the degree of agreement among R observers who independently classify n subjects within K nominal or ordinal categories. The most popular methods are usually kappa-type measurements. When R = 2, Cohen's kappa coefficient (weighted or not) is well known. When defined in the ordinal case while assuming quadratic weights, Cohen's kappa has the advantage of coinciding with the intraclass and concordance correlation coefficients. When R > 2, there are more discrepancies because the definition of the kappa coefficient depends on how the phrase ‘an agreement has occurred’ is interpreted. In this paper, Hubert's interpretation, that ‘an agreement occurs if and only if all raters agree on the categorization of an object’, is used, which leads to Hubert's (nominal) and Schuster and Smith's (ordinal) kappa coefficients. Formulae for the large-sample variances for the estimators of all these coefficients are given, allowing the latter to illustrate the different ways of carrying out inference and, with the use of simulation, to select the optimal procedure. In addition, it is shown that Schuster and Smith's kappa coefficient coincides with the intraclass and concordance correlation coefficients if the first coefficient is also defined assuming quadratic weights.     

Issues in Parent-Child Agreement: The Case of Structured Diagnostic Interviews

There are three primary purposes of this review. First, the review distinguishes among three types of reliability and describes the importance of evaluating the reliability of child psychopathology assessment instruments for clinical practice and research. Second, parent-child reliability findings from 5 of the more carefully studied and frequently used Structured (semi and highly) diagnostic interviews (The Schedule for Affective Disorders and Schizophrenia for School-age Children, The Child Assessment Scale, The Anxiety Disorders Interview Schedule for Children. The Diagnostic Interview for Children and Adolescents, and the Diagnostic Interview Schedule for Children) are examined. Finally, this review explores factors that have been implicated in terms of their potential effect on parent-child agreement. In addition, future directions for research and clinical practice within this area are identified and potential resolutions to the conundrum of parent-child discordance are discussed.     

The Impact of the Big Five Personality Traits on Reports of Child Behavior Problems by Different Informants

The present study compared ratings of a standardized sample of child behavior problems across informants and examined the effects of informant personality traits on child behavior ratings by mothers, teachers, and group-care workers. Participants were 55 clinic-referred children, aged 6–12 years. All informants watched and rated the same 17-min videotaped behavior sample of a familiar target child. Independent trained observers rated the same videotapes to provide criterion ratings. Informants personality traits were assessed using the NEO Five Factor Personality Inventory. Results showed that mothers reported fewer behavior problems than did the professionals, that the informants who were familiar with the child reported more behavior problems than did the independent observers, and that higher levels of informant neuroticism were related to higher ratings of child behavior problems in the case of the professionals, but not in the case of the mothers. In addition, group-care workers who were less extraverted and open were likely to report more child behavior problems than group-care workers with normal levels of extraversion and openness. Finally, no relations were found between agreeableness or conscientiousness and ratings of child behavior. Findings suggest that professionals who work with children are not immune to distortions based on their own personality.     

A Uniform Approach for Characterizing the Provably Total Number-Theoretic Functions of KPM and (Some of) its Subsystems

In this article we show how to extract with the use of the Buchholz-Cichon-Weiermann approach to subrecursive hierarchies from Rathjen's 1991 ordinal analysis of KPM a characterization of the provably total number-theoretic functions of KPM and some of its (most prominent) subsystems in a uniform and direct way.     

INFLUENCES OF RESPONSE RATE AND DISTRIBUTION ON THE CALCULATION OF INTEROBSERVER RELIABILITY SCORES

We examined the effects of several variations in response rate on the calculation of total, interval, exact‐agreement, and proportional reliability indices. Trained observers recorded computer‐generated data that appeared on a computer screen. In Study 1, target responses occurred at low, moderate, and high rates during separate sessions so that reliability results based on the four calculations could be compared across a range of values. Total reliability was uniformly high, interval reliability was spuriously high for high‐rate responding, proportional reliability was somewhat lower for high‐rate responding, and exact‐agreement reliability was the lowest of the measures, especially for high‐rate responding. In Study 2, we examined the separate effects of response rate per se, bursting, and end‐of‐interval responding. Response rate and bursting had little effect on reliability scores; however, the distribution of some responses at the end of intervals decreased interval reliability somewhat, proportional reliability noticeably, and exact‐agreement reliability markedly.     

Personality perceptions and relationship satisfaction in couples

The present study investigates how perceptions of personality are related to relationship satisfaction in an age-heterogeneous sample of romantic couples. Self- and partner-perceptions as well as perceived similarity and self-other agreement were examined separately for the Big Five personality traits. Results of Actor–Partner-Interdependence Models revealed substantial effects of partner-perceived personality in all Big Five traits on both partners’ relationship satisfaction. In contrast, effects of self-perceived personality on relationship satisfaction were small. Over and above self- and partner-rated personality, perceiving one’s partner as similar to oneself made a small unique contribution to relationship satisfaction in couples. These results emphasize the importance of integrating self- and partner-perceptions of personality for relationships outcomes.