Back to basics: Percentage agreement measures are adequate, but there are easier ways

Percentage agreement measures of interobserver agreement or "reliability" have traditionally been used to summarize observer agreement from studies using interval recording, time-sampling, and trial-scoring data collection procedures. Recent articles disagree on whether to continue using these percentage agreement measures, and on which ones to use, and what to do about chance agreements if their use is continued. Much of the disagreement derives from the need to be reasonably certain we do not accept as evidence of true interobserver agreement those agreement levels which are substantially probable as a result of chance observer agreement. The various percentage agreement measures are shown to be adequate to this task, but easier ways are discussed. Tables are given to permit checking to see if obtained disagreements are unlikely due to chance. Particularly important is the discovery of a simple rule that, when met, makes the tables unnecessary. If reliability checks using 50 or more observation occasions produce 10% or fewer disagreements, for behavior rates from 10% through 90%, the agreement achieved is quite improbably the result of chance agreement.     

Axiomatic and numerical conjoint measurement: An evaluation of diagnostic efficacy

Synthetic data are used to examine how well axiomatic and numerical conjoint measurement methods, individually and comparatively, recover simple polynomial generators in three dimensions. The study illustrates extensions of numerical conjoint measurement (NCM) to identify and model distributive and dual-distributive, in addition to the usual additive, data structures. It was found that while minimum STRESS was the criterion of fit, another statistic, predictive capability, provided a better diagnosis of the known generating model. That NCM methods were able to better identify generating models conflicts with Krantz and Tversky's assertion that, in general, the direct axiom tests provide a more powerful diagnostic test between alternative composition rules than does evaluation of numerical correspondence. For all methods, dual-distributive models are most difficult to recover, while consistent with past studies, the additive model is the most robust of the fitted models.Douglas Emery is now at the Krannert Graduate School of Management, Purdue University, West Lafayette, IN, on leave from the University of Calgary.     

Two-step weighted least squares factor analysis of dichotomized variables

A two-step weighted least squares estimator for multiple factor analysis of dichotomized variables is discussed. The estimator is based on the first and second order joint probabilities. Asymptotic standard errors and a model test are obtained by applying the Jackknife procedure.     

Alexithymia as a potential source of symptom over‐reporting: An exploratory study in forensic patients and non‐forensic participants

The traditional interpretation of symptom over‐reporting is that it indicates malingering. We explored a different perspective, namely that over‐reporting of eccentric symptoms is related to deficits in articulating internal experiences (i.e., alexithymia). Given that alexithymia has been linked to sleep problems and that fatigue may fuel inattentive responding to symptom lists, we administered measures of alexithymia (TAS ‐20) and symptom over‐reporting (SIMS ), but also sleep quality (SLEEP ‐50) to forensic psychiatric outpatients (n = 40) and non‐forensic participants (n = 40). Forensic patients scored significantly higher on all three indices than non‐forensic participants. In the total sample as well as in subsamples, over‐reporting correlated positively and significantly with alexithymia, with r s being in the 0.50–0.65 range. Sleep problems were also related to over‐reporting, but in the full sample and in the forensic subsample, alexithymia predicted variance in over‐reporting over and above sleep problems. Although our study is cross‐sectional in nature, its results indicate that alexithymia as a potential source of over‐reporting merits systematic research.     

THE COMMUNITY VIEW REVISITED

Abstract: Joining a vast Wittgensteinian anti‐theoretical movement, John Canfield has argued that it is possible to read the claims that (1) “language is essentially communal” and (2) “it is conceptually possible that a Crusoe isolated from birth should speak or follow rules” in such a way that they are perfectly compatible, and, indeed, that Wittgenstein held them both at once. The key to doing this is to drain them of any theoretical content or implications that would put each claim at odds with the other. I argue here, first of all, that it is not possible to detheorize both (1) and (2) and still hope to say anything illuminating about the nature of language. In fact, Canfield himself does not succeed in detheorizing both (1) and (2) but ends up trivializing (1) and leaving (2) with quite a bit of theoretical content. I further argue, however, that this is getting the matter the wrong way around. Contra Canfield et al., it is only when we recognize this that we can appreciate how radical and innovative Wittgenstein's claims about language really are.     

Decision Support System and Multi‐Criteria Decision Aid: A State of the Art and Perspectives

The aim of this paper is to highlight the role of the Decision Support System within the field of multi‐criteria decision aid (MCDA). The MCDA tools have been incorporated into systems to create Multi‐Criteria Decision Support Systems (MCDSSs). In our literature review, we noticed that more than 100 papers have been written over a 20‐year period in which MCDSS was used as a decision‐making tool. The present paper describes some real applications of MCDSS in different fields, harmoniously combined with decision‐making methods such as analytic hierarchy process, Utility Additive, and Goal Programming. The present study proposes an integrative MCDSS evaluation through guidance on the tools most useful for a specific user with a particular decision problem. Copyright © 2014 John Wiley & Sons, Ltd.     

Intra‐active refractions

Responding to the analyses that Andreas Losch and Lucas John Mix offer regarding Living with Tiny Aliens: The Image of God for the Anthropocene, this article begins to address how their respective concerns regarding ratiocentric and anthropocentric ideas haunt the construction of a planetary account of the imago Dei. The article then introduces a subsequent line of critique not mentioned by Losch or Mix related to decentering the human individual from accounts of the imago Dei in order to highlight an ongoing challenge for transdisciplinary theological projects that involve astrobiology.     

Maintenance of Relationship and Individual Functioning Gains Following Online Relationship Programs for Low‐Income Couples

Initial evidence suggests that gains in relationship functioning from brief, web‐based programs are maintained through one year following the intervention; however, whether these results generalize to a low‐income sample is unclear. Furthermore, previous research from in‐person couple therapy suggests there may be different shapes of maintenance slopes for behavioral versus acceptance‐based techniques. This study contacted 668 individuals who enrolled in online behavioral (ePREP) or acceptance‐based (OurRelationship) programs one year following completion of the program. Multilevel modeling was used to examine linear and quadratic rates of change in the year following the online intervention as well as total amount of change from pretreatment to 12‐month follow‐up for both relationship and individual functioning. The majority of couples who responded continued to be in a relationship with the same partner (68.3%). Examinations of relationship functioning indicated couples in both programs maintained their gains over follow‐up (i.e., no significant linear or quadratic changes), with medium‐to‐large within‐group effect sizes from pre‐ to one‐year follow‐up. There were no significant differences in relationship outcomes between OurRelationship and ePREP. Similarly, examinations of individual functioning outcomes indicated couples maintained their gains over follow‐up or continued to improve. In total, couples experienced small‐to‐medium within‐group effect sizes from pretreatment to one‐year follow‐up, with larger effects for individuals who were initially distressed. These results suggest that online programs create lasting change for low‐income couples in relationship and individual functioning, with minimal differences between behavioral and acceptance‐based orientations.