A review of the observational data-collection and reliability procedures reported in The Journal of Applied Behavior Analysis

The research published in the Journal of Applied Behavior Analysis (1968 to 1975) was surveyed for three basic elements: data-collection methods, reliability procedures, and reliability scores. Three-quarters of the studies reported observational data. Most of these studies' observational methods were variations of event recording, trial scoring, interval recording, or time-sample recording. Almost all studies reported assessment of observer reliability, usually total or point-by-point percentage agreement scores. About half the agreement scores were consistently above 90%. Less than one-quarter of the studies reported that reliability was assessed at least once per condition.     

Testing the significance of interobserver agreement measures in the presence of autocorrelation: The jackknife procedure

Users of interobserver agreement statistics have heretofore ignored the problem of autocorrelation in behavior sequences when testing the statistical significance of agreement measures. Due to autocorrelation traditional reliability tests based on the 2 × 2 contingency-table model (e.g., kappa, phi) are incorrect. Correct tests can be developed by using the bivariate time series as a statistical model. Seen from this perspective, testing the significance of interobserver agreement becomes formally equivalent to testing the significance of the lag-zero cross-correlation between two time series. The robust procedure known as the jackknife is suggested for this purpose.     

Matching models in the analysis of cross-classifications

Inference models motivated by the combinatorial chance literature and the concept of object matching may be used in the analysis of a contingency table if the conditional assumption of fixed row and column totals is imposed. More specifically, by developing a matching reinterpretation for several problems of interest in the prediction analysis of cross-classifications—as defined by Hildebrand, Laing and Rosenthal, appropriate significance tests can be given that may differ from those justified by the more common multinomial models. In the course of the paper the distinction between a degree-1 statistic (based on the relationship between single objects) and a degree-2 statistic (based on the relationship between object pairs) is reviewed in some detail. Also, several specializations are presented to topics of current methodological importance in psychology; for instance, a number of references are made to the measurement of nominal scale response agreement between two raters.Partial support for this research was provided by the National Science Foundation through GSOC-77-28227.     

Exploring Counselor-Client Agreement on Clients’ Work Capacity in Established and Consultative Dyads

Counselor-client agreement on the work capacity of clients living with serious mental illnesses informs the counseling relationship and facilitates accurate assessments of client eligibility for public programs. In this exploratory mixed-methods study, we assessed counselor-client agreement on clients’ work capacity in 61 established therapeutic dyads and compared it with 30 dyads involved in an initial assessment session. Intraclass correlation coefficients and mountain plots were used to examine counselor-client agreement. Results revealed moderate counselor-client agreement of work capacity for both dyads. Counselor interviews illuminated sources of discordance. These results have practical implications for assessing the work capacity of clients.     

An ordinal coefficient of relational agreement for multiple judges

In a recent article, Fagot proposed a generalized family of coefficients of relational agreement for multiple judges, focusing on the concept of empirically meaningful relationships. In this paper an ordinal coefficient of relational agreement, based on ranking data, is presented as a special case of the generalized family. It is shown that the proposed ordinal coefficient encompasses other ordinal coefficients, such as the Kendall coefficient of concordance, the average Spearman rank-order coefficient, and intraclass correlation based on ranks. It is also shown that the Kendall coefficient of concordance, corrected for chance agreement, is equivalent to the ordinal coefficient proposed in this paper.     

Gender and Attitudes Towards a Peace Agreement in Situations of Intractable Conflict: The Case of the Jewish-Israeli Society

The question of whether women are more oriented towards peace has been debated in the research literature for several decades but has not been systematically tested in conflict-driven areas. The aim of our article is twofold: (1) to suggest a conceptual framework regarding gender differences in support for peace in intractable conflict and test it in a prominent case study; and (2) to examine whether major events leading to conflict reescalation have differential effects on women and men. Across 145 polls carried out on a monthly basis among nationally representative samples of Jewish-Israelis between 1995 and 2006, we found only marginally higher levels of support for the Oslo Accords among women versus men, while conflict-related worldviews—political ideology and religiosity—had a much larger effect. Furthermore, violent reescalation in the conflict had a stronger effect on reducing men's levels of support for the Oslo Accords than those of women. Robustness analysis of 196 monthly surveys from 2002 until 2018 examining the effect of gender on support for negotiation provided further support for our findings. Overall, our analyses indicate that sex-based differences play a minor role in explaining attitudes towards peace in situations of protracted violent conflicts at different stages, compared to the prominent effects of political ideology and religiosity.     

A comparison of self-other agreement in personal values versus the Big Five personality traits

Can we judge other people’s values accurately, or are values too subjective to assess? We compared self-other agreement in personal values with agreement in the Big Five personality traits. Self-other agreement in four higher-order values (median r = .47) and in six culture-specific value factors (median r = .50) was substantial and similar to that for the Big Five personality traits (median r = .51). When corrected for attenuation due to measurement error self-other agreement was high for all three scales (median rs > .65). The results suggest that people can assess values of others whom they know well with remarkable accuracy. Therefore, other-ratings of personal values can be used to validate and complement self-report value measures.     

The role of successive popes in the process of unification of the Church in China

ABSTRACT

After the establishment of the People’s Republic of China (PRC) in 1949, the Communist Party of China sought to break all ties between the Church in China and Western powers. Since 1957, there have been two distinct Catholic groups within the PRC: the Chinese Catholic Patriotic Association, and the underground church loyal to the Vatican. This may be about to change, however, as in September 2018, the Vatican and the PRC signed a new provisional agreement on the appointment of bishops, which could lead to e?orts towards reuni?cation of the Catholic Church in China after more than sixty years of division. This paper introduces the changing position of the popes with respect to the PRC. The article argues that the new agreement should not be considered an initiative solely of Pope Francis, but rather the result of numerous changes within the Vatican instigated during the papacy of Pope John XXIII.     

Habermas and validity claims

At the heart of Jürgen Habermas’s explication of communicative rationality is the contention that all speech acts oriented to understanding raise three different kinds of validity claims simultaneously: claims to truth, truthfulness, and normative rightness. This paper argues that Habermas presents exactly three distinct, logically independent arguments for his simultaneity thesis: an argument from structure; an argument from criticizability/rejectability; and an argument from understanding/reaching understanding. It is further maintained that the simultaneity thesis receives cogent support only from the Argument from understanding/reaching understanding, and only if the notion of ‘understanding’ is expanded to that of ‘agreement’.