Hubert's multi-rater kappa revisited

There is a frequent need to measure the degree of agreement among R observers who independently classify n subjects within K nominal or ordinal categories. The most popular methods are usually kappa-type measurements. When R = 2, Cohen's kappa coefficient (weighted or not) is well known. When defined in the ordinal case while assuming quadratic weights, Cohen's kappa has the advantage of coinciding with the intraclass and concordance correlation coefficients. When R > 2, there are more discrepancies because the definition of the kappa coefficient depends on how the phrase ‘an agreement has occurred’ is interpreted. In this paper, Hubert's interpretation, that ‘an agreement occurs if and only if all raters agree on the categorization of an object’, is used, which leads to Hubert's (nominal) and Schuster and Smith's (ordinal) kappa coefficients. Formulae for the large-sample variances for the estimators of all these coefficients are given, allowing the latter to illustrate the different ways of carrying out inference and, with the use of simulation, to select the optimal procedure. In addition, it is shown that Schuster and Smith's kappa coefficient coincides with the intraclass and concordance correlation coefficients if the first coefficient is also defined assuming quadratic weights.     

Exploration of a Marital Typology: Implications for Marital Functioning in a Multi-Ethnic Sample

Marital conflict is associated with multiple negative outcomes for couples, including marital dissatisfaction and divorce. Little research, however, has examined conflict in Hispanic/Latino couples or its association with marital satisfaction, which creates an unfortunate knowledge gap for clinicians working with diverse client groups. The present study sought to examine both marital conflict and satisfaction using a sample of 231 European American (EA; n = 108) and Hispanic/Latino (H/L; n = 123) couples. Through observational coding, couples were placed into four groups based on their type of conflict management strategies: Harmonious, Withdrawn, Conflictual-Expressive, or Conflictual-Hostile. For both ethnic groups, couples in the Harmonious group were nondistressed and couples in the Conflictual-Hostile group were in the distressed range of marital satisfaction. Cross-ethnic differences emerged. EA couples experienced distress when both hostile (Conflictual-Hostile) and nonhostile conflict (Conflictual-Expressive) communication types were observed, while only hostile conflict was associated with distress for the H/L group. H/L couples reported similar levels of satisfaction in both the Harmonious and Conflictual-Expressive groups. H/L couples also fell within the distressed range when withdrawn communication patterns were observed; however, this was not the case for EA couples. These differences suggest that both types of conflict are associated with marital distress for EA couples, whereas hostile conflict and withdrawn behavior appear to be more negatively associated with marital satisfaction in H/L couples. Results provide support for the use of an observational coding system with H/L and EA couples and also suggest the importance of understanding how differences in expressions of conflict across ethnicities may relate to marital satisfaction.     

Construct validation of the Narcissistic Admiration and Rivalry Questionnaire in Spanish-speaking countries: Assessment of the reliability,structural and external validity and cross-cultural equivalence

A recent re-operationalisation of grandiose narcissism has resulted in the distinction of two narcissistic strategies based on the cognitive, affective-motivational and behavioural dynamics: admiration (assertive self-enhancement) and rivalry (antagonistic self-protection). The Narcissistic Admiration and Rivalry Questionnaire (NARQ) was developed to assess this model with two higher-order dimensions. However, cross-validations of the NARQ have not been extensively conducted across diverse population groups and languages. This study aimed to test the internal and external validity (through the relation with envy and self-esteem), reliability and cross-cultural equivalence of the Spanish version of the NARQ. The psychometric properties were evaluated in a Spanish sample (N = 310), and cross-cultural equivalence was tested in participants from Chile (N = 234) and Colombia (N = 256). The results supported the reliability and validity of the Spanish NARQ, as well as the cross-cultural equivalence across Spanish-speaking countries. In addition, we discuss obtained differences across Spanish, Chilean and Colombian sample within two narcissistic strategies.     

A comparison of isolated and synthesized contingencies in functional analyses

Recently, researchers have compared the utility of isolated versus synthesized contingencies in functional analysis (FA) methodology (e.g., Fisher et al., 2016; Slaton et al., 2017). A limitation of these studies is that there were other differences across FA methodologies (e.g., design, contingency) that did not allow for isolation of the influence of isolated versus synthesized contingencies. Therefore, the current study compared outcomes of FAs that involved isolated versus synthesized contingencies for problem behavior of 5 children while controlling for these other differences across FAs (Experiment 1). Next, the current study compared the effects of interventions based on the functions identified in the isolated and synthesized contingencies for each participant (Experiment 2). Results indicated isolated contingency FAs produced differentiated responding for 1 or both functions for all 5 participants, and there were little to no differences between treatments informed by isolated and synthesized contingency FAs.     

Bullying Victimization and Use of Substances in High School: Does Religiosity Moderate the Association?

Alcohol, tobacco and other drug use continue to pose serious public health concerns among youth. Bullying victimization has been identified as a risk factor and religiosity a protective factor for adolescent substance use. No previous research has examined the potential moderating role of religiosity. We explore the association between bullying victimization and substance use in adolescents with low and high levels of religiosity. A cross-sectional survey was conducted with a representative sample of high school students in greater Beirut. Binary and multinomial logistic models were used, adjusting for demographics, and stratified by level of religiosity. Of the 986 students responding to the survey, 65% were females; 48% had experienced some form of bullying; and 52% self-rated as low in religiosity. Between 10 and 30% were current users of alcohol or tobacco. Students of lower religiosity levels who had been bullied were more likely to use substances than those who self-rated as high religiosity. Religiosity may be a potential moderator of the association between being bullied and substance use, but the exact mechanisms and underlying reasons need further investigation.

     

Construct Validity and Dimensionality of the Rosenberg Self-Esteem Scale and Its Association with Spiritual Values Within Irish Population

Until this research, correlation of Rosenberg’s (1965) self-esteem scale (RSES), with religious and spiritual values, was never investigated using the measure as a twofold construct instead of the monolithic form. This research paper explores the prediction of RSES by spiritual values using a twofold structure of: self-esteem-positive (SEP) and self-esteem-negative (SEN), to specify individual and fragmented correlations with spirituality, which until now was unobtainable. Confirmatory factor analysis and structural equation modelling were applied to analyse the data. The survey was conducted among two-hundred and sixty-eight participants from the Republic of Ireland. The research finds that spirituality influences peoples’ self-esteem, but clear and linear correlation between spirituality and self-esteem is difficult to be concluded. People respond oppositely and differently to positive and to negative items in the RSES which indicates that the measure is a combination of two statistically consistent constructs: SEP and SEN. The results of the study confirm that there are many spiritual areas that affect self-esteem.

     

Multilevel Heterogeneous Factor Analysis and Application to Ecological Momentary Assessment

Psychometrika - Ansari et al. (Psychometrika 67:49–77, 2002) applied a multilevel heterogeneous model for confirmatory factor analysis to repeated measurements on individuals. While the mean...     

The relationship between dysfunctional metacognitive beliefs and problematic social networking sites use

Social networking sites (SNSs) enrol new subscribers each day. However, problematic SNS use has undesirable effects on psychological functioning. Therefore, it is important to identify the factors that contribute to the development of problematic SNS use. Very few studies have focused on revealing the underlying mechanisms of problematic SNS use. Although many past studies have examined the relationship between metacognitive beliefs and Internet addiction, the association between metacognitive beliefs and problematic SNS use has not been adequately explored. In this study, we aimed to explore the association between metacognitive beliefs and problematic SNS use among young adults. A total of 308 individuals participated in this study. A socio-demographic data form, the Metacognitions Questionnaire-30 (MCQ-30), and Social Media Addiction Scale (SMAS) were administered. Group comparisons were performed using multivariate analysis of covariance. Pearson's correlational and multiple linear regression analyses were conducted to examine the associations between metacognitive beliefs and problematic SNS use. The SNS addicts scored higher in all of the SMAS assessments. When compared to non-addicts, SNS addicts obtained higher scores on all the subtests of the SMAS and MCQ-30 except cognitive self-consciousness. The negative beliefs about the uncontrollability and danger of worry, cognitive confidence, and need for control thoughts were associated with SMAS mood modification, relapse and conflict subdimensions. Our findings revealed that dysfunctional metacognitive beliefs are related to problematic SNS use among young adults. These findings indicate that mental health workers should consider the modification of metacognitive beliefs in the treatment of problematic SNS use.