Approximate interval estimation for a certain intraclass correlation coefficient

When the raters participating in a reliability study are a random sample from a larger population of raters, inferences about the intraclass correlation coefficient must be based on the three mean squares from the analysis of variance table summarizing the results: between subjects, between raters, and error. An approximate confidence interval for the parameter is presented as a function of these three mean squares.Dr. Fleiss is also with the Biometrics Research Unit of the New York State Psychiatric Institute. This work was supported in part by grant DE 04068 from the National Institute of Dental Research.     

A procedure for evaluating sensitivity to within-person change: can mood measures in diary studies detect change reliably?

The recent growth in diary and experience sampling research has increased research attention on how people change over time in natural settings. Often however, the measures in these studies were originally developed for studying between-person differences, and their sensitivity to within-person changes is usually unknown. Using a Generalizability Theory framework, the authors illustrate a procedure for developing reliable measures of change using a version of the Profile of Mood States (POMS; McNair, Lorr, & Droppleman, 1992) shortened for diary studies. Analyzing two data sets, one composed of 35 daily reports from 68 persons experiencing a stressful examination and another composed of daily reports from 164 persons over a typical 28-day period, we demonstrate that three-item measures of anxious mood, depressed mood, anger, fatigue, and vigor have appropriate reliability to detect within-person change processes.     

Mediation in experimental and nonexperimental studies: new procedures and recommendations

Mediation is said to occur when a causal effect of some variable X on an outcome Y is explained by some intervening variable M. The authors recommend that with small to moderate samples, bootstrap methods (B. Efron & R. Tibshirani, 1993) be used to assess mediation. Bootstrap tests are powerful because they detect that the sampling distribution of the mediated effect is skewed away from 0. They argue that R. M. Baron and D. A. Kenny's (1986) recommendation of first testing the X --> Y association for statistical significance should not be a requirement when there is a priori belief that the effect size is small or suppression is a possibility. Empirical examples and computer setups for bootstrap analyses are provided.     

Relationships,health, and stress: Validation of a relationship sense of coherence measure

Although all romantic relationships experience stress, some thrive when faced with adversity while others are unable to manage the inevitable relationship ups and downs. Rather than seeing stress as a risk factor, this study applied a Salutogenic framework, which posits that stress is a naturally occurring and potentially beneficial part of relationships, to develop a new measure of relationship health and well‐being. In Study 1, we created and tested a self‐report Relationship Sense of Coherence (RSOC) scale. Study 2 demonstrated evidence of convergent reliability for the RSOC. In Study 3, we tested the RSOC in a two‐wave sample of romantically‐involved individuals with a chronic health condition. Guidelines for use and implications for future research are discussed.     

Ethnic Differences in Perceived Impairment and Need for Care

Latino children in the U.S. have high rates of unmet need for mental health services, perhaps due to biased perceptions of impairment and need for care by parents and providers. We tested this argument using an experimental vignette design. Vignettes described children with problems that varied on severity (mild vs. serious), nature of the problem (internalizing vs. externalizing), as well as gender and ethnicity (Latino vs. Anglo). Raters were Latino and Anglo parents (N = 185) and providers (N = 189). Vignettes with Latino names were viewed as more impaired by both parents and providers, and this effect was significantly stronger in Latino vignettes with less severe problems. Severity and Latino features of vignettes also interacted with judgments of need for service. At higher severity, vignettes with Anglo names were judged to need service more than vignettes with Latino names, despite the same judged levels of impairment. Results are discussed in the light of the unmet need for Latinos.     

Life stress and psychopathology: Progress on research begun with Barbara Snell Dohrenwend

This is a progress report on some of the research that was planned and begun with Barbara Dohrenwend before she died in 1982. The main focus is on two of the studies. One was conducted in New York City; the other is still underway in Israel. The New York study is a retrospective case/control study of social and psychological factors that may put people at risk for developing schizophrenic episodes and episodes of major depression. The Israel research consists of epidemiological, case/control, and family studies of these two disorders together with other types of psychopathology that are inversely related to social class. Preliminary findings from both studies are reported, and their implications for primary prevention are discussed.     

Analyzing Consensus to Personality Judgments: A Variance Components Approach

ABSTRACT Although peer raters of personality traits do tend to agree, the strength of their consensus is often modest. This article focuses on methods for analyzing determinants of consensus. Variance components methods adapted from generalizability theory have some untapped potential for understanding gradations in consensus. The methods allow explicit analysis of how social categories of targets might affect judgments of raters from the same or different social categories. Limitations of the variance components approach are also discussed. The methods are illustrated with artificial data.     

Psychometric properties of parents and children as informants in child psychiatry epidemiology with the Spanish diagnostic interview schedule for children (DISC.2)

Parent and child reports were examined to study how epidemiological researchers can best use the information provided to describe childhood psychopathology. As part of a multisite methodologic study of mental disorders in children, a probability sample (N=248) of children aged 9 to 17 years from the San Juan metropolitan area was selected. This sample was enriched with 74 clinic cases. Both parents and children were administered the DISC.2. Results showed that prevalence estimates were influenced by the informant. The clinicians' diagnosis is more concordant with children's reports of depression and with parents' reports of disruptive disorders. Parents and children provided unique information when interviewed with a structured psychiatric interview about child psychopathology. Their unique perspectives contributed to the observed discordance that emerged when DISC parent and DISC child results are compared. Combining the two perspectives with a simple OR rule at the symptom level did not seem to capture the unique perspectives.We acknowledge the research group of the Behavioral Sciences Research Institute for their valuable contributions to this work. We also recognize José V. Martínez, Vivian E. Febo, and Zenaida González for the data analyses, and Elizabeth Pastrana and Felícita Laboy for the secretarial work.This research was supported by grants (MH46732) from the National Institute of Mental Health (NIMH) as part of a collaborative methodologic epidemiologic study of children and adolescents (MECA) between the Universities of Columbia, Emory, Puerto Rico, Yale, and the NIMH.     

Paper or plastic? Data equivalence in paper and electronic diaries

Concern has been raised about the lack of participant compliance in diary studies that use paper-and-pencil as opposed to electronic formats. Three studies explored the magnitude of compliance problems and their effects on data quality. Study 1 used random signals to elicit diary reports and found close matches to self-reported completion times, matches that could not plausibly have been fabricated. Studies 2 and 3 examined the psychometric and statistical equivalence of data obtained with paper versus electronic formats. With minor exceptions, both methods yielded data that were equivalent psychometrically and in patterns of findings. These results serve to at least partially mollify concern about the validity of paper diary methods.