A Measure for the Reliability of a Rating Scale Based on Longitudinal Clinical Trial Data

A new measure for reliability of a rating scale is introduced, based on the classical definition of reliability, as the ratio of the true score variance and the total variance. Clinical trial data can be employed to estimate the reliability of the scale in use, whenever repeated measurements are taken. The reliability is estimated from the covariance parameters obtained from a linear mixed model. The method provides a single number to express the reliability of the scale, but allows for the study of the reliability’s time evolution. The method is illustrated using a case study in schizophrenia. The authors are grateful to J&J PRD for kind permission to use their data. We gratefully acknowledge support from the Belgian IUAP/PAI network “Statistical Techniques and Modeling for Complex Substantive Questions with Complex Data.”     

The Influence of Children on Their Parents’ Values

Many parents report that their values are influenced by their children. However, few studies provide direct evidence regarding child–parent value transmission. We review this evidence and propose five main processes of child influence: (i) Passive child influences, causing change in parental values by the mere presence or development of children; (ii) Active child influences, due to children directly attempting to influence their parents’ opinions or providing parents with relevant information; (iii) Differentiation, the emergence of a distinction between parents’ own personal values and their socialization values; (iv) Reciprocal influences; in which parents’ and children’ influences are intertwined; and (v) Counter‐influences, in which parental values change in a direction opposite to that of children's values. A study on child influence illustrates some of these processes. The roles of migration, aging, and parent and child characteristics in child‐to‐parent influences are discussed.     

Internalized transphobia: Exploring perceptions of social messages in transgender and gender-nonconforming adults

Background: Transgender and gender nonconforming (TGNC) individuals encounter a variety of minority stressors that have yet to be fully articulated or explored within the research literature. The purpose of this study is to better understand internalized stigma—the experience of accepting and internalizing negative social messages and experiences about one's identity—an underexplored minority stressor for TGNC people.

Method: We conducted in-depth interviews with 30 diverse TGNC participants using consensual qualitative research (CQR) methodology.

Results: Following data saturation and analysis, six distinct themes emerged across participants: (1) TGNC identities are regarded negatively by society; (2) social messages are perceived as originating from the media and religious ideology; (3) TGNC individuals report emotional distress; (4) negative self-perceptions in response to social messages; (5) TGNC individuals report resilience processes in response to negative social messages; and (6) social messages are perceived generally to differentially impact TGNC people of color.

Conclusion: Findings highlight the common experience of encountering social marginalization for TGNC individuals. Structural interventions that target pervasive sociocultural messages regarding TGNC identities are warranted.     

Prosocial behavior from early to middle childhood: genetic and environmental influences on stability and change

Prosocial behavior is important for the functioning of society. This study investigates the extent to which environment shared by family members, nonshared environment, and genetics account for children's prosocial behavior. The prosocial behavior of twins (9,424 pairs) was rated by their parents at the ages of 2, 3, 4, and 7 and by their teachers at age 7. For parent ratings, shared environmental effects decreased from .47 on average at age 2 to .03 at age 7, and genetic effects increased from .32 on average to .61. The finding of weak shared environmental effects and large heritability at age 7 was largely confirmed through the use of teacher ratings. Using longitudinal genetic analyses, the authors conclude that genetic effects account for both change and continuity in prosocial behavior and nonshared environment contributes mainly to change.     

A "Jekyll and Hyde" within: aggressive versus friendly interactions in REM and non-REM dreams

We hypothesized that representations of social interactions in REM and non-REM (NREM) dreams would reflect differing regional brain activation patterns associated with the two sleep states, and that levels of aggressive interactions would be higher in REM than in NREM dreams. One hundred REM, 100 NREM, and 100 wake reports were collected in the home from 8 men and 7 women using the Nightcap sleep-wake mentation-monitoring system and scored for number and variety of social interactions. We found that (a) social interactions were more likely to be depicted in dream than in wake reports, (b) aggressive social interactions were more characteristic of REM than NREM or wake reports, and (c) dreamer-initiated friendliness was more characteristic of NREM than REM reports. We conclude that processing of, or simulations about, selected social interactions is preferentially performed while "off-line" during the dream state, with the REM state specializing in simulation of aggressive interactions and the NREM state specializing in simulation of friendly interactions.     

Masculine girls and feminine boys: genetic and environmental contributions to atypical gender development in early childhood

In this genetic study of atypical gender role development, parents of 5,799 twin pairs, ages 3 and 4, rated their twin children's masculinity and femininity. Boys were selected as gender atypical if they were highly feminine (top 5%, 10%, or 15%) relative to other boys, and girls were selected if they were highly masculine relative to other girls. Gender-atypical boys and girls were each divided into 2 groups: fully gender atypical (e.g., feminine boys also low on masculinity) and partially gender atypical (e.g., feminine boys who are not low on masculinity). DeFries-Fulker (DF; J. C. DeFries & D. W. Fulker, 1985, 1988) extremes analysis yielded moderate group heritability and substantial shared environment effects for atypical gender role behavior. However, for fully gender-atypical girls, group heritability accounted for most of the variance, and shared environment had no effect. The results are discussed in light of past studies and potential implications for atypical gender development.     

Drawing the line: How the workplace shapes the naming of sexual harassment

Although sexual harassment naming – the process by which individuals identify and label experiences as sexual harassment – is key to tackling the problem of workplace sexual harassment, extant research focused on individual differences has explained a limited amount of variance in individuals’ propensity to name. We push this research in a new direction, drawing on institutional theory and strategic human resource management to identify workplace contextual factors that influence individuals’ propensity to name sexual harassment. Surveying 408 employed adults, we find that current employment in an industry with a high prevalence of sexual harassment reduces individuals’ likelihood of identifying scenarios as sexual harassment. Further, prior work experience in highly sexually harassing industries has a lasting negative effect on individuals’ propensity to name. In contrast, we show that individuals’ propensity to identify sexual harassment is greater when they perceive that their organization has implemented more HR practices supporting a climate for naming and that these HR practices can actually reduce the negative effect of current employment in a highly sexually harassing industry. Critically, by demonstrating that changing industry norms or adopting specific HR practices can shift individual naming of sexual harassment, we offer new avenues for sexual harassment prevention.     

Pilot test of a measure to assess clients’ perceptions of their home visitors

Home visiting services for caregivers of infants and young children have been found to be an effective method for promoting child development. Unfortunately, such services suffer from high rates of attrition, suggesting the need to identify factors related to client retention in services. Research has indicated that the client-provider relationship is an important predictor of client retention in home visiting services; however, measures to assess this relationship are limited. This study reports on a pilot test of the Client Perceptions of Home Visitors Questionnaire, developed to assess home visiting clients’ perceptions of their relationship with their home visitor. The measure was completed by 39 diverse home visiting clients during pregnancy in a midwestern town in the United States. The scale was found to have good internal consistency. Validity analyses found that the scale was positively associated with client satisfaction with services and perceived provider cultural sensitivity. The scale was also positively associated with retention in services at an 8-month follow-up. Additional research should examine the measure's psychometrics with larger samples.     

Family size and psychological functioning in the Orthodox Jewish community

Caring for children is a known psychosocial stressor; however, its effects on psychological functioning may have substantial cross-cultural variance. We explored relationships between family size and a variety of psychological outcomes among Orthodox Jews in four separate studies: (1) an international treatment-seeking sample (n?=?82), (2) a community sample from Canada (n?=?226), (3) an out-patient clinical sample from greater New York (n?=?82), and (4) a large dyadic sample of Israeli couples (n?=?789). Surprisingly, results suggested that family size was not associated with greater stress, anxiety, depression, global functioning, family functioning, family communication, family satisfaction, or even parenting stress. It is possible that the high religious value placed on family life as well as structural adaptions in families buffer against potential stressors associated with child rearing, and further research on these potential effects is warranted.     

Reliability measures in item response theory: Manifest versus latent correlation functions

For item response theory (IRT) models, which belong to the class of generalized linear or non‐linear mixed models, reliability at the scale of observed scores (i.e., manifest correlation) is more difficult to calculate than latent correlation based reliability, but usually of greater scientific interest. This is not least because it cannot be calculated explicitly when the logit link is used in conjunction with normal random effects. As such, approximations such as Fisher's information coefficient, Cronbach's α, or the latent correlation are calculated, allegedly because it is easy to do so. Cronbach's α has well‐known and serious drawbacks, Fisher's information is not meaningful under certain circumstances, and there is an important but often overlooked difference between latent and manifest correlations. Here, manifest correlation refers to correlation between observed scores, while latent correlation refers to correlation between scores at the latent (e.g., logit or probit) scale. Thus, using one in place of the other can lead to erroneous conclusions. Taylor series based reliability measures, which are based on manifest correlation functions, are derived and a careful comparison of reliability measures based on latent correlations, Fisher's information, and exact reliability is carried out. The latent correlations are virtually always considerably higher than their manifest counterparts, Fisher's information measure shows no coherent behaviour (it is even negative in some cases), while the newly introduced Taylor series based approximations reflect the exact reliability very closely. Comparisons among the various types of correlations, for various IRT models, are made using algebraic expressions, Monte Carlo simulations, and data analysis. Given the light computational burden and the performance of Taylor series based reliability measures, their use is recommended.