Evaluating Item-Sort Task Methods: The Presentation of a New Statistical Significance Formula and Methodological Best Practices

Purpose

An item-sort task is a common method to reduce over-representative item lists during the scale-creation process. The current article delineates the limitations and misapplications of the accepted statistical significance formula for item-sort tasks and proposes a new statistical significance formula with greater utility across a wider range of item-sort tasks.

Design

First, a simulation study compares the two formulas in an array of conditions that vary on sample size and number of assignment choices. Second, an empirical study compares the results of three separate item-sort tasks across the two formulas for statistical significance.

Findings

In the empirical study, the proposed formula produces more correct retention decisions than the existing formula across all three item-sort tasks. In the simulation study, the proposed formula is more appropriate than the existing formula under most conditions. The two formulas function identically in item-sort tasks with only two assignment choices.

Implications

Researchers could obtain erroneous results when misapplying the existing item-sort task statistical significance formula to cases with more than two assignment choices. The proposed formula corrects this limitation, ultimately providing accurate results more often than the existing formula. Applying the proposed formula could help future research and practice throughout the scale development process.

Originality

Despite widespread use, few attempts have been made to improve scale-creation pretest methods, particularly item-sort tasks. The current study demonstrates that even conventional statistical methods are susceptible to misuse and misapplication, and future research could benefit from the reexamination of other common methods.

     

Risk Factors Associated with Proactive and Reactive Aggression in a Child Psychiatric Inpatient Sample

Proactive and reactive aggression represent distinct functions of aggression that are associated with different risk factors, including individual and contextual characteristics. However, more research evaluating the interactive effects of risk factors is needed. The current study evaluated whether corporal punishment moderated the influence of neighborhood problems and anger coping on proactive and reactive aggression in a child psychiatric inpatient sample of 6 to 13 year olds (n?=?151). Findings were compared across child- and caregiver-reports of aggression. Consistent with expectations, anger coping was more strongly associated with reactive aggression than proactive aggression across informants. In contrast, perceived neighborhood problems were only associated with child-reports of proactive aggression, with corporal punishment moderating this association. Specifically, the association between neighborhood problems and proactive aggression was only evident at high levels of corporal punishment. Treatment implications and future directions are discussed.     

Psychopathic Traits Mediate the Relationship Between Exposure to Violence and Violent Juvenile Offending

Exposure to violence (ETV) has emerged as a key and stable predictor of violent offending. However, not all youth offenders who experience ETV go on to chronic violent offending. Consequently, it is possible that individual differences, such as psychopathic traits, may be an important factor in the link between ETV and violent offending. These traits are associated with exposure to violence and, separately, to violent offending. The present study used data from Pathways to Desistance, a multisite, longitudinal study of serious juvenile offenders (N = 1170, Mean_age = 16.05, SD = 1.16) to explore these relationships, simultaneously. First, autoregressive cross-lagged path models were used to examine the longitudinal bivariate relations among violent offending, ETV, and psychopathic traits. Second, latent class growth analysis was used to determine trajectories ETV. And third, the mediating influence of psychopathic traits was examined. Results indicated that ETV predicted later engagement in violence, but there was some degree of reciprocity between ETV and violence over time. Additionally, respondents with stable high or increasing trajectories of ETV reported more instances of violent offending. Finally, psychopathic traits mediated the relationship between ETV and violent offending. Together these findings support the notion that individuals with psychopathic traits perceive and internalize their environment differently than others and that this difference guides their own violent offending. Given the importance of psychopathic traits for understanding the influence of ETV on violent offending, prevention and intervention strategies must be developed that take into account both individual differences and environmental factors.     

Finnish parents’ attitudes toward entrepreneurship education

This study set out to investigate parental attitudes toward entrepreneurship education as evaluative directing components of social representations. A nationwide sample of parents (N = 625) was asked to indicate their opinions on a set of statements about entrepreneurship education. The parents’ attitudinal orientation suggested that they would rather avoid entrepreneurship education than approach it. Additionally, parental evaluations contained indecision and polarised opinions, and most parents saw it as unlikely or were unsure whether their children would become entrepreneurs. Parental attitudes correlated with the established representations of education and subsequent policy stands, suggesting that entrepreneurship education has been made familiar by anchoring attitudes in the field of educational debates. It was suggested that current trends in educational policy and work life may stimulate the formation of polemical social representations pertaining to entrepreneurship education.     

Pathologisches Glücksspiel und Delinquenz

Pathological gambling is characterized by excessive gambling behavior which influences the life and well-being of a person in a dysfunctional way. It often leads to severe consequences in social and family life, career and material matters. This can also include illegal acts. In the Diagnostic and Statistical Manual of Mental Disorders IV (DSM-IV) excessive gambling was classified under impulse-control disorders but was renamed as gambling disorder (GD) and reclassified under the category “substance-related and addictive disorders” in DSM-5, due to parallels to substance use disorders in the clinical characteristics as well as genetic and neurobiological factors. In Germany, approximately 0.5?% of the adult population suffer from GD. Especially gambling machines are associated with an increased risk of gambling-related problems. Common comorbidities are substance-related and affective disorders. The most important risk factors are young age, male gender, a history of migration, gambling-related problems in the family, unemployment, a low educational level and low household income. Delinquent behavior was not considered to be a sufficiently discriminative factor for GD, although there is a correlation between delinquency and gambling behavior. In addition, those GD subjects who show delinquent behavior also show a specific risk profile. Thus, mental health professionals should be aware of possible psychosocial consequences in GD, such as illegal acts, and this should be addressed in the effective treatment strategies, such as cognitive behavioral therapy. Moreover, it is necessary to improve the access routes for affected people into healthcare system in order to ensure early detection and treatment of the disease.     

Pain perception to the cold pressor test during the menstrual cycle in relation to estrogen levels and a comparison with men.

Animal and human research has shown that pain sensitivity changes during the menstrual cycle. This has sometimes been ascribed to hormonal variations. The aim of the present study was to examine how perception of pain, induced by the cold pressor test to the dominant hand, was related to gender and phases of the menstrual cycle. A repeated-measures design was used, where twenty-two female students participated at two different phases of the menstrual cycle (days 2-4 and days 20-24). A control group of nineteen male students participated on two occasions, separated by a three week period. The cycle phase during which each woman began her participation was randomized. Pain was induced using the cold pressor test. Pain threshold was determined as the duration of time between when the subject first reported pain and exposure to the painful stimulus. Pain tolerance was determined as the duration of time until the subject withdraw her/his hand from the test water because the pain was too intensive. The results showed that men tolerated significantly greater pain than women. Women's pain threshold was significantly higher during the second phase of the menstrual cycle. Systolic pressure was higher in men than women, increasing more in men in response to cold pressor testing than women. Further research, including measurements of plasma hormone levels during the menstrual cycle, is needed to clarify the role played by estrogens in pain perception.     

Early Change Trajectories in Cognitive-Behavioral Therapy for Binge-Eating Disorder

Rapid response is considered the most well-established outcome predictor across treatments of binge-eating disorder (BED), including cognitive-behavioral therapy (CBT). This study sought to identify latent trajectories of early change in CBT and compare them to common rapid response classifications. In a multicenter randomized trial, 86 adults with BED (DSM-IV) or subsyndromal BED provided weekly self-reports of binge eating over the first 4 weeks of CBT, which were analyzed to predict binge eating, depression, and body mass index at posttreatment, 6-, and 18-month follow-up. Using latent growth mixture modeling, three patterns of early change—including moderate and low decreasing—as well as low stable binge eating were identified, which significantly predicted binge-eating remission at 6-month follow-up. Other classifications of rapid response based on Receiver Operating Characteristics curve analyses or on the literature (≥ 10% reduction in binge eating at week 1, ≥ 70% reduction in binge eating at week 4) only predicted posttreatment remission or overall depression, respectively. Latent change trajectories, but not other rapid response classifications, predicted binge-eating frequency over time. A fine-grained analysis of change over the first 4 weeks of CBT for BED revealed different trajectories of early change in binge eating that led to an improved prediction of binge-eating outcome, compared to that of common rapid response classifications. Thorough monitoring of early change trajectories during treatment may have clinical utility.     

Adding emotionality to seductive details—Consequences for learning?

According to the seductive detail effect, adding interesting but irrelevant information (i.e., seductive details) can be detrimental to learning success. In this study, it was explored within two experiments whether the valence of text‐based seductive details might affect learning outcomes differently. For Experiments 1 and 2, we pretested text‐based seductive details for their emotional valence (n = 32 or n = 25 students, respectively). For the main studies of Experiments 1 (n = 105) and 2 (n = 131), university students were randomly assigned to one of four conditions that varied with respect to the presence of seductive details and their emotional valence (no vs. positive vs. negative vs. neutral). Unexpectedly, results revealed in both experiments no seductive details effect and also no differences between the three seductive detail conditions for the used learning outcome measures retention and transfer. Possible reasons for these findings and their implications are discussed.