Evaluating Item-Sort Task Methods: The Presentation of a New Statistical Significance Formula and Methodological Best Practices

Purpose

An item-sort task is a common method to reduce over-representative item lists during the scale-creation process. The current article delineates the limitations and misapplications of the accepted statistical significance formula for item-sort tasks and proposes a new statistical significance formula with greater utility across a wider range of item-sort tasks.

Design

First, a simulation study compares the two formulas in an array of conditions that vary on sample size and number of assignment choices. Second, an empirical study compares the results of three separate item-sort tasks across the two formulas for statistical significance.

Findings

In the empirical study, the proposed formula produces more correct retention decisions than the existing formula across all three item-sort tasks. In the simulation study, the proposed formula is more appropriate than the existing formula under most conditions. The two formulas function identically in item-sort tasks with only two assignment choices.

Implications

Researchers could obtain erroneous results when misapplying the existing item-sort task statistical significance formula to cases with more than two assignment choices. The proposed formula corrects this limitation, ultimately providing accurate results more often than the existing formula. Applying the proposed formula could help future research and practice throughout the scale development process.

Originality

Despite widespread use, few attempts have been made to improve scale-creation pretest methods, particularly item-sort tasks. The current study demonstrates that even conventional statistical methods are susceptible to misuse and misapplication, and future research could benefit from the reexamination of other common methods.

     

Risk Factors Associated with Proactive and Reactive Aggression in a Child Psychiatric Inpatient Sample

Proactive and reactive aggression represent distinct functions of aggression that are associated with different risk factors, including individual and contextual characteristics. However, more research evaluating the interactive effects of risk factors is needed. The current study evaluated whether corporal punishment moderated the influence of neighborhood problems and anger coping on proactive and reactive aggression in a child psychiatric inpatient sample of 6 to 13 year olds (n?=?151). Findings were compared across child- and caregiver-reports of aggression. Consistent with expectations, anger coping was more strongly associated with reactive aggression than proactive aggression across informants. In contrast, perceived neighborhood problems were only associated with child-reports of proactive aggression, with corporal punishment moderating this association. Specifically, the association between neighborhood problems and proactive aggression was only evident at high levels of corporal punishment. Treatment implications and future directions are discussed.     

Psychopathic Traits Mediate the Relationship Between Exposure to Violence and Violent Juvenile Offending

Exposure to violence (ETV) has emerged as a key and stable predictor of violent offending. However, not all youth offenders who experience ETV go on to chronic violent offending. Consequently, it is possible that individual differences, such as psychopathic traits, may be an important factor in the link between ETV and violent offending. These traits are associated with exposure to violence and, separately, to violent offending. The present study used data from Pathways to Desistance, a multisite, longitudinal study of serious juvenile offenders (N = 1170, Mean_age = 16.05, SD = 1.16) to explore these relationships, simultaneously. First, autoregressive cross-lagged path models were used to examine the longitudinal bivariate relations among violent offending, ETV, and psychopathic traits. Second, latent class growth analysis was used to determine trajectories ETV. And third, the mediating influence of psychopathic traits was examined. Results indicated that ETV predicted later engagement in violence, but there was some degree of reciprocity between ETV and violence over time. Additionally, respondents with stable high or increasing trajectories of ETV reported more instances of violent offending. Finally, psychopathic traits mediated the relationship between ETV and violent offending. Together these findings support the notion that individuals with psychopathic traits perceive and internalize their environment differently than others and that this difference guides their own violent offending. Given the importance of psychopathic traits for understanding the influence of ETV on violent offending, prevention and intervention strategies must be developed that take into account both individual differences and environmental factors.     

Information about foregone rewards impedes dynamic decision-making in older adults

“Making an informed decision” implies that more information leads to better decisions, yet it may be the case that additional information biases decisions in a systematic and sometimes detrimental manner. In the present study, we examined the effect of additional information on older adults’ decision-making using a task for which available rewards were dependent on the participant’s recent pattern of choices. The optimal strategy was to forego the immediately rewarding option in favor of the option that yielded larger delayed reward. We found that providing information about true foregone rewards – the reward that would have been received had the participant chosen the other option – significantly reduced older adults’ decision-making performance. However, false foregone rewards – foregone rewards manufactured to make the long-term option appear more immediately rewarding – led older adults to perform at a level equal to younger adults. We conclude that providing information about foregone rewards biases older adults toward immediate rewards at a greater rate than younger adults, leading to poorer older adult performance when immediate rewards and long-term rewards conflict, but intact performance when immediate rewards and long-term rewards appear to align.     

Finnish parents’ attitudes toward entrepreneurship education

This study set out to investigate parental attitudes toward entrepreneurship education as evaluative directing components of social representations. A nationwide sample of parents (N = 625) was asked to indicate their opinions on a set of statements about entrepreneurship education. The parents’ attitudinal orientation suggested that they would rather avoid entrepreneurship education than approach it. Additionally, parental evaluations contained indecision and polarised opinions, and most parents saw it as unlikely or were unsure whether their children would become entrepreneurs. Parental attitudes correlated with the established representations of education and subsequent policy stands, suggesting that entrepreneurship education has been made familiar by anchoring attitudes in the field of educational debates. It was suggested that current trends in educational policy and work life may stimulate the formation of polemical social representations pertaining to entrepreneurship education.     

Pathologisches Glücksspiel und Delinquenz

Pathological gambling is characterized by excessive gambling behavior which influences the life and well-being of a person in a dysfunctional way. It often leads to severe consequences in social and family life, career and material matters. This can also include illegal acts. In the Diagnostic and Statistical Manual of Mental Disorders IV (DSM-IV) excessive gambling was classified under impulse-control disorders but was renamed as gambling disorder (GD) and reclassified under the category “substance-related and addictive disorders” in DSM-5, due to parallels to substance use disorders in the clinical characteristics as well as genetic and neurobiological factors. In Germany, approximately 0.5?% of the adult population suffer from GD. Especially gambling machines are associated with an increased risk of gambling-related problems. Common comorbidities are substance-related and affective disorders. The most important risk factors are young age, male gender, a history of migration, gambling-related problems in the family, unemployment, a low educational level and low household income. Delinquent behavior was not considered to be a sufficiently discriminative factor for GD, although there is a correlation between delinquency and gambling behavior. In addition, those GD subjects who show delinquent behavior also show a specific risk profile. Thus, mental health professionals should be aware of possible psychosocial consequences in GD, such as illegal acts, and this should be addressed in the effective treatment strategies, such as cognitive behavioral therapy. Moreover, it is necessary to improve the access routes for affected people into healthcare system in order to ensure early detection and treatment of the disease.     

Verbal facilitation effects instead of verbal overshadowing in face memory of 4- to 6-year olds

Research on eye witness memory in older children and adults revealed that verbally describing unfamiliar faces impairs later recognition of these faces, known as the “verbal overshadowing effect”. The aim of this study was to investigate whether a verbal overshadowing effect occurs in 4- to 6-year olds, too, and whether visualization (i.e., drawing the seen face) might elicit a visual overshadowing effect. Instead of a verbal overshadowing effect, a verbal facilitation effect was revealed with verbal intelligence being a significant predictor for recognition accuracy in the verbalization group but not in the control group. No effect of visualization was observed on recognition accuracy. Potential explanations for the results are discussed.     

Pain perception to the cold pressor test during the menstrual cycle in relation to estrogen levels and a comparison with men.

Animal and human research has shown that pain sensitivity changes during the menstrual cycle. This has sometimes been ascribed to hormonal variations. The aim of the present study was to examine how perception of pain, induced by the cold pressor test to the dominant hand, was related to gender and phases of the menstrual cycle. A repeated-measures design was used, where twenty-two female students participated at two different phases of the menstrual cycle (days 2-4 and days 20-24). A control group of nineteen male students participated on two occasions, separated by a three week period. The cycle phase during which each woman began her participation was randomized. Pain was induced using the cold pressor test. Pain threshold was determined as the duration of time between when the subject first reported pain and exposure to the painful stimulus. Pain tolerance was determined as the duration of time until the subject withdraw her/his hand from the test water because the pain was too intensive. The results showed that men tolerated significantly greater pain than women. Women's pain threshold was significantly higher during the second phase of the menstrual cycle. Systolic pressure was higher in men than women, increasing more in men in response to cold pressor testing than women. Further research, including measurements of plasma hormone levels during the menstrual cycle, is needed to clarify the role played by estrogens in pain perception.