Editorial: Evidence on Questionable Research Practices: The Good,the Bad,and the Ugly

Purpose

Questionable research or reporting practices (QRPs) contribute to a growing concern regarding the credibility of research in the organizational sciences and related fields. Such practices include design, analytic, or reporting practices that may introduce biased evidence, which can have harmful implications for evidence-based practice, theory development, and perceptions of the rigor of science.

Design/Methodology/Approach

To assess the extent to which QRPs are actually a concern, we conducted a systematic review to consider the evidence on QRPs. Using a triangulation approach (e.g., by reviewing data from observations, sensitivity analyses, and surveys), we identified the good, the bad, and the ugly.

Findings

Of the 64 studies that fit our criteria, 6 appeared to find little to no evidence of engagement in QRPs and the other 58 found more severe evidence (91 %).

Implications

Drawing upon the findings, we provide recommendations for future research related to publication practices and academic training.

Originality/value

We report findings from studies that suggest that QRPs are not a problem, that QRPs are used at a suboptimal rate, and that QRPs present a threat to the viability of organizational science research.

     

Idiosyncratic Deals and Helping Behavior: The Moderating Role of I-deal Opportunity for Co-workers

Purpose

This study draws from social comparison theory to explore why and under which circumstances individuals receiving idiosyncratic deals (i-deals) are likely to help their co-workers.

Design

Data were collected with an alumni association of engineers. Participants completed two questionnaires (N = 182 at Time 2).

Findings

We find that the relationship between i-deals and helping behavior is not direct, but is mediated by organizational-based self-esteem. This relationship is stronger when i-deal recipients believe that their co-workers do not have the opportunity to get i-deals for themselves.

Implications

I-deal recipients are expected to help their colleagues because helping colleagues is consistent with the positive self developed thanks to i-deals. When co-workers have the opportunity to get i-deals for themselves, social comparison between the i-deal recipient and colleagues is likely to be more salient, which strengthen the indirect relationship between i-deal and helping behavior.

Originality

This study tests i-deals from the vantage point of social comparison theory rather than from the perspective of social exchange. We thereby provide a richer account of the complexities involved in helping behavior. By exploring contextual variables that are likely to trigger social comparisons, we also expect to better understand the circumstances under which i-deals are likely to be associated with helping behavior.

     

Evaluating Item-Sort Task Methods: The Presentation of a New Statistical Significance Formula and Methodological Best Practices

Purpose

An item-sort task is a common method to reduce over-representative item lists during the scale-creation process. The current article delineates the limitations and misapplications of the accepted statistical significance formula for item-sort tasks and proposes a new statistical significance formula with greater utility across a wider range of item-sort tasks.

Design

First, a simulation study compares the two formulas in an array of conditions that vary on sample size and number of assignment choices. Second, an empirical study compares the results of three separate item-sort tasks across the two formulas for statistical significance.

Findings

In the empirical study, the proposed formula produces more correct retention decisions than the existing formula across all three item-sort tasks. In the simulation study, the proposed formula is more appropriate than the existing formula under most conditions. The two formulas function identically in item-sort tasks with only two assignment choices.

Implications

Researchers could obtain erroneous results when misapplying the existing item-sort task statistical significance formula to cases with more than two assignment choices. The proposed formula corrects this limitation, ultimately providing accurate results more often than the existing formula. Applying the proposed formula could help future research and practice throughout the scale development process.

Originality

Despite widespread use, few attempts have been made to improve scale-creation pretest methods, particularly item-sort tasks. The current study demonstrates that even conventional statistical methods are susceptible to misuse and misapplication, and future research could benefit from the reexamination of other common methods.

     

Risk Factors Associated with Proactive and Reactive Aggression in a Child Psychiatric Inpatient Sample

Proactive and reactive aggression represent distinct functions of aggression that are associated with different risk factors, including individual and contextual characteristics. However, more research evaluating the interactive effects of risk factors is needed. The current study evaluated whether corporal punishment moderated the influence of neighborhood problems and anger coping on proactive and reactive aggression in a child psychiatric inpatient sample of 6 to 13 year olds (n?=?151). Findings were compared across child- and caregiver-reports of aggression. Consistent with expectations, anger coping was more strongly associated with reactive aggression than proactive aggression across informants. In contrast, perceived neighborhood problems were only associated with child-reports of proactive aggression, with corporal punishment moderating this association. Specifically, the association between neighborhood problems and proactive aggression was only evident at high levels of corporal punishment. Treatment implications and future directions are discussed.     

Psychopathic Traits Mediate the Relationship Between Exposure to Violence and Violent Juvenile Offending

Exposure to violence (ETV) has emerged as a key and stable predictor of violent offending. However, not all youth offenders who experience ETV go on to chronic violent offending. Consequently, it is possible that individual differences, such as psychopathic traits, may be an important factor in the link between ETV and violent offending. These traits are associated with exposure to violence and, separately, to violent offending. The present study used data from Pathways to Desistance, a multisite, longitudinal study of serious juvenile offenders (N = 1170, Mean_age = 16.05, SD = 1.16) to explore these relationships, simultaneously. First, autoregressive cross-lagged path models were used to examine the longitudinal bivariate relations among violent offending, ETV, and psychopathic traits. Second, latent class growth analysis was used to determine trajectories ETV. And third, the mediating influence of psychopathic traits was examined. Results indicated that ETV predicted later engagement in violence, but there was some degree of reciprocity between ETV and violence over time. Additionally, respondents with stable high or increasing trajectories of ETV reported more instances of violent offending. Finally, psychopathic traits mediated the relationship between ETV and violent offending. Together these findings support the notion that individuals with psychopathic traits perceive and internalize their environment differently than others and that this difference guides their own violent offending. Given the importance of psychopathic traits for understanding the influence of ETV on violent offending, prevention and intervention strategies must be developed that take into account both individual differences and environmental factors.     

Finnish parents’ attitudes toward entrepreneurship education

This study set out to investigate parental attitudes toward entrepreneurship education as evaluative directing components of social representations. A nationwide sample of parents (N = 625) was asked to indicate their opinions on a set of statements about entrepreneurship education. The parents’ attitudinal orientation suggested that they would rather avoid entrepreneurship education than approach it. Additionally, parental evaluations contained indecision and polarised opinions, and most parents saw it as unlikely or were unsure whether their children would become entrepreneurs. Parental attitudes correlated with the established representations of education and subsequent policy stands, suggesting that entrepreneurship education has been made familiar by anchoring attitudes in the field of educational debates. It was suggested that current trends in educational policy and work life may stimulate the formation of polemical social representations pertaining to entrepreneurship education.     

The spatiotopic representation of visual objects across time

Each eye movement introduces changes in the retinal location of objects. How a stable spatiotopic representation emerges from such variable input is an important question for the study of vision. Researchers have classically probed human observers' performance in a task requiring a location judgment about an object presented at different locations across a saccade. Correct performance on this task requires realigning or remapping retinal locations to compensate for the saccade. A recent study showed that performance improved with longer presaccadic viewing time, suggesting that accurate spatiotopic representations take time to build up. The first goal of the study was to replicate that finding. Two experiments, one an exact replication and the second a modified version, failed to replicate improved performance with longer presaccadic viewing time. The second goal of this study was to examine the role of attention in constructing spatiotopic representations, as theoretical and neurophysiological accounts of remapping have proposed that only attended targets are remapped. A third experiment thus manipulated attention with a spatial cueing paradigm and compared transsaccadic location performance of attended versus unattended targets. No difference in spatiotopic performance was found between attended and unattended targets. Although only negative results are reported, they might nevertheless suggest that spatiotopic representations are relatively stable over time.     

Everyday‐like memory for objects in ageing and Alzheimer's disease assessed in a visually complex environment: The role of executive functioning and episodic memory

To investigate everyday memory, more and more studies rely on virtual‐reality applications to bridge the gap between in situ approaches and laboratory settings. In this vein, the present study was designed to assess everyday‐like memory from the virtual reality‐based Human Object Memory for Everyday Scenes (HOMES) test (Sauzéon et al., 2012 , Exp. Psychol., 59, 99) in ageing and in Alzheimer's disease (AD). Two aims motivated this study: the first was to assess multiple processes of episodic memory (EM) functioning embedded within contexts closely related to real life in ageing and AD using the multi‐trial free‐recall paradigm, and the second aim was to evaluate the mediating effects of executive functioning (EF), EM, and subjective memory complaints (SMCs) on age differences in the HOMES measures and in AD. To this end, the HOMES test and neurocognitive tests of EF and EM were administered to 23 younger adults, 23 older adults, and 16 patients with AD. The results were: firstly, compared to young adults, elderly adults presented only free‐recall decline that almost disappeared in recognition condition whereas AD patients exhibited a poor clustering, learning, and recognition performance, and also a high amount of false recognition; secondly, age differences as well as AD related deficits on the HOMES test were mediated by both memory and EF measure while those observed on false memory indices were only mediated by EM measure; thirdly, the HOMES indices are related to SMCs even when episodic or EF measures are controlled. Overall, the results supported the fact that the VR‐based memory test is an appropriate device to capture age‐related differences as well as the AD effect with respect to both in situ and laboratory settings.