Use and misuse of metrics in research evaluation

This paper addresses some critical issues in the applicability of quantitative performance measures (including bibliometric, economic, and co-occurrence measures) to the assessment of basic research. The strengths and weaknesses of metrics applied as research performance measures are examined. It is concluded that metrics have a useful role to play in the evaluation of research. Each metric employed, whether bibliometric, economic, co-occurrence, or others, brings a new dimension of potential insight to the complex problem of research assessment. However, when used in a stand-alone mode, metrics can be easily misinterpreted and result in misleading conclusions. Metrics should be an integral part of a more comprehensive approach to research evaluation, in which the leading role is assumed by expert peer review. Under this structure, the reviewers must be broadly constituted, so that the technical correctness of the research approaches being taken (doing the job right) can be evaluated by technical experts and the correctness of the research target (doing the right job) can be evaluated as well. This comprehensive approach insures quality in the implementation of existing research paradigms and allows the introduction of revolutionary new research paradigms as well. The views contained in this paper are solely those of the author and do not represent the views of the Department of the Navy. Ronald Kostoff received a Ph.D. from Princeton University, performed technical and economic research at Bell Laboratories, managed energy programs at U.S. Department of Energy, was Director of Technical Assessment at the Office of Naval Research for many years and presently manages the Navy’s In-House Laboratory Independent Research Program.     

Exploring the mediating role of integrative self-knowledge in the relationship between mindfulness and well-being in the context of a mindfulness-based stress reduction program

Mindfulness-based stress reduction (MBSR) is an effective program for improving well-being. A growing body of studies is exploring the mechanisms mediating its beneficial effects. Integrative self-knowledge (ISK) is the construct of focus in this study. The primary goal of the current study was to investigate the mediating role of ISK in the relationship between improved mindful observing (MO), non-judging inner experience (NJ), and well-being following an MBSR program with an Iranian sample. Participants (n = 118) enrolled in MBSR and completed depression, anxiety, stress (DASS), Bartone Symptoms Checklist (BSC), Five-Facet Mindfulness Questionnaire, and ISK scale before and after the program. Results showed significant reductions in BSC, DASS, and improvements in MO, NJ, and ISK at the end of the program. Mediation analyses revealed that changes in ISK significantly mediated the relationship between changes in MO and NJ and symptoms (MO indirect effect on DASS: β = 0.11, confidence interval [CI] [0.003, 0.29]; NJ indirect effect on DASS: β = 0.12, CI [−0.16, 0.45]; MO indirect effect on BSC: β = 0.08, CI [0.001, 0.27]; NJ indirect effect on BSC: β = 0.09, CI [0.01, 0.22]). Improvements in MO and NJ may provide a pathway to cultivating ISK in MBSR, which may lead to enhanced well-being.     

Mindfulness-based programs,perceived stress and well-being at work: The preferential use of informal practices

IntroductionOrganizations which engage in the promotion of well-being are likely to prevent mental health issues in workers. Mindfulness-based interventions offer new perspectives to increase well-being at work. However, the issue of finding time and framework to practice at work is important. Recent studies suggested that informal mindfulness practices could be useful in reducing stress and increasing well-being.ObjectiveThe present study aimed to study how the duration and type of mindfulness practice may enhance employees’ well-being.MethodA multi-method (qualitative and quantitative), controlled pre/post design study (N = 72) was conducted to collect data about the type of preferred mindfulness practices used during an 8-week MBSR program, and to analyse the effects of the program on employees’ well-being. Number of sessions, number of days of practice, and practice time per day were used as moderators.ResultsParticipants reported a preferential use of brief, informal practices. Employees who followed the MBSR program reported higher levels of well-being compared to the wait-list control group (η² = .194). Those who preferentially used informal practices showed the same increase in well-being as those who reported preferentially using formal practices. The number of days of practice did not moderate the effect of the intervention on well-being.ConclusionBrief and informal mindfulness practices appear to be a promising means of increasing well-being in everyday life. Further research is needed to compare an 8-week mainly informal mindfulness-based program to a classical MBSR program to identify whether informal practices may be sufficient to increasing employees’ well-being.     

How Far Have we Come? An Integrative Review of the Current Literature on Sense of Community and Well-being

Sense of community and well-being are considered core tenets in the field of community psychology, acting as focal points for theory, research, and action. This integrative review synthesizes the empirical literature on sense of community and well-being with respect to four research questions focused on the relationships between these variables, the methodologies used to study those relationships, and how future research might expand upon the current literature. A search of the available literature produced 30 articles that met the search criteria, based primarily on conceptualizations and measurement of both sense of community and hedonic and eudaimonic well-being. This review suggests a general consensus across the literature of a positive relationship between sense of community and well-being among both youth and adults in a variety of settings, and discusses the strengths and limitations of this area of research, pointing to the need for more nuanced, ecologically valid research that incorporates more qualitative and critical methodologies. We hope that this review can promote a more thorough understanding of how sense of community and individual well-being relate to each other, and that ongoing research in this area can be a catalyst for action research and interventions that are applied to pressing contemporary issues as well as strengths-based approaches focused on how to foster and support the well-being of individuals within their community contexts.     

État des lieux des comportements proactifs en contexte professionnel

Our aim was to identify in the scientific field of social psychology and management, the different academic approaches and models of the proactivity concept. In the first instance, the proactivity concept is mentioned as a dispositional variable and an interindividual difference involving personality traits and associated behaviors. In the second, we more specifically explore proactive behaviors and their features. In a complementary manner, we expose some environmental elements understood to promote the initiation and continuation of proactive behavior (decision latitude, autonomy, transformational leadership). Finally, we introduce a few proactivity concept limitations and benefits of using such behaviours in organizational environment. We then conclude this work with a few research proposals such as the variability of the proactivity level and the possibility of acquiring proactive behaviours.     

Effects of route familiarity on drivers’ psychological conditions: Based on driving behaviour and driving environment

Route familiarity affects a driver’s mental state and indirectly affects traffic safety; however, this important factor is easily overlooked. Previous research on route familiarity has only analysed psychological states in terms of unfamiliarity and familiarity, the influence of driving behaviour and driving environment on psychological states has been ignored. As a result, the mechanisms through which the route familiarity influence driver psychological states, and vice versa, are unclear. This study proposes a quantitative framework for studying driver psychological condition and route familiarity using experimental data from a real driving task and driving environment data. The experimental data included 1022 observations obtained by 23 participants over 7 consecutive trials on 6 unfamiliar experimental routes with large differences in scenarios; environmental data were automatically extracted after segmenting a driving video through the Dilated Residual NetWorks model. The results reveal that (1) the relationship between the driver’s psychological condition and route familiarity is not monotonic and is different for straight and turning sections; (2) the driver’s psychological condition is influenced by the visual scene elements and the type of road section, and the results of the multivariate regression analysis quantified the variability of the influence; and (3) unlike a majority of findings on distracted driving, our study suggest that the driver’s attention to the external environment in the urban distracted driving state will gradually approach a ‘distraction threshold’, and the time and size of the ‘distraction threshold’ are influenced by the driver. This study can further the development of urban traffic safety research and help urban designers plan and improve urban landscapes to ensure drivers maintain stable mental states when they drive.     

Group cohesion and relatedness as predictors of self-determined motivation and burnout in adolescent female athletes

ObjectivesAthlete burnout is the result of a maladaptive sport experience that is influenced by the social context. A salient social contextual feature of youth sport is group cohesion. Cohesion may link with burnout through its association with relatedness and self-determined motivation. The current study was designed to test a model in which cohesion associates with burnout by way of relatedness and self-determined motivation.DesignCross-sectional survey-based study.MethodFemale youth soccer athletes (N = 276; M age = 14.9 years, SD = 1.3) completed measures of task and social cohesion, relatedness, self-determined motivation, and burnout.ResultsTask (β = 0.26) and social (β = 0.59) cohesion associated with perceptions of relatedness. In turn, relatedness positively linked with self-determined motivation (β = 0.38), which in turn negatively associated with global burnout (β = −0.79). The indirect effects from task cohesion to burnout (β = −0.08) and from social cohesion to burnout (β = −0.18) by way of relatedness and self-determined motivation were significant.ConclusionsResults support the proposed model whereby greater cohesion associates with an athlete’s feelings of relatedness, which links to more self-determined motivation and, consequently, lower burnout perceptions. Future research is needed to assess support for causality of these links and explore how contextual factors such as the teammate-created motivational climate contributes to group cohesion and relatedness perceptions within this burnout model.     

Global Progress I: Empirical Evidence for ongoing Increase in Quality-of-life

This paper argues that both the relativist and the pessimist critiques of the idea of progress are inadequate. Progress is defined as increase in global quality of life (QOL). Such QOL is intrinsically subjective, but not relative. It can be reliably measured through life satisfaction-type questions. The World Database of Happiness provides extensive data on social, economic and psychological factors that correlate with overall QOL. They include wealth, health, security, knowledge, freedom and equality. Various statistical data suggest that all these QOL indicators have undergone significant improvements during the last half century, in most of the world. This gives strong support to the thesis that progress objectively occurs.     

Up-regulating positive emotions in everyday life: Strategies, individual differences, and associations with positive emotion and well-being

This research aimed to identify strategies people use to up-regulate positive emotions, and examine associations with personality, emotion regulation, and trait and state positive experience. In Study 1, participants reported use of 75 regulation strategies and trait emotional experience. Principal component analysis revealed three strategy domains: engagement (socializing, savoring), betterment (goal pursuit, personal growth), and indulgence (substance use, fantasy). In Study 2, participants reported state-level regulation and emotional experience. Engagement correlated with greater state and trait positive emotion, and overall greater well-being. Betterment correlated with less state, but greater trait, positive emotion. Indulgence correlated with greater state, but less trait positive emotion and overall lower well-being. This research suggests trade-offs between short-term and long-term emotional consequences of different strategies.