Application of a Sensemaking Approach to Ethics Training in the Physical Sciences and Engineering

Integrity is a critical determinant of the effectiveness of research organizations in terms of producing high quality research and educating the new generation of scientists. A number of responsible conduct of research (RCR) training programs have been developed to address this growing organizational concern. However, in spite of a significant body of research in ethics training, it is still unknown which approach has the highest potential to enhance researchers' integrity. One of the approaches showing some promise in improving researchers' integrity has focused on the development of ethical decision-making skills. The current effort proposes a novel curriculum that focuses on broad metacognitive reasoning strategies researchers use when making sense of day-to-day social and professional practices that have ethical implications for the physical sciences and engineering. This sensemaking training has been implemented in a professional sample of scientists conducting research in electrical engineering, atmospheric and computer sciences at a large multi-cultural, multi-disciplinary, and multi-university research center. A pre-post design was used to assess training effectiveness using scenario-based ethical decision-making measures. The training resulted in enhanced ethical decision-making of researchers in relation to four ethical conduct areas, namely data management, study conduct, professional practices, and business practices. In addition, sensemaking training led to researchers' preference for decisions involving the application of the broad metacognitive reasoning strategies. Individual trainee and training characteristics were used to explain the study findings. Broad implications of the findings for ethics training development, implementation, and evaluation in the sciences are discussed.     

Mental Models: An Alternative Evaluation of a Sensemaking Approach to Ethics Instruction

In spite of the wide variety of approaches to ethics training it is still debatable which approach has the highest potential to enhance professionals' integrity. The current effort assesses a novel curriculum that focuses on metacognitive reasoning strategies researchers use when making sense of day-to-day professional practices that have ethical implications. The evaluated trainings effectiveness was assessed by examining five key sensemaking processes, such as framing, emotion regulation, forecasting, self-reflection, and information integration that experts and novices apply in ethical decision-making. Mental models of trained and untrained graduate students, as well as faculty, working in the field of physical sciences were compared using a think-aloud protocol 6 months following the ethics training. Evaluation and comparison of the mental models of participants provided further validation evidence for sensemaking training. Specifically, it was found that trained students applied metacognitive reasoning strategies learned during training in their ethical decision-making that resulted in complex mental models focused on the objective assessment of the situation. Mental models of faculty and untrained students were externally-driven with a heavy focus on autobiographical processes. The study shows that sensemaking training has a potential to induce shifts in researchers' mental models by making them more cognitively complex via the use of metacognitive reasoning strategies. Furthermore, field experts may benefit from sensemaking training to improve their ethical decision-making framework in highly complex, novel, and ambiguous situations.     

Field and Experience Influences on Ethical Decision Making in the Sciences

Differences across fields and experience levels are frequently considered in discussions of ethical decision making and ethical behavior. In the present study, doctoral students in the health, biological, and social sciences completed measures of ethical decision making. The effects of field and level of experience with respect to ethical decision making, metacognitive reasoning strategies, social-behavioral responses, and exposure to unethical events were examined. Social and biological scientists performed better than health scientists with respect to ethical decision making. Furthermore, the ethical decision making of health science students decreased as experience increased. Moreover, these effects appeared to be linked to the specific strategies underlying participants' ethical decision making. The implications of these findings for ethical decision making are discussed.     

Effectiveness of a responsible conduct of research course: a preliminary study

Training in the responsible conduct of research (RCR) is required for many research trainees nationwide, but little is known about its effectiveness. For a preliminary assessment of the effectiveness of a short-term course in RCR, medical students participating in an NIH-funded summer research program at the University of California, San Diego (UCSD) were surveyed using an instrument developed through focus group discussions. In the summer of 2003, surveys were administered before and after a short-term RCR course, as well as to alumni of the courses given in the summers of 2002 and 2001. Survey responses were analyzed in the areas of knowledge, ethical decision-making skills, attitudes about responsible conduct of research, and frequency of discussions about RCR outside of class. The only statistically significant improvement associated with the course was an increase in knowledge, while there was a non-significant tendency toward improvements in ethical decision-making skills and attitudes about the importance of RCR training. The nominal impact of a short-term training course should not be surprising, but it does raise the possibility that other options for delivering information only, such as an Internet-based tutorial, might be considered as comparable alternatives when longer courses are not possible.     

The academic outcomes of working memory and metacognitive strategy training in children: A double‐blind randomized controlled trial

Working memory training has been shown to improve performance on untrained working memory tasks in typically developing children, at least when compared to non‐adaptive training; however, there is little evidence that it improves academic outcomes. The lack of transfer to academic outcomes may be because children are only learning skills and strategies in a very narrow context, which they are unable to apply to other tasks. Metacognitive strategy interventions, which promote metacognitive awareness and teach children general strategies that can be used on a variety of tasks, may be a crucial missing link in this regard. In this double‐blind randomized controlled trial, 95 typically developing children aged 9–14 years were allocated to three cognitive training programmes that were conducted daily after‐school. One group received Cogmed working memory training, another group received concurrent Cogmed and metacognitive strategy training, and the control group received adaptive visual search training, which better controls for expectancy and motivation than non‐adaptive training. Children were assessed on four working memory tasks, reading comprehension, and mathematical reasoning before, immediately after, and 3 months after training. Working memory training improved working memory and mathematical reasoning relative to the control group. The improvements in working memory were maintained 3 months later, and these were significantly greater for the group that received metacognitive strategy training, compared to working memory training alone. Working memory training is a potentially effective educational intervention when provided in addition to school; however, future research will need to investigate ways to maintain academic improvements long term and to optimize metacognitive strategy training to promote far‐transfer. A video abstract of this article can be viewed at https://youtu.be/-7MML48ZFgw     

Developing a Framework for Assessing Responsible Conduct of Research Education Programs

Education in the responsible conduct of research (RCR) in the United States has evolved over the past decade from targeting trainees to including educational efforts aimed at faculty and staff. In addition RCR education has become more focused as federal agencies have moved to recommend specific content and to mandate education in certain areas. RCR education has therefore become a research-compliance issue necessitating the development of policies and the commitment of resources to develop or expand systems for educating faculty and staff and for assuring compliance. These changes implied the need to develop a program evaluation model that could be applied to institutional RCR education programs, which were expected to differ from traditional academic credit-bearing courses targeting trainees. Information gleaned from the examination of corporate compliance models was analyzed in order to create a program evaluation module that could be used to document and assess educational programs focused on teaching RCR. A programmed series of questions for each of the nine RCR content areas identified by the United States Office of Research Integrity was created based on a performance-monitoring evaluation model. The questions focus on educational goals, resources provided to support the educational efforts, educational content, content delivery, educational outcomes, compliance requirements and feedback. Answers collected in response to the questions could be used to both document and continually improve the quality of RCR educational programs through on-going formative assessment and feedback.     

A Sensemaking Approach to Ethics Training for Scientists: Preliminary Evidence of Training Effectiveness

In recent years, we have seen a new concern with ethics training for research and development professionals. Although ethics training has become more common, the effectiveness of the training being provided is open to question. In the present effort, a new ethics training course was developed that stresses the importance of the strategies people apply to make sense of ethical problems. The effectiveness of this training was assessed in a sample of 59 doctoral students working in the biological and social sciences using a pre–post design with follow-up and a series of ethical decision-making measures serving as the outcome variable. Results showed not only that this training led to sizable gains in ethical decision making but also that these gains were maintained over time. The implications of these findings for ethics training in the sciences are discussed.     

Ensuring PhD Development of Responsible Conduct of Research Behaviors: Who’s Responsible?

The importance of public confidence in scientific findings and trust in scientists cannot be overstated. Thus, it becomes critical for the scientific community to focus on enhancing the strategies used to educate future scientists on ethical research behaviors. What we are lacking is knowledge on how faculty members shape and develop ethical research standards with their students. We are presenting the results of a survey with 3,500 research faculty members. We believe this is the first report on how faculty work with and educate their PhD students on basic research standards. Specifically, we wanted to determine whether individual faculty members, who are advisors or mentors, differ in how they implemented components of responsible conduct of research (RCR) with their PhD students. Mentors were more likely than advisors or supervisors to report working with all of their PhDs, who graduated in the last 5 years, on the 17 recognized critical components of RCR training and research skill development. We also found about half of the faculty members believe RCR is an institutional responsibility versus a faculty responsibility. Less than a quarter have had opportunities to participate in faculty training to be a better mentor, advisor, or research teacher, and about one third of faculty did not or could not remember whether they had guidelines related to their responsibilities to PhD students. We discuss the implications of our findings and focus on ways that PhD research mentoring can be enhanced.     

The Effect of an Ethical Decision-Making Training on Young Athletes’ Attitudes Toward Doping

This article examines whether a training program in ethical decision making can change young athletes’ doping attitudes. Fifty-two young elite athletes were randomly assigned to either an ethical decision-making training group or a standard-knowledge-based educational program group. Another 17 young elite athletes were recruited for no-treatment control purposes. The ethical decision-making training comprised six 30-min online sessions in which the participants had to work through 18 ethical dilemmas related to doping. The standard-knowledge-based educational program was also conducted in six online sessions of comparable length to that of the ethical training. A short version of the Performance Enhancement Attitude Scale was administered to measure the effects of the trainings on doping attitude. Prior to as well as after the intervention, the mean doping attitude scores of the young athletes were low to very low, indicating vehement rejections of doping. The results of our experiment showed that the ethical training led to an attenuation of these rejections. No intervention effect was found in the standard education group. The observed slight increase in the doping attitude score could be an indication that the ethical decision-making training was successful in breaking up the athletes’ stereotypical style of reasoning about doping.     

Metacognitive scaffolding boosts cognitive and neural benefits following executive attention training in children

Interventions including social scaffolding and metacognitive strategies have been used in educational settings to promote cognition. In addition, increasing evidence shows that computerized process‐based training enhances cognitive skills. However, no prior studies have examined the effect of combining these two training strategies. The goal of this study was to test the combined effect of metacognitive scaffolding and computer‐based training of executive attention in a sample of typically developing preschoolers at the cognitive and brain levels. Compared to children in the regular training protocol and an untrained active control group, children in the metacognitive group showed larger gains on intelligence and significant increases on an electrophysiological index associated with conflict processing. Moreover, changes in the conflict‐related brain activity predicted gains in intelligence in the metacognitive scaffolding group. These results suggest that metacognitive scaffolding boosts the influence of process‐based training on cognitive efficiency and brain plasticity related to executive attention.     

Mentoring for Responsible Research: The Creation of a Curriculum for Faculty to Teach RCR in the Research Environment

Despite more than 25 years of a requirement for training in the responsible conduct of research (RCR), there is still little consensus about what such training should include, how it should be delivered, nor what constitutes “effectiveness” of such training. This lack of consensus on content, approaches and outcomes is evident in recent data showing high variability in the development and implementation of RCR instruction across universities and programs. If we accept that one of the primary aims of instruction in RCR/research ethics is “to foster a community of social responsibility” (Antes et al. 2009: 398), then it makes sense to consider the research environment itself—where learning one’s science happens where one also engages in social interaction around that science. In order to take the best advantage of that already existing/naturally occurring research environment, the authors, through a deliberative, collaborative, and integrative process, crafted a workshop curriculum meant to arm research faculty with concrete and specific tools to effectively introduce research ethics in the context of the research environment.     

A Comparison of the Effects of Ethics Training on International and US Students

As scientific and engineering efforts become increasingly global in nature, the need to understand differences in perceptions of research ethics issues across countries and cultures is imperative. However, investigations into the connection between nationality and ethical decision-making in the sciences have largely generated mixed results. In Study 1 of this paper, a measure of biases and compensatory strategies that could influence ethical decisions was administered. Results from this study indicated that graduate students from the United States and international graduate students studying in the US are prone to different biases. Based on these findings, recommendations are made for developing ethics education interventions to target these decision-making biases. In Study 2, we employed an ethics training intervention based on ethical sensemaking and used a well-established measure of ethical decision-making that more fully captures the content of ethical judgment. Similar to Study 1, the results obtained in this study suggest differences do exist between graduate students from the US and international graduate students in ethical decision-making prior to taking the research ethics training. However, similar effects were observed for both groups following the completion of the ethics training intervention.     

Intrinsic Ethics Regarding Integrated Assessment Models for Climate Management

In this essay we develop and argue for the adoption of a more comprehensive model of research ethics than is included within current conceptions of responsible conduct of research (RCR). We argue that our model, which we label the ethical dimensions of scientific research (EDSR), is a more comprehensive approach to encouraging ethically responsible scientific research compared to the currently typically adopted approach in RCR training. This essay focuses on developing a pedagogical approach that enables scientists to better understand and appreciate one important component of this model, what we call intrinsic ethics. Intrinsic ethical issues arise when values and ethical assumptions are embedded within scientific findings and analytical methods. Through a close examination of a case study and its application in teaching, namely, evaluation of climate change integrated assessment models, this paper develops a method and case for including intrinsic ethics within research ethics training to provide scientists with a comprehensive understanding and appreciation of the critical role of values and ethical choices in the production of research outcomes.     

Metacognitive awareness of learning strategies in undergraduates

Two studies examined undergraduates’ metacognitive awareness of six empirically-supported learning strategies. Study 1 results overall suggested an inability to predict the learning outcomes of educational scenarios describing the strategies of dual-coding, static-media presentations, low-interest extraneous details, testing, and spacing; there was, however, weak endorsement of the strategy of generating one’s own study materials. In addition, an independent measure of metacognitive self-regulation was correlated with scenario performance. Study 2 demonstrated higher prediction accuracy for students who had received targeted instruction on applied memory topics in their psychology courses, and the best performance for those students directly exposed to the original empirical studies from which the scenarios were derived. In sum, this research suggests that undergraduates are largely unaware of several specific strategies that could benefit memory for course information; further, training in applied learning and memory topics has the potential to improve metacognitive judgments in these domains.     

America COMPETES at 5 years: An Analysis of Research-Intensive Universities’ RCR Training Plans

This project evaluates the impact of the National Science Foundation's (NSF) policy to promote education in the responsible conduct of research (RCR). To determine whether this policy resulted in meaningful RCR educational experiences, our study examined the instructional plans developed by individual universities in response to the mandate. Using a sample of 108 U.S. institutions classified as Carnegie “very high research activity”, we analyzed all publicly available NSF RCR training plans in light of the consensus best practices in RCR education that were known at the time the policy was implemented. We found that fewer than half of universities developed plans that incorporated at least some of the best practices. More specifically, only 31% of universities had content and requirements that differed by career stage, only 1% of universities had content and requirements that differed by discipline; and only 18% of universities required some face-to-face engagement from all classes of trainees. Indeed, some schools simply provided hand-outs to their undergraduate students. Most universities (82%) had plans that could be satisfied with online programs such as the Collaborative Institutional Training Initiative's RCR modules. The NSF policy requires universities to develop RCR training plans, but provides no guidelines or requirements for the format, scope, content, duration, or frequency of the training, and does not hold universities accountable for their training plans. Our study shows that this vaguely worded policy, and lack of accountability, has not produced meaningful educational experiences for most of the undergraduate students, graduate students, and post-doctoral trainees funded by the NSF.     

The effects of metacognitive training versus worked‐out examples on students' mathematical reasoning

Background: The present study is rooted in a cognitive‐metacognitive approach. The study examines two ways to structure group interaction: one is based on worked‐out examples (WE) and the other on metacognitive training (MT). Both methods were implemented in cooperative settings, and both guided students to focus on the problem's essential parts and on appropriate problem‐solving strategies. Aims: The aim of the present study is twofold: (a) to investigate the effects of metacognitive training versus worked‐out examples on students' mathematical reasoning and mathematical communication; and (b) to compare the long‐term effects of the two methods on students' mathematical achievement. Sample: The study was conducted in two academic years. Participants for the first year of the study were 122 eighth‐grade Israeli students who studied algebra in five heterogeneous classrooms with no tracking. In addition, problem‐solving behaviours of eight groups (N = 32) were videotaped and analysed. A year later, when these participants were ninth graders, they were re‐examined using the same test as the one administered in eighth grade. Method: Three measures were used to assess students' mathematical achievement: a pretest, an immediate post‐test, and a delayed post‐test. ANOVA was carried out on the post‐test scores with respect to the following criteria: verbal explanations, algebraic representations and algebraic solution. In addition, chi‐square and Mann‐Whitney procedures were used to analyse cooperative, cognitive, and metacognitive behaviours. Results: Within cooperative settings, students who were exposed to metacognitive training outperformed students who were exposed to worked‐out examples on both the immediate and delayed post‐tests. In particular, the differences between the two conditions were observed on students' ability to explain their mathematical reasoning during the discourse and in writing. Lower achievers gained more under the MT than under WE condition. Conclusions: The findings indicate that the kind of task and the way group interaction is structured are two important variables in implementing cooperative learning, each of which is likely to have different effects on mathematical communication and achievement outcomes.     

Scholars’ preferred solutions for research misconduct: results from a survey of faculty members at America’s top 100 research universities

Research misconduct is harmful because it threatens public health and public safety, and also undermines public confidence in science. Efforts to eradicate ongoing and prevent future misconduct are numerous and varied, yet the question of “what works” remains largely unanswered. To shed light on this issue, this study used data from both mail and online surveys administered to a stratified random sample of tenured and tenure-track faculty members (N = 613) in the social, natural, and applied sciences at America’s top 100 research universities. Participants were asked to gauge the effectiveness of various intervention strategies: formal sanctions (professional and legal), informal sanctions (peers), prevention efforts (ethics and professional training), and reducing the pressures associated with working in research-intensive units. Results indicated that (1) formal sanctions received the highest level of support, (2) female scholars and researchers working in the applied sciences favored formal sanctions, and (3) a nontrivial portion of the sample supported an integrated approach that combined elements of different strategies. A key takeaway for university administrators is that a multifaceted approach to dealing with the problem of research misconduct, which prominently features enhanced formal sanctions, will be met with the support of university faculty.     

Science, Human Nature, and a New Paradigm for Ethics Education

For centuries, religion and philosophy have been the primary basis for efforts to guide humans to be more ethical. However, training in ethics and religion and imparting positive values and morality tests such as those emanating from the categorical imperative and the Golden Rule have not been enough to protect humankind from its bad behaviors. To improve ethics education educators must better understand aspects of human nature such as those that lead to ??self-deception?? and ??personal bias.?? Through rationalizations, faulty reasoning and hidden bias, individuals trick themselves into believing there is little wrong with their own unethical behavior. The application of science to human nature offers the possibility of improving ethics education through better self-knowledge. The author recommends a new paradigm for ethics education in contemporary modern society. This includes the creation of a new field called ??applied evolutionary neuro-ethics?? which integrates science and social sciences to improve ethics education. The paradigm can merge traditional thinking about ethics from religious and philosophical perspectives with new ideas from applied evolutionary neuro-ethics.     

What is Working,What is Not,and What We Need to Know: a Meta-Analytic Review of Business Ethics Instruction

Requirements for business ethics education and organizational ethics trainings mark an important step in encouraging ethical behavior among business students and professionals. However, the lack of specificity in these guidelines as to how, what, and where business ethics should be taught has led to stark differences in approaches and content. The present effort uses meta-analytic procedures to examine the effectiveness of current approaches across organizational ethics trainings and business school courses. to provide practical suggestions for business ethics interventions and research. Thus, the primary questions driving this research are as follows: (1) what course characteristics moderate the effectiveness of ethics instruction?, and (2) have ethics education and training efforts improved? Findings suggest that professional, focused, and workshop-based training programs are especially effective for improving business ethics. However, results also reveal considerable problems with many of the criteria used to evaluate the effectiveness of business ethics interventions. Practical suggestions for course design and evaluation in business ethics efforts are discussed along with future research needs.     

The effects of metacognitive training on the academic achievement and happiness of Esfahan University conditional students

Although the current literature supports the effectiveness of metacognition as a learning strategy, little is known about the effects of metacognition on academic achievement and happiness. This study analyzed the effectiveness of training metacognition on the academic achievement and happiness of Esfahan University conditional students. Conditional students are the students whose averages are lower than 12 (12 out of 20). After three times of becoming conditional they are expelled from university. The sample consisted of 60 once-conditional female students. They were randomly selected and allocated to an experimental group and a control group. The independent variable was the metacognitive training sessions performed in the experimental group. The Oxford Happiness Questionnaire scores and the students’ second semester average scores in 2003–2004 were dependent variables. The study predicted that training in metacognition should have positive effects on the academic achievement and that it would increase students’ happiness. The results suggested that metacognitive training had increased the academic achievement average of the experimental group. Similarly, metacognitive training had increased the happiness scores average of the experimental group.