Web‐based Multisource Reference Checking: An investigation of psychometric integrity and applied benefits

Reference checking is a near‐universal practice within personnel selection systems, and legal pressures to gather job‐relevant and structured feedback from references is mounting. Despite this state of affairs, reference checking is a woefully under‐researched method for obtaining psychometrically sound and behaviorally informative data that predict task, team, and leadership behavior at work. From studies of job candidates in applied settings, this article reports on the reliability, validity, and compliance of multisource reference feedback gathered using a web‐based methodology. Acceptable levels of internal consistency, inter‐rater reliability, and test–retest reliability of the reference‐checking instrument were realized. Results of survival analyses found support for prediction of involuntary, but not voluntary turnover. No practically significant differences were found in overall mean scores across demographic subgroups. Finally, the web‐based reference‐checking system evinced high degrees of efficiencies across a range of metrics (e.g., reference response time, reference response rate, candidate response time).     

Intentional Objects,Pretence, and the Quasi-Relational Nature of Mental Phenomena: A New Look at Brentano on Intentionality

Abstract

Brentano famously changed his mind about intentionality between the 1874 and 1911 editions of Psychology from an Empirical Standpoint (PES). The 1911 edition repudiates the 1874 view that to think about something is to stand in a relation to something that is within in the mind, and holds instead that intentionality is only like a relation (it is ‘quasi-relational’). Despite this, Brentano still insists that mental activity involves ‘the reference to something as an object’, much as he did in the 1874 edition of PES. The question is what Brentano might have meant by this, given that he rejects a relational account of intentionality. The present paper suggests an answer. It draws on recent work on pretence theory to provide a model of Brentano’s notion of the quasi-relational nature of mental phenomena, as well as of the notion of mental reference to an object, and argues that the model helps to explain why Brentano might have been able discern a clear continuity between the views of the 1874 and 1911 editions of PES, despite the differences.     

Exposure to Unethical Career Events: Effects on Decision Making,Climate, and Socialization

An implicit goal of many interventions intended to enhance integrity is to minimize peoples' exposure to unethical events. The intent of the present effort was to examine if exposure to unethical practices in the course of one's work is related to ethical decision making. Accordingly, 248 doctoral students in the biological, health, and social sciences were asked to complete a field appropriate measure of ethical decision making. In addition, they were asked to complete measures examining the perceived acceptability of unethical events and a measure examining perceptions of ethical climate. When these criterion measures were correlated with a measure examining the frequency with which they had been exposed to unethical events in their day-to-day work, it was found that event exposure was strongly related to ethical decision making but less strongly related to climate perceptions and perceptions of event acceptability. However, these relationships were moderated by level of experience. The implications of these findings for practices intended to improve ethics are discussed.     

Environmental Influences on Ethical Decision Making: Climate and Environmental Predictors of Research Integrity

It is commonly held that early career experiences influence ethical behavior. One way early career experiences might operate is to influence the decisions people make when presented with problems that raise ethical concerns. To test this proposition, 102 first-year doctoral students were asked to complete a series of measures examining ethical decision making along with a series of measures examining environmental experiences and climate perceptions. Factoring of the environmental measure yielded five dimensions: professional leadership, poor coping, lack of rewards, limited competitive pressure, and poor career direction. Factoring of the climate inventory yielded four dimensions: equity, interpersonal conflict, occupational engagement, and work commitment. When these dimensions were used to predict performance on the ethical decision-making task, it was found that the environmental dimensions were better predictors than the climate dimensions. The implications of these findings for research on ethical conduct are discussed.     

A Sensemaking Approach to Ethics Training for Scientists: Preliminary Evidence of Training Effectiveness

In recent years, we have seen a new concern with ethics training for research and development professionals. Although ethics training has become more common, the effectiveness of the training being provided is open to question. In the present effort, a new ethics training course was developed that stresses the importance of the strategies people apply to make sense of ethical problems. The effectiveness of this training was assessed in a sample of 59 doctoral students working in the biological and social sciences using a pre–post design with follow-up and a series of ethical decision-making measures serving as the outcome variable. Results showed not only that this training led to sizable gains in ethical decision making but also that these gains were maintained over time. The implications of these findings for ethics training in the sciences are discussed.     

The Effects of Note-Taking and Review on Sensemaking and Ethical Decision Making

The effectiveness of case-based learning in ethics education varies widely regarding how cases are presented. Case process instruction may impact case-based ethics education to promote sensemaking processes, ethical sensemaking strategy use, and ethical decision making (EDM) quality. This study examined two teaching techniques, notes and review, and participants completed note-taking and review activities examining a case-based scenario during an ethics education course. Results suggest that providing case notes in outline form improves sensemaking processes, strategy use, and EDM quality. In addition, combining processes of provided notes and passive review results in incremental, additive performance via certain ethical sensemaking strategies and EDM quality.     

The Influence of Temporal Orientation and Affective Frame on Use of Ethical Decision-Making Strategies

This study examined the role of temporal orientation and affective frame in the execution of ethical decision-making strategies. In reflecting on a past experience or imagining a future experience, participants thought about experiences that they considered either positive or negative. The participants recorded their thinking about that experience by responding to several questions, and their responses were content-analyzed for the use of ethical decision-making strategies. The findings indicated that a future temporal orientation was associated with greater strategy use. Likewise, a positive affective frame was associated with greater strategy use. Future orientation may permit better strategy execution than a past orientation because it facilitates more objective, balanced contemplation of the reflected-upon situation and minimizes potential self-threat associated with past behavior. A positive affective frame likely improves strategy execution because it facilitates active analysis of the experience. Future directions and implications of these findings are discussed.