When is ignorance bliss? The effects of inaccurate self-assessments of knowledge on learning and attrition

Two studies were conducted to examine the implications of inaccurate self-appraisals in online training. Self-assessment of knowledge moderated the effects of trainees’ performance on subsequent performance and attrition. Performance was highest after uniformly positive ratings (i.e., high self-assessment and high performance), followed by underestimation, overestimation, and uniformly negative ratings, respectively. Attrition was lowest after uniformly positive ratings, followed by underestimation, uniformly negative ratings, and overestimation, respectively. Effort had a more positive effect on performance following low than high self-assessments and this interaction fully mediated the self-assessment/performance interaction on subsequent performance. Commitment had a more negative effect on subsequent attrition following low than high self-assessments and this interaction fully mediated the self-assessment/performance interaction on subsequent attrition. Finally, trainee conscientiousness affected their behavior when their performance and self-assessments were inconsistent—overestimating and underestimating performance increased attrition more for trainees low in conscientiousness and impaired performance more for trainees high in conscientiousness.     

Modal preferences in creative problem solving

Embodied cognitive science appeals to the idea that cognition depends on the body as well as on the brain. This study looks at whether we are more likely to engage just the brain or enlist the body for complex cognitive functioning such as creative problem solving. Participants were presented with a puzzle based on De Bono's lateral thinking puzzles. The puzzle consisted of rotating and joining two-dimensional shapes to make a three-dimensional one. In one condition, participants were given the choice of either solving the puzzle mentally or through manipulation of the images on a computer screen. In another condition, the subjects had to solve the puzzle first mentally and then report which mode they would have preferred to solve the puzzle. Two more conditions were applied with slight variations. In all conditions, an overwhelming majority of participants chose to solve the puzzle by manipulation, even though there was not a significant increase on performance. It appeared that participants were making a conscious choice for the body to play a feedback-driven role in creative cognitive processing. This strong preference for manual manipulation over just mental representation, regardless of the impact on performance, would seem to suggest that it is our natural tendency to involve the body in complex cognitive functioning. This would support the theory that cognition may be more than just a neural process, and that it is a dynamic interplay between body, brain and world. The experiential feedback of the body moving through space and time may be an inherently important factor in creative cognition.     

Current negative mood encourages changes in end-of-life treatment decisions and is associated with false memories

To investigate the effects of mood on people's end-of-life treatment decisions and their false memories of those decisions, participants took part in two sessions. At Time 1, participants were experimentally induced into positive or negative moods. They decided whether they would want to receive or refuse treatments in a range of hypothetical medical scenarios, such as tube feeding while in a coma. Four weeks later, at Time 2, participants were induced into the same or the opposite mood and made these decisions a second time. They also recalled their previous decisions. Participants in negative moods at Time 2 changed more of their current decisions and falsely remembered more of their previous decisions than participants in positive moods. These findings suggest that people's current moods influence whether they change their treatment decisions; current decisions in turn bias recall of past decisions.     

A Gricean approach to the use of consensus and distinctiveness in causal attributions of verbally described interpersonal events

Various causal attribution theories, starting with the covariation model, argue that people use consensus, distinctiveness, and consistency information to causally explain events and behaviors. Yet, the visual presentation of the covariation model in the form of a cube is based on the assumptions that these dimensions generally affect attributions independently, symmetrically, and equally. A Gricean analysis suggests that these assumptions may not generally hold in the case of causal judgments for verbally communicated interpersonal events. We had participants judge the causal role of an actor and a patient in interpersonal events that were described through actor‐verb‐patient sentences under high versus low consensus and distinctiveness (Studies 1, 2, and 3) or without such information (Studies 2 and 3). As predicted by Gricean logic, consensus and distinctiveness effects on causality ratings depended on the target whose causal role participants assessed, on the information about the alternative dimension, and, most consistently, on consensus and distinctiveness being high versus low. Copyright © 2013 John Wiley & Sons, Ltd.     

Exploring Differential Subgroup Functioning on SAT Writing Items: What Happens When English Is Not a Test Taker's Best Language?

The purpose of this study is to explore patterns in model-data fit related to subgroups of test takers from a large-scale writing assessment. Using data from the SAT, a calibration group was randomly selected to represent test takers who reported that English was their best language from the total population of test takers (N = 322,011). A reference scale for the items was constructed based on EBL responses. Response behaviors of test takers who reported that English was not their best language (ENBL) were examined in relationship to this reference scale. This study illustrates the use of differential subgroup analyses to identify patterns related to person misfit within subgroups, as well as subsets of items, that may affect the validity of writing scores for ENBL test takers. The methodology described here offers an approach that can be used to explore, understand, and improve the validity of scores obtained from ENBL test takers in large-scale writing assessments.     

The Influence of Rater Effects in Training Sets on the Psychometric Quality of Automated Scoring for Writing Assessments

Automated essay scoring engines (AESEs) are becoming increasingly popular as an efficient method for performance assessments in writing, including many language assessments that are used worldwide. Before they can be used operationally, AESEs must be “trained” using machine-learning techniques that incorporate human ratings. However, the quality of the human ratings used to train the AESEs is rarely examined. As a result, the impact of various rater effects (e.g., severity and centrality) on the quality of AESE-assigned scores is not known. In this study, we use data from a large-scale rater-mediated writing assessment to examine the impact of rater effects on the quality of AESE-assigned scores. Overall, the results suggest that if rater effects are present in the ratings used to train an AESE, the AESE scores may replicate these effects. Implications are discussed in terms of research and practice related to automated scoring.     

Taking a Turn Toward the Masculine: The Impact of Mortality Salience on Implicit Leadership Theories

The present research investigates the influence of subtle death-related thoughts (i.e., mortality salience) on people's images of effective leaders (i.e., their implicit leadership theories [ILTs]). We test the prediction that mortality salience will change the content of these implicit theories to be more gender stereotypical such that individuals will conceive of effective leaders in a significantly more masculine, or agentic, manner. To test this prediction, we assessed the communal and agentic components of participants' ILTs after they were presented with a mortality salience or control manipulation. Results show that priming individuals to think about their mortality with two open-ended questions resulted in a significant shift in their ILTs such that an effective leader is described in significantly more agentic terms compared to the control condition. This masculine shift in people's ILTs was demonstrated in both women and men, and mortality salience did not influence perceptions of effective leaders' communal traits. This work contributes to research on gender bias in leadership, ILTs, and terror management theory and has implications for female leaders.