Option weights should be determined empirically and not by experts when assessing knowledge with multiple‐choice items

Multiple‐choice tests are frequently used in personnel selection contexts to measure knowledge and abilities. Option weighting is an alternative multiple‐choice scoring procedure that awards partial credit for incomplete knowledge reflected in applicants’ distractor choices. We investigated whether option weights should be based on expert judgment or on empirical data when trying to outperform conventional number‐right scoring in terms of reliability and validity. To obtain generalizable results, we used repeated random sub‐sampling validation and found that empirical option weighting, but not expert option weighting, increased the reliability of a knowledge test. Neither option weighting procedure improved test validity. We recommend to improve the reliability of existing ability and knowledge tests used for personnel selection by computing and publishing empirical option weights.     

The use of snowball sampling for multi source organizational research: Some cause for concern

In snowball sampling for multisource studies, researchers ask target participants to recruit informants. Despite its widespread use, especially for recruiting informants for multisource research, virtually no published research has addressed possible biases snowball sampling may cause in findings of this type of research. Such potential biases were tested empirically in a multisource study with a sample of 1,058 employed students asked to collect online ratings from their supervisors and coworkers. Informant ratings were obtained for 358 target participants. Objective indicators were employed to identify informant ratings suspicious of being fabricated. Results indicated that target participants who report (a) better relationship quality with informants, (b) fewer organizational constraints, and (c) more favorable self‐evaluations on behaviors to be rated by informants were more likely to be included in multisource data unsuspicious of being fabricated. Inclusion of informant ratings suspicious of being fabricated led to inflated estimates of self‐other consensus and of variance accounted for in criterion measures, to deflated informant rating means, but also to a target sample less restricted in terms of relevant organizational variables. In sum, the present findings suggest that potential biases should be identified in future uses of snowball sampling. Some practical recommendations toward that end are derived.     

Interpreting ambiguous stimuli: Separating perceptual and judgmental biases

Interpreting ambiguous situations is not a purely data-driven process but can be biased towards positive interpretations by top-down influences. The present study tries to identify the underlying processes of these top-down influences. There are two separable types of processes that can be influenced by motivational biases: A perceptual bias affects information uptake whereas a judgmental bias affects acceptance criteria for positive and negative outcomes. In the present study, motivated influences on perception and judgment were investigated with a simple color discrimination task in which ambiguous stimuli had to be classified according to their dominating color. One of two colors indicated a financial gain or a loss, whereas a third color was neutral. To separate perceptual and judgmental biases, Ratcliff’s [Ratcliff, R. (1978). A theory of memory retrieval. Psychological Review, 85, 59–108] diffusion model was employed. Results revealed motivational influences on perception and judgment.     

“How much do you like your name?” An implicit measure of global self-esteem

We introduce a single-item implicit measure of global self-esteem. The measure is based on the mere-ownership effect and asks participants to indicate how much they like their name. Six studies attested to the validity of this measure. In addition to showing high test-retest reliability (r = .85), the studies found that Name-Liking was (a) unrelated to impression management, (b) positively related to the Name-Letter-Task, the Self-Esteem IAT, explicit self-esteem measures, and self-reported subjective well-being, (c) more strongly related to explicit measures of global than domain-specific self-esteem, (d) more strongly related to self-esteem judgments made spontaneously as well as under cognitive load, and (e) predicted observer-reported anxiety during an anxiety-inducing interview whereas an explicit measure of self-esteem did not.     

Pleasure and pressure based prosocial motivation: Divergent relations to subjective well-being

We propose two fundamentally different motives for helping: gaining pleasure and fulfilling one’s duty (“pressure”). Using the newly developed Pleasure and Pressure based Prosocial Motivation Scale, we demonstrated the distinctiveness of pleasure and pressure based prosocial motivation in three studies. Although the two motives exhibited different relations to a variety of personality characteristics, they were similarly related to trans-situational helping. Of particular interest, pleasure based prosocial motivation was positively related to self-actualization, self-esteem, life satisfaction, and positive affect and negatively related to negative affect. On the contrary, pressure based prosocial motivation was unrelated to self-actualization, self-esteem, life satisfaction, and positive affect but positively related to negative affect. These results qualify research showing that prosocial life goals generally increase subjective well-being.     

Personality, political skill, and job performance

Based on the socioanalytic perspective of performance prediction [Hogan, R. (1991). Personality and personality assessment. In M. D. Dunnette, L. Hough, (Eds.), Handbook of industrial and organizational psychology (2nd ed., pp. 873–919). Chicago: Rand McNally; Hogan, R., & Shelton, D. (1998). A socioanalytic perspective on job performance. Human Performance, 11, 129–144.], the present study tests whether motives to get along and to get ahead produce greater performance when interactively combined with social effectiveness. Specifically, we investigated whether interactions of the Five-Factor Model constructs of agreeableness and conscientiousness with political skill predict job performance. Our results supported our hypothesis for the agreeableness-political skill interaction. Additionally, after correcting for the unreliability and restricted range of conscientiousness, we found that its interaction with political skill also significantly predicted job performance, although not precisely as hypothesized. Implications of the results and directions for future research are provided.     

Regret aversion and decision process quality: Effects of regret salience on decision process carefulness

A considerable amount of past research has examined the effects of regret aversion on which options decision makers choose. However, past research has largely neglected to address the effect of regret aversion on the decision process. We conducted five experiments to examine the effect of making regret salient on decision process quality. We predicted that increased regret aversion would lead to more careful decision processing. The results consistently supported this prediction across the different decision situations, incentive structures, regret salience manipulations, and dependent variables used. In all experiments making regret salient led decision makers to take significantly longer to reach a decision. In Studies 2a, 2b, and 4 it also led participants to collect significantly more information before making a choice. Implications and future directions are discussed.     

Perceiving one’s own movements when using a tool

The present study examined what participants perceive of their hand movements when using a tool. In the experiments different gains for either the x-axis or the y-axis perturbed the relation between hand movements on a digitizer tablet and cursor movements on a display. As a consequence of the perturbation participants drew circles on the display while their covered hand movements followed either vertical or horizontal ellipses on the digitizer tablet. When asked to evaluate their hand movements, participants were extremely uncertain about their trajectories. By varying the amount of visual feedback, findings indicated that the low awareness of one’s own movements originated mainly from an insufficient quality of the humans’ tactile and proprioceptive system or from an insufficient spatial reconstruction of this information in memory.