AN EXAMINATION OF THE EFFECTS OF USING BEHAVIOR CHECKLISTS ON THE CONSTRUCT VALIDITY OF ASSESSMENT CENTER DIMENSIONS

Although research has established the criterion-related validity of assessment centers for selection purposes, the construct validity of dimension ratings has not been demonstrated. A quasi-experimental design was used to investigate the influence of retranslated behavior checklists on the construct validity of dimension ratings for two assessment center exercises. Assessor use of behavior checklists increased the average convergent (i.e., same dimension across exercise) validity from .24 to .43 while decreasing the average discriminant (i.e., different dimension within exercise) validity (.47 to .41). Behavior checklist sums were moderately correlated with corresponding dimension ratings and demonstrated a comparable level of construct validity. It is suggested that using behavior checklists may improve dimension construct validity by reducing the cognitive demands placed on raters.     

Value Tensions Between Evangelical Christians and Christian Counseling

The evangelical wing of the American Protestant church has maintained an uneasy and uncertain relationship with the recently emerged Christian counseling movement. Whereas many evangelical Christian groups have been able to assimilate Christian counseling into their panoply of ministry tools, significant sections of this faith group remain very suspicious and doubtful that Christian counseling can be trusted. Most of the stated reasons given by these objectors revolve around theological reservations. This article, however, suggests that an even more powerful barrier between the two groups stems from significantly different values held by each. The article enumerates several of these value differences.     

Perceptions of Brainstorming in Groups: The Quality Over Quantity Hypothesis

Our research focused on the implicit beliefs of potential brainstormers about the possible outcomes of brainstorming. We conducted four studies to assess the relative importance of quality and quantity as goals of brainstorming. In Study 1, we found evidence for a quality over quantity hypothesis: participants indicated that it was more important to produce creative, original, and high quality ideas than to generate a large number of ideas. In Studies 2 and 3, participants displayed support for the quality over quantity hypothesis by showing in group favoritism for a quality dimension but not a quantity dimension. Study 4 showed that participants believed brain-storming would enhance the quality of others' ideas more than one's own ideas, but they did not display a similar bias about idea quantity.     

CAN MULTI-SOURCE FEEDBACK CHANGE PERCEPTIONS OF GOAL ACCOMPLISHMENT,SELF-EVALUATIONS,AND PERFORMANCE-RELATED OUTCOMES? THEORY-BASED APPLICATIONS AND DIRECTIONS FOR RESEARCH

Multi-source feedback extends traditional performance appraisal by collecting information from subordinates, peers, supervisors, and customers. Ratees often receive the results along with normative data and self-ratings. This paper explores how multi-source feedback goes beyond traditional performance appraisal by providing ratees with comparative information. Focusing on person perception and information processing dynamics, this paper develops a model and associated propositions to explain the effects of multi-source feedback on perceptions of goal accomplishment, re-evaluation of self-image, and changes in outcomes such as goals, development, behavior, and performance. Moderators of relationships between the major components in the model include individual difference variables (self-image, feedback seeking, self-monitoring, task-specific self-efficacy, and impression management) and situational conditions (the content and process of multi-source feedback and organizational performance standards). Issues of research and practice intended to improve understanding and effectiveness of multi-source feedback are discussed.     

GENERALIZATION OF EMPLOYEE INVOLVEMENT TRAINING TO THE JOB SETTING: INDIVIDUAL AND SITUATIONAL EFFECTS

This study examined whether variables at individual, unit, and suborganization levels influence the extent to which the knowledge and skills learned in employee involvement (EI) training are generalized beyond specific EI activities. Training generalization occurs when the knowledge and skills learned in training for a specific purpose in one context (e.g., EI training for use in quality circles) are applied by trainees in another context (e.g., regular job duties). A multiple-cross-level design using data gathered from 252 employees and supervisors drawn from 88 units across 11 suborganizations provided support for both individual and situational effects. Hierarchical regression results demonstrated that characteristics at individual, unit, and suborganization levels significantly predicted the extent EI knowledge, skills, and attitudes were generalized to the core job activities. As predicted, trainees were more likely to use EI training in performing core job activities the more EI activities they participated in, the greater their commitment to the organization, and the less cynical they were about the likelihood of positive organizational change. Contrary to expectations, more generalization of EI training was found to occur in units and suborganizations with less participative climates.     

USING THE UNMATCHED COUNT TECHNIQUE (UCT) TO ESTIMATE BASE RATES FOR SENSITIVE BEHAVIOR

Many areas of personnel research are "sensitive." We provide an empirical assessment of the unmatched count technique (UCT) to determine the base rate for a number of proscribed behaviors for professional auctioneers. To our knowledge, this is the first empirical application of a UCT technique in organizational studies. Advantages of the UCT are discussed including: (a) a more accurate estimate of the base rates for sensitive behavior, (b) absolute anonymity to subjects, (c) "legal immunity" to the researcher, and (d) facilitation of complete disclosure to subjects with no deception.     

PERFORMANCE FEEDBACK EFFECTS IN TRAINING: THE ROLE OF PERCEIVED CONTROLLABILITY

A field experiment with 86 employees tested whether performance feedback that attributes past performance to factors within trainees' control would result in heightened software efficacy, goal commitment, positive mood, and learning, compared to feedback that attributes past performance to factors outside trainees' control. In addition, we assessed whether the use of feedback would produce a Galatea effect, or gain in trainees' performance that is the result of a boost in their self-efficacy. The results show that trainees who received feedback that attributed their performance to factors within their control had higher software efficacy. Software efficacy was positively related to learning (both declarative knowledge and compilation). Contrary to our expectations, feedback did not influence goal commitment or positive mood. Further, a statistically significant Galatea effect was not obtained; however, feedback that attributes performance to factors outside trainees' control was related to a decrease in software efficacy.     

EFFECTS OF MULTIPLE ADMINISTRATIONS OF THE MMPI FOR EMPLOYEE SCREENING

Psychological screening has become commonplace in a number of occupational groups. With the growing popularity of screening and the relative scarcity of appropriate personality measures, re-screening individuals with the same inventory is frequent. This paper examines the effect of re-screening with the Minnesota Multiphasic Personality Inventory (MMPI) on contract workers (n = 1,997) from the nuclear power industry. Participants completed the Inventory as a part of a routine screening procedure. Each participant provided several profiles as a result of regular employment cycles. Although the differences are generally small, some scales show large enough mean changes to warrant concern when interpreting the profiles of those who have taken the profile multiple times. Although scale reliabilities tend to increase, the usefulness of the Inventory appears to decrease with an increasing number of administrations. The effect is one of increasing normality of test profiles. One interpretation of the results is that candidates for jobs become "test-wise," and the scores are the result of a combination of responses to the repeated assessment. It becomes increasingly difficult to identify unfit employees with the Inventory. Given these results, further research on retesting effects of the Inventov, as well as other personality measures, is indicated.