INDIVIDUAL DIFFERENCES IN INTERVIEWER RATINGS: THE IMPACT OF STANDARDIZATION, CONSENSUS DISCUSSION, AND SAMPLING ERROR ON THE VALIDITY OF A STRUCTURED INTERVIEW

This research investigated empirical issues regarding the validity of individual interviewers'( N = 62) ratings collected after a structured interview. Each interviewer rated an average of 25 interviewees. One hypothesis examined but not supported was that systematic interviewer errors will attenuate interview validity when data are aggregated across interviewers. Also investigated was the validity of ratings averaged across interviewers compared to consensus ratings; consensus ratings were shown to have significantly but probably not practically higher validities. Third, a meta-analysis of individual interviewer validities revealed that all of the variance in validities could be attributed to sampling error. Results and implications are discussed.     

A LONGITUDINAL STUDY OF UPWARD FEEDBACK

This study followed 92 managers during four administrations of an upward feedback program over 2.5 years. Managers' whose initial level of performance (defined as the average rating from subordinates) was low improved between Administrations 1 and 2, and sustained this improvement 2 years later. Most of the performance improvement occurred between the first and second administrations of the program. The observed performance improvement could not be attributed solely to regression to the mean and was unrelated to the number of times, or when, the managers received feedback. Our results suggest that the continued administration of an upward feedback program can result in sustained change over a fairly long period of time and that actually receiving feedback may be less important than the exposure to the valued behaviors. We use control theory and goal setting theory as frameworks for explaining the results and suggesting directions for future research.     

STATISTICAL POWER AND COST IN TRAINING EVALUATION: SOME NEW CONSIDERATIONS

Two ways to reduce the costs of training evaluation are examined. First, we examine the potential for reducing the costs of training evaluation by assigning different numbers of subjects into training and control groups. Given a total N of subjects, statistical power to detect the effectiveness of a training program can be maximized by assigning the subjects equally to training and control groups. If we take into account the costs of training evaluation, however, an unequal-group-size design with a larger total N may achieve the same level of statistical power at lower cost. We derive formulas for the optimal ratios of the control group size to the training group size for both ANOVA and ANCOVA designs, incorporating the differential costs of training and control group participation. Second, we examine the possibility that using a less expensive proxy criterion measure in place of the target criterion measure of interest when evaluating the training effectiveness can pay off. We show that using a proxy criterion increases the sample size needed to achieve a given level of statistical power, and then we describe procedures for examining the tradeoff between the costs saved by using the less expensive proxy criterion and the costs incurred by the larger sample size.     

EMPLOYEE SELECTION WITH THE PERFORMANCE PRIORITY SURVEY

Person-environment congruence, as defined in this series of studies, is the fit between the subordinate's perceptions of the requirements of the job, and the requirements of the supervisor or of the organization. Person-environment congruence is measured in this research by the Performance Priority Survey (PPS), a Q-sort procedure in which respondents rate the relative importance of work behaviors. The priorities of the organization (reported by supervisors) and the priorities of the subordinates (or applicants) are correlated to produce an agreement score. The agreement score for each supervisor-subordinate pair measures the degree of similarity between the perceptions of the relative importance of work behaviors for the job in question, as reported by both members of the pair. The agreement score is calculated in two ways: (a) between the report of the subordinate (or applicant) and the report of the immediate supervisor, and (b) between the report of the subordinate (or applicant) and the organizational culture (aggregated reports of supervisors). The agreement scores correlate significantly with performance ratings. The PPS has a lower adverse impact on African-Americans than a typical multiple-choice test. The PPS is proposed as a means for improving the validity of selection and for reducing adverse impact.     

Continuing Education Services: A Survey of State Associations of AACD

This article describes a national survey regarding services for continuing education units (CEUs) in state branches of AACD.     

A Bridge Too Far: Incompatibilities of Rational-Emotive Therapy and Pastoral Counseling

The inappropriateness of pure rational-emotive therapy (RET) for pastoral counseling is discussed and a modified version (cognitive appraisal therapy) proposed to replace RET.     

Trends in Counseling: A Delphi Study

Counselor preparation faculty used a Delphi procedure to forecast 48 possible trends in the areas of preparation, licensure, funding, professionalism, organizational bases and counseling procedures.