SETTING CUTOFF SCORES: LEGAL, PSYCHOMETRIC, AND PROFESSIONAL ISSUES AND GUIDELINES

Cutoff scores are used in a variety of settings to help managers make personnel decisions. Although cutoff scores are used widely, information about their derivation and appropriate use is scattered in the legal, psychometric, and professional literatures. The purpose of this paper is to analyze critically and to integrate these diverse literatures, to summarize what is known and what is unknown about the use and misuse of cutoff scores. Alternative methods are examined in relation to legal precedents set by the courts, to psychometric principles, and to the various sets of professional guidelines. Directions for future research are suggested, and we conclude with a set of recommendations regarding acceptable professional practice in this area.     

ISSUES CONCERNING THE USE OF REGRESSION ANALYSIS IN SALARY DISCRIMINATION CASES

Twenty-nine salary discrimination court cases were examined to determine ways an organization can refute a regression analysis that leads to the inference of discrimination in compensation. It was found to be equally effective for the organization to introduce its own regression, other statistics, or no statistics. The plaintiff won all of the cases when discrimination was proven in promotion. The defendant won all cases when discrimination was not proven in promotion. Defendants also won all cases when plaintiffs inappropriately treated jobs as fungible or when they failed to include important variables. Market variables may be included in regressions if defendants can show they were applied consistently to determine salaries. The implications of the courts' acceptance of some regressions for comparable worth is presented, and a list of recommendations is made for organizations that may be faced with results from regression analysis in court.     

PERFORMANCE APPRAISAL AND TERMINATIONS: A REVIEW OF COURT DECISIONS SINCE BRITO V. ZIA WITH IMPLICATIONS FOR PERSONNEL PRACTICES

Court cases since the classic Brito v. Zia (1973) decision dealing with terminations based on subjective performance appraisals are reviewed. Professional interpretations of Brito v. Zia are also examined and criticized in light of professional practice and subsequent court decisions. Major themes and issues are distilled from the review of cases, and implications and recommendations for personnel practices were discussed.     

EMPLOYEE SELECTION WITH THE PERFORMANCE PRIORITY SURVEY

Person-environment congruence, as defined in this series of studies, is the fit between the subordinate's perceptions of the requirements of the job, and the requirements of the supervisor or of the organization. Person-environment congruence is measured in this research by the Performance Priority Survey (PPS), a Q-sort procedure in which respondents rate the relative importance of work behaviors. The priorities of the organization (reported by supervisors) and the priorities of the subordinates (or applicants) are correlated to produce an agreement score. The agreement score for each supervisor-subordinate pair measures the degree of similarity between the perceptions of the relative importance of work behaviors for the job in question, as reported by both members of the pair. The agreement score is calculated in two ways: (a) between the report of the subordinate (or applicant) and the report of the immediate supervisor, and (b) between the report of the subordinate (or applicant) and the organizational culture (aggregated reports of supervisors). The agreement scores correlate significantly with performance ratings. The PPS has a lower adverse impact on African-Americans than a typical multiple-choice test. The PPS is proposed as a means for improving the validity of selection and for reducing adverse impact.     

THREE-ALTERNATIVE MULTIPLE CHOICE TESTS: AN ATTRACTIVE OPTION

Traditionally, multiple choice tests have included four or five alternatives. Data from public sector employment tests are presented that indicate that tests composed of multiple choice items containing three alternatives have psychometric properties similar to those offered by tests composed of items containing five alternatives. Given the similarity of the psychometric properties and the likely reductions in cost of development and administration time, three-alternative multiple choice items may be preferable to five-alternative multiple choice items for some testing purposes.     

Questioning the “Slippery Slope”: Ethical Beliefs and Behaviors of Private Office-Based and Church-Based Therapists

Counselors and other mental health professionals whose primary office is in a church building often face unique challenges in maintaining appropriate client-therapist boundaries. A sample of 497 Christian counselors responded to an 88-item survey of their ethical beliefs and behaviors. Of the respondents, 148 reported a church as their primary work setting and 162 reported a private office as their primary work setting. Survey results were factor analyzed, then church-based therapists were compared with private office-based therapists regarding their views of ethical behaviors. Although church-based therapists take greater liberties with multiple-role relationships than private office-based therapists, they appear similar with regard to other ethical beliefs and behaviors. Results suggest that church-based therapists who take liberties in nonsexual multiple-role relationships are no more likely than other therapists to violate other ethical standards.     

REJOINDER TO AUSTIN, HUMPHREYS, AND HULIN: CRITICAL REANALYSIS OF BARRETT, CALDWELL, AND ALEXANDER

Austin, Humphreys, and Hulin (1989), in their critique of Barrett, Caldwell, and Alexander (1985), disagree with most of the critical comments made about the concept of dynamic criteria. We contend that the burden of proof still rests upon the advocate of a concept. Adequate evidence has not been presented to support the dynamic criteria concept, and Austin et al. (1989) add no new evidence. Austin et al. (1989) claim dynamic criteria can be described as a simplex with correlations decreasing over time. The empirical support for the simplex is based on a few studies with no statistical tests. Evidence from educational, organizational, and experimental psychology is reviewed, and much of it refutes the concept of a pervasive simplex pattern. There is considerable evidence that validity coefficients are stable or may even increase over time. More evidence is required before the Ghiselli and Haire (1960) and Austin et al. (1989) concept of dynamic criteria can be accepted.