THE IMPLICATIONS OF PROFESSIONAL AND LEGAL GUIDELINES FOR COURT DECISIONS INVOLVING CRITERION-RELATED VALIDITY: A REVIEW AND ANALYSIS

Title VII court cases litigated since 1978 were reviewed to assess the implications of the latest professional and legal guidelines for court deliberations regarding the criterion-related validity of paper-and-pencil tests with adverse impact. Major topics important to an understanding of predictor, criterion, procedural, data analysis, and interpretation issues were examined. Among the major findings were the heavy reliance placed on test development procedures and the reluctance of many judges to accept recent research findings, often contained in professional guidelines, which are inconsistent with those in the Uniform Guidelines on Employee Selection Procedures (1978). Suggestions are offered throughout to guide employers who are interested in successfully conducting or defending a criterion-related validation study.     

ITEM GENERATION PROCEDURES AND BACKGROUND DATA SCALES: IMPLICATIONS FOR CONSTRUCT AND CRITERION-RELATED VALIDITY

Background data measures are one of the best predictors of job performance. Nonetheless, questions have been raised about their content and construct validity. The present effort describes a set of procedures for developing construct and content valid background data items. Data gathered in seven field studies and six laboratory studies are presented bearing on the reliability and validity of the measures constructed using these item generation procedures. Findings in these studies indicate that construct-based item generation procedures yield reliable scales evidencing both content and construct validity. Furthermore, these scales are capable of predicting performance in a variety of settings. Theoretical and practical implications of these findings for the development and validation of background data measures are discussed.     

A FORMULA FOR THE USE OF SUPPRESSION VARIABLES IN CORRECTING INDIVIDUAL RATINGS

D unér , A. & M agnusson , D. A formula for the use of suppression variables in correcting individual ratings. Scand. J. Psychol , 1962, 3 , 226–232.—Ratings of aptitude, ability or performance used for selection and/or prediction or as criteria for the estimation of the validity of other methods are often influenced by irrelevant factors. Two correction formulas based on a suppression variable have been derived. The relation between the correlation formula derived and the partial correlation formula is discussed, as well as the effect of the application of the formula on the estimation of differential validity.     

INTERVIEWER VALIDITY AND RELIABILITY: AN INDIVIDUAL ANALYSIS APPROACH

Interviewer reliability, validity, and strategy for information integration were studied by analysis of data across interviewers and, also, by within, individual interviewer analysis. Candidates ( N = 412) for selection to a military division of a national defense organization were interviewed by 10 female interviewers and assessed on nine behaviorally anchored dimensions. Candidates ( N = 131) subsequently admitted to officers' training school were evaluated, for the purposes of this study, on 19 dimensions and on an overall evaluation taken at six and twelve week points. Results of analyses of data across interviewers indicated that interviewers functioned in a similar fashion, using few of the dimensions in their decisions whereas analyses of individual interviewers indicated higher reliability and individual differences among interviewers' strategy formation. Analysis across interviewers of the relationship of the interview decision to six and twelve week training performance evaluations indicated no validity for the interview decision. Analysis of individual interview strategies revealed differences among the interviewers only at the six week point. Results are discussed with regard to methodological problems, interview strategy differences, criteria dimensionality, fruitfulness of individual, within interviewer analyses, and purpose of the interview.     

BIODATA FAKING: EFFECTS OF INDUCED SUBTLETY AND POSITION SPECIFICITY

The fakability of an empirically keyed biographical inventory was studied in a three factor design. The factors were: 1. specificity of position applied for (sales representative versus a general managerial position, 2. induced subtlety of faking (warning of a lie scale versus no warning), and 3. sex of the respondent. Subjects were 91 male and 57 female college students who completed the biographical questionnaire under "fake" and "honest" response sets. Subjects were able to substantially improve their scores under faking instructions. Only the position specific-fake subtle condition failed to show improvement. Instructions indicating that a lie-detection scale might be used reduced faking to a considerable extent. Comparison with norms for the sales representative biographical key suggested that students in the faking condition tended to fake more than did a nation-wide sample of college recruits.     

THE EFFECTS OF INDIVIDUAL AND CONTEXTUAL ATTRIBUTES ON THE SIZES OF RECOMMENDED SALARY INCREASES

In a series of experiments, college students, line managers, and compensation managers allocated salary increases to hypothetical job holders who varied in the criticality of their positions for accomplishment of organizational goals, occupational marketability, job performance, personal need for money, and increase in capability since the last performance review. Results indicated that though performance had the largest impact, a number of nonperformance factors also influenced the recommendations. Salary recommendations were lower when constrained by a budget, and performance, growth in capabilities, marketability, and criticality were all significantly related to the magnitudes of suggested increases.     

STATUS AND ORGANIZATIONAL ENTRY: HOW ORGANIZATIONAL AND INDIVIDUAL STATUS AFFECT JUSTICE PERCEPTIONS OF HIRING SYSTEMS

Despite the fact that cognitive ability tests are highly predictive of job applicants’ future performance, these tests are often viewed as procedurally unfair by both hiring managers and job applicants. In this paper, we build on existing rationales by theorizing that status—both personal and organizational—may affect individuals’ procedural justice perceptions of selection tests. In 2 quasi‐experimental studies representing 435 managers and executives across both the United States and United Kingdom, we demonstrate that status is a double‐edged sword: helpful for high‐status organizations that use demanding selection tests to choose applicants but harmful because high‐status job applicants view these selection tests as more procedurally unjust than low‐status applicants.     

文化震荡及其对个体心理健康的影响

当前我国正在经历的急剧社会文化变迁对众多个体心理产生了强烈冲击,形成了文化震荡,并在不同程度上影响了其心理健康。研究表明,由于不同个体的经历和应付方式不同,其对文化震荡的承受能力也不同。因此,深入研究文化震荡的形成及其对不同个体的影响,充分挖掘各种文化有益于维护个体心理健康的宝贵遗产,建立个体心理健康防卫、救护机制和社会安定预警机制,是一项刻不容缓的紧迫任务。     

INDIVIDUAL AND SITUATIONAL INFLUENCES ON THE DEVELOPMENT OF SELF-EFFICACY: IMPLICATIONS FOR TRAINING EFFECTIVENESS

We proposed a model that included individual and situational antecedents of self-efficacy development during training. Initial performance and self-efficacy levels, achievement motivation, and choice were examined as individual variables. Constraints, operationalized at both the individual and aggregate levels of analysis, were examined as situational influences. Mid-course efficacy was hypothesized to have positive linear relationships with training reactions and subsequent performance, and an interactive relationship with performance when training reactions were considered as a moderator. Survey data were gathered at two points in time from 215 students enrolled in 15 eight-week long university bowling classes. All of the hypothesized antecedents of mid-course self-efficacy were significant except aggregate and individual situational constraints, although both constraints related negatively to training reactions. Time 2 self-efficacy exhibited significant positive influences on training reactions and subsequent performance, but the hypothesized moderated relationship was not supported.     

SEX DISCRIMINATION IN HIRING: THE INFLUENCE OF ORGANIZATIONAL CLIMATE AND NEED FOR APPROVAL ON DECISION MAKING BEHAVIOR

It was hypothesized that an organization's climate could inhibit or encourage discriminatory behavior, and that subjects' need for approval would interact with climate to influence their decisions. One hundred and sixty-one male business students read one of two sets of materials intended to manipulate company climate, and then evaluated a fictitious resume of a male or female applicant for a managerial position within the company. Decisions regarding hire, salary, applicant fit with the company, and anticipated longevity were dependent measures. The hypothesis regarding organizational climate received partial support. In a discriminatory climate women applicants were evaluated less favorably than men in terms of likelihood of hire and degree of fit between the applicant and the organization. Although not statistically significant, a similar pattern of results was obtained on the salary measure and on the measure of applicant predicted longevity. Contrary to expectations, approval motivation was not related to the dependent measures.     

MULTI-STAGE SELECTION STRATEGIES: A MONTE CARLO INVESTIGATION OF EFFECTS ON PERFORMANCE AND MINORITY HIRING

This study explores alternative selection strategies available when a firm has two valid predictors that differ in the magnitude of subgroup differences. We examine 14 different selection rules (e.g., select on a composite of the two predictors versus screen on the first and then select on the second versus screen on the first and then select on a composite of the two), and document through a Monte Carlo simulation that the various selection rules can produce markedly different consequences in terms of the level of job performance achieved and the level of minority representation achieved. The selection rules examined include the use of within-group norming, whichwas restricted by the Civil Rights Act of 1991, and the study examines how selection rules that do and do not include within-group norming fare in terms of the tradeoffs between performance and minority representation. The study shows that the preferred selection strategy will depend on the relative value the firm places on performance and on minority representation, and that the effects of different screen-then-select selection strategies vary as a result of the selection ratios at the screening and selection stages, thus precluding simple conclusions about the merits of each selection strategy.     

THE EFFECTS OF UNREPRESENTED STUDIES ON THE ROBUSTNESS OF VALIDITY GENERALIZATION RESULTS

Researchers conducting meta-analyses such as validity generalization can never be certain that their review contains all studies relevant to the research domain. Indeed, several authors in the past have noted ways in which research reviews may be systematically biased. A few techniques have emerged for addressing the issue of "missing studies" including the use of Rosenthal's (1979) file-drawer equation. Noting that Rosenthal's technique is inappropriate when applied to validity generalization findings, this paper develops a new method for assessing the vulnerability of validity generalization results to unrepresented or missing studies. The results of this new procedure are compared to the results of file-drawer analyses for 103 findings from validity generalization studies. We illustrate that this procedure more appropriately estimates the robustness of validity generalization results.     

个人和团体任务情境中不同心理卷入强度对个体决策行为的影响

使用被试间实验设计,分别研究了个体和团体两种不同的任务情境中,心理卷入强度高低对决策效果的影响。结果表明：（1）无论个体还是团体任务情境,不同的心理卷入度的决策者,决策结果差异显著;高心理卷入情境下,决策者的决策更为客观和公平。（2）团体任务高心理卷入情境下,学生对自己小组的评价和对其他小组的评价差异不显著。（3）团体任务情境中成员的决策结果比个体任务情境的更为客观。     

INDIVIDUAL DIFFERENCES IN INTERVIEWER RATINGS: THE IMPACT OF STANDARDIZATION, CONSENSUS DISCUSSION, AND SAMPLING ERROR ON THE VALIDITY OF A STRUCTURED INTERVIEW

This research investigated empirical issues regarding the validity of individual interviewers'( N = 62) ratings collected after a structured interview. Each interviewer rated an average of 25 interviewees. One hypothesis examined but not supported was that systematic interviewer errors will attenuate interview validity when data are aggregated across interviewers. Also investigated was the validity of ratings averaged across interviewers compared to consensus ratings; consensus ratings were shown to have significantly but probably not practically higher validities. Third, a meta-analysis of individual interviewer validities revealed that all of the variance in validities could be attributed to sampling error. Results and implications are discussed.     

RELATIONSHIPS BETWEEN GRADUATE TRAINING, PROFESSIONAL AFFILIATION, AND INDIVIDUAL PSYCHOLOGICAL ASSESSMENT PRACTICES FOR PERSONNEL DECISIONS

Survey data on 321 psychologists who conduct individual assessments were analyzed to compare practices and opinions of those with differing graduate training (I/O or non-I/O) and professional affiliation (SIOP or non-SIOP). Differences in practice on the basisof training and affiliation occur in licensing, types of assessments conducted, specific testing instruments used, and knowledge of legal guidelines governing selection practices. However, when purpose of assessment was controlled for by examining only managerial selection assessments, few practice differences related to training and affiliation emerged. Implications for the training of individual assessors are discussed, and several practice variations warranting further research are presented.     

ON THE MEANING AND VALIDITY OF TELEVISION VIEWING

The construct validity of “television viewing” is developed and explicated. It is suggested that while this concept is usually used as a strict behavioral variable, many different constructs are implied by it. The construct validity of television viewing can be derived from a conceptualization of what it is in television which, when viewed, or exposed to, interacts with human behavior and attributes. Four such conceptualizations are illustrated, each leading to a different construct of “viewing”: (1) television as a social-situational factor involving choice behavior between activities; (2) television as a transmission of a content repertoire, implying decision-making regarding messages; (3) television as a source of content-messages dealing with recall, comprehension, and attitude change; and (4) television as a “language” pertaining to the processes of encoding messages in the service of extracting knowledge.     

A TALE OF TWO JOB MARKETS: ORGANIZATIONAL SIZE AND ITS EFFECTS ON HIRING PRACTICES AND JOB SEARCH BEHAVIOR

Small firms employ half the U.S. private sector workforce, yet recruitment research has traditionally focused on large firms. The present study attempts to advance knowledge on how recruitment practices vary with firm size. Results suggest that the recruitment practices of larger firms are generally more formal and bureaucratic than those of smaller firms. In addition, the study demonstrates that many job seekers have distinct preferences regarding firm size, and that preferred firm size is related to job search behavior. Taken together, these findings suggest that firm size is an overlooked and important aspect of the recruitment/job search context. The processes involved in matching employers and applicants differ so much as a function of firm size that one might argue that large and small firms comprise separate labor markets.     

ANOTHER LOOK AT THE EFFECTS OF APPEARANCE, GENDER, AND JOB TYPE ON PERFORMANCE-BASED DECISIONS

The present study attempted to replicate and extend Heilman and Stopeck's (1985a) Lack of Fit Model. Using the Lack of Fit Model's proposal that attractiveness enhances perceived gender characteristics, we examined the effects of attractiveness and performance evaluations of persons in jobs rated as masculine, feminine, and neutral. Results were not consistent with the Model and did not replicate the results of the earlier study. Instead, attractiveness emerged as an asset regardless of job type or gender of employee. Attractive men and women were given higher overall ratings in all three jobs. In addition, attractive ratings were related to masculinity–femininity ratings. These findings are discussed in light of demographic and attitudinal changes in the workplace.     

EFFECTS OF ETHNICITY,ACCENT, AND JOB STATUS ON SELECTION DECISIONS

The present study investigated the effects of ethnicity, accent, and job status in the selection interview. Two hundred and ten student subjects viewed simulated, videotaped selection interviews in which applicant ethnicity, applicant accent, and job status were manipulated in a completely crossed 3 × 2 × 2 factorial design. Two sets of ratings were obtained, selection decision ratings of the job applicant, and subjective importance ratings based on the previous selection decisions. Significant main effects were obtained for ethnicity and job status in selection decision as predicted. Contrary to predictions however, the main effect for accent was not found significant. Further analysis of the importance ratings indicated a significant main effect for accent, but not for ethnicity. These findings indicated that applicant ethnicity and job status were important in selection interview decision and accent was not. Contrary to this however, subjects considered that accent was important in their selection decision ratings, while ethnicity was not.