Candidates' Ability to Identify Criteria in Nontransparent Selection Procedures: Evidence from an assessment center and a structured interview

In selection procedures like assessment centers (ACs) and structured interviews, candidates are often not informed about the targeted criteria. Previous studies have shown that candidates' ability to identify these criteria (ATIC) is related to their performance in the respective selection procedure. However, past research has studied ATIC in only one selection procedure at a time, even though it has been assumed that ATIC is consistent across situations, which is a prerequisite for ATIC to contribute to selection procedures' criterion‐related validity. In this study, 95 candidates participated in an AC and a structured interview. ATIC scores showed cross‐situational consistency across the two procedures and accounted for part of the relationship between performance in the selection procedures. Furthermore, ATIC scores in one procedure predicted performance in the other procedure even after controlling for cognitive ability. Implications and directions for future research are discussed.     

Are assessment center behaviors' meanings consistent across exercises? A measurement invariance approach

To examine the appropriateness of a Multi‐Trait–Multi‐Method framework for testing construct validity of Assessment Centers (ACs) and get practical implications for the improved AC design, degree to which the AC dimension‐related performance behaviors consistently manifest across multiple AC rating situations was investigated. The present study used a large sample (N = 5,006) to apply a measurement invariance analysis. AC rating situations generally produced consistent factor loadings for items on AC dimensions, item residuals, dimension factor variances, and covariance between dimensions. The AC rating situation of interview tended to produce higher ratings and less item residuals. These findings support the consistency in constructs assessed across different AC rating situations, while some exercises may be better for teasing apart particular dimensions than others.     

Expectations of consistency about the self: Consequences for self-concept formation

This study proposes that the on-line versus memory-based judgment distinction has important implications for understanding self-concept formation and content. Past research has shown that perceivers form on-line judgments of targets who are expected to display a great deal of behavioral consistency (e.g., individuals) but form memory-based judgments of targets who are expected to display less behavioral consistency (e.g., groups). Experiment 1 found that perceptions of behavioral consistency for the self were strong and closer to perceptions of consistency for individuals than for groups. Thus, we predicted that self-concepts should, by default, be formed on-line. Experiment 2 supported this prediction. Experiment 3 manipulated participants’ expectations of behavior consistency and found that those expecting greater consistency in their behaviors formed on-line self-concepts. Experiment 4 used a different methodology and behavioral domain, and it collected more direct process data that further supported the importance of the on-line versus memory-based distinction for the self. Implications for understanding self-concepts and for comparing self-knowledge to how people understand other types of social entities are discussed.     

Chronic self-destructiveness: Conceptualization,measurement, and initial validation of the construct

Individual differences in various behaviors suggest that those who are primarily motivated by current emotional factors are more likely than those motivated by more distant cognitive considerations to engage in acts that are ultimately self-destructive. To assess and explore these behavioral differences, 12 samples of undergraduate subjects, totaling 864 (527 females, 337 males), a group of 15 businesswomen, and 111 male VA patients were used to develop a measure of this construct in a series of reliability and construct validity studies. By means of internal-consistency item analyses, two cross-validated 52-item measures of chronic self-destructiveness were constructed for males and females. Reliability was established with respect to internal consistency (alpha coefficients range from .73 to .97) and temporal consistency over a 1-month period (test-retest correlations range from .90 to .98). There is a slight drop in chronic self-destructiveness scores across age groups. Test scores were found to be positively related to external locus of control, negatively related to Type A coronary-prone behavior, and unrelated to either social desirability response set or need for achievement. Individuals high in chronic self-destructiveness, compared to those with low scores, are more likely to be in treatment for drug or alcohol abuse, to report having cheated in courses, to have had traffic violations, to report having gone through a rebellious stage in adolescence, and to postpone obtaining a medical test for cancer. Chronic self-destructiveness appears to be a personality dimension that affects behavior across a wide range of ages and situations.We wish to thank John Wapner for his assistance in obtaining data in the clinical sample.     

Appearing truthful generalizes across different deception situations

The authors investigated whether the ability to appear truthful is specific to deception situations. Male participants were interrogated after they took part in 2 high-stake deception situations, one involving a mock crime and another involving a false opinion. The videotaped interrogations from each situation were shown to independent groups of undergraduate observers. The proportion of observers who judged each participant as truthful in one situation correlated highly with the proportion of observers who judged the same participant as truthful in the other situation. This was not correlated with physiognomy judgments. Follow-up studies revealed that although the participants showed consistency in their facial, body, and paralinguistic behaviors across situations, observers' judgments seemed to be driven only by the consistency of the dynamic facial behaviors. These results are discussed in terms of the evolutionary importance of the face in communication.     

The more the better – But more of which? Information quantity and shared meaning as predictors of consistency and accuracy in person judgment

This study investigates the consistency and accuracy of person judgments at zero acquaintance in two conditions: Targets were judged repeatedly across a sequence of videotaped situations, either (a) by different observers in each situation, or (b) by the same observer in all situations. Replicating previous research, accuracy increased (inversely accelerated) when including additional situations rated by different observers. However, much of this increase was owed to improved inter-rater reliability (a confound in previous research). Also, cross-situational consistency of judgments was much higher when all ratings came from the same observer. These results underscore the crucial influence of shared meaning on judgment accuracy and consistency.     

Competitiveness and the Similarity of Preferred Coworkers1

The study investigated effects of different work contexts on the individual's desire to work with a similar or dissimilar coworker. Business students (N= 536) were assigned to 1 of 3 conditions (competitive task, skill‐development task, and nonspecific task) and were asked to describe their preferred coworker for that task. Individuals were expected to prefer coworkers whom they perceived as similar in noncompetitive situations, but those whom they perceived as dissimilar in competitive situations. Further, it was hypothesized that the type of similarity emphasized (skills, personal values, and personal style) would reflect the type of anticipated interaction. As expected, participants in competitive conditions chose coworkers with lower skills and generally dissimilar values and personal style. Coworkers selected for the skill‐development condition possessed similar skills and were more similar in values.     

Personality,Autonomy, and Contextual Performance of Managers

This study contributes to research on assessment centers' (AC) external construct-related validity by investigating a potential moderator of the relationship between personality and AC dimension ratings. On the basis of recent insights in person-situation contingencies we hypothesized that individual differences in people's perception of situational demands moderate the relationship between personality and conceptually related AC dimension ratings. The hypotheses were tested with 108 individuals in two leaderless group discussion exercises. Results confirmed the hypotheses for two of the three traits (i.e., Agreeableness and Conscientiousness). In particular, people high on these traits who identified the situational demands received higher AC dimension ratings. People high on these traits who did not identify the situational demands received lower AC dimension ratings.     

Group entitativity and group perception: associations between physical features and psychological judgment

Two experiments tested whether the perceived entitativity of groups (i.e., cohesiveness) influences judgments about those groups, in terms of both their observable physical properties and underlying psychological traits. Entitativity was manipulated with groups whose members were similar or dissimilar in skin color. Experiment 1 demonstrated that beliefs about entitativity elicited more accurate judgments of skin color for entitative than nonentitative social groups, although memory for individual members of entitative groups was relatively impoverished. Experiment 2 revealed that entitative groups were viewed as not only physically similar but also psychologically homogeneous and elicited strong negative trait and behavioral judgments. Together, these findings suggest that physical properties (e.g., similarity) can create perceptions of psychological "groupness" that have important consequences for group perception.     

Constructs and developmental assessment centers: Further troubling empirical findings

Research indicates that assessment center (AC) ratings typically demonstrate poor construct validity; that is, they do not measure the intended dimensions of managerial performance (e.g., Sackett & Harris, 1988). The purpose of this study was to investigate the construct validity of dimension ratings from a developmental assessment center (N=102), using multitrait-multimethod analysis and factor analysis. The relationships between AC ratings, job performance ratings, and personality measures also were investigated. Results indicate that the AC ratings failed to demonstrate construct validity. The ratings did not show the expected relationships with the job performance and personality measures. Additionally, the factors underlying these ratings were found to be the AC exercises, rather than the managerial dimensions as expected. Potentially, this lack of construct validity of the dimension ratings is a serious problem for a developmental assessment center. There is little evidence that the managerial weaknesses identified by the AC are the dimensions that actually need to be improved on the job. Methods are discussed for improving the construct validity of AC ratings, for example, by decreasing the cognitive demands on the assessors.This study is based on a dissertation submitted to North Carolina State University. Portions of this paper were presented at the meeting of the Society for Industrial and Organizational Psychology in Montreal, Quebec, May, 1992. I am grateful to Paul Thayer, Bert Westbrook, James W. Cunningham, and Patrick Hauenstein for their contributions to this research. I also thank several anonymous reviewers for their comments on this article.     

Variations in Level of Moral Judgment as a Function of Type of Dilemma and Moral Choice

This study compares the predictive power of two models of moral judgment: (a) Kohlberg's model, which predicts stage consistency across varying content, and (b) a model that predicts variations in stage as a function of complex interactions between people and social contexts. Forty university students were asked to make and justify choices on three moral dilemmas—a dilemma involving the sale of defective merchandise (selling dilemma) and two dilemmas from Kohlberg's test of moral judgment. Half the participants made hypothetical choices on the selling dilemma; the other half were offered a selfish incentive—money—for concealing the defects in the merchandise. In support of the interactional model, (a) participants scored lower on the selling dilemma than on Kohlberg's test, (b) the monetary incentive affected moral choices, (c) participants justified the choice to conceal defects in the merchandise with significantly lower stage moral judgments than they invoked in support of the decision to disclose its defects, and (d) participants who upheld the choice to disclose supported it with higher stage justifications than those who rejected it. Surprisingly, however, participants who stood to make money disclosed more about the defects in the article and charged less than participants who did not.     

EXERCISES AND DIMENSIONS ARE THE CURRENCY OF ASSESSMENT CENTERS

A novel assessment center (AC) structure that models broad dimension factors, exercise factors, and a general performance factor is proposed and supported in 4 independent samples of AC ratings. Consistent with prior research, the variance attributable to dimension and exercise factors varied widely across ACs. To investigate the construct validity of these empirically supported components of AC ratings, the nomological network of broad dimensions, exercises, and general performance was examined. Results supported the criterion‐related validity of broad dimensions and exercises as predictors of effectiveness and success criteria as well as the incremental validity of broad dimensions beyond exercises and general performance. Finally, the relationships between individual differences and AC factors supported the construct validity of broad dimension factors and provide initial insight as to the meaning of exercise specific variance and general AC performance.     

Alternate Approaches to Understanding the Psychometric Properties of Assessment Centers: An analysis of the structure and equivalence of exercise ratings

The present study uses an alternate analytical framework to examine the degree to which performance is differentiated by dimensions in assessment center (AC) exercises and whether these performance dimensions are rated on the same scale across exercises. Confirmatory factor analysis likelihood ratio tests supported the presence of three broad latent performance dimensions in each of three AC exercises. Additional tests revealed that five of six manifest performance dimensions were rated on the same psychological scale across exercises. Taken together, our results support a multidimensional interpretation of AC exercises and provide empirical support to the notion that differences in AC performance across exercises reflect true performance, rather than a measurement artifact.     

FATHER–CHILD PLAY DURING THE PRESCHOOL YEARS AND CHILD INTERNALIZING BEHAVIORS: BETWEEN ROBUSTNESS AND VULNERABILITY

Play observations with a total of 400 toddlers and preschoolers were videotaped and rated for Intensity and Quality of play with their parents. Parents were asked about perceived stress and personality characteristics (Big 5). Child's motor, cognitive skills, temperament, and internalizing behaviors were assessed. Study 1 investigated the robustness of play across child age and gender, and examined differences between fathers and mothers. Study 2 explored the vulnerability of play with fathers of children born preterm (PT‐fathers) and fathers who had experienced adverse childhoods (AC‐fathers). Study 3 investigated child internalizing behaviors. Intensity of play was maintained almost independently of child age and gender. It was similar for AC‐ and PT‐fathers, and similar to maternal Intensity. In contrast, paternal Quality of play was higher with boys and independent of fathers’ personality and perceived parenting stress whereas maternal Quality of play was higher with girls and linked to mothers’ perceived parenting competence, acceptability of the child, and neuroticism. AC‐fathers scored significantly low on Quality, as did PT‐fathers, but the Quality of their play became better with growing child age, birth weight, and cognitive (but not motor and temperament) scores. Finally, child internalizing behaviors were negatively related to paternal Quality of play.     

Do Assessors Have Too Much on their Plates? The Effects of Simultaneously Rating Multiple Assessment Center Candidates on Rating Quality

It has been suggested that the large cognitive demands during the observation of assessment center (AC) participants can impair the quality of the assessors' ratings. An aspect that is especially relevant in this regard is the number of candidates that assessors have to observe simultaneously during group discussions, which are one of the most commonly used AC exercises. The present research evaluated potential impairments of the quality of the assessors' ratings (construct‐ and criterion‐related validity and rating accuracy) related to the number of to‐be‐observed candidates. Study 1 (N=1046) was a quasi‐experimental field study and Study 2 (N=71) was an experimental laboratory study. Both studies found significant impairments of assessors' rating quality when a larger in comparison to a lower number of candidates had to be observed simultaneously. These results suggest that assessors should not have to observe too many candidates at the same time during AC group discussions.     

评价中心的构想效度和结构模型

采用多质多法和验证性因素分析的方法,对以无领导小组讨论、文件筐和人格测验构成的一个评价中心的构想效度和结构模型进行了研究。通过对136名被试在四个测评维度上的施测,其结果表明,在评价中心中会聚效度低于区分效度,影响评价中心测评结果的主要因素是测评方法而不是测评维度,从而得到了一个以测评方法为潜变量的评价中心结构模型。从该结构模型来看,评价中心之所以起作用是由于其多个测评方法(情景)的结果。表明测评情景对于构建评价中心有着至关重要的作用。     

Consistency in catecholamine excretion in laboratory and natural settings: correlational and variance components analyses

Data from 20 healthy male subjects were used to evaluate the consistency in catecholamine excretion in both laboratory and natural situations during approximately a 48-hr period. Correlational analyses showed high interindividual consistency in adrenaline excretion under laboratory conditions regardless of degree and kind of activity and of the interval at which measures were taken. In non-standardized natural situations the consistency was low. For nor adrenaline the pattern was less regular. Analysis of variance components showed that absolute consistency was high in both amines in situations with similar activity content and low activity level. It was found that the more similar the situations the more of variation in catecholamine excretion was due to interindividual differences and the more dissimilar the situations the more of the variation was due to interaction. It is concluded that the degree of consistency in catecholamine excretion varies with situational characteristics.     

Self-Esteem in Children as a Function of Perceived Parental Behavior

Shortened versions of Coopersmith's Self-Esteem Inventory, SEI (Coopersmith, 1967) and Schaefer's Children's Report of Parental Behavior Inventory, CRPBI (Schaefer, 1965a, 1965b) were administered to 126 fifth- and sixthgrade children. The mean levels of SEI and CRPBI scores for both parents were similar, as were the patterns of intercorrelations among these variables. A multiple regression analysis confirmed a similar pattern of CRPBI predictors to the SEI for both boys and girls, with Acceptance and granting of psychological autonomy (Control) being the key predictors. An analysis of combined perceptions suggested that boys who perceived both parents as high in acceptance had significantly higher SEI scores than those who perceived both parents as low in acceptance. Boys who perceived both parents as lax in discipline had higher SEI scores than those reporting firm discipline. In contrast, the Control factor was significant for girls but not for boys. Girls who perceived both parents as high in granting psychological autonomy scored significantly higher on the SEI than those reporting both parents as low on this factor.     

Minority children's intergroup attitudes about peer relationships

Intergroup attitudes were assessed in African‐American (N=70) and non‐African‐American minority (N=80) children, evenly divided by gender, in first (M=6.5 years old) and fourth (M=9.6 years old) grades attending mixed‐ethnicity public schools in a suburban area of a large mid‐Atlantic city in the USA. Children were interviewed to test hypotheses about implicit racial biases, perceptions of similarity between peer dyads, and judgments about cross‐race friendships. Implicit racial biases emerged when children evaluated ambiguous picture cards, with children viewing a White child as more likely to be a transgressor than a Black child in certain situations. There were no racial biases when evaluating potential cross‐race friendship (it was judged to be feasible); nor was there any evidence of an outgroup homogeneity effect. Children who used ethnicity as a reason for judging peers to be similar, however, were less likely to judge that the cross‐race dyads could be friends. The findings indicate the ways in which minority children's judgments about the majority and their perceptions of similarity between peer dyads influence their interpretations of peer interactions.