Predicting Training and Job Performance for Transit Operators

Although considerable meta‐analytic research has validated the use of cognitive ability tests, structured interviews, and personality tests with training and job performance criteria, few studies have investigated the validity of these measures with transit operators. There are the only two single studies of concurrent validation research specifically with transit operators. This article presents the results of a predictive validation study conducted with transit operator applicants for a large urban transit authority in Canada. Key knowledge, skills, and abilities were determined for the role and used as a basis for the design and choice of predictors and criteria. Four predictors were used in the study: education, cognitive ability, personality assessment, and structured interview. Criteria included training performance (formative and summative), probationary performance, preventable accidents, and lost time injuries. Validation results supported cognitive ability, structured interview, and several personality factors as predictors of training performance, but less so for job performance. The use of formative training ratings greatly augmented the evidence supporting the predictors beyond typical organizational criteria.     

PROJECT A VALIDITY RESULTS: THE RELATIONSHIP BETWEEN PREDICTOR AND CRITERION DOMAINS

A predictor battery of cognitive ability, perceptual-psychomotor ability, temperament/personality, interest, and job outcome preference measures was administered to enlisted soldiers in nine Army jobs. These measures were summarized in terms of 24 composite scores. The relationships between the predictor composite scores and five components of job performance were analyzed. Scores from the cognitive and perceptual-psychomotor ability tests provided the best prediction of job-specific and general task proficiency, while the temperament/personality composites were the best predictors of giving extra effort, supporting peers, and exhibiting personal discipline. Composite scores derived from the interest inventory were correlated more highly with task proficiency than with demonstrating effort and peer support. In particular, vocational interests were among the best predictors of task proficiency in combat jobs. The results suggest that the Army can improve the prediction of job performance by adding non-cognitive predictors to its present battery of predictor tests.     

Does interview anxiety predict job performance and does it influence the predictive validity of interviews?

Interview anxiety is negatively related to interview performance; however, its relation to job performance is unknown. It could correlate negatively with job performance, and it could moderate the interview performance–job performance relation. In a sample of applicants for Residence Assistant positions, interview anxiety had near‐zero correlations with job performance, rated by supervisors and supervisees. It moderated the relation between interview performance and supervisor‐rated facilitating peer and team performance, such that interview performance did not predict this job performance component for anxious applicants. The moderation was not found for supervisor‐rated task proficiency, or for supervisee ratings of either job performance component, suggesting that the impact of interview anxiety depends on rater source and which job performance component is rated.     

Shall we continue or stop disapproving of self-presentation? Evidence on impression management and faking in a selection context and their relation to job performance

The self-presentation tactics of candidates during job interviews and on personality inventories have been a focal topic in selection research. The current study investigated self-presentation across these two selection devices. Specifically, we examined whether candidates who use impression management (IM) tactics during an interview show more faking on a personality inventory and whether the relation to job performance is similar for both forms of self-presentation. Data were collected in a simulated selection process with an interview under applicant conditions and a personality inventory that was administered under applicant conditions and thereafter for research purposes. Because all participants were employed, we were also able to collect job performance ratings from their supervisors. Candidates who used IM in the interview also showed more faking in a personality inventory. Importantly, faking was positively related to supervisors’ job performance ratings, but IM was unrelated. Hence, this study gives rise to arguments for a more balanced view of self-presentation.     

Evidence of Predictive and Incremental Validity of Personality Factors,Vocal Attractiveness and the Situational Interview

This study evaluates the impact of the situational interview, personality measures, vocal attractiveness, and interactions between personality and vocal attractiveness on job performance. In a concurrent validity study with 154 customer service employees, a structured, situational interview was conducted and three of the Big Five personality factors (agreeableness, conscientiousness, and extraversion) are measured with two different frames‐of‐reference: at‐work and typical. Among the results are the validity of the situational interview and at‐work personality measures is established; vocal attractiveness correlates with both interview ratings and job performance; and finally, agreeableness and conscientiousness are found to vary in a pattern related to levels of vocal attractiveness such that both personality factors predict performance more strongly for people with more attractive voices.     

Selection Practices in Canadian Firms: An empirical investigation

Using 7 years of data from Statistics Canada's Workplace and Employee Survey, this study examined the types of selection tools used with 23,639 employees in 6,693 Canadian firms. While 79% of these employees were given an interview during the selection process, only 10% were given a test on job‐related knowledge and 9% were given a personality test. Using logit analysis, job‐ and organization‐level variables were examined as predictors of the type of selection tools used. The size of the organization, an in‐house human resource department, the presence of a union and occupation were significant predictors of the use of a test on job‐related knowledge in the selection process. The implications and plausible explanations of this theory to practice gap are discussed.     

Predicting Performance with Contextualized Inventories,No Frame‐of‐reference Effect?

A recent meta‐analysis showed that contextualized personality inventories have incremental predictive validity over generic personality inventories when predicting job performance. This study aimed to investigate the differences between two types of contextualization of items: Adding an ‘at work’ tag versus completely modifying items. One hundred thirty‐nine pharmacy assistants from 29 pharmacies filled out a generic, a tagged, and a completely modified personality inventory. The assistants also provided participant reactions for each of the personality inventories. Performance ratings were collected from the supervising pharmacists. We expected to find incremental criterion validity for both the tagged inventory and the completely modified inventory for predicting job performance. However, the results showed an unexpected decrease in predictive validity for the contextualized inventories. Contextualized inventories were liked less than the generic inventory, but were considered somewhat more face valid and predictive by the participants.     

“Dark Side” Personality Styles as Predictors of Task,Contextual, and Job Performance

Many meta‐analyses and hundreds of primary studies have been carried out on the criterion‐oriented validity of personality measures for predicting job performance. The Five‐Factor Model of personality has been used as a frame for analyzing the empirical evidence. However, the research in industrial, work and organizational psychology has not examined the relationship between the dysfunctional tendencies of personality and the personality disorders as described in DSM‐IV (Axis II) Diagnostic and Statistical Manual of Mental Disorders and job performance. The present paper examines the relationship between job performance and the dysfunctional personality styles included in a non‐clinical personality inventory developed to assess personality tendencies related to the dysfunctional (normal) personality styles and the personality disorders in work settings. This inventory assesses 14 dysfunctional personality styles and was given to a sample of 85 applicants. The job performance was rated by the direct supervisor 8 months later, and three measures were obtained: task performance, contextual performance, and overall job performance. The results showed that the seven dysfunctional personality styles (suspicious, shy, sad, pessimistic, sufferer, eccentric, and risky) predicted the three measures of job performance. The egocentric personality style negatively predicted contextual performance. Finally, the submitted style predicted task performance. With the exception of the risky personality style, the rest of the styles mainly consisted of Neuroticism. Implications for the research and practice of personnel selection are discussed.     

Assessing preferred work among adults with autism beginning supported jobs: identification of constant and alternating task preferences

We evaluated a multiple‐stimulus assessment for identifying work preferences among adults with autism prior to beginning supported jobs. Initially, a prework assessment focused on identifying preferences across different work tasks. Eight preference assessments involving office‐cleaning tasks were conducted with five supported workers. Results of five assessments involving three individuals indicated respective workers had a strong preference for one work task. On three assessments involving three workers and different cleaning tasks, weak preferences for given tasks were identified. Next, choices between more‐ and less‐preferred tasks were provided during the daily job routine. Workers who had a strong preference on the prework assessment consistently chose the previously assessed, more preferred task during the daily job. Workers who had a weak preference always chose the more preferred task on the first choice of the work day, and then alternated between tasks on 71% of subsequent choice opportunities. Results appear to support the utility of the prework, multiple‐stimulus assessment for predicting preferred tasks among supported workers with autism when the assessment identifies strong preferences. Results also offer some support for predicting a preference to alternate tasks when the assessment identifies weak preferences for respective work tasks. Implications of the results are discussed in terms of developing work routines within community jobs for adults with autism that are more in accordance with their work preferences than traditional job placement practices. Copyright © 2003 John Wiley & Sons, Ltd.     

Age Discrimination in the Evaluation of Job Applicants

This study investigated the nature of age discrimination against older job applicants. One hundred fifty‐six participants (102 students; 54 organization based) evaluated a hypothetical job applicant's (aged 33–66 years) work‐related competences and likelihood of being hired. Applicant age affected hiring decisions for both samples where there was a preference for hiring applicants aged 42–48 years. Applicants at both the older and younger ends of the continuum were less likely to be hired, with the oldest applicants (over 54 years) being the least likely to be hired. Although the applicants' age negatively affected evaluations of their trainability and sociability, the effect of applicant age on hiring evaluations was not mediated by these work‐related competencies, suggesting that age discrimination occurs via direct bias against older workers.     

Why Don't You Just Show Me? Performance interviews for skill‐based promotions

Despite the high skill levels needed to cope with complex technical systems and the pace of technological change, there remain persistent skill gaps in the United States workforce. Organizations are increasingly relying on skill‐based programs to encourage and foster employee skill development. Unfortunately, many questions remain about how to make skill‐based promotions. Drawing from research on performance testing and structured interviewing, as well as work that examines broader issues of performance prediction and candidate reactions, we outline the development and empirical test of a performance interview that can be used for skill‐based promotions. Such interviews allow employees to demonstrate their skills on the job, and thus may be more accepted by employees. We first discuss seven design principles that form the conceptual foundation for the performance interview, followed by the specific steps practitioners can follow to develop a performance interview. Finally, using a sample of 230 auto parts manufacturing employees, we provide empirical evidence for the high reliability, validity, and positive candidate reactions to the performance interview.     

The validity of the Big Five personality traits for job performance: Meta‐analyses of South African studies

Previous meta‐analyses have established the Big Five personality traits as important predictors of job performance around the globe. This study extends the international generalizability of Big Five criterion‐related validity through systematic review and meta‐analyses of personality–performance research conducted in South Africa. We meta‐analyzed data from 33 studies and 6,782 individuals to estimate validities of Big Five traits for various job performance criteria. Results showed that the Big Five traits have similar validity for job performance criteria as found in other cultural contexts. Conscientiousness was the strongest predictor across performance criteria, while other traits showed validity for specific criteria or subsamples. Results demonstrate the importance of psychometric meta‐analysis for building cumulative knowledge and support applied use of personality assessments in South Africa. Consistency of the results of this study with those of previous meta‐analyses in other national contexts supports the argument that personality–performance relations are a cultural universal.     

What do People Want from their Jobs? The Big Five,core self‐evaluations and work motivation

If people are differentially motivated on the basis of individual differences, this implies important practical consequences with respect to staffing decisions and the selection of the right motivational techniques for managers. In two different samples (students facing graduation vs full‐time employees), the relationships between personality traits and the preference for job characteristics concerning either extrinsic (job environment) or intrinsic job features (work itself) were investigated. Two personality traits [openness to experience and core self‐evaluations (CSE)] were consistently found to be positively related to the preference concerning work characteristics, and CSE showed incremental validity with regard to intrinsic work motivation factors (e.g., experienced meaningfulness, autonomy). Furthermore, age was differentially linked to those job characteristics. The results are discussed with regards to the optimal Person–Job Fit and the practical utility of the personality constructs.     

The interaction between leader–member exchange and perceived job security in predicting employee altruism and work performance

This study investigated the relationships among leader–member exchange (LMX), perceived job security, and employee performance. Drawing on the job demands–resources model and conservation of resources theory, we expected both LMX and perceived job security would affect employee altruism and work performance in a positive manner. In addition, LMX and perceived job security were expected to interact to predict the two outcome variables. The hypotheses were tested with a sample of 184 employees in a state‐owned enterprise in China. Our results showed that LMX, but not perceived job security, was positively related to employee altruism and work performance. Additionally, the effect of LMX on altruism was stronger for employees perceiving less job security. The findings indicated that LMX as a job resource becomes more impactful to altruistic performance when employees feel less secure at work.     

A component analysis of job interview training for young adults with autism spectrum disorder

The job interview is a vital component to acquire employment. Individuals with autism spectrum disorder may experience difficulties with job interviews due to notable deficits in social and communication skills. We evaluated the relative impact of several components of a job interview training package on six participants' responses to commonly asked interview questions. We used a multiple baseline design across participants to present the following components: written instructions, rehearsal and video self‐feedback with a commercially available training program, and verbal feedback delivered by the experimenter. Results demonstrated that all participants required an additional behavioral skills training session to meet our mastery criterion. However, once training was complete, all participants showed generalized performance when the interview questions were presented in a varied format and by a novel interviewer outside of the training environment. In addition, their performance was maintained at follow‐up.     

COMBINING BIODATA TEST AND INTERVIEW INFORMATION: PREDICTING DECISIONS AND PERFORMANCE CRITERIA

An important question in real world selection situations is: How do interviewers integrate employment test scores and interview information in making selection decisions? The present study expands on previous research by examining how valid biodata test scores and interview information interact in the prediction of actual interviewer selection decisions and actual job performance criteria for hired candidates. The sample for the study was 577 actual candidates for the position of life insurance sales agent evaluated by insurance agency managers from a single company. The results indicated the presence of interaction effects in predicting both the interviewers' decision and 12-month survival. The interview information predicted the decision and survival best for candidates with low passing scores on the biodata test and poorest for candidates with high passing scores. The results clarify the conditions under which interview information is most predictive of job performance criteria.     

A meta‐analysis of the predictors and consequences of organization‐based self‐esteem

Organization‐based self‐esteem (OBSE), which represents employees' beliefs about their own value and competence as organizational members, has attracted much recent research attention. In the current paper, we identified several theoretically based predictors and consequences of OBSE. We then conducted a meta‐analysis examining the relationships between OBSE and these variables. Results indicated that several hypothesized predictors, including the work environment and employee dispositions, were related to OBSE. Furthermore, OBSE was related to several hypothesized outcome variables including job satisfaction, organizational commitment, employee health, job performance, and organizational citizenship behaviour. As expected, OBSE generally yielded stronger relationships with work‐related variables than did general self‐esteem and we found evidence that OBSE mediated the relationships between general self‐esteem and work‐related criteria.     

Using the BIDR to Distinguish the Effects of Impression Management and Self‐Deception on the Criterion Validity of Personality Measures: A Meta‐Analysis

Although the use of personality tests for personnel selection has gained increasing acceptance, researchers have raised concerns that job applicants may distort their responses to inflate their scores. In the present meta‐analysis, we examined the effects of the two dimensions of social desirability, impression management and self‐deception, on the criterion validity of personality constructs using the balanced inventory of desirable responding (BIDR). The results indicate that impression management and self‐deception did not create spurious effects on the relationship between personality measures and performance, nor did they function as performance predictors. Moreover, removing the influence of impression management or self‐deception from personality measures did not substantially attenuate the criterion validity of personality variables. Implications of the results and directions for future research are also discussed.     

Social intelligence and interview accuracy: Individual differences in the ability to construct interviews and rate accurately

This research examined differences in interviewers’ ability to identify effective interview questions and to accurately rate interviewees’ responses. Given the theoretical association between these interview activities and the construct of social intelligence (SI), a performance‐based measure of SI was developed utilizing situational judgment test methodology. The initial step was to examine evidence of the psychometric properties and construct validity of the new SI measure. The SI measure, a test of general mental ability (GMA), and a personality inventory were then used to examine aspects of rater performance. Participants chose a set of interview questions and viewed interviewee responses during a videotaped interview. Results showed that people higher in SI and GMA chose interview questions judged by experts to be superior and were more accurate in rating interviewee responses. The SI measure explained variance beyond GMA and outperformed a trait‐based SI measure. Implications for the selection and training of interviewers are discussed.     

The Impact of Contextual Self‐Ratings and Observer Ratings of Personality on the Personality–Performance Relationship1

This study examined 2 possible ways of increasing the predictive validity of personality measures: using observer (i.e., supervisor and coworker) ratings and work‐specific self‐ratings of Big Five personality factors. Results indicated that among general self‐ratings of Big Five personality dimensions, Conscientiousness was the best predictor of in‐role performance, and Agreeableness and Emotional Stability were the best predictors of organizational citizenship behavior (OCB). Observer ratings of personality accounted for incremental variance in job performance (in‐role performance and OCB) beyond that accounted for by general self‐ratings. However, contrary to our expectations, work‐specific (i.e., contextual) self‐ratings of personality generally did not account for incremental variance in job performance beyond that accounted for by general self‐ratings.