Safety Climate Measurement: an Empirical Test of Context-Specific vs. General Assessments

Purpose

Safety climate researchers develop and use both general and industry-specific safety climate measures. Theories about language comprehension suggest that context facilitates meaning; however, the relative value of context-specific safety climate measures in the prediction of safety outcomes is an empirical question that has not been rigorously tested. The purpose of the present study was to provide a rigorous comparison of context-specific vs. general safety climate measures.

Design/Methodology/Approach

Seven hundred forty-six university laboratory personnel from five different kinds of research labs (i.e., animal biological, biological, chemical, human subjects/computer, or mechanical/electrical) completed contextualized safety climate measures, a general safety climate measure, and measures of other safety-related constructs.

Findings

Measurement equivalence analyses indicated that the general safety climate measure was not equivalent across the five lab types. Hypothesis testing revealed that contextualized information was most helpful when included in safety climate measures for less, rather than more, safety-salient contexts, but overall, there was relatively little difference in the validities for general and context-specific measures.

Implications

Results suggest that context has a small influence on how individuals respond to safety climate measures and provide guidance for researchers/practitioners when deciding between using industry-specific or general safety climate measures. It appears most beneficial to use industry-specific measures when examining safety climate in a less-safety-salient context.

Originality/Value

This study offers one of the first empirical tests of a contextualized safety climate measure involving a rigorous, unconfounded comparison of five context-specific safety climate measures with a general measure.

     

Running on Empty: The Effects of Aggregate Travel Stress on Team Performance

Purpose

In this study, we explore the effects of travel on performance at the team level using conservation of resources (COR) theory as an explanatory mechanism. We investigate the effects of aggregate travel stress, which we define as the accumulated strain experienced by a team when traveling, on key components of team functioning and performance including team task performance, team concentration level, and counterproductive work behaviors (CWB).

Design/Methodology/Approach

We analyze 3054 games played in the National Football League across six seasons using multilevel structural equation modeling. Replicating our findings, we also analyzed an additional 11,802 games played in the National Basketball Association across five seasons.

Findings

Aggregate travel stress, as a latent construct, negatively impacts team task performance and team concentration level. Team concentration partially mediates the relationship between aggregate travel stress and CWB.

Implications

Findings suggest that travel has a deleterious effect on various forms of team functioning and performance. As a result, organizations and leaders need to be aware of the potential side effects of travel, and researchers need to further incorporate travel into models and examinations of workplace stress.

Originality/Value

This is the first study to provide a theoretically driven investigation of the effects of business travel on team outcomes and to apply COR theory to team-level phenomena. Results put forth offer a more nuanced understanding of the effects of travel as well as open up new avenues of exploration for COR theory.

     

Humor in Teams: Multilevel Relationships Between Humor Climate,Inclusion, Trust,and Citizenship Behaviors

Purpose

This study examines the cross-level influence of positive and offensive leader humor climates on employee inclusion and citizenship behaviors, and the moderating effect of trust in such relationships.

Design/Methodology/Approach

We collected data from a sample of 225 respondents nested within 23 teams from a Canadian financial organization. A multilevel confirmatory analysis was used to provide evidence that variables of this study are distinct and a HLM analysis to test the hypotheses.

Findings

We find that employees’ perception of inclusion is influenced much more by an offensive humor climate than by a positive one. The results also suggest that the perception of inclusion plays a significant intermediary role in the influence of humor climates on citizenship behavior. Finally, trust in leaders acts as an important contingent condition in the effectiveness of a humor climate.

Implications

Use of humor does not always pay. Offensive humor by supervisor is a risky strategy that may undermine the beneficial effects of positive humor climate, increase employee exclusion and weaker individual performance.

Originality/Value

Our study shows the utility of using micro- and macro-approaches, and more specifically, the relevance of adopting an integrative multilevel view of the effect of a humor environment in predicting individual inclusion and citizenship behaviors.

     

Differences in the Valuing of Power Among Team Members: a Contingency Approach Toward Examining the Effects of Power Values Diversity and Relationship Conflict

Purpose

The purpose of this study was to investigate the conditional effects of power values diversity and relationship conflict.

Design/Methodology/Approach

We utilized a time-lagged survey design and multilevel modeling to investigate 60 teams working on a project task over the course of 4 months.

Findings

When participative safety climate was high, the presence of high power values diversity was particularly helpful for reducing relationship conflict. In turn, decreased relationship conflict tended to increase team performance. Additionally, when workload sharing was low, high relationship conflict was especially harmful to team performance.

Implications

Results support the consideration of team participative safety climate to better understand the conditions under which power values diversity is likely to lessen relationship conflict and subsequently increase team performance. Findings also highlight the importance of avoiding low workload sharing, in the presence of prominent relationship conflict, to increase team performance.

Originality/Value

By examining relationship conflict as a mediator and participative safety climate as a moderator of power values diversity’s effects, we make a novel contribution to extant literature by helping to elucidate both how and under what conditions differences in power values, among team members, can influence team performance. Relatedly, we answer the call for more research that adopts a contingency approach toward examining the effects of values diversity and relationship conflict. In doing so, we help to identify the conditions under which power values diversity and relationship conflict are likely to differentially influence important team outcomes.

     

Evaluating Item-Sort Task Methods: The Presentation of a New Statistical Significance Formula and Methodological Best Practices

Purpose

An item-sort task is a common method to reduce over-representative item lists during the scale-creation process. The current article delineates the limitations and misapplications of the accepted statistical significance formula for item-sort tasks and proposes a new statistical significance formula with greater utility across a wider range of item-sort tasks.

Design

First, a simulation study compares the two formulas in an array of conditions that vary on sample size and number of assignment choices. Second, an empirical study compares the results of three separate item-sort tasks across the two formulas for statistical significance.

Findings

In the empirical study, the proposed formula produces more correct retention decisions than the existing formula across all three item-sort tasks. In the simulation study, the proposed formula is more appropriate than the existing formula under most conditions. The two formulas function identically in item-sort tasks with only two assignment choices.

Implications

Researchers could obtain erroneous results when misapplying the existing item-sort task statistical significance formula to cases with more than two assignment choices. The proposed formula corrects this limitation, ultimately providing accurate results more often than the existing formula. Applying the proposed formula could help future research and practice throughout the scale development process.

Originality

Despite widespread use, few attempts have been made to improve scale-creation pretest methods, particularly item-sort tasks. The current study demonstrates that even conventional statistical methods are susceptible to misuse and misapplication, and future research could benefit from the reexamination of other common methods.

     

Examining Ethicality Judgements of Theft Behavior: The Role of Moral Relativism

Purpose

The purpose of this study was to investigate whether situational factors predict ethicality judgments of theft behavior, and whether the effect of situational factors is moderated by moral relativism.

Design/Methodology/Approach

Data were obtained across two laboratory experiments using undergraduate business students attending a Canadian university (n = 372). Student participants viewed a videotaped vignette of an employee informed that he had been caught stealing sales commission. In the vignettes, we manipulated two situational factors: whether or not (a) the theft has monetary consequences for the organization, and (b) similar theft is commonplace within the organization.

Findings

In Experiment 1, both situational factors interacted with moral relativism in the prediction of ratings of unethical conduct. In Experiment 2, using a within-participant research design, we achieved an interaction between the organizational consequences manipulation and moral relativism, although we obtained a considerably stronger effect size for the interaction compared to the first experiment.

Implications

We discuss implications of our findings and suggest avenues for future research. In particular, we consider the possibility that managers may not share a common frame-of-reference when considering the ethicality of theft. This could affect whether and the extent to which theft behavior is reprimanded.

Originality/Value

Our study contributes to research on employee theft, and also adds incrementally to our understanding of how both situational factors and moral relativism jointly influence perceptions of theft behavior.

     

Linking Workplace Aggression to Employee Well-Being and Work: The Moderating Role of Family-Supportive Supervisor Behaviors (FSSB)

Purpose

The present study examined the moderating effects of family-supportive supervisor behaviors (FSSB) on the relationship between two types of workplace aggression (i.e., patient-initiated physical aggression and coworker-initiated psychological aggression) and employee well-being and work outcomes.

Methodology

Data were obtained from a field sample of 417 healthcare workers in two psychiatric hospitals. Hypotheses were tested using moderated multiple regression analyses.

Findings

Psychiatric care providers’ perceptions of FSSB moderated the relationship between patient-initiated physical aggression and physical symptoms, exhaustion and cynicism. In addition, FSSB moderated the relationship between coworker-initiated psychological aggression and physical symptoms and turnover intentions.

Implications

Based on our findings, family-supportive supervision is a plausible boundary condition for the relationship between workplace aggression and well-being and work outcomes. This study suggests that, in addition to directly addressing aggression prevention and reduction, family-supportive supervision is a trainable resource that healthcare organizations should facilitate to improve employee work and well-being in settings with high workplace aggression.

Originality

This is the first study to examine the role of FSSB in influencing the relationship between two forms of workplace aggression: patient-initiated physical and coworker-initiated psychological aggression and employee outcomes.

     

A Meta-Analytic Investigation of Objective Learner Control in Web-based Instruction

Purpose

Research examining learner control of adult web-based instruction has been inconsistent, showing both positive and negative effects on learning outcomes. In addition, the specific implementation decisions made across studies that are labeled “learner control” often differ dramatically. The purpose of the present study was to provide a theoretical framework by which to understand objective learner control and to empirically test it.

Design/Methodology

In this study, a nine-dimensional hierarchical framework of objective learner control was developed from an extensive literature review. This framework includes instructional control (skip, supplement, sequence, pace, practice, and guidance control), style control (i.e., control of aesthetic training characteristics), and scheduling control (time and location control). Hypothesized effects were tested meta-analytically.

Findings

Findings suggested that (1) types of learner control are almost always confounded in experimental learner control research; (2) objective learner control is not a multidimensional construct but instead of a set of related design choices; (3) across types, learner control is generally effective in skill training but varies greatly in knowledge training and in terms of reactions; and (4) sequence control is the only type that generally does not harm either learning or reactions across contexts.

Implications

Given the significant confounding present in most of the literature, learner control researchers are recommended to isolate specific control features. Practitioners should identify specific targeted outcomes and choose features according to those goals.

Originality/Value

This is the first study to propose and test a theoretically derived framework of objective learner control, providing a roadmap for research and state-of-the-art practice.

     

The Performance Appraisal Milieu: A Multilevel Analysis of Context Effects in Performance Ratings

Purpose

The purpose of this study was to take an inductive approach in examining the extent to which organizational contexts represent significant sources of variance in supervisor performance ratings, and to explore various factors that may explain contextual rating variability.

Design/Methodology/Approach

Using archival field performance rating data from a large state law enforcement organization, we used a multilevel modeling approach to partition the variance in ratings due to ratees, raters, as well as rating contexts.

Findings

Results suggest that much of what may often be interpreted as idiosyncratic rater variance, may actually reflect systematic rating variability across contexts. In addition, performance-related and non-performance factors including contextual rating tendencies accounted for significant rating variability.

Implications

Supervisor ratings represent the most common approach for measuring job performance, and understanding the nature and sources of rating variability is important for research and practice. Given the many uses of performance rating data, our findings suggest that continuing to identify contextual sources of variability is particularly important for addressing criterion problems, and improving ratings as a form of performance measurement.

Originality/Value

Numerous performance appraisal models suggest the importance of context; however, previous research had not partitioned the variance in supervisor ratings due to omnibus context effects in organizational settings. The use of a multilevel modeling approach allowed the examination of contextual influences, while controlling for ratee and rater characteristics.

     

Development and Validation of the Workplace Age Discrimination Scale

Purpose

Workplace age discrimination research is proliferating, but researchers lack a valid measure with which to capture targets’ discriminatory experiences. We developed a measure of perceived workplace age discrimination that assesses overt and covert forms of discrimination and then compared older, middle-aged, and younger workers’ experiences.

Design/Methodology

In Study 1, we developed the Workplace Age Discrimination Scale (WADS) based on older workers’ experiences using a deductive approach, a qualitative study, and two quantitative surveys. In Study 2, we validated the measure among young employees using a qualitative and two quantitative surveys. In Study 3, we tested the WADS among middle-aged workers and tested models of invariance between age groups.

Findings

Participants frequently endorsed covert discriminatory experiences, which the WADS reflects. The WADS contains convergent and discriminant validity, high reliability, and a unidimensional structure across age groups. It demonstrates criterion-related validity among older and younger workers but not middle-aged workers, given their low experiences of age discrimination. Age discrimination frequency follows a U-shaped pattern across age groups.

Implications

Researchers can use the WADS to identify long-term outcomes of age discrimination and to further compare workers’ discriminatory experiences. Practitioners and policymakers can use the measure to develop interventions to ameliorate workplace age discrimination and inform policymaking.

Originality/Value

The WADS is the first validated measure of targets’ perspectives of workplace age discrimination. Our results challenge assumptions that only older workers experience age discrimination (younger workers’ means were highest) and that age discrimination is usually overt in nature (it is often covert).

     

Internet-Based,Unproctored Assessments on Mobile and Non-Mobile Devices: Usage,Measurement Equivalence,and Outcomes

Purpose

The purpose of this study was to determine the usage rates, measurement equivalence, and potential outcome differences between mobile and non-mobile device-based deliveries of an unproctored, non-cognitive assessment.

Design/Methodology/Approach

This study utilized a quasi-experimental design based on archival data obtained from applicants who completed a non-cognitive assessment on a mobile (n = 7,743; e.g., smartphones, tablet computers) or non-mobile (n = 929,341; e.g., desktop computers) device as part of an operational, high-stakes pre-employment selection process.

Findings

One percent of applicants used mobile devices to complete the assessment. Multiple-group confirmatory factor analysis indicated the assessment was equivalent across mobile and non-mobile devices at the configural, metric, scalar, and latent mean levels. A comparison of observed score means using one-way and factorial ANOVAs demonstrated that the use of mobile and non-mobile devices did not produce any practically significant score differences on the assessment across devices or applicant demographic subgroups.

Implications

Industry and technological trends suggest mobile device usage will only increase. Thus, demonstrating that mobile device functionality and hardware characteristics do not change the psychometric functioning or applicant outcomes for a non-cognitive, text-based selection assessment is critical to talent assessment.

Originality/Value

This study provides the first empirical examination of the usage of mobile devices to complete talent assessments and their impact on assessment properties and applicant outcomes, and serves as the foundation for future research and application of this growing technological trend in pre-employment assessment.

     

The Usefulness of Tenacity in Spurring Problem-Focused Voice: The Moderating Roles of Workplace Adversity

Purpose

Drawing from conservation of resources theory and affective events theory, this article examines the hitherto unexplored relationship between employees’ tenacity levels and problem-focused voice behavior, as well as how this relationship may be augmented when employees encounter adversity in relationships with peers or in the organizational climate in general.

Design/Methodology/Approach

The study draws on quantitative data collected through a survey administered to employees and their supervisors in a large manufacturing organization.

Findings

Tenacity increases the likelihood of speaking up about problem areas, and this relationship is strongest when peer relationships are characterized by low levels of goal congruence and trust (relational adversity) or when the organization does not support change (organizational adversity). The augmenting effect of organizational adversity on the usefulness of tenacity is particularly salient when it combines with high relational adversity, which underscores the critical role of tenacity for spurring problem-focused voice behavior when employees negatively appraise different facets of their work environment simultaneously.

Implications

The results inform organizations that the allocation of personal energy to reporting organizational problems is perceived as particularly useful by employees when they encounter significant adversity in their work environments.

Originality/Value

This study extends research on voice behavior by providing a better understanding of the likelihood that employees speak up about problem areas, according to their levels of tenacity, and explicating when this influence of tenacity tends to be more prominent.

     

Idiosyncratic Deals and Helping Behavior: The Moderating Role of I-deal Opportunity for Co-workers

Purpose

This study draws from social comparison theory to explore why and under which circumstances individuals receiving idiosyncratic deals (i-deals) are likely to help their co-workers.

Design

Data were collected with an alumni association of engineers. Participants completed two questionnaires (N = 182 at Time 2).

Findings

We find that the relationship between i-deals and helping behavior is not direct, but is mediated by organizational-based self-esteem. This relationship is stronger when i-deal recipients believe that their co-workers do not have the opportunity to get i-deals for themselves.

Implications

I-deal recipients are expected to help their colleagues because helping colleagues is consistent with the positive self developed thanks to i-deals. When co-workers have the opportunity to get i-deals for themselves, social comparison between the i-deal recipient and colleagues is likely to be more salient, which strengthen the indirect relationship between i-deal and helping behavior.

Originality

This study tests i-deals from the vantage point of social comparison theory rather than from the perspective of social exchange. We thereby provide a richer account of the complexities involved in helping behavior. By exploring contextual variables that are likely to trigger social comparisons, we also expect to better understand the circumstances under which i-deals are likely to be associated with helping behavior.

     

The Manager as Coach: The Role of Feedback Orientation

Purpose

This study investigated the consequences of manager feedback orientation in the manager-as-coach process. Integrating theories of feedback and coaching, we examined the extent to which manager feedback orientation was related to indicators of effective coaching and subordinate feedback orientation.

Design/methodology/approach

One hundred three manager–subordinate dyads participated in this study.

Findings

Managers who value feedback for themselves (high feedback orientation) were viewed as better coaches as assessed through employee perceptions of coaching behaviors, the coaching relationship, and the feedback environment. Manager feedback orientation was also related to subordinate feedback orientation, and this relationship was mediated by the coaching effectiveness indicators.

Implications

This study demonstrated that the coaching manager with higher feedback orientation is viewed as more effective than the coaching manager with lower feedback orientation. This study assesses previously untested theories of coaching and demonstrates the value of manager feedback orientation in the coaching process.

Originality/value

This is the first study to integrate the feedback and coaching literatures to test derived hypotheses regarding feedback orientation in the manager-as-coach framework.

     

Impression Management Use in Resumes and Cover Letters

Purpose

This study contributes to the ecological validity of resume research by systematically examining the impression management (IM) content of actual resumes and cover letters and empirically testing the effect on applicant evaluation.

Design/methodology/approach

A content analysis of the frequency and intensity of IM tactic use in 60 resumes and cover letters was completed (Study 1). Next, an experiment was conducted in which IM tactic use was manipulated and the effect on applicant evaluation examined, using a sample of MTurk workers as evaluators (Study 2).

Findings

In Study 1, four self-promotion categories, three ingratiation categories, and one hybrid category were delineated. In Study 2, ingratiation and lower intensity self-promotion were found to increase perceptions of job and organization fit.

Implications

Employers should be aware that resumes and cover letters contain IM tactics that may influence applicant evaluation. In addition, employment training programs might communicate the benefits of using ingratiation and lower intensity self-promotion, while emphasizing the importance of accurately conveying one’s qualifications. Furthermore, the present taxonomy of IM resume content might be applied to resume database search engines to identify and index IM tactic use.

Originality/value

This research is the first to develop a taxonomy of IM tactics based on actual resumes and cover letters and may facilitate more comprehensive manipulations of IM tactic use and better integration of IM research across the selection process.

     

Editorial: Evidence on Questionable Research Practices: The Good,the Bad,and the Ugly

Purpose

Questionable research or reporting practices (QRPs) contribute to a growing concern regarding the credibility of research in the organizational sciences and related fields. Such practices include design, analytic, or reporting practices that may introduce biased evidence, which can have harmful implications for evidence-based practice, theory development, and perceptions of the rigor of science.

Design/Methodology/Approach

To assess the extent to which QRPs are actually a concern, we conducted a systematic review to consider the evidence on QRPs. Using a triangulation approach (e.g., by reviewing data from observations, sensitivity analyses, and surveys), we identified the good, the bad, and the ugly.

Findings

Of the 64 studies that fit our criteria, 6 appeared to find little to no evidence of engagement in QRPs and the other 58 found more severe evidence (91 %).

Implications

Drawing upon the findings, we provide recommendations for future research related to publication practices and academic training.

Originality/value

We report findings from studies that suggest that QRPs are not a problem, that QRPs are used at a suboptimal rate, and that QRPs present a threat to the viability of organizational science research.

     

Good Soldier or Good Actor? Supervisor Accuracy in Distinguishing Between Selfless and Self-Serving OCB Motives

Purpose

In line with findings that organizational citizenship behaviors (OCBs) may be driven by selfless and self-serving motives, we sought to determine supervisor effectiveness in distinguishing good soldiers from good actors.

Design/Methodology/Approach

Employing a sample of 197 supervisor-subordinate dyads, we collected self- and supervisor-reports of employees’ citizenship motives. Dominance analysis was used to determine supervisory accuracy in identifying and distinguishing among subordinates’ motives.

Findings

We found that the relationships between self- and supervisor-reports of corresponding motives were strongest, supporting our hypotheses that supervisors are able to accurately identify their subordinates’ OCB motives and that they are not fooled by good actors.

Implications

Our results address concerns raised in previous research that inaccuracy in supervisor attributions of motives might lead to unfair reward or punishment of their subordinates. In demonstrating their accuracy in identifying their subordinates’ motives, an important implication of our work is that supervisors’ preferences for selfless motives may relate to actual differences in their employees’ contribution to the organization.

Originality/Value

Our study contributes to existing research to more conclusively address the question of supervisors’ bias in their preference for selfless motives. Our results also underscore the importance of accounting for employee motives in research exploring the outcomes of OCBs.

     

Motivational Mechanisms of Self-Concordance Theory: Goal-Specific Efficacy and Person–Organization Fit

Purpose

The purpose of this study was to elaborate on two mechanisms of self-concordance theory (SCT; Sheldon and Elliot in Pers Soc Psychol 24(5):546, 1998)—goal-specific efficacy and perceived person–organization (PO) fit—as mediators of the relationships between autonomous and controlled goal motives and goal accomplishment and job satisfaction.

Design/Methodology/Approach

Data were from two independently collected samples of administrative employees (N1 = 37, N2 = 102) and their significant others across two points in time.

Findings

Results indicated that autonomous motives were positively related to goal-specific efficacy and perceived PO fit (Time 1), and showed indirect effects on goal accomplishment and other-rated job satisfaction (Time 2). Controlled motives were negatively related to the same intermediaries and outcomes.

Implications

Goal motives implicate goal-specific outcomes, and individuals’ overall composition of goal motives—across their goals—shape their goal efficacy and PO fit perceptions. These mechanisms relate to distal outcomes of goal accomplishment and job satisfaction. The research offers theoretical implications for the proximal outcomes of goal motives, but also practical implications for ways in which organizations can improve incumbent PO fit perceptions.

Originality/Value

Although research has shown that having self-concordant goals is positively associated with individual outcomes, existing research has yet to understand why this is the case. In addition, most studies of SCT apply difference scores to study the construct at the individual-level rather than specifying motives separately and considering a multilevel perspective. Our research offers a novel investigation of the proximal outcomes of SCT and the levels at which they operate.

     

Saving Face: Reactions to Cultural Norm Violations in Business Request Emails

Purpose

This research examines reactions to relationship building statements (termed facework; e.g., I hope all is well) and message structure (placement of reasoning either before or after the request itself) in business emails presented to U.S. and Chinese employees.

Design/methodology/approach

Two studies manipulated the use of facework and message structure in samples of Chinese and American employees and measured reactions to the email. Study 1 sampled Chinese (n = 57) and U.S. (n = 56) employees within the same multinational firm. Study 2 employed multi-industry samples of Chinese (n = 99) and U.S. (n = 105) employees. Both studies also examined within-culture differences in self-construal as predictors of reactions to the messages.

Findings

Chinese employees reported greater desire to do business with the sender of an email that included facework and placed reasoning before the request, whereas U.S. employees were more irritated with this type of email (Study 1). However, when facework and message structure were manipulated independently (Study 2), Chinese employees preferred the messages with facework or reasoning before request only when the two strategies were not combined. Within-culture differences in independent and interdependent self-construal interacted with email condition in complex ways.

Implications

Results have implications for employees who use email to communicate cross-culturally and also point to within-culture differences in email preferences.

Originality/value

Despite the prevalent use of email for cross-cultural business communication, lack of understanding of cultural nuances may result in misunderstandings and breakdowns in communication. Results have implications for training employees who communicate cross-culturally.