The Performance Appraisal Milieu: A Multilevel Analysis of Context Effects in Performance Ratings

Purpose

The purpose of this study was to take an inductive approach in examining the extent to which organizational contexts represent significant sources of variance in supervisor performance ratings, and to explore various factors that may explain contextual rating variability.

Design/Methodology/Approach

Using archival field performance rating data from a large state law enforcement organization, we used a multilevel modeling approach to partition the variance in ratings due to ratees, raters, as well as rating contexts.

Findings

Results suggest that much of what may often be interpreted as idiosyncratic rater variance, may actually reflect systematic rating variability across contexts. In addition, performance-related and non-performance factors including contextual rating tendencies accounted for significant rating variability.

Implications

Supervisor ratings represent the most common approach for measuring job performance, and understanding the nature and sources of rating variability is important for research and practice. Given the many uses of performance rating data, our findings suggest that continuing to identify contextual sources of variability is particularly important for addressing criterion problems, and improving ratings as a form of performance measurement.

Originality/Value

Numerous performance appraisal models suggest the importance of context; however, previous research had not partitioned the variance in supervisor ratings due to omnibus context effects in organizational settings. The use of a multilevel modeling approach allowed the examination of contextual influences, while controlling for ratee and rater characteristics.

     

Parenting Stress and Sexual Satisfaction Among First-Time Parents: A Dyadic Approach

The present paper reports on longitudinal associations between parenting stress and sexual satisfaction among 169 heterosexual couples in the first year after the birth of a first child. Actor Partner Interdependence Modeling (APIM) was used to model the effects of the mother’s and father’s parenting stress at 6 months after birth on sexual satisfaction at 1 year after birth. Based on social constructivist theory and scarcity theory, two hypotheses were posed: (a) mothers’ parenting stress will predict their own later sexual satisfaction whereas fathers’ parenting stress will not predict their own later sexual satisfaction (actor effects) and (b) mothers’ parenting stress will predict fathers’ later sexual satisfaction but fathers’ parenting stress will not predict mothers’ later sexual satisfaction (partner effects). On average, parents were only somewhat satisfied with their sex life. The first hypothesis was supported as greater parenting stress significantly predicted lower sexual satisfaction for mothers but not for fathers. The second hypothesis was also supported as mothers’ greater parenting stress significantly predicted less sexual satisfaction in fathers, whereas fathers’ parenting stress did not significantly predict mothers’ sexual satisfaction. We discuss how our results may be interpreted considering the social construction of gendered family roles.     

Further Evidence that Creativity and Innovation are Inhibited by Conservative Thinking: Analyses of the 2016 Presidential Election

The investigation replicated and extended previous research showing a negative relationship between conservatism and creative accomplishment. Conservatism was estimated, as in previous research, from voting patterns. The voting data used here were from the 2016 US Presidential election. The number of patents granted per county in the United States was used as estimate of creative and innovative accomplishment. Using a 2-level multilevel approach, in which state-level influences are taken into consideration, various control variables were tested, including socioeconomic status (SES), education, income, and diversity. The results confirmed a negative relationship between conservatism and the number of patents granted. Therefore, in counties and states with high conservatism, fewer patents were granted, even after controlling for SES and population. Patents were positively related to racial diversity and education. Practical implications include the benefits of liberal thinking outside of the political arena. Liberal thinking is very likely associated with flexibility, tolerance, and openness, and according to the present results, creative accomplishment. Limitations of the research and future directions are discussed.     

Normative Sample of the PEAK Relational Training System: Generalization Module with Comparison to Individuals with Autism

With the rising number of individuals diagnosed with autism and other developmental disabilities comes an increased need for effective assessment and treatment options. Previous research has indicated that applied behavior analytic techniques are among the most empirically supported and utilized treatments for this population; however, curriculum and assessment tools rooted in utilizing these techniques have very little empirical support for their reliability and validity. The current studies sought to assess the performance of both a normative sample and a sample with autism on one such assessment tool: The PEAK Generalization Module. Altogether, 183 typically developing children participated in study 1 and 84 children with a diagnosis of autism participated in study 2. The results indicated that the normative sample demonstrated a strong positive correlation between the PEAK Generalization Assessment and age, whereas the sample with autism demonstrated no significant relationship between the two. Further analysis indicates that the PEAK Generalization Assessment may be an appropriate tool for assessing individuals with autism across a wide range of ages, and provides a preliminary benchmark against which to measure both current functioning and progress in individuals with developmental disabilities.     

Measuring adult indirect aggression: The development and psychometric assessment of the indirect aggression scales

This paper describes the development of a psychometric measure of indirect aggression for use in an adult population. Items were generated from a series of qualitative interviews. Two versions of the scale were developed; the Indirect Aggression Scale Aggressor version (IAS‐A) and Target version (IAS‐T). Both versions of the scale were administered to separate samples (n_A=294; n_T=294). Scales were analysed using item analysis of internal consistency, as well as exploratory factor analysis. Both versions were found to have the same consistent three sub‐scales: social exclusion, use of malicious humour, and guilt induction. Preliminary psychometric evaluation suggests that the scales are both sufficiently reliable (with Cronbach's alphas ranging from .81 to .89) and valid. There were no gender differences in either using or being the victim of indirect aggression, and the behaviour was significantly negatively correlated with age. Future validation and potential usage of the measures are discussed. Aggress. Behav. 31:1–14, 2005. © 2005 Wiley‐Liss, Inc.     

Feminism and Feminist Therapy: Lessons From the Past and Hopes for the Future

Feminist therapy incorporates the psychology of women (e.g., J. B. Miller, 1976), developmental research (e.g., C. Gilligan, 1982), cognitive‐behavioral techniques (J. Worell & P. Remer, 1992), multicultural awareness (L. Comas‐Diaz & B. Greene, 1994), and social activism (L. S. Brown, 1994) in a coherent theoretical and therapeutic package. It is an orientation that is effective in various venues and with diverse populations. In this article, the authors trace the relevant historical aspects of the orientation along with implications for practice, critiques, and trends.     

Salvation through Relaxation: Proprioceptive Therapy and its Relationship to Yoga

Relaxation constitutes a primary feature of yoga as it is taught in the West today. However, typical modern practices have no precedent in the pre-modern yoga tradition, but derive largely from techniques of proprioceptive relaxation developed in nineteenth- and twentieth-century Europe and America. These techniques (along with their assumptions of the soteriological value of relaxation) in turn alter the theory and praxis of yoga itself, such that its fundamental enterprise is significantly modified. Does a transformation constitute a development or merely a corruption of the yoga tradition? This article considers the extent to which Modern Yoga fills the cultural space once occupied by ‘relaxationism’.