Managerial Experience and the Measurement Equivalence of Performance Ratings

ABSTRACT: Establishing the measurement equivalence of instruments is a prerequisite to making meaningful comparisons between individuals or within individuals over time. Whereas previous research has investigated the effects of rater characteristics on the measurement equivalence of performance ratings, the current study investigated a ratee characteristic—ratee job experience. Using confirmatory factor analysis and item response theory methods with replication, the measurement equivalence of supervisor ratings of 7,200 managers with differing levels of managerial experience was assessed. Overall, results indicated a high degree of measurement equivalence suggesting that meaningful comparison may be made across ratees with different levels of job experience.     

Women's social experiences before and during the COVID-19 pandemic: A 3-part measurement burst study among women in midlife with health risks

Women in midlife (ages 40–60) with elevated risk for cardiovascular disease (CVD) often rely on social networks during times of high stress. Precautions against the spread of COVID-19—particularly stay-at-home-orders—could have limited positive social experiences during a stressful time, but also could have reduced unwanted negative social experiences. This report presents findings from an ecological momentary assessment study that used 3 bursts of 5 surveys per day for 5 days, to test for changes in women's social experiences: prior to COVID-19 (2019), during stay-at-home-orders (April-May 2020), and during initial reopening (August-September 2020). Participants were women aged 40–60 with one or more CVD risk factors (e.g., hypertension; N = 35, M_Age = 51, M_BMI = 32.2 kg/m²). Momentary reports showed that the number of positive interactions experienced in daily life did not significantly change from before to during the pandemic; positive interactions were more variable during stay-at-home orders than pre-COVID, but rebounded by initial reopening (to pre-COVID levels). In contrast, the number of negative social interactions and social comparisons decreased from before COVID to stay-at-home orders, and remained lower during initial reopening; these experiences were also less variable during stay-at-home orders and initial reopening than before COVID-19. Thus, in a vulnerable group of women with health risks, there is little evidence that social experiences worsened during the first 6 months of the COVID-19 pandemic; decreases in (potentially) negative social experiences may be a small but beneficial side effect of short-term public health precautions.     

Enhancing measurement validity in diverse populations: Modern approaches to evaluating differential item functioning

When developing and evaluating psychometric measures, a key concern is to ensure that they accurately capture individual differences on the intended construct across the entire population of interest. Inaccurate assessments of individual differences can occur when responses to some items reflect not only the intended construct but also construct-irrelevant characteristics, like a person's race or sex. Unaccounted for, this item bias can lead to apparent differences on the scores that do not reflect true differences, invalidating comparisons between people with different backgrounds. Accordingly, empirically identifying which items manifest bias through the evaluation of differential item functioning (DIF) has been a longstanding focus of much psychometric research. The majority of this work has focused on evaluating DIF across two (or a few) groups. Modern conceptualizations of identity, however, emphasize its multi-determined and intersectional nature, with some aspects better represented as dimensional than categorical. Fortunately, many model-based approaches to modelling DIF now exist that allow for simultaneous evaluation of multiple background variables, including both continuous and categorical variables, and potential interactions among background variables. This paper provides a comparative, integrative review of these new approaches to modelling DIF and clarifies both the opportunities and challenges associated with their application in psychometric research.     

The biasing effects of selection and attrition on estimating the mean

Organizational and validation researchers often work with data that has been subjected to selection on the predictor and attrition on the criterion. These researchers often use the data observed under these conditions to estimate either the predictor or criterion's restricted population means. We show that the restricted means due to direct or indirect selection are a function of the population means plus the selection ratios. Thus, any difference between selected mean groups reflects the population difference plus the selection ratio difference. When there is also attrition on the criterion, the estimation of group differences becomes even more complicated. The effect of selection and attrition induces measurement bias when estimating the restricted population mean of either the predictor or criterion. A sample mean observed under selection and attrition does not estimate either the population mean or the restricted population mean. We propose several procedures under normality that yield unbiased estimates of the mean. The procedures focus on correcting the effects of selection and attrition. Each procedure was evaluated with a Monte Carlo simulation to ascertain its strengths and weaknesses. Given appropriate sample size and conditions, we show that these procedures yield unbiased estimators of the restricted and unrestricted population means for both predictor and criterion. We also show how our findings have implications for replicating selected group differences.     

人类为什么会好奇?人际好奇的概念、功能及理论解释

人际好奇是个体对他人的信息产生的好奇,其中包括对他人的生活经历、生活习惯和细节,以及想法、感受、动机产生的好奇。人际好奇受到个体性别、年龄、个体状态、人格和文化价值观等因素的影响,而且人际好奇在人际关系的建立与维持、人格判断、文化学习和维护社会规范等方面有积极影响。人际好奇可以用本能论、信息缺口理论、兴趣?剥夺理论和社会比较理论加以解释。目前对人际好奇研究较少,未来需从毕生发展的角度探索人际好奇,研究网络中的人际好奇现象,进一步完善人际好奇的测量方式,加强基础研究和实证研究,考虑文化因素的影响等。     

Using Interactive Theater to Create Socioculturally Relevant Community-Based Intimate Partner Violence Prevention

This article describes the use of interactive theater, audience response assessment, and peer educators to create community-generated approaches for bystander interventions (i.e., actions taken by people who become aware of controlling, abusive and violent behavior of others) to prevent intimate partner violence (IPV) and to foster change in community norms. We include a case example of an ongoing university–community partnership, which mobilizes community members to develop and implement socioculturally relevant IPV prevention programs in multiple Asian communities. We used interactive theater at a community event—a walk to raise awareness about IPV in South Asian communities—and examined how the enacted bystander interventions reflect specific community contexts. We detail the challenges and limitations we have encountered in our attempts to implement this approach in collaboration with our community partners.     

Stress assessment during adolescence: Psychometric properties and measurement invariance of the Student Stress Inventory-Stress Manifestations across gender and age

The main purpose of this study was to analyze the psychometric properties and measurement invariance across gender and age of the Student Stress Inventory-Stress Manifestations (SSI-SM) scores in a large sample of adolescents. The sample was comprised by a total of 1108 students (482 were male), with a mean age of 14.61 years (SD = 1.71). The results indicated that the SSI-SM scores presented adequate psychometric properties from both classical test theory and Item Response Theory (IRT). Confirmatory factorial analysis (CFA), showed that both the bifactor model and a three-factor model (emotional, physiological, and behavioural) were adequate. Multi-group CFA showed that the three-factor model had strong measurement invariance across gender and age. Statistically significant differences in gender were found between latent means as well as raw scores of SSI-SM. Ordinal alpha was .78 for Physiological, .90 for the Emotional, and .79 for the Behavioural subscales. Using IRT, the SSI-SM provides more accuracy information at the medium level of the latent trait. SSI-SM subscales were associated with emotional and behavioural problems. These results provided new sources of validity evidence of the SSI-SM scores in adolescents from general population. The SSI-SM appears to be a useful, brief, and easy to administrate self-report instrument for the screening of stress manifestations at school and educational settings.     

Distinguishing intellectual humility and general humility

Two studies provide evidence for distinguishing intellectual humility (IH) from general humility (GH). Humility involves (a) an Accurate View of Self and (b) the ability to regulate egotism and cultivate an other-oriented stance; IH is a subdomain of humility that involves (a) having an accurate view of one’s intellectual strengths and limitations and (b) the ability to negotiate ideas in a fair and inoffensive manner. First, we present a theoretical framework for distinguishing these constructs. In Study 1, with a sample of undergraduate students (N = 1097), we used confirmatory factor analysis to provide empirical evidence for this distinction. We also found that IH predicted unique variance in openness to experience relative to GH. In Study 2, we examined additional evidence of discriminant validity with another sample of college students (N = 355). IH also predicted unique variance in need for cognition, objectivism, and religious ethnocentrism relative to GH.     

Positivity ratio of flourishing individuals: Examining the moderation effects of methodological variations and chronological age

We tested the relationship between flourishing and positivity ratio while accounting for different measures of affect and rating scale formats. We further examined age-related differences in positivity ratio. Studies 1 and 2 showed that positivity ratio is affected by the measure used, but not by the rating scale format. Study 3 further showed that positivity ratio is higher among older adults. The above pattern of methodological variations was replicated in Study 4 with daily ratings of emotions and in Study 5 where emotions were rated on an extended scale. Study 5 also replicated the aforementioned age effect. Together these studies suggest that positivity ratio is moderated by methodological variants and individual differences, such as chronological age. Future studies should account for these possible moderation effects when exploring the positivity ratio and its relationship to flourishing.     

Perception Differences in Ambiguous Forms of Workplace Sexual Harassment: A Comparison between the United States and Turkey

Certain social–sexual behaviors that could be potentially encountered in workplaces are ambiguous in nature and perceiving them as sexual harassment can depend on the culture. With an aim to delineate the overlap and distinctions of sexual harassment perceptions of such behaviors across samples of women university students from Turkey (TR, N = 215) and the United States (US, N = 209), measurement invariance and latent mean differences in perceiving three ambiguous forms; sexist hostility, sexual hostility, and insinuation-of-interest, were examined. It was hypothesized that the US sample would perceive sexist hostility more sexually harassing as sexist workplace discriminatory practices are emphasized as a form of sexual harassment, and that the TR sample would perceive sexual hostility and insinuation-of-interest as more sexually harassing as women in TR operate in a conservative context. Despite similarities in rank ordering, US participants perceived sexist hostility more sexually harassing; insinuation-of-interest and sexual hostility less sexually harassing than Turkish participants, supporting all three hypotheses. There are implications of differing perceptions across cultures for organizations in terms of disseminating awareness via training programs about the forms of sexual harassment (SH) in a local context and for taking account of local findings in shaping the labor code of countries in relation to SH.