A Comparison of a Subjective and Statistical Method for Establishing Score Comparability in an Organizational Culture Survey

Purpose

The purpose of this study was to compare the results of a subjective and a statistical method of detecting non-comparable items in 14 language-translated forms of a survey measuring organizational culture.

Design/Methodology/Approach

Data were obtained from a large multinational organization using a 60-item organizational culture survey. Each of 14 language-translated forms were administered to members of their respective language groups and compared to the original English (United States) form. Subjective reviews were conducted using fluent bilingual organizational members whom flagged items they did not believe were comparable. Statistical analyses using an item response theory (IRT) approach were used to detect problematic items from 14 samples with sizes ranging from 304 to 3,014. Detection patterns from these two approaches were compared.

Findings

The subjective approach identified far less items as problematic and did not agree with the statistical approach.

Implications

Our results suggest that the subjective approach as a pre-screening adaptation procedure has little added value over a careful translation/back-translation procedure.

Originality/Value

The use of language-adapted organizational surveys has become increasingly important to multinational organizations. In examining scores from such surveys the establishment of score comparability is essential. IRT analyses are often used to determine whether scores are comparable across language translations. It is also common for subjective reviews of item content to be utilized prior to statistical techniques to determine if the translated items are comparable to the original form. No research known to authors has compared modern statistical and subjective approaches to addressing these issues.     

Investing in karma: when wanting promotes helping

People often face outcomes of important events that are beyond their personal control, such as when they wait for an acceptance letter, job offer, or medical test results. We suggest that when wanting and uncertainty are high and personal control is lacking, people may be more likely to help others, as if they can encourage fate's favor by doing good deeds proactively. Four experiments support this karmic-investment hypothesis. When people want an outcome over which they have little control, their donations of time and money increase (Experiments 1 and 2), but their participation in other rewarding activities does not (Experiment 1b). In addition, at a job fair, job seekers who feel the process is outside (vs. within) their control make more generous pledges to charities (Experiment 3). Finally, karmic investments increase optimism about a desired outcome (Experiment 4). We conclude by discussing the role of personal control and magical beliefs in this phenomenon.     

Extending self‐leadership research to the East: Measurement equivalence of the Chinese and English versions of the MSLQ

In response to calls regarding the applicability of self‐leadership measurement in Eastern (collectivistic) and Western (individualistic) cultures, this study examined the psychometric properties and measurement invariance of the modified self‐leadership questionnaire (MSLQ). The sample consisted of 395 Chinese students and 241 Australian students. Results revealed that the modified self‐leadership questionnaire exhibited a satisfactory condition of psychometric properties across cultures. A series of multi‐sample confirmatory factor analyses demonstrated the cross‐cultural similarity of an 11‐factor model across the Chinese and Australian samples. The modified self‐leadership questionnaire was also found to possess measurement invariance, suggesting that it is appropriate for cross‐cultural research assessing differences of self‐leadership behaviour across Chinese and Western cultures. Implications for future research are also discussed.     

Meta-analytic evidence for a superordinate cognitive control network subserving diverse executive functions

Classic cognitive theory conceptualizes executive functions as involving multiple specific domains, including initiation, inhibition, working memory, flexibility, planning, and vigilance. Lesion and neuroimaging experiments over the past two decades have suggested that both common and unique processes contribute to executive functions during higher cognition. It has been suggested that a superordinate fronto–cingulo–parietal network supporting cognitive control may also underlie a range of distinct executive functions. To test this hypothesis in the largest sample to date, we used quantitative meta-analytic methods to analyze 193 functional neuroimaging studies of 2,832 healthy individuals, ages 18–60, in which performance on executive function measures was contrasted with an active control condition. A common pattern of activation was observed in the prefrontal, dorsal anterior cingulate, and parietal cortices across executive function domains, supporting the idea that executive functions are supported by a superordinate cognitive control network. However, domain-specific analyses showed some variation in the recruitment of anterior prefrontal cortex, anterior and midcingulate regions, and unique subcortical regions such as the basal ganglia and cerebellum. These results are consistent with the existence of a superordinate cognitive control network in the brain, involving dorsolateral prefrontal, anterior cingulate, and parietal cortices, that supports a broad range of executive functions.     

When appearance concerns make women look bad: Solo status and body image concerns diminish women’s academic performance

Women entering male-dominated fields often find themselves the only women present, i.e., they experience solo status. Solo status diminishes women’s performance when women are negatively stereotyped in the testing domain (Inzlicht & Ben-Zeev, 2000) or when the performance is public (Sekaquaptewa & Thompson, 2002). Because women experience greater body image concerns than men and underperform when these concerns are high (Fredrickson, Roberts, Noll, Quinn, & Twenge, 1998), body image concerns may also cause diminished performance in solo women. Women were given a stigmatized (i.e., heavy) or neutral appearance (via a manipulated photograph), then tested as either solos or non-solos. Results showed that women performed more poorly when given a stigmatized appearance and placed under solo status compared to when only one of these factors were present. Social identity threat concerns (Steele, Spencer, & Aronson, 2002) mediated the solo status effect on performance for women given a stigmatized appearance.     

Selling Sex to Radio Program Directors: A Content Analysis of Radio & Records Magazine

This study was designed to examine whether radio format and musical artists' gender predict sexual content in trade advertisements geared toward radio program directors. Advertisements were coded from one of the leading music trade magazines, Radio & Records magazine, between 2002 and 2003. Results indicated that overall women artists used sexual content in trade advertisements more often and to a greater degree than did men. In some cases, advertisements in radio formats with younger demographic markets, such as pop or hip-hop, also used higher levels of sexual content. It is concluded that the organizational context of the commercial music industry helps to perpetuate status differences between women and men artists, which may then bring about a cognitive bias in the field that promotes women artists' over reliance on using sexual content in trade advertisements.