Examining the cross‐cultural validity of the positive affect and negative affect schedule between an Asian (Singaporean) sample and a Western (American) sample

The positive affect and negative affect schedule (PANAS) is a popular measure of positive (PA) and negative affectivity (NA). Developed and validated in Western contexts, the 20‐item scale has been frequently administered on respondents from Asian countries with the assumption of cross‐cultural measurement invariance. We examine this assumption via a rigorous multigroup confirmatory factor analysis, which allows us to assess between‐group differences in both strength of scale item‐to‐latent factor relationship (metric invariance test) and mean of each scale item (scalar invariance test), on a large sample of 1,065 respondents recruited from Singapore (Asian sample) and the United States (Western sample). We found that two items assessing PA (“excited” and “proud”) and three items assessing NA (“guilty,” “hostile,” and “ashamed”) exhibited metric noninvariance whereas 11 of the remaining metric invariant items exhibited scalar noninvariance, suggesting that the PA and NA constructs differ from what the PANAS is expected to measure for Asian respondents. Our findings serve as a cautionary note to researchers who intend to administer the PANAS in future studies as well as to researchers interpreting the results of past studies involving respondents from Asian countries.     

Affective structure,measurement invariance,and reliability across different experience sampling protocols

While affect is frequently measured with experience sampling methodology (ESM), the affective structure at the between- and within-person level has not been thoroughly investigated. We investigated the affective structure at the between- and within-person level, its invariance across different ESM protocols, and its reliability. Participants (N = 147) were randomly assigned to receive either a 30 or 60 item questionnaire three, six, or nine times per day, resulting in 72–75 participants per questionnaire length and 48–50 participants per sampling frequency. Momentary affect was assessed with 8 or 18 items. At both levels, a structure with two correlated factors showed the best fit compared to an orthogonal and a unidimensional model. A structure with additional freed residual correlations was invariant across protocols at the within-person level and showed high reliability. We observed indications of a more discrete affective structure within than between persons.     

The Satisfaction With Life Scale: Measurement invariance across immigrant groups

The current study examined measurement invariance of the Satisfaction With Life Scale (SWLS; Diener, Emmons, Larsen, & Griffin, 1985) across three immigrant groups, namely, immigrants from the Former Soviet Union (FSU) in Israel, Turkish-Bulgarians, and Turkish-Germans. The results demonstrate measurement invariance of the SWLS across groups. The findings that Turkish-Bulgarian and FSU immigrants in Israel scored significantly lower on the SWLS compared to Turkish-Germans can be explained by assimilative policies in Israel and Bulgaria. In conclusion, our results suggest the SWLS is feasible for cross-cultural comparisons of immigrants of various age groups. Future investigation of measurement invariance over time is needed to use the SWLS in a developmental perspective.     

Measurement Equivalence/Invariance of the Abusive Supervision Measure Across Workers From Taiwan and the United States

Growing international research interest in negative-leadership behaviors prompts the need to examine whether measures of ineffective leadership developed in the United States are equivalent across countries outside the United States. B. J. Tepper's (2000) abusive supervision measure has been used widely inside and outside the United States and merits research attention on its construct equivalence across different cultural settings. The authors conducted a series of multigroup confirmatory factor analyses to investigate the measurement equivalence of this measure across Taiwan (N = 256) and the United States (N = 389). Configural invariance was established, suggesting that both U.S. and Taiwanese samples perceive abusive supervision as a single-factor concept. Furthermore, the establishment of partial metric invariance and partial scalar invariance suggests that the abusive supervision measure is applicable to crosscultural comparisons in latent means, construct variance, construct covariances, and unstandardized path coefficients with the caution that workers from different cultures calibrate their responses differently when answering some items.     

Item-response theory modeling of IQ gains (the Flynn effect) on crystallized intelligence: Rodgers' hypothesis yes,Brand's hypothesis perhaps

Potential explanations for generational intelligence test score gains continue to be subject to intense debate and scrutiny in the scientific community. However, the explanatory value of some of the proposed causes remains difficult to determine, since only little empirical evidence is available. To clarify the role of two scarcely investigated theories accounting for the Flynn effect, this study set out to examine the role of changing test-taking behavior (Brand's hypothesis) and of a narrowing of the IQ ability distribution (Rodgers' hypothesis). Archival records of crystallized intelligence test performance over a time-span of 17 years of a large number of psychiatric inpatients and outpatients in Austria were investigated (N = 5445; 1978–94). This sample was particularly suitable to investigate our hypotheses since participants were under no pressure to perform which makes observed changes in test taking behavior attributable to personal style and ability rather than differential performance in pressure situations. Analytical approaches of both classical test theory and item response theory (IRT) yielded gains of 1.0 to 2.4 IQ points per decade. Test-taking behavior indicative of guessing and decreasing population IQ variability appeared to contribute both to IQ test score gains. IRT-based analyses showed that gains were largely preserved when controlling for highest educational qualification, while the test instrument showed measurement invariance between cohorts. However, IRT-based results also suggested that changes in test-taking behavior might not necessarily reflect increased guessing, but item drift instead. In all, this evidence emphasizes better performance of individuals of the lower tail of the IQ ability distribution in more recent years as one important contributing factor for generational IQ test score gains.     

Facets of the Childhood Anxiety Sensitivity Index Among Serbian Youth

Data from factor analytic studies using the Child Anxiety Sensitivity Index (CASI) suggest that global anxiety sensitivity (AS) is best represented by three or four underlying factors or facets. The aim of this study was to identify facets best representing the CASI structure in its Serbian version. Confirmatory factor analysis was used on data collected from 456 non-referred children in Serbia. A 13-item version of the CASI provided a better fit to the data than the original 18-item version. The four-factor model of the CASI-13 with disease, unsteady, mental incapacitation, and social concerns facets provided the best fits for the data and it was found to be fully invariant (configural, metric, and scalar invariance) across gender and age. Among Serbian children, hierarchical structure was found for a 13-item CASI version with a single higher-order factor of global AS represented by four underlying facets. Future research will consider these AS facets and their role in the development, maintenance, and exacerbation of anxiety symptoms in children.     

Does body dissatisfaction have the same meaning for males and females? A measurement invariance study

ObjectivesThe aim of this study was to assess the psychometric equivalence of body dissatisfaction (BD) between males and females.MethodTwo scales, BD and Drive to Thinness (DT), from the Eating Disorder Inventory-3 were evaluated. The sample was comprised of 1616 adolescent males and 1429 adolescent females. Factorial invariance across gender of two scales was assessed in order to evaluate the equivalence of scores.ResultsThe results showed full invariance for the DT scale items, and partial invariance for BD scale items. The content analysis of the items confirmed that items related to the perception of thighs, stomach and hips showed differential functioning across gender.ConclusionsDifferent representation of the BD construct between males and females was concluded, and caution was recommended in assessing and interpreting BD in male samples with questionnaires designed for women.     

Is Measurement Noninvariance a Threat to Inferences Drawn from Randomized Control Trials? Evidence From Empirical and Simulation Studies

Randomized control trials (RCTs) are considered the gold standard when evaluating the impact of psychological interventions, educational programs, and other treatments on outcomes of interest. However, few studies consider whether forms of measurement bias like noninvariance might impact estimated treatment effects from RCTs. Such bias may be more likely to occur when survey scales are utilized in studies and evaluations in ways not supported by validation evidence, which occurs in practice. This study consists of simulation and empirical studies examining whether measurement noninvariance impacts treatment effects from RCTs. Simulation study results demonstrate that bias in treatment effect estimates is mild when the noninvariance occurs between subgroups (e.g., male and female participants), but can be quite substantial when being assigned to control or treatment induces the noninvariance. Results from the empirical study show that surveys used in two federally funded evaluations of educational programs were noninvariant across student age groups.     

Empirical evaluation of a model of global psychophysical judgments: III. A form for the psychophysical function and intensity filtering

In part I, a concept of ratio estimation is defined and it is shown that if such estimates depend only upon the physical ratio of the signal to the reference signal, the psychophysical function must be a power function. Assuming the same exponents for each component, an invariance condition, equivalent to a sum of power functions, is studied empirically for binaural loudness. It is fully or partially sustained for 19 of 22 respondents. Since failures may be attributable to different exponents in the two ears, the ratio of the two exponents is estimated but that fails to explain the failures. Other possible explanations are suggested. In part II, an intensity filtering model is presented, accounting for the phenomenon where monaural loudness matches show a bias depending on the matching ear. We show (a) that the existence of such a bias does not alter the prior experimental results; and (b) assuming the power function, that five respondents attenuate the opposite ear and two enhance it.     

Configural instability of data from the Life Orientation Test—Revised

Scores obtained with the Revised Life Orientation Test (LOT-R) are commonly interpreted according to the optimism–pessimism factorial model. Positive items would measure individual differences in positive outcome expectancy, and negative items would measure differences in negative outcome expectancy. Configural stability was assessed using four datasets from French adults, N₁ = 429, N₂ = 278, N₃ = 468, and N₄ = 909. Two times out of four the third positive item-variable could also be regressed on the pessimism factor, with a significant improvement of the goodness of fit. Moreover, the semantic content of the best items reveals that the positive vs. negative outcome expectancy interpretation of the factors was not self-consistent. Practical consequences for the use of the usual optimism composite score are discussed.