Psychometric assessment of the processes of change scale for sun protection

The fourteen-factor Processes of Change Scale for Sun Protection assesses behavioral and experiential strategies that underlie the process of sun protection acquisition and maintenance. Variations of this measure have been used effectively in several randomized sun protection trials, both for evaluation and as a basis for intervention. However, there are no published studies, to date, that evaluate the psychometric properties of the scale. The present study evaluated factorial invariance and scale reliability in a national sample (N = 1360) of adults involved in a Transtheoretical model tailored intervention for exercise and sun protection, at baseline. Invariance testing ranged from least to most restrictive: Configural Invariance (constraints only factor structure and zero loadings); Pattern Identity Invariance (equal factor loadings across target groups); and Strong Factorial Invariance (equal factor loadings and measurement errors). Multi-sample structural equation modeling tested the invariance of the measurement model across seven subgroups: age, education, ethnicity, gender, race, skin tone, and Stage of Change for Sun Protection. Strong factorial invariance was found across all subgroups. Internal consistency coefficient Alpha and factor rho reliability, respectively, were .83 and .80 for behavioral processes, .91 and .89 for experiential processes, and .93 and .91 for the global scale. These results provide strong empirical evidence that the scale is consistent, has internal validity and can be used in research interventions with population-based adult samples.     

SWLS网络测验中可靠性变量的测量不变性检验

测量不变性在自我报告问卷或量表的心理测量应用中非常重要,是跨组比较的前提条件。测量不变性检验模型包括无任何约束的分组验证性因素分析(M_group)、形态的不变性(M1)、负荷的不变性(M2)、截距的不变性(M3)、严格不变性(M4)、因子方差-协方差的不变性(M5)以及潜均值的不变性(M6)。以生活满意度量表(SWLS)为例,针对1343名大学生(年龄17-25岁,20.01±1.53),进行有急事需要处理(否vs.是),答题时感受(积极情绪vs.消极情绪),噪音水平(无噪音vs.有噪音),答题用时(长vs.短),性别(男vs.女),户口(非农业户口vs.农业户口)等不同组别的生活满意度量表(SWLS)完全因素不变性检验。结果表明:(1)是否有急事需要处理的不变性成立(Δχ²=0.49～10.59,p>0.05);(2)答题时感受不变性部分成立,M5、M6模型不变性不成立(Δχ²₍₁=3.96、20.89,p<0.05);(3)噪音水平不变性部分成立,M3与M4模型不变性检验不成立(Δχ²₍₄₎=14.75,Δχ²₍₅₎=23.91,p<0.05);(4)答题用时不变性不成立(Δχ²=11.01～41.95,均p<0.05);(5)性别的不变性部分成立,M4模型不变性检验不成立(Δχ²₍₅₎=64.40,p<0.05);(6)户口的不变性部分成立,M6模型不变性检验不成立(Δχ²₍₁₎=11.49,p<0.05)。     

Do overall dimension ratings from assessment centres show external construct-related validity?

ABSTRACT

There have been repeated calls for an external construct validation approach to advance our understanding of the construct-related validity of assessment centre dimension ratings beyond existing internal construct-related validity findings. Following an external construct validation approach, we examined whether linking assessment centre overall dimension ratings to ratings of the same dimensions that stem from sources external to the assessment centre provides evidence for construct-related validity of assessment centre ratings. We used data from one laboratory assessment centre sample and two field samples. External ratings of the same dimensions stemmed from assessees, assessees’ supervisors, and customers. Results converged across all three samples and showed that different dimension-same source correlations within the assessment centres were larger than same dimension-different source correlations. Moreover, confirmatory factor analyses revealed source factors but no dimension factors in the latent factor structure of overall dimension ratings from the assessment centre and from external sources. Hence, consistent results across the three samples provide no support that assessment centre overall dimension ratings and ratings of the same dimensions from other sources can be attributed to dimension factors. This questions arguments that assessment centre overall dimension ratings should have construct-related validity.     

A multigroup multitrait-multimethod study in two countries supports the validity of a two-factor higher order model of personality

This study examined the factor structure of the Big Five Inventory and tested the hypothesis that the five personality dimensions could be summarized by two higher order factors, namely, plasticity and stability, using multigroup multitrait-multimethod confirmatory factor analyses. We tested the higher order model in two young adult samples drawn from Germany and Turkey. Adequate inter-rater agreement between self- and informant reports was obtained. Among the models tested, a two-factor model was the most parsimonious model in which the first factor included Agreeableness, Conscientiousness, and low Neuroticism; and the second factor included Extraversion and Openness to Experience. Invariance of this model was supported by multiple-group analyses, suggesting a lack of variability across samples.     

Replication of the factor structure of the fear of AIDS schedule (FAIDSS) across samples

Abstract

The stability of the Fear of AIDS Scale (FAIDSS) was studied using three samples (two samples of health workers and one of social work students) on Cattel's s index. Using hyperplane cutoffs between 0.35 and 0.45, on the five factor solution of the FAIDSS, there were significant correlations between factors across samples and with few exceptions each factor correlated significantly with only one factor in its comparison samples. Concurrent validity was demonstrated by comparing scores on the Attitudes toward AIDS scale with the FAIDSS. Data indicated that the FAIDSS structure was stable across samples and is an appropriate instrument for measurement of fear of AIDS in the helping professions.     

Empirically based dimensions of externalizing symptoms in children and adolescents: a multitrait-multisource approach

The present study sought to refine knowledge about the structure underlying externalizing dimensions. From a “top-down” ICD/DSM-based perspective, externalizing symptoms can be categorized into attention-deficit/hyperactivity disorder (ADHD), oppositional defiant disorder (ODD), and conduct disorder (CD). From a “bottom-up” developmental theory-based perspective, disruptive behaviors can be meaningfully described as aggressive (AGG) and rule-breaking (RB) behaviors. We analyzed five large data sets comprising externalizing symptom ratings obtained with a screening instrument using different sources (parents, teachers, self-ratings) from different samples. Using confirmatory factor analyses, we evaluated several factor models (unidimensional; correlated factors; bifactor (S-1) models) derived from an ICD/DSM- and theory-based perspective. Our optimally fitting models were assessed for measurement invariance across all sources, sample settings, and sex. Following several model-based criteria (model fit indices; factor loadings; omega statistics; model parsimony), we discarded our models stepwise and concluded that both the ICD/DSM-based model with three correlated factors (ADHD, ODD, CD) and the developmental theory-based model with three correlated factors (ADHD, AGG, RB) displayed a statistically sound factor structure and allowed for straightforward interpretability. Furthermore, these two models demonstrated metric invariance across all five samples and across sample settings (community, clinical), as well as scalar invariance across sources and sex. While the dimensions AGG and RB may depict a more empirically coherent view than the categorical perspective of ODD and CD, at this point we cannot clearly determine whether one perspective really outperforms the other. Implications for model selection according to our model-based criteria and clinical research are discussed.

     

The Flow State Scale-2 and Dispositional Flow Scale-2: Examination of factorial validity and reliability for Japanese adults

ObjectiveThe primary purpose of this study was to examine the factorial validity and reliability of the Japanese versions of the Flow State Scale-2 and Dispositional Flow Scale-2 (JFSS-2 and JDFS-2) for use with Japanese adults.MethodTo accomplish the aim, a multi-staged approach was employed. Following the guidelines for test adaptation [Tanzer, N. K., & Sim, C. Q. E. (1999). Adapting instruments for use in multiple languages and cultures: A review of the ITC guidelines for test adaptations. European Journal of Psychological Assessment, 15, 258–269], the two flow scales were translated from English to Japanese and the best 36 items for each instrument was identified through two pilot studies. Employing a 9-factor 1st-order hypothesized model, the factorial validity of the JFSS-2 and JDFS-2 was tested and cross-validated with confirmatory factor analysis (CFA). In addition to internal consistency reliability for the both scales, stability was assessed over a 4-week time period for the JDFS-2. Furthermore, measurement equivalence was examined across Japanese independent samples as well as two cultural samples.ResultsThe results of a series of CFAs revealed that the data for the JFSS-2 and JDFS-2 were represented appropriately by the hypothesized 1st-order model. For the both scales, internal consistency estimates for all factors were satisfactory, whereas the stability of single factors over time were medium to high. Measurement invariance was established across the Japanese samples as well as the cultural samples.ConclusionsThe findings from this study provided strong support for the validity and reliability of the JFSS-2 and JDFS-2 in assessing flow experiences in physical activity for Japanese adults. In addition, this study indicated that the Japanese versions of the flow scales are useful instruments for cross-cultural research.     

Adaptation of a Muslim Spiritual Attachment Scale (God attachment) for Turkish Muslims: a validity and reliability study

ABSTRACT

Despite the importance of a believer’s attachment relationship with God for mental health, there are few measures relevant to Muslims, and little work on cross-cultural validation of such measures. The objective of the present study was to examine the validity and reliability of the Muslim Spiritual Attachment Scale (M-SAS) in Turkish Muslim samples. In analyzing the data, three different samples of college students (N?=?525, N?=?341, and N?=?47 respectively) were used. The validity and reliability of M-SAS were examined through exploratory factor analysis, confirmatory factor analysis, the internal consistency coefficient and the split-half reliability coefficient. Results supported a three-factor model of M-SAS with good reliability for the factors, and convergence with an alternative God Attachment measure. As a result, it may be concluded that M-SAS can be used as a valid and reliable measurement instrument in Turkish Muslim samples. The results are discussed in the light of the relevant literature.     

Measurement Invariance of the Adolescent Quality of Life-Mental Health Scale (AQOL-MHS) across Gender,Age and Treatment Context

The Adolescent Quality of Life-Mental Health Scale (AQOL-MHS) was designed to measure quality of life in clinical samples of Latino adolescents aged 12–18 years, but has also been used in community samples. The original measure included three factors: Emotional Regulation (ER), Self-Concept (SC) and Social Context (SoC). The goals of this study are to replicate the factor structure using confirmatory factor analysis (CFA), shorten the instrument and test the degree of measurement invariance across gender, age, and type of sample. Participants for the analyses (N?=?354) came from two populations in the San Juan Metropolitan Area: (1) adolescents from randomly selected households, using a multi-stage probability sampling design (n?=?295), and (2) adolescents receiving treatment at mental health clinics (n?=?59). We first carried out a conceptual item analysis for item reduction purposes and then assessed dimensional, configural, metric and scalar invariance for each factor using the Mplus software system. The original 3-factor structure was replicated with comparable model fit in each treatment context. Metric invariance was attained for all three scales across groups. Either full or partial scalar invariance was also observed with DIF in a total of 6 items. Invariance testing supports the use of the abridged 21 item version of the AQOL-MHS to compare diverse individuals with little bias using observed scores, but for refined estimates the ideal scoring will be from a latent variable model.     

Trust and Involvement as Higher-Order Factors of General Attitudes Towards Politics. Testing a Structural Model Across 26 Democracies

Interindividual differences in how people think and feel about politics have been investigated for decades. However, the great number of attitudinal concepts that has been developed to describe these differences is likely to distract from their conceptual overlap and dimensional structure. In addition, not much is known about the cross-cultural invariance of their interrelation. We propose that attitudes towards politics can be structured by two broad higher-order factors, a factor of general political involvement and a factor of general political trust. In two studies (N₁ = 767; N₂ = 29,018), including representative samples from 26 democracies, we first conduct several confirmatory factor analyses (CFA) to show that the higher-order model is a well-fitting and parsimonious alternative to a baseline model without higher-order factors in most samples. Second, we present evidence from multigroup CFA that the overall patterns of factor loadings are the same across all 26 countries. We interpret this structural equivalence across different democracies as support for the assumption that general political involvement and general political trust reflect basic orientations towards politics that are based on (1) demands of democratic political systems and (2) universal principles in human trait structure.     

Salutogenic constructs across Pakistan and Germany: A cross sectional study

Background/ObjectiveProtective factors are relevant for mental health in general, however, universality of the instruments has been rarely tested. Therefore, the current study aimed to examine psychometric properties and cross-cultural measurement invariance of salutogenic constructs.MethodData was collected from university students of Pakistan (n = 1,841) and Germany (n = 7,890). Single-group confirmatory analysis (CFA) and multiple-group CFA was tested to examine the proposed factor structure and measurement invariance of Positive Mental Health Scale, Resilience Scale, Perceived Social Support Questionnaire, and Life Satisfaction Scale across student samples from Pakistan and Germany respectively.ResultsWe found strong measurement invariance for the Positive Mental Health Scale, Life Satisfaction Scale, and partial strong measurement for the Resilience Scale, and Perceived Social Support Questionnaire.ConclusionsThe results indicate that these scales could be recommended for the meaningful comparison of latent means across cultures. Understanding these differences would further advance our knowledge about the mechanism underlying positive mental health.     

Development and evaluation of the psychometric properties of the parents' Perceptions of Physical Activity Importance and their Children's Ability Questionnaire (PPPAICAQ)

ObjectivesThe purpose of the present study was to develop and psychometrically evaluate a new measure of parental perceptions grounded in the Eccles' parental socialization framework: the Parents' Perceptions of Physical Activity Importance and their Children's Ability Questionnaire (PPPAICAQ).DesignCross-sectional with self-reported questionnaires.MethodThe total sample comprised 1100 parents of children (6–11 years old) and was randomly divided in third (one calibration and two validation samples). Data were analyzed with reliability, confirmatory factor analyses (CFA), multi-group CFAs as well as with correlational analyses.ResultsResults of the initial confirmatory factor analyses (CFAs) of the 2-factor 12-item model on the calibration sample resulted in a poor fit to the data. Re-estimation of the PPPAICAQ resulted in the deletion of 4 initial items. The 2-factor 8-item model revealed a good fit to the data for the three samples. Results of two multiple-group CFAs showed that the final model was partially invariant across the father and mother as well as the boy and girl samples. The patterns of relationships between parents' motivation, parents' support and the PPPAICAQ subscales provided evidence for the criterion-related validity of the PPPAICAQ.ConclusionThis study provided support for the reliability and validity of the PPPAICAQ. The PPPAICAQ is an instrument that will be useful for theoretically-driven research on parental socialization influence on children’ PA.     

The Counseling Center Assessment of Psychological Symptoms Distress Index: A pragmatic exploration of general factors to enhance a multidimensional scale

Objective: The authors attempted to develop and validate a general distress index for a multidimensional psychological symptom/outcome measure used in over 300 college counseling centers with more than 100,000 cases annually: the Counseling Center Assessment of Psychological Symptoms (CCAPS). Method: Four models were compared for fit indices (n = 19,247): the existing first-order factor model (without a general factor), a second-order factor model, a bifactor model, and a single factor or “total score” model. In separate clinical and non-clinical samples, concurrent and divergent validity were examined using several well-established measures of psychological symptoms, as well as two-week test–retest and treatment utilization data. Results: Second-order and bifactor models which captured a single “distress” factor both exhibited good fit to the data relative to the baseline and “total score” model. Validity data indicated that factors adequately measured meaningful clinical onstructs. Conclusion: Both the bifactor and second-order models indicated the presence of a “distress index” comprised items across many of the CCAPS subscales. This distress scale has strong applicability for benchmarking the overall severity and complexity of patients at different centers, and can be used to help identify colleges and universities with areas of clinical strength, which can be studied to improve the field. Clinically, the distress index offers a parsimonious and efficient method for clinicians to monitor patients’ progress through treatment.     

Conceptions of the Opposite-Sex Ideal by International Students in the Netherlands

Abstract

An exploratory cross-cultural survey was used to investigate similarities and differences in stereotypes of good and evil. Students from the United States, West Germany (Federal Republic of Germany), Singapore, Nigeria, and Argentina responded projectively to a 62-item questionnaire, completing it as they imagined an extremely “good and virtuous,” an extremely “wicked and evil,” or an extremely “weak and helpless” person would. Two factors consistently emerged: control (the impulse to influence or dominate others) and power (the impulse to accomplish objectives). Stereotypes of good, bad, and helpless were related to extreme positions on these factors, suggesting that the concepts of good and evil are richer than simply opposite poles of a single, evaluative dimension. Strong similarities in factor structures were found across the five samples, but inconsistencies also emerged. In general, control and power appear to have been common across cultures; however, the five samples operationalized them, as well as good and evil, somewhat differently.     

Score comparability of a state mathematics assessment across students with and without reading accommodations

This study investigated the factorial invariance of a fourth-grade state mathematics assessment across groups of general education students and students with learning disabilities with and without reading accommodations. Confirmatory factor analysis was used to assess the fit of a 2-factor model to each of the 3 groups. In addition to the overall fit of this model, several levels of constraint were investigated. Invariance across the 3 groups was supported for factor loadings and intercepts. However, invariance of the factor covariances across the general education group and the groups of students with learning disabilities was not supported. Because of the implications for aggregating reported scores, further research is needed into the relationship between the factors in the different groups.     

The four-factor model of depressive symptoms in dementia caregivers: a structural equation model of ethnic differences

Previous studies have suggested that 4 latent constructs (depressed affect, well-being, interpersonal problems, somatic symptoms) underlie the item responses on the Center for Epidemiological Studies Depression (CES-D) Scale. This instrument has been widely used in dementia caregiving research, but the fit of this multifactor model and the explanatory contributions of multifactor models have not been sufficiently examined for caregiving samples. The authors subjected CES-D data (N = 1,183) from the initial Resources for Enhancing Alzheimer's Caregiver Health Study to confirmatory factor analysis methods and found that the 4-factor model provided excellent fit to the observed data. Invariance analyses suggested only minimal item-loading differences across race subgroups and supported the validity of race comparisons on the latent factors. Significant race differences were found on 3 of the 4 latent factors both before and after controlling for demographic covariates. African Americans reported less depressed affect and better well-being than White caregivers, who reported better well-being and fewer interpersonal problems than Hispanic caregivers. These findings clarify and extend previous studies of race differences in depression among diverse samples of dementia caregivers.     

A Two Factor ANOVA-like Test for Correlated Correlations: CORANOVA

Testing homogeneity of correlations with Fisher's Z is inappropriate when correlations are themselves correlated. Suppose measurements of brain activation and performance are taken before and during a verbal memory task. Of interest are changes in activity gradients in specific regions, R₁, R₂, R₃, and performance, V. The "correlated correlations" of interest ρ_V,R1 , ρ_V,R2 , and ρ_V,R3 , have a single variable, V, in common. We wish to compare these correlations between males and females, across regions, and to assess an interaction of the correlation. Fisher's Z can compare pairs of correlations, and Olkin and Finn's (1990) method can test homogeneity of correlated correlations across a single within factor (based on asymptotic normality), but no current procedure can test a region by gender (within by between) interaction of correlations. We propose a nonparametric method for testing this interaction and both main effects. The procedure is analogous to two-way ANOVA, but hypotheses test homogeneity of correlations, not means. The null distributions are estimated with permutations, avoiding asymptotic distributional assumptions and enhancing applicability to smaller samples and non-normal data. Simulations demonstrated maintenance of correct level (power = alpha level under the null) for normal and non-normal data and small samples. The Olkin-Finn test had inflated level for non-normal data or small samples. The Fisher's Z had inflated level for non-normal data, but not for small samples. Our method had better efficiency across contrasts and data types and sizes. Applied to correlations between regional laterality of blood flow and verbal memory performance, the method showed sensitivity to a biologically meaningful sex by region interaction in these correlations. A SAS macro for CORANOVA is available.     

Psychometric properties of the Portuguese version of the Alabama Parenting Questionnaire parent form

ABSTRACT

The Alabama Parenting Questionnaire parent form (APQ-P) is one of the most commonly used measures to assess parenting practices. The current study evaluated the psychometric properties of the APQ-P using a community sample of 499 Portuguese mothers of children and adolescents aged 10 to 17 years. Confirmatory factor analysis revealed adequate psychometric properties of a three-factor model (positive parenting, ineffective parenting, and poor monitoring) in a solution of 20-items. After comparing the three-factor model across children’s age groups (≤13 vs. ≥14), partial metric and partial scalar invariance were found. Items loadings were similar between groups for ineffective parenting and poor monitoring, and factor scores were similar between groups for positive parenting. The 20-item version can be an appropriate measure of parenting, relevant for research and intervention purposes. Future studies should validate the current findings in independent samples, and devote particular attention to different parenting practices across different children’s age groups.     

French translation of the Flow State Scale-2: Factor structure,cross-cultural invariance,and associations with goal attainment

ObjectivesThe goal of this paper was to assess the cross-cultural invariance of the factor structure of the French and English versions of the Flow State Scale-2 (FSS-2) [Jackson, S. A., & Eklund, R. C. (2002). Assessing flow in physical activity: The Flow State Scale-2 and Dispositional Flow State Scale-2. Journal of Sport and Exercise Psychology, 24, 133–115] and to assess the relationships between athletes’ flow state and perceived goal attainment.DesignCross-sectional with self-reported questionnaires.MethodTwo samples of sport participants completed the FSS-2 immediately after an event and within a few days after the event, respectively. Data were analyzed with reliability and confirmatory factor analyses as well as with correlational and regression analyses.ResultsResults of confirmatory factor analyses on the French FSS-2 replicated the factor structure of the original FSS-2 with the first-order 9-factor and the hierarchical models both displaying adequate level of goodness-of-fit. Results of multi-sample analyses indicated that most parameters of the FSS-2 were invariant across languages. As expected, flow state correlated significantly with goal attainment during a sport competition. The relationship between flow and goal attainment was invariant across levels of competition.ConclusionsThis study provided support for the factor structure of the French version of the FSS-2 and for the invariance of the flow construct across languages. Flow state is significantly associated with goal attainment and the relationship is equivalent across athletes’ levels of competition.     

The Genderqueer Identity (GQI) Scale: Measurement and validation of four distinct subscales with trans and LGBQ clinical and community samples in two countries

ABSTRACT

Background: Non-binary gender measurement has grown out of a need for accurate representation in scholarship and public health services available to a diverse gender population.

Aims: The Genderqueer Identity Scale (GQI) was developed to allow for a multidimensional assessment of genderqueer identity, including non-binary identity, socially constructed versus essentialist gender, theoretical awareness of gender concepts, and gender fluidity. The GQI was designed to assess gender identity across a full spectrum of gender, at any age after mid-adolescence, and at various stages of gender identity development, including prior to, during, and after a gender transition, where applicable. Two of the GQI subscales focus on intrapersonal processes, while two focus on interpersonal processes.

Methods: The measure was piloted and refined across four distinct samples: a U.S. university based LGBT sample, consecutive clinical referrals at the Center of Expertise on Gender Dysphoria in Amsterdam, the Netherlands, a Dutch LGB community sample, and an online survey forum (LGBTQ).

Results: The first exploratory factor analysis identified minor potential adjustments, which were refined and retested. Researchers evaluated and cross-validated the hypothesized factor structure and determined that the three factor GQI subscales and the unidimensional Gender Fluidity measure yielded internally consistent and valid scores among transgender individuals seeking clinical treatment and LGB individuals within a community setting. The exploratory and confirmatory factor analyses provide evidence of good reliability, construct validity, and internal consistency of all four subscales.

Discussion: The subscales were appropriate across a spectrum of gender identities and can be taken in the same form over time and across gender transition statuses, making them suitable for clinical evaluation and community based longitudinal research with trans-identified or gender nonconforming persons. The development of the GQI fills critical gaps in gender-related measurement including the ability to assess multiple dimensions of gender identity, and to assess gender identity across time.