Effects of varying numbers of Likert scale points on factor structure of the Rosenberg Self‐Esteem Scale

Likert‐type rating scales are among the most widely used tools in psychological research. Different numbers of response categories would likely affect response style, data distribution, reliability, and construct validity. There is a lack of research in factor structure invariance under Likert scales with different numbers of categories. The purpose of this study is to examine the effects of varying numbers of Likert points (4–11) on scale properties such as factor structure, external validity, and latent means based on the Rosenberg Self‐Esteem Scale (M. Rosenberg, 1989 ). The sample consists of 1,807 students from secondary schools in Macau. Confirmatory factor analysis shows that the correlated two‐factor model is the most appropriate one; longitudinal invariance analysis reveals that measurement invariance across Likert scales was satisfied at the scalar level. In addition, latent mean scores on the two factors as well as observed means on the subscales are comparable across Likert scales. Moreover, the measurement model across Likert scales exhibit similar external validity. Although psychometric properties are mostly similar among a different number of points, the 4‐point Likert scale is not recommended for its higher skewness and lower loadings; the 11‐point Likert scale from 0 to 10 is slightly preferred for its higher loadings and composite reliability.     

Attitude Toward Own Aging: Age Invariance and Construct Validity Across Middle-Aged,Young-Old,and Old-Old Adults

The Attitude Toward Own Aging (ATOA) Scale assesses an individual’s evaluation of their own aging, and has been widely used in the field of subjective aging literature. The present study examined whether the ATOA scale measures the same construct across middle-aged (40–60), young-old (61–74), and old-old adults (ages 75 or older) and also evaluated the construct validity of the ATOA construct in relation to measures of subjective well-being. Data drawn from the 2008 wave of the German Aging Survey (DEAS; n?=?6091) were used. ATOA was assessed by the ATOA subscale of the Philadelphia Geriatric Center Morale Scale (PGCMS), and subjective well-being was assessed with the Satisfaction with Life Scale (SWLS) and the Positive and Negative Affect Scale (PANAS). Confirmatory factor analysis revealed that the model fit of the one-factor model consisting of four items fits the data well. Multi-group invariance analyses provide evidence for configural and metric invariance of the ATOA scale across the age groups, but not for scalar invariance. Additional analysis assessing construct validity indicated that the ATOA items exhibited convergent validity. The findings support the utility of the 4-item scale when examining age group differences of ATOA across a wide age range and that ATOA is distinct from measures of subjective well-being.     

Optimal Items for Assessing Parental Involvement across Different Groups During Middle Childhood

Various definitions and different approaches for assessing the complex construct of parental involvement (PI) have led to inconsistent findings regarding the impact of PI on child development. To date, limited information is available regarding the measurement invariance of PI measures across time and groups (e.g., children’s gender, ethnicity, and socio-economic status), leaving a concern that group differences in PI might reflect item bias instead of true differences in PI. The present study aimed to obtain a set of optimal items for measuring PI from kindergarten through the elementary school years and investigate whether they could be used for parents from different groups. A Rasch measurement model was implemented to investigate item difficulty, step calibrations, and measurement invariance (differential item functioning; DIF, here). The results from the Early Childhood Longitudinal Study, Kindergarten Class of 1998–1999 data set showed that 20 items can be used to measure three dimensions of PI—namely school/home involvement, family educational investment, and family routines—across four time points. Administrative time, children’s gender, ethnicity, and social economic status showed different levels of effect on item difficulty for half of these items. Practitioners and researchers should be cautious when using these items and are suggested to freely estimate the item parameters of DIF items as well as add more items to the PI scale to improve reliability.     

The Role Maturity of Parents of Emerging Adult Children: Validity of a Parental Maturity Measure

Parental maturity refers to parents’ ability to see their child as an independent adult with limitations and needs, and relate to him/her accordingly. In this study, we had two main aims: (a) develop a measure of parental maturity and test its construct validity in a sample of middle-aged parents with an emerging adult child, and (b) examine how the dimensions of parental maturity varied with a child’s gender and life course transitions (i.e., employment and leaving the parental home). A sample of 343 Portuguese parents (187 mothers and 156 fathers) aged 40–68 participated in this study. Factorial validity of the Parental Maturity Measure was tested using exploratory and confirmatory factor analyses and measurement invariance across mothers and fathers. Results gave support for a two-factor measure—Comprehending (6 items) and Letting Go (4 items)—with an equivalent meaning across parents. Dimensions of parental maturity were associated with differentiated and positive parent–child relationship qualities, but were quite independent of the child’s gender and life course transitions.     

A closer look at the measurement of dispositional reasoning: Dimensionality and invariance across assessor groups

Despite the growing interest in dispositional reasoning as a construct and determinant of good raters (‘good judges’), its measurement still requires attention. We address two measurement issues in the present study. First, this study tests a hierarchical model as a more parsimonious account for dispositional reasoning than component‐ or general‐factor models that were examined in earlier studies. So, this provides a more comprehensive test of the different measurement models underlying dispositional reasoning data. Second, we assess the measurement invariance of dispositional reasoning measure scores across two different populations of assessors that are often trained and used in workplace assessments, namely psychology students (N = 161) and managers (N = 160). Results showed that dispositional reasoning is well represented as componential in nature, with a higher‐order construct underlying three lower‐order components. A comparison of managers and psychology students through measurement invariance analysis showed relatively similar factor structures underlying dispositional reasoning scores across these groups, but metric invariance could be only partially established.     

Validation of an italian version of the oxford happiness inventory in adolescence

An Italian adaptation of the Oxford Happiness Inventory was administered to 782 adolescents. Exploratory structural equation modeling (ESEM) was used to examine the first- and second-order factorial structure of the scale and its invariance across gender; internal consistency and construct validity were also investigated. ESEM underlined a 5-factor structure (mastery and self-fulfillment, satisfaction with life, vigor, social interest, and social cheerfulness) that measures positive psychological functioning. These dimensions form a single latent construct of general psychological well-being. The scale showed adequate internal consistency values and strong measurement invariance across gender. Finally, regarding convergent validity, both total scale and subscales were positively correlated with extraversion and self-esteem, were negatively correlated with neuroticism, and displayed no correlation with psychoticism.     

A Measurement Framework to Determine the Construct Validity of ADHD/ODD Rating Scales: Additional Evaluations of the Child and Adolescent Disruptive Behavior Inventory

A multiple group confirmatory factor analysis was used to test the invariance of an attention-deficit/hyperactivity disorder-inattention, attention-deficit/hyperactivity disorder-hyperactivity/impulsivity, oppositional defiant disorder toward adults, academic and social competence five-factor model across of independent groups of Thai adolescents with the Child and Adolescent Disruptive Behavior Inventory (CADBI). Mothers and fathers’ ratings on 872 adolescents were compared to mothers and fathers’ ratings on a different group of 983 adolescents. The design allowed four invariance analyses (i.e., mothers’ ratings of the first group compared to mothers’ ratings of the second group; fathers’ ratings of first group compared to fathers’ ratings of the second group; mothers’ ratings of first group compared to fathers’ ratings of the second group; and fathers’ ratings of first group compared to mothers’ ratings of second group). Support was found for the invariance of like-symptom loadings and symptom intercepts as well as like-factor variances, covariances, and factor means across the four invariance analyses. The findings further expand the construct validity of the CADBI. The paper also introduces a multiple indicators by multiple traits by multiple methods by multiple sources by multiple occasions by multiple groups’ measurement matrix to guide the evaluation of the construct validity of ADHD/ODD rating scales.     

The Turkish Version of the Meaning in Life Questionnaire: Assessing the Measurement Invariance Across Turkish and American Adult Samples

The purpose of this study was to adapt the Meaning in Life Questionnaire (MLQ) developed by Steger, Frazier, Oishi, and Kaler (2006) into Turkish and examine the measurement and structural invariance of this scale across Turkish (N = 815) and U.S. (N = 207) samples. Our findings indicated that the hypothesized 2-factor model of the MLQ fit the data well for both Turkish and U.S. samples. Results also provided support for the full metric invariance, partial scalar invariance, and partial invariance of residual variances of the MLQ across the 2 samples (i.e., Turkish and U.S.). Supporting the structural invariance, we found that factor variances and covariances were equivalent across the 2 groups. Internal consistency reliability analyses revealed a Cronbach's alpha value of .88 for the MLQ Presence scale and .90 for the Search scale. Our findings also provided preliminary support for the convergent validity of the Turkish version of the MLQ (MLQ–TR). Contrary to findings in other collectivist cultures, the relationship between Search and Presence was negative in Turkish culture. These results support the psychometric properties of the MLQ–TR and its partial equivalence to the original U.S. version.     

Measurement invariance of the Belief in a Zero‐Sum Game scale across 36 countries

In this paper, we examined the psychometric properties of cross‐cultural validation and replicability (i.e. measurement invariance) of the Belief in a Zero‐Sum Game (BZSG) scale, measuring antagonistic belief about interpersonal relations over scarce resources. The factorial structure of the BZSG scale was investigated in student samples from 36 countries (N = 9907), using separate confirmatory factor analyses (CFAs) for each country. The cross‐cultural validation of the scale was based on multigroup confirmatory factor analyses (MGCFA). The results confirmed that the scale had a one‐factor structure in all countries, in which configural and metric invariance between countries was confirmed. As a zero‐sum belief about social relations perceived as antagonistic, BZSG is an important factor related to, for example, social and international relations, attitudes toward immigrants, or well‐being. The paper proposes different uses of the BZSG scale for cross‐cultural studies in different fields of psychology: social, political, or economic.     

IRT框架下追踪数据的测量不变性分析——————以4至5岁儿童认知能力测验为例

本研究以4岁~5岁儿童认知能力测验为例,在IRT框架下探讨了如何进行追踪数据的测量不变性分析。分析模型采用项目间多维项目反应理论模型(between-item MIRT model)和项目内（within-item MIRT model）多维two-tier model,被试为来自全国的882名48个月的儿童,工具为自编4岁~5岁儿童认知能力测验。经测验水平 分析和项目水平分析,结果表明：(1)本文对追踪数据的测量不变性分析方法合理有效; (2)该测验在两个时间点上满足部分测量不变性要求,测验的潜在结构稳定; (3)“方位题”的区分度和难度参数都发生变化,另有4题难度参数出现浮动; (4)儿童在4岁~5岁期间认知能力总体呈快速发展趋势,能力增长显著。     

The Unidimensional Relationship Closeness Scale (URCS): reliability and validity evidence for a new measure of relationship closeness

A fundamental dimension along which all social and personal relationships vary is closeness. The Unidimensional Relationship Closeness Scale (URCS) is a 12-item self-report scale measuring the closeness of social and personal relationships. The reliability and validity of the URCS were assessed with college dating couples (N = 192), female friends and strangers (N = 330), friends (N = 170), and family members (N = 155). The results show that the scale is unidimensional, with high reliability across relationship types (M α = .96). Evidence consistent with validity included substantial within-couple agreement for the romantic couples (intraclass correlation = .41), substantial friend-stranger discrimination for the female friends (η2 = .82), and measurement invariance across relationship types. Evidence of convergent and divergent validity was obtained for inclusion of other in the self and relational satisfaction, respectively.     

Psychometric Properties of the Posttraumatic Growth Inventory–Short Form Among Chilean Adults

This study evaluated the factorial structure, internal consistency, and construct validity of the Chilean version of the Posttraumatic Growth Inventory–Short Form. The participants were 1,817 Chilean adults who had experienced the 2010 earthquake in Chile or other highly stressful events. Confirmatory factorial analysis supported the correlated five-factor structure of the PTGI-SF. A multigroup confirmatory factor analysis confirmed measurement invariance across different samples. Concurrent validity was assessed by correlation. These findings suggest that the psychometric properties of the PTGI-SF are adequate to measure posttraumatic growth in the Chilean and Latin American population.     

Assessing Measurement and Predictive Invariance of the Toronto Alexithymia Scale–20 in U.S. Anglo and U.S. Hispanic Student Samples

We collected data from a predominately Anglo American student sample in the Southeastern United States and a predominately Hispanic student sample in the Southwestern United States. Along with an assessment of internal consistency reliability, we examined measurement invariance of the Toronto Alexithymia Scale–20 (TAS–20) using confirmatory factor analysis. We also assessed the predictive invariance of the TAS–20. Results indicate that 2 of the 3 TAS–20 subscales demonstrated satisfactory internal consistency reliability across samples. Items from the TAS–20 subscales demonstrated measurement invariance of the latent means. The relationship between 2 measures of emotional dysfunction and the TAS–20 also demonstrated slope and intercept invariance, indicating equivalent validity.     

Loneliness and Attitudes Toward Being Alone in Belgian and Chinese Adolescents: Examining Measurement Invariance

Loneliness is an adverse phenomenon that tends to peak during adolescence. As loneliness is a subjective state, it is different from the objective state of being alone. People’s attitudes toward being alone can be more or less negative or positive. Cultures differ in the form and meaning of social behavior, interpersonal relationships, and time spent alone. However, for cross-cultural comparisons to be meaningful, measurement invariance of the measure should be established. The present study examined measurement invariance of the Loneliness and Aloneness Scale for Children and Adolescents (LACA) in a sample of 218 Belgian and 190 Chinese early adolescents, aged 11–15 years. Using nested multigroup confirmatory factor analyses, measurement invariance of the LACA across Belgium and China was established. More specifically, evidence was found for configural, metric, and partial scalar invariance. Because partial scalar invariance was established, the two cultural groups could be compared. No significant differences were found for peer-related loneliness. Regarding the attitudes toward aloneness, Belgian adolescents were more negative and less positive toward being alone than Chinese adolescents. The present study is encouraging for researchers who want to use the LACA for cross-cultural comparisons, in that we found evidence for measurement invariance across two disparate cultural groups speaking completely different languages.     

Video game addiction test: validity and psychometric characteristics

Abstract The study explores the reliability, validity, and measurement invariance of the Video game Addiction Test (VAT). Game-addiction problems are often linked to Internet enabled online games; the VAT has the unique benefit that it is theoretically and empirically linked to Internet addiction. The study used data (n=2,894) from a large-sample paper-and-pencil questionnaire study, conducted in 2009 on secondary schools in Netherlands. Thus, the main source of data was a large sample of schoolchildren (aged 13-16 years). Measurements included the proposed VAT, the Compulsive Internet Use Scale, weekly hours spent on various game types, and several psychosocial variables. The VAT demonstrated excellent reliability, excellent construct validity, a one-factor model fit, and a high degree of measurement invariance across gender, ethnicity, and learning year, indicating that the scale outcomes can be compared across different subgroups with little bias. In summary, the VAT can be helpful in the further study of video game addiction, and it contributes to the debate on possible inclusion of behavioral addictions in the upcoming DSM-V.     

Reliability and factorial validity of Adolescent Time Inventory–Time Attitude (ATI-TA) Scores in Scottish and Northern Irish adolescents

The contemporary literature investigating the construct broadly known as time perspective is replete with methodological and conceptual concerns. These concerns focus on the reliability and factorial validity of measurement tools, and the sample-specific modification of scales. These issues continue to hamper the development of this potentially useful psychological construct. An emerging body of evidence has supported the six-factor structure of scores on the Adolescent Time Inventory–Time Attitudes Scale, as well as their reliability. The present study utilized data from the first wave of a longitudinal study in the United Kingdom to examine the reliability, validity, and cross-cultural invariance of the scale. Results showed that the hypothesized six-factor model provided the best fit for the data; all alpha and omega estimates were > .70; scores on ATI-TA factors related meaningfully to self-efficacy scores; and the factor structure was invariant across both research sites. Results are discussed in the context of the extant temporal literature.     

A caregiver–child socioemotional and relationship rating scale

This article reports the construction and pilot reliability, validity, and psychometric properties of a new caregiver–child rating scale that emphasizes caregiver–child socioemotional interactions and relationships. While the scale was developed and studied in orphanages for young children, it potentially could be used in nonresidential early care and education settings as well as for parent–child interactions in the home. The intent was to assess a few dimensions that comprehensively cover the range of caregiver–child socioemotional interactions and relationships, by means of a scale that could be administered in a relatively short time period in a variety of situations and would not require extensive coder training, manuals, or materials. Results showed that the scale can be reliably administered even using observation periods as short as 5 min, that inter‐rater reliability was acceptable (based on data from two raters working in two orphanages, and five raters working in another), and that ratings of caregivers were similar across different types of caregiving activities (i.e., feeding, dressing/bathing, free play) and for caregivers attending to children birth to 4 and 4 to 8 years of age. In the orphanage context, factor analyses showed that the scale primarily reflects caregiver–child mutual engagement and relationship with subordinate components of caregiver punitiveness and caregiver‐ versus child‐directed behaviors and intrusiveness.     

Validating the Student-Teacher Relationship Scale: testing factor structure and measurement invariance across child gender and age in a Dutch sample

The Student-Teacher Relationship Scale (STRS) is widely used to examine teachers' relationships with young students in terms of closeness, conflict, and dependency. This study aimed to verify the dimensional structure of the STRS with confirmatory factor analysis, test its measurement invariance across child gender and age, improve its measurement of the dependency construct, and extend its age range. Teachers completed a slightly adapted STRS for a Dutch sample of 2335 children aged 3 to 12. Overall, the 3-factor model showed an acceptable fit. Results indicated metric invariance across gender and age up to 8years. Scalar invariance generally did not hold. Lack of metric invariance at ages 8 to 12 primarily involved Conflict items, whereas scale differences across gender and age primarily involved Closeness items. The adapted Dependency scale showed strong invariance and higher internal consistencies than the original scale for this Dutch sample. Importantly, the revealed non-invariance for gender and age did not influence mean group comparisons.     

Assessing relationship quality across cultures: An examination of measurement equivalence

Researchers are increasingly studying close relationships across cultural contexts. One issue that arises when applying scales originally developed in Western countries to a different cultural context is measurement invariance. Researchers often do not examine whether scales show invariance across cultures and thus can be used with confidence. The goal of this article is to discuss the importance of measurement invariance, to discuss what testing invariance involves, and to test the measurement properties of scales of relationship satisfaction, commitment, intimacy, and trust across 4 samples (United States, Canada, Indonesia, and China). Analyses indicated that weak measurement invariance was met for all 4 scales, and assumptions of strong measurement invariance had to be relaxed for only a few items in each scale. Findings are discussed and recommendations are made regarding using these or other scales that have been shown to meet assumptions of invariance across different cultural groups.     

The classmates social isolation questionnaire (CSIQ): An initial validation

Social Isolation means having a lack of social contacts. This study reports a first validation of a brief self-report measure, the Classmates Social Isolation Questionnaire (CSIQ). The CSIQ is a questionnaire for children which assesses social isolation from classmates within the classroom as well as outside school. Data was based on a nationally representative sample of 26,670 Italian fifth grade students. Through exploratory and confirmatory factor analyses the bidimensional structure of the scale was established. The CSIQ showed measurement invariance both across gender and across groups with different immigrant backgrounds.Various tests of criterion validity had positive results and the CSIQ appears to be a valid and time-efficient instrument that can make a contribution to the study of social isolation and correlated factors.