The Importance of Construct Validity in Consumer Research

Vosgerau, Scopelliti, and Huh (2020) question the construct validity of the most commonly used measures of self‐control and argue that many studies that claim to be examining self‐control may in fact be examining something else. In this comment, we generalize this argument and propose that this criticism could be leveraged against many other areas of consumer research. Indeed, many studies fail to properly establish the construct validity of their measures. Consequently, they may not be examining the construct they purport to be studying, which can lead to unreliable and conflicting findings.     

Psychometric adaption of the impulsive driver behavior scale in a Chinese sample

Impulsivity plays an important role in aberrant driving behavior and crash involvement. The purpose of this study was to evaluate the reliability and validity of the Impulsive Driver Behavior Scale (IDBS, Bıçaksız & Özkan, 2016a) with a Chinese sample. Two hundred and ninety-nine drivers completed the Chinese version of the Impulsive Driver Behavior Scale, the Driver Behavior Questionnaire, the Big Five Inventory and some social-demographic and traffic violation items. A confirmatory factor analysis indicated that a four-factor solution with 20 items yielded a better fit to the data than other solutions. The reduced IDBS showed good reliability and a stable structure. Drivers’ functional impulsivity was positively correlated with positive driver behavior and some ordinary violations. Meanwhile, the other three dimensions of dysfunctional impulsivity showed negative correlations with positive driver behavior and positive associations with aberrant driving behavior and penalty points and fines. Impulsive driver behavior is also associated with agreeableness and conscientiousness. These results provide evidence supporting the IDBS as a reliable and valuable instrument for measuring driving impulsivity in the Chinese traffic environment.     

矛盾年龄偏见量表在中国大学生群体中的修订及信效度检验

目的：修订矛盾年龄偏见量表(the Ambivalent Ageism Scale, AAS),并在中国大学生群体中进行信、效度检验。方法：对1182名大学生施测AAS中文翻译版,探索并验证其因子结构,分析信、效度和测量等值性。其中347人还完成老化知识量表(FAQ)和容纳他人量表(AOS),用以检验AAS中文版的校标关联效度。另有74人在4周后重测AAS中文版。结果：AAS中文修订版包含认知帮助/保护、不想要的帮助和敌意年龄偏见三因子,总量表和各维度的Cronbach’s α系数依次为0.83、0.80、0.85、0.76,重测信度依次为0.78、0.62、0.78、0.71。AAS中文修订版及各维度与FAQ和AOS负相关(r=-0.23～-0.48,ps<0.001)。验证因素分析表明AAS中文修订版的拟合良好(χ²/df=3.51,CFI=0.96,TLI=0.94,RMSEA=0.07,SRMR=0.05)。且该量表跨性别形态、弱等值、部分强等值和部分严格测量等值成立。结论：修订后的矛盾年龄偏见量表(AAS)中文版的信、效度良好,具备跨性别的测量部分...     

An empirical look at the Defense Mechanism Test (DMT): reliability and construct validity

Although the Defense Mechanism Test (DMT) has been in use for almost half a century, there are still quite contradictory views about whether it is a reliable instrument, and if so, what it really measures. Thus, based on data from 39 female students, we first examined DMT inter-coder reliability by analyzing the agreement among trained judges in their coding of the same DMT protocols. Second, we constructed a "parallel" photographic picture that retained all structural characteristic of the original and analyzed DMT parallel-test reliability. Third, we examined the construct validity of the DMT by (a) employing three self-report defense-mechanism inventories and analyzing the intercorrelations between DMT defense scores and corresponding defenses in these instruments, (b) studying the relationships between DMT responses and scores on trait and state anxiety, and (c) relating DMT-defense scores to measures of self-esteem. The main results showed that the DMT can be coded with high reliability by trained coders, that the parallel-test reliability is unsatisfactory compared to traditional psychometric standards, that there is a certain generalizability in the number of perceptual distortions that people display from one picture to another, and that the construct validation provided meager empirical evidence for the conclusion that the DMT measures what it purports to measure, that is, psychological defense mechanisms.     

A Multitrait–Multisource Confirmatory Factor Analytic Approach to the Construct Validity of ADHD and ODD Rating Scales with Malaysian Children

Confirmatory factor analysis (CFA) was used to model a multitrait by multisource matrix to determine the convergent and discriminant validity of measures of attention-deficit hyperactivity disorder (ADHD)-inattention (IN), ADHD-hyperactivity/impulsivity (HI), and oppositional defiant disorder (ODD) in 917 Malaysian elementary school children. The three trait factors were ADHD-IN, ADHD-HI, and ODD. The two source factors were parents and teachers. Similar to earlier studies with Australian and Brazilian children, the parent and teacher measures failed to show convergent and discriminant validity with Malaysian children. The study outlines the implications of such strong source effects in ADHD-IN, ADHD-HI, and ODD measures for the use of such parent and teacher scales to study the symptom dimensions.     

Validity of the Eating Disorder Examination Questionnaire (EDE-Q) in screening for eating disorders in community samples

In order to examine the concurrent and criterion validity of the questionnaire version of the Eating Disorders Examination (EDE-Q), self-report and interview formats were administered to a community sample of women aged 18-45 (n = 208). Correlations between EDE-Q and EDE subscales ranged from 0.68 for Eating Concern to 0.78 for Shape Concern. Scores on the EDE-Q were significantly higher than those of the EDE for all subscales, with the mean difference ranging from 0.25 for Restraint to 0.85 for Shape Concern. Frequency of both objective bulimic episodes (OBEs) and subjective bulimic episodes (SBEs) was significantly correlated between measures. Chance-corrected agreement between EDE-Q and EDE ratings of the presence of OBEs was fair, while that for SBEs was poor. Receiver operating characteristic (ROC) analysis, based on a sample of 13 cases, indicated that a score of 2.3 on the global scale of the EDE-Q in conjunction with the occurrence of any OBEs and/or use of exercise as a means of weight control, yielded optimal validity coefficients (sensitivity = 0.83, specificity = 0.96, positive predictive value = 0.56). A stepwise discriminant function analysis yielded eight EDE-Q items which best distinguished cases from non-cases, including frequency of OBEs, use of exercise as a means of weight control, use of self-induced vomiting, use of laxatives and guilt about eating. The EDE-Q has good concurrent validity and acceptable criterion validity. The measure appears well-suited to use in prospective epidemiological studies.     

The factor structure of the Anxiety Sensitivity Index among Northern Plains Native Americans

Within our current research climate, an emphasis has been placed on examining the cross-cultural applicability of psychological tools, and exploring their utility with people of different backgrounds. Within this line of investigation lies the risk of classifying people too broadly and masking important regional, tribal, or dialectical differences. This may be particularly potent among Native Americans, given the number of distinct indigenous entities. This study examined the psychometric characteristics of the Anxiety Sensitivity Index with a tribally homogeneous sample, as compared to previous tribally-heterogeneous and majority culture findings. Results suggested that data from a homogeneous Native American sample poorly fit factor solutions reported from heterogeneous Native American and Caucasian samples, and favored a unifactorial solution. Implications for assessment with Native American peoples are discussed.     

Measuring Qualitative Aspects of Preschool Boys' Noncompliance: The Response Style Questionnaire (RSQ)

Child noncompliance is a core maladjustment factor in current clinical models of aggression and antisocial development. However, little is known about the relations among qualitative aspects of child noncompliance and aggressive maladjustment. The authors developed the Response Style Questionnaire, an instrument designed to measure the multidimensional qualities of child noncompliance, and tested its validity and reliability. Tests of internal validity provided a five-factor solution, featuring distinctions in noncompliance quality between and among skilled noncompliance (verbally skilled and emotionally regulated) and unskilled noncompliance (overt/confrontational, covert/sneaky, and emotionally labile). Theory-driven tests of external validity using peer-adjustment variables as criteria provided discriminant prediction (a) among qualitatively distinct aspects of noncompliance and (b) between noncompliance qualities and rate. Discussion focuses on a modified view of the nature and role of noncompliance in aggressive and antisocial development.     

组织变革背景下团队主动性的结构与测量

旨在探索组织变革背景下团队主动性行为的结构,并开发出相应的测量工具。首先对20家企业的27位高管进行了深度访谈,然后按照扎根理论思路对获取资料进行细致分析,探索团队主动性的结构,再按照严格的心理测量学程序开发团队主动性的测量问卷,并以来自60家企业的70个团队（共292位成员）为对象进行了测验。研究发现：团队主动性的主要维度包括群策、协作和适应。经过探索性因素分析和验证性因素分析,结果表明测量工具有着良好的信度和构思效度。