Examining the Construct Validity of Mastery-Avoidance Achievement Goals: A Meta-Analysis

We used meta-analysis to obtain a comprehensive perspective on the construct validity of achievement goals, focusing on the most recent addition to the achievement goal framework, mastery-avoidance (Elliot & McGregor, 2001). Mastery-avoidance achievement goals positively correlated with need for achievement, perceived competence, competitiveness, interest, negative affect, and other achievement goals (mastery-approach, performance-approach, performance-avoidance) and negatively correlated with cognitive ability, help seeking, and performance. The correlations between mastery-avoidance and the other achievement goals were moderate. Thus, we conclude that mastery-avoidance is a conceptually and empirically distinct construct with unique antecedents and consequences and should be included in future studies on achievement goals.     

Conceptual Complexity and Construct Validity

Despite a century of methodological and conceptual advances in the technology of psychosocial measurement, poor correspondence between indicators and the constructs they are intended to represent remains a limiting factor to the accumulation of scientific knowledge. Longstanding conventions in measurement may contribute to the failure to develop optimal criteria. These conventions include the focus on complex over simple constructs and the use of multi-item measures of disparate content to represent those constructs. Several arguments suggest that such a measurement model compromises the potential for developing measures that accurately reflect psychosocial phenomena. The article concludes with some preliminary suggestions concerning an alternative model that may address this construct validity problem more effectively.     

Social Status: Construct and External Validity

Abstract

The present study examined the construct and external validity of social status based on data covering various aspects of the construct, and collected from adolescent samples in Sweden, Australia, and the United States. Using correlation and factor analytic techniques it was found that (a) the various social status variables were, in general, only moderately related within the different countries, (b) the relations among variables were not congruent between countries, (c) two social status factors were revealed in all countries, separating educational-occupational status from social-economic status, and (d) only the educational-occupational factor showed high congruence between all of the countries.     

Applications of Job Component/Synthetic Validity to Construct Validity

The origin and history of job component validity (JCV) and its relationship to construct validity are presented, followed by a summarization of how the methodology has been accomplished in research using the Position Analysis Questionnaire (PAQ). Data are presented that document the capability of both PAQ-based attribute profiles and predictions of aptitude data from PAQ job dimensions to establish job requirements. Finally, two practical ap- plications of JCV are described that illustrate the unique capability of the methodology to develop selection systems to screen individuals for jobs un- dergoing design or occurring in difficult-to-study environments.     

Construct Validity of Belief Systems Subscales

Abstract

The purpose of this study was to evaluate the construct validity of 11 subscales from the Belief Systems Test, a new Likert-type measure of conceptual system, as defined by Harvey, Hunt, and Schroder's (1961) model of cognitive development. Using responses from 136 undergraduate college students, we examined (a) intercorrelations among scores on the subscales, and (b) correlations between scores on the subscales and several measures of stress, an affective trait theoretically and empirically related to several conceptual systems. The scales associated with System 2 (characterized by rebelliousness and a distrust of people) and those associated with System 3 (defined by a concern for social relationships) emerged as the most cohesive sets of beliefs. System 2 subscales were also positively related to each of the five measures of stress administered.     

评价中心的结构效度研究

评价中心虽然具备很高的预测效度,但其结构效度指标却不太理想,如研究普遍发现其汇聚效度和区分效度较低。影响评价中心结构效度的因素众多,如评分维度因素（数量和类型）、评价者因素（培训方式和人员类型）、测评方法因素（情景导向特征、特质激活潜力、测评活动形式）以及系统的观察与评价程序。该文从上述因素出发,综述了评价中心结构效度的相关研究,总结了提高评价中心结构效度的措施,并指出了未来的研究方向     

Construct Validity of the Perceived Criticism Measure

The construct validity of the Perceived Criticism Measure (PCM) was examined in 2 studies. In Study 1, 50 community couples participated in problem-solving interactions after which they rated interaction-specific perceived criticism and their criticism of their spouses. In addition, they provided ratings of perceived criticism for their relationship overall and completed measures of psychopathology and marital satisfaction. For both husbands and wives, convergent validity was demonstrated by moderate-to-large correlations between the PCM and spouses' own ratings of their criticism for both general and interaction-specific perceived criticism. In Study 2, 37 patients with obsessive-compulsive disorder and their spouses participated in problem-solving interactions and provided ratings of marital satisfaction and general perceived criticism. Five untrained coders rated the interactions according to their own definitions of the relatives' destructive criticism of the patient. Their aggregated ratings proved strongly related to patients' PCM scores. Higher PCM scores were related to lower marital satisfaction in both Studies 1 and 2. The results of these studies are supportive of the convergent validity of the Perceived Criticism Measure. Evidence of discriminant validity was mixed.     

Construct Validity of the Iowa Gambling Task

The Iowa Gambling Task (IGT) was created to assess real-world decision making in a laboratory setting and has been applied to various clinical populations (i.e., substance abuse, schizophrenia, pathological gamblers) outside those with orbitofrontal cortex damage, for whom it was originally developed. The current review provides a critical examination of lesion, functional neuroimaging, developmental, and clinical studies in order to examine the construct validity of the IGT. The preponderance of evidence provides support for the use of the IGT to detect decision making deficits in clinical populations, in the context of a more comprehensive evaluation. The review includes a discussion of three critical issues affecting the validity of the IGT, as it has recently become available as a clinical instrument: the lack of a concise definition as to what aspect of decision making the IGT measures, the lack of data regarding reliability of the IGT, and the influence of personality and state mood on IGT performance.     

RBANS Validity Indices: a Systematic Review and Meta-Analysis

Neuropsychology practice organizations have highlighted the need for thorough evaluation of performance validity as part of the neuropsychological assessment process. Embedded validity indices are derived from existing measures and expand the scope of validity assessment. The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) is a brief instrument that quickly allows a clinician to assess a variety of cognitive domains. The RBANS also contains multiple embedded validity indicators. The purpose of this study was to synthesize the utility of those indicators to assess performance validity. A systematic search was completed, resulting in 11 studies for synthesis and 10 for meta-analysis. Data were synthesized on four indices and three subtests across samples of civilians, service members, and veterans. Sufficient data for meta-analysis were only available for the Effort Index, and related analyses indicated optimal cutoff scores of ≥1 (AUC?=?.86) and?≥?3 (AUC?=?.85). However, outliers and heterogeneity were present indicating the importance of age and evaluation context. Overall, embedded validity indicators have shown adequate diagnostic accuracy across a variety of populations. Recommendations for interpreting these measures and future studies are provided.     

The Interaction Anxiousness Scale: Construct and Criterion-Related Validity

This article presents data regarding the validity and reliability of the Interaction Anxiousness Scale (LAS; Leary 1983c), a self-report measure of dispositional social anxiety. The IAS demonstrates high test-retest and internal reliability. Correlations with measures relevant to social and general anxiety document its convergent and discriminant validity, and it correlates well with measures of anxiety and interpersonal concern in actual interactions.     

面试预测效度和构想效度研究述评

面试是人才甄选中最常用的测量工具。大量研究证实,面试的预测效度比较理想,但不同类型面试的预测效度存在差异。虽然能够证实面试的预测效度较好,但对面试的测量构想却知之甚少。研究面试的构想效度,对于提高面试的递增效度有着重要的实践价值。相对人格成分而言,以往研究对面试能够测量到认知成分形成了更加一致地认识。     

The Importance of Construct Validity in Consumer Research

Vosgerau, Scopelliti, and Huh (2020) question the construct validity of the most commonly used measures of self‐control and argue that many studies that claim to be examining self‐control may in fact be examining something else. In this comment, we generalize this argument and propose that this criticism could be leveraged against many other areas of consumer research. Indeed, many studies fail to properly establish the construct validity of their measures. Consequently, they may not be examining the construct they purport to be studying, which can lead to unreliable and conflicting findings.     

The Construct Validity of Assessment Centre Performance Dimensions

Evidence regarding the construct validity of assessment centre performance dimensions is reviewed. The evidence strongly suggests that variance in ratings tends to reflect exercises more than individual performance dimensions, thus calling into question the construct validity and utility of these dimensions. A number of biases in the assessment centre process, as well as more general rating biases are noted that may be responsible for these pervasive exercise effects. Suggestions are made for enhancing the construct validity of performance dimensions.     

Construct Validity of Parent Ratings of Inhibitory Control

Recent literature has emphasized the need to examine executive functions (EF) in children using multiple sources, including both parent rating and performance-based measures. Computerized Go/No-Go tests, including commercially available continuous performance tests (CPTs), represent one of the most commonly used methods of assessing inhibitory control—a variable central to the executive function construct. We examined the relationship between parent ratings of inhibitory control and CPT performance in two mixed clinical samples. Experiment 1 examined 109 children ages 6–18 using the Behavior Rating Inventory of Executive Function (BRIEF; Gioia, Isquith, Guy, & Kenworthy, 2000) and the Conners' CPT-II (Conners, 2000). In this sample, ratings on the BRIEF Inhibit scale (mean T-score?=?62.3) were significantly higher than the CPT-II commissions score (mean T-score?=?50.7; p < .0001); and the BRIEF and CPT-II scores were not highly correlated (r?=???.12). Experiment 2 examined a sample of 131 children ages 7–18 using the BRIEF and the Tests of Variables of Attention (TOVA; Greenberg, 1996). In this sample, parent ratings on the BRIEF Inhibit scale (mean T-score?=?56.8) were similar to TOVA commissions scores (mean T-score?=?58.6; p?=?.33), although still poorly correlated (r?=??.02). Factor analyses exploring covariance between BRIEF scales CPT-II variables (Experiment 1) and between BRIEF and TOVA (Experiment 2) yielded similar findings. In both experiments, all eight BRIEF scales loaded on a single factor, with no overlap with either the CPT-II or the TOVA. In mixed outpatient clinical samples, the BRIEF appears to measure different elements of inhibitory control than those assessed by computerized continuous performance tests.     

Clarifying Construct Validity: Definitions,Processes, and Models

Despite definitions in standard sources, personnel managers, psychologists, and psychometricians persistently encounter problems that are best referred to as the ambiguous nature of validity. The purpose of this article is to pro- vide an overview of construct validity and personnel testing, to demonstrate its practical utility, and to clarify with concrete examples certain theories and models, as well as to illustrate the meaning of the terminology used by com- mentators on the topic. A brief historical overview of testing and validation is presented; the progress of construct validity and its acceptance by various sec- tors of society is discussed parsimoniously in the section The Seven Wonders of Personnel Psychology. In the past, personnel psychologists have not done a very good job of understanding the constructs that underlie test perform- ance. Some new approaches can help to correct this. A process should be rou- tinely used on all tests in order to develop an understanding of the constructs that underlie performance on an employment test; only by knowing the cor- rect criterion and method of measuring it can we ascertain the intrinsic valid- ity of our measures.     

Factorial and Construct Validity of FACES IV Among Italian Adolescents

The aims of this study were to evaluate the reliability, validity and factorial structure of Family Adaptability and Cohesion Evaluation Scale, Version IV (FACES IV), investigate the relevance of sex and age on family functioning and study the relationship between family functioning and adolescents’ perception of parent and peer attachment. The sample consisted of 1,416 participants (672 women, 744 men, M_age = 17.38 years; age range = 13–22 years) divided into three age groups: 13–15, 16–18, and 19–22 years. Factor analysis confirmed the dimensions formulated to define the construct of family functioning: all the items of each dimension were loaded in the same factor with a correlation of at least 0.30. Groups differed with regard to the age on Cohesion, Enmeshed and Rigid scales: Younger adolescents (age 13–15 years) showed significantly higher scores than adolescents (age 16–18 and 19–22). Sex differences revealed that females had a higher mean score on Cohesion and Flexibility, whereas males had a higher mean score on Disengaged, Enmeshed and Chaotic. Correlations between FACES IV and Parent and Peer Attachment Scale demonstrated the convergent validity of the FACES IV. Data confirmed the validity of FACES IV’s Italian version and suggested that the Circumplex Model has a cross-cultural applicability and it could be a useful instrument in the Italian context.     

The Validity of Landfield's Measure of Personal Construct Ordination

The correlation coefficient appropriate in a fourfold situation resulting from the crossing of two dichotomous variables depends on whether the dichotomies are true or arbitrary. Almost all sources dealing with the fourfold situation discuss only the pure cases (both dichotomies true or both dichotomies arbitrary). The mixed case (one dichotomy true and the other arbitrary), introduced at least four decades ago and accompanied in more than one source with the wrong formula for the coefficient, is reintroduced in this study. In addition, a correction for unequal sample size respecting the true dichotomy is presented.     

Examining the Construct Validity for the Multiple-Content Testing Programs

The primary objective of this study was to examine the construct validity for the 2 multiple-content testing programs-the multiple-choice Comprehensive Tests of Basic Skills (CTBS/5) together with the performance-based Maryland School Performance Assessment Program (MSPAP)-by evaluating the true-score longitudinal associations among multiple-content scores in 1 school district. Each content area measure in the 2 testing programs was closely examined by the following criterion: The true-score correlation between 2 time-period measures of the same content area is higher than its longitudinal true-score correlations with other content areas. This criterion was achieved in 2 (Reading and Mathematics) of 5 CTBS/5 content subtests, as well as 1 (Language) of 6 MSPAP content subtests. The structural equation modeling has been conducted on a multitrait-multimethod correlation dataset, where the traits of Reading and Mathematics were assessed by MSPAP and the old version of CTBS/4. Although convergent validity existed in these 2 measures, there was little evidence to support discriminant validity in both measures.     

A Meta-Analysis of the Convergent Validity of Self-Control Measures

There is extraordinary diversity in how the construct of self-control is operationalized in research studies. We meta-analytically examined evidence of convergent validity among executive function, delay of gratification, and self- and informant-report questionnaire measures of self-control. Overall, measures demonstrated moderate convergence (r_random = .27 [95% CI = .24, .30]; r_fixed = .34 [.33, .35], k = 282 samples, N = 33,564 participants), although there was substantial heterogeneity in the observed correlations. Correlations within and across types of self-control measures were strongest for informant-report questionnaires and weakest for executive function tasks. Questionnaires assessing sensation seeking impulses could be distinguished from questionnaires assessing processes of impulse regulation. We conclude that self-control is a coherent but multidimensional construct best assessed using multiple methods.