A Psychometric Network Perspective on the Validity and Validation of Personality Trait Questionnaires

This article reviews the causal implications of latent variable and psychometric network models for the validation of personality trait questionnaires. These models imply different data generating mechanisms that have important consequences for the validity and validation of questionnaires. From this review, we formalize a framework for assessing the evidence for the validity of questionnaires from the psychometric network perspective. We focus specifically on the structural phase of validation, where items are assessed for redundancy, dimensionality, and internal structure. In this discussion, we underline the importance of identifying unique personality components (i.e. an item or set of items that share a unique common cause) and representing the breadth of each trait's domain in personality networks. After, we argue that psychometric network models have measures that are statistically equivalent to factor models but we suggest that their substantive interpretations differ. Finally, we provide a novel measure of structural consistency, which provides complementary information to internal consistency measures. We close with future directions for how external validation can be executed using psychometric network models. © 2020 European Association of Personality Psychology     

The Multiplicative AHP,SMART and ELECTRE in a Common Context

This paper presents a comparative study of three popular methods for multicriteria decision analysis based on a particular model of human preferential judgement. Since decisions are invariably made within a given context, we model relative preferences as ratios of increments or decrements in an interval on an axis of desirability. Next we sort the ratio magnitudes into a small number of categories, represented by numerical values on a geometric scale. We explain why the analytic hierarchy process (AHP) and the French collection of ELECTRE methods, typically based on pairwise comparison methods, are concerned with categories of ratio magnitudes, whereas the simple multiattribute rating technique (SMART) essentially uses orders of magnitude of these ratios. This phenomenon provides a common basis for the analysis of the methods in question and for a cross-validation of their results. We illustrate the approach via a well-known case study, the choice of a location for a nuclear power plant. We conclude by discussing the scope of the comparative study. © 1997 John Wiley & Sons, Ltd.     

Beyond the molar-molecular distinction: we need multiscaled analyses.

Dinsmoor's (2001) adherence to molecular analyses may require him to assert that molar and molecular principles are mutually exclusive, but to instead analyze the phenomena of avoidance as inherently multiscaled is to follow a well-established practice in the natural sciences. Besides the issue of scale, two-factor theory, which Dinsmoor advocates, has little to say about some important and longstanding results in experiments that qualify as avoidance.     

Cross-Validation of the Behavioral and Emotional Rating Scale-2 Youth Version: An Exploration of Strength-Based Latent Traits

High-quality measurement is a necessary requirement to develop and evaluate the effectiveness of programs that use strength-based principles and strategies. Using independent cross-validation samples, we report two studies that explored the construct validity of the BERS-2 Youth Report, a popular measure designed to assess youth strengths, whose conceptual structure has not yet been examined. In Study 1, an exploratory factor analysis found a four-factor solution with conceptual support, which included both internal assets associated with (a) the management of emotions and positive social interaction skills and (b) engagement in the important social contexts of family and school. In Study 2, confirmatory factor analyses found reasonable model fit for the BERS-2 five-factor structure and superior model fit for the more parsimonious four-factor solution found in Study 1. In future studies, parallel reporting of the four-factor model may provide additional insight to the nature and structure of the BERS-2 Youth Version’s clinical validity and utility when compared with the five-factor model, thus potentially contributing to a broader objective to develop a better understanding of important strength-based latent traits.     

Variation of Preference Inconsistency When Applying Ratio and Interval Scale Pairwise Comparisons

Several studies on numerical rating in discrete choice problems address the tendency of inconsistencies in decision makers' measured preferences. This is partly due to true inconsistencies in preferences or the decision makers' uncertainty on what he or she really wants. This uncertainty may be reflected in the elicited preferences in different ways depending on the questions asked and methods used in deriving the preferences for alternatives. Some part of the inconsistency is due to only having a discrete set of possible judgments. This study examined the variation of preference inconsistency when applying different pairwise preference elicitation techniques in a five‐item discrete choice problem. The study data comprised preferences of five career alternatives elicited applying interval scale and numerically and verbally anchored ratio scale pairwise comparisons. Statistical regression technique was used to analyse the differences of inconsistencies between the tested methods. The resulting relative residual variances showed that the interval ratio scale comparison technique provided the greatest variation of inconsistencies between respondents, thus being the most sensitive to inconsistency in preferences. The numeric ratio scale comparison gave the most uniform preferences between the respondents. The verbal ratio scale comparison performed between the latter two when relative residual variances were considered. However, the verbal ratio scale comparison had weaker ability to differentiate the alternatives. The results indicated that the decision recommendation may not be sensitive to the selection between these preference elicitation methods in this kind of five‐item discrete choice problem. The numeric ratio scale comparison technique seemed to be the most suitable method to reveal the decision makers' true preferences. However, to confirm this result, more studying will be needed, with an attention paid to users' comprehension and learning in the course of the experiment. Copyright © 2013 John Wiley & Sons, Ltd.     

Some thoughts on Likert-type scales

Many articles published in the International Journal of Clinical and Health Psychology describe the results obtained in studies that have used Likert-type scales. Such scales have advantages and disadvantages and in this article I comment on some of these. In particular I comment on the effects of using scales that start with the positive end and finish with the negative one, and on those that present high ratings on the left - as opposed to the right. I also consider that scores on negatively-worded items differ from those obtained on positively-worded ones and that it is not, therefore, appropriate to simply reverse the scores obtained on such items. Finally, I note that some items on these scales present more than one issue and it is hard to know whether when responding to these items, respondents are responding to all of the item or just one part.     

Interpersonal violence and its relationship to some personality measures

One hundred and fifteen patients in a psychiatric hospital for criminal offenders volunteered to be tested with the overcontrolled hostility scale, the self focus sentence completion, and an emotional empathy measure. The subjects were divided into five groups on the basis of criminal offenses (murder, assault with a deadly weapon, rape, pedophilia, and nonviolent property offenses). It was also possible to divide the sample on the basis of diagnostic features (psychosis, personality disorder, and brain syndrome). The results failed to support the hypothesis that more violent (by nature of their offense) individuals would-as a group-score higher on the overcontrolled hostility scale than less aggressive counterparts. There was some evidence that psychotics showed more self focus at the expense of external focus. The empathy measure failed to reveal any meaningful differences. It is suggested that more validation data are called for to establish the generality of the overcontrolled hostility scale and that, in view of the therapeutic importance which empathy training may have for violent individuals, further effort should be expanded to find a generally valid empathy measure.     

Adaptation et validation d’une version brève en langue française du questionnaire d’impulsivité de Barratt (BIS-15)

IntroductionThe Barratt Impulsiveness Scale is one of the most frequently used questionnaires to assess impulsivity. Many versions of the questionnaire were developed during the 50 years that followed its creation.ObjectivesThis article reports validation data for a French-language version of Spinella's (2007) BIS-15 questionnaire, a short version of Barratt's original scale (BIS-11; Patton, Standford, & Barratt, 1995).MethodReliability, principal component analyses and confirmatory factor analyses have been conducted with two university student samples (study 1, n = 366; study 2, n = 322).ResultsThe results of this study revealed a number of redundant items, which lead us to consider a unidimensional model with correlated measurement errors. Cronbach's alpha reliability was acceptable for study 1 (0.71), and satisfactory for study 2 (0.81). Test-retest reliability was also satisfactory (0.84). Elements of external validity (correlations with anxiety, neurosis, and extraversion) are reported.ConclusionsConsiderations regarding the type of response scales and assessment methods used in questionnaires are discussed in the conclusion.     

Fear of Death and Supernatural Beliefs: Developing a New Supernatural Belief Scale to Test the Relationship

Fear of death features in both historical and contemporary theories of religion, but the relationship between death anxiety and religious belief is still ambiguous, largely due to the use of inappropriate or imprecise measures. The current studies therefore aimed to develop a valid, targeted measure of respondents' tendency towards religious belief, the ‘Supernatural Belief Scale’ (SBS), and to use the SBS to examine the relation between death anxiety and religious belief. Results indicate that the SBS shows high reliability and convergent validity and that its relation to death anxiety depends on participants' religious identification: ‘religious’ participants fear death less the stronger their religious beliefs, whereas ‘non‐religious’ participants are more inclined towards religious belief the more they fear death. These studies contribute a new measurement tool for research on religious belief and provide a starting point for an experimental integration of discrepant research findings. Copyright © 2013 European Association of Personality Psychology     

Opening a donor's wallet: The influence of appeal scales on likelihood and magnitude of donation

We examine the influence of appeal scales on the likelihood and magnitude of donation in a large field experiment. We argue and show that the leftmost anchor on the appeal scale most strongly influences the likelihood of donating; the lower the anchor, the higher the donation likelihood. Furthermore, our findings indicate that increasing the steepness of the amounts on the appeal scale increases the magnitude of donations. Both effects are stronger for infrequent than for frequent donors. Our results demonstrate that by using what a charity knows about past donor behavior, it can alter appeal scales to change donation behavior.