Normativity and Desirability in Observational Assessments of Family Interaction

Issues of normativity (responding in a typical or average fashion) and desirability (the tendency for raters to endorse positive characteristics rather than neutral or more negative ones) are common in areas of the social sciences that frequently utilize profile correlations to measure dyadic similarity. They have implications for family scholars as well. In the present study, a pre‐existing data set was used to make an initial, though limited, investigation into potential confounds of normativity and desirability for macrolevel observational assessments of family interaction. An empirical example is presented using q‐sort ratings of family interaction, with variance in observational assessments decomposed into component parts. High levels of both normativity and desirability were found, indicating possible problems in terms of both reliability and validity of assessment. While the results provide an interesting beginning, they are limited due to the use of a q‐sort methodology as well as an instrument with limited background and use. These limitations are discussed, as well as alternative interpretations for normativity and desirability and implications for future research.     

A multitrait-multimethod validation of the Implicit Association Test: implicit and explicit attitudes are related but distinct constructs

Recent theoretical and methodological innovations suggest a distinction between implicit and explicit evaluations. We applied Campbell and Fiske's (1959) classic multitrait-multimethod design precepts to test the construct validity of implicit attitudes as measured by the Implicit Association Test (IAT). Participants (N = 287) were measured on both self-report and IAT for up to seven attitude domains. Through a sequence of latent-variable structural models, systematic method variance was distinguished from attitude variance, and a correlated two-factors-per-attitude model (implicit and explicit factors) was superior to a single-factor-per-attitude specification. That is, despite sometimes strong relations between implicit and explicit attitude factors, collapsing their indicators into a single attitude factor resulted in relatively inferior model fit. We conclude that these implicit and explicit measures assess related but distinct attitude constructs. This provides a basis for, but does not distinguish between, dual-process and dual-representation theories that account for the distinctions between constructs.     

The impact of social desirability on psychometric measures of aggression

Although many studies have focused on the effects of social desirability in personality measures, few have analysed its effects on such highly undesirable behaviour as aggressiveness. The present study analyzes the impact of social desirability on measures of direct and indirect aggression and on the relationships between both kinds of aggression with impulsivity, using a method that enables the content factors of the measures to be isolated from social desirability. Results showed that aggression measures are highly affected by social desirability and that the relationships between the two forms of aggression and impulsivity are due to the content measured by the tests and not to a common social desirability factor.     

RELATIONSHIPS BETWEEN RESPONSE STABILITY AND ITEM ENDORSEMENT,SOCIAL DESIRABILITY,AND AMBIGUITY IN THE MMPI AND THE CPI

Relationships between two indices of response stability and item endorsement, social desirability, and seven ambiguity indices were investigated separately within the MMPI, the unique items of the CPI, and two subpools moderate in endorsement and social desirability. Within the two original pools, zero-order correlations and multiple regression analyses revealed that only extremeness of endorsement and social desirability were substantially related to response stability; within the moderate subpools, however, indices of ambiguity-especially item length and ratings of global ambiguity, behavioral reference, and estimated stability-accounted for important degrees of variance individually as well as in combination. Reasons for the moderating effects of endorsement and social desirability are discussed, as are the implications for scale construction.     

Accounting for the evaluative factor in self-ratings provides a more accurate estimate of the relationship between personality traits and well-being

Social desirability may cause spurious relations in self-rating measures. The present study sought to disentangle socially desirable responding and content in the relation between measures of personality traits and well-being. Social desirability was operationalized as the evaluative factor (the tendency to react to evaluative content in questionnaire items). We collected self- and peer-ratings of personality and self-ratings of well-being from 219 participants. The evaluative factor in personality self-ratings significantly predicted well-being and explained more variance than all Big Five traits combined. The evaluative factor in personality peer-ratings had no unique relation to well-being. These findings suggest that previous estimates of the relationship between personality traits and well-being have generally been exaggerated. Different methods of accounting for social desirability are discussed.     

Two Dimensions of Attachment to God and Their Relation to Affect, Religiosity, and Personality Constructs

In this study we sought to address several limitations of previous research on attachment theory and religion by (1) developing a dimensional attachment to God scale, and (2) demonstrating that dimensions of attachment to God are predictive of measures of affect and personality after controlling for social desirability and other related dimensions of religiosity. Questionnaire measures of these constructs were completed by a sample of university students and community adults (total n = 374). Consistent with prior research on adult romantic attachment, two dimensions of attachment to God were identified: avoidance and anxiety . After statistically controlling for social desirability, intrinsic religiousness, doctrinal orthodoxy, and loving God image, anxious attachment to God remained a significant predictor of neuroticism , negative affect , and (inversely) positive affect ; avoidant attachment to God remained a significant inverse predictor of religious symbolic immortality and agreeableness . These findings are evidence that correlations between attachment to God and measures of personality and affect are not merely byproducts of confounding effects of socially desirable responding or other dimensions of religiosity.     

Comparison of self-reports, reports by knowledgeable informants, and behavioral observation data

The strengths and weaknesses for the assessment of personality characteristics of self-reports, reports by knowledgeable informants, and measures based on behavioral observation data are discussed and compared It is suggested that measurement methods should be evaluated with respect to Loevinger's concept of structural validity The concept of structural validity is expanded to include evidence that the scores have properties paralleling the theoretical definition of the characteristic with respect to reliability over occasions, range of referent attributes sampled, and generality across situations or the specification of situation parameters Each of the methods is evaluated for its potential to construct measures with structural validity for different models of constructs The methods are also discussed in relation to several other common threats to validity, specifically, threats stemming from the respondent, from the investigator, and from sampling errors It is likely that demonstrations of convergence between these methods will be possible for some but not all constructs It is also suggested that the examination of structural validity will contribute to the evolution and refinement of constructs appropriate for interactionist theories     

Relationships between Growth need Strength and selected individual differences measures employed in job design research

The present study examines the degree to which the Growth Need Strength scales (Job Choice and Would Like formats) of the Job Diagnostic Survey (Hackman & Oldham, Journal of Applied Psychology, 1975, 60, 159–170) correlate with (a) other measures of needs and values employed in research as moderators of the job scope-job satisfaction relationship and (b) a measure of social desirability. Results showed (a) only moderate correlations between the Growth Need Strength scales and the other measures of needs and values and (b) a relatively high degree of correlation between social desirability and the Would Like measure of Growth Need Strength. Implications of these findings for job design research are considered.     

Probing item social desirability by correlating personality items with Balanced Inventory of Desirable Responding (BIDR): A validity examination

Researchers often include a social desirability measure in personality measures, commonly the Balanced Inventory of Desirable Responding (BIDR), and correlate it with personality items to probe for social desirability of the items. A strong correlation between BIDR scores and a personality item would indicate high item social desirability. The current research assesses the validity of this practice. Results showed that these correlations have high validity only when BIDR scores are calculated as a continuous variable rather than as dichotomized item scores. In addition, self-deception scores have higher validity for detecting item social desirability than do impression management scores. The current research supported the use of the self-deception scores, in particular, to detect highly desirable or undesirable items.     

A general factor of personality,social desirability,cognitive ability,and the survey of work styles in an employment selection setting

How a general factor of personality (GFP) correlated with employment screening measures in an applied setting was examined. Participants were 540 adult insurance sales job applicants who completed scales from two personality measures, the five scales from the Survey of Work Styles (SWS), an intelligence measure, and a social desirability scale. A joint factor analysis of the personality questionnaires produced four first order factors. A single GFP was also extracted. Strong correlations were found between some of the personality factors and the SWS scales. Strong significant correlations were found between the GFP and three of the four personality factors with social desirability. Neither the GFP nor the personality factors correlated significantly with cognitive abilities.     

Employing automatic approach and avoidance tendencies for the assessment of implicit personality self-concept: The implicit association procedure (IAP)

A new chronometric procedure, the Implicit Association Procedure (IAP), was adapted to assess the implicit personality self-concept of shyness. A sample of 300 participants completed a shyness-inducing role play and, before or after the role play, a shyness IAP, a shyness Implicit Association Test (IAT), and direct self-ratings. The experimental group was instructed to fake nonshyness. The control group did not receive this instruction. IAT and IAP were unaffected by position effects, and were less susceptible to faking than direct self-ratings with regard to mean levels and correlates. Under faking, correlations between direct and indirect measures decreased, and direct but not indirect measures showed higher correlations with social desirability and lower correlations with observed shyness. Despite many similarities, the true correlation between IAT and IAP was estimated only .61, indicating high method-specific variance in both procedures. The findings suggest that indirect measures are more robust against faking than traditional self-ratings but do not yet meet psychometric criteria for practical assessment purposes.     

Testing attitudes,social desirability and behavioral regulations as moderators of implicit-explicit exercise discrepancies: A replication study in Iranian students

IntroductionThere is mixed evidence regarding moderators of the relationship between implicitly and explicitly measured constructs. This study examined this issue with evaluations of exercise relative to health or appearance in a sample of Iranian adolescents. Investigaing automatic associations and reflective constructs might provide important implications for developing interventions targeting exercise behavior in a population with different cultural, social, and economic barriers to exercise than European or North American adolescents.MethodsParticipants were 471 students enrolled in grades 9 to 12, of whom 269 (54.9%) were female. Behavioral regulations, explicit attitudes, and social desirability were investigated as possible moderators. All students completed questionnaire measures of physical activity behavior, attitudes, social desieality and behavioral regulation. They also completed two Go/No Go Association tasks to measure automatic associations of exercise with health and apperarance.ResultsAttitude was a significant moderator of discrepancies between automatic associations of exercise with health and health motives. Interjected regulation moderated implicit-explicit appearance discrepancies. Participants with low social desirability and negative automatic appearance associations had the highest appearance motivation.ConclusionsParticipants focused on the potential of achieving positive health outcomes of exercise rather than physical appearance outcomes, which differs from research from other countries. It is possible that, health was strongly linked with exercise by the pervasive societal pressures in Iran to have a healthy body.     

THEORY TESTING: COMBINING PSYCHOMETRIC META-ANALYSIS AND STRUCTURAL EQUATIONS MODELING

This paper presents an overview of a useful approach for theory testing in the social sciences that combines the principles of psychometric meta-analysis and structural equations modeling. In this approach to theory testing, the estimated true score correlations between the constructs of interest are established through the application of meta-analysis (Hunter & Schmidt, 1990), and structural equations modeling is then applied to the matrix of estimated true score correlations. The potential advantages and limitations of this approach are presented. The approach enables researchers to test complex theories involving several constructs that cannot all be measured in a single study. Decision points are identified, the options available to a researcher are enumerated, and the potential problems as well as the prospects of each are discussed.     

Parents' and Teachers' Implicit Theories of Children's Creativity: A Cross-Cultural Perspective

ABSTRACT: A social validation methodology was applied across two cultures to examine the implicit theories of parents and teachers. Adults (N = 150) from the United States and India were rated on 68 adjectives for creativity and desirability. The results indicated that all groups distinguished between indicative and contraindicative aspects of creativity and, for the most part, viewed creative traits desirably. These results were qualified by the adjectives that received high ratings for creativity but significantly lower ratings for desirability. These provided evidence that creativity and desirability are related yet separate constructs and that parents and teachers recognize that some traits associated with creativity may be undesirable. Multiple analysis of variance (MANOVA) revealed significant differences between the United States and India for intellectual and attitudinal clusters of adjectives, p < .001; however, parent and teacher differences were not found, p > .05. These findings support the notion that implicit theories are influenced by cultural traditions and expectations.     

Uncertainty and social comparison

Two experimetnal tests were conducted of a model which predicts social comparison choices of extreme scores on a personality inventory. In groups of nine, subjects completed a bogus personality inventory that ostensibly measured a desirable or undesirable trait, and were told that either the highest or the lowest obtained score was a positive instance of the trait. The highest score was located for the subjects either with certainty or uncertainty, and the two experiments employed different manipulations of this factor. In both experiments the pattern of subjects' social comparison choices of other subjects' scores was fit best by a model comprising main effects of each factor and interactions between desirability and positive instance and between desirability and certainty.     

Adolescent suicidal behavior and popular self-report instruments of depression, social desirability, and anxiety

Popular self-report inventories of depression, hopelessness, social desirability, and anxiety, along with the Suicidal Behaviors Questionnaire, were completed by 150 college students. Tanaka-Matsumi and Kameoka (1986) had questioned the use of popular depression instruments in the assessment of this population, due to the high correlation between depression, anxiety, and social desirability scales. The present experiment also found significant correlations between the self-report instruments and suicidal behaviors. These findings may be due to the fact that anxiety and depression are often found together in clinical settings, and that the content of depression and anxiety scales is not specific to those constructs.     

Norwegian short-form of the Marlowe-Crowne Social Desirability Scale

A tutorial example demonstrates the effects of social desirability bias on fictional multiculturalism and mental health data and how bias can be moderated by parital correlations using social desirabiliry measures of different degrees of validity. The 33-item Marlowe-Crowne Social Desirability scale was translated from English to Norwegian and presented to 117 university students and 124 non-students. Using psychometric criteria, and a "seed-crystal" method accretion, a 10-item Norwegian short-form of the Marlowe-Crowne scale was produced.     

Evaluating the Distorting Effects of Inattentive Responding and Social Desirability on Self‐Report Scales in Creativity and the Arts

Inattentiveness and social desirability might be particularly problematic for self‐report scales in creativity and arts research. Respondents who are inattentive or who present themselves favorably will score highly on scales that yield positively skewed distributions and that assess socially valued constructs, such as scales measuring creativity and arts knowledge. A total of 204 undergraduates completed an online survey with several self‐report measures (the Creative Achievement Questionnaire, the Biographical Inventory of Creative Behavior, and the Aesthetic Fluency Scale). Many metrics of inattentiveness were included, such as directed response items, self‐reported attentiveness, and scales to catch inconsistent and patterned responses. The Balanced Inventory of Desirable Responding measured facets of social desirability. We found high rates of inattentive responding. A latent class analysis indicated that around 25% of the sample was potentially inattentive, and inattentive respondents received higher scores on the creativity and arts scales. Excluding problematic participants increased the effect sizes of interest, consistent with the coarsening effect of careless participants. Social desirability, in contrast, had essentially no relationship with the creativity and arts scales. These findings suggest that social desirability is probably less of a problem than researchers fear, but that inattentiveness is an underappreciated threat. Some practical guidelines are suggested.     

On the division of working memory and long-term memory and their relation to intelligence: A latent variable approach

The present study examined the extent to which working (WM) and long-term memory (LTM) reflect the same, related, or completely different constructs and how they relate to other cognitive ability constructs. Participants performed various WM, recall, recognition, general fluid (gF) and general crystallized intelligence (gC) measures. Confirmatory factor analyses suggested that the memory measures could be grouped into three separate yet correlated factors (WM, recall, and recognition) and that these factors were strongly related to gF, but were related less so with gC. Furthermore, it was found that the common variance from the three memory factors could be accounted for by a higher-order memory factor which was strongly related to gF, but less so with gC. Finally, structural equation modeling suggested that both the variance common to the WM tasks and the variance common to all the memory tasks accounted for a unique variance in gF. These results are interpreted within an embedded process model of memory and suggest that WM and LTM tasks measure both shared and unique processes, which are important for intelligence.     

Self-activation increases social comparison

In a series of studies it was demonstrated that activating the self is sufficient to increase social comparison tendencies. Treating the relevant constructs as individual differences that can be measured as well as contextual variables that can be manipulated, the authors show that individual differences in self-activation are correlated with interest in social comparison information and that manipulations of self-activation cause changes in interest in social comparison. Self-certainty often has been portrayed as the primary determinant of social comparison interest. The present results suggest that self-activation affects interest in social comparison even when self-certainty is controlled.