Measurement of ambiguity tolerance

Summary: Presented definitions for the construct of ambiguity tolerance. The measun: of ambiguity tolerance (MAT-50) had high internal reliability (r = .88) and high test-retest reliability (r = .86) over a 10-to-12 week period. A content analysis of the measure and a subjective imalysis by 20 graduate students indicated adequate content validity. A multivariate comparison with two other ambiguity measures, two rigidity measures, and a short dogmatism measure provided strong evidence for criteria-related validity. Finally, four independent empirical studies showed good construct validity.     

Therapeutic insight and tolerance of ambiguity

The author discusses the implications of the psychoanalytic concept of insight. He refers to it as an "action-steering utopia of the psychoanalytic process".     

Measuring the automatic negative self-schema: New evidence for the construct and criterion validity of the Depression Implicit Association

The construct and criterion validity of the Depression Implicit Association Test (Depression IAT) as a marker of an automatic negative self-schema was investigated. The Depression IAT and other measures were administered to a sample of 116 participants (72 females) aged 37.28 (SD = 15.69) that was composed by 56 patients with an history of suicide ideation (SI) and by 60 university students. Combining students and patients’ sub-samples, results revealed that the Depression IAT was significantly and positively correlated with self-report scales of depression and hopelessness as well as with implicit and explicit measures of death-life identification. On the contrary, it was negatively correlated with life satisfaction, optimism, and self-esteem scales. These results give new evidence for the construct validity of the Depression IAT. Moreover, considering only the patients’ sub-sample, significant correlations between Depression IAT scores and SI in the last year, month, and week, as well as in a follow-up observation two months later, were found. These correlations remain unchanged even when the Death IAT was controlled for, supporting the incremental validity of the Depression IAT. Overall, these results provide new evidence for the construct and criterion validity of the Depression IAT as a marker of an automatic negative self-schema.     

Emotional Intelligence in Personnel Selection: Applicant reactions,criterion, and incremental validity

In two studies, based on four samples and more than 600 participants, the authors examined applicant reactions, criterion and incremental validity, and differential prediction of emotional intelligence (EI) in personnel selection using the Mayer–Salovey–Caruso Emotional Intelligence Test. The first study examined applicant reactions in terms of face validity and fairness evaluation of the EI test. The second study examined across three samples (salespeople, front‐desk public employees, and hospital chief executive officers) the criterion validity, incremental validity, and differential prediction of EI. Results suggest that the EI test is perceived as a fair selection tool, and is predictive of performance. The EI test has incremental validity over cognitive abilities and personality (big five) when predicting subjective and objective performance criteria. Based on these results, the authors encourage further research on the use of EI in selection settings.     

A measure of parental stress in mothers with small children: dimensionality, stability and validity

Self-reported parental stress was investigated in three samples of mothers with small children, using a Swedish version of the Parenting Stress Index (PSI). Dimensionality in experienced stress using items from six PSI Parent Domain subscales and eight new items was examined in factor analyses of data from a nationwide representative sample. Cross-validation proved the chosen factor pattern to be stable. Based on an oblique 5-factor solution new subscales were constructed. A second order factor analysis indicated influence from a higher order factor, seen as a general parental stress construct. High alpha coefficients revealed that homogeneous subscales had been formed. Test-retest correlations indicated good stability over a mean time period of 30 days. Influences from maternal background variables were found, but no relation to child age or gender. Global estimates of parental stress, reported child problems, mothers' scoring on the Edinburgh Postnatal Depression Scale and two measures of social support all correlated significantly with overall parental stress, and with some subscales. The justification of the subscale approach to parental stress was discussed. It was concluded that the PSI in its present form could be used as a reliable and valid instrument for measuring experienced parental stress in mothers of young children.     

Psychological correlates of reasons for nonbelief: tolerance of ambiguity,intellectual humility,and attachment

ABSTRACT

The process of acquiring beliefs – including the belief that there is no God–is largely implicit. We propose that psychological factors that function largely outside of conscious awareness make different conscious reasons for nonbelief more plausible to different people. The present study focuses on intellectual humility, tolerance of ambiguity and attachment and how they relate to stated reasons for nonbelief. The survey was distributed online to an international network of over 100 atheist, secular, and freethought organisations. As predicted, emotional reasons for nonbelief were positively related to anxious attachment, and intellectual reasons for nonbelief were inversely related to tolerance of ambiguity. We did not find evidence for our hypotheses that intellectual reasons for belief would be related to intellectual humility, or that uncertainty reasons would be related to tolerance of ambiguity, intellectual humility, and avoidant attachment. We unexpectedly found that early socialisation reasons for nonbelief were negatively related to intellectual humility.     

Reinvestment: Examining convergent,discriminant, and criterion validity using psychometric and behavioral measures

Given scarce external validity available to date concerning the reinvestment construct, the aim of this four-study research project was to further explore the validity of the Movement-Specific Reinvestment Scale and the Decision-Specific Reinvestment Scale, using psychometric and behavioral measures. Study 1 showed that deliberative participants had a higher reinvestment tendency than intuitive participants. Study 2 showed that reinvestment was linked to self-consciousness, rumination, perfectionism, and had satisfactory test–retest reliability. Moreover, it provided some potential insights on the development of reinvestment due to parental criticisms. Study 3 indicated that high decision reinvestors performed worse than their low decision reinvestor counterparts in a visual search task under pressure. Study 4 showed that older participants had a lower reinvestment score, and that reinvestment was associated with higher motor imagery ability, challenging the idea that reinvestment can only be seen as detrimental to performance.     

Item validity of the Myers-Briggs Type Indicator

The present study presents a brief summary of four extensive psychometric analyses of the Myers-Briggs Type Indicator (MBTI) items. Positive empirical evidence supports the MBTI item validity. However, several measurement issues on item construction were raised to caution the future users.     

Further validation of the IDAS: evidence of convergent, discriminant, criterion, and incremental validity

The authors explicated the validity of the Inventory of Depression and Anxiety Symptoms (IDAS; D. Watson et al., 2007) in 2 samples (306 college students and 605 psychiatric patients). The IDAS scales showed strong convergent validity in relation to parallel interview-based scores on the Clinician Rating version of the IDAS; the mean convergent correlations were .51 and .62 in the student and patient samples, respectively. With the exception of the Well-Being Scale, the scales also consistently demonstrated significant discriminant validity. Furthermore, the scales displayed substantial criterion validity in relation to Diagnostic and Statistical Manual of Mental Disorders (4th ed.; DSM-IV; American Psychiatric Association, 1994) mood and anxiety disorder diagnoses in the patient sample. The authors identified particularly clear and strong associations between (a) major depression and the IDAS General Depression, Dysphoria and Well-Being scales, (b) panic disorder and IDAS Panic, (c) posttraumatic stress disorder and IDAS Traumatic Intrusions, and (d) social phobia and IDAS Social Anxiety. Finally, in logistic regression analyses, the IDAS scales showed significant incremental validity in predicting several DSM-IV diagnoses when compared against the Beck Depression Inventory-II (A. T. Beck, R. A. Steer, & G. K. Brown, 1996) and the Beck Anxiety Inventory (A. T. Beck & R. A. Steer, 1990).     

The relationships among sex-role orientation,cognitive complexity,and tolerance for ambiguity

Two hundred and four female and eighty-seven male college students completed the Schroder and Streufert measure of cognitive complexity, Budner's Intolerance for Ambiguity Scale, and Bem's Sex Role Inventory (BSRI). It was hypothesized that subjects classified as androgynous and as cross-sexed would be more cognitively complex and more tolerant of ambiguity than sex-typed or undifferentiated subjects; and cognitive complexity and intolerance for ambiguity would be negatively correlated. The data indicated that male and female androgynous and cross-sexed subjects were more tolerant of ambiguity than sex-typed subjects and cognitively more complex than undifferentiated subjects. Cross-sexed subjects were more cognitively complex than sex-typed subjects. Cognitive complexity and intolerance for ambiguity were negatively correlated. The BSRI had differential power to predict cognitive complexity depending upon sex of subject.Part of this research was presented at the Forty-Ninth Annual Convention of the Eastern Psychological Association, Washington, D.C., April 1978.Both authors are senior authors; each contributed equally to this work.     

Self‐reported attitude scales: current practice in adequate assessment of reliability,validity, and dimensionality

The development of methods to create self‐reported attitude scales has lost momentum, in part because of increased research focused on implicit measures. This paper reviews 162 papers on methodological approaches applied to the validation and assessment of attitude scales. Assessment of methodological approaches applied indicates that neither reliability, validity, nor dimensionality assessments are consistently used according to standard operating procedures or in accordance with best practice. Within current practices in the field of attitude scale development, the full potential of self‐report scales is not met, in part because of such methodological issues. The improvement of existing practices and adoption of promising new developments in attitude scale construction and evaluation are discussed, together with recommendations for best practice in scale validation.     

Averaging: An empirical validity criterion for magnitude estimation

Ss judged grayness of neutral value Munsell chips under two response conditions: magnitude estimation and graphic rating. In addition, they judged average grayness of pairs of chips under the same two response modes. The averaging data were evaluated in terms of a simple model for subjective averaging. The graphic rating data fitted the model, but the magnitude estimates showed consistent discrepancy. It was concluded that the Ss were averaging, but that magnitude estimation distorted their judgments.     

Item Randomized-Response Models for Measuring Noncompliance: Risk-Return Perceptions,Social Influences,and Self-Protective Responses

Randomized response (RR) is a well-known method for measuring sensitive behavior. Yet this method is not often applied because: (i) of its lower efficiency and the resulting need for larger sample sizes which make applications of RR costly; (ii) despite its privacy-protection mechanism the RR design may not be followed by every respondent; and (iii) the incorrect belief that RR yields estimates only of aggregate-level behavior but that these estimates cannot be linked to individual-level covariates. This paper addresses the efficiency problem by applying item randomized-response (IRR) models for the analysis of multivariate RR data. In these models, a person parameter is estimated based on multiple measures of a sensitive behavior under study which allow for more powerful analyses of individual differences than available from univariate RR data. Response behavior that does not follow the RR design is approached by introducing mixture components in the IRR models with one component consisting of respondents who answer truthfully and another component consisting of respondents who do not provide truthful responses. An analysis of data from two large-scale Dutch surveys conducted among recipients of invalidity insurance benefits shows that the willingness of a respondent to answer truthfully is related to the educational level of the respondents and the perceived clarity of the instructions. A person is more willing to comply when the expected benefits of noncompliance are minor and social control is strong. The authors are grateful to the reviewers whose suggestions helped to improve the clarity of the paper substantially. The authors also wish to thank the Dutch Ministry of Social Affairs and Employment for making the reported data available. This research was supported in parts by grants from the Social Sciences and Humanities Research Council of Canada and the Canadian Foundation of Innovation.     

The Rotter locus of control scale: The comparison of alternative response formats and implications for reliability, validity, and dimensionality

Participants completed the Rotter internal/external (IE) instrument using three different response formats before and after completion of the Outward Bound program, and were evaluated by external observers at the end of the intervention. Multitrait-multimethod analyses indicated that five specific IE facets identified in previous research were consistently distinguished with each of the response formats. While responses were substantially more internal after the intervention, effect sizes varied with the IE facet and with the response format. Observer responses were significantly correlated with self-responses, and provided additional support for the construct validity of responses to the Rotter instrument and the interpretation of the intervention effect. Nevertheless, problems with the Rotter instrument were identified, and the implications for further research were discussed.     

The relationship between tolerance of ambiguity and attitudinal conservatism: a multidimensional analysis

The predictions of four social psychological theories of the relationship between cognitive style and conservatism—the theory of the authoritarian personality, extremism theory, context theory, and value pluralism theory—are examined in two empirical studies. Unlike previous research, these studies employ a measure of ambiguity tolerance, the Attitudinal Ambiguity Tolerance scale, which can assess cross-content variability in cognitive style. The results of the two studies conflict with the expectations of all four theories. In particular, only certain aspects of conservatism were related to ambiguity tolerance toward a particular content domain; and massive variability was evident in the shape of the relationship between ambiguity tolerance and conservatism across different content domains of ambiguity tolerance. The results are discussed in terms of value conflict which arises from endorsing conservative beliefs in a liberal institutional context. © 1998 John Wiley & Sons, Ltd.     

A reanalysis of two scales of tolerance of ambiguity

Important reviews of the tolerance of ambiguity literature have shown that the concept has become overextended and its elements remain unsupported by the confused data collected, and scales with inadequate psychometric performance have been used. In the present study 631 subjects responded to Budner's (1962) test of Intolerance of Ambiguity and MacDonald's (1970) revision of Rydell and Rosen's (1966) Tolerance of Ambiguity Scale. These scales were chosen because they seemed somewhat less suspect than others. Tests of other personality dimensions which the literature reviews suggested were likely correlates of intolerance of ambiguity were also included. Initial results were uneven and inconclusive. After using item analysis to reduce the tests, more logical and consistent results were obtained. These help to clarify the concept, differentiating sharply between its supposed primary and secondary elements. Three studies in which the reduced tests were used with desirable results are reported.     

Set ambiguity: A key determinant of reliability and validity in the picture story exercise

The picture story exercise (PSE), in which participants write imaginative stories in response to motivationally-arousing images, is the most commonly-used tool for the assessment of implicit motives. Despite decades of research into the qualities of effective individual picture cues, much less is known about the desirable properties of overall picture sets. The present research highlights a previously undocumented methodological consideration—set ambiguity—which has important implications for the reliability and validity of the PSE. In a four-part study of 74 undergraduates, motive scores derived from an ambiguous picture set comprising cues that vary in motivational focus displayed greater test–retest reliability, convergent validity, and predictive validity than those derived from an unambiguous picture set. Researchers are therefore advised to consider set ambiguity when selecting images for use in PSE research.