The development and evaluation of a computer-administered measure of cognitive complexity

The present study presents and evaluates the Computer-Administered Rep Test (CART). The CART is a micro computer program that automates both the administration and scoring of a repertory grid based measure of cognitive complexity. Preliminary evaluation of the CART indicates that it provides a useful alternative to traditional paper-and-pencil administered repertory grid measures of cognitive complexity. We also examine the effect of an alternative scoring approach on the reliability of scores derived from role repertory grid measures of cognitive complexity. Results indicate that this scoring approach substantially enhances the reliability of cognitive complexity scores derived from both the paper-and-pencil and computer-administered measures.     

Quantifying construct validity: two simple measures

Construct validity is one of the most central concepts in psychology. Researchers generally establish the construct validity of a measure by correlating it with a number of other measures and arguing from the pattern of correlations that the measure is associated with these variables in theoretically predictable ways. This article presents 2 simple metrics for quantifying construct validity that provide effect size estimates indicating the extent to which the observed pattem of correlations in a convergent-discriminant validity matrix matches the theoretically predicted pattern of correlations. Both measures, based on contrast analysis, provide simple estimates of validity that can be compared across studies, constructs, and measures meta-analytically, and can be implemented without the use of complex statistical procedures that may limit their accessibility.     

The stability of structural measures derived from repertory grids

Although the use of repertory grids in psychological research has proliferated, studies of their psychometric properties are relatively rare. For this reason, we studied the reliability and convergence of several measures of cognitive structure derived from grids, including intensity, percentage of variance accounted for by the first component, cognitive complexity, ordination, extremity of ratings, self-ideal discrepancy, and self-other discrepancy, as well two measures of rating stability, construct consistency and factor loading consistency. Eighty-two Spanish (Catalan) and American participants completed small and large grids on each of four occasions, which enabled exploratory analyses of the impact of grid size and subject characteristics on the structural scores obtained. Results indicated that the majority of scores showed impressive test-relest reliability (modal r = .85 for periods up to 1 month), but also suggested a gradual tightening effect across subsequent administrations. In general, scores intercorrelated in theoretically anticipated ways, converging on the assessment of cognitive differentiation and discrimination of elements within construct dimensions. The results have implications for the reactivity of structural scores to variations in grid format, as well as for use of grids in the study of sex differences and cross-cultural comparisons.     

The Intolerable Wrestle: Words,Numbers, and Meanings

Repertory grids are used by some as the basis, and by others as the vehicle, for the transmission of meanings. This article is based on the premise that meanings are of paramount importance to those working within the framework of personal construct theory and attempts to establish two general propositions: (1) that, despite a considerable measure of content freedom, repertory grids severely constrain respondents; and (2) that it is difficult for meanings to pass through the linguistic constrictions of the grid matrix. Some implications of the argument are subsequently discussed.     

THE EFFECT OF REPERTORY GRID SCALE SIZE AND RATING DIRECTION ON STRUCTURAL MEASURES OF DIFFERENTIATION

Previous work by Soldz and Soldz (1989) indicated that variations in repertory grid features can have a significant impact on the interpretation of the Landfield Functionally Independent Construction Score (FIC), which is a measure of cognitive differentiation. In this study, we showed that four different grid measures (FIC, Total number of zeroes, and the number of midpoint ratings used to indicate either equality or nonapplicability) can be effected by the use of a certain scale size (3-point, 7-point, 13-point), and by the direction of administration (completing the grid in a downwards direction vs. an across-wise direction). In addition, correlations between the number of zero ratings and the total FIC scores for each of the different scale sizes and directions showed evidence to support and to qualify previous work conducted by Soldz and Soldz (1989). In general, high positive correlations were found, suggesting the impact of zero ratings on FIC scores. But the magnitude of the correlations between the zero ratings and the total FIC scores varied as a function of the scale size, the direction of administration, and the meaning of the zero rating (neutrality vs. nonapplicability), raising theoretical, as well as procedural, considerations for future repertory grid research.     

A difficulty with the functionally independent construction measure of cognitive differentiation

Abstract

Much effort has gone into development of measures of cognitive differentiation. One of the most frequently used measures is Landfield's Functionally Independent Construction (FIC). The present study of the personal constructs of psychotherapists raises issues regarding the validity of FIC. Forty therapists were administered a repertory grid (Rep Grid) assessing their construal of self, clients, and acquaintances on both elicited and supplied constructs. Ratings were completed using a seven-point Likert-type scale (? 3 to + 3). FIC was calculated separately for the parts of the Rep Grid involving acquaintance construal, client construal, the total elicited construct Rep Grid, and the total Rep Grid. These FIC scores were correlated with the number of zero ratings in the grids, producing correlations greater than .70. It is proposed that these results are largely due to the method of computing FIC.     

The development of a measure to assess vocational maturity in adults with delayed career development

The development and validation of a measure of vocational maturity for educationally and economically “disadvantaged” adults who experience delayed career development is described. The Adult Vocational Maturity Assessment Interview (AVMAI) measures the attitudinal, cognitive, and behavior aspects involved in coping with exploratory and early entrance stage vocational development tasks. The measure employs a structured interview format accompanied by a detailed content scoring manual. It includes 120 items which yield scores for eight scales: Orientation to Education; Orientation to Work; Concern with Choice; Self-Appraisal: Interests and Abilities; Self-Appraisal: Personality Characteristics; Self-Appraisal: Values; Exploring Occupations; and Using Resources. Evidence for the measure's reliability, content, and construct validity is presented by examining the internal consistency of the scales, the reliability of its scoring procedures, its interscale correlations, and its performance in a pretest-post-test experimental situation. Research and counseling uses of the measure are discussed in the context of the need for vocational psychologists to develop and use measures that are appropriate for the specific career development problems of different groups in society.     

A New Development to Aid Interpretation of Hierarchical Cluster Analysis of Repertory Grid Data

Hierarchical clustering is a common way to analyze repertory grid data, as it allows visual identification of homogeneous groups of elements and constructs. This article explores a bootstrap approach to clustering that additionally allows significance testing of dendrogram structures. Given that the choice of the specific clustering method and distance measure can be justified, the method yields indications of closely related element or construct structures. Closely integrated groups of constructs link to the concept of cognitive complexity. Several new complexity indexes are derived from the bootstrap solution. The behavior of the indexes is compared (a) across the most common clustering methods and distance measures and (b) to standard complexity measures. The derived measures reflect a different aspect of complexity than standard measures.     

Development of the Cognitive Dysfunction Questionnaire (CDQ) in a population based sample

The study reports on the development of a questionnaire for assessment of adult cognitive dysfunction (CDQ). Participants in a population-based sample (65±15 years, N=370) responded to a 90-item pilot version covering multiple aspects of memory/cognition. Based on exploratory principal components analyses and correlations with criterion measures of cognitive functioning (MMSE, Block Design, semantic/episodic memory), 20 items loading on 6 components were selected for the final version of the questionnaire. Cronbach's α for the total score was 0.90. There was evidence of construct validity as judged by correlations between CDQ scores, objective cognitive measures, and a subjective memory measure (PRMQ). Discriminant validity was demonstrated by a low and non-significant correlation with depressive symptoms. Further evidence of construct validity was provided by correlations with age and educational attainment. In conclusion, the CDQ is promising as a self-rating screening tool for cognitive dysfunction, and will be the subject of further development and validation.     

Expert and Target Scoring: Their relation,corresponding test instructions,and their effects on the construct validity of the video‐based social understanding test (VSU)

This study investigated the relation between expert and target scoring of a video‐based social understanding test (VSU) under two different types of instructions (internal and observer). The effects of the scoring methods and instructions on the VSU's construct validity were also examined. A total of 529 pilot applicants completed the VSU (some with internal and some with observer instructions), cognitive ability and knowledge tests, and a personality questionnaire. A subsample (n = 132) completed the VSU again with the other instructions and participated in an assessment center (AC). The two scores were moderately correlated; correlations decreased when the instructions were considered. Neither expert nor target scores showed convergent validity with AC variables; none of the scoring‐instruction combinations showed significant associations with the remaining measures.     

Preference or ability: Exploring the relations between risk preference,personality, and cognitive abilities

Key issues in the behavioral sciences are if there exist stable risk preferences that generalize across domains and if these are best measured by revealed risk preference (RRP) in behavioral decision tasks or by surveys eliciting stated risk preference (SRP). We applied network analysis to data from a representative Swedish sample to investigate the relations between RRP, SRP, personality characteristics, and cognitive abilities, using in total over 70 measurements. The results showed that different measures of RRP were poorly intercorrelated and formed a community together with measures of numerical and cognitive abilities. Measures of SRP were weakly correlated with measures of RRP and identified in a distinctly separate community, along with personality characteristics and gender. The ensuing analyses provided support for a model suggesting that RRPs are contaminated by demands on numerical and cognitive abilities. RRPs may thus suffer from poor construct validity, whereas SRPs may better capture people's everyday risk preferences because they are related to more stable traits.     

Familiarity,Cued and Free Odor Identification and Their Association with Cognitive Functioning in Middle Aged and Older Adults

ABSTRACT

The aim of the present study was to examine the association between familiarity of odors, cued and free odor identification performance and cognitive function in elderly adults. It was further investigated how age affects performance on the various odor tasks. A third aim was to investigate the role of familiarity in explaining performance on the free identification task. One hundred and thirty-six participants (aged 45–79 years) with normal olfactory sensitivity were assessed with the Scandinavian Odor Identification Test (SOIT) and standardized tests of cognitive function. Familiarity did not correlate with any measure of cognitive function, while verbal identification performance was associated with several cognitive measures, although correlations were modest. In this sample, free odor identification was affected by increasing age to a marginally larger extent than cued identification performance and familiarity ratings. The results suggest that the different olfactory tasks involve different levels of cognitive processing.     

Interactive Elicitation and Exchange of Knowledge

This paper gives a state-of-the-art report on the use of techniques based on personal construct psychology to automate interactive elicitation of cognitive structures for group learning and decision making. It outlines the structure and key components of the RepGrid implementation on a network of Macintosh computers, which includes tools for interactive reperto y grid elicitation and analysis, and a system for intemctizely exchanging and comparing reperto y grids from multiple simultaneous users on the network. The users of RepGrid are attempting to extend and understand their own thinking and problem-solving capabilities by interacting w'th other people. They are able to: see the relationship of thrir points of view to those of others explore differing termin, logy for the same constructs become aware of differing constructs having the same terminology extend their own construct systems with those of others provide others with constructs they have found valuable explore a problem-solving domain using the fill group resources     

Correlations among scores on measures of field dependence-independence cognitive style, cognitive ability, and sustained attention

The Children's Embedded Figures Test, the Rod and Frame Test to measure the field dependence-independence cognitive style, Cattell's Culture Fair Intelligence Tests to measure cognitive ability, and two cancellation tasks (Zazzo task and Bourdon task) to assess sustained attention were administered to 179 boys and 110 girls whose average age was 9.0 yr. Correlations between scores on measures of field dependence-independence and cognitive ability were moderated. Average correlations between scores on measures of field dependence-independence, cognitive ability, and measures of sustained attention was .23 for the Zazzo task and quite weak (.06) for the Bourdon task.     

Comparing continuous and dichotomous scoring of the balanced inventory of desirable responding

The Balanced Inventory of Desirable Responding (BIDR; Paulhus, 1994) is a widely used instrument to measure the 2 components of social desirability: self-deceptive enhancement and impression management. With respect to scoring of the BIDR, Paulhus (1994) authorized 2 methods, namely continuous scoring (all answers on the continuous answer scale are counted) and dichotomous scoring (only extreme answers are counted). In this article, we report 3 studies with student samples, and continuous and dichotomous scoring of BIDR subscales are compared with respect to reliability, convergent validity, sensitivity to instructional variations, and correlations with personality. Across studies, the scores from continuous scoring (continuous scores) showed higher Cronbach's alphas than those from dichotomous scoring (dichotomous scores). Moreover, continuous scores showed higher convergent correlations with other measures of social desirability and more consistent effects with self-presentation instructions (fake-good vs. fake-bad instructions). Finally, continuous self-deceptive enhancement scores showed higher correlations with those traits of the Five-factor model for which substantial correlations were expected (i.e., Neuroticism, Extraversion, and Conscientiousness). Consequently, these findings indicate that continuous scoring may be preferable to dichotomous scoring when assessing socially desirable responding with the BIDR.     

FACTORS AFFECTING INTERPERSONAL CONSTRUCT DIFFERENTIATION WHEN MEASURED USING THE REPERTORY GRID

This article focuses on the notion of Interpersonal Construct Differentiation (ICD) and its measurement, using measures derived from the repertory grid technique. To study the nature of these measures and factors such as grid size and type of scale that could affect them, a set of randomly generated grid data sets are compared to a sample of grids administered to subjects, among which we can distinguish a clinical (n = 422) and a nonclinical (n = 304) sample. Results show that ICD related measures derived from 140 randomly generated grids are clearly distinct from those of subjects. Subjects' grids show lower levels of ICD, polarization, and conflict. Grid size and type of scale exert a powerful mathematical effect on the values of these measures, as illustrated by the sample of random grids, but the grid size effect seems to vanish when applied to the subject sample. However, this mathematical effect should not be ignored in further research.     

Motives, values and moral judgments

This study examined McClelland's (1981) hypothesis that operant and respondent measures of personality are orthogonal and assess different dimensions of personality structure. An operant measure of motives, a sentence completion test, and two respondent measures of cognitive schema variables, the Rokeach Value Survey and the Defining issues Test, were administered to 311 subjects. As predicted and in support of McClelland's hypothesis, 69% of the correlations between the respondent measures were significant at the alpha .05 level of probability versus 14% of the correlations between the operant and respondent measures. Further, within the domain of cognitive schema variables, it was theoretically possible to predict which values would correlate with different levels of moral judgment. The findings were discussed in terms. of their implications for person x situation models of social interaction and the prediction of criterion variables from typologies of personality.     

Accounting for age differences on the Wisconsin Card Sorting Test: decreased working memory, not inflexibility

Two experiments examined the role of cognitive inflexibility and reduced working memory in age-related declines on the Wisconsin Card Sorting Test. Both standard scoring procedures and newly developed scores were used to measure each construct, and modifications of the test further evaluated the role of working memory. Results indicated that age differences are not due to cognitive inflexibility but that for a subset of older adults errors are associated with a reduction in the amount of information that can be stored or processed in working memory. These age differences disappear, however, when visual cues provide information about the immediately preceding sort. The authors conclude by proposing a decline in updating working memory as the explanation that can best account for the entire pattern of age differences on this test.