Automated Integrative Complexity: Current Challenges and Future Directions

Automating integrative complexity is fraught with many challenges. To address these challenges, we discuss the tension between a specificity approach and a more flexible multiple‐pass approach, the multifaceted nature of the complexity construct, the gold standard for complexity measurement, the difficulty of human scoring and its consequences for automation, and some ways forward for creating the best complexity measurements. In so doing, we present new data demonstrating (1) initial evidence for the validity of a new automated system for measuring two different forms of complexity (elaborative and dialectical), (2) the danger of constructing measurements in a purely ad hoc fashion that ignores prospective testing, (3) human‐to‐computer correspondence is in part a function of human‐to‐human correspondence, (4) human‐to‐computer correspondence increases systematically as one uses tests with larger units of analysis, and (5) the lack of correspondence of different systems (both human and automated) may occur in part because they were designed for different units of analysis.     

Does Complex or Simple Rhetoric Win Elections? An Integrative Complexity Analysis of U.S. Presidential Campaigns

Research suggests that the integrative complexity of political rhetoric tends to drop during election season, but little research to date directly addresses if this drop in complexity serves to increase or decrease electoral success. The two present studies help fill this gap. Study 1 demonstrates that, during the Democratic Party primary debates in 2003–2004, the eventual winners of the party nomination showed a steeper drop in integrative complexity as the election season progressed than nonwinning candidates. Study 2 presents laboratory evidence from the most recent presidential campaign demonstrating that, while the complexity of Obama's rhetoric had little impact on college students' subsequent intentions to vote for him, the complexity of McCain's rhetoric was significantly positively correlated with their likelihood of voting for him. Taken together, this research is inconsistent with an unqualified simple is effective view of the complexity‐success relationship. Rather, it is more consistent with a compensatory view: Effective use of complexity (or simplicity) may compensate for perceived weaknesses. Thus, appropriately timed shifts in complexity levels, and/or violations of negative expectations relevant to complexity, may be an effective means of winning elections. Surprisingly, mere simplicity as such seems largely ineffective.     

The Influence of Social and Economic Background on Stanford-Binet Performance

Summary

The relationship of integrative complexity to the favorability of impressions was investigated. It was hypothesized that (a) favorability of impressions of subjects of high integrative complexity would be less affected by a positive or negative set than the favorability responses of subjects low in integrative complexity, and (b) when no set was induced, that subjects of high integrative complexity would form more favorable impressions of an inconsistently behaving target person than subjects of low integrative complexity. The hypotheses were basically supported for female subjects, but not for male subjects.     

AUTOMATED MEASUREMENT IN APPLIED BEHAVIOR ANALYSIS: A REVIEW

Measurement is a critical aspect of the scientific process. If measurement systems are not accurate and precise, the findings of experiments will most likely be spurious. In applied behavior analysis, the most prevalent form of measurement is human observation with automated measurement being used sporadically. Automated measurement is generally more accurate as it minimizes recording error. This paper reviews some of the common measurement systems currently in use and examines some new technologies that may expand the use of automated recording in the future. Copyright © 2013 John Wiley & Sons, Ltd.     

Test‐Specificity of the Advantage of Retaking Cognitive Ability Tests

In selection settings, when people retake the same cognitive ability tests, scores are generally positively biased. Our approach aimed to test whether these previous exposure effects are test‐specific or transferable to other tests. We compared the differences between scores for first‐time test takers and retakers for 2 kinds of material: ‘old’ tests, known only to the retakers, and ‘new’ tests, unknown to both groups. The current study used data collected during 2 sessions –S and S+1 – of a selection process for entry into the French national air transport pilot training system, with at least 500 first‐time test takers and 130 retakers in each session. For Session S, on average, retakers scored higher on the ‘old’ tests, but not on the ‘new’ tests. Moreover, the material that was new to retakers at Session S was old at Session S+1, and the finding for old tests could be replicated at Session S+1. The finding that the acquired skills that led to higher scores on old tests were only test‐specific is discussed.     

Scientific Creativity: Divergent and Convergent Thinking and the Impact of Culture

This paper examines the contrast and distinction between divergent and convergent scientific creativity, and the paradoxical relationship of scientific creativity with cultural factors in elementary students. With a newly developed measure of potential for scientific creativity, EPoC Science (Lubart et al., in press), students produce ideas in response to scientific problems, and both divergent‐exploratory as well as convergent‐integrative processes involved in scientific creativity are analyzed. An empirical study (n = 118) was conducted in France with elementary school children (ages 7–10). The divergent‐exploratory task was scored for fluency and statistical uniqueness. For the convergent‐integrative task, the number of concepts that a student integrated and synthesized, and the originality of the synthesis were scored. Results showed that divergent and convergent task performances were weakly related to each other. This suggests that divergence and convergence are two relatively distinct processes for scientific creativity, and that the relation is more complex than commonly assumed. In terms of culture‐related variables, immigrant cultural background (number of family members born outside of France) was significantly and negatively correlated with the originality of divergent and convergent scientific creativity. Findings are discussed and educational implications are proposed.     

Are Conservatives Really More Simple‐Minded than Liberals? The Domain Specificity of Complex Thinking

Prior research suggests that liberals are more complex than conservatives. However, it may be that liberals are not more complex in general, but rather only more complex on certain topic domains (while conservatives are more complex in other domains). Four studies (comprised of over 2,500 participants) evaluated this idea. Study 1 involves the domain specificity of a self‐report questionnaire related to complexity (dogmatism). By making only small adjustments to a popularly used dogmatism scale, results show that liberals can be significantly more dogmatic if a liberal domain is made salient. Studies 2–4 involve the domain specificity of integrative complexity. A large number of open‐ended responses from college students (Studies 2 and 3) and candidates in the 2004 Presidential election (Study 4) across an array of topic domains reveals little or no main effect of political ideology on integrative complexity, but rather topic domain by ideology interactions. Liberals are higher in complexity on some topics, but conservatives are higher on others. Overall, this large dataset calls into question the typical interpretation that conservatives are less complex than liberals in a domain‐general way.     

The “Deliberative Digital Divide:” Opinion Leadership and Integrative Complexity in the U.S. Political Blogosphere

This study examined the association between political ideology and linguistic indicators of integrative complexity and opinion leadership in U.S. political blog posts (N = 519). Using Linguistic Inquiry and Word Count (LIWC) text analysis, we found that the posts of conservative bloggers were more integratively simple than those of liberal bloggers. Furthermore, in support of a proposed opinion leadership model of integrative complexity, the relationship between ideology and integrative complexity was mediated by psychological distancing (an indicator of a hierarchical communication style). These findings demonstrate an ideological divide in the extent to which the blogosphere reflects deliberative democratic ideals.     

The mixed blessings of migration: Life satisfaction and self‐esteem over the course of migration

We investigated the psychological adaptation of Ingrian–Finnish migrants from Russia to Finland between 2008 and 2013. Pre‐migration data (N = 225) were collected at the Finnish language courses that were part of the immigration training program. The three post‐migration follow‐ups were conducted half a year (N = 155), and 2 (N = 133) and 3 years (N = 85) after migration. Well‐being was assessed with measures of Life Satisfaction and Self‐Esteem. Life Satisfaction increased from pre‐migration to the first post‐migration measurement point, after which it stabilized. Self‐Esteem decreased throughout the study. Variables reflecting adjustment to the event of migration (e.g., acculturation stress, socio‐cultural adaptation) were primarily associated with well‐being at the first post‐migration measurement point. More general determinants of well‐being (e.g., social support and subjective economic situation) were more consistently associated with well‐being throughout the study. The results suggest that migration can be beneficial to some but detrimental to other types of well‐being.     

International comparison of group differences in general mental ability for immigrants versus non‐immigrants

Globalization has led to increased migration and labor mobility over the past several decades and immigrants generally seek jobs in their new countries. Tests of general mental ability (GMA) are common in personnel selection systems throughout the world. Unfortunately, GMA test scores often display differences between majority groups and ethnic subgroups that may represent a barrier to employment for immigrants. The purpose of this study was to examine differences in GMA based on immigrant status in 29 countries (or jurisdictions of countries) throughout the world using an existing database that employs high‐quality measurement and sampling methodologies with large sample sizes. The primary findings were that across countries, non‐immigrants (n = 139,464) scored approximately half of a standard deviation (d = .53) higher than first‐generation immigrants (n = 22,162) but only one‐tenth of a standard deviation (d = .12) higher than second‐generation immigrants (n = 6,428). Considerable variability in effect sizes was found across countries as Nordic European and Germanic European countries evidenced the highest non‐immigrant/first‐generation immigrant mean differences and Anglo countries the smallest. Countries with the lowest income inequality tended to evidence the highest differences in GMA between non‐immigrants and first‐generation immigrants. Implications for GMA testing as a potential barrier to immigrant employment success and the field's current understanding of group differences in GMA test scores will be discussed.     

The Eysenckian personality factors and their correlations with academic performance

Background. The relationship between personality and academic performance has long been explored, and a recent meta‐analysis established that measures of the five‐factor model (FFM) dimension of Conscientiousness have similar validity to intelligence measures. Although currently dominant, the FFM is only one of the currently accepted models of personality, and has limited theoretical support. In contrast, the Eysenckian personality model was developed to assess a specific theoretical model and is still commonly used in educational settings and research. Aims. This meta‐analysis assessed the validity of the Eysenckian personality measures for predicting academic performance. Sample. Statistics were obtained for correlations with Psychoticism, Extraversion, and Neuroticism (20–23 samples; N from 8,013 to 9,191), with smaller aggregates for the Lie scale (7 samples; N= 3,910). Methods. The Hunter–Schmidt random effects method was used to estimate population correlations between the Eysenckian personality measures and academic performance. Moderating effects were tested using weighted least squares regression. Results. Significant but modest validities were reported for each scale. Neuroticism and Extraversion had relationships with academic performance that were consistent with previous findings, while Psychoticism appears to be linked to academic performance because of its association with FFM Conscientiousness. Age and educational level moderated correlations with Neuroticism and Extraversion, and gender had no moderating effect. Correlations varied significantly based on the measurement instrument used. Conclusions. The Eysenckian scales do not add to the prediction of academic performance beyond that provided by FFM scales. Several measurement problems afflict the Eysenckian scales, including low to poor internal reliability and complex factor structures. In particular, the measurement and validity problems of Psychoticism mean its continued use in academic settings is unjustified.     

Subgroup differences in situational judgment test scores: Evidence from large applicant samples

To promote diversity in organizations it is important to have accurate knowledge about subgroup differences associated with selection procedures. However, current estimates of subgroup differences in situational judgment tests (SJTs) are overwhelmingly based on range‐restricted incumbent samples that are downwardly biased. This study provides much‐needed applicant level estimates of SJT subgroup differences (N = 37,530). As a key finding, Black‐White differences (d = 0.66) were higher than in incumbent samples (d = 0.38). Overall, sex differences were small. Females scored higher for management jobs (d = ?0.13) and males scored higher for administrative jobs (d = 0.15). By analyzing applicant samples that do not suffer from range restriction, this study adds knowledge about subgroup differences in SJTs.     

Measuring icon complexity: An automated analysis

Measures of icon designs rely heavily on surveys of the perceptions of population samples. Thus, measuring the extent to which changes in the structure of an icon will alter its perceived complexity can be costly and slow. An automated system capable of producing reliable estimates of perceived complexity could reduce development costs and time. Measures of icon complexity developed by Garcia, Badre, and Stasko (1994) and McDougall, Curry, and de Bruijn (1999) were correlated with six icon properties measured using Matlab (MathWorks, 2001) software, which uses image-processing techniques to measure icon properties. The six icon properties measured were icon foreground, the number of objects in an icon, the number of holes in those objects, and two calculations of icon edges and homogeneity in icon structure. The strongest correlates with human judgments of perceived icon complexity (McDougall et al., 1999) were structural variability (r _s = .65) and edge information (r _s = .64).     

UNDERSTANDING THE IMPACT OF TEST VALIDITY AND BIAS ON SELECTION ERRORS AND ADVERSE IMPACT IN HUMAN RESOURCE SELECTION

We propose an integrative framework for understanding the relationship among 4 closely related issues in human resource (HR) selection: test validity, test bias, selection errors, and adverse impact. One byproduct of our integrative approach is the concept of a previously undocumented source of selection errors we call bias‐based selection errors (i.e., errors that arise from using a biased test as if it were unbiased). Our integrative framework provides researchers and practitioners with a unique tool that generates numerical answers to questions such as the following: What are the anticipated consequences for bias‐based selection errors of various degrees of test validity and test bias? What are the anticipated consequences for adverse impact of various degrees of test validity and test bias? From a theory point of view, our framework provides a more complete picture of the selection process by integrating 4 key concepts that have not been examined simultaneously thus far. From a practical point of view, our framework provides test developers, employers, and policy makers a broader perspective and new insights regarding practical consequences associated with various selection systems that vary on their degree of validity and bias. We present a computer program available online to perform all needed calculations.     

Mindfulness and integrative self‐knowledge: Relationships with health‐related variables

This study examined how mindfulness and integrative self‐knowledge were related to health‐related issues. Men in general population (n = 103) and coronary heart disease samples (n = 101) completed the Mindful Attention Awareness Scale, the Integrative Self‐knowledge Scale, the Type 2 subscale of the Interpersonal Reactions Inventory, the Perceived Stress Scale, and the Anxiety and Depression Scales. In both samples, there was a moderate positive correlation between mindfulness and integrative self‐knowledge and they were negatively correlated with all health‐related variables. However, only integrative self‐knowledge explained independent variance in health‐related variables. Specifically, in both samples, the relationship between mindfulness and health‐related variables was mediated by integrative self‐knowledge. Mindfulness and integrative self‐knowledge are related domains of self‐awareness that are associated with a range of health‐related variables. These relationships are robust across samples drawn from general population and patients with coronary heart disease. The finding that integrative self‐knowledge explained additional variance in the health‐related variables after the contribution of mindfulness had been accounted for suggests that reflective self‐awareness in integrative self‐knowledge may make a unique contribution to the explanation of individual differences in health variables.     

Suspicious minds: The motive to acquire relationship‐threatening information

In four studies, we obtained evidence for the reliability and validity of a 21‐item scale designed to measure a new theoretical construct: individual differences in the motivation to acquire relationship‐threatening information (hereafter, MARTI). Study 1 provided evidence for the MARTI scale's reliability and discriminant validity, revealing that it was reliable and not significantly correlated with measures of the Big Five personality traits, adult attachment styles, or more general social orientations. Studies 2 and 3 provided evidence for the scale's convergent and discriminant validity, showing that dating partners with higher MARTI scores (i.e., those who were more motivated to acquire relationship‐threatening information) scored lower in relational trust and reported engaging in more “suspicion behaviors.” Study 4 provided behavioral evidence for the scale's predictive validity, revealing that (a) dating partners with higher MARTI scores were more likely to break up within 5 months, and (b) the breakup rate was most pronounced for dating partners who scored higher on the scale and who also reported being less close. We discuss how this new construct and measure can be used to study important relationship dynamics.

相似文献   

Extending SME to Handle Large‐Scale Cognitive Modeling

Analogy and similarity are central phenomena in human cognition, involved in processes ranging from visual perception to conceptual change. To capture this centrality requires that a model of comparison must be able to integrate with other processes and handle the size and complexity of the representations required by the tasks being modeled. This paper describes extensions to Structure‐Mapping Engine (SME) since its inception in 1986 that have increased its scope of operation. We first review the basic SME algorithm, describe psychological evidence for SME as a process model, and summarize its role in simulating similarity‐based retrieval and generalization. Then we describe five techniques now incorporated into the SME that have enabled it to tackle large‐scale modeling tasks: (a) Greedy merging rapidly constructs one or more best interpretations of a match in polynomial time: O(n²log(n)); (b) Incremental operation enables mappings to be extended as new information is retrieved or derived about the base or target, to model situations where information in a task is updated over time; (c) Ubiquitous predicates model the varying degrees to which items may suggest alignment; (d) Structural evaluation of analogical inferences models aspects of plausibility judgments; (e) Match filters enable large‐scale task models to communicate constraints to SME to influence the mapping process. We illustrate via examples from published studies how these enable it to capture a broader range of psychological phenomena than before.     

Degeneracy of the local structure renormalizing infinite time and space

A model for a system consisting of elements which detect the measurement apparatus of other elements is proposed. By any apparatus one can observe locally, however it can refer to non‐local property because apparatus itself is indefinite. In taking this aspect into consideration, I formulate expressions for a local interaction referring to non‐local property. This formalization can satisfy the aspect of what is called, internal measurement. This system shows teleological global motion toward criticality which is relevant to the degeneracy of a specific element featuring D ? Hom(Z), E) by which infinite time and space are renormalized.     

Understanding pro‐environmental intentions by integrating insights from social mobility,cosmopolitanism, and social dominance

To offer an integrative account bridging individuals’ sociocultural orientations with pro‐environmentalism, the current research tested the mediating and moderating relationships among pro‐environmental intentions and three person‐level factors: perceived social mobility, cosmopolitan orientation, and social dominance orientation (SDO). With a Singaporean college student sample (N = 220), we found support for the hypothesized second‐stage moderation model that perceived social mobility positively predicts cosmopolitan orientation, and in turn, cosmopolitan orientation is moderated by SDO to positively predict pro‐environmental intentions. Specifically, lower levels of SDO strengthen the pro‐environmental advantages of endorsing higher levels of cosmopolitan orientation. These findings add novel knowledge to the environmental psychology literature by advancing an integrative approach that demonstrates how the interplay of people's perceptions about the social, cultural, and group standing impacts their likelihood to engage in pro‐environmental actions. We discuss the implications that an egalitarian worldview toward other cultures, social groups, and human–nature relations might be the key to addressing the global challenge of climate change.     

Personality Traits as Potential Susceptibility Markers: Differential Susceptibility to Support Among Parents

In this study, we examined whether parents are differentially susceptible to support from their spouse and adolescent child depending on their personality traits, and whether differences in susceptibility to support among parents, in turn, are linked to the quality of support parents give to their children. Participants in this three‐wave longitudinal study were 288 two‐parent Dutch families with an adolescent child. Fathers were on average 43.9 years old (SD = 3.7 years), mothers were 41.7 years old (SD = 3.3 years), and adolescents (50% girls) were 14.5 years old (SD = 0.8 years). We found that the association between support from children toward their parents and subsequent support from parents toward their children was more pronounced for parents high on Openness, for better and for worse. Extraversion, Agreeableness, Conscientiousness, and Emotional Stability did not emerge as markers of differences in susceptibility. Also, parents did not differ in their susceptibility to support from their spouse, nor were differences in susceptibility found a year later when using data from a third wave. We found very modest support for differential susceptibility, only for Openness, and depending on the source of perceived support and on the timing of measurement.