The Childhood Executive Functioning Inventory (CHEXI): Factor structure,measurement invariance,and correlates in US preschoolers

This study tests the factor structure, measurement invariance, and correlates of the Childhood Executive Functioning Inventory (CHEXI) with a large and diverse sample of 3- to 5-year-olds (n = 844). Consistent with previous studies, a two-factor model that distinguishes working memory from inhibition provides the best fit to the observed data. This two-factor model has been shown to demonstrate strong measurement invariance for different subgroups of children (boys vs. girls, high vs. low income). Whereas boys tend to have greater working memory and inhibition difficulties (Cohen’s d = 0.15 and 0.20, respectively), children from low-income households tend to have more working memory problems than their peers from high-income households (Cohen’s d = 0.25). Finally, correlations between CHEXI scores, examiner reports of child behavior, and child performance on a battery of executive function (EF) tasks were investigated. CHEXI scores were found to be more consistently related to examiner reports of child behavior than child performance on EF tasks. Tthe strengths and weaknesses of the CHEXI as a questionnaire measure of EF are discussed, and directions for future research are suggested.     

Differential Item Functioning of the Emotional and Behavioral Screener for Caucasian and African American Elementary School Students

The present study examined the psychometric properties of a universal screening instrument called the Emotional and Behavioral Screener (EBS), which is designed to identify students exhibiting emotional and behavioral problems. The primary purposes of this study were to assess the measurement invariance of EBS items between Caucasian and African-American students and to assess the impact of differential item functioning (DIF) on EBS scores. The sample consisted of 946 elementary students from throughout the U.S. The findings suggested that EBS items exhibited small to negligible levels of DIF, and that DIF did not significantly impact EBS scores. The results supported the EBS as universal screening instrument that is fair in measuring the emotional and behavioral risk of elementary students. Research limitations and implications for school professionals are discussed.     

Variations of career decision ambiguity tolerance between China and the United States and between high school and college

The variation of career decision ambiguity tolerance (CDAT) by cultures and development stages was examined in a sample of Chinese high school students (n = 339), a sample of Chinese college students (n = 356), along with U.S. college students (n = 328). It was hypothesized that career decision ambiguity tolerance decreases when individuals experience more societal/cultural pressure on decidedness and responsibility for their career decision making. Based on the three-factor structure of CDAT (i.e., preference, tolerance, and aversion), measurement invariance was examined between Chinese and U.S. college students and between Chinese high school and college students. While the factor of tolerance was not upheld in both Chinese samples, the factors of preference and aversion were found to be structurally invariant across cultures and developmental stages. The analyses comparing means of preference and aversion found that U.S. college students had a higher level of preference relative to Chinese college students. It was also found that in comparison to Chinese high school students, Chinese college students had a higher level of aversion. The criterion validity of CDAT in Chinese culture was supported in the findings of preference and aversion being associated with career exploration and career indecision. The implication of this study was discussed along with its limitations and suggestions for future research.     

Asymptotic efficiency of the pseudo‐maximum likelihood estimator in multi‐group factor models with pooled data

A multi‐group factor model is suitable for data originating from different strata. However, it often requires a relatively large sample size to avoid numerical issues such as non‐convergence and non‐positive definite covariance matrices. An alternative is to pool data from different groups in which a single‐group factor model is fitted to the pooled data using maximum likelihood. In this paper, properties of pseudo‐maximum likelihood (PML) estimators for pooled data are studied. The pooled data are assumed to be normally distributed from a single group. The resulting asymptotic efficiency of the PML estimators of factor loadings is compared with that of the multi‐group maximum likelihood estimators. The effect of pooling is investigated through a two‐group factor model. The variances of factor loadings for the pooled data are underestimated under the normal theory when error variances in the smaller group are larger. Underestimation is due to dependence between the pooled factors and pooled error terms. Small‐sample properties of the PML estimators are also investigated using a Monte Carlo study.     

Assessing decision-making style in French-speaking populations: Translation and validation of the general decision-making style questionnaire

IntroductionIndividual differences in decision-making are a fundamental component of our understanding of the decision-making process. Scott and Bruce (1995) developed the General Decision-Making Style (GDMS) questionnaire to assess five decision-making styles: rational, intuitive, dependent, avoidant, and spontaneous.ObjectiveThe purpose of our study was to translate and validate the GDMS into French. This measure has been used frequently to assess decision-making style since its creation. Yet, the scale is currently unavailable in French despite being already available in Slovak, Italian, and Swedish.MethodFollowing best practices for scale translation (e.g., Vallerand, 1989), the original version of the GDMS was administered to a group of 345 English-speaking participants and the translated version of the questionnaire was administered to a group of 325 French-speaking participants.ResultsThe properties of the translated questionnaire were then compared to those of the original questionnaire. Results of item-level, scale-level and measurement invariance analyses demonstrate that the translated measure, the Échelle des styles décisionnels, is a valid and reliable assessment of decision-making style in French-speaking populations.ConclusionThis measure already exists in languages that are much less commonly spoken than French. The newly translated Échelle des styles décisionnels will now allow researchers to validly assess decision-making style in French-speaking populations, thereby greatly increasing the ability to assess cross-cultural stability of decision-making theories.     

Some Behaviorial Science Measurement Concerns and Proposals

Primarily from a measurement standpoint, we question some basic beliefs and procedures characterizing the scientific study of human behavior. The relations between observed and unobserved variables are key to an empirical approach to building explanatory theories and we are especially concerned about how the former are used as proxies for the latter. We believe that behavioral science can profitably reconsider the prevailing version of this arrangement because of its vulnerability to limiting idiosyncratic aspects of observed/unobserved variable relations. We describe a general measurement approach that takes into account idiosyncrasies that should be irrelevant to the measurement process but can intrude and may invalidate it in ways that distort and weaken relations among theoretically important variables. To clarify further our major concerns, we briefly describe one version of the measurement approach that fundamentally supports the individual as the primary unit of analysis orientation that we believe should be preeminent in the scientific study of human behavior.     

Empirical evaluation of a model of global psychophysical judgments: IV. Forms for the weighting function

Understanding the psychological interpretation of numerals is of both practical and theoretical interest. In classical magnitude estimation, respondents match numerals to sensations and in magnitude production they select sensations that stand in a prescribed numerical ratio to a given standard. The present work focusses on evaluating several possible, and related, forms for the function W formulating the distortion of numerals. The main form, of which a power function is a special case, is the Prelec exponential/power representation. Behavioral equivalents to power and to Prelec functions are formulated, tested, and rejected. It is argued that either the mathematical form or the assumption W(1)=1 is wrong. Whereas, the axiomatic literature has focussed exclusively on the former inference, we explore the alternate that W(1)≠1. Behavioral axioms are formulated in each case and experimentally tested. We conclude that most respondents satisfy a general power function and that those who do not, satisfy the general Prelec function.     

Invariance in Measurement and Prediction Revisited

Borsboom (Psychometrika, 71:425–440, 2006) noted that recent work on measurement invariance (MI) and predictive invariance (PI) has had little impact on the practice of measurement in psychology. To understand this contention, the definitions of MI and PI are reviewed, followed by results on the consistency between the two forms of invariance in the general case. The special parametric cases of factor analysis (strict factorial invariance) and linear regression analyses (strong regression invariance) are then described, along with findings on the inconsistency between the two forms of invariance in this context. Two numerical examples of inconsistency are reviewed in detail. The impact of violations of MI on accuracy of selection is illustrated. Finally, reasons for the slow dissemination of work on invariance are discussed, and the prospects for altering this situation are weighed. This paper is based on the Presidential Address given at the International Meeting of the Psychometric Society in Tokyo, Japan, on July 11, 2007. This research was supported by National Institute of Mental Health grants 1P30 MH 068685-01A1 and RO1 MH64707-01.     

Learning representations of wordforms with recurrent networks: comment on sibley, kello, plaut, & elman (2008)

Sibley et al. (2008) report a recurrent neural network model designed to learn wordform representations suitable for written and spoken word identification. The authors claim that their sequence encoder network overcomes a key limitation associated with models that code letters by position (e.g., CAT might be coded as C‐in‐position‐1, A‐in‐position‐2, T‐in‐position‐3). The problem with coding letters by position (slot‐coding) is that it is difficult to generalize knowledge across positions; for example, the overlap between CAT and TOMCAT is lost. Although we agree this is a critical problem with many slot‐coding schemes, we question whether the sequence encoder model addresses this limitation, and we highlight another deficiency of the model. We conclude that alternative theories are more promising.     

The Construct Validity of the Utrecht Work Engagement Scale: Multisample and Longitudinal Evidence

This study investigated the factor structure and factorial group and time invariance of the 17-item and 9-item versions of the Utrecht Work Engagement Scale (UWES; Schaufeli et al. (2002b) Journal of Happiness Studies 3:71–92). Furthermore, the study explored the rank-order stability of work engagement. The data were drawn from five different studies (N = 9,404), including a three-year longitudinal study (n = 2,555), utilizing five divergent occupational samples. Confirmatory factor analysis supported the hypothesized correlated three-factor structure—vigor, dedication, absorption—of both UWES scales. However, while the structure of the UWES-17 did not remain the same across the samples and time, the structure of the UWES-9 remained relatively unchanged. Thus, the UWES-9 has good construct validity and use of the 9-item version can be recommended in future research. Moreover, as hypothesized, Structural Equation Modeling showed high rank-order stabilities for the work engagement factors (between 0.82 and 0.86). Accordingly, work engagement seems to be a highly stable indicator of occupational well-being.