Psychometrics in Support of a Valid Assessment of Linguistic Minorities: Implications for the Test and Sampling Designs

In this study, we propose that the unique needs and characteristics of linguistic minorities should be considered throughout the test development process. Unlike most measurement invariance investigations in the assessment of linguistic minorities, which typically are conducted after test administration, we propose strategies that focus on the early stages of test development. Our approaches involve considering linguistic minorities in the selection of the test and sampling designs. We posit that joint consideration of these issues preemptively can strengthen the claims derived from tests used to assess linguistically diverse populations. This also will contribute to more psychometrically robust assessments, which can yield accurate and valid score-based inferences for linguistic minorities. To this end, we provide various examples and methodological approaches that can be used in the selection of the test and sampling designs that take these issues into consideration.     

PDP启动型实验程序与Richardson-Klavehn模型的比较研究

2个实验对PDP的启动型实验程序与Richardson-Klavehn的修正模型进行了比较研究,通过对指示语的操纵,考察提取策略是否完全受意志控制,以及注意水平、刺激材料、测验类型、加工水平对被试作业的影响.结果发现刺激材料对有意识控制记忆的实验结果影响很大,对PDP的无意识自动加工参数无影响;启动型实验程序的结果与PDP理论相当一致;提取策略不一定是受意志精确控制的.     

A multitrait-multimethod model with minimal assumptions

A new model of confirmatory factor analysis (CFA) for multitrait-multimethod (MTMM) data sets is presented. It is shown that this model can be defined by only three assumptions in the framework of classical psychometric test theory (CTT). All other properties of the model, particularly the uncorrelated-ness of the trait with the method factors are logical consequences of the definition of the model. In the model proposed there are as many trait factors as different traits considered, but the number of method factors is one fewer than the number of methods included in an MTMM study. The covariance structure implied by this model is derived, and it is shown that this model is identified even under conditions under which other CFA-MTMM models are not. The model is illustrated by two empirical applications. Furthermore, its advantages and limitations are discussed with respect to previously developed CFA models for MTMM data.     

Some relationships between factors and components

The asymptotic correlations between the estimates of factor and component loadings are obtained for the exploratory factor analysis model with the assumption of a multivariate normal distribution for manifest variables. The asymptotic correlations are derived for the cases of unstandardized and standardized manifest variables with orthogonal and oblique rotations. Based on the above results, the asymptotic standard errors for estimated correlations between factors and components are derived. Further, the asymptotic standard error of the mean squared canonical correlation for factors and components, which is an overall index for the closeness of factors and components, is derived. The results of a Monte Carlo simulation are presented to show the usefulness of the asymptotic results in the data with a finite sample size.The author is indebted to anonymous referees for their comments, corrections and suggestions which have led to the improvement of this article.     

心理学视野下的社会变迁研究：研究设计与分析方法

近年来,社会变迁导致的文化、心理与行为变化及其相互建构已经成为心理学的研究热点。社会变迁研究通常涉及和变迁相关的时间效应、时代效应以及和变迁无关的年龄效应。在考察变迁趋势及其影响因素时,常用的研究设计有跨时间比较、跨代际比较、跨地区比较(历史重构)等方法;常用的分析方法有传统的相关和回归分析和现代的时间序列分析(比如交叉滞后相关和格兰杰因果检验)等。由于每一种设计都有其优点和不足,在具体研究中,研究者要根据研究的问题和可操作性选择合适的方法;如果可能,最好同时采用多种方法,以寻求基于不同方法的聚合证据。     

A caveat on the Savage–Dickey density ratio: The case of computing Bayes factors for regression parameters

The Savage–Dickey density ratio is a simple method for computing the Bayes factor for an equality constraint on one or more parameters of a statistical model. In regression analysis, this includes the important scenario of testing whether one or more of the covariates have an effect on the dependent variable. However, the Savage–Dickey ratio only provides the correct Bayes factor if the prior distribution of the nuisance parameters under the nested model is identical to the conditional prior under the full model given the equality constraint. This condition is violated for multiple regression models with a Jeffreys–Zellner–Siow prior, which is often used as a default prior in psychology. Besides linear regression models, the limitation of the Savage–Dickey ratio is especially relevant when analytical solutions for the Bayes factor are not available. This is the case for generalized linear models, non-linear models, or cognitive process models with regression extensions. As a remedy, the correct Bayes factor can be computed using a generalized version of the Savage–Dickey density ratio.     

Moving From Classical Test Theory to the Evaluation of Usefulness: A Theoretical and Practical Examination of Alternative Approaches to the Development of Career Tools for Job Seekers

This article critiques the common use of principles of classical test theory (CTT) as the key means of assessing the effectiveness of career instruments for employment counseling. The authors argue that excessive reliance on CTT has hindered the development of career assessment tools that better meet the diverse and changing needs of those seeking guidance in their career choice. The authors argue for an alternative paradigm based on notions of usefulness. A computerized career tool is evaluated to illustrate the limitations of CTT and the benefit of alternative methodologies for the assessment of instruments designed to provide effective career guidance.     

Determinants of assessing efficiency within auditory attention networks

The attention network test (ANT) assesses efficiency across alerting, orienting, and executive components of visual attention. This study examined approaches to assessing auditory attention networks, and performance was compared to the visual ANT. Results showed (1) alerting was sufficiently elicited in a pitch discrimination and sound localization task, although these effects were unrelated, (2) weak orienting of attention was elicited through pitch discrimination, which varied based on ISI and conflict level, but robust orienting of attention was found through sound localization, and (3) executive control was sufficiently assessed in both pitch discrimination and sound localization tasks, but these effects were unrelated. Correlation analysis suggested that, unlike alerting and orienting, sound localization auditory executive control functions tap a shared attention network system. Overall, the results suggest that auditory ANT measures are largely task and modality specific, with sound localization offering potential to assess all three attention networks in a single task.     

Mathematics ability and related skills in preschoolers born very preterm

Children born very preterm (VPT) are at risk for academic, behavioral, and/or emotional problems. Mathematics is a particular weakness and better understanding of the relationship between preterm birth and early mathematics ability is needed, particularly as early as possible to aid in early intervention. Preschoolers born VPT (n = 58) and those born full term (FT; n = 29) were administered a large battery of measures within 6 months of beginning kindergarten. A multiple-mediation model was utilized to characterize the difference in skills underlying mathematics ability between groups. Children born VPT performed significantly worse than FT-born children on a measure of mathematics ability as well as full-scale IQ, verbal skills, visual–motor integration, phonological awareness, phonological working memory, motor skills, and executive functioning. Mathematics was significantly correlated with verbal skills, visual–motor integration, phonological processing, and motor skills across both groups. When entered into the mediation model, verbal skills, visual–motor integration, and phonological awareness were significant mediators of the group differences. This analysis provides insights into the pre-academic skills that are weak in preschoolers born VPT and their relationship to mathematics. It is important to identify children who will have difficulties as early as possible, particularly for VPT children who are at higher risk for academic difficulties. Therefore, this model may be used in evaluating VPT children for emerging difficulties as well as an indicator that if other weaknesses are found, an assessment of mathematics should be conducted.     

Evaluating the Impact of Careless Responding on Aggregated-Scores: To Filter Unmotivated Examinees or Not?

When examinees' test-taking motivation is questionable, practitioners must determine whether careless responding is of practical concern and if so, decide on the best approach to filter such responses. As there has been insufficient research on these topics, the objectives of this study were to: a) evaluate the degree of underestimation in the true mean when careless responses are present, and b) compare the effectiveness of two filtering procedures in purifying biased aggregated-scores. Results demonstrated that: a) the true mean was underestimated by around 0.20 SDs if the total amount of careless responses exceeded 6.25%, 12.5%, and 12.5% for easy, moderately difficult, and difficult tests, respectively, and b) listwise deleting data from unmotivated examinees artificially inflated the true mean by as much as .42 SDs when ability was related to careless responding. Findings from this study have implications for when and how practitioners should handle careless responses for group-based low-stakes assessments.