Empirically Corrected Rescaled Statistics for SEM with Small N and Large p

Survey data often contain many variables. Structural equation modeling (SEM) is commonly used in analyzing such data. With typical nonnormally distributed data in practice, a rescaled statistic T_rml proposed by Satorra and Bentler was recommended in the literature of SEM. However, T_rml has been shown to be problematic when the sample size N is small and/or the number of variables p is large. There does not exist a reliable test statistic for SEM with small N or large p, especially with nonnormally distributed data. Following the principle of Bartlett correction, this article develops empirical corrections to T_rml so that the mean of the empirically corrected statistics approximately equals the degrees of freedom of the nominal chi-square distribution. Results show that empirically corrected statistics control type I errors reasonably well even when N is smaller than 2p, where T_rml may reject the correct model 100% even for normally distributed data. The application of the empirically corrected statistics is illustrated via a real data example.     

Evaluation of Multi-parameter Test Statistics for Multiple Imputation

In Ordinary Least Square regression, researchers often are interested in knowing whether a set of parameters is different from zero. With complete data, this could be achieved using the gain in prediction test, hierarchical multiple regression, or an omnibus F test. However, in substantive research scenarios, missing data often exist. In the context of multiple imputation, one of the current state-of-art missing data strategies, there are several different analogous multi-parameter tests of the joint significance of a set of parameters, and these multi-parameter test statistics can be referenced to various distributions to make statistical inferences. However, little is known about the performance of these tests, and virtually no research study has compared the Type 1 error rates and statistical power of these tests in scenarios that are typical of behavioral science data (e.g., small to moderate samples, etc.). This paper uses Monte Carlo simulation techniques to examine the performance of these multi-parameter test statistics for multiple imputation under a variety of realistic conditions. We provide a number of practical recommendations for substantive researchers based on the simulation results, and illustrate the calculation of these test statistics with an empirical example.     

生态化微表情识别测验EMERT的建立——对JACBART微表情识别测验的改进与发展

经典JACBART微表情识别测验只考察平静表情背景下微表情识别,生态效度不高。本研究创建生态化微表情识别测验,考察所有7种基本表情背景下的6种微表情识别特征。结果发现:(1)该测验具有良好的重测信度、校标效度和生态效度,能够稳定有效地测量生态化微表情识别。(2)信效度检验揭示了生态化微表情识别特征。某些生态化微表情识别存在训练效应。生态化微表情与经典微表情或普通表情普遍相关。恐惧、悲伤、厌恶、愤怒微表情背景主效应显著;惊讶和愉快微表情背景主效应不显著,成对比较发现各背景下惊讶/愉快微表情差异不显著,但是与普通表情有广泛的显著差异。用不同背景下微表情识别正确率的标准差定义生态化微表情识别波动,发现生态化微表情识别具有稳定的波动性。     

On Being Found: How Habitual Patterns of Thought Influence Creative Interest,Behavior, and Ability

This study on 138 undergraduate students used path analysis to investigate the relationship between creativity (interest, measured by a creative activities survey; and ability: fluency, originality, and elaboration) and different aspects of thought patterns presumed to influence the preparation and illumination phase of the creative process: habitual patterns of thought (ruminative brooding, ruminative self-reflection), thought suppression, thought intrusion, mind wandering, and associative ability. Such relationship was hinted at in Wallas’s classical model of the creative sequence, but is rarely investigated. We found that creative behavior/interest was driven by self-reflection, thought intrusion, and the lack of a need for thought suppression; creative ability was fueled mainly by associative ability. The only variable that influenced both aspects of creativity was the lack of resistance to thought suppression; this distinguished the creativity variables from dysphoria, which was associated with a desire for thought suppression. The results suggest that what drives the need to create is not creative ability per se, but rather self-focused attention, as well as the feeling or experience of being found by thought, rather than finding it. That is, the need to create is associated with having thoughts that interrupt one’s ordinary stream of consciousness and that are seen as welcome rather than interfering.     

The cognitive reflection test revisited: exploring the ways individuals solve the test

Individuals’ propensity not to override the first answer that comes to mind is thought to be a crucial cause behind many failures in reasoning. In the present study, we aimed to explore the strategies used and the abilities employed when individuals solve the cognitive reflection test (CRT), the most widely used measure of this tendency. Alongside individual differences measures, protocol analysis was employed to unfold the steps of the reasoning process in solving the CRT. This exploration revealed that there are several ways people solve or fail the test. Importantly, 77% of the cases in which reasoners gave the correct final answer in our protocol analysis, they started their response with the correct answer or with a line of thought which led to the correct answer. We also found that 39% of the incorrect responders reflected on their first response. The findings indicate that the suppression of the first answer may not be the only crucial feature of reflectivity in the CRT and that the lack of relevant knowledge is a prominent cause of the reasoning errors. Additionally, we confirmed that the CRT is a multi-faceted construct: both numeracy and reflectivity account for performance. The results can help to better apprehend the “whys and whens” of the decision errors in heuristics and biases tasks and to further refine existing explanatory models.     

The greatest lower bound to the reliability of a test and the hypothesis of unidimensionality

To assess the reliability of congeneric tests, specifically designed reliability measures have been proposed. This paper emphasizes that such measures rely on a unidimensionality hypothesis, which can neither be confirmed nor rejected when there are only three test parts, and will invariably be rejected when there are more than three test parts. Jackson and Agunwamba's (1977) greatest lower bound to reliability is proposed instead. Although this bound has a reputation for overestimating the population value when the sample size is small, this is no reason to prefer the unidimensionality-based reliability. Firstly, the sampling bias problem of the glb does not play a role when the number of test parts is small, as is often the case with congeneric measures. Secondly, glb and unidimensionality based reliability are often equal when there are three test parts, and when there are more test parts, their numerical values are still very similar. To the extent that the bias problem of the greatest lower bound does play a role, unidimensionality-based reliability is equally affected. Although unidimensionality and reliability are often thought of as unrelated, this paper shows that, from at least two perspectives, they act as antagonistic concepts. A measure, based on the same framework that led to the greatest lower bound, is discussed for assessing how close is a set of variables to unidimensionality. It is the percentage of common variance that can be explained by a single factor. An empirical example is given to demonstrate the main points of the paper. The authors are obliged to Henk Kiers for commenting on a previous version. Gregor Sočan is now at the University of Ljubljana.     

Comparison of two procedures for teaching dictated-word/symbol relations to learners with autism

The efficacy of exclusion and delayed-cue procedures for establishing novel dictated-word/symbol relations with 2 boys with autism was compared using computerized match-to-sample procedures. Acquisition of the relations under the two training conditions was compared via an alternating treatments design. The delayed-cue procedure was more efficacious than the exclusion procedure in four of five comparisons across participants.     

Using a modified constant prompt-delay procedure to teach spelling to students with physical disabilities

Current research suggests that constant delay is an effective means of teaching students through near-errorless learning. The current study examined how procedures used in previous research may be modified so that constant delay can be implemented with students who have physical disabilities that prevent them from engaging in fluent academic responding. A multiple baseline design with probes was used to assess the effectiveness of a modified constant-delay procedure in teaching spelling to students with physical disabilities. This procedure was found to be effective for all 3 students.     

Effects of delayed constructed-response identity matching on spelling of dictated words

We studied the effects of delayed constructed-response identity matching on spelling with 6 first graders with histories of school failure. After training, the children learned to spell words to dictation and their cursive writing improved. These results replicate studies showing that delayed constructed-response matching establishes spelling. For 2 children, spelling of generalization words--words formed by recombining the syllables of training words--also improved. These results extend studies that have shown recombinative generalization in reading and spelling.     

Reliability as a function of the number of item options derived from the “knowledge or random guessing” model

For (0, 1) scored multiple-choice tests, a formula giving test reliability as a function of the number of item options is derived, assuming the knowledge or random guessing model, the parallelism of the new and old tests (apart from the guessing probability), and the assumptions of classical test theory. It is shown that the formula is a more general case of an equation by Lord, and reduces to Lord's equation if the items are effectively parallel. Further, the formula is shown to be closely related to another formula derived from Lord's randomly parallel tests model.