Efficient nonparametric approaches for estimating the operating characteristics of discrete item responses

Rationale and the actual procedures of two nonparametric approaches, called Bivariate P.D.F. Approach and Conditional P.D.F. Approach, for estimating the operating characteristic of a discrete item response, or the conditional probability, given latent trait, that the examinee's response be that specific response, are introduced and discussed. These methods are featured by the facts that: (a) estimation is made without assuming any mathematical forms, and (b) it is based upon a relatively small sample of several hundred to a few thousand examinees.Some examples of the results obtained by the Simple Sum Procedure and the Differential Weight Procedure of the Conditional P.D.F. Approach are given, using simulated data. The usefulness of these nonparametric methods is also discussed.This research was mostly supported by the Office of Naval Research (N00014-77-C-0360, N00014-81-C-0569, N00014-87-K-0320, N00014-90-J-1456).     

过去时间的心理结构

４０８名大学生被试用秒、分、小时、日、星期、年和月７个时间单位和模糊统计试验方法对４０个不定的过去时间修饰词作经验赋值,结果显示：（１）过去时间和未来时间在心理结构上是对称的,分为三个心理时间段,即以秒和分为计时单位的“较近的过去”和“较近的未来”,以小时、日和月为计时单位的“近的过去”和“近的未来”,和以年为计时单位的“远的过去”和“远的未来”。（２）随着时间修饰词的词义离现在由近至远,其词义地     

Profiling movement quality and gait characteristics according to body-mass index in children (9–11 y)

Obese children move less and with greater difficulty than their normal-weight counterparts. Whilst the effect of high BMI on cardiovascular fitness is well known, the effect on movement quality characteristics during a standardised fitness test has not been investigated. The aims of this study were, to characterise the movement quality of children performing the multi-stage fitness test (MSFT), and, report how movement quality characteristics cluster according to weight status. One hundred and three children (10.3 ± 0.6 y, 1.42 ± 0.08 m, 37.8 ± 9.3 kg, BMI; 18.5 ± 3.3 kg m²) performed the MSFT whilst wearing an ankle mounted accelerometer. BMI groups were used to classify children as underweight (UW), normal weight (NW), overweight (OW) and obese (OB). Characteristics of movement were profiled using a clustering algorithm. Spearman’s rho was used to assess relationship with BMI group, and a Mann-Whitney U test was used to assess differences between BMI groups. Obese children had significantly lower spectral purity than every other group and significantly lower time to exhaustion (TTE) than UW and NW children (P < 0.05). BMI was clustered with stride profile and TTE with spectral purity. Significant negative correlations (P < 0.05) were found between BMI and TTE (r = −0.25), spectral purity (r = −0.24), integrated acceleration (r = −0.22), stride angle (r = −0.23) and stride variability (r = −0.22). This was the first study to report the spectral purity of children’s gait. Further analysis unveiled key performance characteristics that differed between BMI groups. These were (i) representative of children’s performance during the MSFT and, (ii) significantly negatively correlated with BMI.     

The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT)

The cognitive reflection test (CRT) is a short measure of a person's ability to resist intuitive response tendencies and to produce a normatively correct response, which is based on effortful reasoning. Although the CRT is a very popular measure, its psychometric properties have not been extensively investigated. A major limitation of the CRT is the difficulty of the items, which can lead to floor effects in populations other than highly educated adults. The present study aimed at investigating the psychometric properties of the CRT applying item response theory analyses (a two‐parameter logistic model) and at developing a new version of the scale (the CRT‐long), which is appropriate for participants with both lower and higher levels of cognitive reflection. The results demonstrated the good psychometric properties of the original, as well as the new scale. The validity of the new scale was also assessed by measuring correlations with various indicators of intelligence, numeracy, reasoning and decision‐making skills, and thinking dispositions. Moreover, we present evidence for the suitability of the new scale to be used with developmental samples. Finally, by comparing the performance of adolescents and young adults on the CRT and CRT‐long, we report the first investigation into the development of cognitive reflection. Copyright © 2015 John Wiley & Sons, Ltd.     

Test of memory malingering with children: The utility of Trial 1 and TOMMe10 as screeners of test validity

There is a growing body of research suggesting that the shorter versions of the Test of Memory Malingering (TOMM) may provide an accurate assessment of effort in children. During neuropsychological evaluations, some circumstances result in only one completed trial of the TOMM or partial completion of a trial. Research suggests that a cut-score of 40 or 41 on Trial1 is highly predictive of passing the TOMM overall. In the current study, 194 school-age children with academic and/or behavioral problems were used to compare the accuracy of TOMM1 and TOMMe10 (errors on the first 10 items of TOMM1) in predicting passing/failing of TOMM2. For the children in this sample, a score of < 40 items correct (≥ 10 errors) on TOMM1 was highly accurate in predicting a passing performance on the TOMM2 (sensitivity = .80, specificity = .91) with a Negative Predictive Value = .98 at the malingering base rate of 7% (TOMM2 failure in our sample). A score of 2 errors (8 items correct) on the TOMMe10 was slightly less sensitive than that of the TOMM1 (specificity = .96, sensitivity = .53) but with a similar Negative Predictive Value (.96). Consistent with the research from adult populations, TOMM1 and TOMMe10 appear to be quite accurate in predicting performance on the standard administration of the TOMM and may be useful screeners. However, compared to that found in adult samples, slight differences in suggested cutoffs for TOMM1 and TOMMe10 may be warranted for children.     

Unique designs,errors and strategies in the Five-Point Test: The contribution of age,phonemic fluency and visuospatial abilities in Italian children aged 6–11 years

Performances on the Five-Point Test of 161 Italian children aged 6 to 11 years were investigated, along with phonemic fluency, visual-motor integration, visual perception, motor coordination, visuospatial memory, and fluid intelligence. Five-Point Test accuracy was significantly related to phonemic fluency and visual-motor integration, while phonemic fluency was linked to motor coordination. The two fluency measures increased linearly with age, but the developmental progression of Five-Point Test accuracy was less influenced by age. Different age effects were also found on the relationship between fluid intelligence and the two fluency measures. The inspection of qualitative aspects of Five-Point Test performance (errors and strategies) suggested that strategy usage enhanced both productivity and accuracy in children; age-related changes were observed in the relationship between the number of errors and the total number of designs produced.     

The International Test Commission Guidelines on the Security of Tests,Examinations, and Other Assessments

The amount and severity of security threats have increased considerably over the past two decades, calling into question the validity of assessments administered around the world. These threats have increased for a number of reasons, including the popular use of computerized and online technologies for test administration and the use of almost undetectable technologies for capturing test content and illegally sharing it instantly across borders and cultures. No assessment program, large or small, is immune to this potential damage. The International Test Commission has recognized the critical need for every organization with an important assessment program to be aware of these and be prepared to counter them. It was for this purpose that these guidelines were developed. Knowing the threats and the guidelines will lead to effective measures to protect the program and its assets, maintaining the value of the tests and assessments to the international community. The guidelines listed in this article provide recommendations on planning for better security, maintaining security during the development of tests and while they are administered, and responding well when a security breach occurs. Following these guidelines will create a significant protective barrier between those who willingly commit test fraud and the valuable assets a program has spent time and money to build.     

Developing Pairwise Preference-Based Personality Test and Experimental Investigation of Its Resistance to Faking Effect by Item Response Model

Recent years have shown increased awareness of the importance of personality tests in educational, clinical, and occupational settings, and developing faking-resistant personality tests is a very pragmatic issue for achieving more precise measurement. Inspired by Stark (2002) and Stark, Chernyshenko, and Drasgow (2005), we develop a pairwise preference-based personality test that aims to measure multidimensional personality traits using a large-scale statement bank. An experiment compares the resistance of the developed personality test to faking with that of rating scale-based personality tests in the item response theory model framework. Results show that latent traits estimated from the personality test based on the rating scale method are severely biased, and that faking effect can be pragmatically ignored in the personality test developed based on the pairwise preference method.     

Psychometrics in Support of a Valid Assessment of Linguistic Minorities: Implications for the Test and Sampling Designs

In this study, we propose that the unique needs and characteristics of linguistic minorities should be considered throughout the test development process. Unlike most measurement invariance investigations in the assessment of linguistic minorities, which typically are conducted after test administration, we propose strategies that focus on the early stages of test development. Our approaches involve considering linguistic minorities in the selection of the test and sampling designs. We posit that joint consideration of these issues preemptively can strengthen the claims derived from tests used to assess linguistically diverse populations. This also will contribute to more psychometrically robust assessments, which can yield accurate and valid score-based inferences for linguistic minorities. To this end, we provide various examples and methodological approaches that can be used in the selection of the test and sampling designs that take these issues into consideration.     

PDP启动型实验程序与Richardson-Klavehn模型的比较研究

2个实验对PDP的启动型实验程序与Richardson-Klavehn的修正模型进行了比较研究,通过对指示语的操纵,考察提取策略是否完全受意志控制,以及注意水平、刺激材料、测验类型、加工水平对被试作业的影响.结果发现刺激材料对有意识控制记忆的实验结果影响很大,对PDP的无意识自动加工参数无影响;启动型实验程序的结果与PDP理论相当一致;提取策略不一定是受意志精确控制的.