Stopping rules for multi-category computerized classification testing

Computerized classification testing (CCT) aims to classify persons into one of two or more possible categories to make decisions such as mastery/non-mastery or meet most/meet all/exceed. A defining feature of CCT is its stopping criterion: the test terminates when there is enough confidence to make a decision. There is abundant research on CCT with a single cut-off, and two common stopping criteria are the sequential probability ratio test (SPRT) statistic and the generalized likelihood ratio statistic (GLR). However, there is a relative scarcity of research extending the SPRT to the multi-hypothesis case for when there is more than one cut-off. In this paper, we propose a new multi-category GLR (mGLR) statistic as well as a stochastically curtailed version of the CCT with three or more categories. A simulation study was conducted to show that the mGLR statistic outperformed the existing stopping rules by generating shorter average test length without sacrificing classification accuracy. Results also revealed that the stochastically curtailed mGLR successfully increased test efficiency in certain testing conditions.     

Comparing Chinese youth with American youth on adjustment: An illustration of measurement issues in cross-cultural research

In this article, we used results from two studies to show the need to go beyond linguistic equivalence to establish construct validity and measurement invariance in cross-cultural research. Study 1 examined Rosenberg Self-Esteem (RSE; 10 items) data from 156 Mainland Chinese youth (M = 13.8 years, SD = .53) and 213 Chinese-American youth (M = 13.6 years, SD = 2.1) from high socioeconomic status (SES) families. The Chinese translation of the RSE has been widely used. Study 2 included 1060 Mainland Chinese youth (M = 15.6 years, SD = 2.3) and 412 racially diverse American youth (M = 16.0, SD = 2.9) from all SES backgrounds. Data were collected with the third and newest edition of the Behavioural Assessment System for Children-Self Report of Personality (BASC-3-SRP; 189 items). We translated and back-translated the BASC-3-SRP between English and Chinese to establish linguistic equivalence. All participants were females. Study 1 showed that the RSE had acceptable internal consistency but lacked construct validity. Study 2 showed that the original and the translated BASC-3-SRP had good internal consistency and construct validity, but nine of its 16 subscales lacked measurement invariance. These results highlight measurement issues facing international and cross-cultural research.     

Factorial validation and measurement invariance of the French version of the multidimensional competitive orientation inventory (FVMCOI) in the sport field

IntroductionLittle is known about the importance of the adaptive, maladaptive and neutral facets of competitive orientations among French athletes.ObjectiveThe aim of this study is to test the factorial validation and measurement invariance of the French version of the multidimensional competitive orientation inventory (FVMCOI) from the original version (MCOI, Orosz et al., 2018), which included 12 items and four factors (i.e., hypercompetitive orientation, self-developmental competitive orientation, anxiety-driven competition avoidance, and lack of interest toward competition).MethodA series of three complementary studies was carried out with a total sample of 891 competitors.ResultsFollowing cross-cultural validation methods a preliminary version of the FVMCOI was constructed and the clarity of its items was established (study 1). Then, exploratory structural equation modeling (ESEM) confirmed that the four-factor model for the FVMCOI was factorially valid, and consistent with the model of the original version. As such, the multiple-group invariance tests showed that the FVMCOI was partially invariant across both age and gender and fully invariant across type of sport, level of competition and over time (study 2). Finally, the concurrent validity of the FVMCOI was demonstrated through its expected relationships with achievement goals, competitive aggressiveness and anger in sport (study 3).ConclusionThe establishment of the FVMCOI extends the research in sport psychology by allowing an extensive psychometric study of the MCOI in the sport domain and providing deeper insights into the healthy, unhealthy, and neutral nature of competitive orientation in this context. The FVMCOI's potential practical applications in sport context, with some limitations and perspectives of this study, are also discussed.     

非符号数量表征和符号分数表征的关系

个体学习符号分数的一个关键是能对其数值形成准确表征。现有研究假设符号分数表征的认知基础是人类自婴幼儿期就具有的非符号数量表征(如表征两个集合各自的数量, 或两个数量的比例)。其证据包括表征非符号数量(尤其是非符号数量比例关系)和表征符号分数在行为和大脑神经活动层面上都表现出相关性。然而要说明非符号数量表征是符号分数表征的认知基础, 还需更多研究表明两者在数量概念上的独特相关和因果联系, 并阐明符号分数表征形成的认知机制。     

矛盾年龄偏见量表在中国大学生群体中的修订及信效度检验

目的：修订矛盾年龄偏见量表(the Ambivalent Ageism Scale, AAS),并在中国大学生群体中进行信、效度检验。方法：对1182名大学生施测AAS中文翻译版,探索并验证其因子结构,分析信、效度和测量等值性。其中347人还完成老化知识量表(FAQ)和容纳他人量表(AOS),用以检验AAS中文版的校标关联效度。另有74人在4周后重测AAS中文版。结果：AAS中文修订版包含认知帮助/保护、不想要的帮助和敌意年龄偏见三因子,总量表和各维度的Cronbach’s α系数依次为0.83、0.80、0.85、0.76,重测信度依次为0.78、0.62、0.78、0.71。AAS中文修订版及各维度与FAQ和AOS负相关(r=-0.23～-0.48,ps<0.001)。验证因素分析表明AAS中文修订版的拟合良好(χ²/df=3.51,CFI=0.96,TLI=0.94,RMSEA=0.07,SRMR=0.05)。且该量表跨性别形态、弱等值、部分强等值和部分严格测量等值成立。结论：修订后的矛盾年龄偏见量表(AAS)中文版的信、效度良好,具备跨性别的测量部分...     

Testing two variances for superiority/non-inferiority and equivalence: Using the exhaustion algorithm for sample size allocation with cost

The equality of two group variances is frequently tested in experiments. However, criticisms of null hypothesis statistical testing on means have recently arisen and there is interest in other types of statistical tests of hypotheses, such as superiority/non-inferiority and equivalence. Although these tests have become more common in psychology and social sciences, the corresponding sample size estimation for these tests is rarely discussed, especially when the sampling unit costs are unequal or group sizes are unequal for two groups. Thus, for finding optimal sample size, the present study derived an initial allocation by approximating the percentiles of an F distribution with the percentiles of the standard normal distribution and used the exhaustion algorithm to select the best combination of group sizes, thereby ensuring the resulting power reaches the designated level and is maximal with a minimal total cost. In this manner, optimization of sample size planning is achieved. The proposed sample size determination has a wide range of applications and is efficient in terms of Type I errors and statistical power in simulations. Finally, an illustrative example from a report by the Health Survey for England, 1995–1997, is presented using hypertension data. For ease of application, four R Shiny apps are provided and benchmarks for setting equivalence margins are suggested.     

Psychometric properties and measurement invariance of Depression,Anxiety and Stress Scales (DASS-21) across cultures

Cross-culturally measurement invariant instruments are useful for the assessment of mental symptoms across cultures. The current study aimed to investigate the psychometric properties and measurement invariance of the Depression, Anxiety and Stress Scales (DASS-21) (DASS) across Pakistan and Germany. German participants were recruited through an online survey (N = 1323), while Pakistani participants were recruited through online survey or paper-and-pencil survey (N = 1841). The DASS-21 showed good reliability, construct and structure validity in both countries. The DASS-21 indicated partial weak (stress subscale) and partial strong measurement invariance (depression and anxiety subscales) between both countries. Latent mean comparison of depression and anxiety symptoms between Pakistani and German students indicated that Pakistani university students experience more symptoms of depression and anxiety. Results suggest that the DASS-21 could be used in Pakistan and Germany, but caution should be taken when making direct comparisons between the two countries.     

得失情境下他人参照点及心理距离对自我-他人利益权衡的影响

以福利权衡率(WTR)为利他程度的指标, 通过3个实验逐步深入地考察了得失情境下他人参照点及心理距离对自我-他人利益权衡的影响。实验1的结果表明, 得失情境并未改变被试的WTR。实验2引入他人底线、现状和目标三个参照点变量, 发现被试获益情境下的WTR高于损失情境, 且WTR从高到低依次为他人临近底线、目标和现状; 他人临近底线时, 被试在获益情境下的WTR高于损失情境, 而他人临近现状和目标时, 个体在得失情境下的WTR无显著差异。实验3进一步引入心理距离变量, 发现心理距离较近他人的WTR高于较远他人, 且与得失情境和参照点发生了复杂的交互效应, 得失情境的主效应消失了, 但总体上并未改变实验2发现的参照点效应。这些结果对于更深入地理解得失不对称效应、三参照点理论及社会折扣和自我-他人决策差异研究的相关发现具有一定的启示意义。     

Modeling the Influence of Language Input Statistics on Children's Speech Production

We trained a computational model (the Chunk-Based Learner; CBL) on a longitudinal corpus of child–caregiver interactions in English to test whether one proposed statistical learning mechanism—backward transitional probability—is able to predict children's speech productions with stable accuracy throughout the first few years of development. We predicted that the model less accurately reconstructs children's speech productions as they grow older because children gradually begin to generate speech using abstracted forms rather than specific “chunks” from their speech environment. To test this idea, we trained the model on both recently encountered and cumulative speech input from a longitudinal child language corpus. We then assessed whether the model could accurately reconstruct children's speech. Controlling for utterance length and the presence of duplicate chunks, we found no evidence that the CBL becomes less accurate in its ability to reconstruct children's speech with age.     

Drug discrimination under concurrent variable-ratio variable-ratio schedules

Pigeons were trained to discriminate 5 mg/kg pentobarbital from saline under concurrent variable-ratio (VR) VR schedules, in which responses on the pentobarbital-biased lever were reinforced under the VR schedule with the smaller response requirements when pentobarbital was given before the session, and responses on the saline-biased key were reinforced under the VR schedule with the larger response requirements. When saline was administered before the session, the reinforcement contingencies associated with the two response keys were reversed. When responding stabilized under concurrent VR 20 VR 30, concurrent VR 10 VR 40, or concurrent VR 5 VR 50 schedules, pigeons responded almost exclusively on the key on which fewer responses were required to produce the reinforcer. When other doses of pentobarbital and other drugs were substituted for the training dose, low doses of all drugs produced responding on the saline-biased key. Higher doses of pentobarbital and chlordiazepoxide produced responding only on the pentobarbital-biased key, whereas higher doses of ethanol and phencyclidine produced responding only on this key less often. d-Amphetamine produced responding primarily on the saline-biased key. When drugs generalized to pentobarbital, the shape of the generalization curve under concurrent VR VR schedules was more often graded than quantal in shape. Thus, drug discrimination can be established under concurrent VR VR schedules, but the shapes of drug-discrimination dose-response curves under concurrent VR VR schedules more closely resemble those seen under interval schedules than those seen under fixed-ratio schedules. Graded dose-response curves under concurrent VR VR schedules may relate to probability matching and difficulty in discriminating differences in reinforcement frequency.