A model-based standardization approach that separates true bias/DIF from group ability differences and detects test bias/DTF as well as item bias/DIF

A model-based modification (SIBTEST) of the standardization index based upon a multidimensional IRT bias modeling approach is presented that detects and estimates DIF or item bias simultaneously for several items. A distinction between DIF and bias is proposed. SIBTEST detects bias/DIF without the usual Type 1 error inflation due to group target ability differences. In simulations, SIBTEST performs comparably to Mantel-Haenszel for the one item case. SIBTEST investigates bias/DIF for several items at the test score level (multiple item DIF called differential test functioning: DTF), thereby allowing the study of test bias/DIF, in particular bias/DIF amplification or cancellation and the cognitive bases for bias/DIF.This research was partially supported by Office of Naval Research Cognitive and Neural Sciences Grant N0014-90-J-1940, 4421-548 and National Science Foundation Mathematics Grant NSF-DMS-91-01436. The research reported here is collaborative in every respect and the order of authorship is alphabetical. The assistance of Hsin-hung Li and Louis Roussos in conducting the simulation studies was of great help. Discussions with Terry Ackerman, Paul Holland, and Louis Roussos were very helpful.     

运动竞赛焦虑量表中国常模的修订

运动竞赛焦虑量表是由美国的马腾斯专为运动员编制的特质焦虑量表。它是一种与特定的情境相结合的、能够有效地测出被测者通常在运动竞赛(或游戏)时焦虑水平的量表。我们在全国六大区十四个省市抽取了2,988名被试,修订了10—12岁(男、女),13—15岁(男、女),16—18岁(男、女)和19—25岁(男、女)的八个常模。同时,进行了效度和信度检验。本量表可以作为对业余的或专业的运动员进行运动竞赛焦虑的诊断与研究用。     

Rasch-representable reaction time distributions

This article investigates properties of a representation based on the Rasch test model for reaction times (RT) that was proposed by Micko. Necessary and sufficient conditions for a set of RT distributions to be Rasch-representable are derived. It is shown that independent serial and independent parallel processing models cannot be reconciled with the representation. However, random extreme models compatible with the Reasch-representation exist that assume RT is determined by the longest or he shortest processing time of a random number of independent paraloel channels. Nonparametric properties of Rasch-representable distributions are derived that can be used for testing the model and for estimating its parameters. Conditions are presented for Rasch-representable distributions to form a scale family. Finally, Rasch-represent-able distributions are characterized interms of their hazard functions.For helpful discussions, we are grateful to Hans Irtel, Christoph Micko, Hartmann Scheiblechner, and Hans-Henning Schultz.     

Virtual reality technology in neuropsychological testing: A systematic review

Neuropsychological testing aims to measure individuals' cognitive abilities (e.g. memory, attention), analysing their performance on specific behavioural tasks. Most neuropsychological tests are administered in the so-called ‘paper-and-pencil’ modality or via computerised protocols. The adequacy of these procedures has been recently questioned, with more specific concerns about their ecological validity, i.e. the relation between test scores observed in the laboratory setting and the actual everyday cognitive functioning. In developing more ecological tasks, researchers started to implement virtual reality (VR) technology as an administration technique focused on exposing individuals to simulated but realistic stimuli and environments, maintaining at the same time a controlled laboratory setting and collecting advanced measures of cognitive functioning. This systematic review aims to present how VR procedures for neuropsychological testing have been implemented in the last years. We initially explain the rationale for supporting VR as an advanced assessment tool, but we also discuss the challenges and risks that can limit the widespread implementation of this technology. Then, we systematised the large body of studies adopting VR for neuropsychological testing, describing the VR tools' distribution amongst different cognitive functions through a PRISMA-guided systematic review. The systematic review highlighted that only very few instruments are ready for clinical use, reporting psychometric proprieties (e.g. validity) and providing normative data. Most of the tools still need to be standardised on large cohorts of participants, having published only limited data on small samples up to now. Finally, we discussed the possible future directions of the VR neuropsychological test development linked to technological advances.     

Development of the Basel Version of the Awareness of Social Inference Test – Theory of Mind (BASIT-ToM) in healthy adults

Impairments of Theory of Mind (ToM) abilities occur in a wide range of brain disorders. Therefore, reliable and ecologically valid examination of these abilities is a crucial part of any comprehensive neuropsychological assessment. An established and ecologically valid, English-language test identifying deficits in ToM abilities is “The Awareness of Social Inference Test – Social Inference Minimal (TASIT-SIM)”. However, no comparable German-language ToM test currently exists. In this study, we aimed to develop the first German-language adaption of TASIT-SIM in healthy adults. We selected 13 scenes [four scenes per message type (i.e., honesty, simple sarcasm, paradoxical sarcasm) and one practice scene] out of the 30 TASIT-SIM scenes. In collaboration with a film institute, we filmed each scene at three different intensities. These intensity version scenes were then administered to 240 healthy adults, equally distributed in sex and age, ranging from 35 to 92 years. By applying Rasch analysis, we selected intensity versions that showed neither floor nor ceiling effects in the majority of ToM questions in participants whose ToM abilities were in the medium range. In conclusion, we have developed the first German-language adaption of TASIT-SIM, i.e., the “Basel Version of the Awareness of Social Inference Test – Theory of Mind (BASIT-ToM)”. The BASIT-ToM incorporates the strengths of TASIT-SIM, while overcoming its limitations such as inconsistencies in cinematic realization and ceiling effects in healthy participants. Next, the BASIT-ToM needs to be validated in healthy people and clinical populations.     

Validation of the Chinese version of the Walsh Family Resilience Questionnaire

The Walsh Family Resilience Questionnaire (WFRQ) is one of the most widely used and strong theory-based measurement tools of family resilience. This study aimed to develop and psychometrically test the Chinese version of the WFRQ (WFRQ-C). The WFRQ was translated following Brislin's translation model. Psychometric testing, combining classical theory test and item response theory, was conducted with a sample of 800 community adult residents. The Connor-Davidson resilience scale-10 (CD-RISC-10), Self-reported Family Happiness Scale (SFHS-1), and Family APGAR (Adaption, Partnership, Growth, Affection, Resolve) Scale (Family APGAR-5) were applied for convergent validity. Six items were deleted at the item analysis level. The minimum average partial test and a parallel analysis supported a three-factor structure, which was validated by confirmatory factor analysis. The three factors were named “Family belief system,” “Organization, communication and problem solving,” and “Utilization of external resources.” The WFRQ-C was significantly correlated with CD-RISC-10, SFHS-1, and Family APGAR-5, with r values ranged from 0.51 to 0.56. The Cronbach's α was 0.97 for the scale and 0.93, 0.95, and 0.72 for the three factors, respectively. The ICCs of 0.96 for the whole scale, and 0.95, 0.75, and 0.95 for the three factors, respectively. The mean score for the WFRQ-C was 97.00 ± 17.94, of which per capita monthly income and education level were predictors. The 26-item WFRQ-C is a stable, concise, and validated tool to measure family resilience. It is applicable for Chinese community adults in nonspecific stressful settings and has potential utility in the health care domain.     

Période périnatale et Rorschach : normes,indicateurs, mentalisation et perspectives théorico-cliniques

ObjectiveThe perinatal period is a maturation phase characterised by the appearance of a radical psychological and identity crisis, little studied by projective methods, in particular the Rorschach inkblot test. The objective of this article is to offer a list of Rorschach norms and indicators adapted to the perinatal population. This is to comprehend the psychological modifications occurring during pregnancy.Materials and methodThe projective Rorschach inkblot test was presented to a representative sample of 54 pregnant primiparous French women. Based on the scoring and analysis methods of the Parisian School, the quantitative norms from the analysis of the psychogram, the chosen cards, and the mentalization indicators were compared to those of the general population.ResultsWith the exception of F +% and H%, all the normative data for the perinatal population are significantly different from those related to the general population (p .005). On a qualitative level, the interpretation of the data highlights the presence of major inhibition mechanisms, associated with a preconscious functioning stasis.ConclusionThe normative data in Rorschach of the perinatal population should be specifically used for the study and psychological support devoted to this population. It also allows a better understanding of the feminine psychologic modifications during pregnancy.     

Définir ou détecter des pathologies ? Utilisation et interprétation des scores seuils à la lumière du débat dimensions/catégories

A number of psychometric tests are aimed at locating the performance of an individual along a continuous range that goes from normal to worrying. In a different paradigm, there are tests whose goal is to assess whether or not an individual is healthy with respect to a psychological, psychiatric or neurological pathology that is defined independently from the test itself. The former rely on a dimensional concept of psychopathologies; the latter imply a categorical concept. The former require to compare the performance of the individual to a standard sample that is representative of the general population; the latter involve a standard sample representative of the healthy population only. The former might imply the use of a cut-off score to indicate that a certain degree of rarity of the performance has been reached, while the latter must involve a cut-off score to make a decision (whether the individual belongs to the “healthy” or “pathological” category), a score that is most often set so as to control the false-positive rate in making this decision. In the former paradigm, the cut-off score defines or contributes to define the pathology. In the latter, it only helps detecting it. This article aims at making clear the difference between these two realms and highlight their practical as well as theoretical impact on psychological practice.     

Reduction of faking with the use of a forced-choice personality test: Cross-cultural comparisons between South Korea and the United States

Forced-choice format tests have been suggested as an alternative to Likert-scale measures for personnel selection due to robustness to faking and response styles. This study compared degrees of faking occurring in Likert-scale and forced-choice five-factor personality tests between South Korea and the United States. Also, it was examined whether the forced-choice format was effective at reducing faking in both countries. Data were collected from 396 incumbents participating in both honest and applicant conditions (N_SK = 179, N_US = 217). Cohen's d values for within-subjects designs (ds_within) for between the two conditions were utilized to measure magnitudes of faking occurring in each format and country. In both countries, the degrees of faking occurring in the Likert-scale were larger than those from the forced-choice format, and the magnitudes of faking across five personality traits were larger in South Korea by from 0.07 to 0.12 in ds_within. The forced-choice format appeared to successfully reduce faking for both countries as the average ds_within decreased by 0.06 in both countries. However, the patterns of faking occurring in the forced-choice format varied between the two countries. In South Korea, degrees of faking in Openness and Conscientiousness increased, whereas those in Extraversion and Agreeableness were substantially decreased. Potential factors leading to trait-specific faking under the forced-choice format were discussed in relation to cultural influence on the perception of personality traits and score estimation in Thurstonian item response theory (IRT) models. Finally, the adverse impact of using forced-choice formats on multicultural selection settings was elaborated.     

Revisiting the effect of incentivization on cognitive reflection: A meta-analysis

The effect of performance-based incentives on judgment biases is a controversial issue. A recent extensive meta-analysis of Brañas-Garza et al. (2019, https://doi.org/10.1016/j.socec.2019.101455 ) found no effect of incentives on performance in the cognitive reflection test (CRT), a test commonly used for assessing heuristic versus deliberative judgments. We conducted a meta-analysis of studies that directly compared an incentive versus no-incentive conditions (n = 2836) and found a small positive effect of incentivization (Cohen's d = .21) on CRT performance. In addition, we re-examined the Brañas-Garza et al. (2019) dataset (n = 39,385), taking into consideration not only whether incentivization was used but also the nominal and fiscal size of the incentive. The results show that surprisingly when including only studies that used monetary incentives, the effect of incentivization and incentive size are significant, even when taking into consideration other aspects of the studies. The results thus suggest a small but robust effect of incentives on judgment biases.