Testing Practices and Attitudes Toward Tests and Testing: An International Survey

On behalf of the International Test Commission and the European Federation of Psychologists' Associations a world-wide survey on the opinions of professional psychologists on testing practices was carried out. The main objective of this study was to collect data for a better understanding of the state of psychological testing worldwide. These data could guide the actions and measures taken by ITC, EFPA, and other stakeholders. A questionnaire was administered to 20,467 professional psychologists from 29 countries. Five scales were constructed relating to: concern over incorrect test use, regulations on tests and testing, internet and computerized testing, appreciation of tests, and knowledge and training relating to test use. Equivalence across countries was evaluated using the alignment method, four scales demonstrated acceptable levels of invariance. Multilevel analysis was used to determine how scores were related to age, gender, and specialization, as well as how scores varied between countries. Although the results show a high appreciation of tests in general, the appreciation of internet and computerized testing is much lower. These scales show low variability over countries, whereas differences between countries on the other reported scales are much greater. This implies the need for some overarching improvements as well as country-specific actions.     

The test–retest reliability of the latent construct of executive function depends on whether tasks are represented as formative or reflective indicators

This study investigates the test–retest reliability of a battery of executive function (EF) tasks with a specific interest in testing whether the method that is used to create a battery-wide score would result in differences in the apparent test–retest reliability of children’s performance. A total of 188 4-year-olds completed a battery of computerized EF tasks twice across a period of approximately two weeks. Two different approaches were used to create a score that indexed children’s overall performance on the battery—i.e., (1) the mean score of all completed tasks and (2) a factor score estimate which used confirmatory factor analysis (CFA). Pearson and intra-class correlations were used to investigate the test–retest reliability of individual EF tasks, as well as an overall battery score. Consistent with previous studies, the test–retest reliability of individual tasks was modest (rs ≈ .60). The test–retest reliability of the overall battery scores differed depending on the scoring approach (r_mean = .72; r_{factor_score} = .99). It is concluded that the children’s performance on individual EF tasks exhibit modest levels of test–retest reliability. This underscores the importance of administering multiple tasks and aggregating performance across these tasks in order to improve precision of measurement. However, the specific strategy that is used has a large impact on the apparent test–retest reliability of the overall score. These results replicate our earlier findings and provide additional cautionary evidence against the routine use of factor analytic approaches for representing individual performance across a battery of EF tasks.     

The roles of encoding strategies and retrieval practice in test-expectancy effects

We investigated whether expectations for different kinds of memory tests induce qualitatively different encoding strategies. In Experiment 1, participants studied four lists of words and after each list completed a cued-recall test that contained either all semantic or all orthographic cues so as to build up an expectancy for receiving the same type of test for the fifth critical study list. To rule out that the test-expectancy effects in Experiment 1 were due to differences in retrieval practice, in Experiment 2, participants received three practice tests each for both cue-types. Participants’ test expectancy for all lists was induced by telling them before each list the type of cue they would receive for the upcoming study list. In both experiments, the critical test contained both expected and unexpected cues. In Experiment 1, participants who expected semantic cues had better recall to the semantic cues than to the orthographic cues and vice versa for those who expected orthographic cues. However, in Experiment 2, there was no effect of test expectancy. These findings suggest that the test-expectancy effects in Experiment 1 were due to more retrieval practice on the expected than unexpected tests rather than to qualitatively different test-expectancy-induced encoding strategies.     

内隐自尊的特性：来自EAST的证据

采用外部情绪性Simon任务（EAST）对109名大学生对代表自我和他人的刺激词的态度差异进行测量,从而探讨内隐自尊的特性。结果显示：在个体的认知图式中,对自我持有一种内隐的积极的评价或态度,对他人持有一种内隐的相对消极的评价或态度。具体表现在：（1）内隐自尊的特性是将自己与积极的评价和情感相联系,将他人与消极的评价和情感相联系;（2）自我姓名激活的积极的内隐自我态度比一般性自我词更为强烈,而他人姓名激活的消极的内隐态度比一般性非我词更弱。本研究表明,EAST能有效检测出内隐自尊效应,并可以同时获得个体对自我和他人的内隐态度的强度和方向,为内隐自尊研究提供了一种新的有效的方法,但其应用仍需谨慎。     

Religious Appeals and Implicit Attitudes

This article explores the effects of religious appeals by politicians on attitudes and behavior. Although politicians frequently make religious appeals, the effectiveness of these appeals and the mechanisms of persuasion are unknown. This article explores the possibility that religious language can affect political attitudes through implicit processes. Because religious attachments are formed early in the lives of many Americans, religious language may influence citizens without their awareness. Implicit and explicit attitudes are related but distinct constructs, and implicit attitudes may have behavioral implications in the political realm. I test these hypotheses experimentally, relying on a widely used implicit measure, the Implicit Association Test. I find that a Christian religious appeal affects implicit attitudes and political behavior among people who currently or previously identify as Christian. Furthermore, an explicit preference for less religion in politics does not moderate implicit effects.     

The relationship between pitch and space in congenital amusia

Congenital amusia manifests as a lifelong difficulty in making sense of musical sound. The extent to which this disorder is accompanied by deficits in visuo-spatial processing is an important question, bearing on the issue of whether pitch processing draws on supramodal spatial representations. The present study assessed different aspects of visuo-spatial processing with a range of tasks (Shepard-Metzler Mental Rotation, Corsi Blocks Task, Visual Patterns Test) in 14 amusics and matched controls. The absence of a group difference on any of these tasks fails to support a previous claim that the disorder is strongly related to deficits in spatial processing. However, a subgroup of amusics, with significantly elevated thresholds on a pitch direction discrimination task relative to the rest of the group, were slower, but equally accurate, at Mental Rotation. This finding is discussed in relation to the nature of supramodal representations of contour and strategies for dynamic mental transformation.     

An fMRI investigation of a novel analogue to the Trail-Making Test

The Trail-Making Test (TMT) is a widely used neuropsychological measure that assesses visuomotor abilities and cognitive flexibility. For the TMT-A condition participants are required to locate and connect numbers (i.e. 1-2-3…) while in the TMT-B condition participants perform the set-shifting task of locating and connecting numbers and letters (i.e. 1-A-2-B…). The TMT-B condition has shown impairments in many clinical populations, particularly schizophrenia patients, but the neurobiological underpinning of the task can be difficult to discern given pragmatic obstacles in adapting the task for neuroimaging. In a behavioural testing experiment we demonstrated a close correspondence between performance on the standard TMT and a novel, computer programmed adaptation of the TMT (pcTMT). The pcTMT was designed for functional magnetic resonance imaging (fMRI) administration and neuroimaging data for this task were obtained in. A whole brain analysis revealed significantly greater activation during the pcTMT-B relative to the pcTMT-A in right inferior/middle frontal cortices, right precentral gyrus, left angular gyrus/left middle temporal gyrus. These results identify the regions that most likely underlie cognitive flexibility during the TMT and are candidate regions underlying the impairment of groups with poor set-shifting abilities.     

What a Rational Parser Would Do

This article examines cognitive process models of human sentence comprehension based on the idea of informed search. These models are rational in the sense that they strive to find a good syntactic analysis quickly. Informed search derives a new account of garden pathing that handles traditional counterexamples. It supports a symbolic explanation for local coherence as well as an algorithmic account of entropy reduction. The models are expressed in a broad framework for theories of human sentence comprehension.     

Using Participatory System Dynamics Modeling to Examine the Local HIV Test and Treatment Care Continuum in Order to Reduce Community Viral Load

Achieving community‐level goals to eliminate the HIV epidemic requires coordinated efforts through community consortia with a common purpose to examine and critique their own HIV testing and treatment (T&T) care system and build effective tools to guide their efforts to improve it. Participatory system dynamics (SD) modeling offers conceptual, methodological, and analytical tools to engage diverse stakeholders in systems conceptualization and visual mapping of dynamics that undermine community‐level health outcomes and identify those that can be leveraged for systems improvement. We recruited and engaged a 25‐member multi‐stakeholder Task Force, whose members provide or utilize HIV‐related services, to participate in SD modeling to examine and address problems of their local HIV T&T service system. Findings from the iterative model building sessions indicated Task Force members’ increasingly complex understanding of the local HIV care system and demonstrated their improved capacity to visualize and critique multiple models of the HIV T&T service system and identify areas of potential leverage. Findings also showed members’ enhanced communication and consensus in seeking deeper systems understanding and options for solutions. We discuss implications of using these visual SD models for subsequent simulation modeling of the T&T system and for other community applications to improve system effectiveness.