Optimal appropriateness measurement

The test-taking behavior of some examinees may be so idiosyncratic that their test scores may not be comparable to the scores of more typical examinees. Appropriateness measurement attempts to use answer patterns to recognize atypical examinees. In this report appropriateness measurement procedures are viewed as statistical tests for choosing between a null hypothesis of normal test-taking behavior and an alternative hypothesis of atypical test-taking behavior. Most powerful tests for inappropriateness are described together with methods for computing their power. A recursion greatly simplifying the calculation of optimal test statistics is described and illustrated.The work reported in this article was supported by United States Office of Naval Research contracts N00014-79C-0752, NR 154-445 and N00014-83K-0397, NR 150-518, Michael V. Levine, Principal Investigator.     

A comparison of the efficiency and accuracy of BILOG and LOGIST

Comparisons are made between BILOG version 2.2 and LOGIST 5.0 Version 2.5 in estimating the item parameters, traits, item characteristic functions (ICFs), and test characteristic functions (TCFs) for the three-parameter logistic model. Data analyzed are simulated item responses for 1000 simulees and one 10-item test, four 20-item tests, and four 40-item tests. LOGIST usually was faster than BILOG in producing maximum likelihood estimates. BILOG almost always produced more accurate estimates of individual item parameters. In estimating ICFs and TCFs BILOG was more accurate for the 10-item test, and the two programs were about equally accurate for the 20- and 40-item tests.I am grateful to Robert J. Mislevy, Martha L. Stocking, and Marilyn S. Wingersky for many helpful comments on an earlier version of this paper. I would also like to thank Hamid Kamrani and Bongmyoung Park for getting LOGIST and BILOG running and keeping them running under changing computer systems at CTB/McGraw-Hill.     

Trusting the Media? TV News as a Source of Knowledge

Abstract

Why do we trust TV news? What reasons might support a recipient’s assessment of the trustworthiness of this kind of information? This paper presents a veritistic analysis of the epistemic practice of news production and communication. The topic is approached by discussing a detailed case study, namely the characteristics of the most popular German news programme, called the ‘Tagesschau’. It will be shown that a veritistic analysis can indeed provide a recipient with relevant reasons to consider when pondering on the trustworthiness of sources of information. Moreover, it will turn out that these reasons are part of what recipients might gather from media literacy.     

Construct and concurrent validity of the Cambridge neuropsychological automated tests in Portuguese older adults without neuropsychiatric diagnoses and with Alzheimer’s disease dementia

We aimed to analyze the construct and concurrent validity of the Rapid Visual Information Processing (RVP), Paired Associates Learning (PAL), Reaction Time (RTI), and Spatial Working Memory (SWM) tests from the Cambridge Neuropsychological Test Automated Battery (CANTAB®). Inclusion criteria were checked in a first session. The CANTAB and additional pencil-and-paper tests were administered within 1 week. The participants (aged 69–96 years) were 137 Portuguese adults without neuropsychiatric diagnoses and 37 adults with mild-to-moderate Alzheimer’s disease dementia. Comparisons were made between the CANTAB tests and between these tests and the Rey Complex Figure Test (RCFT), Verbal Fluency (VF) test, and some Wechsler Memory Scale-III and Wechsler Adult Intelligence Scale-III subtests. Most intra-test correlations were stronger than the CANTAB inter-test correlations. The RVP correlated more with VF animals (.44), the PAL with RCFT immediate recall (–.52), the RTI with RVP mean latency (.42), and the SWM with Spatial Span backward (–.39).     

A longitudinal assessment of the home literacy environment and early language

This longitudinal assessment concentrated on the relation between the home literacy environment (HLE) and early language acquisition during infancy and toddlerhood. In study 1, after controlling for socio‐economic status, a broadly defined HLE predicted language comprehension in 50 infants. In study 2, 27 children returned for further analyses. Findings revealed that the HLE measured in infancy predicted language production in toddlerhood and maternal redirecting behaviours measured in toddlerhood were negatively associated with expressive language. Results across both studies indicate the importance of a broadly defined HLE (including joint attention and parent–child conversation) for language development. Taken together, these findings highlight the importance of the HLE in supporting both receptive and expressive vocabulary growth in the second and third years of life. Copyright © 2011 John Wiley & Sons, Ltd.     

Comprehensive driving assessment: neuropsychological testing and on-road evaluation of brain injured patients

The study investigates the correspondence between neuropsychological test results and on-road driving performance among 55 patients with a CT-verified brain damage or documented neurological disorder (cerebrovascular accident: 43, traumatic brain injury: 5, multiple sclerosis: 4, other: 3). 5 patients showed unimpaired test profiles and passed the on-road evaluation. 18 patients showed severe neuropsychological deficits contrary to driving and were not recommended for on-road evaluation. Of the remaining 32 patients with some neuropsychological deficits, all 100% in the minor impaired group (n = 8) passed the driving evaluation, compared to 69% in the mildly impaired (n = 16) and 38% in the moderately impaired group (n = 8). Measures of reduced visuoconstructive ability, reaction time, visual attention, and awareness of cognitive impairments, were found to discriminate between groups. It is concluded that neuropsychological assessment of targeted functions provide an ecological valid prediction of driving skill after brain damage, but that on-road evaluation is needed as supplement in cases with ambiguous test findings.     

How are physical literacy interventions conceptualized? – A systematic review on intervention design and content

The concept of physical literacy (PL) has gained increasing attention over the last decade and posits that individuals value and take responsibility for engagement in physical activities for life through (a) motivation/confidence, (b) physical competence, and (c) knowledge/understanding. There is a mounting number of articles that have recently transformed the conceptual ideas of PL into interventions. The goal of this pre-registered (PROSPERO CRD42020188926) systematic review was to analyze and summarize PL interventions in terms of design and content. A total of 18 databases were searched drawing on the 2020 preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines. Inclusion criteria were English language, publication by November 2020, and interventions based on or inspired by PL. Articles that met these criteria were analyzed in relation to basic delivery characteristics, theoretical foundations, study objectives, intervention content, and potential links between the PL domains (a-c) and content. The multiphase screening process with two independent raters yielded 44 eligible interventions across 46 articles. The analyses of the review demonstrated that the majority of interventions were conducted on children or adolescents and in countries with higher economic development. While 77.3% of the interventions adopted a holistic understanding of PL, only 38.6% formulated study goals or intervention content to cover all the core PL domains. Importantly, only 25.0% of the interventions showed substantial links between PL domains and intervention content and can thus be classified as theory-based. Taken together, most interventions targeted aspects of physical competence (84.1%), whereas knowledge/understanding (59.1%) and motivation/confidence (47.7%) were often neglected. Therefore, future interventions should commit to systematically address all domains of PL simultaneously. PL interventions exposed weaknesses in reporting delivery characteristics and content. Finally, a model is suggested which assumes that practical PL efforts may better harmonize with PL theory and conception if they cultivated a tight interlocking with the three core domains of PL at all stages of the intervention process.     

The impact of culture and education on non-verbal neuropsychological measurements: a critical review

Clinical neuropsychology has frequently considered visuospatial and non-verbal tests to be culturally and educationally fair or at least fairer than verbal tests. This paper reviews the cross-cultural differences in performance on visuoperceptual and visuoconstructional ability tasks and analyzes the impact of education and culture on non-verbal neuropsychological measurements. This paper compares: (1) non-verbal test performance among groups with different educational levels, and the same cultural background (inter-education intra-culture comparison); (2) the test performance among groups with the same educational level and different cultural backgrounds (intra-education inter-culture comparisons). Several studies have demonstrated a strong association between educational level and performance on common non-verbal neuropsychological tests. When neuropsychological test performance in different cultural groups is compared, significant differences are evident. Performance on non-verbal tests such as copying figures, drawing maps or listening to tones can be significantly influenced by the individual's culture. Arguments against the use of some current neuropsychological non-verbal instruments, procedures, and norms in the assessment of diverse educational and cultural groups are discussed and possible solutions to this problem are presented.     

Robust nonorthogonal analyses revisited: An update based on trimmed means

Three approaches to the analysis of main and interaction effect hypotheses in nonorthogonal designs were compared in a 2×2 design for data that was neither normal in form nor equal in variance. The approaches involved either least squares or robust estimators of central tendency and variability and/or a test statistic that either pools or does not pool sources of variance. Specifically, we compared the ANOVA F test which used trimmed means and Winsorized variances, the Welch-James test with the usual least squares estimators for central tendency and variability and the Welch-James test using trimmed means and Winsorized variances. As hypothesized, we found that the latter approach provided excellent Type I error control, whereas the former two did not.Financial support for this research was provided by grants to the first author from the National Sciences and Engineering Research Council of Canada (#OGP0015855) and the Social Sciences and Humanities Research Council (#410-95-0006). The authors would like to express their appreciation to the Associate Editor as well as the reviewers who provided valuable comments on an earlier version of this paper.