Selecting measures for the neurodevelopmental assessment of children in low- and middle-income countries

Diseases affecting millions of children in low- and middle-income countries (LMICs), such as malnutrition, micronutrient deficiency, malaria, and HIV, can lead to adverse neurodevelopmental outcomes. Thus, a key health outcome in children is neurodevelopmental status. In this paper, the neurodevelopmental screening and testing measures most commonly utilized in LMICs are reviewed, and a matrix is presented to help researchers and clinicians determine which measures may be most useful for various LMIC inquiries. The matrix is based on an Internet literature review of 114 publications for the period January 1998 to February 2016, reporting the psychometric properties of instruments tested in LMIC children. The measures are classified as screening tests or more detailed tests that include both comprehensive batteries of general development and tests of specific domains. For completeness, two experts have reviewed this paper, as well as the authors. An overview of the tests used to date is presented, including the benefits and drawbacks of each test, in order to provide researchers and developmental clinicians with a way to decide which tests may be best suited to their developmental assessment goals. Remarkable progress has been made in neurodevelopmental testing in children in LMICs over the past two decades but there remains a need for additional research in this area to develop new tests, better evaluate and adapt current tests, and assess test validity and reliability across cultures.     

Future of Psychometrics: Ask What Psychometrics Can Do for Psychology

I address two issues that were inspired by my work on the Dutch Committee on Tests and Testing (COTAN). The first issue is the understanding of problems test constructors and researchers using tests have of psychometric knowledge. I argue that this understanding is important for a field, like psychometrics, for which the dissemination of psychometric knowledge among test constructors and researchers in general is highly important. The second issue concerns the identification of psychometric research topics that are relevant for test constructors and test users but in my view do not receive enough attention in psychometrics. I discuss the influence of test length on decision quality in personnel selection and quality of difference scores in therapy assessment, and theory development in test construction and validity research. I also briefly mention the issue of whether particular attributes are continuous or discrete.     

Stereotype threat and group differences in test performance: a question of measurement invariance

Studies into the effects of stereotype threat (ST) on test performance have shed new light on race and sex differences in achievement and intelligence test scores. In this article, the authors relate ST theory to the psychometric concept of measurement invariance and show that ST effects may be viewed as a source of measurement bias. As such, ST effects are detectable by means of multi-group confirmatory factor analysis. This enables research into the generalizability of ST effects to real-life or high-stakes testing. The modeling approach is described in detail and applied to 3 experiments in which the amount of ST for minorities and women was manipulated. Results indicate that ST results in measurement bias of intelligence and mathematics tests.     

Extending neuropsychological assessments into the primary mental ability space

A battery of 17 neuropsychological tests (including the CERAD battery) and 17 psychometric ability tests were administered to a sample of 499 participants of the Seattle Longitudinal study who had been given the psychometric ability tests seven and 14 years earlier. The neuropsychological tests were projected into a 5-factor psychometric ability space by means of extension analysis. The concurrent regressions of the neuropsychology tests on the psychometric ability tests were then used to estimate neuropsychology test scores from the psychometric ability tests administered in 1984, 1991 and 1998. Neuropsychologists then rated the study participants as either normal, suspect or cognitively impaired in 1998. Changes in estimated test scores were computed over seven and fourteen years. Significant odds ratios between normal and cognitively impaired groups were found for all neuropsychological tests over the proximal period and for most tests over the 14-year period. Similar findings occurred for the odds ratios between the normal and suspect groups for the most proximal 7-year changes.     

Extending Neuropsychological Assessments into the Primary Mental Ability Space

ABSTRACT

A battery of 17 neuropsychological tests (including the CERAD battery) and 17 psychometric ability tests were administered to a sample of 499 participants of the Seattle Longitudinal study who had been given the psychometric ability tests seven and 14 years earlier. The neuropsychological tests were projected into a 5-factor psychometric ability space by means of extension analysis. The concurrent regressions of the neuropsychology tests on the psychometric ability tests were then used to estimate neuropsychology test scores from the psychometric ability tests administered in 1984, 1991 and 1998. Neuropsychologists then rated the study participants as either normal, suspect or cognitively impaired in 1998. Changes in estimated test scores were computed over seven and fourteen years. Significant odds ratios between normal and cognitively impaired groups were found for all neuropsychological tests over the proximal period and for most tests over the 14-year period. Similar findings occurred for the odds ratios between the normal and suspect groups for the most proximal 7-year changes.     

International publication trends of JABA authorship

The present study addressed international publication trends in JABA authorship between 1970 and 1999. First, we analyzed authorship patterns to identify trends in the appearance of new first authors, unfamiliar authors, and frequent contributors. Second, articles were assigned to either a North American or an international category. The data show a decline in the number of articles by new authors and an increase in the publications of frequent contributors from North America. Trends are shown in comparison to those from the American Journal on Mental Retardation.     

Cognitive and personality determinants of safe driving performance in professional drivers

Large truck and bus crashes still cause a high rate of fatalities and costs. Considering that the human factor plays an important role it is obvious that there is great interest in predicting safe driving performance in professional drivers, especially with new technologies emerging to assist drivers. This study uses a modern theoretical framework to assess which psychometric tests are still able to predict safe driving performance in today’s professional drivers under these new circumstances.126 male professional bus drivers completed a standardized digital test battery and three driving exercises. The test battery was used to assess reaction time, concentration, ability to gain an overview, reactive stress tolerance, logical reasoning, and safety-related personality traits. The exercises consisted of an on-road driving test, an obstacle course, and a maneuvering course.The study yielded satisfactory indicators of criterion related validity. It also showed that different tests were relevant for the prediction of safe driving performance in different driving exercises. Contrary to previous research, logical reasoning showed significant effects. The results indicate that in order to assess safe driving performance in professional drivers, a comprehensive assessment with psychometric tests should be recommended.     

Results of a Citation Analysis of the Career Counselling Field from an African Perspective

The study examined research and trends in career counselling published in selected professional sources during the period 1980–2010. Citation analysis was used in this study to investigate documents which were indexed in the Web of Science related to career counselling. Career counselling and related keywords were used jointly in the search for documents. There were a total of 730 documents judged to be relevant to the field of career counselling and were citation analysed. The number of citations related to the career counselling field has been increasing continuously since 2000. Research publications on career counselling are projected to increase for both South African authors and the authors of other African countries.     

中国发展心理学的研究热点与发展趋势——基于《心理发展与教育》创刊35年的文献计量分析

为宏观地把握中国发展心理学的研究热点与发展趋势,基于我国唯一的发展心理学与教育心理学专业学术刊物《心理发展与教育》1985~2019年的2456篇文献,采用文献计量法对该刊年发文量、年被引量、年下载量、年转载量、研究机构、关键词等指标进行分析。结果发现,《心理发展与教育》历年的发文量总体呈波动上升的趋势,认知与社会性发展的研究为教育与学习心理以及心理健康的研究主题奠定了夯实的理论基础。结合关键词共现和聚类分析的结果,本文从发展时期、学科交叉和特殊群体三方面对我国发展心理学的未来发展趋势进行了展望。     

Social psychological research in The Netherlands, 1980-1988

This paper contains an investigation about research of Dutch social psychologists. Based on reported publications two types of analyses were performed. The reported publications were categorized by means of a topic-inventory proposed by Fisch and Daniel (1982), which enabled us to compare Dutch trends with developments in Europe and the U. S.A. Moreover, by means of bibliometric analyses publications of Dutch social psychologists were related to data obtained by the Institute for Scientific Information (ISI). Several trends were observed and discussed.     

Genetics and general cognitive ability (g)

Two recent articles in this journal made the case for the existence and importance of g and reviewed research on cognitive and psychophysical correlates of psychometric g. This review considers g from a genetic perspective. Multivariate genetic research indicates that g accounts for nearly all of the genetic variance of diverse psychometric cognitive tests (genetic g). Recent research suggests not only that elementary cognitive tasks are genetically linked to psychometric g but also that genetic g pervades these tasks. Contrary to the assumption of modularity that dominates cognitive science, genetic g exists in the mind as well as in psychometric tests.     

The Work Addiction Risk Test: development of a tentative measure of workaholism

The development and analyses of the psychometric characteristics of a tentative self-report measure of work addiction are reported. A total of 363 college students completed a battery of tests including the Work Addiction Risk Test. Internal consistency of the scores was .88. Also, these scores were compared with those on the Type A Self-rating Scale and the Jenkins Activity Survey, which give self-reports of Type A behavior and the State-Trait Anxiety Inventory. That scores on the work addiction risk test were reliable and showed concurrent validity supported psychometric utility for research and clinical practice.     

A Retrospective Analysis of the Trend of Retracted Publications in the Field of Biomedical and Life Sciences

Among the many forms of research misconduct, publishing fraudulent data is considered to be serious where the confidence and validity of the research is detrimentally undermined. In this study, the trend of 303 retracted publications from 44 authors (with more than three retracted publications each) was analysed. The results showed that only 6.60% of the retracted publications were single-authored and the discovery of fraudulent publications had reduced from 52.24 months (those published before the year 2000) to 33.23 months (those published on the year 2000 and onwards). It appears that with the widely accessible public databases like PubMed, fraudulent publications can be detected more easily. The different approaches adopted by authors who had previous publications retracted are also discussed herein.     

An examination of the factor structure of the Social Skills Rating System parent elementary form

Although previous studies have questioned the factor structure of the Social Skills Rating System (SSRS), it continues to be one of the most prominent measures used to assess child social skills. Previous examinations of the SSRS have been conducted on samples that differ demographically from the standardization sample. The present study presents a factor analysis of the SSRS parent elementary form, social skills domain, in a sample of 298 non-referred children. Similar to previous research, the factor structure proposed by the authors of the SSRS was not replicated. An alternative 2-factor model based on previous research also did not adequately fit the data. Other psychometric properties, such as the range of inter-item correlations, were evaluated and did not meet suggested guidelines for test construction. Despite its psychometric difficulties, the SSRS was related to history of treatment for peer difficulties.     

Trends and developments in community and applied social psychology: JCASP 1991–2010

This paper looks back on the trends and developments in and of the Journal of Community and Applied Social Psychology since its inception twenty years ago. We review to what extent the aims that were originally set for JCASP have been fulfilled. The trends in nationality of authors, themes of publications and their methodology are discussed. Possible implications of these trends and developments for JCASP and its future are pointed at. Copyright © 2010 John Wiley & Sons, Ltd.     

Reliability of the Attitudes Toward Women Scale (AWS) and the Personal Attributes Questionnaire (PAQ)

The stability and internal consistency of Spence and Helmreich's Attitudes Toward Women Scale (AWS) and Personal Attributes Questionnaire (PAQ) are reported. An entire first-year class of 1,007 male and 78 female cadets at the U.S. Military Academy were given a battery of psychological tests before and after cadet basic training, a 2 1/2-month period. The AWS and PAQ proved to be highly reliable, comparable to other frequently used psychological tests. This psychometric information encourages researchers to make further use of these gender-related instruments.This research was conducted under research grants from the Army Research Institute (Alan G. Vitters and Jerome Adams, Principal Investigators). The views expressed herein are opinions of the authors and do not necessarily reflect the policy of the U.S. Army, the U.S. Military Academy, or the Army Research Institute. The authors appreciate the editorial comments of Dr. Brenda Major.     

Modified test administration using assistive technology: preliminary psychometric findings

This study examined the psychometric properties of test presentation and response formats that were modified to be accessible with the use of assistive technology (AT). First, the stability of psychometric properties was examined in 60 children, ages 6 to 12, with no significant physical or communicative impairments. Population-specific differences were then examined with samples that included 24 children with cerebral palsy and matched control peers. Children were administered standard and modified versions of tests. The type of AT access did not have a statistically significant effect on modified test scores. Measurement stability between the standard and modified versions of quadrant forced-choice format tests was sufficient. The findings support the potential use of AT and accessible procedures for some test instruments in the assessment of children with cerebral palsy.     

Profile of Mood States Research in Sport and Exercise Psychology: Past,Present, and Future

Abstract

A review was conducted of the sport and exercise literature for the years 1971 to early 1998 in which the Profile of Mood States (POMS) figured prominently. Analyses indicated that there were 258 published articles in which the POMS was used with athletic or exercise samples during this time period. Of these articles, 226 were data-based and the remainder dealt with general, theoretical, or psychometric issues. Prominent journals publishing the data-based research, leading authors, sport samples used, gender issues, and temporal trends in the use of the POMS were noted. Anticipated future developments include: improvements in research methodologies used to study relationships among sport, exercise, and mood; continued validation of abbreviated forms of the scale as well as a form for use with youth samples; and increased utilization of the POMS for mood profiling.     

Using Invariance to Examine Cheating in Unproctored Ability Tests

Despite their widespread use in personnel selection, there is concern that cheating could undermine the validity of unproctored Internet‐based tests. This study examined the presence of cheating in a speeded ability test used for personnel selection. The same test was administered to applicants in either proctored or unproctored conditions. Item response theory differential functioning analyses were used to evaluate the equivalence of the psychometric properties of test items across proctored and unproctored conditions. A few items displayed different psychometric properties, and the nature of these differences was not uniform. Theta scores were not reflective of widespread cheating among unproctored examinees. Thus, results were not consistent with what would be expected if cheating on unproctored tests was pervasive.     

Cyberbullying assessment instruments: A systematic review

Although several instruments to assess cyberbullying have been developed, there is nevertheless a lack of knowledge about their psychometric properties. The aim of the present systematic review is to provide a representative overview of the current instruments designed to assess cyberbullying. Further, emphasis will be placed on the structural and psychometric properties of cyberbullying instruments, such as validity and reliability, as well as their conceptual and definitional bases. It will also provide criteria for readers to evaluate and choose instruments according to their own aims. A systematic literature review, limited to publications published prior to October 2010, generated 636 citations. A total of 61 publications fulfilled the delineated selection criteria and were included in the review, resulting in 44 instruments. Following a rater training, relevant information was coded by using a structured coding manual. The raters were the nine authors of this review. Almost half of the instruments included in this review do not use the concept of cyberbullying. The constructs measured by the instruments range from internet harassment behavior to electronic bullying behavior to cyberbullying. Even though many of the authors use other concepts than cyberbullying they claim that their instruments do measure it. For the purpose of this systematic review, we have chosen to categorize them as two different groups, cyberbullying instruments and related instruments. Additionally, most of the included instruments had limited reports of reliability and validity testing. The systematic review reveals a need for investigating the validity and reliability of most of the existing instruments, and resolving the conceptual and definitional fluctuations related to cyberbullying.