Administration and Environment Considerations in Computer-Based Sports-Concussion Assessment

Computer-based testing has become a vital tool for the assessment of sport-related concussion (SRC). An increasing number of papers have been published on this topic, focusing on subjects such as the purpose and validity of baseline testing, the performance of special populations on computer-based tests, the psychometric properties of different computerized neurocognitive tools, and considerations for valid and reliable administration of these tools. The current paper describes several considerations regarding computerized test design, input and output devices, and testing environment that should be described explicitly when administering computer-based cognitive testing, regardless of whether the assessment is used for clinical or research purposes. The paper also reviews the conclusions of recent literature (2007–2013) using computer-based testing for the assessment of SRC, with special attention to the methods used in these studies. We also present an appendix checklist for clinicians and researchers that may be helpful in ensuring proper attention to factors that could influence the reliability and validity of computer-based cognitive testing. We believe that explicit attention to these technological factors may lead to the development of standards for the development and implementation of computer-based tests. Such standards have the potential to enhance the accuracy and utility of computer-based tests in SRC.     

Computerized Cognitive Tests (CCT) in elderly: A psychometric review

Introduction/aim

Computerized Cognitive Tests (CCT) play an increasing role in the assessment of elderly cognitive impairment. In this framework, it is important to review the psychometric data of the available CCT in the detection of cognitive decline.

Psychometric Properties of Parent–Child (0–5 years) Interaction Outcome Measures as Used in Randomized Controlled Trials of Parent Programs: A Systematic Review

This systematic review sought to identify observational measures of parent–child interactions commonly implemented in parenting program research, and to assess the level of psychometric evidence available for their use with this age group. Two separate searches of the same databases were conducted; firstly, to identify eligible instruments, and secondly to identify studies reporting on the psychometric properties of the identified measures. Five commercial platforms hosting 19 electronic databases were searched from their inception to conducted search dates. Fourteen measures were identified from Search 1; a systematic search of randomized controlled trial evaluations of parenting programs. For Search 2, inclusion/exclusion criteria were applied to 1327 retrieved papers that described the development and/or validation of the 14 measures identified in Search 1. Seventeen articles met the inclusion criteria, resulting in five observational measures for the final review. Data were extracted and synthesized using the COSMIN rating system to describe the methodological quality of each article alongside the overall quality rating of the psychometric property reported for each measure using the Terwee checklist. Measure reliability was categorized into four domains (internal consistency, test-re-test, inter-rater, and intra-rater). Measure validity was categorized into four domains (content, structural, convergent/divergent, and discriminant). Results indicated that the majority of psychometric evidence related to children aged from birth the three with internal consistency, inter-rater reliability, and structural validity the most commonly reported properties, although this evidence was often weak. The findings suggest further validation of the included measures is required to establish acceptability for the whole target age group.

     

Computerized assessment in neuropsychology: A review of tests and test batteries

This article contains detailed reviews of 13 computerized neuropsychological and performance test batteries and six stand-alone computer tests. Tasks found on these instruments are described and tables illustrate which batteries employ which measures. In addition to issues of reliability and validity, special considerations apply to computerized assessment. These issues are discussed and readers are provided information to help them assess computerized tests in relation to their particular clinical and research needs. Since many computerized tests were developed as performance assessment tools, the relationship between performance and neuropsychological assessment is examined.     

Preliminary analysis of the psychometric properties of Ryff's scales of psychological well-being in Portuguese adolescents

This article presents a set of research studies that aim to adapt Carol Ryff's scales of psychological wellbeing (SPWB) and to analyze its psychometric properties in adolescents. The first two studies focused on the reliability and factorial validity of different Portuguese short versions of SPWB, revealing measurement models inadequacies and low internal consistency. In the third study we developed a shortened version (30 items), taking into account the application of psychometric criteria suggested by van Dierendonck (2005). The scales of this version revealed better reliability and adequate goodness of fit indices for the six-factor model, as proposed by Carol Ryff's PWB theory. Although further research focused on the psychometrical properties reanalysis of this shortened version of SPWB is needed, this article provides a contribution to the research and intervention on positive mental health during adolescence.     

Assessment of Attention in Preschoolers

In the past two decades, there has been an increased interest in the assessment and treatment of preschool children presenting with concerns about attention problems. This article reviews the research and clinical literature involving assessment of attention and related skills in the preschool years. While inattention among preschoolers is common, symptoms alone do not necessarily indicate a disorder, and most often represent a normal variation in typical preschool child development. Thus, accurate identification of ??disordered?? attention in preschoolers can be challenging, and development of appropriate, norm-referenced tests of attention for preschoolers is also difficult. The current review suggests that comprehensive assessment of attention and related functions in the preschool child should include thorough review of the child??s history, planned observations, and formal psychometric testing. The three primary methods of psychometric assessment that have been used to characterize attentional functioning in preschool children include performance-based tests, structured caregiver interviews, and rating scales (parent, teacher, and clinician). Among performance-based methods for measurement of attention in the preschool years, tests have been developed to assess sustained attention, selective (focused) attention, span of attention (encoding/manipulation), and (top-down) controlled attention??including freedom from distractibility and set shifting. Many of these tests remain experimental in nature, and review of published methods yields relatively few commercially available, nationally normed tests of attention for preschoolers, and an overall dearth of reliability and validity studies on the available measures.     

心理健康素质测评系统·中国成年人心理弹性量表的编制

编制适用于我国成年人使用的心理弹性量表。通过对心理弹性研究的文献分析,将心理弹性定义为能够帮助个体从逆境、灾难、丧失或威胁等重大应激事件所造成的心理创伤中恢复过来的心理特质。在确立内控性,注重问题解决的应对风格,乐观性,接受和运用社会支持的人格倾向性,接纳性5个维度后,编写与之对应的50个项目。通过对420名大学生被试的测试进行项目筛选后,形成由30个项目组成的正式量表。通过对285名成年被试和457名大学生被试的实测,考察量表的心理测量学指标。结果表明,心理弹性量表具有较高的内部一致性信度和重测信度,也     

Hormones and personality: Testosterone as a marker of individual differences

Recently, testosterone (T) has been linked to behaviors that are conceptually related to dominance as a personality characteristic. Although evidence for this association is growing, the psychometric properties of T as an individual difference variable have been largely neglected. For T to be considered a biological marker of dispositional dominance it is critical that it demonstrates high test–retest reliability and good convergent and discriminant validity. Two studies tested the temporal stability of salivary T in humans and the relationship between T and traditional measures of personality. Across both studies, test–retest reliability for T was high and comparable to the short-term stability of questionnaire-based and implicitly assessed personality assessment instruments. In being modestly correlated with self-reported dominance, T showed some evidence of convergent validity. In being statistically independent from conceptually unrelated personality constructs (such as Emotional Stability and Openness to Experience) it showed good evidence of discriminant validity. The findings strengthen the psychometric foundation for using T as a hormonal marker of individual differences.     

A short form of the Common Beliefs Survey III

Previous studies have shown that the Common Beliefs Survey III (CBS III) is an irrational beliefs inventory with satisfactory psychometric properties. We extended research on the CBS by examining this 54-item inventory for redundant material, and substantially abbreviated it without compormising its reliability or validity. This article describes the development of the new, 19-item short form (CBS19), convenient for clinical use, that preserves the psychometric properties of the original.     

Psychometric properties of the Social Problem Solving Inventory‐Revised Short‐Form in a South African population

The Social Problem Solving Inventory‐Revised Short‐Form (SPSI‐R:SF) has been used in several countries to identify problem‐solving deficits among clinical and general populations in order to guide cognitive‐behavioural interventions. Yet, very few studies have evaluated its psychometric properties. Three language versions of the questionnaire were administered to a general population sample comprising 1000 participants (771 English‐, 178 Afrikaans‐ and 101 Xhosa‐speakers). Of these participants, 210 were randomly selected to establish test–retest reliability (70 in each language). Principal component analysis was performed to examine the applicability of the factor structure of the original questionnaire to the South African data. Supplementary psychometric analyses were performed, including internal consistency and test–retest reliability. Collectively, results provide initial evidence of the reliability and validity of the SPSI‐R:SF for the assessment of problem solving deficits in South Africa. Further studies that explore how the Afrikaans language version of the SPSI‐R:SF can be improved and that establish the predictive validity of scores on the SPSI‐R:SF are needed.     

Further investigation of the validity and reliability of the photographic figure rating scale for body image assessment

Previous studies have not fully investigated the psychometric properties of the Photographic Figure Rating Scale (PFRS). In 2 studies, we report on the test-retest reliability and convergent validity of ratings derived from the PFRS. In Study 1, 322 female university students in Britain provided self-ratings on the PFRS and objectively measured body mass index (BMI); a subsample of 132 women also completed the task after 5 weeks. In Study 2, 243 women from the community in Austria completed the PFRS along with a battery of other body image scales. Results of Study 1 showed that ratings on the PFRS had good test-retest reliability (all rs > .87) and good convergent validity in relation to BMI. Results of Study 2 showed that PFRS-derived body dissatisfaction scores were significantly correlated with a range of body image variables. These results provide evidence for the convergent validity and good test-retest reliability of the PFRS.     

A depressive symptom scale for the California Psychological Inventory: construct validation of the CPI-D

To facilitate life span research on depressive symptomatology, a depressive symptom scale for the California Psychological Inventory (CPI) is needed. The authors constructed such a scale (the CPI-D) and compared its psychometric properties with 2 widely used self-report depression scales: the Beck Depression Inventory and the Center for Epidemiological Studies Depression Scale. Construct validity of the CPI-D was examined in 3 studies. Study 1 established content validity, classifying CPI-D items into Diagnostic and Statistical Manual of Mental Disorders-Fourth Edition depressive symptoms. Study 2 used 3 large samples to gather evidence for reliability and validity: correlational analyses demonstrated alpha reliability and convergent and discriminant validity; factor analysis provided evidence for discriminant validity with anxiety; and regression analyses demonstrated comparative validity with existing standard PI scales. Study 3 used clinician ratings of depression and anxiety as criteria for external validity.     

Tripartite model of anxiety and depression: psychometric evidence and taxonomic implications

We review psychometric and other evidence relevant to mixed anxiety-depression. Properties of anxiety and depression measures, including the convergent and discriminant validity of self- and clinical ratings, and interrater reliability, are examined in patient and normal samples. Results suggest that anxiety and depression can be reliably and validly assessed; moreover, although these disorders share a substantial component of general affective distress, they can be differentiated on the basis of factors specific to each syndrome. We also review evidence for these specific factors, examining the influence of context and scale content on ratings, factor analytic studies, and the role of low positive affect in depression. With these data, we argue for a tripartite structure consisting of general distress, physiological hyperarousal (specific anxiety), and anhedonia (specific depression), and we propose a diagnosis of mixed anxiety-depression.     

The depressive personality disorder inventory and current depressive symptoms: implications for the assessment of depressive personality

The Depressive Personality Disorder Inventory (DPDI; Huprich, Margrett, Barthelemy, & Fine, 1996; see Appendix) was created to assess Depressive Personality Disorder in clinical and nonclinical samples. Since its creation, the DPDI has been used in multiple studies, and the psychometric properties of the measure have generally supported its reliability, convergent validity, and construct validity; however, evidence for the measure's discriminant validity has been mixed. Specifically, the DPDI tends to correlate highly with measures of current depressive symptoms, which limits its efficacy in differentiating current depressive symptoms from a depressive personality structure. A principal components analysis of 362 individuals who completed both the DPDI and Beck Depression Inventory (BDI-II; Beck, Steer, & Brown, 1996) found that 49% of the variance was accounted for in two components. Seven items from the DPDI loaded more strongly on the first component composed of many BDI-II items. These items were removed in order to create a measure believed to assess DPD without the confounding influence of current depressive symptomology. Principal components analysis of the revised measure yielded three components, accounting for 46% of the variance. The revised DPDI was used to calculate convergent, discriminant, and construct validity coefficients from measures used in former studies. Virtually no improvement in the validity coefficients was observed. It is concluded that assessing DPD via self-report is limited in its utility.     

Assessing Sexual Orientation Symptoms in Obsessive-Compulsive Disorder: Development and Validation of the Sexual Orientation Obsessions and Reactions Test (SORT)

Obsessive-compulsive disorder (OCD) includes many symptom presentations, which creates unique diagnostic challenges. Fears surrounding one’s sexual orientation are common within OCD (also called SO-OCD), but SO-OCD is consistently misdiagnosed by physicians and psychologists. To address this issue, we describe the development of a self-report measure for assessing SO-OCD to help distinguish OCD from distress caused by a sexual orientation identity crisis. The current paper details two studies that established the psychometric properties and clinical utility of this measure. In Study 1, the factor structure, validity, and reliability were examined for the measure’s 12 items in a sample of 1,673 university students. The results revealed a two-factor solution for the measure (Factor 1: Transformation Fears; Factor 2: Somatic Checking) and preliminary evidence of validity and reliability. In Study 2, the measure was tested with LGBTQ and heterosexual community samples and clinical samples of individuals with SO-OCD and other types of OCD. The two-factor solution and evidence of validity and reliability were supported in these samples. Cut-off points were established to distinguish between community members and SO-OCD sufferers, as well as between those experiencing SO-OCD and other types of OCD. Limitations and future directions are discussed.     

A Psychometric Review of Measures of Irrational Beliefs: Implications for Psychotherapy

In this study, measures of irrational beliefs based on the principles of Rational Emotive Behavior Therapy (REBT) were reviewed and contrasted based on psychometric characteristics and quality of guidelines for interpretation. The use of measures of irrational beliefs is an important component of the assessment of presenting problems in psychotherapy and may inform clinical decision making. Additionally, these measures are a helpful way to identify change in irrational beliefs and to measure the effectiveness of specific interventions to facilitate such change. While there are a number of measures of beliefs, there is considerable variability in their psychometric properties and utility for assessment. The majority of the tests are not produced by a publishing company, nor do they provide test manuals. The reliability and validity evidence presented in the publications varies considerably as do the size and quality of standardization samples, which impacts upon the ability to draw normative conclusions. Analyses demonstrated that most measures of irrational beliefs do not provide the evidence needed to adequately address the Standards for Educational and Psychological Testing (Standards; American Educational Research Association [AERA], American Psychological Association [APA], National Council on Measurement in Education [NCME] 1999). Discussion of the implications of this review for the development of future measures of irrational thinking by researchers as well as recommendations in the test selection process for an REBT practitioner is offered.     

The Islamophobia Scale: Instrument Development and Initial Validation

Opinion poll research suggests that a significant number of Westerners hold negative and fearful perceptions toward Muslims and their religion. Although evidence of Islamophobia has been documented in a number of poll studies, no psychometrically based, multifaceted measure that focuses exclusively on fear related attitudes and is not confounded with a particular group currently exists in the scientific literature. The authors of this study describe the development and psychometric properties of the Islamophobia Scale, which measures cognitive and affective-behavioral facets of fear-related attitudes toward the religion of Islam and Muslims. The results of the study demonstrate a measure of Islamophobia that yielded acceptable psychometric properties of reliability and validity.     

自闭症谱系障碍的早期筛查工具

基于35项实证研究, 遵循诊断准确性研究的质量评估(QUADAS-2)的循证程序对自闭症谱系早期预警特征筛查工具开展质量评估, 包括婴儿阶段(10个筛查工具, 159388人)、幼儿阶段(14项筛查工具, 11712人), 旨在为自闭症谱系风险的早期识别提供全面的理解。结果表明：幼儿阶段的筛查工具的分类准确性要高于婴儿阶段, 在婴儿阶段达到良好水平的筛查工具有M-CHAT-R/F、PDQ-1; 在幼儿阶段达到优秀水平的筛查工具有OERA、TIDOS。其中, “改良的幼儿自闭症检查表-有修订的后续随访” (M-CHAT-R/F)是目前最具潜力的自闭症谱系风险筛查工具之一。最后, 我们探讨了应用QUADAS-2评估研究质量的局限性, 强调需要规范工具的质量评估标准与进一步验证研究的必要性。     

Further explorations of perceptual speed abilities in the context of assessment methods, cognitive abilities, and individual differences during skill acquisition

Measures of perceptual speed ability have been shown to be an important part of assessment batteries for predicting performance on tasks and jobs that require a high level of speed and accuracy. However, traditional measures of perceptual speed ability sometimes have limited cost-effectiveness because of the requirements for administration and scoring of paper-and-pencil tests. There have also been concerns about the validity of previous computer approaches to administering perceptual speed tests (e.g., see Mead & Drasgow, 1993). The authors developed two sets of computerized perceptual speed tests, with touch-sensitive monitors, that were designed to parallel several paper-and-pencil tests. The reliability and validity of the tests were explored across three empirical studies (N = 167, 160, and 117, respectively). The final study included two criterion tasks with 4.67 and 10 hours of time-on-task practice, respectively. Results indicated that these new measures provide both high levels of reliability and substantial validity for performance on the two skill-learning tasks. Implications for research and application for computerized perceptual speed tests are discussed.