The Effect of Method Characteristics on Retest Score Gains and Criterion-Related Validity

Purpose

We sought to empirically assess the effect of predictor method characteristics (test form, item-type, and test-type) on retest score change associated with an invariant construct—general mental ability (GMA)—and to evaluate the effect of retesting on the criterion-related validity of assessments that vary in their susceptibility to retest effects.

Design

Three hundred seven individuals completed a battery of GMA assessments. After a 6-week interval, participants returned to the testing site to retest using both alternate and identical forms of the initial assessments.

Findings

Greater score gains were observed on assessments comprising heterogeneous item-types than homogeneous item-types, and on performance-based assessments than self-report assessments. However, despite variations in score gains, the relationships between the initial test scores and criterion scores were no different than the relationships between retest scores and criterion scores for all assessments.

Implications

Tests and procedures that reduce reliance on test- or item-specific knowledge and skill may help minimize score changes due to retesting across multiple administrations. Moreover, under the boundary conditions present in this study, the criterion-related validity of ability assessments may not be affected by increases in test-specific knowledge and skills.

Originality/Value

Despite the prevalence and industry support of retesting, a comprehensive understanding of retest score change still eludes researchers and practitioners. This ambiguity may be due in part to neglecting the method-construct distinctions in the retest literature. This is the first report to explicitly utilize the method-construct distinction in an effort to examine the causes and consequences of retest effects.

     

Psychological Distress,Anxiety, and Depression of Cancer-Affected BRCA1/2 Mutation Carriers: a Systematic Review

Understanding the intermediate- and long-term psychological consequences of genetic testing for cancer patients has led to encouraging research, but a clear consensus of the psychosocial impact and clinical routine for cancer-affected BRCA1 and BRCA2 mutation carriers is still missing. We performed a systematic review of intermediate- and long-term studies investigating the psychological impact like psychological distress, anxiety, and depression in cancer-affected BRCA mutation carriers compared to unaffected mutation carriers. This review included the screening of 1243 studies. Eight intermediate- and long-term studies focusing on distress, anxiety, and depression symptoms among cancer-affected mutation carriers at least six months after the disclosure of genetic testing results were included. Studies reported a great variety of designs, methods, and patient outcomes. We found evidence indicating that cancer-affected mutation carriers experienced a negative effect in relation to psychological well-being in terms of an increase in symptoms of distress, anxiety, and depression in the first months after test disclosure. In the intermediate- and long-term, no significant clinical relevant symptoms occurred. However, none of the included studies used specific measurements, which can clearly identify psychological burdens of cancer-affected mutation carriers. We concluded that current well-implemented distress screening instruments are not sufficient for precisely identifying the psychological burden of genetic testing. Therefore, future studies should implement coping strategies, specific personality structures, the impact of genetic testing, supportive care needs and disease management behaviour to clearly screen for the possible intermediate- and long-term psychological impact of a positive test disclosure.     

The Impact of Parent Empowerment in Children’s Mental Health Services on Parenting Stress

Emotional and behavioral (EB) problems in children are associated with increased perceptions of strain in parenting. Among children receiving services, parenting stress has been linked to initiating services for their children, and may strain the relationship between parent and child. In contrast, parental engagement and empowerment in services is an important quality indicator for positive treatment outcomes. However, no known studies have examined the association between parent empowerment in their child’s services and their perceptions of stress related to parenting a child with significant mental health needs. Further, no studies have explored whether empowerment moderates the relationship between the child’s symptoms and parental perceptions of stress. The current study examined the impact of child EB problems and parent empowerment on parenting stress. Among a sample of 525 parents of children receiving school-based services for disruptive behavior disorders, child EB problems significantly predicted parenting stress. Parent empowerment also correlated with lower parenting stress, as hypothesized. Although parent empowerment was not found to moderate the relationship between child symptomatology and parenting stress, the relationship between parent empowerment and parenting stress differed based on child gender and age. Parent empowerment was associated with lower parenting stress more for parents of females and younger children than for parents of males and older children.     

Free-energy and the brain

If one formulates Helmholtz’s ideas about perception in terms of modern-day theories one arrives at a model of perceptual inference and learning that can explain a remarkable range of neurobiological facts. Using constructs from statistical physics it can be shown that the problems of inferring what cause our sensory inputs and learning causal regularities in the sensorium can be resolved using exactly the same principles. Furthermore, inference and learning can proceed in a biologically plausible fashion. The ensuing scheme rests on Empirical Bayes and hierarchical models of how sensory information is generated. The use of hierarchical models enables the brain to construct prior expectations in a dynamic and context-sensitive fashion. This scheme provides a principled way to understand many aspects of the brain’s organisation and responses. In this paper, we suggest that these perceptual processes are just one emergent property of systems that conform to a free-energy principle. The free-energy considered here represents a bound on the surprise inherent in any exchange with the environment, under expectations encoded by its state or configuration. A system can minimise free-energy by changing its configuration to change the way it samples the environment, or to change its expectations. These changes correspond to action and perception, respectively, and lead to an adaptive exchange with the environment that is characteristic of biological systems. This treatment implies that the system’s state and structure encode an implicit and probabilistic model of the environment. We will look at models entailed by the brain and how minimisation of free-energy can explain its dynamics and structure.     

The effect of brief auditory stimuli on visual apparent motion

When two discrete stimuli are presented in rapid succession, observers typically report a movement of the lead stimulus toward the lag stimulus. The object of this study was to investigate crossmodal effects of irrelevant sounds on this illusion of visual apparent motion. Observers were presented with two visual stimuli that were temporally separated by interstimulus onset intervals from 0 to 350 ms. After each trial, observers classified their impression of the stimuli using a categorisation system. The presentation of short sounds intervening between the visual stimuli facilitated the impression of apparent motion relative to baseline (visual stimuli without sounds), whereas sounds presented before the first and after the second visual stimulus as well as simultaneously presented sounds reduced the motion impression. The results demonstrate an effect of the temporal structure of irrelevant sounds on visual apparent motion that is discussed in light of a related multisensory phenomenon, 'temporal ventriloquism', on the assumption that sounds can attract lights in the temporal dimension.     

Changing viewpoints during dynamic events

The connection of various viewpoints of a visual dynamic scene can be realised in different ways. We examined if various presentation modes influence scene recognition and cognitive representation type. In the learning phase, participants saw clips of basketball scenes from (a) a single, unvaried viewpoint, or with a change of viewpoint during the scene, whereby the connection was realised (b) by an abrupt cut, or (c) by a continuous camera move. In the test phase, participants had to recognise video stills presenting basketball scenes from the same or differing viewpoints. As expected, cuts led to lower recognition accuracy than a fixed unvaried viewpoint, whereas this was not the case for moves. However, the kind of connection between two viewpoints had no influence on the viewpoint dependence of the cognitive representation. Additionally, it was found that the amount of viewpoint deviation seemed to influence the overall conservativeness of participants' reactions.