Increasing accurate preference assessment implementation through pyramidal training

Preference assessments directly evaluate items that may serve as reinforcers, and their implementation is an important skill for individuals who work with children. This study examined the effectiveness of pyramidal training on teachers' implementation of preference assessments. During Experiment 1, 3 special education teachers taught 6 trainees to conduct paired-choice, multiple-stimulus without replacement, and free-operant preference assessments. All trainees acquired skills necessary to implement preference assessments with 90% or greater accuracy during the training sessions and demonstrated generalization of skills to their classrooms or clinic. During Experiment 2, 5 teachers who served as trainees in Experiment 1 trained 18 preschool teachers. All preschool teachers met the mastery criterion following training. Training teachers to implement preference assessments may increase teachers' acceptance and use of behavior-analytic procedures in school settings.     

Accuracy of Effect Size Estimates From Published Psychological Experiments Involving Multiple Trials

The reporting of exaggerated effect size estimates may occur either through researchers accepting statistically significant results when power is inadequate and/or from repeated measures approaches aggregating, averaging multiple items, or multiple trials. Monte-Carlo simulations with input of a small, medium, or large effect size were conducted on multiple items or trials that were either averaged or aggregated to create a single dependent measure. Alpha was set at the .05 level, and the trials were assessed over item or trial correlations ranging from 0 to 1. Simulations showed a large increase in observed effect size averages and the power to accept these estimates as statistically significant increased over numbers of trials or items. Overestimation effects were mitigated as correlations between trials increased but still remained substantial in some cases. The implications of these findings for meta-analyses and different research scenarios are discussed.     

Developmental changes in coping: Situational and methodological influences

Abstract

Previous studies on the development of coping have shown rather inconsistent findings regarding the developmental trajectories for different coping dimensions. The aim of this study is to search for possible influences that might explain these inconsistencies. The analysis focuses on methodological influences (longitudinal vs. cross-sectional assessments) and situational influences. Two samples of children were traced longitudinally with yearly assessments from grade 2 to 5 (sample 1, N =432) and from grade 4 to 7 (sample 2, N =366). A third sample (N =849) was added with cross-sectional assessments from grade 2 to 7. The assessed coping dimensions were related to (a) problem solving, (b) seeking social support, (c) palliative coping, (d) externalizing emotional coping, and (e) avoidant coping. The use of the coping strategies had to be assessed for six stress-evoking situations. The results show only small differences between the longitudinal and the cross-sectional coping assessments. There are, however, clear situational influences on the choice of the coping strategies and also on the resulting developmental trajectories.     

The Impact of the United States Air Force Deployment Transition Center on Postdeployment Mental Health Outcomes

The United States Air Force Deployment Transition Center (DTC) operates a 2-day third-location decompression program that commenced operations during the summer of 2010 in Ramstein, Germany, with the aim to assist Air Force service members (AFSMs) who are returning from deployment as they prepare to reintegrate back into their home lives and work stations. The present study evaluated the impact of DTC attendance on later mental health outcomes. Because participants are not randomly assigned to attend the DTC, propensity score weighting was used to compare DTC participants (N = 1,573) to a weighted control group of AFSMs (N = 1,570) in the same job specialties who returned from deployment during the same time period. Rates of endorsement to items on the Postdeployment Health Reassessment were examined and compared, as were rates of mental health diagnoses from AFSMs’ official medical records. Key findings indicate that DTC participants reported lower levels of depressive and posttraumatic stress symptoms and lower levels of relationship conflict following return from deployment, as compared to weighted control participants. Mental health diagnostic rates were comparable for the 2 groups during the first 6 months following return from deployment. These findings suggest that participation in the DTC program had notable benefits for redeploying AFSMs and support the continued use of the program.     

An assessment of antecedent events influencing noncompliance in an outpatient clinic

Several studies have shown that various factors can influence noncompliance, including task novelty, rate of presentation, and task preference. This study examined the impact of selected antecedent variables on noncompliance in an outpatient clinic setting. In two experiments involving 6 typically developing children, the consequences for noncompliance remained constant. During Experiment 1, demands that included noncontingent access to adult attention were contrasted with the same demands that did not include attention within a multielement design. In Experiment 2, demands were altered by decreasing the difficulty or amount of work or providing access to attention. In both experiments, results indicated idiosyncratic responses to the manipulated variables, with decreases in noncompliance observed following introduction of one or more antecedent variables with 5 of the 6 participants. These results suggested that noncompliance can be reduced via changes in antecedent variables, including adding potential positive reinforcers to the task situation, and that it is possible to probe variables that alter noncompliance in an outpatient clinic setting.     

Cross-national applicability of a game-based cognitive assessment

New technology has had a discernable impact on how organizations recruit and select potential employees. Game-based assessment has emerged as a potential technology that can be used to enhance the assessment of individual differences and applicants' views of the selection process. However, studies investigating the psychometric properties and predictive validity of game-based assessments are still lacking. This study investigated the structural equivalence of a game-based assessment of cognitive ability across 228 Australians and 239 South Africans. A smaller sample of 115 South Africans also received work performance ratings to investigate the predictive validity of the cognitive assessment. Results of factor analysis supported a strong general factor of cognitive ability across the entire sample but only partial metric and scalar invariance across the two nations. The general factor of the game-based assessment further revealed promising results in terms of its predictive validity for five broad dimensions of individual work performance.     

Issues associated with repeated neuropsychological assessments

Distinguishing practice effects from other factors in repeated neuropsychological assessments are discussed in the context of research studies and clinical/forensic assessments. Potential methodological procedures for reducing the impact of practice effects in research settings are outlined. In contrast, the potential clinical utility and interpretation of practice effects in clinical assessments and forensic evaluations are highlighted.     

The use of decomposition in probability assessments of continuous variables

In this study, decomposition is used as a tool for the assessment of continuous probability distributions. The goal of using decomposition is to obtain better calibrated probability distributions by expressing a variable as a known function of several component variables. Three target quantities were used in the study. Each was assessed holistically and using two different decompositions. Thus, each subject provided three distributions for each of the three target quantities. The recomposed assessments were compared to holistic assessments. The distributions obtained using decomposition were found to be much better calibrated than those obtained holistically. Two methods of aggregating distributions from multiple subjects were also examined. One involves aggregating (averaging) distributions before recomposing while the second method involves recomposing and then averaging distributions for the target variable. The second method was found to be slightly better, although both showed better calibration than was found in the individual assessments.     

Utopias and Comparative Assessments of Justice

When we make public policy choices, is it helpful to know how utopia (that is, the perfectly just institutional design) would look? Amartya Sen argues that it is neither necessary, nor sufficient, nor even contributory. He claims that before making a policy choice one should compare several feasible institutional designs to see which promotes justice most (a “comparative assessment” of justice), and that it is misleading to use the perfect design as a standard in those comparisons. Principles of justice are the proper standard. The present article contends that the perfect design has nevertheless an important role to play in the prior task of identifying and refining our principles of justice. It also shows that the perfect design—in at least one sense of this term—may be a legitimate long‐term goal for present policy choices.     

Cognitive ability in virtual reality: Validity evidence for VR game‐based assessments

Virtual reality (VR) technology may provide unique benefits for assessing individual characteristics, in contrast with traditional assessments. This study examined validity evidence for the use of VR game (VRG) scores to indicate specific cognitive abilities. Participants completed three VRGs, three computer‐based assessments (CBAs), and additional scales. To evaluate convergent validity, VRG scores were compared with CBA scores. For divergent validity, VRG scores were compared with five factors of personality based on the Five Factor Model. For criterion‐related validity, VRG scores were compared with academic achievement (i.e., grade point average). Findings generally provided support that the VRG scores are related to certain spatial reasoning subdimensions of cognitive ability. However, further research is needed to examine the qualities of VRGs as assessment tools.