Direct behavior rating as a school-based behavior universal screener: Replication across sites

The purpose of this study was to evaluate the utility of Direct Behavior Rating Single Item Scale (DBR–SIS) targets of disruptive, engaged, and respectful behavior within school-based universal screening. Participants included 31 first-, 25 fourth-, and 23 seventh-grade teachers and their 1108 students, sampled from 13 schools across three geographic locations (northeast, southeast, and midwest). Each teacher rated approximately 15 of their students across three measures, including DBR–SIS, the Behavioral and Emotional Screening System (Kamphaus & Reynolds, 2007), and the Student Risk Screening Scale (Drummond, 1994). Moderate to high bivariate correlations and area under the curve statistics supported concurrent validity and diagnostic accuracy of DBR–SIS. Receiver operating characteristic curve analyses indicated that although respectful behavior cut scores recommended for screening remained constant across grade levels, cut scores varied for disruptive behavior and academic engaged behavior. Specific cut scores for first grade included 2 or less for disruptive behavior, 7 or greater for academically engaged behavior, and 9 or greater for respectful behavior. In fourth and seventh grades, cut scores changed to 1 or less for disruptive behavior and 8 or greater for academically engaged behavior, and remained the same for respectful behavior. Findings indicated that disruptive behavior was particularly appropriate for use in screening at first grade, whereas academically engaged behavior was most appropriate at both fourth and seventh grades. Each set of cut scores was associated with acceptable sensitivity (.79–.87), specificity (.71–.82), and negative predictive power (.94–.96), but low positive predictive power (.43–.44). DBR–SIS multiple gating procedures, through which students were only considered at risk overall if they exceeded cut scores on 2 or more DBR–SIS targets, were also determined acceptable in first and seventh grades, as the use of both disruptive behavior and academically engaged behavior in defining risk yielded acceptable conditional probability indices. Overall, the current findings are consistent with previous research, yielding further support for the DBR–SIS as a universal screener. Limitations, implications for practice, and directions for future research are discussed.     

The Impact of Asymmetric Partial Feedback on Response‐Bias

For many decisions we make, we are more likely to receive feedback about some outcomes than about others, and thus we must operate under conditions of asymmetric partial feedback. In this paper, we examine the effects of asymmetric partial feedback on decision making across three experiments. Experiment 1 examines the effects of four partial feedback schedules on decision making in a single‐attribute auditory detection task. Experiment 2 examines these same schedules in the context of a simulated experiment in which virtual participants perform a multi‐attribute choice task. Experiment 3 then examines effects of one partial feedback schedule representative of a real‐world decision‐making domain (personnel selection) using an ecologically informed multi‐attribute choice task. All three experiments reveal that asymmetric partial feedback primarily impacts on response‐bias, a parameter of signal detection theory. These findings can be explained in terms of decision makers' attempts to maximize accuracy and the fact that shifts in response‐bias will, under partial feedback, produce misleading impressions of greater accuracy. Copyright © 2013 John Wiley & Sons, Ltd.     

Introduction to the Special Issue on Selected New Developments in Military Enlistment Testing

This article provides a brief discussion of the historical context for the major recent advances in enlisted selection and classification that are the subject of this special issue. By providing a perspective on the difficulty personality assessment has had gaining traction as a screening measure, it supplies a basis for understanding the significance of recent advances in personality measurement. This article also summarizes the military research on interest measurement that will receive more extended treatment later in this issue. It relates the work in this issue on new information technology testing to the role of information testing in the current military operational selection and classification test battery, the Armed Services Vocational Aptitude Battery (ASVAB), and discusses the background for 2 additional cognitive measures, Coding Speed and Assembling Objects. Finally, it previews issues to be discussed in the commentary article at the end of this issue.     

Taking the Measure of Work Interests: Past,Present, and Future

The influence of work interests on employee behavior is often misunderstood. Accordingly, the potential of work interest measures to improve “high stakes” employee decision-making has been grossly underestimated. One organization that has taken work interests seriously however, is the U.S. military. The purpose of this article is threefold: (a) to summarize the rich history of military-sponsored research on work interests for employee selection and classification, (b) to highlight recent advances in work interest measurement from military-sponsored research, and (c) to outline the way forward for advancing work interest theory and measurement.     

对于提高X线平片诊断准确率的思考

在临床实践中由于X线诊断方法具有操作简单方便、影像直观、空间及整体定位高及价格低廉等的优势,是其他影像检查不可替代的.但是X线平片显影主要是骨组织,X线平片检查伪影发生概率相对较高,为诊断的准确性带来了困难,X线影像诊断的误诊在临床工作中也是不可避免的,作为医务工作者总是要努力做到把误诊和漏诊减少到最低限度.本文就X线平片诊断医生在临床工作中要树立的诊断观念、拥有的读片方式、遵循的思维方法以及最后的报告书写,结合工作实践来探讨了对疾病的诊断,避免诊断结果对临床医生的错误导向.     

特质模糊性对大学生人格判断准确性的影响

该研究从大学生样本中抽取19名目标被试、57名熟人被试和76名陌生人被试,采用词汇评定方法考察了特质模糊性对人格判断准确性的影响,结果表明：（1）自我、熟人及陌生人对清晰特质判断的一致性比模糊特质的一致性更高,这种差异在自我—陌生人及熟人—陌生人一致性中尤为显著;（2）无论是模糊特质还是清晰特质,自我—熟人判断一致性显著高于自我—陌生人和熟人—陌生人一致性,后两者差异不明显;（3）随着特质模糊性的增加,被试判断间一致性差异总体上呈不断增大的趋势,清晰特质判断一致性的差异较小,模糊特质判断一致性的差异较大。     

An Illustration of Diagnostic Classification Modeling in Student Learning Outcomes Assessment

The assessment of higher-education student learning outcomes is an important component in understanding the strengths and weaknesses of academic and general education programs. This study illustrates the application of diagnostic classification models, a burgeoning set of statistical models, in assessing student learning outcomes. To facilitate understanding and future applications of diagnostic modeling, the log-linear cognitive diagnosis model used in this study is presented in a didactic manner. The model is applied in a context where undergraduate students were assessed along four learning outcomes related to psychosocial research across two time points. Results focus on implications and methods to aid stakeholders’ interpretation of the analyses. Contrasts to traditional measurement models and potential future applications are also discussed.     

Appraisal of Memory Functioning and Memory Performance in Healthy Ageing and Early-Stage Alzheimer's Disease

ABSTRACT

Background/Aims: To compare memory evaluations in healthy older people and people with Alzheimer's disease (AD) and present standardised individual and dyadic methods for classifying degree of memory awareness in the participants with dementia. Methods: Cross-sectional study evaluating awareness of memory functioning and performance and providing normative data for healthy individuals and couples, together with comparison data from people with AD. Results: As a group, older people are reasonably accurate raters of their own memory functioning and performance, although considerable individual differences can be observed, and control dyads show good comparative accuracy. Comparing normative data from the control group to data from participants with AD confirms that significant overestimation is a frequent feature among people with dementia, with approximately two-thirds showing this pattern, although significant under-estimation is also reliably observed in a small proportion of people with dementia. Different types of measure elicit different profiles of memory awareness in participants with dementia. Conclusion: Normative data from older individuals and couples provides useful percentile-based indices for determining level of memory awareness in people with dementia.     

The varying effects of age of acquisition

There are a number of theories that suggest that age of acquisition (AoA) effects are not uniform across different tasks. Catling and Johnston (2006a) found greater AoA effects within an object-naming task than in a semantic classification task. They explained these findings by suggesting that AoA effects might accumulate according to how many levels of representation a task necessitates access to. Brysbaert and Ghyselinck (2006) explain the difference in AoA effects by proposing two distinct types of AoA (frequency dependent and frequency independent), the first accounted for by a connectionist-type mechanism and the latter situated at the interface between semantics and word production. Moreover, Moore, Smith-Spark, and Valentine (2004) and Holmes and Ellis (2006) have suggested that there are two loci of AoA effects: at the phonological level and somewhere within the perceptual level of representation. Again, this could account for the varying degrees of AoA effects. This study sets about testing these ideas by assessing the effect size of AoA across a series of different tasks that necessitate access to various levels of representation. Experiments 1–4 demonstrate significant effects of AoA in a novel picture–picture verification task, an object classification task, a picture verification task, and an object-naming task. Experiment 5 showed no effects of initial phoneme on the naming of the critical objects used within Experiments 1–4. The implication of the varying AoA effect sizes found within Experiments 1–4 in relation to explanations of AoA are discussed.     

Improving college students’ evaluation of text learning using idea-unit standards

When recalling key definitions from class materials, college students are often overconfident in the quality of their responses. Even with commission errors, they often judge that their response is entirely or partially correct. To further understand this overconfidence, we investigated whether idea-unit judgements would reduce overconfidence (Experiments 1 and 2) and whether students inflated their scores because they believed that they knew answers but just responded incorrectly (Experiment 2). College students studied key-term definitions and later attempted to recall each definition when given the key term (e.g., What is the availability heuristic?). All students judged the quality of their recall, but some were given a full-definition standard to use, whereas other students first judged whether their response included each of the individual ideas within the corresponding correct answer. In Experiment 1, making these idea-unit judgements reduced overconfidence for commission errors. In Experiment 2, some students were given the correct definitions and graded other students’ responses, and some students generated idea units themselves before judging their responses. Students were overconfident even when they graded other students’ responses, and, as important, self-generated idea units for each definition also reduced overconfidence in commission errors. Thus, overconfidence appears to result from difficulties in evaluating the quality of recall responses, and such overconfidence can be reduced by using idea-unit judgements.