Ecological validity of neuropsychological assessment: Do neuropsychological indexes predict performance in everyday activities?

This paper discusses the nature of neuropsychological assessment within the context of ecological validity. It considers the extent to which traditional neuropychological tests can predict performance in everyday life before going on to describe several new procedures designed to map directly on to real life functioning.     

Observation procedure, observer gender, and behavior valence as determinants of sampling error in a behavior assessment analogue

Several factors thought to influence the representativeness of behavioral assessment data were examined in an analogue study using a multifactorial design. Systematic and unsystematic methods of observing group behavior were investigated using 18 male and 18 female observers. Additionally, valence properties of the observed behaviors were inspected. Observers' assessments of a videotape were compared to a criterion code that defined the population of behaviors. Results indicated that systematic observation procedures were more accurate than unsystematic procedures, though this factor interacted with gender of observer and valence of behavior. Additionally, males tended to sample more representatively than females. A third finding indicated that the negatively valenced behavior was overestimated, whereas the neutral and positively valenced behaviors were accurately assessed.     

评价中心的结构效度研究

评价中心虽然具备很高的预测效度,但其结构效度指标却不太理想,如研究普遍发现其汇聚效度和区分效度较低。影响评价中心结构效度的因素众多,如评分维度因素（数量和类型）、评价者因素（培训方式和人员类型）、测评方法因素（情景导向特征、特质激活潜力、测评活动形式）以及系统的观察与评价程序。该文从上述因素出发,综述了评价中心结构效度的相关研究,总结了提高评价中心结构效度的措施,并指出了未来的研究方向     

Traits,states, situations,and uncertainty

The shift of paradigm from psychodynamic therapy to behavior modification has changed the views of assessment and challenged traditional broad trait concepts. Behavioral assessment has used narrow, situation-specific trait tests, state self-report tests given in situations, and behavioral observations and performance ratings. Comparison of these types of measures are reported from a study of fear reactions in three situations. Narrow trait measures are generally more predictive of behavior than broad trait measures. State measures are even more predictive when given just before the performance. But only a sampling of such state measures can be used to define a trait because of the lower reliability of states. It is argued that behavior in situations is only predictable when an adequate number of behavioral samples is used.     

An Analysis of Feedback from a Behavior Analytic Perspective

The present paper presents a systematic analysis from a behavior analytic perspective of procedures termed feedback. Although feedback procedures are widely reported in the discipline of psychology, including in the field of behavior analysis, feedback is neither consistently defined nor analyzed. Feedback is frequently treated as a principle of behavior; however, its effects are rarely analyzed in terms of well-established principles of learning and behavior analysis. On the assumption that effectiveness of feedback procedures would be enhanced when their use is informed by these principles, we sought to provide a conceptually systematic account of feedback effects in terms of operant conditioning principles. In the first comprehensive review of this type, we compare feedback procedures with those of well-defined operant procedures. We also compare the functional relations that have been observed between parameters of consequence delivery and behavior under both feedback and operant procedures. The similarities observed in the preceding analyses suggest that processes revealed in operant conditioning procedures are sufficient to explain the phenomena observed in studies on feedback.     

不同类型的测评维度对评价中心结构效度的影响研究

本研究将测评维度分为行为能力和心理特质两组,考察对评价中心结构效度的不同影响。A公司216名部门副经理级员工接受了本次管理素质评价中心测评,采用公文筐、角色扮演和无领导小组讨论三种方法,测查行为能力和心理特质两组维度,各自有三个维度被一种以上的方法测量。多质多法和验证性因素分析的结果表明,评价中心以行为能力比以心理特质为测评维度结构效度好;以行为能力为测评维度时,会聚效度和区分效度都较好。     

IS SOCIAL VALIDITY WHAT WE ARE INTERESTED IN? ARGUMENT FOR A FUNCTIONAL APPROACH

It is argued that neither the term social nor the term validity is best to identify the processes used or the results obtained in questioning consumers about the goals set, procedures employed, or outcomes achieved in habilitative programming. The term consumer satisfaction acknowledges the fact that it is essentially a collection of consumer opinions. The underlying intent of the process might be called habilitative validation, a name that seems to better guide our validation efforts. More important, in carefully considering consumer satisfaction assessment, it becomes clear that not only does consumer satisfaction itself need to be validated, but also that more objective methods can be used for assessing habilitative validity. However, legitimate uses still remain for consumer satisfaction measurement, as long as we do not mistake it for strong evidence of the habilitative validity of our goals, procedures, or outcomes.     

The importance of multiple exemplar instruction in the establishment of novel verbal behavior

According to traditional linguistic accounts language, and its generative nature, cannot be taught. From a behavior analytic perspective, language is like any other behavior; it is learned and amenable to change. Based upon Skinner's radical behavioral analysis of verbal behavior, specific procedures have been designed to promote novel verbal relations. However, despite the strength and utility of this approach, using behavioral principles to understand the generativity of language has been challenging. Dependent upon the specific theory (e.g., stimulus equivalence, relational frame theory, bidirectional naming) within the radical behavioral orientation, researchers arrange unique procedures to evaluate the variables responsible for this phenomenon. This paper presents the commonalities and differences of two procedures (i.e., multiple exemplar training, multiple exemplar instruction) with examples of research highlighting the use of both in producing generativity. Further, it describes how multiple exemplar instruction is independent from other procedures leading to this outcome, and concludes by providing recommendations for both research and practice.     

Multiple schedules with response interruption and redirection to reduce stereotypy in children with autism spectrum disorder: Generalization and social validity

Although response interruption and redirection (RIRD) and multiple schedule arrangements have sometimes been shown to be effective in reducing stereotypy for individuals with autism spectrum disorder (ASD), important questions remain about optimal methods for facilitating generalization and social validity. In the current study, we sought to extend the literature on stereotypy treatment and MSAs in several ways. First, we programmed for generalization by conducting sessions with two exemplars of two different categories of activities (i.e., school work, toy play) and assessing generalization with novel exemplars and activities and during the participant's typical instructional program. Second, we used RIRD instructions that were contextual models of appropriate behavior relevant to each activity. Third, during the free access component of the multiple schedule, we used a child's play tent as a first step toward teaching participants to engage in stereotypy during private free time. For all three participants with ASD, stereotypy decreased quickly and substantially, with reductions generalizing to novel activities and contexts. An extensive social validity assessment with board-certified behavior analysts indicated high social acceptability of the goals, procedures, and outcomes.     

效度概化：预测效度元分析的30年成果述评

效度概化是通过元分析技术对普遍化的预测效度的估计。元分析是研究效度概化问题的技术,是对具有“预测因子-效标”特征的相关数据进行定量综合的方法。效度概化促进了预测因子与效标之间关系的理论研究和应用研究,是应用心理学领域近30年（1977~2007）来最重要的进展之一。30年来的效度概化研究表明,认知能力测验、知识和技能测验、人格测验、结构化面试和评价中心技术等的预测效度具有鲁棒性、对应性和联合增值性     

Evaluation of the rate of problem behavior maintained by different reinforcers across preference assessments

The rates of problem behavior maintained by different reinforcers were evaluated across 3 preference assessment formats (i.e., paired stimulus, multiple-stimulus without replacement, and free operant). The experimenter administered each assessment format 5 times in a random order for 7 children with developmental disabilities whose problem behavior was maintained by attention, tangible items, or escape. Results demonstrated different effects related to the occurrence of problem behavior, suggesting an interaction between function of problem behavior and assessment format. Implications for practitioners are discussed with respect to assessing preferences of individuals with developmental disabilities who exhibit problem behavior.     

A concise review of the correspondence between the traditional functional analysis and alternative assessment formats

The functional assessment of challenging behavior (e.g., self-injurious behavior) has evolved over many years of research and practice. This concise review summarizes the positive predictive value, negative predictive value, accuracy, sensitivity, and specificity of common procedural adaptations reported to improve functional assessment safety and efficiency. We conclude with suggestions for clinicians and researchers.     

Examination of efficacious,efficient, and socially valid error‐correction procedures to teach sight words and prepositions to children with autism spectrum disorder

Prior research shows that learners have idiosyncratic responses to error‐correction procedures during instruction. Thus, assessments that identify error‐correction strategies to include in instruction can aid practitioners in selecting individualized, efficacious, and efficient interventions. The current investigation conducted an assessment to compare 5 error‐correction procedures that have been evaluated in the extant literature and are common in instructional practice for children with autism spectrum disorder (ASD). Results showed that the assessment identified efficacious and efficient error‐correction procedures for all participants, and 1 procedure was efficient for 4 of the 5 participants. To examine the social validity of error‐correction procedures, participants selected among efficacious and efficient interventions in a concurrent‐chains assessment. We discuss the results in relation to prior research on error‐correction procedures and current instructional practices for learners with ASD.     

Increasing on-task behavior in every student in a second-grade classroom during transitions: Validating the color wheel system

A single-case (B-C-B-C) experimental design was used to evaluate the effects of the Color Wheel classroom management system (CWS) on on-task (OT) behavior in an intact, general-education, 2nd-grade classroom during transitions. The CWS included three sets of rules, posted cues to indicate the rules students are expected to be following at that time, and transition procedures for altering activities and rules. Class-wide data analysis showed large, immediate, and sustained increases in OT behavior when the CWS was applied, with OT behavior returning to baseline levels when typical classroom management (TCM) procedures were reinstated. Each student's average phase data also showed increases in OT behavior when the CWS was applied and re-applied, and showed reductions when the CWS was withdrawn. Discussion focuses on evaluating the internal, external, and contextual validity of class-wide remediation and prevention procedures.     

Unobtrusive measures in behavioral assessment

A major distinguishing characteristic of behavioral assessment is the direct assessment of overt behavior. Direct assessment is assumed to provide a sample of behavior that reflects client performance in the situation in which behavior is assessed, even if the assessment procedures were not implemented. Yet, in the majority of investigations, behavioral assessment procedures are obtrusive, i.e., subjects are aware that their behavior is being assessed. The potential problem with obtrusive assessment is that it may be reactive, i.e., affect how subjects perform. Recent research has demonstrated that obtrusive observations often are reactive and that behaviors assessed under obtrusive and unobtrusive conditions bear little relation. From methodological and applied perspectives, additional attention needs to be given to unobtrusive measures of behavior change. The present paper illustrates unobtrusive measures in behavior modification including direct observations, archival records, and physical traces of performance. In addition, validation and assessment problems, questions about the obtrusiveness of the measures, and ethical issues are discussed.     

Integrating Milton H. Erickson's Hypnotherapeutic Techniques Into General Counseling and Psychotherapy

Milton H. Erickson's approach to clinical hypnosis has recently attracted the attention of many professional counselors. Although traditional hypnotherapy presumes the induction and utilization of trance, some of Erickson's hypnotherapeutic principles can be easily translated into the general framework of counseling. This article examines several basic techniques of Erickson that are applicable to four aspects of counseling: (a) rapport building, (b) problem assessment, (c) resistance management, and (d) behavior change. Clinical examples and discussion are provided for illustration.     

中学生问题行为多视角评估的构想效度

本文以多质多法和验证性因素分析的方法对由中学生问题行为三视角评估(自我评定、教师评定和家长评定)构成的数据模型进行了构想效度的研究。研究样本为分层随机抽取的北京市292名中学生,对其三视角问题行为的施测结果进行了会聚效度和区分效度的分析,结果表明:(1)中学生问题行为三视角六因子的MTMM模型构想效度良好;(2)评定者对问题行为的评估有影响,存在评定者效应,而且评定者效应对内倾问题因子比对外倾问题因子影响大。     

Personnel selection in the digital age: a review of validity and applicant reactions,and future research challenges

ABSTRACT

We present a targeted review of recent developments and advances in digital selection procedures (DSPs) with particular attention to advances in internet-based techniques. By reviewing the emergence of DSPs in selection research and practice, we highlight five main categories of methods (online applications, online psychometric testing, digital interviews, gamified assessment and social media). We discuss the evidence base for each of these DSP groups, focusing on construct and criterion validity, and applicant reactions to their use in organizations. Based on the findings of our review, we present a critique of the evidence base for DSPs in industrial, work and organizational psychology and set out an agenda for advancing research. We identify pressing gaps in our understanding of DSPs, and ten key questions to be answered. Given that DSPs are likely to depart further from traditional non-digital selection procedures in the future, a theme in this agenda is the need to establish a distinct and specific literature on DSPs, and to do so at a pace that reflects the speed of the underlying technological advancement. In concluding, we, therefore, issue a call to action for selection researchers in work and organizational psychology to commence a new and rigorous multidisciplinary programme of scientific study of DSPs.     

Evaluation of a finger prompt variation in the treatment of pediatric feeding disorders

Children with feeding disorders often engage in refusal behavior to escape or avoid eating. Escape extinction combined with reinforcement is a well-established intervention to treat food refusal. Physical guidance procedures (e.g., jaw prompt, finger prompt) have been shown to increase food acceptance and decrease inappropriate mealtime behavior when more commonly employed escape extinction (e.g., nonremoval of the spoon) procedures are ineffective. The finger prompt, however, has not been extensively evaluated as a treatment adjunct to target food refusal, thus necessitating further examination. The purpose of this prospective study was to assess a variation of a finger prompt procedure to treat food refusal and to assess caregivers' acceptability of the procedure. Three children age 1 to 4 years admitted to an intensive feeding disorders program and their caregivers participated. The finger prompt was effective in increasing bite acceptance across all participants and decreasing or maintaining low levels of inappropriate behavior for 2 participants. The procedure was also acceptable to all caregivers.