THE BEHAVIOR OBSERVATION INSTRUMENT: A METHOD OF DIRECT OBSERVATION FOR PROGRAM EVALUATION1

The background and development of a multicategory direct observation system, the Behavior Observation Instrument (BOI), is described. This time-sampling procedure for recording the behavior of persons is demonstrated in several treatment settings and the results applied to issues of program evaluation. Elements that have prevented direct observation from being widely adopted, such as costs, manpower, and training requirements, are systematically analyzed. A basic psychometric analysis of the instrument is used to determine optimum frequency and duration of observation intervals as well as observer agreement. The results imply that direct observation methods, once assumed by some to belong to the special province of the single-subject design, can be used to assess the effects of programs on groups of psychiatric clients in an efficient and economic manner.     

The use of teachers as behavioral observers

The effect of using teachers as behavioral observers on both student and teacher behavior was examined with eight teachers and 32 elementary school children. The frequency of prompts (but not praise or criticism) to those students observed by the teacher increased significantly from nonobserver to teacher observed experimental phases. In addition, students observed by the teacher showed more change in appropriate behavior than students who were not observed. The significance of these findings for research and therapy is discussed.     

Considerations in the choice of interobserver reliability estimates

Two types of interobserver reliability values may be needed in treatment studies in which observers constitute the primary data-acquisition system: trial reliability and the reliability of the composite unit or score which is subsequently analyzed, e.g., daily or weekly session totals. Two approaches to determining interobserver reliability are described: percentage agreement and "correlational" measures of reliability. The interpretation of these estimates, factors affecting their magnitude, and the advantages and limitations of each approach are presented.     

A comparison of frequency, interval, and time-sampling methods of data collection

Data representing high, medium, and low response rates in constant and nonconstant patterns were generated by electromechanical equipment to determine whether the same data collected by time-sampling, interval recording, and frequency recording would be represented similarly by each method. Results indicated: (1) that time-sampling provided an extremely inaccurate estimate of responding, and (2) that interval recording accurately represented responding of low and medium rates, but grossly underestimated high-rate responding.     

Joseph Margolis on Pragmatism

This paper begins with a memoir of the author’s interactions with Joseph Margolis that delineates both Margolis’s importance as a teacher and their disagreements on aspects of American philosophy. It then turns to Margolis’s discussions of pragmatism as a philosophical movement, with an emphasis on his understanding of John Dewey. The paper considers, third, Margolis’s account of the decline and rebirth of pragmatism, the latter process attributed largely to the work of Richard Rorty. The paper concludes with an examination of what it sees as Margolis’s most valuable work: his explorations of the nature of the self and of human society.     

自我-朋友冲突情境下智慧推理的文化差异及其机制

相对于面对自己的人际冲突, 以独立自我为主的西方人在面对朋友的人际冲突时表现更智慧(所罗门悖论)。在以互依自我为主的中国人身上所罗门悖论是否会有不同特点?研究1通过在线平台招募中美两国被试, 随机分配到自我与朋友冲突组考察其智慧推理水平, 并考察自我类型的影响。对齐法与方差分析的结果均显示美国文化下朋友组智慧推理显著高于自我组, 而中国文化下两组差异不显著, 进一步分析发现中国文化下独立自我与冲突类型的交互项显著预测智慧推理。在此基础上, 研究2~4在中国文化背景下, 通过启动不同自我类型, 考察个体在自我或朋友冲突组中的智慧推理差异, 结果显示启动独立自我的朋友组显著高于自我组, 而启动互依自我的两组差异不显著。研究表明所罗门悖论可能只存在独立自我高的人身上, 并不具有普适性。可见心理学研究除了关注样本多样性问题外, 更需关注使用单一样本却默认结论具有文化普适性的研究者。     

Quitters would not prosper: Examining the relationship between online assessment performance and assessment attrition behavior

Hiring managers are often hesitant to implement online assessments over concerns that higher‐quality candidates are more likely to quit lengthy assessment batteries than lower‐quality candidates. In this paper, we present the results of two studies that collectively challenge this assumption. In Study 1, data from 327,517 job‐seekers spanning eight hiring contexts showed that assessment performance was negatively associated with subsequent assessment attrition behavior. In Study 2, we replicated this pattern of effects in two additional samples comprising 1,844,604 applicants for hourly associate positions, and 18,937 applicants for nursing positions. Collectively, these findings suggest that some degree of attrition may ultimately benefit, rather than harm, organizations using prehire assessments.     

Computer‐based training to teach observers to accurately score problem behavior using fast forwarding at 5x normal speed

The current study evaluated whether a computer‐based training program could improve observers' accuracy in scoring discrete instances of problem behavior at 5x normal speed using a multiple‐baseline design across subjects. During pretraining and posttraining, observers attempted to score multiple examples of problem behavior at 5.0x without feedback. During training, participants scored multiple examples of problem behavior at 5.0x with automated feedback. Researchers measured omission (missing problem behavior) and commission (scoring other behavior as problem behavior) errors and the total duration of scoring time to determine the observers' accuracy and efficiency, respectively. After training, all participants scored instances of problem behavior with less than 11% error using 5.0x. The time required to score the videos across 90‐min observations was reduced by 66%. Results extend previous evaluations of fast forwarding by demonstrating that the training program could be used to teach observers to accurately score problem behavior using a speed faster than 3.5x.     

忘我问卷的编制及其信效度检验

通过文献分析和访谈,阐明忘我的概念与结构,并编制了忘我问卷。采用现场发放和网络问卷的方式对607名被试进行忘我问卷的初测。接着,对357名被试施测正式问卷,进行信度、效度检验。探索性因素分析显示,忘我问卷由3个因子构成; 验证性因素分析表明该量表拟合良好(RMSEA=0.07,NFI=0.95,CFI=0.95,GFI=0.92,AGFI=0.89)。问卷总体一致性系数为0.89,3个因子的内部一致性系数在0.84-0.88之间。问卷总体得分与效标问卷特质焦虑得分呈负相关(-0.51),与安适幸福感、正念觉知的得分呈正相关(分别为0.36、0.31)。忘我问卷具有良好的信度和效度,可在后续的相关研究和实践中作为测量问卷或评估工具使用。