A post hoc correction procedure for systematic errors in time-sampling duration estimates

Numerous previous studies have shown that partial-interval sampling in direct observation systematically overestimates duration and underestimates frequency. Whole-interval sampling systematically underestimates both duration and frequency. This paper presents a post hoc method through which the systematic errors in duration estimates in partial-interval sampling and whole-interval sampling can be minimized.     

Some empirical justification for a modest proposal regarding data acquisition via intermittent direct observation

Computer simulations of behavior and event records of a child's visual fixation on an adult person were generated and sampled using a modified time sampling procedure. The modified approach required making two independent scoring judgments per observation interval: if the behavior was initiated within the interval, the interval was scored; if the behavior was ongoing precisely at the end of the interval, the interval was again scored. The results showed that the within-interval and end-of-interval scores yielded, respectively, estimates of behavioral frequency and duration. The accuracy of the estimates was a function of the number of observations. Several field studies demonstrated high agreement among observers who employed the measurement system.     

Methods of time sampling: A reappraisal of momentary time sampling and partial interval recording

We compared the accuracy of momentary time sampling (MTS) and partial interval recording (PIR) in estimating both absolute behavioral levels and relative change. A computer randomly generated runs of pseudobehavior varying in duration and rate and simulated MTS and PIR of each run. Results indicated that when estimating absolute behavioral levels, duration rather than rate should be used as the dependent measure, and MTS is more accurate than PIR. In contrast, PIR is the more sensitive method for detecting relative changes in behavioral levels, although, at high rates, PIR tends to underestimate the degree of change.     

Evaluation of the accuracy,reliability, efficiency,and acceptability of fast forwarding to score problem behavior

Technological advances have allowed professionals to obtain extended recordings of caregiver–client interactions in natural settings, but scoring recorded video at normal speed to identify instances of low‐rate problem behavior is impractical in terms of scoring time. Fast forwarding is a continuous measurement system in which all seconds of an observation are viewed at a speed faster than normal. In Study 1, we evaluated whether three groups of five observers could discriminate problem behavior at three fast‐forwarding speeds across 10‐min observations. We analyzed the efficiency of using fast forwarding compared to continuous scoring, and interobserver agreement across the fast‐forwarding speeds. In Study 2, we compared the accuracy, efficiency, and social acceptability of fast forwarding (3.5x) and momentary time sampling (3.5 s) across 90‐min observations. Results support the use of 3.5x fast forwarding as a viable measurement system of improving the practicality of scoring problem behavior from video.     

Behavior systems and reinforcement: an integrative approach.

Most traditional conceptions of reinforcement are based on a simple causal model in which responding is strengthened by the presentation of a reinforcer. I argue that reinforcement is better viewed as the outcome of constraint of a functioning causal system comprised of multiple interrelated causal sequences, complex linkages between causes and effects, and a set of initial conditions. Using a simplified system conception of the reinforcement situation, I review the similarities and drawbacks of traditional reinforcement models and analyze the recent contributions of cognitive, regulatory, and ecological approaches. Finally, I show how the concept of behavior systems can begin to incorporate both traditional and recent conceptions of reinforcement in an integrative approach.     

A comparison of momentary time sampling and partial-interval recording for evaluating functional relations

In the current study, momentary time sampling (MTS) and partial-interval recording (PIR) were compared to continuous-duration recording of stereotypy and to the frequency of self-injury during a treatment analysis to determine whether the recording method affected data interpretation. Five previously conducted treatment analysis data sets were analyzed by creating separate graphic displays for each measurement method (duration or frequency, MTS, and PIR). An expert panel interview and structured criterion visual inspection were used to evaluate treatment effects across measurement methods. Results showed that treatment analysis interpretations based on both discontinuous recording methods often matched those based on frequency or duration recording; however, interpretations based on MTS were slightly more likely to match those based on duration and those based on PIR were slightly more likely to match those based on frequency.     

Development and evaluation of the evidence‐based practice classroom observation measure (EBP‐COM)

Due to the increased emphasis on evidence‐based practices (EBPs) in recent education initiatives, classroom observers need an objective way to measure teacher use of EBPs. Although some measures for this purpose exist, these measures are limited by their reliance on self‐report. Therefore, we created a direct observation tool titled the Evidence‐Based Practice Classroom Observation Measure (EBP‐COM) for observers to assess the use of EBPs by teachers of students with autism spectrum disorder (ASD). We evaluated reliability and validity of the EBP‐COM, as well as whether the assessment tool could detect change in teacher behavior. A measurement refinement process involving six raters collecting 65 data points revealed the EPB‐COM to have sound psychometric properties. With this tool, researchers can conduct comprehensive and objective assessments of teacher EBP use.     

Using an integrated simulation environment for the risk based design of advanced driver assistance systems

When designing new Advanced Driver Assistance Systems (ADAS), the existing guidelines like the RESPONSE 3 Code of Practice imply intense testing of the system prior series production. Within the EU-FP7-Project ISi-PADAS a new methodology of risk based design has been established which includes an integrated simulation platform. This integration enables intense testing of new prototypes in an accelerated way and therefore enhances the design process while directly combining the simulation results with a risk matrix.This paper describes the new methodology while focussing on the software framework and the procedure of risk assessment in detail. It shows the general approach as well as the appropriate steps taken for an ADAS prototype developed in the context of ISi-PADAS.     

A method for describing preschoolers' activity preferences

We designed a series of analyses to develop a measurement system capable of simultaneously recording the free-play patterns of 20 children in a preschool classroom. Study 1 determined the intermittency with which the location and engagement of each child could be momentarily observed before the accuracy of the measurement was compromised. Results showed that intervals up to 120 s introduced less than 10% measurement error. Study 2 determined the extent of agreement between two observers who simultaneously collected data for 20 children using 30-, 60-, 90-, and 120-s momentary time sampling (MTS) intervals. The three larger intervals resulted in high levels of interobserver agreement (above 90%), whereas the 30-s interval resulted in unacceptably low levels of agreement (less than 80%). By allowing observers to select from among the different MTS intervals via a datasheet array and then collect data with the chosen system, Study 3 determined observers' preferences for the remaining MTS intervals. Both data collectors preferred the 90-s MTS procedure. The sensitivity of the 90-s MTS procedure, which was shown to be accurate, reliable, and preferred, was then demonstrated by its use to describe activity preferences of a classroom of children in Study 4. This system identified high- and low-preference activities for individual children and revealed interesting patterns of response allocation by the group.     

A probability-based formula for calculating interobserver agreement

Estimates of observer agreement are necessary to assess the acceptability of interval data. A common method for assessing observer agreement, per cent agreement, includes several major weaknesses and varies as a function of the frequency of behavior recorded and the inclusion or exclusion of agreements on nonoccurrences. Also, agreements that might be expected to occur by chance are not taken into account. An alternative method for assessing observer agreement that determines the exact probability that the obtained number of agreements or better would have occurred by chance is presented and explained. Agreements on both occurrences and nonoccurrences of behavior are considered in the calculation of this probability.     

Modification of school attendance for an elementary population

The staff and students of a school composed of Grades 1 through 3 participated in a program to increase school attendance. Children earned the opportunity to attend part or all of a monthly party by their attendance. Immediate feedback occurred each morning by placing stars on a classroom chart for each child present. The school's attendance during the program was compared both with attendance during preceding years and with attendance at other schools. The experimental school's attendance improved dramatically to become the best of all elementary schools in the system.     

Psychological and educational characteristics of instruction for people with severe disabilities: Interacting systems of responding

This paper presents a behavioral model which proposes that operants are organized and regulated into systems of responding. Multi-operant theory proposes that operants are organized into response systems that interact to adapt behavior to the complexities of the environment. The operant is the interaction between behavior and the environment which includes the conditions under which responses may occur, the class of behavior that is likely to be effective in producing outcomes, and the antecedent conditions that define the context of behavior. A central feature of this theory is that operants within a repertoire are organized into regulated systems of responding. The mechanisms of regulation are themselves operants that are learned and controlled by processes that are the same as those that govern more overt behavior. Operants stand in relationship to each other in coordinated response systems with some operants directly affecting and organizing the performance of other operants. An important implication of the systemic nature of behavioral repertoires is that bringing some aspect of a behavior class under control of new variables may demonstrate a spread throughout the entire operant system depending on past histories linking the classes.deceased     

Representing decision-makers using styles of behavior: An approach designed for group decision support systems

Supporting decision-making processes when the elements of a group are geographically dispersed and on a tight schedule is a complex task. Aiming to support decision-makers anytime and anywhere, Web-based group decision support systems have been studied. However, the limitations in the decision-makers’ interactions associated to this scenario bring new challenges. In this work, we propose a set of behavioral styles from which decision-makers’ intentions can be modelled into agents. The goal is that, besides having agents represent typical preferences of the decision-makers (towards alternatives and criteria), they can also represent their intentions. To do so, we conducted a survey with 64 participants in order to find homogeneous operating values so as to numerically define the proposed behavioral styles in four dimensions. In addition, we also propose a communication model that simulates the dialogues made by decision-makers in face-to-face meetings. We developed a prototype to simulate decision scenarios and found that agents are capable of acting according to the decision-makers’ intentions and fundamentally benefit from different possible behavioral styles, just as a face-to-face meeting benefits from the heterogeneity of its participants.     

THE BEHAVIOR OBSERVATION INSTRUMENT: A METHOD OF DIRECT OBSERVATION FOR PROGRAM EVALUATION1

The background and development of a multicategory direct observation system, the Behavior Observation Instrument (BOI), is described. This time-sampling procedure for recording the behavior of persons is demonstrated in several treatment settings and the results applied to issues of program evaluation. Elements that have prevented direct observation from being widely adopted, such as costs, manpower, and training requirements, are systematically analyzed. A basic psychometric analysis of the instrument is used to determine optimum frequency and duration of observation intervals as well as observer agreement. The results imply that direct observation methods, once assumed by some to belong to the special province of the single-subject design, can be used to assess the effects of programs on groups of psychiatric clients in an efficient and economic manner.