Taking a closer look: time sampling and measurement error

A person manufactured his in-seat behavior for 15, 30-min sessions so that there were three blocks of five sessions where the behavior occurred 20%, 50%, and 80% of the time. Whole interval, partial interval, and momentary time-sample measures of the behavior were taken and compared to the continuous measure of the behavior i.e., per cent of time the behavior occurred. For interval time sampling, the difference between the continuous and sample measures i.e., measurement error, was: (1) extensive, (2) unidirectional, (3) a function of the time per response, and (4) inconsistent across changes in the continuous measure. A procedural analysis demonstrated that the frequency and duration of behavior are confounded in interval time sampling. Momentary time sampling was found to be superior to interval time sampling in estimating the duration a behavior occurs.     

Methods of time sampling: A reappraisal of momentary time sampling and partial interval recording

We compared the accuracy of momentary time sampling (MTS) and partial interval recording (PIR) in estimating both absolute behavioral levels and relative change. A computer randomly generated runs of pseudobehavior varying in duration and rate and simulated MTS and PIR of each run. Results indicated that when estimating absolute behavioral levels, duration rather than rate should be used as the dependent measure, and MTS is more accurate than PIR. In contrast, PIR is the more sensitive method for detecting relative changes in behavioral levels, although, at high rates, PIR tends to underestimate the degree of change.     

Conceptualizing and Estimating Process Speed in Studies Employing Ecological Momentary Assessment Designs: A Multilevel Variance Decomposition Approach

Researchers have been making use of ecological momentary assessment (EMA) and other study designs that sample feelings and behaviors in real time and in naturalistic settings to study temporal dynamics and contextual factors of a wide variety of psychological, physiological, and behavioral processes. As EMA designs become more widespread, questions are arising about the frequency of data sampling, with direct implications for participants' burden and researchers' ability to capture and study dynamic processes. Traditionally, spectral analytic techniques are used for time series data to identify process speed. However, the nature of EMA data, often collected with fewer than 100 measurements per person, sampled at randomly spaced intervals, and replete with planned and unplanned missingness, precludes application of traditional spectral analytic techniques. Building on principles of variance partitioning used in the generalizability theory of measurement and spectral analysis, we illustrate the utility of multilevel variance decompositions for isolating process speed in EMA-type data. Simulation and empirical data from a smoking-cessation study are used to demonstrate the method and to evaluate the process speed of smoking urges and quitting self-efficacy. Results of the multilevel variance decomposition approach can inform process-oriented theory and future EMA study designs.     

Conceptualizing and Estimating Process Speed in Studies Employing Ecological Momentary Assessment Designs: A Multilevel Variance Decomposition Approach

Researchers have been making use of ecological momentary assessment (EMA) and other study designs that sample feelings and behaviors in real time and in naturalistic settings to study temporal dynamics and contextual factors of a wide variety of psychological, physiological, and behavioral processes. As EMA designs become more widespread, questions are arising about the frequency of data sampling, with direct implications for participants' burden and researchers' ability to capture and study dynamic processes. Traditionally, spectral analytic techniques are used for time series data to identify process speed. However, the nature of EMA data, often collected with fewer than 100 measurements per person, sampled at randomly spaced intervals, and replete with planned and unplanned missingness, precludes application of traditional spectral analytic techniques. Building on principles of variance partitioning used in the generalizability theory of measurement and spectral analysis, we illustrate the utility of multilevel variance decompositions for isolating process speed in EMA-type data. Simulation and empirical data from a smoking-cessation study are used to demonstrate the method and to evaluate the process speed of smoking urges and quitting self-efficacy. Results of the multilevel variance decomposition approach can inform process-oriented theory and future EMA study designs.     

A method for describing preschoolers' activity preferences

We designed a series of analyses to develop a measurement system capable of simultaneously recording the free-play patterns of 20 children in a preschool classroom. Study 1 determined the intermittency with which the location and engagement of each child could be momentarily observed before the accuracy of the measurement was compromised. Results showed that intervals up to 120 s introduced less than 10% measurement error. Study 2 determined the extent of agreement between two observers who simultaneously collected data for 20 children using 30-, 60-, 90-, and 120-s momentary time sampling (MTS) intervals. The three larger intervals resulted in high levels of interobserver agreement (above 90%), whereas the 30-s interval resulted in unacceptably low levels of agreement (less than 80%). By allowing observers to select from among the different MTS intervals via a datasheet array and then collect data with the chosen system, Study 3 determined observers' preferences for the remaining MTS intervals. Both data collectors preferred the 90-s MTS procedure. The sensitivity of the 90-s MTS procedure, which was shown to be accurate, reliable, and preferred, was then demonstrated by its use to describe activity preferences of a classroom of children in Study 4. This system identified high- and low-preference activities for individual children and revealed interesting patterns of response allocation by the group.     

THE EFFECTIVENESS OF A CONSTANT TIME-DELAY PROCEDURE TO TEACH CHAINED RESPONSES TO ADOLESCENTS WITH MENTAL RETARDATION

The effectiveness of a 5-s constant time-delay procedure to teach three chained food preparation behaviors to four moderately retarded adolescent students was evaluated within a multiple probe design across behaviors. Results indicate that the procedure was effective in teaching all four students to make a sandwich, boil a boil-in-bag item, and bake canned biscuits. The skills maintained with at least 85% accuracy over a 3-month period. Training generalized from the school to the home setting for the 2 subjects that completed generalization probe sessions. The percentage of errors across all skills and students was less than 9%.     

Detecting changes in simulated events using partial‐interval recording and momentary time sampling

In a series of three studies, we evaluated simulated data with reversal designs to determine whether partial‐interval recording (PIR) and momentary time sampling (MTS) detected changes that were evident with continuous measures. The results from Study 1 showed that MTS with interval sizes up to 30 s detected most of the moderate and large changes in duration events and MTS with interval sizes up to 1 min detected most large changes in duration events. By comparison, PIR with 10‐s intervals detected approximately half of all changes in duration events. The results of Study 2 showed that only 10‐s PIR reliably detected most small, moderate, and large changes in frequency events. The results of Study 3 showed that PIR with 10‐s intervals generated a relatively high percentage of false positives for duration events, whereas MTS did not. As a whole, the results support previous findings, but also provide new guidelines for the use of PIR and MTS. Copyright © 2008 John Wiley & Sons, Ltd.     

Momentary mood and coping processes in TMD pain.

Temporomandibular dysfunction (TMD) pain, like many chronic pain problems, appears to be multiply determined. Patients with TMD pain of at least 6 months duration (N = 30) were administered questionnaires measuring dispositional coping styles and appraisals to explore the dynamic interactions of the pain and coping process. Patients were then issued handheld computers that prompted them to record their momentary pain and coping processes 4 times per day for 7 days. Hierarchical linear regression models using both the dispositional and momentary predictors indicated that momentary pain was a function both of dispositional tendency to catastrophize and of momentary measures of catastrophization, self-efficacy, and mood states. Results were seen as supporting a situational model of intervention for chronic TMD pain.     

Quantifying false positives in simulated events using partial interval recording and momentary time sampling with dual‐criteria methods

The dual‐criteria (DC) and conservative dual‐criteria (CDC) methods allow clinicians and researchers to quantify the occurrence of false‐positive outcomes within single‐case experimental designs. The purpose of the current study was to use these DC and CDC methods to measure the incidence of false positives with simulated data collected via discontinuous interval methods (i.e., momentary time sampling, partial‐interval recording) as a function of data series length. We generated event data to create 316,800 unique simulated data series for analysis. In Experiment 1, we evaluated how changes in relevant parameters (i.e., interval sizes, event durations, IRT‐to‐event‐run ratios) produced false positives with momentary time sampling procedures. We also assessed the degree that the CDC method produced fewer false positives than the DC method with simulated interval data. In Experiment 2, we used similar procedures to quantify the occurrence of false positives with partial‐interval recording data. We successfully replicated outcomes from previous research in the current study, though such results only highlight the generality of the procedures relating to false positive (and not false negative) outcomes. That is, these results indicate MTS and PIR may adequately control for false positives, but our conclusions are limited by a lack of data on power.     

An experience sampling study of the momentary dynamics of moral,autonomous, competent,and related need satisfactions,moral enactments,and psychological thriving

Motivation and Emotion - Do people really have a psychological need to be moral? We present results from an experience sampling study of momentary moral need satisfaction, moral behaviors, and...     

The use of momentary time sampling to assess both frequency and duration of behavior

When the time-sampling interval size can be set so it is smaller than both the shortest behavior instance and the shortest interresponse time, momentary time sampling will yield an accurate count of the frequency of behavior occurrence. It will also yield an unbiased estimate of behavior duration.     

Detecting Changes in Simulated Events Using Partial‐Interval Recording and Momentary Time Sampling III: Evaluating Sensitivity as a Function of Session Length

In a series of two studies, we graphed simulated data representing continuous duration recording and continuous frequency recording into ABAB reversal designs depicting small, moderate, and large behavior changes during 10‐min, 30‐min, and 60‐min sessions. Data sets were re‐scored using partial‐interval recording and momentary time sampling with interval sizes set at 10 s, 20 s, 30 s, 1 min, and 2 min. In study 1, we visually inspected converted data for experimental control and compared the conclusion with those from the respective continuous duration recording or continuous frequency recording data to test for false negatives. In study 2, we evaluated the extent to which interval methods that were sensitive to changes in study 1 produced false positives. In part, the results show that momentary time sampling with interval sizes up to 30 s detected a wide range of changes in duration events and frequency events during lengthier observation periods. The practical implications of the findings are briefly discussed. Copyright © 2011 John Wiley & Sons, Ltd.     

Effortful Control and Interpersonal Behavior in Daily Life

The Cognitive-Affective Processing System (CAPS) was used to examine effortful control (EC) as a moderator of daily interpersonal behavior. Participants (N = 240) were nonclinical young adults who completed a 7-day event-contingent experience sampling study of interpersonal perception and affect. Multilevel linear models indicated that EC moderated within-person covariation of interpersonal warmth and affect activation; high EC individuals reported greater momentary warm behaviors when perceiving others as affectively activated. EC also amplified between-person covariation of interpersonal warmth between self and others; high EC individuals generally responded to perceptions of another's warmth with a greater degree of warm behavior. Varying levels of EC predict responses to interpersonal perceptions and affect in daily life, suggesting an important dimension for interpersonal functioning.     

Non-aging fore-periods and simple reaction time

This study deals with the relationship between the momentary objective probability of the delivery of a stimulus and the reaction time in a simple reaction-time task. The hypothesis was that the reaction time is closely related to the objective probability via expectancy i.e., the momentary probability of the delivery of the stimulus as experienced by the subject. This problem was experimentally approached from two directions: (1) by varying the objective probability, in which case the reaction times should change inversely with the objective probability, and (2) by keeping the objective probability constant (by using the Bernoulli process), in which case the reaction times should not change. Eight male subjects were used. The first assumption proved to be correct, whereas the second held only when certain mean inter-stimulus intervals were used.     

DETECTING CHANGES IN NON‐SIMULATED EVENTS USING PARTIAL INTERVAL RECORDING AND MOMENTARY TIME SAMPLING: EVALUATING FALSE POSITIVES,FALSE NEGATIVES,AND TRENDING

Several studies have evaluated false positives and false negatives produced with partial interval recording (PIR) and momentary time sampling (MTS) using simulated data. However, no study to date has evaluated false positives and negatives using a large sample of non‐simulated behaviors. In addition, few studies have evaluated whether interval methods of data collection alter trends that are evident in continuous records. We conducted three experiments to evaluate the extent to which various interval sizes of MTS and PIR produced false negatives (Experiment 1), false positives (Experiment 2), and trends that were inconsistent with the continuous records (Experiment 3). Collectively, the results show the following: (i) 10‐s PIR and 10‐s MTS produced few false negatives and few false positives (i.e., both were sensitive) to changes in duration events; (ii) 10‐s PIR produced very few false negatives, but an unexpected high percentage of false positives for frequency events; and (iii) each interval size of PIR and MTS produced a high percentage of changes in trending for duration events and frequency events. We briefly discuss the potential limitations and clinical implications of these findings. Copyright © 2012 John Wiley & Sons, Ltd.     

A comparison of momentary time sampling and partial-interval recording for evaluating functional relations

In the current study, momentary time sampling (MTS) and partial-interval recording (PIR) were compared to continuous-duration recording of stereotypy and to the frequency of self-injury during a treatment analysis to determine whether the recording method affected data interpretation. Five previously conducted treatment analysis data sets were analyzed by creating separate graphic displays for each measurement method (duration or frequency, MTS, and PIR). An expert panel interview and structured criterion visual inspection were used to evaluate treatment effects across measurement methods. Results showed that treatment analysis interpretations based on both discontinuous recording methods often matched those based on frequency or duration recording; however, interpretations based on MTS were slightly more likely to match those based on duration and those based on PIR were slightly more likely to match those based on frequency.     

Perceived Consensus in Estimates of the Prevalence of Driving Errors and Violations

This paper reports a study of perceptions of the prevalence of certain driving errors and violations in a large ( N = 1,656) sample of drivers. In keeping with previous research on perceptions of social consensus, it was predicted that (a) drivers who reported that they themselves regularly commit these errors and violations would make larger estimates of the percentage of other road users who regularly engage in these behaviors, by comparison with drivers who reported that they do not regularly commit these errors and violations; (b) comparison of estimates of social consensus for own behavior with the actual numbers of respondents reporting that they did or did not engage in these behaviors would show that those who do commit the behaviors regularly would overestimate consensus for their position, while those who do not commit the behaviors regularly would underestimate consensus for their position; and (c) these tendencies to overestimate or underestimate actual consensus for own position would be correlated with the perceived offensiveness to others of the behavior concerned, such that departures from actual consensus would be greater for behaviors rated as more offensive. The results provide strong support for the first two predictions but none for the third; indeed, the degree of over- or underestimation tended to be inversely related to offensiveness. In addition, there were unanticipated but highly consistent sex and age differences in perceptions of the prevalence of the target behaviors, with female and younger respondents making higher estimates than male and older respondents, respectively. The theoretical and practical implications of these findings are discussed.     

Evaluation of the accuracy,reliability, efficiency,and acceptability of fast forwarding to score problem behavior

Technological advances have allowed professionals to obtain extended recordings of caregiver–client interactions in natural settings, but scoring recorded video at normal speed to identify instances of low‐rate problem behavior is impractical in terms of scoring time. Fast forwarding is a continuous measurement system in which all seconds of an observation are viewed at a speed faster than normal. In Study 1, we evaluated whether three groups of five observers could discriminate problem behavior at three fast‐forwarding speeds across 10‐min observations. We analyzed the efficiency of using fast forwarding compared to continuous scoring, and interobserver agreement across the fast‐forwarding speeds. In Study 2, we compared the accuracy, efficiency, and social acceptability of fast forwarding (3.5x) and momentary time sampling (3.5 s) across 90‐min observations. Results support the use of 3.5x fast forwarding as a viable measurement system of improving the practicality of scoring problem behavior from video.     

Voxcom: A system for analyzing natural speech in real time

A system is described for analyzing recorded natural speech in real time using a microcomputer. Recordings up to 15 min in length can be analyzed in terms of fundamental frequency, amplitude, length of utterances, and pauses. Although primarily developed for clinical research, the system has applicability to other research areas involving speech.