Some empirical justification for a modest proposal regarding data acquisition via intermittent direct observation

Computer simulations of behavior and event records of a child's visual fixation on an adult person were generated and sampled using a modified time sampling procedure. The modified approach required making two independent scoring judgments per observation interval: if the behavior was initiated within the interval, the interval was scored; if the behavior was ongoing precisely at the end of the interval, the interval was again scored. The results showed that the within-interval and end-of-interval scores yielded, respectively, estimates of behavioral frequency and duration. The accuracy of the estimates was a function of the number of observations. Several field studies demonstrated high agreement among observers who employed the measurement system.     

Extending generalized symmetric means to arbitrary matrix sampling designs

Generalized symmetric means are redefined in a way which allows them to be calculated for any matrix sampling design. It is proved that these sample gsm's are unbiased estimates of the analogous population gsm's. Illustrative examples are given.This paper is based on Applied Technology Center for Education Technical Memorandum 75-03-01. Special appreciation is expressed to Ken Sirotnik and Tom Knapp for their suggestions on clarifing this presentation.     

Analytic smoothing for equipercentile equating under the common item nonequivalent populations design

A cubic spline method for smoothing equipercentile equating relationships under the common item nonequivalent populations design is described. Statistical techniques based on bootstrap estimation are presented that are designed to aid in choosing an equating method/degree of smoothing. These include: (a) asymptotic significance tests that compare no equating and linear equating to equipercentile equating; (b) a scheme for estimating total equating error and for dividing total estimated error into systematic and random components. The smoothing technique and statistical procedures are explored and illustrated using data from forms of a professional certification test.     

Retrospective questions and correlations

In survey research it is not uncommon to ask questions of the following type: “How many times did you undertake actiona in reference periodT of length τ?.” The relationship is established between τ and the correlation of the number of reported actions with some background variable. To this end it is assumed that the process of actions satisfies a renewal model with individual heterogeneity. Also a model has to be formulated for possible recall effects. Applications are given in the field of medical consumption.     

Measures of observer agreement when binomial data are collected in free operant situations

This paper examines a model and defines reasonable assumptions underlying different measures of observer agreement for categorical data collected in free operant situations. It is assumed that two or more observers classify operant behaviors of subjects into occurrences and nonoccurrences by recognition by validated response classes (categories) such that the rates of false positives and observer biases are acceptably low. Thus errors are mostly omissions, i.e., failing to observe events that occur. Four alternative cases are derived, together with formulas for calculating significance tests, variances, and standard errors, three of which do not depend on knowledge of the proportion of time points at which the event does not occur.We wish to acknowledge NICHD Grant HD-10570, The Neuropharmacology of Developmental Disorders, George Breese, Ph.D., and C. T. Gualtieri, M.D., Principal Investigators; NIEHS Grant ES-01104; USPHS Grant HD-03110; and MCH Project 916 to the Division for Disorders of Development and Learning.     

On the use of bisection procedures in animal psychophysical scaling

The ability of bisection procedures to specify the form of the psychophysical scale depends upon the precision of the technique. It is demonstrated that the precision of bisection techniques is a function of the stimulus interval bisected. Consequently, the choice of stimuli in a bisection experiment may predispose the ability of the experiment to distinguish between alternative psychophysical scales. The testing of interval scale properties of derived scales and the assessment of context effects in bisection experiments was also discussed.This material has been reviewed by the Walter Reed Army Institute of Research, and there is no objection to its presentation and/or publication. The opinions or assertions contained herein are the private views of the author and are not to be construed as official or as reflecting the view of the Department of the Army or the Department of Defense.     

Statistical inference for false positive and false negative error rates in mastery testing

This paper describes an asymptotic inferential procedure for the estimates of the false positive and false negative error rates. Formulas and tables are described for the computations of the standard errors. A simulation study indicates that the asymptotic standard errors may be used even with samples of 25 cases as long as the Kuder-Richardson Formula 21 reliability is reasonably large. Otherwise, a large sample would be required.This work was performed pursuant to Grant No NIE-G-78-0087 with the National Institute of Education, Department of Health, Education and Welfare, Huynh Huynh, Principal Investigator. Points of view or opinions stated do not necessarily reflect NIE position or policy and no official endorsement should be inferred. The editorial assistance of Joseph C. Saunders is gratefully acknowledged.     

Feasibility,acceptability, and validity of crowdsourcing for collecting longitudinal alcohol use data

Challenges to conducting longitudinal research include financial, time, and geographic constraints. An emerging sampling method positioned to address these concerns is crowdsourcing. This study evaluated the feasibility, acceptability, and validity of collecting intensive longitudinal alcohol use data with the crowdsourcing platform, Amazon.com 's Mechanical Turk (mTurk). Participants (N = 278) recruited from mTurk provided weekly recordings of daily alcohol and soda use over an 18‐week period. Construct and external validity was evaluated using generalized linear mixed models describing associations of between‐subject (e.g., alcohol use severity) and within‐subject (e.g., day of week) variables with prospectively collected alcohol and soda use. High response rates were observed across the 18‐week period demonstrating feasibility (64.1%‐86.8%). The design was acceptable with 94% of participants indicating they were satisfied with the procedures. Multilevel models supported construct and external validity by replicating expected associations, such as more frequent and heavier drinking by individuals with higher AUDIT scores and on weekends. These effects were specific to alcohol use and did not extend to soda consumption. These data support the feasibility, acceptability, and validity of using mTurk for intensive longitudinal data collection. Future studies may leverage this platform to generate large, geographically diverse samples for prospective behavioral analytic research.     

Affective influences on within-person changes in work performance as mediated by attentional focus

A great deal of research has investigated the performance consequences of affective experiences at work, but the mediating mechanisms that explain these consequences remain understudied. In this study, we used experience sampling method to examine within-person relationships between changes in affective states and episodic performance, as mediated by attentional allocation and regulation. Our findings show that within-person changes in negative affective states have a concurrent association with episodic performance as mediated by reduced attentional allocation and regulation, while positive affective states are associated with better performance, as mediated by enhanced attentional allocation and regulation. Our results are discussed in terms of their implications for understanding the performance and attentional consequences of affective states at work.