Observer reliability as a function of circumstances of assessment

THREE FACTORS CHARACTERISTIC OF EXPERIMENTAL SETTINGS WERE HYPOTHESIZED TO INFLATE ARTIFACTUALLY THE RELIABILITY OF OBSERVATIONAL RECORDINGS: (a) knowledge by observers of when and by whom their reliability is being assessed, (b) the absence of the experimenter or a monitor to prevent cheating, and (c) computation of reliability within- (versus between-) observer group. Three groups of four observers used a standard nine-category observational code for disruptive behavior in recording from videotapes of a classroom for 22 days. Analyses revealed considerable increases in average occurrence reliability as a function of the main effects of each of the experimental factors. The specific increases in reliability associated with each of the 12 combinations of the experimental factors are presented for each category of behavior. The possible role of observer-training procedures and behavioral definitions as determiners of nonartifactual reliability is discussed.     

A review of the observational data-collection and reliability procedures reported in The Journal of Applied Behavior Analysis

The research published in the Journal of Applied Behavior Analysis (1968 to 1975) was surveyed for three basic elements: data-collection methods, reliability procedures, and reliability scores. Three-quarters of the studies reported observational data. Most of these studies' observational methods were variations of event recording, trial scoring, interval recording, or time-sample recording. Almost all studies reported assessment of observer reliability, usually total or point-by-point percentage agreement scores. About half the agreement scores were consistently above 90%. Less than one-quarter of the studies reported that reliability was assessed at least once per condition.     

Simplifying continuous monitoring of multiple-response/multiple-subject classroom interactions

In order to facilitate the field monitoring of three subjects interacting according to one or more of 18 response categories, a modified version of several available, but oftentimes mechanically incompatible, observational procedures was designed. Its continuous recording strategy, sectioned into one-minute observational units, enabled researchers to derive highly representative behavior samples, and when accompanied by the specially tailored coding form and recording apparatus, observers achieved over 90% agreement across all reliability sessions. This procedure provides applied researchers with a simple, highly reliable, and adaptable observation tool for continuously and simultaneously monitoring the behaviors of one or more subjects.     

GENERALIZATION OF THE EFFECTS OF TEACHER- AND SELF-ADMINISTERED TOKEN REINFORCERS TO NONTREATED STUDENTS

Ten, black, second-grade boys served in a series of single-subject studies. They were from poor families, did not do well in arithmetic, were deficient in sustained attention, and presented behavior problems at school. One boy was a therapeutic confederate. Of the remaining nine nontreated students, three observed the confederate reinforced by a teacher, three observed the confederate self-reinforce without having an opportunity to use “self-reinforcement” themselves, and three observed self-reinforcement while having an opportunity to use “self-reinforcement.” The target behavior was attending. Other measures of outcome were glancing, academic achievement, and accuracy of reinforcement. The basic experimental design consisted of an ABAB withdrawal applied to the confederate while the nontreated students remained on baseline. Generalization was expressed as a ratio (i.e., percent change in the generalization measure divided by percent change in the target behavior). Teacher-administered reinforcers to the confederate did not produce generalization of any kind. Both arrangements of self-administered reinforcers to the confederate produced across-subjects generalization and subject-response generalization. Additionally, the confederate manifested response generalization.     

Workaholism in Organizations: Measurement Validation and Replication

Although workaholism in organizations has received considerable attention in the popular press, our understanding of it based on research is quite limited. This deficit is the result of absence of both suitable definitions and measures of the concept. This study reports the replication of earlier work undertaken by Spence and Robbins (1992) applying their measures to a managerial population (N = 530). Considerable support was found for the usefulness of their measures based on reliability and construct validity data.     

企业员工工作价值观与组织公民行为的关系研究

本研究旨在探讨企业员工工作价值观与组织公民行为的关系。用工作价值观调查表、中国组织公民行为量表对525名企业员工进行了问卷调查,结果发现：整体工作价值观与整体组织公民行为存在着显著性相关;工作价值观的能力警曼等璧翌组织公民行为的公司认同、个人主动性、保护公司资源因素有显著正向影响;工作价值观的地位因素对组织公民行为的公司认同、同事间的利他行为、个人主动性因素有显著正向影响。     

TEMPORAL AND CLIMATIC VARIABLES IN NATURALISTIC OBSERVATION1

Home-observation data on 5- to 7-yr-old boys collected over 2 yr were examined for systematic variations in rates of desirable and undesirable behaviors associated with several temporal and climatic variables. Significant effects associated with time of day, day of the week, precipitation, and temperature were found. No significant effects on the naturalistic observation data were found for environmental factors associated with lunar phase. It was noted that the correlational nature of the findings did not obviate the necessity for control of the influence of temporal and climatic variables. Several methodological strategies for such control were discussed.     

The use of teachers as behavioral observers

The effect of using teachers as behavioral observers on both student and teacher behavior was examined with eight teachers and 32 elementary school children. The frequency of prompts (but not praise or criticism) to those students observed by the teacher increased significantly from nonobserver to teacher observed experimental phases. In addition, students observed by the teacher showed more change in appropriate behavior than students who were not observed. The significance of these findings for research and therapy is discussed.     

Methods of time sampling: A reappraisal of momentary time sampling and partial interval recording

We compared the accuracy of momentary time sampling (MTS) and partial interval recording (PIR) in estimating both absolute behavioral levels and relative change. A computer randomly generated runs of pseudobehavior varying in duration and rate and simulated MTS and PIR of each run. Results indicated that when estimating absolute behavioral levels, duration rather than rate should be used as the dependent measure, and MTS is more accurate than PIR. In contrast, PIR is the more sensitive method for detecting relative changes in behavioral levels, although, at high rates, PIR tends to underestimate the degree of change.     

The relationship between performance-based self-esteem and self-reported work and health behaviors among Danish knowledge workers

Since knowledge intensive work often requires self-management, one might fear that persons who are dependent on work success for self-esteem will have difficulties in finding a healthful and sustainable balance between internal needs and external demands. Accordingly, we examined to what degree work-related performance-based self-esteem (PBS) was linked to work and health behaviors in 392 knowledge workers (226 women, 166 men). In the women group, multiple binary logistic regression analyses with repeated measurements showed that the PBS score was associated with 10 of the 17 examined work and health behaviors. For men the corresponding figure was 3 of 17. In both men and women, higher PBS scores were positively associated with reports of efforts and strivings for work as well as attending work while ill. In conclusion, statistically significant relationships between PBS and work and health behaviors were more clearly visible among women than men. Whether this gender difference is dependent on the study design, or on true inherent differences between women and men, cannot be concluded with any certainty. However, persons who described themselves as being relatively more dependent on work accomplishments for a high self-esteem, as expressed by the PBS score, seem to display work behaviors that may lessen their restitution time. In addition, they also seem to be more prone to work while sick.     

Two Faces of Representativeness: The Effects of Response Format on Beliefs about Random Sampling

Two beliefs that act in concert have been proposed as the basis for the representativeness heuristic in general, and judgments about random sampling in particular: samples resemble their parent populations (resemblance), and random sampling is a self-correcting process (balancing). Based on the results of a preliminary experiment, we proposed the ‘rule-cuing’ hypothesis, which is that different aspects of sampling problems can invoke these two beliefs separately. We found that when response formats required subjects to estimate themean of a sample, subjects’ responses reflected resemblance beliefs, whereas when subjects estimated the total score in a sample, balancing beliefs were elicited. In additional experiments we eliminated two rival hypotheses: theproblem difficulty hypothesis, and thearithmetic inconsistency hypothesis. Results suggest that beliefs, as well as preferences, may be constructed on-line in response to task characteristics.     

The Assessment of Adult Health Care Orientations: Development and Preliminary Validation of the Multidimensional Health Profile–Health Functioning Index (MHP-H) in a National Sample

This paper describes the development and preliminary validation of the Multidimensional Health Profile–Health Functioning Index (MHP-H), a 69-item self-report instrument designed to assess a variety of behaviors, perceptions, attitudes, and beliefs presumed to influence health status and the pursuit of lay and professional health care. The MHP-H briefly measures adult health history, health habits, health care utilization, health beliefs and attitudes, and response to illness (help-seeking behaviors). A national sample of adults (N = 673) was assessed, comprising 3 age groupings (18–32, 33–50, and 51–89) crossed with gender and then further subdivided into several subsamples for purposes of reliability and validity assessment. In addition, a group of spouse key informants was also recruited. Preliminary validation of single-item indicators as well as confirmatory factor analyses of multi-item scales was achieved. The present findings support the psychometric and practical utility of the MHP-H and warrant its use by health psychologists in a variety of research and applied settings.     

The Relationship Between Volunteers' Work Behaviors and Background and Preparation Variables

Increasingly, a large number of individuals provide volunteer services. Demographic information known about these individuals is also increasing. Although recent efforts have attempted to examine more closely the relationships between demographic and background variables and subsequent volunteer motivation and retention, few have studied how these variables impact actual work performed by volunteers. This study provides a model for how volunteers' demographic and background variables may be related to volunteers' perceptions of the frequency and importance of their work behaviors. Although it is possible that motivation also may be related to work behaviors, this study provides information ultimately leading to a more complete picture of the potential impact of demographic and background variables on work behaviors.