Shaping data collection congruent with experimental hypotheses

The influence of instructions and feedback from an experimenter on observational recordings of disruptive behavior was evaluated. Four subject-observers recorded four categories of disruptive behavior from videotapes of children in a classroom setting. Two sets of videotapes, labelled "baseline" and "treatment", were matched for rates of disruptive behavior in each category. The observers were told that two target behaviors were expected to decrease and the other two control behaviors were not expected to change during the treatment condition. During observational recording of treatment videotapes, the observers were given positive feedback when they reported decreases in the two target behaviors, and negative feedback when they reported either to change or increases in the two control behaviors. The target behaviors were recorded less frequently by observers, while recordings of control behaviors were unaffected during the treatment phase. These results suggest that contingent feedback to observers should be avoided as a possible source of bias in behavioral recordings.     

A method for recording verbal behavior in free-play settings

The present study attempted to test the reliability of a new method of recording verbal behavior in a free-play preschool setting. Six children, three normal and three speech impaired, served as subjects. Videotaped records of verbal behavior were scored by two experimentally naive observers. The results suggest that the system provides a means of obtaining reliable records of both normal and impaired speech, even when the subjects exhibit nonverbal behaviors (such as hyperactivity) that interfere with direct observation techniques.     

Simplifying continuous monitoring of multiple-response/multiple-subject classroom interactions

In order to facilitate the field monitoring of three subjects interacting according to one or more of 18 response categories, a modified version of several available, but oftentimes mechanically incompatible, observational procedures was designed. Its continuous recording strategy, sectioned into one-minute observational units, enabled researchers to derive highly representative behavior samples, and when accompanied by the specially tailored coding form and recording apparatus, observers achieved over 90% agreement across all reliability sessions. This procedure provides applied researchers with a simple, highly reliable, and adaptable observation tool for continuously and simultaneously monitoring the behaviors of one or more subjects.     

Ideology and Gender: Observers’ System Justification and Targets’ Gender as Interactive Predictors of Citizenship Expectations

We integrate system justification and social role theory to explain how observers’ system justification and target employees’ gender interact to predict observers’ expectations of targets’ sportsmanship citizenship behaviors. In contrast with social role theory predictions, observers did not expect greater levels of sportsmanship from women compared to men. Yet observers expected more sportsmanship from women (a) when observers were ideologically motivated by gender-specific beliefs (gender-specific system justification; Study 1) and (b) when system justification was cued experimentally (Study 2). A heretofore-unexamined aspect, observers’ ideology, modifies their expectations of sportsmanship citizenship across target genders. This has implications for system justification, social role, and organizational citizenship theoretical perspectives.     

Observing Workplace Incivility Towards Women: The Roles of Target Reactions,Actor Motives,and Actor-Target Relationships

The current study conceptualized observer reactions to uncivil behavior towards women as an ethical behavior and examined three factors (target reaction, actor motive, and actor-target relationship) that influence these reactions. Two vignette studies with women and men undergraduate and graduate students in western Switzerland were conducted. Study 1 (N?=?148) was a written vignette study that assessed how the reaction of female targets to incivility and the motives of actors influenced observer reactions. Results showed that a female target’s reaction influenced observers’ evaluations of the harm caused by an uncivil incident, and that an actor’s motive affected observers’ assessments of the necessity to intervene. Study 2 (N?=?81) was a video vignette study that assessed the effects of the reactions by female targets to incivility and the relationship between the target and the actor on observer reactions. We found that female targets’ reactions influenced observers’ evaluations of harm and the perceived necessity to intervene. Furthermore, the effect of a female target’s reaction on observers’ evaluations of harm was moderated by the relationship between the actor and the target: a female target who laughed at the uncivil behavior was perceived as less harmed, when she and the actor had a personal relationship than when they had a professional relationship. When the female target reacted hurt or neutrally, actor-target relationship did not affect observers’ evaluations of harm. We conclude by discussing the implications of our findings for theory and practice.     

Fixational eye movements are not an index of covert attention

The debate about the nature of fixational eye movements has revived recently with the claim that microsaccades reflect the direction of attentional shifts. A number of studies have shown an association between the direction of attentional cues and the direction of microsaccades. We sought to determine whether microsaccades in attentional tasks are causally related to behavior. Is reaction time (RT) faster when microsaccades point toward the target than when they point in the opposite direction? We used a dual-Purkinje-image eyetracker to measure gaze position while 3 observers (2 of the authors, 1 naive observer) performed an attentional cuing task under three different response conditions: saccadic localization, manual localization, and manual detection. Critical trials were those on which microsaccades moved away from the cue. On these trials, RTs were slower when microsaccades were oriented toward the target than when they were oriented away from the target. We obtained similar results for direction of drift. Cues, not fixational eye movements, predicted behavior.     

Nonshared environmental processes in social‐emotional development: an observational study of identical twin differences in the preschool period

Differences in mothers’ parenting behaviors toward their identical twin preschoolers were examined to identify nonshared environmental processes in social‐emotional development. The study included 62 pairs of 3½‐year‐old same‐sex identical twins. Indicators of each child’s social‐emotional development (temperament, prosocial behavior, behavior problems and noncompliance) and parenting environment (warmth and negativity, positive and negative control, responsiveness) were assessed using observers’, interviewers’, and parents’ ratings. Mothers treated their identical twins differently, and this differential treatment covaried in expected ways with identical twin differences in social‐emotional adjustment. The twin who received more supportive and less punitive forms of parenting was also higher in positive mood and prosocial behaviors and lower in negative mood and behavior problems when compared to her or his twin.     

USING CALIBRATION AND INTEROBSERVER AGREEMENT ALGORITHMS TO ASSESS THE ACCURACY AND PRECISION OF DATA FROM ELECTRONIC AND PEN‐AND‐PAPER CONTINUOUS RECORDING METHODS

Often it is assumed that electronic recording by observers necessarily provides better quality data than pen‐and‐paper methods. Fifteen novice observers recorded rates of responding from 10 role‐played video samples using one of three continuous recording input formats: keyboard (laptop), touchscreen (personal digital assistants), or pen‐and‐paper. We evaluated the quality of the observers' data compared with criterion records using calibration and interobserver agreement algorithms. Results of the calibration analysis revealed that observers in the touchscreen group produced the most consistently accurate and precise data, the keyboard group observers showed wide variation in precision and accuracy, and the pen‐and‐paper group observers were significantly less precise than the touchscreen group. We conclude that although electronic recording has the potential to be as accurate as, and more precise than, pen‐and‐paper methods, this is far from guaranteed. Analyses of observers' errors advise recommendations for improving data accuracy and precision when using each method. Copyright © 2014 John Wiley & Sons, Ltd.     

Change in selectivity of infant social behavior between 15 and 30 weeks

Six infants were filmed at 15 and 30 weeks of age while alone as well as in the presence of an adult (mother or stranger) who interacted with the infant or remained passive. Judges viewing samples of infant behavior tried to identify the social context in which episodes of behavior had occurred. Signal detection analysis of ratings made by the judges showed that infant behavior at both ages varied in accord with whether or not an adult was present. The identity and interactional style of the adult had only limited influence on infant behavior at 15 weeks, but judges could readily establish from the behavior of 30-week infants whether the adult was interactive or passive. Mothers were no more accurate in their ratings of social context than other judges were, even when they were observing the behavior of their own infant. Measurement of specific infant behaviors showed that the presence of the adult at both ages and the interactional style of the adult at 30 weeks exerted selective influence over rates of looking and smiling by infants. Signal detection classification was more sensitive to social context variables than microanalysis, possibly because observers had access to complex behavioral configurations.     

The effect of witnessing consequences on the behavioral recordings of experimental observers

The cueing effects of interviewer praise contingent on a target behavior and expectation of behavior change were examined with six observers. Experiment I investigated the effect of cues in conjunction with expectation. Experiment II assessed the relative contributions of cues and expectation, and Experiment III examined the effect of cues in the absence of expectation. The frequencies of two behaviors, client eye contact and face touching, were held constant throughout a series of videotaped interviews between an "interviewer" and a "client". A within-subjects design was used in each experiment. During baseline conditions, praise did not follow eye contact by the client on the videotape. In all experimental conditions, praise statements from the interviewer followed each occurrence of eye contact with an equal number of praises delivered at random times when there was no eye contact. Three of the six observers dramatically increased their recordings of eye contact during the first experimental phase, but these increases were not replicated in a second praise condition. There were no systematic changes in recorded face touching. Witnessing the delivery of consequences, rather than expectation seemed to be responsible for the effect. This potential threat to the internal validity of studies using observational data may go undetected by interobserver agreement checks.     

CUE: The continuous unified electronic diary method

In the present article, we introduce the continuous unified electronic (CUE) diary method, a longitudinal, event-based, electronic parent report method that allows real-time recording of infant and child behavior in natural contexts. Thirty-nine expectant mothers were trained to identify and record target behaviors into programmed handheld computers. From birth to 18?months, maternal reporters recorded the initial, second, and third occurrences of seven target motor behaviors: palmar grasp, rolls from side to back, reaching when sitting, pincer grip, crawling, walking, and climbing stairs. Compliance was assessed as two valid entries per behavior: 97?% of maternal reporters met compliance criteria. Reliability was assessed by comparing diary entries with researcher assessments for three of the motor behaviors: palmar grasp, pincer grip and walking. A total of 81?% of maternal reporters met reliability criteria. For those three target behaviors, age of emergence was compared across data from the CUE diary method and researcher assessments. The CUE diary method was found to detect behaviors earlier and with greater sensitivity to individual differences. The CUE diary method is shown to be a reliable methodological tool for studying processes of change in human development.     

The teacher as observer and experimenter in the modification of disputing and talking-out behaviors

Disputing and talking-out behaviors of individual pupils and entire classroom groups in special education classes and regular classes from white middle-class areas and from all black poverty areas ranging from the first grade to junior high school were studied. The classroom teacher in each case acted as the experimenter and as an observer. Various means of recording behaviors were used and reliability of observation was checked by an outside observer, another teacher, a teacher-aide, a student, or by using a tape recorder. Observation sessions varied from 15 min to an entire school day. After baseline rates were obtained, extinction of inappropriate disputing or talking-out behaviors and reinforcement of appropriate behavior with teacher attention, praise and in some cases a desired classroom activity or a surprise at the end of the week brought a decrease in undesired verbalizations. A reversal of contingencies brought a return to high levels of inappropriate talking with a return to low levels when reinforcement for appropriate talking was reinstated. The experiments demonstrated that teachers in a variety of classroom settings could obtain reliable observational records and carry out experimental manipulations successfully using resources available in most schools.     

Sex and age modulate the visual perception of distance

An experiment was conducted to evaluate the ability of 28 younger and older adults to visually bisect distances in depth both indoors and outdoors; half of the observers were male and half were female. Observers viewed 15-m and 30-m distance extents in four different environmental settings (two outdoor grassy fields and an indoor hallway and atrium) and were required to adjust the position of a marker to place it at the midpoint of each stimulus distance interval. Overall, the observers’ judgments were more accurate indoors than outdoors. In outdoor environments, many individual observers exhibited perceptual compression of farther distances (e.g., these observers placed the marker closer than the actual physical midpoints of the stimulus distance intervals). There were significant modulatory effects of both age and sex upon the accuracy and precision of the observers’ judgments. The judgments of the male observers were more accurate than those of the female observers and they were less influenced by environmental context. In addition, the accuracies of the younger observers’ judgments were less influenced by context than those of the older observers. With regard to the precision of the observers’ judgments, the older females exhibited much more variability across repeated judgments than the other groups of observers (younger males, younger females, and older males). The results of our study demonstrate that age and sex are important variables that significantly affect the visual perception of distance.     

Observation procedure, observer gender, and behavior valence as determinants of sampling error in a behavior assessment analogue

Several factors thought to influence the representativeness of behavioral assessment data were examined in an analogue study using a multifactorial design. Systematic and unsystematic methods of observing group behavior were investigated using 18 male and 18 female observers. Additionally, valence properties of the observed behaviors were inspected. Observers' assessments of a videotape were compared to a criterion code that defined the population of behaviors. Results indicated that systematic observation procedures were more accurate than unsystematic procedures, though this factor interacted with gender of observer and valence of behavior. Additionally, males tended to sample more representatively than females. A third finding indicated that the negatively valenced behavior was overestimated, whereas the neutral and positively valenced behaviors were accurately assessed.     

Panoramic search: the interaction of memory and vision in search through a familiar scene

How do observers search through familiar scenes? A novel panoramic search method is used to study the interaction of memory and vision in natural search behavior. In panoramic search, observers see part of an unchanging scene larger than their current field of view. A target object can be visible, present in the display but hidden from view, or absent. Visual search efficiency does not change after hundreds of trials through an unchanging scene (Experiment 1). Memory search, in contrast, begins inefficiently but becomes efficient with practice. Given a choice between vision and memory, observers choose vision (Experiments 2 and 3). However, if forced to use their memory on some trials, they learn to use memory on all trials, even when reliable visual information remains available (Experiment 4). The results suggest that observers make a pragmatic choice between vision and memory, with a strong bias toward visual search even for memorized stimuli.