The Observer: A software system for collection and analysis of observational data

The Observer is a general-purpose software package for event recording and data analysis in behavioral research. It allows any IBM-type personal computer to serve as an event recorder. In addition, The Observer can generate dedicated event-recording programs for several types of non-IBM-compatible portable and hand-held computers and transfer files between the PC and such computers. The user specifies options through menus. The configuration can be either used directly for event recording on the PC or passed on to a program generator that creates a program to collect data on a hand-held computer. Observational data from either type of computer can be analyzed by the program. Event-recording configurations can be tailored to many different experimental designs. Keys can be designated as events, and modifiers can be used to indicate the limits of an event. The program allows grouping of events in classes and distinction between mutually exclusive versus nonexclusive events and duration events versus frequency events. Timing of events is accurate to 0.1 sec. An on-line electronic notepad permits notes to be made during an observation session. The program also includes on-line error correction. User comments as well as independent variables can be stored together with the observational data. During data analysis, the user can select the level of analysis and the type of output file. The Observer calculates frequency of occurrence and duration for classes of events, individual events, or combinations of events. For analysis of concurrence, one can select the number of nesting levels and the order of nesting. Output can be generated in the form of sorted event sequence files, text report files, and tabular ASCII files. The results can be exported to spreadsheet and statistical programs.     

A simple LSI-11 system for real-time control,interevent time storage,and data analysis

A simple laboratory computer system based on a Digital Equipment Corporation LSI-11, floppy disk, DRV11 parallel input-output board, and the RT-11 operating system is described. Interface to experimental devices is provided through a lab-built relay driver and relay closure sensing interface. An extensive high-level software package provides an easy-to-use control language (e.g., stimuli can be controlled with a simple “TURN ON” or “TURN OFF” instruction) and easy-to-use FORTRAN subroutines for data exploration (e.g., “IFIND” searches a data file for a particular event). The control software automatically generates, codes, and stores a complete log of every input and output event and its time of occurrence in each of five simultaneously running experiments. This provides the capability to reanalyze data in light of hypotheses not available when the experiment was designed. The FORTRAN subroutine library for data exploration provides a conditional and iterative search facility to sift out events or sets of events from the data file for analysis. Standard FORTRAN statements perform arithmetic operations on the resulting data.     

Moderated multiple regression for interactions involving categorical variables: a statistical control for heterogeneous variance across two groups

Moderated multiple regression (MMR) arguably is the most popular statistical technique for investigating regression slope differences (interactions) across groups (e.g., aptitude-treatment interactions in training and differential test score-job performance prediction in selection testing). However, heterogeneous error variances can greatly bias the typical MMR analysis, and the conditions that cause heterogeneity are not uncommon. Statistical corrections that have been developed require special calculations and are not conducive to follow-up analyses that describe an interaction effect in depth. A weighted least squares (WLS) approach is recommended for 2-group studies. For 2-group studies, WLS is statistically accurate, is readily executed through popular software packages (e.g., SAS Institute, 1999; SPSS, 1999), and allows follow-up tests.     

Mousetrap: An integrated,open-source mouse-tracking package

Mouse-tracking – the analysis of mouse movements in computerized experiments – is becoming increasingly popular in the cognitive sciences. Mouse movements are taken as an indicator of commitment to or conflict between choice options during the decision process. Using mouse-tracking, researchers have gained insight into the temporal development of cognitive processes across a growing number of psychological domains. In the current article, we present software that offers easy and convenient means of recording and analyzing mouse movements in computerized laboratory experiments. In particular, we introduce and demonstrate the mousetrap plugin that adds mouse-tracking to OpenSesame, a popular general-purpose graphical experiment builder. By integrating with this existing experimental software, mousetrap allows for the creation of mouse-tracking studies through a graphical interface, without requiring programming skills. Thus, researchers can benefit from the core features of a validated software package and the many extensions available for it (e.g., the integration with auxiliary hardware such as eye-tracking, or the support of interactive experiments). In addition, the recorded data can be imported directly into the statistical programming language R using the mousetrap package, which greatly facilitates analysis. Mousetrap is cross-platform, open-source and available free of charge from https://github.com/pascalkieslich/mousetrap-os.     

Enhancing dynamic graphical analysis with the Lisp-Stat language and the ViSta statistical program

Presented is a sample of computerized methods aimed at multidimensional scaling and psychometric item analysis that offer a dynamic graphical interface to execute analyses and help visualize the results. These methods show how the Lisp-Stat programming language and the ViSta statistical program can be jointly applied to develop powerful computer applications that enhance dynamic graphical analysis methods. The feasibility of this combined strategy relies on two main features: (1) The programming architecture of ViSta enables users to add new statistical methods as plug-ins, which are integrated into the program environment and can make use of all the functions already available in ViSta (e.g., data manipulation, editing, printing); and (2) the set of powerful statistical and graphical functions integrated into the Lisp-Stat programming language provides the means for developing statistical methods with dynamic graphical visualizations, which can be implemented as ViSta plug-ins.     

The Observer Video-Pro: New software for the collection, management, and presentation of time-structured data from videotapes and digital media files

The Observer Video-Pro is a system for collecting, managing, analyzing, and presenting observational data. It integrates The Observer software with time code and multimedia hardware components. It extends the functionality of a conventional real-time event recording program in various ways. Observational data can be collected, reviewed, and edited with synchronized display of the corresponding video images. For optimal visual feedback during coding, one can display the video image in a window on the computer screen. Video playback from either a VCR or a digital media file can be controlled by the computer, allowing software-controlled jog, shuttle, and search functions. Besides a wide range of VCRs, The Observer Video-Pro supports all major digital video file formats. The software allows the user to summarize research findings in numerical, graphical, or multimedia format. One can create a time-event plot for a quick glance at the temporal structure of the observed process, or run specific analysis procedures and generate reports with statistics. An Event Summary function is available for exploratory and qualitative analysis. Video material can be summarized in a Video Play List, which allows on-screen summary presentations or the creation of highlight compilations on tape, CD, or other media. Video images can be captured and saved as disk files, for use as illustrations in documents, slides for presentations, and so forth. In this paper we describe the design and operation of the system, illustrated with a case study from research on Repetitive Strain Injury (RSI).     

OGAMA (Open Gaze and Mouse Analyzer): Open-source software designed to analyze eye and mouse movements in slideshow study designs

In the present article, a new software is introduced that allows the recording and analyzing of eye- and mouse-tracking data from slideshow-based experiments in parallel. The Open Gaze and Mouse Analyzer (OGAMA) is written in C#.NET and has been released as an open-source project. Its main features include slide-show design, the recording of gaze and mouse data, database-driven preprocessing and filtering of gaze and mouse data, the creation of attention maps, areas-of-interest definition, and replay. Eyetracking and/or presentation soft- and hardware recordings in ASCII format can be imported. Data output is provided that can be used directly with different statistical software packages. Because it is open source, one can easily adapt it to suit one’s needs.     

GazeAlyze: a MATLAB toolbox for the analysis of eye movement data

This article presents GazeAlyze, a software package, written as a MATLAB (MathWorks Inc., Natick, MA) toolbox developed for the analysis of eye movement data. GazeAlyze was developed for the batch processing of multiple data files and was designed as a framework with extendable modules. GazeAlyze encompasses the main functions of the entire processing queue of eye movement data to static visual stimuli. This includes detecting and filtering artifacts, detecting events, generating regions of interest, generating spread sheets for further statistical analysis, and providing methods for the visualization of results, such as path plots and fixation heat maps. All functions can be controlled through graphical user interfaces. GazeAlyze includes functions for correcting eye movement data for the displacement of the head relative to the camera after calibration in fixed head mounts. The preprocessing and event detection methods in GazeAlyze are based on the software ILAB 3.6.8 Gitelman (Behav Res Methods Instrum Comput 34(4), 605-612, 2002). GazeAlyze is distributed free of charge under the terms of the GNU public license and allows code modifications to be made so that the program's performance can be adjusted according to a user's scientific requirements.     

CFS MATLAB toolbox: An experiment builder for continuous flash suppression (CFS) task

CFS toolbox is an open-source collection of MATLAB functions that utilizes PsychToolbox-3 (PTB-3). It is designed to allow a researcher to create and run continuous flash suppression experiments using a variety of experimental parameters (i.e., stimulus types and locations, noise characteristics, and experiment window settings). In a CFS experiment, one of the eyes at a time is presented with a dynamically changing noise pattern, while the other eye is concurrently presented with a static target stimulus, such as a Gabor patch. Due to the strong interocular suppression created by the dominant noise pattern mask, the target stimulus is rendered invisible for an extended duration. Very little knowledge of MATLAB is required for using the toolbox; experiments are generated by modifying csv files with the required parameters, and result data are output to text files for further analysis. The open-source code is available on the project page under a Creative Commons License (http://www.mikkonuutinen.arkku.net/CFS_toolbox/ and https://bitbucket.org/mikkonuutinen/cfs_toolbox).     

Scientific LogAnalyzer: a web-based tool for analyses of server log files in psychological research.

Scientific LogAnalyzer is a platform-independent interactive Web service for the analysis of log files. Scientific LogAnalyzer offers several features not available in other log file analysis tools--for example, organizational criteria and computational algorithms suited to aid behavioral and social scientists. Scientific LogAnalyzer is highly flexible on the input side (unlimited types of log file formats), while strictly keeping a scientific output format. Features include (1) free definition of log file format, (2) searching and marking dependent on any combination of strings (necessary for identifying conditions in experiment data), (3) computation of response times, (4) detection of multiple sessions, (5) speedy analysis of large log files, (6) output in HTML and/or tab-delimited form, suitable for import into statistics software, and (7) a module for analyzing and visualizing drop-out. Several methodological features specifically needed in the analysis of data collected in Internet-based experiments have been implemented in the Web-based tool and are described in this article. A regression analysis with data from 44 log file analyses shows that the size of the log file and the domain name lookup are the two main factors determining the duration of an analysis. It is less than a minute for a standard experimental study with a 2 x 2 design, a dozen Web pages, and 48 participants (ca. 800 lines, including data from drop-outs). The current version of Scientific LogAnalyzer is freely available for small log files. Its Web address is http://genpsylab-logcrunsh.unizh.ch/.     

Observer agreement, credibility, and judgment: some considerations in presenting observer agreement data

Graphical and statistical indices employed to represent observer agreement in interval recording are described as "judgmental aids", stimuli to which the researcher and scientific community must respond when viewing observer agreement data. The advantages and limitations of plotting calibrating observer agreement data and reporting conventional statistical aids are discussed in the context of their utility for researchers and research consumers of applied behavior analysis. It is argued that plotting calibrating observer data is a useful supplement to statistical aids for researchers but is of only limited utility for research consumers. Alternatives to conventional per cent agreement statistics for research consumers include reporting special agreement estimates (e.g., per cent occurrence agreement and nonoccurrence agreement) and correlational statistics (e.g., Kappa and Phi).     

Eavesdropping on character: Assessing everyday moral behaviors

Despite decades of interest in moral character, comparatively little is known about moral behavior in everyday life. This paper reports a novel method for assessing everyday moral behaviors using the Electronically Activated Recorder (EAR)—a digital audio-recorder that intermittently samples snippets of ambient sounds from people’s environments—and examines the stability of these moral behaviors. In three samples (combined N = 186), participants wore an EAR over one or two weekends. Audio files were coded for everyday moral behaviors (e.g., showing sympathy, gratitude) and morally-neutral comparison language behaviors (e.g., use of prepositions, articles). Results indicate that stable individual differences in moral behavior can be systematically observed in daily life, and that their stability is comparable to the stability of neutral language behaviors.     

Scientific LogAnalyzer: A Web-based tool for analyses of server log files in psychological research

Scientific LogAnalyzer is a platform-independent interactive Web service for the analysis of log files. Scientific LogAnalyzer offers several features not available in other log file analysis tools—for example, organizational criteria and computational algorithms suited to aid behavioral and social scientists. Scientific LogAnalyzer is highly flexible on the input side (unlimited types of log file formats), while strictly keeping a scientific output format. Features include (1) free definition of log file format, (2) searching and marking dependent on any combination of strings (necessary for identifying conditions in experiment data), (3) computation of response times, (4) detection of multiple sessions, (5) speedy analysis of large log files, (6) output in HTML and/or tab-delimited form, suitable for import into statistics software, and (7) a module for analyzing and visualizing drop-out. Several methodological features specifically needed in the analysis of data collected in Internet-based experiments have been implemented in the Web-based tool and are described in this article. A regression analysis with data from 44 log file analyses shows that the size of the log file and the domain name lookup are the two main factors determining the duration of an analysis. It is less than a minute for a standard experimental study with a 2 × 2 design, a dozen Web pages, and 48 participants (ca. 800 lines, including data from drop-outs). The current version of Scientific LogAnalyzer is freely available for small log files. Its Web address ishttp://genpsylab-logcrunsh.unizh.ch/.     

EMOTLAB: Software for studying emotional signaling in economic bargaining games

EMOTLAB software creates a virtual social environment in which individuals interact via computer with a virtual interaction partner in a series of economic bargaining games. The virtual partner appears on the participant's computer screen as a digital image (e.g., video or picture file) during each trial. A key feature of EMOTLAB software is its ability to control both the strategic behavior and the emotion signaling behavior (e.g., anger vs. embarrassment) of the virtual interaction partner. By simply editing a series of text files that control the subroutines governing the different features of the experiment (payoff structure, number of trials, etc.), EMOTLAB can generate an essentially infinite number of different social bargaining situations in which participants earn monetary payoffs contingent upon their decisions. This paper provides an overview of this software and how one can edit various subroutines to generate a typical experimental session in which research participants encounter a virtual interaction partner who displays different emotional signals.     

A microcomputer-based software package for eye monitoring research

A software package is described that collects and reduces eye behavior (eye position and pupil size) data using an IBM-compatible personal computer. Written in the C language for speed and portability, the package includes several unique features: data can be collected simultaneously from other sources (e.g., EEG, EMG), logically defined events can be detected in real time on any data channel, and either of two types of data matrix can be produced. Data reduction algorithms and data structures are described.     

ODAP: a stand-alone program for observational data acquisition

A software program written to collect real-time, observational data is described. The flexible program allows customized behavior codes and observational durations and simultaneously records both timed and counted events. The data are collected by means of single keystrokes, automatically stored to disk with 100th of a second resolution and summarized for each observational session. The program’s database files are dBASE III PLUS compatible and may be browsed, edited, or converted to ASCII files from the program’s main menu. Field testing demonstrated the efficiency and interobserver reliability of the program (for frequency,r=0.81; for durational behaviors,rs=0.89 and 0.96). The software operates on IBM XT/AT/PS 2s and most clones with PC/MS DOS version 2.0 or greater.     

Tutorial: Perl, a psychologically efficient reformatting language

Psychologists are often faced with the need to manipulate one or more files, either to modify the format or to extract specific information. Traditionally, these manipulations have been performed using programming languages or statistical software, but such solutions are often expensive, platform dependent, or limited in their ability to handle both numerical and textual data. This tutorial introduces the perl programming language, a free, platform-independent language that excels at pattern matching and text processing but that is also numerically capable. A running example illustrates an application of perl to psychological data.