Adaptive user displays for intelligent tutoring software.

Intelligent tutoring software (ITS) holds great promise for K-12 instruction. Yet it is difficult to obtain rich information about users that can be used in realistic educational delivery settings--public school classrooms--in which eye tracking and other user sensing technologies are not suitable. We are pursuing three "cheap and cheerful" strategies to meet this challenge in the context of an ITS for high school math instruction. First, we use detailed representations of student cognitive skills, including tasks to assess individual users' proficiency with abstract reasoning, proficiency with simple math facts and computational skill, and spatial ability. Second, we are using data mining and machine learning algorithms to identify instructional sequences that have been effective with previous students, and to use these patterns to make decisions about current students. Third, we are integrating a simple focus-of-attention tracking system into the software, using inexpensive, web cameras. This coarse-grained information can be used to time the display of multimedia hints, explanations, and examples when the user is actually looking at the screen, and to diagnose causes of problem-solving errors. The ultimate goal is to create non-intrusive software that can adapt the display of instructional information in real time to the user's cognitive strengths, motivation, and attention.     

A tachistoscopic software system for use in remote timesharing applications

A program is described that permits the use of an Imlac PDS-1 display computer, in conjunction with a host timeshare system, as a software-controlled tachistoscope. Alphanumeric and graphic message strings are received from the host computer over a telephone line, and are then displayed for specified periods of time in sequence. The display computer records the S’s responses and reaction time and reports this information back to the host computer for recording and analysis. The system is designed so that the burden of software development for the realization of a specific experimental plan is shifted to the large-capacity host machine, and it can utilize all of the features of standard FORTRAN as implemented on the host computer system.     

A real-time control system for CAI and prothesis

An integrated hardware and software system was used for the real-time control of text display in a CAI environment. Reliability and cost considerations led to the development of a digital EOG transducer, which was used in conjunction with a KIM-1 microcomputer. This paper traces the development of that system from a complex and expensive PDP-11-based system to a microcomputer firmware approach. Such a system could, in real time, accomplish a similar display task for severely handicapped nonvocal individuals.     

An eye movement analysis system (EMAS) for the identification of cognitive processes on figural tasks

EMAS is a software system (written in VAX-11 FORTRAN) for the analysis of eye movement data recorded during the performance of figural tasks. Its main functions are: (1) Calibration of raw coordinates of eye movements to determine their actual position on the stimulus display. Different kinds of measurement distortion may be corrected. (2) Identification of eye fixations and the determination of their locations and durations. (3) Analysis of fixation sequences. The frequency of transitions of fixations among specified sectors of the stimulus display is computed. A sequential list is made of the successive fixations in which the fixated sector and the fixation duration are graphically indicated. (4) Plotting of raw or calibrated eye movement data and fixation points. The sequence of fixations in specified display sectors can also be plotted in real time. Applications of the programs to the Embedded Figures Test and the Hidden Figures Test are illustrated.     

Accurate millisecond timing on Apple’s Macintosh using Drexel’s MilliTimer

Many of the timed functions that concern psychologists, such as perceptual presentations and reaction time, are sensitive to a maximum variability in display timing caused by screen-refresh characteristics. For the Apple Macintosh, the screen operating speed is 60 Hz, which translates to an average of 8.33-msec variability. For microcomputers other than the Macintosh, a variety of hardware and software modifications to generate millisecond timing have become standard (e.g., Reed, 1979). Other than Reed College’s (1985) implementation in Rascal, which requires the Rascal development language, there has been no method of which we were aware to synchronize experimental timing with display presentation on the Macintosh. This limitation in the usefulness of the Macintosh as an otherwise excellent research tool can be overcome using Drexel University’s MilliTimer. The assembler code which follows should be considered in the public domain and can be readily adapted to any of the Macintosh-based languages.     

Testing the accuracy of timing reports in visual timing tasks with a consumer-grade digital camera

This study tested the accuracy of a visual timing task using a readily available and relatively inexpensive consumer grade digital camera. A visual inspection time task was recorded using short high-speed video clips and the timing as reported by the task’s program was compared to the timing as recorded in the video clips. Discrepancies in these two timing reports were investigated further and based on display refresh rate, a decision was made whether the discrepancy was large enough to affect the results as reported by the task. In this particular study, the errors in timing were not large enough to impact the results of the study. The procedure presented in this article offers an alternative method for performing a timing test, which uses readily available hardware and can be used to test the timing in any software program on any operating system and display.     

Experimental RunTime System: Software for developing and running reaction time experiments on IBM-compatible PCs

The Experimental RunTime System (ERTS) is a recent addition to the small collection of commercial software packages available for writing and running reaction time experiments on IBM-compatible PCs. Experiments are written using any text editor and a relatively small set of ERTS commands. Millisecond timing is provided by a software timer with no additional hardware requirements. All displays are in high-resolution VGA graphics. The Creative Labs Soundblaster card is supported in 16-bit mode, but is not required for simple tone generation. Voice-key support is available via the Soundblaster card. Keyboard, mouse, and external keys may be used as reaction keys, and the mouse or a joystick may be used as a tracking device. The stimulus-centered design and powerful display control commands of ERTS make it appropriate for developing a wide range of trial-based experiments.     

The Observer Video-Pro: New software for the collection, management, and presentation of time-structured data from videotapes and digital media files

The Observer Video-Pro is a system for collecting, managing, analyzing, and presenting observational data. It integrates The Observer software with time code and multimedia hardware components. It extends the functionality of a conventional real-time event recording program in various ways. Observational data can be collected, reviewed, and edited with synchronized display of the corresponding video images. For optimal visual feedback during coding, one can display the video image in a window on the computer screen. Video playback from either a VCR or a digital media file can be controlled by the computer, allowing software-controlled jog, shuttle, and search functions. Besides a wide range of VCRs, The Observer Video-Pro supports all major digital video file formats. The software allows the user to summarize research findings in numerical, graphical, or multimedia format. One can create a time-event plot for a quick glance at the temporal structure of the observed process, or run specific analysis procedures and generate reports with statistics. An Event Summary function is available for exploratory and qualitative analysis. Video material can be summarized in a Video Play List, which allows on-screen summary presentations or the creation of highlight compilations on tape, CD, or other media. Video images can be captured and saved as disk files, for use as illustrations in documents, slides for presentations, and so forth. In this paper we describe the design and operation of the system, illustrated with a case study from research on Repetitive Strain Injury (RSI).     

Three-dimensional audio versus head-down traffic alert and collision avoidance system displays

The advantage of a head-up auditory display for situational awareness was evaluated in an experiment designed to measure and compare the acquisition time for capturing visual targets under two conditions: standard head-down Traffic Alert and Collision Avoidance System display and three-dimensional (3-D) audio Traffic Alert and Collision Avoidance System presentation. (The technology used for 3-D audio presentation allows a stereo headphone user to potentially localize a sound at any externalized position in 3-D auditory space). Ten commercial airline crews were tested under full-mission simulation conditions at the NASA-Ames Crew-Vehicle Systems Research Facility Advanced Concepts Flight Simulator. Scenario software generated targets corresponding to aircraft that activated a 3-D aural advisory (the head-up auditory condition) or a standard, visual-audio TCAS advisory (map display with monaural audio alert). Results showed a significant difference in target acquisition time between the two conditions, favoring the 3-D audio Traffic Alert and Collision Avoidance System condition by 500 ms.     

An IBM XT-compatible,computer-based,slide-projector laboratory

In the present paper, we describe the software and hardware of an on-line, visual-memory laboratory running under Turbo Pascal on an IBM PC XT-compatible computer. The display system includes one Kodak random access projector and four standard Kodak carousel projectors, all equipped with tachistoscopic shutters and luminance-control devices. The response system consists of eight 16-key response boxes. The laboratory can be used for any experiment in which 35-mm slides are to be used as stimuli, and in which precise display times, stimulus luminances, and reaction times are required. The laboratory is particularly well suited to picture-perception and picture-memory experiments.     

Introduction

A series of eight papers is introduced on methods of using a computer system as a tachistoscope. Comparisons are based on the type of display and the type of software.     

Eye movement contingent display control in studying reading

A computer system has been developed that permits experimental control over a CRT display contingent upon characteristics of the viewer’s eye movements. The display can be changed during specific saccadic eye movements or fixations. Uses of such a system for studying reading are described. The paper reviews hardware and software considerations in developing such a system.     

Tachistoscopic software for the Hercules display controller

The functions necessary for a high-quality microcomputer emulation of a tachistoscope are summarized. A software package containing an extensive set of tachistoscope-emulation functions for IBM PC-type computers is described. This software gives computers equipped with the Hercules monochrome/graphics display controller the ability to produce fast tachistoscopic presentations of text material.     

An experimental analysis of decision channeling by restrictive information display

This study focuses on the effect of restrictive information display on decision performance. Specifically the study examines whether two‐channeled and one non‐channeled computerized information display systems result in significant differences in decision accuracy. The two‐channeled information display systems are designed to encourage two general information processing patterns commonly observed in the experimental literature examining multi‐alternative, multi‐attribute choice decisions: information processing by alternative and information processing by attribute. An information display program was developed which used restrictive information display to operationalize the channeled versus non‐channeled manipulation. Channeling was implemented either by displaying information only by alternative or by displaying information only by attribute. The task was an operations scheduling problem that subjects completed under three levels of time pressure. The results indicate statistically significant effects on decision accuracy for both the type of information display and time pressure manipulations. The highest decision accuracy was observed when information was displayed by alternative and when subjects were under highest levels of time pressure. Copyright © 2002 John Wiley & Sons, Ltd.     

Computer programming for generating visual stimuli

Critical to vision research is the generation of visual displays with precise control over stimulus metrics. Generating stimuli often requires adapting commercial software or developing specialized software for specific research applications. In order to facilitate this process, we give here an overview that allows nonexpert users to generate and customize stimuli for vision research. We first give a review of relevant hardware and software considerations, to allow the selection of display hardware, operating system, programming language, and graphics packages most appropriate for specific research applications. We then describe the framework of a generic computer program that can be adapted for use with a broad range of experimental applications. Stimuli are generated in the context of trial events, allowing the display of text messages, the monitoring of subject responses and reaction times, and the inclusion of contingency algorithms. This approach allows direct control and management of computer-generated visual stimuli while utilizing the full capabilities of modern hardware and software systems. The flowchart and source code for the stimulus-generating program may be downloaded from www.psychonomic.org/archive.     

VRVision: A new tool for the display of 3-D images in behavioral research

Researchers using three-dimensional (3-D) scenes in their studies often spend a lot of time prerendering the scenes into a set of images for later presentations. To improve efficiency, we have developed a new plugin program for MATLAB that eliminates this step. The program is able to manipulate and present 3-D scenes in real time. It allows fine control over numerous parameters, including the mode of projection, angular rotation, lighting, surface photo textures, and animation. Images can be presented with monoscopic or stereoscopic display. It can also dynamically track viewer position and update and display an appropriate 3-D projection. The program is fully compatible with existing MATLAB utilities such as the Psychophysics Toolbox (psychtoolbox.org). It is made freely available to the research community (www.hive.hull .ac.uk/software/vrvision).     

An introduction to the PLATO CAI system

The PLATO interactive computer system is discussed as a fully developed large-scale CAI system. Both the hardware and software aspects of the system are discussed. The discussion of hardware includes the necessary equipment to operate a PLATO system and the flow of control during an interactive session on that system. The discussion of the software on the PLATO system focuses on the TUTOR lesson-authoring language. The aspects of the TUTOR language that facilitate display of material, student input and judging of input, and either student-initiated or author-initiated branching in the program are discussed.     

A visual display system for reading and visual perception research

The selection of a computer visual display system suitable for word recognition and reading research is described. The software character generation routines permit flexible definition of character sets. The display software permits control of size scaling and point density of characters being displayed as well as control over the temporal microstructure of presenting and refreshing the displayed text.