Problems with evaluation of courseware for instruction in psychology

Recent trends in courseware evaluation have stressed the importance of program characteristics ancillary to the learning process, such as the use of menus. Although attention to these aspects of programming may improve the appearance and ease of use of software, the primary consideration in the selection of instructional software is whether it can provide instructional content to the students who use it. This can best be determined by the instructor alone, who may often find it necessary to write programs to suit specific instructional needs. Such programs are in wide use and are often better than commercially available sets designed by professionals.     

Integrating a computer component into the student psychology laboratory: Problems and prospects

This paper presents some commonly occurring problems associated with integrating a computer component into student psychology laboratories. Implementation of a computer component requires consideration of differences among students, objectives and teaching style of the instructor, course level and content, and courseware to be used. These factors are examined with respect to how they can affect the success of an attempt to use computers in the instructional laboratory.     

A model for courseware development in psychology

Many behavioral scientists are aware of the advantages of a systematic approach to research and the development of software used in research. However, coordinated and systematic efforts to develop instructional materials in the behavioral sciences are relatively rare. This paper and the symposium of which it is a part describe a systematic effort funded by FIPSE to assess the needs for microcomputer tools and courseware in the undergraduate curriculum in psychology and to stimulate the development of high-quality materials. The conceptual bases for development of materials are vertical and horizontal integration-the development of courseware that spans the curriculum from introductory to advanced, specialized, courses, and the systematic use of materials within a course and across courses and subject areas. The activities of the project, as well as implications for other computer-based development projects, are discussed.     

PC-Based Game Features That Influence Instruction and Learner Motivation

PC-based games are currently being used for military training, but the instructional and motivational features of such technology are not well understood. To identify features of training games that influence instruction and motivation, a popular first-person-perspective game with a military theme was analyzed empirically. Twenty-one participants played the “basic training” portion of the game, which included Army background information, virtual marksmanship training, an obstacle course, virtual weapons familiarization, and an urban terrain training mission. The results of this research provide useful information to individuals developing training games, desktop simulations, and interactive multimedia courseware to meet optimal training objectives and strategies.     

Overview and examples of instructional modules

The fundamental instructional design concepts underlying the systematic development of new computer-based courseware are defined and illustrated. The advantages of the electronic chalkboard and electronic studyguide are discussed.     

Effects of teaching an introductory psychology laboratory using a computerized research tool

In the introductory psychology laboratory at Drexel University, we employ courseware modules that transform the computer into various pieces of psychological research equipment. Students enrolled in this course use the courseware modules in a series of experiments that investigate motor learning, perception, memory, and other psychological phenomena. In choosing this form of computerization, we have encountered challenges to our methods of instruction, both in the laboratory and in the lecture hall. Opportunities, in the form of financial and programming assistance, have also resulted from our computerization efforts.     

Survey on present and potential instructional use of computers in psychology

A survey of academic psychologists was taken to determine present use of computers in instruction, willingness to use good education software, and kinds of potential uses of computers in psychology courses. A majority of the respondents reported using computers in instruction. Respondents indicated substantial willingness to adopt computer-based courseware. Respondents believed that a variety of uses, including classroom demonstrations and student experiments, would facilitate student learning. The results of the survey are compared with the instructional modules the task force is developing.     

FIELD REPLICATION OF CLASSWIDE PEER TUTORING

We conducted a large-scale field replication study of classwide peer tutoring applied to spelling instruction (Greenwood, Delquadri, & Hall, 1984). Two hundred and eleven inner-city students in four schools participated during their first- and second-grade school years. The effects of classwide peer tutoring were compared to teacher instructional procedures and pretest probes using a group replication design (Barlow, Hayes, & Nelson, 1984). Analysis of group and individual results indicated that (a) both teacher instructional procedures and classwide peer tutoring were effective in increasing spelling performance above pretest levels, (b) peer tutoring produced statistically greater gains relative to the teachers' procedures for both low and high student groups formed on pretest levels, (c) these outcomes were representative of groups, classes, individuals, and years during the project, and (d) participant satisfaction with the program was generally high. A separate analysis of the social importance of treatment outcome revealed differential findings for low and high groups related to pretest levels. Implications of these findings are discussed.     

SHORT- AND LONG-TERM EFFECTS OF CONTINGENCY MANAGED INSTRUCTION ON LOW,MEDIUM, AND HIGH GPA STUDENTS1

Undergraduate students had been assigned to a contingency managed course or a conventional lecture course (Du Nann and Fernald, Journal of Applied Behavior Analysis, 1976, 9 , 373–374). Two years later, some 35% (N = 86) of the original classes responded to a letter offering them $2.00 to participate in a study of their educational experiences. These students completed a multiple-choice test on material from the course, and answered questions about activities and attitudes that might have been affected by the experience in Introductory Psychology. In the contingency management course 2 yr past, students were tested each week on a chapter of textbook material with 10-item multiple-choice quizzes. The course employed a modified “Doomsday Contingency”, requiring each student to achieve 80% mastery on one of the four weekly quizzes or drop the course. Quizzes were given in small groups and scored individually, while the student stood near, by an undergraduate proctor assigned to that group. The proctor was asked to show interest in the students' quiz performances, help clear up difficult areas, and develop a friendly working relationship with each student. While many students passed the quiz on the first attempt, others were given individual tutoring, so that no one was in fact forced to drop the course. In addition to the weekly quiz assignment, students in the contingency managed group were asked to attend one lecture each week. While the contingency management course procedures had much in common with PSI (Keller, Journal of Applied Behavior Analysis, 1968, 1 , 79–89), several departures made them unique. First, self-pacing was curtailed because students were required to master one unit per week or drop the course. Second, proctors met with students in small groups, usually giving individual tutoring only to those students who did not pass the quiz on the first attempt. Finally, students were asked to attend one lecture per week. Students in the conventional lecture group were not asked to pass weekly quizzes, but instead attended three 50-min lectures each week. Two of these lectures followed the textbook material closely, while the third, which was also attended by students from the contingency management course, covered material only indirectly related to the text. This partition of lecture content allowed material to be similar across the two instructional groups. Although students in the lecture condition were told they could obtain copies of the quizzes, few of them did so. Course grades were determined by scores on two 45-item multiple-choice hourly exams, each covering half the semester material (each worth 25%), and by a 90-item final exam, which served as a measure of short-term retention. Before analyzing the follow-up data, several characteristics of the returning students were compared to determine the comparability of the sample from the two original classes. Most important, both attrition and the current mean GPAs of students from the two classes were very similar. These considerations, and others, suggested there was no systematic sampling bias to confound comparisons of student performance. A 2 (contingency management versus traditional lecture) by 3 (high, medium, and low GPA) analysis of variance was computed on the course final-exam scores and the follow-up measures. Instructional procedure and GPA interacted on the final exam such that low and medium GPA students performed significantly better under contingency management, but there was no significant effect of instructional procedure with high GPA students. On the 2-yr retention measures, students from the contingency management course performed significantly (p < 0.01) better on items drawn from quizzes used in their original course, and marginally better (p < 0.10) on items drawn from the final exams, but no interactions with GPA appeared. Furthermore, instructional method produced no significant main effects or interaction with how many students became majors or minors in psychology, how many psychology courses were later taken, how many books in psychology were reported to have been read, or on students' evaluation of the interest and importance of psychology.     

Use of Brief Instructional Trials to Identify Small Group Reading Strategies: A Two Experiment Study

The Instructional Hierarchy (IH) has proven useful for understanding the functional properties of empirically valid instructional strategies. Investigators have relied heavily on the IH as a heuristic in conceptualizing instructional components used in brief experimental analyses. To date, only one investigation has applied brief experimental analysis results to small group reading interventions. The purpose of this paper is to describe two studies which used single session instructional trials to identify interventions that were subsequently applied to small group reading instruction. In both studies, individualized instructional trials that probed for skill and performance deficits were carried out and results suggested that all students benefited from the instructional intervention. Next, the intervention was implemented in a small group format. In Experiment 2, however, validation of the instructional package was carried out by the classroom teacher who delivered the instructional package to the small group. In both cases, extended experimental analyses suggested that the intervention was effective at improving all participants’ generalized reading fluency. Results of both studies are discussed in terms of how future studies can refine procedures for validating instructional and motivational components before classroom applications.     

The knowledge-learning-instruction framework: bridging the science-practice chasm to enhance robust student learning

Despite the accumulation of substantial cognitive science research relevant to education, there remains confusion and controversy in the application of research to educational practice. In support of a more systematic approach, we describe the Knowledge-Learning-Instruction (KLI) framework. KLI promotes the emergence of instructional principles of high potential for generality, while explicitly identifying constraints of and opportunities for detailed analysis of the knowledge students may acquire in courses. Drawing on research across domains of science, math, and language learning, we illustrate the analyses of knowledge, learning, and instructional events that the KLI framework affords. We present a set of three coordinated taxonomies of knowledge, learning, and instruction. For example, we identify three broad classes of learning events (LEs): (a) memory and fluency processes, (b) induction and refinement processes, and (c) understanding and sense-making processes, and we show how these can lead to different knowledge changes and constraints on optimal instructional choices.     

Modeling the Instructional Effectiveness of Responsible Conduct of Research Education: A Meta-Analytic Path-Analysis

Predictive modeling in education draws on data from past courses to forecast the effectiveness of future courses. The present effort sought to identify such a model of instructional effectiveness in scientific ethics. Drawing on data from 235 courses in the responsible conduct of research (RCR), structural equation modeling techniques were used to test a predictive model of RCR course effectiveness. Fit statistics indicated the model fit the data well, with the instructional characteristics included in the model explaining approximately 85% of the variance in RCR instructional effectiveness. Implications for using the model to develop and improve future RCR courses are discussed.     

The triad of science foundations, instructional technology, and organizational structure

Over the centuries and across all societies educational achievement does not improve. The attempt to improve the instructional process has concentrated on instructional technology. But these attempts have overlooked the importance of two other factors: the science that should underlie the instructional technologies and the organization that must operate those technologies. A considerable step forward in handling the problems of instructional effectiveness has been the derivation of instructional technologies based on Skinnerian science. But the instructional technologies based on Skinner's analysis of behavior are promoted as if they were to operate in an organizational vacuum. The division of labor, and its necessary coordination and control, is taken for granted. But in any large scale enterprise, the organization of the division of labor must fit the technology through which that enterprise achieves its mission. Educational technology must tie directly to a pertinent science and to a proper organizational structure. To teach effectively requires an overhaul along three lines: 1) a relevant science that reflects and encapsulates an accurate understanding of behavior; 2) a contingency-based technology of instruction that directly derives its practices upon proper scientific principles; and 3) a suitable organization based on teaching teams that operate the new instructional technology.     

Secrets to Creating Effective and Interesting Educational Experiences: Tips and Suggestions for Clinical Educators

Genetic Counselors (GCs) spend years learning about genetics and practicing counseling techniques in classroom environments. From the learner perspective, teaching may seem straightforward: provide appropriate information, develop tests or assignments and submit grades. When asked to teach for the first time, however, clinicians suddenly realize that there is a lot more to education than standing in front of a class and talking. This article introduces clinical educators to strategies and learning principles that help make the teaching/learning process more interesting and successful for faculty and students alike. The instructional concepts presented here are useful across the entire spectrum of learning situations; a 1 hour discussion with a lay audience, a 3 hour workshop at a professional meeting, a 15 week graduate course, or a series of courses culminating in an advanced degree. The article offers suggestions for writing course competencies, selecting instructional approaches, embedding learning engagement options, leveling course content and choosing evaluation strategies.     

Navy Self-Paced Computer-Based Courses: Practical Implications of Saving Time Under Instruction (UI)

Previous research has shown that converting courses to computerized self-paced format usually decreases average time under instruction (UI). This study addressed three different Navy A-School course conversions, with a total of 4,417 students over 3 years. Converting courses to computerized self-paced format decreased UI by 12–42%, resulting in significant cost savings. These savings persisted, even when considering a decreased graduation rate in one class and increased time awaiting transfer (AT) in others. However, some aspects of instructional management became more difficult because of the increased dispersion of students' UI times. These findings have implications for instructional design.     

Instructional Patterns in Science An Exploratory Study

This article describes a re-analysis of a national study of instructional practices in seventh- and eighth-grade science classes. Responses from a subset (n = 81) of Christian-school teachers taken from the original study population (n = 543) was analyzed to determine what instructional practices predominated in Christian-school science classes. Results indicate the use of a variety of both teacher- and student-centered instructional approaches by science teachers in Christian schools.     

Computer-based interactive video systems

Computer-controlled interactive video instruction provides an instructional technique that overcomes many of the shortcomings of using the computer alone as an instructional device. Students who have used interactive video modules have been shown to better retain the material presented and to enjoy the course more than students not using the video modules.     

Refining the experimental analysis of academic skills deficits: Part I. An investigation of variables that affect generalized oral reading performance

Experimental analyses for improving reading fluency deficits have rarely targeted generalized increases in academic responding. As a consequence, the variables that may help students to generalize newly learned forms of academic responding like reading are not well understood. Furthermore, experimental analyses of reading fluency interventions have not systematically examined difficulty level as a variable that may affect instructional outcomes. The experiment reported in this paper expands (a) the measurement of the dependent variables to include generalized increases across tasks (reading passages) and (b) the combination of independent variables used to produce measurable generalized increases. The results demonstrate the importance of combining reward and instructional variables (including difficulty level) to produce generalized increases and how those variables can be meaningfully investigated prior to making treatment recommendations.     

The Social Construction of Copyright Ethics and Values

This study is based on analysis of copyright policies and 26 interviews with science and engineering faculty at three research universities on the topic of copyright beliefs, values, and practices, with emphasis on copyright of instructional materials, courseware, tools, and texts. Given that research universities now emphasize increasing external revenue flows through marketing of intellectual property, we expected copyright to follow the path of patents and lead to institutional emphasis of policies and practices that enhanced universities’ intellectual property portfolios, accompanied by an increase in copyrighting by professors. Although this pattern occurred with regard to institutions, professors offered a more varied pattern, with some fully participating in commercialization of copyright and embracing entrepreneurial values, while others resisted or subverted commercial activity in favor of traditional science and engineering values.