Collaborative dialogue patterns in naturalistic one-to-one tutoring

Naturalistic one-to-one tutoring is more effective than traditional classroom teaching methods, but there have been few attempts to examine the features of normal tutoring that might explain its advantage. This project explored dialogue patterns in two samples of naturalistic tutoring with normal unskilled tutors (as opposed to expert tutors): graduate students tutoring undergraduates in research methods and high school students tutoring 7th graders in algebra. We analysed the extent to which those tutoring protocols manifested components that have been emphasized in contemporary pedagogical theories and intelligent tutoring systems: active student learning, sophisticated pedagogical strategies, specific examples and cases, collaborative problem solving and question answering, deep explanatory reasoning, convergance toward shared meanings, feedback, error diagnosis and remediation, and affect. The most prominent components consisted of collaborative problem solving, question answering, and explanation in the context of specific examples. We identify frequent dialogue patterns that characterize these collaborative processes.     

Tutoring Techniques in Algebra

Although one-to-one tutoring has been regarded as the most effective method of teaching (Bloom, 1984), surprisingly little is understood about tutoring expertise. Much educational research focuses on classroom teaching, whereas the few studies that focus on one-to-one tutoring do not offer a precise information-processing account of this skill. This article describes our initial attempts to study one-to-one tutoring. The goal of our research is to construct a detailed cognitive model of the reasoning and knowledge of an expert human tutor. The method we have employed is a variant of knowledge engineering. We videotaped tutoring sessions with expert teachers, subjecting them to a detailed analysis aimed at abstracting the tutor's knowledge structures. In this article, we describe some important tutoring techniques we have isolated using these methods. We discuss several dimensions along which tutors appear to be intelligent planners and problem solvers. Finally, we note several implications of our research, including its potential impact on the construction of intelligent computer-based tutoring systems.     

The Impact of Goal Specificity on Strategy Use and the Acquisition of Problem Structure

Theories of skill acquisition have made radically different predictions about the role of general problem-solving methods in acquiring rules that promote effective transfer to new problems. Under one view, methods that focus on reaching specific goals, such as means-ends analysis, are assumed to provide the basis for efficient knowledge compilation (Anderson, 1987), whereas under an alternative view such methods are believed to disrupt rule induction (Sweller, 1988). We suggest that the role of general methods in learning varies with both the specificity of the problem solver's goal and the systematicity of the strategies used for testing hypotheses about rules. In the absence of a specific goal people are more likely to use a rule-induction learning strategy, whereas provision of a specific goal fosters use of difference reduction, which tends to be a non-rule-induction strategy. We performed two experiments to investigate the impact of goal specificity and systematicity of rule-induction strategies in learning and transfer within a complex dynamic system. The results of Experiment 1 indicated that during free exploration of a problem space, greater learning occurred if participants adopted more systematic strategies for rule induction, and that participants come to favor such strategies. Experiment 2 revealed that participants who were provided with a specific goal performed well on the initial problem but were impaired on a transfer test using a similar problem with a different goal. Instruction on a systematic rule-induction strategy facilitated solution for both the initial and transfer problems, but participants' use of this strategy declined if they had a specific goal. Our results support Sweller's (1988) proposal that general problemsolving methods applied to a specific goal foster acquisition of knowledge about an isolated solution path but do not provide an effective way of learning the overall structure of a problem space. We interpret these results in terms of dualspace theories of search through problem space.     

The impact of politeness and relationship on perceived quality of advice about a problem

Advice is a common but potentially problematic way to respond to someone who is distressed. Politeness theory (Brown & Levinson, 1987) suggests advice threatens a hearer's face and predicts that the speaker‐hearer relationship and the use of politeness strategies can mitigate face threat and enhance the effectiveness of advice messages. Students (N=384) read 1 of 16 hypothetical situations that varied in speaker power and closeness of the speaker‐hearer relationship. Students then read 1 of 48 advice messages representing different politeness strategies and rated the message for regard shown for face and for effectiveness. However, neither speaker‐hearer relationship nor politeness strategies was consistently associated with perceived threat to face or perceived advice effectiveness. We suggest revisions to politeness theory and additional factors that may affect judgments of face sensitivity and advice effectiveness.     

AN INVESTIGATION OF COMPLIANCE-GAINING AS POLITENESS

This study considers an alternative perspective on the compliance-gaining phenomenon, specifically the theory of politeness articulated by Brown and Levinson (1978). They posit that all interaction is characterized by concern over the other person's autonomy needs and his or her desire to be liked, manifested in message behavior that addresses these needs (i.e., politeness). Brown and Levinson's typology of politeness strategies was translated into 32 items to which 155 respondents indicated likelihood of use and perceived politeness. Respondents assessed the items while imagining themselves in one of eight hypothetical scenarios created to manipulate the three situational factors posited as significant by Brown and Levinson: relationship distance, relationship power, and the magnitude of the request. A factor analysis reduced the 32 tactics to four underlying factors, which in turn served as one variable set for a canonical correlation whose second variable set was the situational factors and the agent's gender. Results indicated that females and persons in close relationships use more polite tactics than males and persons in more distant relationships. Secondarily, results also indicated that persons with power use less politeness than less powerful persons.     

Being Polite and Keeping MUM: How Bad News is Communicated in Organizational Hierarchies1

There are many ways to communicate bad news. The MUM effect (Tesser & Rosen, 1975), which is keeping mum and not transmitting the bad news at all, is only one of many possible approaches. Using P. Brown and Levinson's (1987) politeness theory, an experimental study was conducted to address not whether bad news is being transmitted, but how bad news is being transmitted. The results show that most communicators tend to use politeness strategies when communicating bad news. Moreover, using politeness strategies to couch the message did not attenuate the informative value of the message. Focused contrasts revealed two strong interactions between gender and communication direction on strategy use. First, power differences more strongly predicted strategy use for men, whereas distance differences more strongly predicted strategy use for women. Second, men used most politeness strategies when the combined effect of power and distance was the highest (as the politeness theory would predict), but the trend was reversed for women. This finding suggests that politeness theory may not be an accurate model for describing female communicators.     

Studies of Diagnosis and Remediation with High School Algebra Students

Despite extensive discussion in the literature about the diagnosis and subsequent remediation of students' errors, few studies have compared the effects of different styles of error-based remediation. Swan (1983) found that a conflict approach (pointing out errors made by students and demonstrating their consequences) was more effective than simple reteaching, but Bunderson & Olsen (1983) found no difference between error-specific remediation and reteaching. More studies are needed in order to understand the factors which lead to successful remediation. The three studies discussed in this article compared error-specific or model-based remediation (MBR) with reteaching in algebra. MBR bases its remediation on the model inferred for an individual student before reteaching the correct procedure. Reteaching simply shows students the correct procedure without addressing specific errors. The results show that MBR and reteaching are both more effective than no tutoring; however, MBR is not clearly more effective than reteaching. The results are discussed in terms of stability of errors, their relevance to educational practice and to intelligent tutoring systems (ITS). Although the studies were carried out using human tutors, the results suggest that for the purpose of remediation in the algebra domain, when taught procedurally, “classical” computer-assisted instruction (CAI) would be as effective as an ITS.     

Learning to Graph Linear Functions: A Case Study of Conceptual Change

This case study shows how a student's strategies and associated conceptions emerged and changed over the course of a 6-session tutoring curriculum designed to develop conceptual knowledge of linear functions. Using microgenetic and sequential analyses, we identify the student's strategies and conceptions and describe how these changed. We show how the student did not erase his original conception or replace it with a conception supported by instruction, but instead refined his initial strategies and conceptions.     

Voices,Boxes, and Sources of Messages

Can adults be induced to use social rules distinguishing “self” and “other” to respond to the behaviors of technologies? In a 2×2×2 between-subjects laboratory experiment involving the use of multiple computers with voice output, 88 computer-literate college students used a computer for tutoring and a different computer for testing. The performance of the tutoring session was either praised or criticized (Manipulation 1) in the same voice as the tutoring session or a distinct voice (Manipulation 2) via the computer (box) that performed the tutoring or a distinct computer (box; Manipulation 3). Respondents were shown to use voices but not boxes to distinguish “self” from “other” behavior in applying the social rules “Performance evaluations from others are more accurate than are performance evaluations of self,”“Praise from others is friendlier than praise from self,” and “Criticism from self is friendlier than is criticism from others,” to evaluate the tutoring and evaluation session.     

Does the use of dolls facilitate children's memory of visits to the doctor?

Age differences in children's recall of salient experiences have frequently been documented, but these findings have routinely been based on studies in which verbal interviews have been employed. Because verbal interview protocols may underestimate the memory of young children, the purpose of this research was to compare the effectiveness of such an interview with two alternative protocols that involved the use of a doll. Using these contrasting protocols, 3-and 5-year-old children were asked to remember the details of a routine physical examination. Neither doll protocol facilitated 3-year-olds' recall of the features of the check-up. In contrast, 5-year-olds who were asked to demonstrate with a doll what happened in their examination showed enhanced recall. The inclusion of a doll had no effect on older or younger children's provision of elaborative detail about their visits to the doctor. Various measures of individual differences (e. g. temperament, language skill) predicted some aspects of the children's recall and elaboration. The findings are discussed in terms of the cognitive skills necessary for effective use of dolls in the assessment process, and are related to problems associated with interviewing young children who are involved in legal proceedings.     

Research Methods Tutor: Evaluation of a dialogue-based tutoring system in the classroom

Research Methods Tutor (RMT) is a dialogue-based intelligent tutoring system for use in conjunction with undergraduate psychology research methods courses. RMT includes five topics that correspond to the curriculum of introductory research methods courses: ethics, variables, reliability, validity, and experimental design. We evaluated the effectiveness of the RMT system in the classroom using a nonequivalent control group design. Students in three classes (n = 83) used RMT, and students in two classes (n = 53) did not use RMT. Results indicated that the use of RMT yielded strong learning gains of 0.75 standard deviations above classroom instruction alone. Further, the dialogue-based tutoring condition of the system resulted in higher gains than did the textbook-style condition (CAI version) of the system. Future directions for RMT include the addition of new topics and tutoring elements.     

The Precalculus Concept Assessment: A Tool for Assessing Students’ Reasoning Abilities and Understandings

This article describes the development of the Precalculus Concept Assessment (PCA) instrument, a 25-item multiple-choice exam. The reasoning abilities and understandings central to precalculus and foundational for beginning calculus were identified and characterized in a series of research studies and are articulated in the PCA Taxonomy. These include a strong understanding of ideas of rate of change and function, a process view of function, and the ability to use covariational reasoning to examine and represent how two covarying quantities change together. This taxonomy guided the PCA development and now provides the theoretical basis for interpreting and reporting PCA results. A critical element of PCA's design was to identify the constructs essential for learning calculus and to employ methods to assure that PCA items are effective in assessing these constructs. We illustrate the role that cognitive research played during both the design and validation phases of the PCA instrument. We also describe our Four-Phase Instrument Development Framework that articulates the methods used to create and validate PCA. This framework should also be useful for others interested in developing similar instruments in other content areas. The uses of PCA are described and include (a) assessing student learning in college algebra and precalculus, (b) comparing the effectiveness of various curricular treatments, and (c) determining student readiness for calculus.     

Acquisition of Mental Multiplication Skill: Evidence for the Transition Between Counting and Retrieval Strategies

Strategies used by third and fourth graders to perform simple multiplication problems were examined. Children participated in an interview and then completed a timed production task in which they solved single-digit multiplication problems. Analyses of children's verbal reports and of solution latency data were found to support the view that the acquisition of mental multiplication begins with the use of counting strategies. By the fourth grade, however, there was a marked transition toward the use of a retrieval strategy. Children in both grade levels were found to apply rules to solve problems that involved multiplication by 1 or 0; however, not all students reported using these rules, and those students who did report the use of these rules were not consistent in the application of the rules. Comparisons between groups' and individual subjects' performance revealed that some important individual differences were obscured when the group served as the unit of analysis. Although several discrepancies were noted between the analyses of verbal reports and the analyses of chronometric data, correlations between the two methods were moderately high.     

Observing tutorial dialogues collaboratively: insights about human tutoring effectiveness from vicarious learning

The goals of this study are to evaluate a relatively novel learning environment, as well as to seek greater understanding of why human tutoring is so effective. This alternative learning environment consists of pairs of students collaboratively observing a videotape of another student being tutored. Comparing this collaboratively observing environment to four other instructional methods—one-on-one human tutoring, observing tutoring individually, collaborating without observing, and studying alone—the results showed that students learned to solve physics problems just as effectively from observing tutoring collaboratively as the tutees who were being tutored individually. We explain the effectiveness of this learning environment by postulating that such a situation encourages learners to become active and constructive observers through interactions with a peer. In essence, collaboratively observing combines the benefit of tutoring with the benefit of collaborating. The learning outcomes of the tutees and the collaborative observers, along with the tutoring dialogues, were used to further evaluate three hypotheses explaining why human tutoring is an effective learning method. Detailed analyses of the protocols at several grain sizes suggest that tutoring is effective when tutees are independently or jointly constructing knowledge: with the tutor, but not when the tutor independently conveys knowledge.     

Instruction and Practice in Learning to use a Device

We explore the extent to which Anderson's (1987) theory of knowledge compilation can account for the relationship between instructions and practice in learning to use a simple device. Bibby and Payne (1993) reported experimental support for knowledge compilation in this domain. This article replicates the finding of a performance cross-over between instruction type and task type that disappears with practice on the tasks. The research is extended by using verbal protocols to model the strategies of novice and more experienced individuals. Production system models of these strategies suggest that knowledge compilation only provides an adequate account of practice for one of two Instruction groups. To model the strategy shifts for the second group, we employ a “procedure modification heuristic” (after Neches, 1987), which relies on access to a declarative model of the configuration of the device. This suggests that instructionally derived declarative knowledge may have a subtle ongoing effect on the changes in procedural knowledge with practice.     

Verbalization of Decision Strategies in Multiple‐Cue Probabilistic Inference

In multiple‐cue probabilistic inference, people choose between alternatives based on several cues, each of which is differentially associated with an alternative's overall value. Various strategies have been proposed for probabilistic inference (e.g., weighted additive, tally, and take‐the‐best). These strategies differ in how many cue values they require to enact and in how they weight each cue. Do decision makers actually use any of these strategies? Ways to investigate this question include analyzing people's choices and the cues that they reveal. However, different strategies often predict the same decisions, and search behavior says nothing about whether or how people use the information that they acquire. In this research, we attempt to elucidate which strategies participants use in a multiple‐cue probabilistic inference task by examining verbal protocols, a high‐density source of process data. The promise of verbal data is in their utility for testing detailed information processing models. To that end, we apply protocol analysis in conjunction with computational simulations. We find converging evidence across outcome measures, search measures, and verbal reports that most participants use simplifying heuristics, namely take‐the‐best. Copyright © 2015 John Wiley & Sons, Ltd.     

Instructor and student knowledge of study strategies

Students' self-reported study skills and beliefs are often inconsistent with empirically supported (ES) study strategies. However, little is known regarding instructors' beliefs about study skills and if such beliefs differ from those of students. In the current study, we surveyed college students' and instructors' knowledge of study strategies and had both groups evaluate the efficacy of learning strategies described in six learning scenarios. Results from the survey indicated that students frequently reported engaging in methods of studying that were not optimal for learning. Instructors' responses to the survey indicated that they endorsed a number of effective study skills but also held several beliefs inconsistent with research in learning and memory (e.g., learning styles). Further, results from the learning scenarios measure indicated that instructors were moderately more likely than students to endorse ES learning strategies. Collectively, these data suggest that instructors exhibited better knowledge of effective study skills than students, although the difference was small. We discuss several notable findings and argue for the improvement of both students' and instructors' study skill knowledge.     

Children tell white lies to make others feel better

We investigated whether children tell white lies simply out of politeness or as a means to improve another person's mood. A first experimental phase probed children's individual insight to use white lies when prosocial behaviour was called for. We compared a situation in which a person had expressed sadness about her artwork and the goal was to make her feel better (Sad condition) with a situation in which a person was indifferent about her work (Neutral condition). Children at 7 years and older were more likely to tell a white lie than the blunt truth in the Sad over the Neutral condition. Five‐year‐olds showed only a trend. A second phase tested whether children selectively use white lie telling after it was modelled by an adult. Results showed that after modelling, children from all age groups were significantly more likely to use white lies in the Sad condition than in the Neutral condition. Taken together, these results show that children are attentive to another person's affective states when choosing whether to tell a white lie or tell the truth. We discuss the emergence of this behaviour in relation to children's developing social cognition and the increasing sophistication of children's prosocial behaviour.     

FIELD REPLICATION OF CLASSWIDE PEER TUTORING

We conducted a large-scale field replication study of classwide peer tutoring applied to spelling instruction (Greenwood, Delquadri, & Hall, 1984). Two hundred and eleven inner-city students in four schools participated during their first- and second-grade school years. The effects of classwide peer tutoring were compared to teacher instructional procedures and pretest probes using a group replication design (Barlow, Hayes, & Nelson, 1984). Analysis of group and individual results indicated that (a) both teacher instructional procedures and classwide peer tutoring were effective in increasing spelling performance above pretest levels, (b) peer tutoring produced statistically greater gains relative to the teachers' procedures for both low and high student groups formed on pretest levels, (c) these outcomes were representative of groups, classes, individuals, and years during the project, and (d) participant satisfaction with the program was generally high. A separate analysis of the social importance of treatment outcome revealed differential findings for low and high groups related to pretest levels. Implications of these findings are discussed.