Drawing is Integrating: An Examination of Students’ Graphic Representations of Multiple Texts

In this study, integration, or students’ connection formation across texts, was examined across two tasks: when undergraduates were asked to complete a writing assignment and a novel, diagram construction task. While the writing assignment asked students to compose an argument based on multiple texts, the diagram construction task asked students to visually represent a set of eight conflicting texts and the relations among them. The Documents Model Framework (DM) was used to code undergraduates’ written responses and diagrams for the type of multiple text representations they featured (i.e., mush models, separate representations models, and documents models of multiple texts). Moreover, written responses and diagrams were coded for the specificity at which they integrated texts, corresponding to the formation of evidentiary, thematic, and contextual relations. Limited associations were found between college students’ written responses and the diagrams constructed. Implications for understanding multiple text integration are discussed.     

The use of diagrams in analogical problem solving

In four experiments, we examined the impact of perceptual properties on the effectiveness of diagrams in analogical problem solving, using variants of convergence diagrams as source analogues for the radiation problem. Static diagrams representing the initial problematic state (one large line directed at a target) and the final state for a convergence solution (multiple converging lines) were not accessed spontaneously but were often used successfully once a hint to consider the diagram had been provided. The inaccessibility of static diagrams was not alleviated by adding additional diagrams to represent intermediate states (Experiment 1), but spontaneous access was improved by augmenting static diagrams with a verbal statement of the convergence principle (Experiment 3). Spontaneous retrieval and noticing were increased markedly by animating displays representing converging forces and thereby encouraging encoding of the lines as indicating motion toward a target (Experiments 3 and 4). However, neither static nor animated diagrams were effective when the arrows were reversed to imply divergence rather than convergence (Experiment 2). The results indicate that when animation encourages the interpretation of a diagram as a helpful source analogue, it can greatly enhance analogical transfer.     

The effect of layout and pacing on learning from diagrams with unnecessary text

Although the presentation of extraneous (i.e., irrelevant or unnecessary) information hinders learning, it is unclear whether and how layout and pacing influence this effect. In two experiments, participants learned how the heart functions using four different layouts: a diagram presented without unnecessary text (diagram only), with unnecessary text separated from the diagram (separated) or integrated into the diagram (integrated), or with separated unnecessary text and the instruction to integrate (integration instruction). In Experiment 1, study time was self‐paced for half of the participants and system paced for the other half. There were no effects of layout and of pacing on learning, although system pacing was more effortful than self‐pacing. In Experiment 2, which was system paced and employed eye tracking, the integrated condition showed worse learning outcomes than the separated condition. Moreover, in the integrated condition, participants made more integration attempts between the unnecessary text and the diagram than in the separated condition.     

Can students evaluate their understanding of cause-and-effect relations? The effects of diagram completion on monitoring accuracy

For effective self-regulated study of expository texts, it is crucial that learners can accurately monitor their understanding of cause-and-effect relations. This study aimed to improve adolescents' monitoring accuracy using a diagram completion task. Participants read six texts, predicted performance, selected texts for restudy, and were tested for comprehension. Three groups were compared, in which learners either completed causal diagrams immediately after reading, completed them after a delay, or received no-diagram control instructions. Accuracy of predictions of performance was highest for learning of causal relations following delayed diagram completion. Completing delayed diagrams focused learners specifically on their learning of causal relations, so this task did not improve monitoring of learning of factual information. When selecting texts for restudy, the participants followed their predictions of performance to the same degree, regardless of monitoring accuracy. Fine-grained analyses also showed that, when completing delayed diagrams, learners based judgments on diagnostic cues that indicated actual understanding of connections between events in the text. Most important, delayed diagram completion can improve adolescents' ability to monitor their learning of cause-and-effect relations.     

Diagrams increase the recall of nondepicted text when understanding is also increased

Multimedia presentations typically produce better memory and understanding than do single-medium presentations. Little research, however, has considered the effect of multimedia on memory for nonmultimedia information within a large multimedia presentation (e.g., nondepicted text in a large text with diagrams). To this end, the present two experiments compared memory for target text information that was either depicted in diagrams or not. Participants (n 5 180) studied either a text-only version of a text about lightning or a textwith-diagrams version in which half the target information was depicted in diagrams. Memory was tested with both free recall and cued recall questions. Overall, diagrams did not affect memory for the entire text; diagrams increased memory only for the information they depicted. Diagrams exerted a generalized effect on free recall only when diagrams increased the overall understanding of the text (i.e., when the participants studied the materials twice before the test).     

The effects of self‐explaining when learning with text or diagrams

Self‐explaining is an effective metacognitive strategy that can help learners develop deeper understanding of the material they study. This experiment explored if the format of material (i.e., text or diagrams) influences the self‐explanation effect. Twenty subjects were presented with information about the human circulatory system and prompted to self‐explain; 10 received this information in text and 10 in diagrams. Results showed that students given diagrams performed significantly better on post‐tests than students given text. Diagrams students also generated significantly more self‐explanations that text students. Furthermore, the benefits of self‐explaining were much greater in the diagrams condition. To discover why diagrams can promote the self‐explanation effect, results are interpreted with reference to the multiple differences in the semantic, cognitive and affective properties of the texts and diagrams studied.     

Procedural Multimedia Presentations: The Effects of Working Memory and Task Complexity on Instruction Time and Assembly Accuracy

Procedural text conveys information of a series of steps to be performed. This study examined the role of verbal and visuo‐spatial WM in comprehension and execution of assembly instructions, as a function of format (text, images, multimedia) and task complexity (three or five steps). One hundred and eight participants read and executed 27 instructions to assemble a LEGO^TM object, in single and dual task conditions. Study times and errors during assembly were measured. Participants processed faster pictorial and multimedia instructions than text instructions, and made fewer errors in the execution of multimedia instructions. Dual task affected more text or picture‐only, than multimedia presentation. A verbal secondary task caused more errors in text or picture‐only presentations, and spatial secondary task also caused interference in text‐only instructions. Overall, these results support the multimedia advantage, and the role of both verbal and visuo‐spatial WM, when understanding instructions. Copyright © 2016 John Wiley & Sons, Ltd.     

Influencesicture context on object recognition

The effect of sorrounding context on the recognition of objects from briefly presented pictures was investigated. Forty-eight undergraduates saw 100 msec displays of either line drawings containing several objects embedded in context or drawings of object arrays without background context. Following each exposure they were required to select from among four objects the one that had been contained in the picture. Presentation of objects in context aided recognition only when incorrect response alternatives were inconsistent with the picture context. The results suggest that context contributes to the construction of a general characterization of the pictures which provides expectancies regarding the identity of specific objects.     

An eye movement analysis of the spatial contiguity effect in multimedia learning

In three studies, eye movements of participants were recorded while they viewed a single-slide multimedia presentation about how car brakes work. Some of the participants saw an integrated presentation in which each segment of words was presented near its corresponding area of the diagram (integrated group, Experiments 1 and 3) or an integrated presentation that also included additional labels identifying each part (integrated-with-labels group, Experiment 2), whereas others saw a separated presentation in which the words were presented as a paragraph below the diagrams (separated group, Experiments 1 and 2) or as a legend below the diagrams (legend group, Experiment 3). On measures of cognitive processing during learning, the integrated groups made significantly more eye-movements from text to diagram and vice versa (integrative transitions; d = 1.65 in Experiment 1, d = 0.85 in Experiment 2, and d = 1.44 in Experiment 3) and significantly more eye-movements from the text to the corresponding part of the diagram (corresponding transitions; d = 2.02 in Experiment 1 and d = 1.35 in Experiment 3) than the separated groups. On measures of learning outcome the integrated groups significantly outperformed the separated groups on transfer test score in Experiment 1(d = .80) and Experiment 2 (d = .73) but not in Experiment 3 (d = .35). Spatial contiguity encourages more attempts to integrate words and pictures and enables more successful integration of words and pictures during learning, which can result in meaningful learning outcomes.     

Adoption of an internal viewpoint following presentations of plan‐view diagrams and maps

This study investigated people's ability to adopt novel imagined viewpoints after studying plan‐view diagrams and maps. In two experiments, university students were presented with a plan‐view diagram of a character surrounded by nearby objects (Expt 1) or a character within a map of a multi‐level shopping centre (Expt 2). Subsequently, participants' spatial knowledge of the diagrams/maps was tested by asking them about the location of six salient objects/places. In both experiments, the analyses of participants' spatial judgments suggested that they had adopted an imagined viewpoint internal to the character. The findings add to our understanding of imagined viewpoint switches along the vertical axis of space.     

多媒体环境下图文的具体程度对学习效果的影响

让70名小学生在多媒体环境中学习概念材料与原理材料,以探讨文本和图画材料的具体程度对学习迁移效果的影响。结果表明,在概念材料上,文本与图画的具体性程度之间存在显著的交互作用,即在具体图水平上,具体文的迁移成绩显著高于抽象文;在抽象图水平上,具体文的迁移成绩低于抽象文,但没有达到显著性水平。在原理材料上,文本与图画的具体性程度之间也存在显著的交互作用,但交互作用的方式与概念材料相反,即在具体图水平上,具体文的迁移成绩显著低于抽象文;在抽象图水平上,具体文的迁移成绩高于抽象文,但没有达到显著水平。     

Metacomprehension judgements reflect the belief that diagrams improve learning from text

In two experiments we systematically explored whether people consider the format of text materials when judging their text learning, and whether doing so might inappropriately bias their judgements. Participants studied either text with diagrams (multimedia) or text alone and made both per-paragraph judgements and global judgements of their text learning. In Experiment 1 they judged their learning to be better for text with diagrams than for text alone. In that study, however, test performance was greater for multimedia, so the judgements may reflect either a belief in the power of multimedia or on-line processing. Experiment 2 replicated this finding and also included a third group that read texts with pictures that did not improve text performance. Judgements made by this group were just as high as those made by participants who received the effective multimedia format. These results confirm the hypothesis that people's metacomprehension judgements can be influenced by their beliefs about text format. Over-reliance on this multimedia heuristic, however, might reduce judgement accuracy in situations where it is invalid.     

Abstract Planning and Perceptual Chunks: Elements of Expertise in Geometry

We present a new model of skilled performance in geometry proof problem solving called the Diagram Configuration model (DC). While previous models plan proofs in a step-by-step fashion, we observed that experts plan at a more abstract level: They focus on the key steps and skip the less important ones. DC models this abstract planning behavior by parsing geometry problem diagrams into perceptual chunks, called diagram configurations, which cue relevant schematic knowledge. We provide verbal protocol evidence that DC's schemas correspond with the step-skipping inferences experts make in their initial planning. We compare DC with other models of geometry expertise and then, in the final section, we discuss more general implications of our research. DC's reasoning has important similarities with Larkin's (1988) display-based reasoning approach and Johnson-Laird's (1983) mental model approach. DC's perceptually based schemas are a step towards a unified explanation of (1) experts' superior problem-solving effectiveness, (2) experts' superior problem-state memory, and (3) experts' ability, in certain domains, to solve relatively simple problems by pure forward inferencing. We also argue that the particular and efficient knowledge organization of DC challenges current theories of skill acquisition as it presents an end-state of learning that is difficult to explain within such theories. Finally, we discuss the implications of DC for geometry instruction.     

Visual working memory for line orientations and face identities

Previous studies have shown that the number of objects we can actively hold in visual working memory is smaller for more complex objects. However, complex objects are not just more complex but are often more similar to other complex objects used as test probes. To separate effects of complexity from effects of similarity, we measured visual memory following a 1-sec delay for complex and simple objects at several levels of memory-to-test similarity. When memory load was one object, memory accuracy for a face (a complex attribute) was similar to a line orientation (a simple attribute) when the face changed in steps of 10% along a morphing continuum and the line changed in steps of 5° in orientation. Performance declined with increasing memory load and increasing memory-to-test similarity. Remarkably, when memory load was three or four objects, face memory was better than orientation memory at similar changed steps. These results held when memory for line orientations was compared with that for inverted faces. We conclude that complex objects do not always exhaust visual memory more quickly than simple objects do.     

When auditory presentations should and should not be a component of multimedia instruction

Based on cognitive load theory, two experiments investigated the conditions under which audiovisual‐based instruction may be an effective or an ineffective instructional technique. Results from Experiment 1 indicated that visual with audio presentations were superior to equivalent visual‐only presentations. In this experiment, neither the auditory nor the visual material could be understood in isolation. Both sources of information were interrelated and were essential to render the material intelligible. In contrast, Experiment 2 demonstrated that a non‐essential explanatory text, presented aurally with similar written text contained in a diagram, hindered learning. This result was obtained because when compared to a diagram only format, the aural material was unnecessary and therefore created a redundancy effect. Differences between groups were stronger when information was high in complexity. It was concluded that the effectiveness of multimedia instruction depends very much on how and when auditory information is used. Copyright © 2003 John Wiley & Sons, Ltd.     

Visual working memory capacity for objects from different categories: a face-specific maintenance effect

The capacity of visual working memory was examined when complex objects from different categories were remembered. Previous studies have not examined how visual similarity affects object memory, though it has long been known that similar-sounding phonological information interferes with rehearsal in auditory working memory. Here, experiments required memory for two or four objects. Memory capacity was compared between remembering four objects from a single object category to remembering four objects from two different categories. Two-category sets led to increased memory capacity only when upright faces were included. Capacity for face-only sets never exceeded their nonface counterparts, and the advantage for two-category sets when faces were one of the categories disappeared when inverted faces were used. These results suggest that two-category sets which include faces are advantaged in working memory but that faces alone do not lead to a memory capacity advantage.     

ANTECEDENT CONTROL OF ORAL READING ERRORS AND SELF-CORRECTIONS BY MENTALLY RETARDED CHILDREN

Academic behaviors can be enhanced through the manipulation of either consequent or antecedent stimuli. In this study, we evaluated the effects of manipulating two antecedent stimulus events with respect to oral reading errors and self-corrections of four mentally retarded children. Using an alternating treatments design, the effects of previewing the target text and previewing an unrelated text were evaluated against no-previewing. In the first previewing condition, the teacher discussed the target text with the children before they were required to read it orally. The same procedure was used in the other previewing condition but with the provision that an unrelated text was previewed. Oral reading errors decreased and self-corrections increased when the children previewed the target text with their teacher before reading it orally. No changes were observed as a result of implementing the other two procedures, previewing an unrelated text and no-previewing. The results, which were consistent across all four children, showed that reading proficiency can be increased by manipulating antecedent stimulus events prior to oral reading.     

Behaviour and gaze analyses during a goal-directed locomotor task

The objectives of the current study were: (a) to determine whether perception-action coupling controlled behaviours when walking through moving doors and (b) to determine how vision contributed to this behaviour. Participants (N = 6) walked along a 7-m path toward two motor-driven doors, which moved at rates ranging between 20 and 40 cm/s. Each door was independently driven such that both moved at the same velocity (symmetrical) or at different velocities (asymmetrical). The results showed that in both door movement conditions the participants controlled their approach velocity by slowing down prior to crossing the doors. The decrease in walking velocity produced greater velocity variability in the final stages prior to crossing the doors and high success rates. The results from the gaze behaviours showed that fixation durations were significantly longer when the doors moved asymmetrically, suggesting that the visual information from this unpredictable environment took longer to process. However, the fixation patterns were similar between the two door movement conditions. Regardless of the door movement condition, the participants spent about 60% of each trial fixating environmental objects (i.e., left door, right door, or aperture). The majority of fixations were directed towards one of the doors at the beginning of the trial and then shifted towards the aperture in the final phase. The participants were using perception-action coupling to control their behaviours in the final phase in order to steer locomotion through the aperture.