Effectiveness of Positive Hypothesis Testing for Cooperative Groups

In a rule induction problem positive hypothesis tests select evidence that the tester expects to be an example of the correct rule if the hypothesis is correct, whereas negative hypothesis tests select evidence that the tester expects to be a nonexample if the hypothesis is correct. We extend previous analyses of the effectiveness of positive and negative tests for ambiguous verification or conclusive falsification of hypotheses by emphasizing the importance of examples following positive or negative tests. Cooperative four-person groups solved rule induction problems from a single known example of the correct rule by proposing hypotheses and selecting evidence on each of four arrays on a series of trials. There were more examples following positive tests than negative tests. The transition probability from an incorrect hypothesis on trialtto the correct hypothesis on trialt+ 1 was higher for positive tests than for negative tests, higher for positive tests followed by examples than positive tests followed by nonexamples, and higher for negative tests followed by examples than negative tests followed by nonexamples. Once the group proposed the correct hypothesis on trialtthey were highly likely to continue to propose the correct hypothesis on trialt+ 1.     

Positive and Negative Hypothesis Testing by Cooperative Groups

In a rule induction problem positive hypothesis tests select evidence that the tester expects to be an example of the correct rule if the hypothesis is correct, whereas negative hypothesis tests select evidence that the tester expects to be a nonexample if the hypothesis is correct. Previous research indicates the general effectiveness of a positive test strategy for individuals, but there has been very little research with cooperative groups. We extend the analysis of Klayman and Ha (Psychological Review, 1987) of ambiguous verification or conclusive falsification of five possible types of hypotheses by positive and negative tests by emphasizing the importance of further examples following hypothesis tests. In two experiments four-person cooperative groups solved rule induction problems by proposing a hypothesis and selecting evidence to test the hypothesis on each of four arrays on each trial. In different conditions the groups were instructed to use different combinations of positive and negative tests on the four arrays. Positive tests were more likely to lead to further examples than negative tests, and the proportion of correct hypotheses corresponded to the proportion of positive tests, in both experiments. We suggest that positive tests are more effective than negative hypothesis tests in generating further evidence, and thus in inducing the correct rule, in experimental rule induction tasks with a criterion of certainty imposed by the researcher.     

Inducing a Rule in Wason's 2-4-6 Task: A Test of the Information-Quantity and Goal-Complementarity Hypotheses

In the standard 2-4-6 induction task, subjects are instructed to discover the rule generating sequences of three numbers by inventing number triples for which they receive immediate feedback. The rule is “ascending numbers”. Performance is greatly aided with Dual Goal (DG) instructions that ask subjects to discover two rules, one that generates “Dax” triples (equivalent to “yes” instances with Single Goal [SG] instructions) and another that generates “Med” triples (equivalent to “no” instances). The present study eliminates two explanations for this effect suggested by Wharton, Cheng, and Wickens (1993). Experiment 1 tested their Information-Quantity hypothesis that the effect results simply from the DG subjects testing more triples prior to proposing a rule. Our DG subjects were more likely to solve the problem and produced more “negative” triples than SG subjects when both groups generated exactly 15 triples. Two further groups received feedback only after generating all 15 triples, and again DG subjects were more likely to solve the problem and to generate more “negative” triples. Experiment 2 tested Wharton et al.'s Goal-Complementarity hypothesis that success under DG instructions hinges on preserving the complementary representation of the two rules. We compared SG instructions with three types of DG instructions that suggested different types of triples (Dax, Med, both Dax and Med, neither Dax nor Med). DG instructions were more effective in promoting successful rule discovery regardless of differences in rule complementarity. Our analysis of the heterogeneity of the examplars generated with DG instructions in both experiments suggest that success on the 2-4-6 task is as much a consequence of the breadth of hypotheses that subjects entertain as it is a consequence of the testing strategy.     

The Role of Task Experience and Prior Knowledge for Detecting Invalid Augmented Feedback while Learning a Motor Skill

Two hypotheses were investigated. These were generated from results reported by Buekers, Magill, and Sneyers (1994) and an uncertainty account of those and other effects on skill learning of erroneous knowledge of results (KR). The first hypothesis proposes that if experienced performers have developed the capability of detecting and correcting errors, then they should not be influenced by erroneous KR in the same way as novices. The second proposes that if information about the invalid feedback is given to subjects prior to the beginning of the practice trials, then the capability for assessing feedback can be accelerated such that subjects who receive this advance information should not be misled by the erroneous KR. The first hypothesis was investigated in Experiment 1 by having subjects practise an anticipation timing task for 450 trials. One group received correct KR on all trials, and another group received no KR. Half of the subjects in each group were unexpectedly switched to erroneous KR after 400 trials. Results indicated that the erroneous KR influenced both groups during acquisition and on a retention test one minute later. However, on a retention test given one week later, only the group that had practised with no KR before being switched to erroneous KR continued to show the negative influence of the invalid KR. The second hypothesis was examined in Experiment 2 by telling subjects prior to beginning practice trials that it was possible that the KR they received would be erroneous. Results showed that this intervention strategy was effective on the no-KR retention tests only for subjects who had no-KR trials alternated with trials on which they received the erroneous KR. The results of these experiments provide evidence that uncertainty about the validity of sensory feedback increases the likelihood that subjects will be misled by invalid augmented feedback. Moreover, this uncertainty can be overcome by increased experience or by providing advance knowledge about the nature of the invalid feedback.     

Deductive and inductive conditional inferences: Two modes of reasoning

A number of single- and dual-process theories provide competing explanations as to how reasoners evaluate conditional arguments. Some of these theories are typically linked to different instructions—namely deductive and inductive instructions. To assess whether responses under both instructions can be explained by a single process, or if they reflect two modes of conditional reasoning, we re-analysed four experiments that used both deductive and inductive instructions for conditional inference tasks. Our re-analysis provided evidence consistent with a single process. In two new experiments we established a double dissociation of deductive and inductive instructions when validity and plausibility of conditional problems were pitted against each other. This indicates that at least two processes contribute to conditional reasoning. We conclude that single-process theories of conditional reasoning cannot explain the observed results. Theories that postulate at least two processes are needed to account for our findings.     

Learning Problem‐Solving Rules as Search Through a Hypothesis Space

Learning to solve a class of problems can be characterized as a search through a space of hypotheses about the rules for solving these problems. A series of four experiments studied how different learning conditions affected the search among hypotheses about the solution rule for a simple computational problem. Experiment 1 showed that a problem property such as computational difficulty of the rules biased the search process and so affected learning. Experiment 2 examined the impact of examples as instructional tools and found that their effectiveness was determined by whether they uniquely pointed to the correct rule. Experiment 3 compared verbal directions with examples and found that both could guide search. The final experiment tried to improve learning by using more explicit verbal directions or by adding scaffolding to the example. While both manipulations improved learning, learning still took the form of a search through a hypothesis space of possible rules. We describe a model that embodies two assumptions: (1) the instruction can bias the rules participants hypothesize rather than directly be encoded into a rule; (2) participants do not have memory for past wrong hypotheses and are likely to retry them. These assumptions are realized in a Markov model that fits all the data by estimating two sets of probabilities. First, the learning condition induced one set of Start probabilities of trying various rules. Second, should this first hypothesis prove wrong, the learning condition induced a second set of Choice probabilities of considering various rules. These findings broaden our understanding of effective instruction and provide implications for instructional design.     

The establishment of stimulus control by instructions and by differential reinforcement

A repeated acquisition design was used to study the effects of instructions and differential reinforcement on the performance of complex chains by undergraduates. The chains required responding on a series of keys that corresponded to characters that appeared on a monitor. Each day, subjects performed a new chain in a learning session and later relearned the same chain in a test session. Experiment 1 replicated previous research by showing that instructional stimuli paired with the correct responses in the learning sessions, combined with differential reinforcement in both learning and test sessions, resulted in stimulus control by the characters in each link. Experiment 2 separated the effects of instructional stimuli and differential reinforcement, and showed that stimulus control by the characters could be established solely by differential reinforcement during the test sessions. Experiment 3 showed that when a rule specified the relation between learning and test sessions, some subjects performed accurately in the test sessions without exposure to any differential consequences. This rule apparently altered the stimulus control properties of the characters much as did differential reinforcement during testing. However, compared to differential reinforcement, the rule established stimulus control more quickly.     

Biased lineup instructions and face identification from video images

Previous eyewitness memory research has shown that biased lineup instructions reduce identification accuracy, primarily by increasing false-positive identifications in target-absent lineups. Because some attempts at identification do not rely on a witness's memory of the perpetrator but instead involve matching photos to images on surveillance video, the authors investigated the effects of biased instructions on identification accuracy in a matching task. In Experiment 1, biased instructions did not affect the overall accuracy of participants who used video images as an identification aid, but nearly all correct decisions occurred with target-present photo spreads. Both biased and unbiased instructions resulted in high false-positive rates. In Experiment 2, which focused on video-photo matching accuracy with target-absent photo spreads, unbiased instructions led to more correct responses (i.e., fewer false positives). These findings suggest that investigators should not relax precautions against biased instructions when people attempt to match photos to an unfamiliar person recorded on video.     

Learning and hypothesis testing in probabilistic inference tasks

The relation between learning of probabilistic inference tasks and the availability of correct hypotheses for the tasks in individual subjects was investigated in two experiments. The results showed that having the correct hypotheses as measured before learning the tasks was neither a sufficient nor a necessary condition for learning the task. It was concluded that the hypothesis measurements are not reliable enough to allow predictions on an individual level. The results also showed that subjects have not only the four basic functions: positive linear, negative linear, U-shaped and inversely U-shaped, in their hypothesis hierarchies but also J-shaped functions. That the subjects can leam such functions is thus no discodinnation of the hypotheses sampling conception of learning as assumed in earlier studies.     

The resistance of renewal to instructions that devalue the role of contextual cues in a conditioned suppression task with humans

The renewal of extinguished conditioned behaviour appears to reflect context-dependent learning. The present research used a conditioned suppression task with humans to examine whether instructions concerning the context could influence renewal. Pairings of a conditional stimulus (CS) and unconditional stimulus (US) were made in one context, followed by extinction trials of CS alone in a second context, and test trials of CS alone upon return to the original learning context. Four experiments tested whether the renewal of conditioned suppression observed during test would be attenuated if participants were instructed that the context changes were irrelevant to the predictive relationship between the CS and US. Using a differential conditioning design, no attenuation was found when the instructions were given prior to conditioning (Experiment 1) or immediately prior to the test trials (Experiment 2). The latter result was replicated with a single-cue conditioning design and further controls for exposure to the extinction contexts (Experiment 3). The collection of on-line ratings about the relationship between the contextual changes and the predictive nature of the CS indicated that participants did attend to and believe the instructions (Experiment 4). The results point to the resistance of renewal to explicit instructions that attempt to devalue the role of the contextual cues.     

Facilitation in the abstract selection task: The effects of attentional and instructional factors

The present study examined performance on Wason's four-card abstract selection task. Baseline performance is very poor, usually less than 10% correct; and this task has a long record of resistance to facilitation. It was hypothesized that the two primary sources of difficulty are selective encoding of the problem information and the lack of satisfactory analytic processing. Three experiments were conducted to test this hypothesis. In Experiment 1, performance was improved by explicating the implication rule. The majority of subjects, however, still failed to make the correct selection. Subjects were required in Experiment 2 to provide reasons for their selection or non-selection of each of the cards. This response procedure, paired with an explicated rule, led to further improvements in performance (over 50% correct selections). In Experiment 3, the influence of the type of selection instruction (true-false vs. violation) was examined. Paired with an explicated rule and the reasons response format, violation instructions led to one of the highest correct selection rates ever observed for any version of the selection task: over 80% correct. Because of the importance of this result, it was replicated twice. The results of these three experiments are discussed in terms of Johnson-Laird and Byrne's mental models theory and Evans's two-stage model of reasoning.     

Facilitation in Wason’s selection task: Content and instructions

Two experiments investigated the influence of rule content and instructions on subjects’ ability to reason about conditional rules. Experiment 1 had subjects determine whether two rules were “true or false” or whether two rules were being “violated.” Subjects had direct experience with one rule and indirect experience with the other. Performance was superior with direct experiential rules and with violation instructions. Experiment 2 was conducted to determine whether violation instructions could facilitate correct selections with content for which subjects had no experience. Subjects were presented with a familiar and unfamiliar rule. The results were consistent with those of Experiment 1. The possibility of a cognitive trade-off between rule familiarity and instructions is discussed.     

Resolving a conflict between sensory feedback and knowledge of results, while learning a motor skill

In a recent study, Buekers, Magill, and Hall (1992) showed that even when verbal knowledge of results (KR) was redundant with sensory feedback, erroneous KR influenced the learning of motor skills. To determine why this occurred, we conducted two experiments. In Experiment 1, subjects performed 50 practice trials on a complex anticipation task and then performed three non-KR retention tests of 25 trials each. The results indicated that when correct KR and erroneous KR were provided alternately, subjects ignored the erroneous KR and performed according to the correct KR. Experiment 2 compared different ratios of no KR to erroneous KR. The results showed that, for low ratios (1:1 and 4:1), learning experience was similar to a condition in which erroneous KR was presented on all trials. For a higher ratio (9:1), however, learning performance was similar to performance when KR was correct on all trials or was not presented. These results are interpreted as support for the hypothesis that when two conflicting sources of information are available, the subject's degree of uncertainty about the valid source of information influences his selection of the information to guide performance.     

Control of adolescents' arbitrary matching-to-sample by positive and negative stimulus relations.

In Experiment 1, four developmentally delayed adolescents were taught an A-B matching-to-sample task with nonidentical stimuli: given Sample A1, select Comparison B1; given A2, select B2. During nonreinforced test trials, appropriate matching occurred when B stimuli appeared as samples and A stimuli as comparisons, i.e., the sample and comparison functions were symmetrical (B-A matching). During A-B or B-A matching test trials in which familiar samples and correct comparisons were presented along with novel comparisons, the subjects selected the correct comparisons. In tests with familiar samples and both incorrect and novel comparisons, subjects selected the novel comparisons, demonstrating control by both positive ("matching") and negative ("nonmatching") stimulus relations in A-B and B-A arrays. In Experiment 2, 12 developmentally delayed subjects were taught a two-stage arbitrary-matching task (e.g., A-B, C-B matching). Test sessions showed sample-comparison symmetry (e.g., B-A, B-C matching) and derived sample-comparison relations (e.g., A-C, C-A matching) for 11 subjects. These subjects also demonstrated control by positive and negative stimulus relations in the derived relations.     

Lateralisation of emotions: evidence from pupil size measurement

The way our brain processes emotional stimuli has been studied intensively. One of the main issues still under debate is the laterality of valence processing. Herein, we employed the fact that pupil size increases under conditions of higher mental effort and during emotional processing, in order to contrast three proposed hypotheses in the field. We used different manual response mapping for emotional stimuli: Participants responded with their right hand for positive and with their left hand for negative facial expressions, or vice versa. The hands position was either regular (Experiment 1) or crossed (Experiment 2) in order to rule out a “spatial-valence association” alternate explanation. A third experiment was conducted by employing a passive viewing procedure of peripheral emotional stimuli. In the first two experiments, pupil size was larger when participants responded to positive stimuli with their left hand and to negative with their right hand, compared with the opposite mapping. Results of Experiment 3 strengthen the findings of Experiments 1 and 2. These findings provide significant psychophysiological evidence for the valence hypothesis: Processing positive stimuli involves the left hemisphere, while processing negative stimuli involves the right hemisphere. These results are discussed in relation to contemporary theories of emotion processing.     

Effects of aging on implicit sequence learning: Accounting for sequence structure and explicit knowledge

The present research was intended to examine the sequence learning ability of elderly people — with a focus on comparing sequences with different structural characteristics and on properly assessing explicit knowledge. Experiment 1 showed that learning-related improvements in serial reaction time task performance were greater for young than elderly subjects, and elderly subjects were especially poor at learning a sequence with complex structural characteristics. Measures of recognition memory showed that neither young nor elderly subjects showed above-chance explicit knowledge of the sequences. Experiment 2 was designed to test the validity and sensitivity of the explicit recognition measures by comparing young subjects in groups given all random trials, given sequence trials with implicit instructions, or given sequence trials with explicit instructions. Experiment 2 confirmed the sensitivity of the recognition measures to explicit knowledge, so it is concluded that group effects in Exp. 1 reflect age-related differences in implicit learning.     

Effect of cue validity on learning of complex rules in probabilistic inference tasks

The effect of cue validity on the learning of positive and negative J-shaped relations in single-cue probability learning was studied. As would be expected from a hypothesis construction model, learning of the J-shaped relations was better when cue validity was high than when it was low. However, the results also showed that positive J-rules were learned more efficiently than negative J-rules. This shows that subjects do not construct their hypotheses on the basis of data from task only. It was concluded that subjects construct their hypotheses from elements stored in memory, and that data are used only to test their hypotheses.     

Learning By Tracing Worked Examples

Cognitive load theorists have only recently begun to test the role of the body in learning. Tracing the index finger over the surface of instructions while reading, an embodied pedagogy based on Montessori's sandpaper letters, may hold substantial promise for learning by reducing cognitive load. Two experiments tested whether students who traced their index fingers against paper‐based worked example instructions in triangle geometry (Experiment 1; N = 52) and order of operations (Experiment 2; N = 54) would perform better on a subsequent test than students who only studied the materials visually. Students in the tracing condition outperformed the non‐tracing condition on transfer problems in both Experiment 1 (d = .78) and Experiment 1 (d = .50), but hypotheses regarding self‐reports of cognitive load during testing were not supported. Implications for research and practice are discussed. Copyright © 2015 John Wiley & Sons, Ltd.