Empirical indistinguishability: From the knowledge structure to the skills

Recent literature has pointed out that the basic local independence model (BLIM) when applied to some specific instances of knowledge structures presents identifiability issues. Furthermore, it has been shown that for such instances the model presents a stronger form of unidentifiability named empirical indistinguishability, which leads to the fact that the existence of certain knowledge states in such structures cannot be empirically tested. In this article the notion of indistinguishability is extended to skill maps and, more generally, to the competence-based knowledge space theory. Theoretical results are provided showing that skill maps can be empirically indistinguishable from one another. The most relevant consequence of this is that for some skills there is no empirical evidence to establish their existence. This result is strictly related to the type of probabilistic model investigated, which is essentially the BLIM. Alternative models may exist or can be developed in knowledge space theory for which this indistinguishability problem disappears.     

Skills and Knowledge - Nothing but Memory?

The aim of this article is to enquire into neuroscientific research on memory and relate it to topics of skill, knowledge and consciousness. The article outlines some contemporary theories on procedural and working memory, and discusses what contributions they give to sport science and philosophy of sport. It is argued that memory research gives important insights to the neuronal structures and events involved in knowledge and consciousness contributing to sport skills, but that these explanations are not exhaustive. The article argues that phenomenal consciousness in skills is not explained by the neuroscience of memory, and hence neither are skills.     

Instructor and student knowledge of study strategies

Students' self-reported study skills and beliefs are often inconsistent with empirically supported (ES) study strategies. However, little is known regarding instructors' beliefs about study skills and if such beliefs differ from those of students. In the current study, we surveyed college students' and instructors' knowledge of study strategies and had both groups evaluate the efficacy of learning strategies described in six learning scenarios. Results from the survey indicated that students frequently reported engaging in methods of studying that were not optimal for learning. Instructors' responses to the survey indicated that they endorsed a number of effective study skills but also held several beliefs inconsistent with research in learning and memory (e.g., learning styles). Further, results from the learning scenarios measure indicated that instructors were moderately more likely than students to endorse ES learning strategies. Collectively, these data suggest that instructors exhibited better knowledge of effective study skills than students, although the difference was small. We discuss several notable findings and argue for the improvement of both students' and instructors' study skill knowledge.     

Assessing complex problem-solving skills with multiple complex systems

In this paper we propose the multiple complex systems (MCS) approach for assessing domain-general complex problem-solving (CPS) skills and its processes knowledge acquisition and knowledge application. After defining the construct and the formal frameworks for describing complex problems, we emphasise some of the measurement issues inherent in assessing CPS skills with single tasks (i.e., fixed item difficulty, low or unknown reliability, and a large impact of random errors). With examples of the MicroDYN test and the MicroFIN test (two instances of the MCS approach), we show how to adequately score problem-solving skills by using multiple tasks. We discuss implications for problem-solving research and the assessment of CPS skills in general.     

Individual differences in children's understanding of inversion and arithmetical skill

Background and aims. In order to develop arithmetic expertise, children must understand arithmetic principles, such as the inverse relationship between addition and subtraction, in addition to learning calculation skills. We report two experiments that investigate children's understanding of the principle of inversion and the relationship between their conceptual understanding and arithmetical skills. Sample. A group of 127 children from primary schools took part in the study. The children were from 2 age groups (6–7 and 8–9 years). Methods. Children's accuracy on inverse and control problems in a variety of presentation formats and in canonical and non‐canonical forms was measured. Tests of general arithmetic ability were also administered. Results. Children consistently performed better on inverse than control problems, which indicates that they could make use of the inverse principle. Presentation format affected performance: picture presentation allowed children to apply their conceptual understanding flexibly regardless of the problem type, while word problems restricted their ability to use their conceptual knowledge. Cluster analyses revealed three subgroups with different profiles of conceptual understanding and arithmetical skill. Children in the ‘high ability’ and ‘low ability’ groups showed conceptual understanding that was in‐line with their arithmetical skill, whilst a 3rd group of children had more advanced conceptual understanding than arithmetical skill. Conclusions. The three subgroups may represent different points along a single developmental path or distinct developmental paths. The discovery of the existence of the three groups has important consequences for education. It demonstrates the importance of considering the pattern of individual children's conceptual understanding and problem‐solving skills.     

Parent education home visitation program: adolescent and nonadolescent mother comparison after six months of intervention

This study examined the effect of an intervention over a 6-month period to improve first time mothers knowledge about parenting and safety in the home. The sample included 61 mothers who completed a baseline and follow-up survey. Mothers were first time adolescent (38) and nonadolescent (22) mothers recruited from rural county health departments for participation in a voluntary home visitation intervention program. Four hypotheses were tested that associated home visitation with greater parenting skill and child development knowledge and safety. Adolescent mothers were expected to make greater gains but to lag behind nonadolescent mothers in child development knowledge, parenting skills knowledge, household safety, and use of community resources. The sample included 32% with a high school degree and 12% African American. 83% were in school. 85% lived at or below the US federal poverty level. Parent Educators provided weekly in-home education based on a manual and individualized curriculum. Parenting skills knowledge was measured by the Adolescent-Adult Parenting Inventory (Bavolek, 1984). Home safety was measured by Culp's Home Safety Checklist. Educators recorded use of 13 community services. Analysis of variance revealed that infant knowledge increased to the same level among all mothers regardless of adolescents' lesser knowledge at baseline. Parenting skill knowledge of child roles increased for both ages, but older mothers scored higher. Parenting skill knowledge of alternatives to corporal punishment increased similarly for both ages. No age or interactive effects were related to improvement in safety or use of community services.     

小学三年级数学学优生与学困生解决比较问题的差异

运用实验法和临床访谈法研究了数学学优生与学困生在解决比较问题时的差异及元认知对解题成绩的影响。被试为40名小学三年级学生。比较问题分为一致问题和不一致问题。元认知包括元认知知识和元认知监控技能。结果表明：(1)学优生与学困生解决比较问题的成绩差异显著,学优生在一致问题和不一致问题上的解题成绩均优于学困生。这种差异与其解题时所运用的表征策略有关。(2)学生在解决比较问题中出现的主要错误为转换错误,在不一致问题中出现的错误多于一致问题中出现的错误。(3)学优生与学困生在元认知知识和监控技能上均有显著差异,元认知监控技能对解决比较问题的成绩有显著预测作用。     

Skill Acquisition and Utilization During Evidence-Based Psychosocial Treatments for Childhood Disruptive Behavior Problems: A Review and Meta-analysis

We review 85 empirical articles published since 2000 that measured the acquisition and/or utilization of parent management skills and/or child cognitive-behavioral skills in the context of an evidence-based treatment (EBT) for childhood behavior problems. Results showed that: (1) there are no standardized measures of skill acquisition or skill utilization that are used across treatments, (2) little is known about predictors, correlates, or outcomes associated with skill acquisition and utilization, and (3) few studies systematically examined techniques to enhance the acquisition and utilization of specific skills. Meta-analytic results from a subset of 68 articles (59 studies) showed an overall treatment–control ES = .31, p < .01 for skill acquisition and ES = .20, p = ns for skill utilization. We recommend that future research focus on the following three areas: (1) development of standardized measures of skill acquisition and utilization from a “common elements” perspective that can used across EBTs; (2) assessment of the predictors, correlates, and outcomes associated with skill acquisition and utilization; and (3) development of innovative interventions to enhance the acquisition and utilization of cognitive-behavioral and parent management skills.     

Role of Verbal Working Memory in Complex Skill Acquisition

Although research has shown that general cognitive ability is related to performance during the initial stage of skill acquisition, empirical evidence is needed to increase understanding of the primary abilities responsible for the relation. We propose that verbal working memory is related to initial skill acquisition performance based on cognitive activities people enact when learning complex skills. After completing a general cognitive ability measure and a test of verbal working memory, 120 undergraduate students performed a complex computer simulation. The working memory test accounted for a meaningful amount of performance variance after statistically controlling for the general cognitive ability measure. These data suggest that tasks depending heavily on the activation of multiple knowledge structures may be understood in terms of individual differences in working memory.     

Integration and Reuse in Cognitive Skill Acquisition

Previous accounts of cognitive skill acquisition have demonstrated how procedural knowledge can be obtained and transformed over time into skilled task performance. This article focuses on a complementary aspect of skill acquisition, namely the integration and reuse of previously known component skills. The article posits that, in addition to mechanisms that proceduralize knowledge into more efficient forms, skill acquisition requires tight integration of newly acquired knowledge and previously learned knowledge. Skill acquisition also benefits from reuse of existing knowledge across disparate task domains, relying on indexicals to reference and share necessary information across knowledge components. To demonstrate these ideas, the article proposes a computational model of skill acquisition from instructions focused on integration and reuse, and applies this model to account for behavior across seven task domains.     

More on the fragility of performance: choking under pressure in mathematical problem solving

In 3 experiments, the authors examined mathematical problem solving performance under pressure. In Experiment 1, pressure harmed performance on only unpracticed problems with heavy working memory demands. In Experiment 2, such high-demand problems were practiced until their answers were directly retrieved from memory. This eliminated choking under pressure. Experiment 3 dissociated practice on particular problems from practice on the solution algorithm by imposing a high-pressure test on problems practiced 1, 2, or 50 times each. Infrequently practiced high-demand problems were still performed poorly under pressure, whereas problems practiced 50 times each were not. These findings support distraction theories of choking in math, which contrasts with considerable evidence for explicit monitoring theories of choking in sensorimotor skills. This contrast suggests a skill taxonomy based on real-time control structures.     

The assessment of knowledge and learning in competence spaces: The gain–loss model for dependent skills

The gain–loss model (GaLoM) is a formal model for assessing knowledge and learning. In its original formulation, the GaLoM assumes independence among the skills. Such an assumption is not reasonable in several domains, in which some preliminary knowledge is the foundation for other knowledge. This paper presents an extension of the GaLoM to the case in which the skills are not independent, and the dependence relation among them is described by a well‐graded competence space. The probability of mastering skill s at the pretest is conditional on the presence of all skills on which s depends. The probabilities of gaining or losing skill s when moving from pretest to posttest are conditional on the mastery of s at the pretest, and on the presence at the posttest of all skills on which s depends. Two formulations of the model are presented, in which the learning path is allowed to change from pretest to posttest or not. A simulation study shows that models based on the true competence space obtain a better fit than models based on false competence spaces, and are also characterized by a higher assessment accuracy. An empirical application shows that models based on pedagogically sound assumptions about the dependencies among the skills obtain a better fit than models assuming independence among the skills.     

Improving computer skill training: behavior modeling, symbolic mental rehearsal, and the role of knowledge structures

Effective computer skill training is vital to organizational productivity. Two experiments (N = 288) demonstrated that the behavior modeling approach to computer skill training could be substantially improved by incorporating symbolic mental rehearsal (SMR). SMR is a specific form of mental rehearsal that establishes a cognitive link between visual images and symbolic memory codes. As theorized, the significant effects of SMR on declarative knowledge and task performance were shown to be fully mediated by changes in trainees' knowledge structures. The mediational role of knowledge structures is expected to generalize to other training interventions and cognitive skill domains. Our findings have the immediate implications that practitioners should use SMR for improving the effectiveness of computer skill training.     

Multimedia comprehension skill predicts differential outcomes of web-based and lecture courses

College students (134 women and 55 men) participated in introductory psychology courses that were offered largely online (on the World Wide Web) or in a lecture format. Student comprehension skills were inferred from their scores on a multimedia comprehension battery. The learning of content knowledge was affected interactively by comprehension skill level and course format. Differences between format increased with comprehension skill such that the Web-based course advantage became greater as comprehension skill increased. This same pattern was not seen when self-reports of comprehension ability were used as the predictor. Furthermore, comprehension skill did not predict course satisfaction. Generally, students of all skill levels preferred the lecture courses.     

Counting knowledge and skill in cognitive addition: a comparison of normal and mathematically disabled children.

The relationship between counting knowledge and computational skills (i.e., skill at counting to solve addition problems) was assessed for groups of first-grade normal and mathematically disabled (MD) children. Twenty-four normal and 13 MD children were administered a series of counting tasks and solved 40 computer-administered addition problems. For the addition task, problem-solving strategies were recorded on a trial-by-trial basis. Performance on the counting tasks suggested that the MD children were developmentally delayed in the understanding of essential and unessential features of counting and were relatively unskilled in the detection of certain forms of counting error. On the addition task, the MD children committed many more computational errors and tended to use developmentally immature counting procedures. The immature counting knowledge of the MD children, combined with their relatively poor skills at detecting counting errors, appeared to underlie their poor computational skills on the addition task. Suggestions for future research are presented.     

The Role of Language Skill in Child Psychopathology: Implications for Intervention in the Early Years

In this narrative review, we suggest that children’s language skill should be targeted in clinical interventions for children with emotional and behavioral difficulties in the preschool years. We propose that language skill predicts childhood emotional and behavioral problems and this relationship may be mediated by children’s self-regulation and emotion understanding skills. In the first sections, we review recent high-quality longitudinal studies which together demonstrate that that children’s early language skill predicts: (1) emotional and behavioral problems, and this relationship is stronger than the reverse pattern; (2) self-regulation skill; this pattern may be stronger than the reverse pattern but moderated by child age. Findings also suggest that self-regulation skill mediates the relation between early language skill and children’s emotional and behavioral problems. There is insufficient evidence regarding the mediating role of emotion understanding. In subsequent sections, we review evidence demonstrating that: (1) particular kinds of developmentally targeted parent–child conversations play a vital role in the development of language skill, and (2) some current clinical interventions, directly or indirectly, have a beneficial impact on children’s vocabulary and narrative skills, but most approaches are ad hoc. Targeting language via parent–child conversation has the potential to improve the outcomes of current clinical interventions in the preschool years.     

Knowledge-telling and knowledge-transforming arguments in mock jurors' verdict justifications

According to the “story model” a juror constructs an implicit mental model of a story telling what happened as the basis for the verdict choice. But the explicit justification of a verdict choice could take the form of a story (knowledge telling) or the form of a relational (knowledge-transforming) argument structure that brings together diverse, non-chronologically related pieces of evidence. The study investigates whether people tend towards knowledge telling or knowledge transforming, and whether use of these argument structure types are related to skilled argument and epistemic understanding. A sample of people on jury duty chose and justified verdicts in two abridged cases. Participants tended to display the same argument structure and argument skill across cases. Those using knowledge-transforming structures were more successful at the juror argument skills task and had a higher level of epistemic understanding. The discussion suggests that jurors approach their task with an epistemic orientation towards knowledge telling or knowledge transforming.     

Factors That Influence Skill Decay and Retention: A Quantitative Review and Analysis

This article presents a review of the skill retention and skill decay literature that focuses on factors that influence the loss of trained skills or knowledge over extended periods of nonuse. Meta-analytic techniques were applied to a total of 189 independent data points extracted from 53 articles. Results indicate that there is substantial skill loss with nonpractice or nonuse, with the amount of skill loss ranging from an effect size (d) of -0.01 immediately after training to a d of -1.4 after more than 365 days of nonuse. Most of the study's hypotheses for moderators were supported. Physical, natural, and speed-based tasks were less susceptible to skill loss than cognitive, artificial, and accuracy-based tasks. Additionally, certain methodological variables, such as using recognition tests, using similar conditions of retrieval at retention, and using behavioral evaluation criteria, resulted in less skill loss over time. Implications of the results for training and future research are discussed.     

Assessing learning processes with the gain-loss model

Within the framework of knowledge space theory, a probabilistic skill multimap model for assessing learning processes is proposed. The learning process of a student is modeled as a function of the interaction between his competence state and the effect of a learning object on specific skills. Model parameters are initial probabilities of the skills, effects of learning objects on gaining and losing the skills, careless error, and lucky guess probabilities of the problems. A simulation study assessed model identifiability and goodness-of-recovery under several conditions. Practical implications of using the model are discussed, and the MATLAB code for simulating, estimating and testing it is available in the Psychonomic Society supplemental archive.     

How Experts Solve a Novel Problem in Experimental Design

Research on expert-novice differences has mainly focused on how experts solve familiar problems. We know far less about the skills and knowledge used by experts when they are confronted with novel problems within their area of expertise. This article discusses a study in which verbal protocols were taken from subjects of various expertise designing an experiment in an area with which they were unfamiliar. The results showed that even when domain knowledge is lacking, experts solve a novel problem within their area of expertise by dividing the problem into a number of subproblems that are solved in a specified order. The lack of domain knowledge is compensated for by using abstract knowledge structures and domain-specific heuristic strategies. However, the quality of their solutions is considerably lower than the quality attained by experts who were familiar with the type of problem to be solved. The results suggest that when experts are confronted with novel problems as compared with familiar problems, their form of reasoning remains intact, but the content of their reasoning suffers due to lack of domain knowledge.