Cross-national comparisons of complex problem-solving strategies in two microworlds

Research in the fields of complex problem solving (CPS) and dynamic decision making using microworlds has been mainly conducted in Western industrialized countries. This study analyzes the CPS process by investigating thinking-aloud protocols in five countries. Participants were 511 students from Brazil, Germany, India, the Philippines, and the United States who worked on two microworlds. On the basis of cultural-psychological theories, specific cross-national differences in CPS strategies were hypothesized. Following theories of situatedness of cognition, hypotheses about the specific frequency of problem-solving strategies in the two microworlds were developed. Results of the verbal protocols showed (a) modification of the theoretical CPS model, (b) task dependence of CPS strategies, and (c) cross-national differences in CPS strategies. Participants' CPS processes were particularly influenced by country-specific problem-solving strategies.     

A multitrait–multimethod study of assessment instruments for complex problem solving

Recently published studies on Complex Problem Solving (CPS) suggest that assessments of CPS using multiple complex systems are only moderately related to tests of classical cognitive abilities. Further, CPS assessments show incremental validity beyond tests of other cognitive abilities when predicting relevant outcomes. However, these empirical accounts have relied on single CPS assessment instruments. We do not know whether these findings will generalize to the construct level across different CPS assessment instruments. To answer this question, we tested a sample of N = 339 German university students who completed three CPS assessment instruments based on multiple complex systems (MicroDYN, the Genetics Lab, and MicroFIN) and the matrices subtest of the Intelligence Structure Test as measure of reasoning. Students further reported their school grades. Analyses including latent multitrait–multimethod models provided support for the conceptualization of CPS as a complex cognitive ability. Results indicated that different CPS assessment instruments showed sufficient convergent validity (with a consistency mostly between .50 and .60). In addition, we found evidence for the divergent validity of CPS from reasoning (reasoning predicted two CPS facets, knowledge and control, β_KNOW = .49 and β_CON = .53, respectively). In the prediction of academic achievement, CPS explained variance in natural science grades after we controlled for reasoning (β_CPS = .22), whereas social science grades were not predicted. Our findings suggest that the validity of CPS generalizes across different measurement instruments.     

Problem-solving skills training for psychiatric inpatients: An analysis of generalization

A program for teaching problem-solving skills was evaluated with six psychiatric inpatients in a multiple baseline across groups design. Subjects received training on 12 problem situations and the generalization of verbal problem-solving to six novel situations was assessed via probes presented by a novel person in an untrained setting. The generalization of overt behavior was assessed via pre/post contrived in vivo assessments that contained six situations used in training. The in vivo situations were integrated within a sequence of ongoing events in an effort to enhance the ‘naturalness’ of the assessment. The probes revealed some improvement in verbal problem-solving skills, whereas minimal improvement occurred in the post in vivo test. Following the study, an attempt was made to enhance performance by having the trainer conduct a probe and adding verbal prompts to evoke problem-solving during an additional in vivo assessment. Both efforts produced improvements in subjects' performance to a level near that achieved by a normative sample of 20 individuals. The results suggest that in vivo problem-solving may be dependent on the methods used in presenting problem situations as well as situational factors. Issues related to these results and suggestions for future research are discussed.     

An expanded etiological model for suicide behavior in adolescents: Evidence for its specificity relative to depression

This study tests both the stress/social support and the stress/problem-solving etiological models for suicidality while controlling for depression. To this end, a depressed, high-suicide-ideating sample (N=68) was compared to a depressed, low-suicide-ideating sample (N=64). Hierarchical multiple regression analyses were used to test the unique contributions of stress, problem-solving orientation, problem-solving skills, and perceived level of social support in predicting level of suicidality. Hierarchical regression analyses were also used to test the interactive contributions of problem-solving × stress and social support × stress in predicting level of suicidality. Regression models were generated separately for men, women, and the entire sample using all factors. The results clearly support the importance of social support as an independent predictor of suicidality for men, women, and the entire sample. Ability to generate alternatives to identified problems predicted suicidality, but only for women and the entire sample. Problem-solving orientation was not uniquely predictive of suicidality and may affect suicidal behavior via its relationship to depression.     

Students' complex problem-solving abilities: Their structure and relations to reasoning ability and educational success

Complex Problem Solving (CPS) is considered to be a promising candidate for capturing higher order thinking skills that are emphasized in new educational curricula but are not adequately measured by traditional intelligence tests. However, little is known about its psychometric structure and its exact relation to intelligence and educational success—especially in student populations. This study is among the first to use a large and representative sample of secondary school students (N = 563) to examine different measurement models of CPS—that conceptualize the construct as either faceted or hierarchical—and their implications for the construct's validity. Results showed that no matter which way it was conceptualized, CPS was substantially related to reasoning and to different indicators of educational success. Controlling for reasoning within a joint hierarchical measurement model, however, revealed that the impressive external validity was largely attributable to the variance that CPS shares with reasoning, suggesting that CPS has only negligible incremental validity over and above traditional intelligence scales. On the basis of these results, the value of assessing CPS within the educational context is discussed.     

Software review

Summary Riddle Mysteries is a useful tool for teachers of second through fourth graders who wish to enhance their students' problem-solving capabilities. Cognitively advanced first graders with adequate reading skills are potential users as well. Only a limited knowledge on how to operate a computer is required, making it appropriate for young users. Teachers should be aware that it is relatively easy for students to avoid using problem-solving skills when operatingRiddle Mysteries as trial-and-error typing of keyboard letters alone can reveal the answer to the riddle. Moreover, due to a limited variety of items on which to apply problem-solving skills, boredom can quickly inhibit the user's motivation to think critically.     

Racial differences in intelligence: The importance of the executive system

The race-IQ controversy arose at a time when psychometric views of intelligence dominated. Little attention was paid to more process-oriented models in spite of the fact they provide alternative perspectives on the causes of individual differences in problem-solving. We hypothesized that much of the IQ spread commonly observed between black and white children can be attributed to differences in components of their executive systems, including the knowledge base, control processes, and metacognitive states. To test this possibility, black and white children who differed significantly on fluid and crystallized intelligence were tested on multiple tasks reflecting components of the executive systems as well as on perceptual efficiency tasks. Striking group differences were observed in metamemory, stragegy use, and general knowledge, but few reliable differences were found in perceptual efficiency. Regression analyses showed that different factors predicted fluid and crystallized intelligence, with metamemory predicting the latter but not the former. An implication of these findings has potential educational significance: training directed at executive skills, introduce at an early age, might elevate learning and problem-solving skills in black children, thereby reducing racial differences in crystallized intelligence.     

An Evaluation of Interventions to Facilitate Algebra Problem Solving

Three participants were trained on 6 target algebra skills and subsequently received a series of 5 instructional interventions (cumulative practice, tiered feedback, feedback plus solution sequence instruction, review practice, and transfer training) in a multiple baseline across skills design. The effects of the interventions on the performance of 5 problem-solving tasks that required novel combinations of 2 or more of the target skills were evaluated. Results showed that cumulative practice of the skills and a combination of feedback with solution sequence instruction led to limited performance increases on some of the problem-solving tasks, with one task meeting the mastery criterion following the solution sequence intervention. The introduction of the transfer training resulted in more consistent improvements across tasks such that participants achieved the performance criterion on all remaining problem-solving tasks during a final baseline condition. The findings suggest that a structured intervention designed to transfer stimulus control from previously established discriminative stimuli to more complex, novel stimuli can facilitate problem solving without extensive direct instruction on the higher-level skills. This research was funded in part by a contract with the Florida Department of Children and Families. The content and opinions expressed herein do not necessarily reflect the position or policy of the Department of Children and Families. We thank Tim Vollmer for suggestions made throughout this study and for helpful comments on an earlier draft of this paper. We also thank Linda Meckler for her assistance with data collection. Kristin H. Mayfield, now at iLearn, Inc., Marietta, GA, USA.     

Parental Problem-Solving Abilities and the Association of Sickle Cell Disease Complications with Health-Related Quality of Life for School-Age Children

Children with sickle cell disease (SCD) are at risk for poor health-related quality of life (HRQOL). The current analysis sought to explore parent problem-solving abilities/skills as a moderator between SCD complications and HRQOL to evaluate applicability to pediatric SCD. At baseline, 83 children ages 6–12 years and their primary caregiver completed measures of child HRQOL. Primary caregivers also completed a measure of social problem-solving. A SCD complications score was computed from medical record review. Parent problem-solving abilities significantly moderated the association of SCD complications with child self-report psychosocial HRQOL (p = .006). SCD complications had a direct effect on parent proxy physical and psychosocial child HRQOL. Enhancing parent problem-solving abilities may be one approach to improve HRQOL for children with high SCD complications; however, modification of parent perceptions of HRQOL may require direct intervention to improve knowledge and skills involved in disease management.     

Testing problem-solving capacities: differences between individual testing and social group setting

Testing animals individually in problem-solving tasks limits distractions of the subjects during the test, so that they can fully concentrate on the problem. However, such individual performance may not indicate the problem-solving capacity that is commonly employed in the wild when individuals are faced with a novel problem in their social groups, where the presence of a conspecific influences an individual’s behaviour. To assess the validity of data gathered from parrots when tested individually, we compared the performance on patterned-string tasks among parrots tested singly and parrots tested in social context. We tested two captive groups of orange-winged amazons (Amazona amazonica) with several patterned-string tasks. Despite the differences in the testing environment (singly vs. social context), parrots from both groups performed similarly. However, we found that the willingness to participate in the tasks was significantly higher for the individuals tested in social context. The study provides further evidence for the crucial influence of social context on individual’s response to a challenging situation such as a problem-solving test.     

Moving arms: the effects of sensorimotor information on the problem-solving process

Embodied cognition postulates a bi-directional link between the human body and its cognitive functions. Whether this holds for higher cognitive functions such as problem solving is unknown. We predicted that arm movement manipulations performed by the participants could affect the problem-solving solutions. We tested this prediction in quantitative reasoning tasks that allowed two solutions to each problem (addition or subtraction). In two studies with healthy adults (N?=?53 and N?=?50), we found an effect of problem-congruent movements on problem solutions. Consistent with embodied cognition, sensorimotor information gained via right or left arm movements affects the solution in different types of problem-solving tasks.     

Children's comprehension of complex sentences

Four tasks were given to children from 4–12 to test their comprehension of complex sentences containing main verbs taking underlying sentences as their complements (Sally knew that she was early). In an imperatives task, very young children interpreted only the complement verb and ignored the complex verb. In a short-term memory task, sentences with two negations usually lost the second not in recall. In direct questioning and anomaly-detection tasks, children tended to make pragmatic inferences and excessively depend on knowledge about the world, as opposed to linguistic information. Overall results showed that even sixth graders had not yet attained adult-level comprehension of complex sentences.     

Optimizing the number of steps in learning tasks for complex skills

Background. Carrying out whole tasks is often too difficult for novice learners attempting to acquire complex skills. The common solution is to split up the tasks into a number of smaller steps. The number of steps must be optimized for efficient and effective learning. Aim. The aim of the study is to investigate the relation between the number of steps provided to learners and the quality of their learning of complex skills. It is hypothesized that students receiving an optimized number of steps will learn better than those receiving either the whole task in only one step or those receiving a large number of steps. Sample. Participants were 35 sophomore law students studying at Dutch universities, mean age = 22.8 years (SD=3.5), 63% were female. Method. Participants were randomly assigned to 1 of 3 computer‐delivered versions of a multimedia programme on how to prepare and carry out a law plea. The versions differed only in the number of learning steps provided. Videotaped plea‐performance results were determined, various related learning measures were acquired and all computer actions were logged and analyzed. Results. Participants exposed to an intermediate (i.e. optimized) number of steps outperformed all others on the compulsory learning task. No differences in performance on a transfer task were found. A high number of steps proved to be less efficient for carrying out the learning task. Conclusions. An intermediate number of steps is the most effective, proving that the number of steps can be optimized for improving learning.     

Group-based problem-solving therapy in self-poisoning females: A pilot study

Aims: The treatment of suicidal behaviour remains limited in efficacy. This pilot study assessed the effectiveness of a time-limited, group-based problem-solving therapy intervention compared with a treatment as usual control group, in females who self-poison. Method: A total of 18 clients were equally randomised to treatment or control groups. All clients were assessed using standardised questionnaires for depression, hopelessness, suicidal ideation and social problem-solving skills, at pre-treatment, post-treatment and two months follow-up. Results: The treatment group experienced significant reductions in levels of depression, hopelessness, suicidal ideation and improvements in self-assessed social problem-solving skills. Improvements in mental health and aspects of self-assessed problem-solving skills for the treatment group continued to be evident at two months follow-up. The control group did not change significantly over time on mental health measures or social problem solving abilities. Conclusion: Although limited by small sample size, the results suggest that group-based problem-solving therapy is effective in the management of deliberate self-poisoning. This paper is a unique contribution in that it examines the implementation of problem solving therapy with a homogenous population and in a group format. Methodological concerns and directions for future research are discussed.     

On the relationship between children's perspective taking in complex scenes and their spatial drawing ability

Depicting space and volume in drawings is challenging for young children in particular. It has been assumed that several cognitive skills may contribute to children's drawing. In the present study, we investigated the relationship between perspective‐taking skills in complex scenes and the spatial characteristics in drawings of 5‐ to 9‐year‐olds (N= 121). Perspective taking was assessed by two tasks: (a) a visual task similar to the three‐mountains task, in which the children had to select a three‐dimensional model that showed the view on a scene from particular perspective and (b) a spatial construction task, in which children had to plastically reconstruct a three‐dimensional scene as it would appear from a new point of view. In the drawing task, the children were asked to depict a three‐dimensional scene exactly as it looked like from their own point of view. Several spatial features in the drawings were coded. The results suggested that children's spatial drawing and their perspective‐taking skills were related. The axes system and the spatial relations between objects in the drawings in particular were predicted, beyond age, by certain measures of the two perspective‐taking tasks. The results are discussed in the light of particular demands that might underlay both perspective taking and spatial drawing.     

Conflict management: A premarital training program in mutual problem solving

Abstract

The purpose of this study was to evaluate the effectiveness of a structured educational program designed to train premarital couples in communication and mutual problem-solving skills. Twenty-six couples participated in an eight-week, 24-hour problem-solving training program, while 28 similar couples participated in an eight-week, 24-hour relationship discussion group. Results indicated that the problem-solving group, as compared to the relationship-discussion group, showed a significant increase in communication and mutual problem-solving skills. Discussion focused on the benefits for premarital couples of learning effective problemsolving procedures as well as the need for follow-up assessments of both behavioral skill level and relationship satisfaction and adjustment.     

Individual Differences in Early Scientific Thinking: Assessment,Cognitive Influences,and Their Relevance for Science Learning

ABSTRACT

Early scientific thinking in kindergarten (6-year-olds) was investigated in a large study involving 227 participants. We investigated (1) whether individual differences across 3 scientific-thinking components (experimentation, data interpretation, and understanding the nature of science) are stable across children, (2) whether children’s increased information-processing skills (intelligence, language abilities) and their development of an advanced theory of mind (AToM) are potential mechanisms that bring about individual differences in scientific thinking, and (3) whether individual differences in scientific thinking predict individual differences in science content knowledge. Using a newly developed instrument with 30 items (the Science-K inventory), we found that a one-dimensional Rasch model provides a good fit to the data, showing that kindergarteners’ scientific thinking goes beyond competencies in single tasks. Individual differences across the diverse scientific-thinking tasks were stable, and children’s scientific thinking was correlated with their intelligence and their language abilities. AToM was an important precursor for scientific thinking, predicting it independently from the influences of information-processing skills. Children’s science content knowledge was predicted by their score on the Science-K inventory. This finding points to a specific relation between these 2 components of scientific literacy, and it supports the view that scientific-thinking skills help to better test and revise (wrong) beliefs and misconceptions about science. Our study is the first to reveal substantial individual differences in scientific thinking in children as young as kindergarteners, and it shows that scientific thinking is important for a successful learning of science concepts, even before children enter formal schooling and begin science education.     

When Reflection Hinders Creative Problem-Solving: a Test of Alternative Reflection Strategies

A growing body of evidence suggests that reflecting on performance is an important source of individual learning. Given the importance of creativity in contemporary business settings, reflection has also been cast as a useful strategy to facilitate creative problem-solving. Challenging this idea, we conducted a series of lab experiments to examine the effects of reflection on creative problem-solving. Drawing from theory in cognitive psychology on knowledge structures, we argue that reflection may sometimes debilitate rather than improve creative problem-solving, due to the reinforcement of existing cognitive schemas and the resulting cognitive entrenchment. To test our theoretical arguments, we developed two alternative reflection strategies, imaginative reflection and vicarious elaboration. In Study 1 (N = 101), we observed a detrimental effect of task reflection on creative problem-solving, which was offset by having participants engage in imaginative reflection. In Study 2 (N = 191), vicarious elaboration, elaborating on another’s creative experiences instead of reflecting on one’s own creative experiences, was introduced as a second strategy to counter cognitive entrenchment. In Study 3 (N = 235), we combined the reflection strategies, demonstrating that imaginative thinking was more effective when focused on one’s own experiences rather than on others’ experiences (i.e., vicarious imaginative elaboration). Together, these findings increase our understanding of the effects of different reflection strategies, but also call for further research to address an intriguing observation: none of the reflection strategies led to better outcomes as compared to a control condition without reflection, suggesting that individual reflection might not help creative problem-solving at all.

     

The test–retest reliability of the latent construct of executive function depends on whether tasks are represented as formative or reflective indicators

This study investigates the test–retest reliability of a battery of executive function (EF) tasks with a specific interest in testing whether the method that is used to create a battery-wide score would result in differences in the apparent test–retest reliability of children’s performance. A total of 188 4-year-olds completed a battery of computerized EF tasks twice across a period of approximately two weeks. Two different approaches were used to create a score that indexed children’s overall performance on the battery—i.e., (1) the mean score of all completed tasks and (2) a factor score estimate which used confirmatory factor analysis (CFA). Pearson and intra-class correlations were used to investigate the test–retest reliability of individual EF tasks, as well as an overall battery score. Consistent with previous studies, the test–retest reliability of individual tasks was modest (rs ≈ .60). The test–retest reliability of the overall battery scores differed depending on the scoring approach (r_mean = .72; r_{factor_score} = .99). It is concluded that the children’s performance on individual EF tasks exhibit modest levels of test–retest reliability. This underscores the importance of administering multiple tasks and aggregating performance across these tasks in order to improve precision of measurement. However, the specific strategy that is used has a large impact on the apparent test–retest reliability of the overall score. These results replicate our earlier findings and provide additional cautionary evidence against the routine use of factor analytic approaches for representing individual performance across a battery of EF tasks.     

The complex problem-solving competence of team coaches

ObjectivesThe complexity and dynamics of team sports places high information-processing demands on coaches. They can meet these demands by applying either domain-specific or domain-unspecific problem-solving strategies.MethodThe first phase of this study used a domain-unspecific computer-simulated scenario (“heating oil company” [Hasselmann, D., & Strauss, B. (1993). Herausforderung Komplexität: Baustein 1 (HEIZÖLHANDEL) [The challenge of complexity: Building block 1 (heating oil company)]. Hamburg, Germany: Windmühle]) to measure domain-unspecific complex problem-solving strategies in 38 top-league coaches (first or second German national league in team handball or basketball) and 43 local-league coaches.ResultsResults showed that top-league coaches exhibited better problem-solving performance than lower-league coaches in an unspecific domain. The second phase recorded the real-life coaching behavior of some of these coaches 6 months later during competitions and analyzed the content of their utterances. The main findings were that top-league coaches (n=14) made fewer utterances in competitions, but gave relatively more concrete instructions compared with lower-league coaches (n=13). Top-league coaches also criticized and motivated their players more frequently during play. Comparing intervention behavior across the two settings (computer-simulated scenario vs. competition) disclosed some general problem-solving strategies (e.g., number of motivating utterances, strength of interventions).ConclusionIt is concluded that the achievement of sports coaches depends at least in part on their domain-general, complex problem-solving competence.