Recall or evaluation of chess positions as determinants of chess skill

Previous research has found that the ability to recall briefly presented chess positions varies with playing strength, except when random positions are used. The suggestion therefore arises that mastery consists of recognizing configurations that are associated with plausible moves. This approach is tested by comparing the memory scores and move-choice protocols of players in six skill categories, using random chess positions. Contrary to any strong form of recognition-association hypothesis, differences in chess skill are shown to persist although memory differences are abolished. It is further shown that the moves selected are not based on those few pieces that are remembered. Skill-related differences in the accuracy of positional evaluations also occur, but they are less marked than in earlier results. An alternative approach to chess skill seems appropriate, in which memory effects may function at the evaluation phase.     

The effects of speed on skilled chess performance

Two types of mechanisms may underlie chess skill: fast mechanisms, such as recognition, and slow mechanisms, such as search through the space of possible moves and responses. Speed distinguishes these mechanisms, so I examined archival data on blitz chess (5 min for the whole game), in which the opportunities for search are greatly reduced. If variation in fast processes accounts for substantial variation in chess skill, performance in blitz chess should correlate highly with a player's overall skill. In addition, restricting search processes should tend to equalize skill difference between players, but this effect should decrease as overall skill level increases. Analyses of three samples of blitz chess tournaments supported both hypotheses. Search is undoubtedly important, but up to 81% of variance in chess skill (measured by rating) was accounted for by how players performed with less than 5% of the normal time available.     

A Pattern-recognition Theory of Search in Expert Problem Solving

Understanding how look-ahead search and pattern recognition interact is one of the important research questions in the study of expert problem solving. This paper examines the implications of the template theory (Gobet & Simon, 1996a), a recent theory of expert memory, on the theory of problem solving in chess. Templates are “chunks” (Chase & Simon, 1973) that have evolved into more complex data structures and that possess slots allowing values to be encoded rapidly. Templates may facilitate search in three ways: (a) by allowing information to be stored into LTM rapidly; (b) by allowing a search in the template space in addition to a search in the move space; and (c) by compensating loss in the “mind's eye” due to interference and decay. A computer model implementing the main ideas of the theory is presented, and simulations of its search behaviour are discussed. The template theory accounts for the slight skill difference in average depth of search found in chess players, as well as for other empirical data.     

THE ROLES OF RECOGNITION PROCESSES AND LOOK-AHEAD SEARCH IN TIME-CONSTRAINED EXPERT PROBLEM SOLVING:

Abstract— Chess has long served as an important standard task environment for research on human memory and problem-solving abilities and processes In this article, we report evidence on the relative importance of recognition processes and planning (look-ahead) processes in very high level expert performance in chess The data show that the rated skill of a top-level grand master is only slightly lower when he is playing simultaneously against a half-dozen grand-master opponents than under tournament conditions that allow much more time for each move As simultaneous play allows little time for look-ahead processes, the data indicate that recognition, based on superior chess knowledge, plays a much larger part in high-level skill in this task than does planning by looking ahead.     

The effects of time pressure on chess skill: an investigation into fast and slow processes underlying expert performance

The ability to play chess is generally assumed to depend on two types of processes: slow processes such as search, and fast processes such as pattern recognition. It has been argued that an increase in time pressure during a game selectively hinders the ability to engage in slow processes. Here we study the effect of time pressure on expert chess performance in order to test the hypothesis that compared to weak players, strong players depend relatively heavily on fast processes. In the first study we examine the performance of players of various strengths at an online chess server, for games played under different time controls. In a second study we examine the effect of time controls on performance in world championship matches. Both studies consistently show that skill differences between players become less predictive of the game outcome as the time controls are tightened. This result indicates that slow processes are at least as important for strong players as they are for weak players. Our findings pose a challenge for current theorizing in the field of expertise and chess.     

Recall or evaluation of chess positions revisited: the relationship between memory and evaluation in chess skill

We extend work by Holding and Reynolds (1982) on recall and problem solving with quasirandom chess positions. We tested 17 chess players on both quasirandom and structured chess positions. Consistent with the earlier study, initial recall of quasirandom chess positions is unrelated to chess skill level, and quality of the move selected in subsequent problem solving is related to skill level. However, recall following problem solving is related to chess skill level. These results support the view that pattern recognition processes underlie superior performance by skilled chess players, contrary to the conclusions of Holding and Reynolds (1982). Mechanisms such as long-term working memory retrieval structures (Ericsson & Kintsch, 1995) or templates (Gobet & Simon, 1996a) could explain the effective encoding of quasirandom positions during problem solving.     

Pattern recognition makes search possible: Comments on Holding (1992)

Chase and Simon's chunking theory of expert memory, which emphasizes the role of pattern recognition in problem solving, has attracted much attention in cognitive psychology. Holding advanced a series of criticisms that, taken together, purported to refute the theory. Two valid criticisms – that chunk size and LTM encoding were underestimated – are dealt with by a simple extension of the theory. The remainder of Holding's criticisms either are not empirically founded or are based on a misunderstanding of the chunking theory and its role in a comprehensive theory of skill. Holding's alternative SEEK theory, which emphasizes the role of search, lacks key mechanisms that could be implemented by the type of pattern recognition proposed by Chase and Simon. Received: 3 September 1997 / Accepted: 28 January 1998     

Chess databases as a research vehicle in psychology: Modeling large data

The game of chess has often been used for psychological investigations, particularly in cognitive science. The clear-cut rules and well-defined environment of chess provide a model for investigations of basic cognitive processes, such as perception, memory, and problem solving, while the precise rating system for the measurement of skill has enabled investigations of individual differences and expertise-related effects. In the present study, we focus on another appealing feature of chess—namely, the large archive databases associated with the game. The German national chess database presented in this study represents a fruitful ground for the investigation of multiple longitudinal research questions, since it collects the data of over 130,000 players and spans over 25 years. The German chess database collects the data of all players, including hobby players, and all tournaments played. This results in a rich and complete collection of the skill, age, and activity of the whole population of chess players in Germany. The database therefore complements the commonly used expertise approach in cognitive science by opening up new possibilities for the investigation of multiple factors that underlie expertise and skill acquisition. Since large datasets are not common in psychology, their introduction also raises the question of optimal and efficient statistical analysis. We offer the database for download and illustrate how it can be used by providing concrete examples and a step-by-step tutorial using different statistical analyses on a range of topics, including skill development over the lifetime, birth cohort effects, effects of activity and inactivity on skill, and gender differences.     

Patterns of theorizing about chess skill – Commentary on Linhares and Freitas (2010) and Lane and Gobet (2011)

Although Linhares and Freitas (2010) have failed to characterize earlier experimental work in chess skill accurately, their conceptual approach of “experience-recognition”-driven problem solving points to the need to incorporate analogical reasoning mechanisms into explanations of how chess players choose the best move in chess. The Lane and Gobet (2011) commentary and the cognitive simulation models that they espouse consist of plausible mechanisms to support choosing a good move, but need additional development to incorporate abstract/semantic information. One possible avenue for future exploration will be to produce hybrid models that use both “piece-on-square” chunk and template representations and abstract high-level representations to guide search in chess.     

Expertise and age effects on knowledge activation in chess

Novice, intermediate, and expert chess players of various ages, playing with two chess pieces on a quarter-section of a chessboard, performed a simple task to detect that the king is in check or is threatened with being in check. Age slowed response for both tasks. An interaction of task and skill revealed differences in diminishing response time between check and threat tasks as skill increased; experts were equally fast on both tasks. Measures of speed and working memory were negatively related to age but unrelated to skill. Skill did not mitigate age-related effects on speed of detection. These results suggest that knowledge-activation processes necessary to assess basic chess relationships slow with age, even in experts.     

Judgment and decision-making: experts' and novices' evaluation of chess positions

The present study examined how experts differ from nonexperts in estimation and evaluation during a judgment-and-decision task. In the experiment, the performance of 125 chess players (21 women and 104 men) whose mean age was 32.5 yr. (SD = 13.3) was examined to assess decision processes with an emphasis on postdecision differentiation and consolidation. Chess players of differing skill made evaluations of a complex middle-game chess position. The experimental condition was made by the means of chess articles with enclosed information, either about the current chess position or about other similar positions. Both novices and experts upgraded their chosen alternative in a postdecision phase more than intermediate level chess players did. Various explanations of these results are discussed.     

Chess as a Behavioral Model for Cognitive Skill Research: Review of Blindfold Chess by Eliot Hearst and John Knott

This multifaceted work on chess played without sight of the pieces is a sophisticated psychologist's examination of this topic and of chess skill in general, including a detailed and comprehensive historical account. This review builds on Hearst and Knott's assertion that chess can provide a uniquely useful model for research on several issues in the area of cognitive skill and imagery. A key issue is the relationship between viewing a stimulus and mental imagery in the light of blindfold chess masters' consistent reports that they do not use or have images. This review also proposes a methodology for measuring and quantifying an individual's skill shortfall from a theoretical maximum. This methodology, based on a 1951 proposal by Claude Shannon, is applicable to any choice situation in which all the available choices are known. The proposed “Proficiency” measure reflects the equivalent number of “yes—no” questions that would have been required to arrive at a best choice, considering also the time consumed. As the measure provides a valid and nonarbitrary way to compare different skills and the effects of different independent variables on a given skill, it may have a wide range of applications in cognitive skill research, skill training, and education.     

Visualization,pattern recognition,and forward search: effects of playing speed and sight of the position on grandmaster chess errors

A new approach examined two aspects of chess skill, long a popular topic in cognitive science. A powerful computer‐chess program calculated the number and magnitude of blunders made by the same 23 grandmasters in hundreds of serious games of slow (“classical”) chess, regular “rapid” chess, and rapid “blindfold” chess, in which opponents transmit moves without ever seeing the actual position. Rapid chess led to substantially more and larger blunders than classical chess. Perhaps more surprisingly, the frequency and magnitude of blunders did not differ in rapid versus blindfold play, despite the additional memory and visualization load imposed by the latter. We discuss the involvement of various cognitive processes in human problem‐solving and expertise, especially with respect to chess. Prior opposing views about the basis of general chess skill have emphasized the dominance of either (a) swift pattern recognition or (b) analyzing ahead, but both seem important and the controversy appears currently unresolvable and perhaps fruitless.     

Five Seconds or Sixty? Presentation Time in Expert Memory

For many years, the game of chess has provided an invaluable task environment for research on cognition, in particular on the differences between novices and experts and the learning that removes these differences, and upon the structure of human memory and its paramaters. The template theory presented by Gobet and Simon based on the EPAM theory offers precise predictions on cognitive processes during the presentation and recall of chess positions. This article describes the behavior of CHREST, a computer implementation of the template theory, in a memory task when the presentation time is varied from one second to sixty, on the recall of game and random positions, and compares the model to human data. Strong players are better than weak players in both types of positions, especially with long presentation times, but even after brief presentations. CHREST predicts the data, both qualitatively and quantitatively. Strong players' superiority with random positions is explained by the large number of chunks they hold in LTM. Their excellent recall with short presentation times is explained by templates, a special class of chunks. CHREST is compared to other theories of chess skill, which either cannot account for the superiority of Masters in random positions or predict too strong a performance of Masters in such positions.     

Chess players' intake of task-relevant cues

Patterns of chess pieces are important for chess players in storing information in memory-recall tasks. It also may be assumed that these patterns play a central role in the perceptual coding of task-relevant cues. Two perceptual classification experiments were done to test this assumption. Chess-players' intake of task-relevant cues was studied by measuring the reaction times of subjects in counting the minor pieces on the chessboard or searching for checks in the game and in random positions. Surprisingly, there was no interaction between the level of skill and the type of position. In Experiment 3, both a perceptual classification task and a memory-recall task using the same positions were presented to a group of chess players at the same session. In the perceptual classification task, there was no interaction between the level of skill and the type of position, but in the recall task there was strong interaction. The result suggests that the information intake of chess players, in its lowest levels, is not dependent on the learned patterns. The role of the patterns becomes important in defining the information to be looked for, but the patterns are not important in the early-stage perceptual structuring of a position.     

The role of attack and defense semantics in skilled players’ memory for chess positions

There is much evidence that chess skill is based on chunks in memory that represent parts of positions from previously encountered games. However, the content of these chunks is a matter for debate. According to one view, (1) the closer two pieces are to each other on a board (proximity), the more likely they are to be in the same chunk, and (2) skilled players encode the precise locations of pieces. An alternative view is that what information is encoded in a chess chunk is determined more by processing of the attack/defense relations during evaluation. In three experiments, participants evaluated positions and completed recognition tests. Experiment 1 supported the view that expert players make more use of attack/defense relations than of locations of pieces in a recognition test. Experiments 2 and 3 demonstrated that, for both long and short presentation times, expert players' recognition for a piece within a position was primed more by a piece related by attack or defense than by a piece merely proximal. These findings challenge theories of expertise for chess that assume a primary role for proximity and location in determining which pieces are grouped together in memory.     

Meta-analysis of age and skill effects on recalling chess positions and selecting the best move

A meta-analysis was conducted of studies that measured the effects of both age and skill in chess on the tasks of selecting the best move for chess positions (the best move task) as well as recalling chess game positions (the recall task). Despite a small sample of studies, we demonstrated that there are age and skill effects on both tasks: age being negatively associated with performance on both tasks and skill being positively associated with performance on both tasks. On the best move task, we found that skill was the dominant effect, while on the recall task, skill and age were approximately equally strong effects. We also found that skill was best measured by the best move task. In the case of the best move task, this result is consistent with the argument that it accurately replicates expert performance (Ericsson & Smith, 1991). Results for the recall task argue that this task captures effects related to skill, but also effects likely due to a general aging process. Implications for our understanding of aging in skilled domains are also discussed.     

Slow and fast chess performance across three expert levels

ObjectivesSlow and fast thinking are crucial for human decision making in several domains of human activity including sports. These cognitive processes are remarkable in the intellectually demanding sport of chess. Slow and fast thinking underlie chess performance. However, the relative influence of each process has elicited controversial findings. Moreover, individual differences in chess skill are likely to moderate the integration of both processes.DesignThe simultaneous change over six time points in slow and fast chess performance was analyzed with a cross-domain latent curve model (LCM).MethodArchival data from an extensive group of chess players (n = 32,173) were included in these analyses at untitled, intermediate, and advanced levels of expertise. Intercept and slope latent factors of growth were specified and correlated for both processes.ResultsThere were remarkable differences in the change in slow and fast performance regarding the three expert levels, and in the concurrent interrelationship of both processes. The interdependence between both processes was more robust for the advanced than for the untitled and intermediate players.ConclusionsThese findings suggest that a better integration of slow and fast performance is produced at higher levels of expertise.     

Chess expertise in children

This paper reports several studies of chess expertise in children who play competitive chess. The first study examines (1) the relationship between experience and skill among 113 school-age children (grades 1 through 12); and (2) the relationship between chess skill and scores on various spatial and logical abilities tests among the top 15 players. Improvement in skill is related to experience, and chess players score higher than average on the Raven's Progressive Matrices. Also, scores on a chess-specific test, the Knight's Tour, correlate with scores on the Raven's. The second study reports three experiments with 59 Ss involving chess-specific tasks in memory, perception, and similarity judgements. The first two experiments replicated and extended Chase and Simon (1973). The third experiment, which asked Ss to judge similarities of chess positions, demonstrated that similarity judgements become more global and abstract with increased skill. The final section describes qualitatively how children's chess expertise compares to that of adults. Drawing upon Anderson (1985), we focus on some distinctive features of children's chess play and on some successful techniques in coaching young players.     

The role of constraints in expert memory

A great deal of research has been devoted to developing process models of expert memory. However, K. J. Vicente and J. H. Wang (1998) proposed (a) that process theories do not provide an adequate account of expert recall in domains in which memory recall is a contrived task and (b) that a product theory, the constraint attunement hypothesis (CAH), has received a significant amount of empirical support. We compared 1 process theory (the template theory; TT; F. Gobet & H. A. Simon, 1996c) with the CAH in chess. Chess players (N=36) differing widely in skill levels were required to recall briefly presented chess positions that were randomized in various ways. Consistent with TT, but inconsistent with the CAH, there was a significant skill effect in a condition in which both the location and distribution of the pieces were randomized. These and other results suggest that process models such as TT can provide a viable account of expert memory in chess.