Mechanisms and neural basis of object and pattern recognition: a study with chess experts

Comparing experts with novices offers unique insights into the functioning of cognition, based on the maximization of individual differences. Here we used this expertise approach to disentangle the mechanisms and neural basis behind two processes that contribute to everyday expertise: object and pattern recognition. We compared chess experts and novices performing chess-related and -unrelated (visual) search tasks. As expected, the superiority of experts was limited to the chess-specific task, as there were no differences in a control task that used the same chess stimuli but did not require chess-specific recognition. The analysis of eye movements showed that experts immediately and exclusively focused on the relevant aspects in the chess task, whereas novices also examined irrelevant aspects. With random chess positions, when pattern knowledge could not be used to guide perception, experts nevertheless maintained an advantage. Experts' superior domain-specific parafoveal vision, a consequence of their knowledge about individual domain-specific symbols, enabled improved object recognition. Functional magnetic resonance imaging corroborated this differentiation between object and pattern recognition and showed that chess-specific object recognition was accompanied by bilateral activation of the occipitotemporal junction, whereas chess-specific pattern recognition was related to bilateral activations in the middle part of the collateral sulci. Using the expertise approach together with carefully chosen controls and multiple dependent measures, we identified object and pattern recognition as two essential cognitive processes in expert visual cognition, which may also help to explain the mechanisms of everyday perception.     

Temporal Sequences Quantify the Contributions of Individual Fixations in Complex Perceptual Matching Tasks

Perceptual tasks such as object matching, mammogram interpretation, mental rotation, and satellite imagery change detection often require the assignment of correspondences to fuse information across views. We apply techniques developed for machine translation to the gaze data recorded from a complex perceptual matching task modeled after fingerprint examinations. The gaze data provide temporal sequences that the machine translation algorithm uses to estimate the subjects' assumptions of corresponding regions. Our results show that experts and novices have similar surface behavior, such as the number of fixations made or the duration of fixations. However, the approach applied to data from experts is able to identify more corresponding areas between two prints. The fixations that are associated with clusters that map with high probability to corresponding locations on the other print are likely to have greater utility in a visual matching task. These techniques address a fundamental problem in eye tracking research with perceptual matching tasks: Given that the eyes always point somewhere, which fixations are the most informative and therefore are likely to be relevant for the comparison task?     

Bothered by abstraction: the effect of expertise on knowledge transfer and subsequent novice performance.

Although experts should be well positioned to convey their superior knowledge and skill to novices, the organization of that knowledge, and particularly its level of abstraction, may make it difficult for them to do so. Using an electronic circuit-wiring task, the authors found that experts as compared with beginners used more abstract and advanced statements and fewer concrete statements when providing task instructions to novices. In a 2nd study, the authors found that beginner-instructed novices performed better than expert-instructed novices and reported fewer problems with the instructions when performing the same task. In Study 2, the authors found that although novices performed better on the target task when instructed by beginners, they did better on a different task within the same domain when instructed by experts. The evidence suggests that the abstract, advanced concepts conveyed by experts facilitated the transfer of learning between the different tasks.     

The relation between problem categorization and problem solving among experts and novices

These investigations were conducted to examine the relationship between problem-solving ability and the criteria used to decide that two classical mechanics problems would be solved similarly. We began by comparing experts and novices on a similarity judgment task and found that the experts predominantly relied on the problems' deep structures in deciding on similarity of solution, although the presence of surface-feature similarity had a clear adverse effect on performance. The novices relied predominantly on surface features, but were capable of using the problems' deep structures under certain conditions. In a second experiment, we compared groups of novices, at the same level of experience, who tended to employ different types of reasoning in making similarity judgments. Compared to novices who relied predominantly on surface features, novices who made greater use of principles tended to categorize problems similarly to how experts categorized them, as well as score higher in problem solving. These results suggest that principles play a fundamental role in the organization of conceptual and procedural knowledge for good problem solvers at all levels.     

Visual search strategies of baseball batters: eye movements during the preparatory phase of batting

The aim of this study was to analyze visual search strategies of baseball batters during the viewing period of the pitcher's motion. The 18 subjects were 9 experts and 9 novices. While subjects viewed a videotape which, from a right-handed batter's perspective, showed a pitcher throwing a series of 10 types of pitches, their eye movements were measured and analyzed. Novices moved their eyes faster than experts, and the distribution area of viewing points was also wider than that of the experts. The viewing duration of experts of the pitching arm was longer than those of novices during the last two pitching phases. These results indicate that experts set their visual pivot on the pitcher's elbow and used peripheral vision properties to evaluate the pitcher's motion and the ball trajectory.     

The influence of degree of expertise and objective task complexity on perceived task complexity and performance

Research on expertise has shown that nonexperts may sometimes outperform experts. Some researchers have suggested that superior performance by experts depends on the match between the experts' cognition and the demands of the task. The authors explored this issue using a quasi-experiment set in an organization. They examined how 3 sets of similar tasks that differ in their type of complexity can lead to differences in task perceptions and performance among experts, intermediates, and novices. The results suggest that experts and novices pay attention to different aspects of a task and that this affects both their perceptions of task complexity (i.e., task analyzability and variability) and their performance on the task.     

Cognitive engagement in emotional text reading: concurrent recordings of eye movements and head motion

ABSTRACT

The present study examined the effects of emotions on eye movements, head motion, and iPad motion during reading. Thirty-one participants read neutral, emotionally negative texts and emotionally positive texts on a digital tablet and both participants’ eye movements and body movements were recorded using respectively eye-tracking glasses and a motion capture system. The results showed that emotionally positive texts were read faster than neutral texts, and that readers’ movements decreased when reading emotional texts regardless of valence polarity. Recent studies suggested that postural movements may reflect cognitive engagement and especially the engagement in the task to be done. Our findings seem to validate this hypothesis of a bodily engagement in reading emotional contents. The present results suggest that the novel methodology of eye and postural movement recordings is informative in studying the readers’ embodied engagement during reading emotional materials.     

How eye movements affect unpleasant memories: support for a working-memory account

Eye movement desensitization and reprocessing can reduce ratings of the vividness and emotionality of unpleasant memories-hence it is commonly used to treat posttraumatic stress disorder. The present experiments compared three accounts of how eye movements produce these benefits. Participants rated unpleasant autobiographical memories before and after eye movements or an eyes stationary control condition. In Experiment 1, eye movements produced benefits only when memories were held in mind during the movements, and eye movements increased arousal, contrary to an investigatory-reflex account. In Experiment 2, horizontal and vertical eye movements produced equivalent benefits, contrary to an interhemispheric-communication account. In Experiment 3, two other distractor tasks (auditory shadowing, drawing) produced benefits that were negatively correlated with working-memory capacity. These findings support a working-memory account of the eye movement benefits in which the central executive is taxed when a person performs a distractor task while attempting to hold a memory in mind.     

Carryover of scanning behaviour affects upright face recognition differently to inverted face recognition

Face perception is characterized by a distinct scanpath. While eye movements are considered functional, there has not been direct evidence that disrupting this scanpath affects face recognition performance. The present experiment investigated the influence of an irrelevant letter-search task (with letter strings arranged horizontally, vertically, or randomly) on the subsequent scanning strategies in processing upright and inverted famous faces. Participants’ response time to identify the face and the direction of their eye movements were recorded. The orientation of the letter search influenced saccadic direction when viewing the face images, such that a direct carryover-effect was observed. Following a vertically oriented letter-search task, the recognition of famous faces was slower and less accurate for upright faces, and faster for inverted faces. These results extend the carryover findings of Thompson and Crundall into a novel domain. Crucially they also indicate that upright and inverted faces are better processed by different eye movements, highlighting the importance of scanpaths in face recognition.     

Colour and spatial cueing in low-prevalence visual search

People are able to judge the current position of occluded moving objects. This operation is known as motion extrapolation. It has previously been suggested that motion extrapolation is independent of the oculomotor system. Here we revisited this question by measuring eye position while participants completed two types of motion extrapolation task. In one task, a moving visual target travelled rightwards, disappeared, then reappeared further along its trajectory. Participants discriminated correct reappearance times from incorrect (too early or too late) with a two-alternative forced-choice button press. In the second task, the target travelled rightwards behind a visible, rectangular occluder, and participants pressed a button at the time when they judged it should reappear. In both tasks, performance was significantly different under fixation as compared to free eye movement conditions. When eye movements were permitted, eye movements during occlusion were related to participants' judgements. Finally, even when participants were required to fixate, small changes in eye position around fixation (<2°) were influenced by occluded target motion. These results all indicate that overlapping systems control eye movements and judgements on motion extrapolation tasks. This has implications for understanding the mechanism underlying motion extrapolation.     

The eyes know what you are thinking: eye movements as an objective measure of mind wandering

Paralleling the recent work by Reichle, Reineberg, and Schooler (2010), we explore the use of eye movements as an objective measure of mind wandering while participants performed a reading task. Participants were placed in a self-classified probe-caught mind wandering paradigm while their eye movements were recorded. They were randomly probed every 2–3 min and were required to indicate whether their mind had been wandering. The results show that eye movements were generally less complex when participants reported mind wandering episodes, with both duration and frequency of within-word regressions, for example, becoming significantly reduced. This is consistent with the theoretical claim that the cognitive processes that normally influence eye movements to enhance semantic processing during reading exert less control during mind wandering episodes.     

Gesturing during mental problem solving reduces eye movements,especially for individuals with lower visual working memory capacity

Non-communicative hand gestures have been found to benefit problem-solving performance. These gestures seem to compensate for limited internal cognitive capacities, such as visual working memory capacity. Yet, it is not clear how gestures might perform this cognitive function. One hypothesis is that gesturing is a means to spatially index mental simulations, thereby reducing the need for visually projecting the mental simulation onto the visual presentation of the task. If that hypothesis is correct, less eye movements should be made when participants gesture during problem solving than when they do not gesture. We therefore used mobile eye tracking to investigate the effect of co-thought gesturing and visual working memory capacity on eye movements during mental solving of the Tower of Hanoi problem. Results revealed that gesturing indeed reduced the number of eye movements (lower saccade counts), especially for participants with a relatively lower visual working memory capacity. Subsequent problem-solving performance was not affected by having (not) gestured during the mental solving phase. The current findings suggest that our understanding of gestures in problem solving could be improved by taking into account eye movements during gesturing.     

Learning From Peers’ Eye Movements in the Absence of Expert Guidance: A Proof of Concept Using Laboratory Stock Trading,Eye Tracking,and Machine Learning

Existing research shows that people can improve their decision skills by learning what experts paid attention to when faced with the same problem. However, in domains like financial education, effective instruction requires frequent, personalized feedback given at the point of decision, which makes it time‐consuming for experts to provide and thus, prohibitively costly. We address this by demonstrating an automated feedback mechanism that allows amateur decision‐makers to learn what information to attend to from one another, rather than from an expert. In the first experiment, eye movements of N = 100 subjects were recorded while they repeatedly performed a standard behavioral finance investment task. Consistent with previous studies, we found that a significant proportion of subjects were affected by decision bias. In the second experiment, a different group of N = 100 subjects faced the same task but, after each choice, they received individual, machine learning‐generated feedback on whether their pre‐decision eye movements resembled those made by Experiment 1 subjects prior to good decisions. As a result, Experiment 2 subjects learned to analyze information similarly to their successful peers, which in turn reduced their decision bias. Furthermore, subjects with low Cognitive Reflection Test scores gained more from the proposed form of process feedback than from standard behavioral feedback based on decision outcomes.     

Eye—response lags during a continuous monitoring task

We measured the temporal relationship between eye movements and manual responses while experts and novices watched a videotaped football match. Observers used a joystick to continuously indicate the likelihood of an imminent goal. We measured correlations between manual responses and between-subjects variability in eye position. To identify the lag magnitude, we repeated these correlations over a range of possible delays between these two measures and searched for the most negative correlation coefficient. We found lags in the order of 2 sec and an effect of expertise on lag magnitude, suggesting that expertise has its effect by directing eye movements to task-relevant areas of a scene more quickly, facilitating a longer processing duration before behavioral decisions are made. This is a powerful new method for examining the eye movement behavior of multiple observers across complex moving images.     

Do common systems control eye movements and motion extrapolation?

People are able to judge the current position of occluded moving objects. This operation is known as motion extrapolation. It has previously been suggested that motion extrapolation is independent of the oculomotor system. Here we revisited this question by measuring eye position while participants completed two types of motion extrapolation task. In one task, a moving visual target travelled rightwards, disappeared, then reappeared further along its trajectory. Participants discriminated correct reappearance times from incorrect (too early or too late) with a two-alternative forced-choice button press. In the second task, the target travelled rightwards behind a visible, rectangular occluder, and participants pressed a button at the time when they judged it should reappear. In both tasks, performance was significantly different under fixation as compared to free eye movement conditions. When eye movements were permitted, eye movements during occlusion were related to participants' judgements. Finally, even when participants were required to fixate, small changes in eye position around fixation (<2°) were influenced by occluded target motion. These results all indicate that overlapping systems control eye movements and judgements on motion extrapolation tasks. This has implications for understanding the mechanism underlying motion extrapolation.     

An integrated model of eye movements and visual encoding

Recent computational models of cognition have made good progress in accounting for the visual processes needed to encode external stimuli. However, these models typically incorporate simplified models of visual processing that assume a constant encoding time for all visual objects and do not distinguish between eye movements and shifts of attention. This paper presents a domain-independent computational model, EMMA, that provides a more rigorous account of eye movements and visual encoding and their interaction with a cognitive processor. The visual-encoding component of the model describes the effects of frequency and foveal eccentricity when encoding visual objects as internal representations. The eye-movement component describes the temporal and spatial characteristics of eye movements as they arise from shifts of visual attention. When integrated with a cognitive model, EMMA generates quantitative predictions concerning when and where the eyes move, thus serving to relate higher-level cognitive processes and attention shifts with lower-level eye-movement behavior. The paper evaluates EMMA in three illustrative domains — equation solving, reading, and visual search — and demonstrates how the model accounts for aspects of behavior that simpler models of cognitive and visual processing fail to explain.     

Attentional strategies for studying scientific texts

Content-area novices develop rules as to what types of information (e.g., definitions, facts, equations) are important in texts (Dee-Lucas & Larkin, 1988). The study reported here indicates that these rules influence text learning. Experts and novices read and recalled science texts. Reading times and recall for different types of content were compared for the two groups. Results indicate that novices’ importance rules function as part of novices’ control schema during reading, influencing their attentional processes and the resulting representation formed for the text. This was evident in qualitative differences between experts and novices in their attentional patterns and text recall. The study also found that the number of passage readings and the passage topic have a greater influence on the reading times of exports, but both groups adjust processing time according to the hierarchical level of the passage content. The findings are discussed in terms of their implications for novices learning from texts.     

Attending to the execution of a complex sensorimotor skill: expertise differences, choking, and slumps

A simulated baseball batting task was used to compare the relative effects of attending to extraneous information (tone frequency) and attending to skill execution (direction of bat movement) on performance and swing kinematics and to evaluate how these effects differ as a function of expertise. The extraneous dual task degraded batting performance in novices but had no significant effect on experts. The skill-focused dual task increased batting errors and movement variability for experts but had no significant effect on novices. For expert batters, accuracy in the skill-focused dual task was inversely related to the current level of performance. Expert batters were significantly more accurate in the skill-focused dual task when placed under pressure. These findings indicate that the attentional focus varies substantially across and within performers with different levels of expertise.     

Facial comparison behaviour of forensic facial examiners

Facial examiners make visual comparisons of face images to establish the identities of persons in police investigations. This study utilised eye-tracking and an individual differences approach to investigate whether these experts exhibit specialist viewing behaviours during identification, by comparing facial examiners with forensic fingerprint analysts and untrained novices across three tasks. These comprised of face matching under unlimited (Experiment 1) and time-restricted viewing (Experiment 2), and with a feature-comparison protocol derived from examiner casework procedures (Experiment 3). Facial examiners exhibited individual differences in facial comparison accuracy and did not consistently outperform fingerprint analysts and novices. Their behaviour was also marked by similarities to the comparison groups in terms of how faces were viewed, as evidenced from eye movements, and how faces were perceived, based on the made feature judgements and identification decisions. These findings further understanding of how facial comparisons are performed and clarify the nature of examiner expertise.