How to Gain Eleven IQ Points in Ten Minutes: Thinking Aloud Improves Raven's Matrices Performance in Older Adults

ABSTRACT

Few studies have examined the impact of age on reactivity to concurrent think-aloud (TA) verbal reports. An initial study with 30 younger and 31 older adults revealed that thinking aloud improves older adult performance on a short form of the Raven's Matrices (Bors & Stokes, 1998 Bors, D. A. and Stokes, T. L. 1998. Raven's Advanced Progressive Matrices: Norms for first-year university students and the development of a short form. Educational and Psychological Measurement, 58: 382–398. [Crossref], [Web of Science ®] , [Google Scholar], Educational and Psychological Measurement, 58, p. 382) but did not affect other tasks. In the replication experiment, 30 older adults (mean age = 73.0) performed the Raven's Matrices and three other tasks to replicate and extend the findings of the initial study. Once again older adults performed significantly better only on the Raven's Matrices while thinking aloud. Performance gains on this task were substantial (d = 0.73 and 0.92 in Experiments 1 and 2, respectively), corresponding to a fluid intelligence increase of nearly one standard deviation.     

Cognitive mediation of putting: Use of a think-aloud measure and implications for studies of golf-putting in the laboratory

ObjectivesWhereas accounts of skilled performance based on automaticity (Beilock & Carr, 2001; Fitts & Posner, 1967) emphasize reduced cognitive involvement in advanced skill, other accounts propose that skilled performance relies on increased cognitive control (Ericsson & Kintsch, 1995). The objective of this study was to test predictions differentiating the automaticity and cognitive control accounts by assessing thinking during golf putting.DesignThe cognitive processes of less-skilled and more-skilled golfers were examined during putting using concurrent, think-aloud verbal reports. The design included putting conditions that differed in complexity and thus the need to adapt the putt to the particular conditions.MethodPutting complexity was manipulated via changes to putt length and perceived stress during putting. Putts were executed from two starting locations (i.e., the same starting location as the previous putt or a new starting location).ResultsThe analysis showed that, during putting: more thoughts were verbalized overall by more-skilled golfers than less-skilled golfers; both groups verbalized more thoughts overall during higher-complexity putts (i.e., longer distance putts, and putts under higher stress when executed from a new starting location) than lower-complexity putts; and the two groups did not differ significantly in the number of thoughts related to motor mechanics.ConclusionsThe results of this study provide support for a cognitive control account of skilled performance and suggest that the path to skilled performance involves the acquisition of more refined higher-level cognitive representations mediating planning and analysis.     

On the validity of remember-know judgments: evidence from think aloud protocols

The use of remember–know judgments to assess subjective experience associated with memory retrieval, or as measures of recollection and familiarity processes, has been controversial. In the current study we had participants think aloud during study and provide verbal reports at test for remember–know and confidence (i.e., sure–probably) judgments. Results indicated that the vast majority of remember judgments for studied items were associated with recollection from study (87%), but this correspondence was less likely for high-confidence judgments (72%). Instead, high-confidence judgments were more likely than remember judgments to be associated with incorrect recollection and a lack of recollection. Know judgments were typically associated with a lack of recollection (62%), but still included recollection from the study context (33%). Thus, although remember judgments provided fairly accurate assessments of retrieval including contextual details, know judgments did not provide accurate assessments of retrieval lacking contextual details.     

Human machine interface design for continuous support of mode awareness during automated driving: An online simulation

In the transition towards higher levels of vehicle automation, one of the key concerns with regards to human factors is to avoid mode confusion, when drivers misinterpret the driving mode and therewith misjudge their own tasks and responsibility. To enhance mode awareness, a clear human centered Human Machine Interface (HMI) is essential. The HMI should support the driver tasks of both supervising the driving environment when needed and self-regulating their non-driving related activities (NDRAs). Such support may be provided by either presenting continuous information on automation reliability, from which the driver needs to infer what task is required, or by presenting continuous information on the currently required driving task and allowed NDRA directly. Additionally, it can be valuable to provide continuous information to support anticipation of upcoming changes in the automation mode and its associated reliability or required and allowed driver task(s). Information that could support anticipation includes the available time until a change in mode (i.e. time budget), information on the upcoming mode, and reasons for changing to the upcoming mode. The current work investigates the effects of communicating this potentially valuable information through HMI design. Participants received information from an HMI during simulated drives in a simulated car presented online (using Microsoft Teams) with an experimenter virtually accompanying and guiding each session. The HMI either communicated on automation reliability or on the driver task, and either included information supporting anticipation or did not include such information. Participants were thinking aloud during the simulated drives and reported on their experience and preferences afterwards. Anticipatory information supported understanding about upcoming changes without causing information overload or overreliance. Moreover, anticipatory information and information on automation reliability, and especially a combination of the two, best supported understandability and usability. Recommendations are provided for future work on facilitating supervision and NDRA self-regulation during automated driving through HMI design.     

Mental Models: An Alternative Evaluation of a Sensemaking Approach to Ethics Instruction

In spite of the wide variety of approaches to ethics training it is still debatable which approach has the highest potential to enhance professionals' integrity. The current effort assesses a novel curriculum that focuses on metacognitive reasoning strategies researchers use when making sense of day-to-day professional practices that have ethical implications. The evaluated trainings effectiveness was assessed by examining five key sensemaking processes, such as framing, emotion regulation, forecasting, self-reflection, and information integration that experts and novices apply in ethical decision-making. Mental models of trained and untrained graduate students, as well as faculty, working in the field of physical sciences were compared using a think-aloud protocol 6 months following the ethics training. Evaluation and comparison of the mental models of participants provided further validation evidence for sensemaking training. Specifically, it was found that trained students applied metacognitive reasoning strategies learned during training in their ethical decision-making that resulted in complex mental models focused on the objective assessment of the situation. Mental models of faculty and untrained students were externally-driven with a heavy focus on autobiographical processes. The study shows that sensemaking training has a potential to induce shifts in researchers' mental models by making them more cognitively complex via the use of metacognitive reasoning strategies. Furthermore, field experts may benefit from sensemaking training to improve their ethical decision-making framework in highly complex, novel, and ambiguous situations.     

Understanding text after severe closed-head injury: assessing inferences and memory operations with a think-aloud procedure

A think-aloud method was used to examine the content of information available to working memory during narrative comprehension in a CHI population. Twenty severe CHI participants (>1 year post-injury) and 20 controls talked aloud after they read each sentence of story narratives. Trabasso and Magliano's (1996a) verbal protocol analysis was then used to code for the production of inferential and non-inferential clauses and the memory operations that supported inferential clause production. We found that CHI and control groups produced a comparable number of clauses, that inferences dominated narrative comprehension, and that both groups produced more explanatory inferences than predictive or associative inferences. Despite these qualitative similarities, the CHI group demonstrated poorer comprehension, generated proportionately fewer inferences, relied less on retrieval as a memory source for explanatory inferences, and produced more non-inferential clauses and associative inferences.