The influence of articulation,self‐monitoring ability,and sensitivity to others on creativity

Although it is often recommended to think aloud to solve problems and to become more creative, cognitive and social psychological research suggests thinking aloud may actually produce less creative ideas than thinking in silence. The results of two experiments indeed showed that thinking aloud hinders creativity—although people produced the same amount of new uses for an object, these were judged to be less original in the thinking aloud condition. Experiment 2 further showed that this effect was particularly pronounced for individuals with high sensitivity to what other's think of them and low ability to adapt to these expectations. From this, we conclude that the felt presence of an actual or implied audience when thinking aloud, reduces creative idea generation especially among those having difficulty adapting to others. Implications for creativity research, and for promoting creativity in applied settings such as organizational teams are discussed. Copyright © 2006 John Wiley & Sons, Ltd.     

Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods

Since its establishment, psychology has struggled to find valid methods for studying thoughts and subjective experiences. Thirty years ago, Ericsson and Simon (1980) proposed that participants can give concurrent verbal expression to their thoughts (think aloud) while completing tasks without changing objectively measurable performance (accuracy). In contrast, directed requests for concurrent verbal reports, such as explanations or directions to describe particular kinds of information, were predicted to change thought processes as a consequence of the need to generate this information, thus altering performance. By comparing performance of concurrent verbal reporting conditions with their matching silent control condition, Ericsson and Simon found several studies demonstrating that directed verbalization was associated with changes in performance. In contrast, the lack of effects of thinking aloud was merely suggested by a handful of experimental studies. In this article, Ericsson and Simon's model is tested by a meta-analysis of 94 studies comparing performance while giving concurrent verbalizations to a matching condition without verbalization. Findings based on nearly 3,500 participants show that the "think-aloud" effect size is indistinguishable from zero (r = -.03) and that this procedure remains nonreactive even after statistically controlling additional factors such as task type (primarily visual or nonvisual). In contrast, procedures that entail describing or explaining thoughts and actions are significantly reactive, leading to higher performance than silent control conditions. All verbal reporting procedures tend to increase times to complete tasks. These results suggest that think-aloud should be distinguished from other methods in future studies. Theoretical and practical implications are discussed.     

The validity of verbal protocols

The reactivity of a "think aloud" verbal protocol and the veridicality of different retrospective protocols were tested over four dissimilar tasks. Generating a concurrent protocol altered accuracy in two tasks, simple addition and a choice between two gambles, and generally prolonged response times. Such reactivity partially qualifies the dominant theory of protocol generation (Ericsson & Simon, 1984). Retrospective protocols yielded substantial forgetting or fabrication in all tasks, supporting the consensus on the nonveridicality of these methods. It is concluded that protocol validity should be based on an empirical check rather than on theory-based assurances.     

Thinking aloud performance: Individual consistencies over tasks

Previous research (Gilhooly, 1987) indicated considerable individual consistency in quantity and quality of thinking aloud performance over three 8-puzzle tasks. The present study investigated the consistency of individual thinking aloud performance over two types of tasks. One type was largely spatial (the 8-puzzle) and the other largely verbal (the Poisoned Foods task). Considerable individual consistency in thinking aloud performance was found within each task type and, more importantly, between types of task. Thus, subjects who produced lengthy and complete protocols on the 8-puzzle problems also did so in the Poisoned Foods task. These results are discussed in the context of Ericsson and Simon’s (1984) model of thinking aloud.     

Thinking aloud performance: Individual consistencies over tasks

Previous research (Gilhooly, 1987) indicated considerable individual consistency in quantity and quality of thinking aloud performance over three 8-puzzle tasks. The present study investigated the consistency of individual thinking aloud performance over two types of tasks. One type was largely spatial (the 8-puzzle) and the other largely verbal (the Poisoned Foods task). Considerable individual consistency in thinking aloud performance was found within each task type and, more importantly, between types of task. Thus, subjects who produced lengthy and complete protocols on the 8-puzzle problems also did so in the Poisoned Foods task. These results are discussed in the context of Ericsson and Simon’s (1984) model of thinking aloud.     

Following the wrong footsteps: fixation effects of pictorial examples in a design problem-solving task

Two experiments examined possible negative transfer in nonexperts from the use of pictorial examples in a laboratory design problem-solving situation. In Experiment 1, 89 participants were instructed to "think aloud" and were assigned to 1 of 3 conditions: (a) control (standard instructions), (b) fixation (inclusion of a problematic example, describing its problematic elements), or (c) defixation (inclusion of a problematic example, with instructions to avoid using problematic elements). Negative transfer due to examples was measured both quantitatively and qualitatively through verbal protocols. Verbal protocols (N = 176) were analyzed for participants' reasons for reference to the examples. In Experiment 2, fixation to examples was evaluated in nonverbalizing participants (N = 60). Results of both experiments suggest that (a) although participants consulted the problem instructions, they tended to follow the examples even when they included inappropriate elements and (b) the fixation effects can be diminished with the use of defixating instructions.     

Protocol analysis of the correspondence of verbal behavior and equivalence class formation.

In two equivalence experiments, a "think aloud" procedure modeled after Ericsson and Simon's (1980) protocol analysis was implemented to examine subjects' covert verbal responses during matching to sample. The purpose was to identify variables that might explain individual differences in equivalence class formation. The results from Experiment 1 suggested that subjects who formed equivalence classes described the relations among stimuli, whereas those not showing equivalence described sample and comparison stimuli as unitary compounds. Because Experiment 1 only demonstrated a correlation between describing stimulus compounds and the absence of equivalence classes, a second study was conducted. In Experiment 2, equivalence class formation was brought under experimental control through pretraining manipulations that facilitated responding either to stimulus compounds or to relations among stimuli. The results demonstrated that a history of describing stimulus compounds, when compared with describing the relations among the stimuli, interfered with the emergence of stimulus equivalence. These findings clarify individual differences in stimulus equivalence. They also demonstrate the utility of analyzing verbal reports to identify possible variables that can be manipulated experimentally.     

Reading aloud: spelling-sound translation uses central attention

Contrary to the received view that reading aloud reflects processes that are "automatic," recent evidence suggests that some of these processes require a form of attention. This issue was investigated further by examining the effect of a prior presentation of exception words (words whose spelling-sound translation are atypical, such as pint as compared with mint, hint, or lint) and pseudohomophones (nonwords that sound identical to words, such as brane from brain) on reading aloud in the context of the psychological refractory period paradigm. For exception words, the joint effects of repetition and stimulus onset asynchrony (SOA) yielded an underadditive interaction on the time to read aloud, replicating previous work -- a short SOA between Task 1 and Task 2 increased reaction time (RT) and reduced the magnitude of the repetition effect relative to the long SOA. For pseudohomophones, in contrast, the joint effects of repetition and SOA were additive on RT. These results provide converging evidence for the conclusion that (a) processing up to and including the orthographic input lexicon does not require central attention when reading aloud, whereas (b) translating lexical and sublexical spelling to sound requires the use of central attention.     

The effect of pictorial context on sentence memory in Broca's and Wernicke's aphasia

Eighteen aphasic patients (8 Broca's and 10 Wernicke's aphasics), 11 right hemisphere damaged patients and 12 normal subjects were tested to assess the effect of pictorial context on verbal memory with a sentence recognition task. The subjects were read aloud a stimulus sentence describing a simple event and simultaneously shown a picture congruent or incongruent with the sentence. Immediately following or after an interval of 30 sec, the subjects were read aloud a second sentence and asked to judge whether this sentence was the same or different from the stimulus sentence. The results indicated that verbal memory was better retained in supportive situations than in distracting situations, and that this contextual effect was greater in aphasic patients than in any of the other groups. Verbal memory declined rapidly after an interval in aphasic patients, but not in normal subjects. The Broca's and the Wernicke's aphasics demonstrated different performance patterns when semantic analysis of sentences was critical.     

What you say matters: exploring visual-verbal interactions in visual working memory

The aim of this study was to explore whether the content of a simple concurrent verbal load task determines the extent of its interference on memory for coloured shapes. The task consisted of remembering four visual items while repeating aloud a pair of words that varied in terms of imageability and relatedness to the task set. At test, a cue appeared that was either the colour or the shape of one of the previously seen objects, with participants required to select the object's other feature from a visual array. During encoding and retention, there were four verbal load conditions: (a) a related, shape-colour pair (from outside the experimental set, i.e., "pink square"); (b) a pair of unrelated but visually imageable, concrete, words (i.e., "big elephant"); (c) a pair of unrelated and abstract words (i.e., "critical event"); and (d) no verbal load. Results showed differential effects of these verbal load conditions. In particular, imageable words (concrete and related conditions) interfered to a greater degree than abstract words. Possible implications for how visual working memory interacts with verbal memory and long-term memory are discussed.     

Determinants of Short-term Forgetting: Decay,Retroactive Interference,or Proactive Interference?

In two experiments short-term forgetting was investigated in a short-term cued recall task designed to examine proactive interference effects. Mixed modality study lists were tested at varying retention intervals using verbal and nonverbal distractor activities. When an interfering foil was read aloud and a target item read silently, strong PI effects were observed for both types of distractor activity. When the target was read aloud and followed by a verbal distractor activity, weak PI effects emerged. However, when a target item was read aloud and nonverbal distractor activity filled the retention interval, performance was immune to the effects of PI for at least 8 seconds. The results indicate that phonological representations of items read aloud still influence performance after 15 seconds of distractor activity.     

Introspecting in the spirit of William James: comment on Fox, Ericsson, and Best (2011)

Fox, Ericsson, and Best's (2011) thoughtful justification of the use of think-aloud protocols for revealing the stream of consciousness comes on the centennial of the death of William James, history's greatest practitioner and advocate of introspection. This confluence naturally invites speculation about how James might have responded to the analysis of Fox et al. I suggest that although James would likely view the think-aloud procedure as a scientifically rigorous form of introspection, he would also admonish us not to overlook its limitations. Most notably, although the think-aloud procedure readily captures substantive verbal thoughts, it is less able to capture inchoate cognitions. The conclusion that verbal protocols are nonreactive also raises several additional issues. First, the nonreactivity of thinking aloud does not necessarily speak to its validity. Second, the conclusion that verbal protocols are benign is at odds with recent findings in which verbalization impairs performance on various tasks. I suggest that whereas James might express some concerns regarding aspects of conscious thought that may be overlooked by the think-aloud procedure as well as some caution regarding the possible situations in which thinking aloud might still be reactive, he would almost certainly be pleased to see introspection finally getting the scientific grounding that it deserves.     

On the validity of remember-know judgments: evidence from think aloud protocols

The use of remember–know judgments to assess subjective experience associated with memory retrieval, or as measures of recollection and familiarity processes, has been controversial. In the current study we had participants think aloud during study and provide verbal reports at test for remember–know and confidence (i.e., sure–probably) judgments. Results indicated that the vast majority of remember judgments for studied items were associated with recollection from study (87%), but this correspondence was less likely for high-confidence judgments (72%). Instead, high-confidence judgments were more likely than remember judgments to be associated with incorrect recollection and a lack of recollection. Know judgments were typically associated with a lack of recollection (62%), but still included recollection from the study context (33%). Thus, although remember judgments provided fairly accurate assessments of retrieval including contextual details, know judgments did not provide accurate assessments of retrieval lacking contextual details.     

Web usability evaluation with screen reader users: implementation of the partial concurrent thinking aloud technique

A verbal protocol technique, adopted for a web usability evaluation, requires that the users are able to perform a double task: surfing and talking. Nevertheless, when blind users surf by using a screen reader and talk about the way they interact with the computer, the evaluation is influenced by a structural interference: users are forced to think aloud and listen to the screen reader at the same time. The aim of this study is to build up a verbal protocol technique for samples of visual impaired users in order to overcome the limits of concurrent and retrospective protocols. The technique we improved, called partial concurrent thinking aloud (PCTA), integrates a modified set of concurrent verbalization and retrospective analysis. One group of 6 blind users and another group of 6 sighted users evaluated the usability of a website using PCTA. By estimating the number of necessary users by the means of an asymptotic test, it was found out that the two groups had an equivalent ability of identifying usability problems, both over 80%. The result suggests that PCTA, while respecting the properties of classic verbal protocols, also allows to overcome the structural interference and the limits of concurrent and retrospective protocols when used with screen reader users. In this way, PCTA reduces the efficiency difference of usability evaluation between blind and sighted users.     

Emotional memory for words: Separating content and context

We developed a technique to examine the effects of emotional content and context on verbal memory. Two sets of sentences were devised: in the first, each sentence was emotionally arousing due to the inclusion of an emotional “target” word. In the second set, “targets” were replaced with well-matched neutral words. Subjects read aloud a selection of emotional and neutral sentences, and were then surprised with memory tasks after a range of time delays. Emotional target words were remembered significantly better than neutral words in all experiments. Recognition of emotional words was relatively stable despite increasing delays between encoding and recognition testing, in contrast to memory for neutral words, which decayed over time. Memory for neutral non-target words was enhanced when words had been presented in an emotional context. The results confirm the phenomenon of emotional enhancement of memory at short and long delays and suggest that emotional context may be encoded independently of word meaning.     

INCREASING APPROPRIATE SPEECH IN A CHRONIC SCHIZOPHRENIC

In a severely withdrawn schizophrenic, a combination of instructions, modeling, informational feedback, and noncontingent reinforcement was associated with a low rate of appropriate verbalizations. However, an increase in speech output was obtained using a combination of instructions, modeling, informational feedback, and contingent reinforcement. The design of this study thus permitted the conclusion that contingent reinforcement was crucial in bringing about the increase in appropriate verbalizations. The three verbal behaviors that increased in frequency were: (a) the number of socially appropriate words emitted, (b) declarative statements, and (c) appropriate replies to questions. The verbal behaviors of conversational questions and positive conversational feedback failed to be significantly affected by the experimental procedures. An attempt was also made to establish whether having the subject engage in the observable, information-gathering response of reading aloud would result in increased speech output during a subsequent conversation period. Having the subject read aloud failed to have any discernible positive effect on his speech output. A withdrawal design was used to evaluate the effectiveness of the experimental procedures. The importance of assessing changes in verbal output with a variety of verbal response measures, stereotyped verbal behaviors, and carryover effects are discussed.     

Context effects of pictures and words in naming objects, reading words, and generating simple phrases

In five language production experiments it was examined which aspects of words are activated in memory by context pictures and words. Context pictures yielded Stroop-like and semantic effects on response times when participants generated gender-marked noun phrases in response to written words (Experiment 1A). However, pictures yielded no such effects when participants simply read aloud the noun phrases (Experiment 2). Moreover, pictures yielded a gender congruency effect in generating gender-marked noun phrases in response to the written words (Experiments 3A and 3B). These findings suggest that context pictures activate lemmas (i.e., representations of syntactic properties), which leads to effects only when lemmas are needed to generate a response (i.e., in Experiments 1A, 3A, and 3B, but not in Experiment 2). Context words yielded Stroop-like and semantic effects in picture naming (Experiment 1B). Moreover, words yielded Stroop-like but no semantic effects in reading nouns (Experiment 4) and in generating noun phrases (Experiment 5). These findings suggest that context words activate the lemmas and forms of their names, which leads to semantic effects when lemmas are required for responding (Experiment 1B) but not when only the forms are required (Experiment 4). WEAVER++ simulations of the results are presented.     

Naming pictures at no cost: asymmetries in picture and word conditional naming

We report a striking finding about naming and categorization of pictures and reading aloud and categorization of words. The categorization of a word before reading it aloud leads to an increase in response time as compared with the condition in which naming is not conditional on the categorization of the word. Quite differently, no cost is associated with the conditional naming of pictures. Results are discussed in terms of multiple procedures operating on pictorial and verbal stimuli to retrieve phonological forms.     

Context effects of pictures and words in naming objects,reading words,and generating simple phrases

In five language production experiments it was examined which aspects of words are activated in memory by context pictures and words. Context pictures yielded Stroop-like and semantic effects on response times when participants generated gender-marked noun phrases in response to written words (Experiment 1A). However, pictures yielded no such effects when participants simply read aloud the noun phrases (Experiment 2). Moreover, pictures yielded a gender congruency effect in generating gender-marked noun phrases in response to the written words (Experiments 3A and 3B). These findings suggest that context pictures activate lemmas (i.e., representations of syntactic properties), which leads to effects only when lemmas are needed to generate a response (i.e., in Experiments 1A, 3A, and 3B, but not in Experiment 2). Context words yielded Stroop-like and semantic effects in picture naming (Experiment 1B). Moreover, words yielded Stroop-like but no semantic effects in reading nouns (Experiment 4) and in generating noun phrases (Experiment 5). These findings suggest that context words activate the lemmas and forms of their names, which leads to semantic effects when lemmas are required for responding (Experiment 1B) but not when only the forms are required (Experiment 4). WEAVER++ simulations of the results are presented.