The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT)

The cognitive reflection test (CRT) is a short measure of a person's ability to resist intuitive response tendencies and to produce a normatively correct response, which is based on effortful reasoning. Although the CRT is a very popular measure, its psychometric properties have not been extensively investigated. A major limitation of the CRT is the difficulty of the items, which can lead to floor effects in populations other than highly educated adults. The present study aimed at investigating the psychometric properties of the CRT applying item response theory analyses (a two‐parameter logistic model) and at developing a new version of the scale (the CRT‐long), which is appropriate for participants with both lower and higher levels of cognitive reflection. The results demonstrated the good psychometric properties of the original, as well as the new scale. The validity of the new scale was also assessed by measuring correlations with various indicators of intelligence, numeracy, reasoning and decision‐making skills, and thinking dispositions. Moreover, we present evidence for the suitability of the new scale to be used with developmental samples. Finally, by comparing the performance of adolescents and young adults on the CRT and CRT‐long, we report the first investigation into the development of cognitive reflection. Copyright © 2015 John Wiley & Sons, Ltd.     

A Goal‐Priming Approach to Cognitive Consistency: Applications to Judgment

A fundamental criterion of judgment is consistency among beliefs. To augment traditional methods for studying cognitive consistency, we treat it as a goal and present a priming method for increasing its activation. Three studies use three criteria to validate the method: an increase in the biased evaluation of incoming information, speed in a lexical decision task, and participants' direct reports of greater goal activation. The method is then used to verify the role of the consistency goal in three diverse judgment phenomena. Priming cognitive consistency increases the search for postdecisional supporting information (selective exposure to information), the agreement between preference and prediction (the desirability bias or wishful thinking), and the adjustment of a socially unacceptable implicit attitude to conform to the corresponding explicit attitude. One conclusion is that the cause of these phenomena is not only motivated reasoning (driven directionally by a desired outcome) but also the purely cognitive and nondirectional process of simply making beliefs more consistent. Copyright © 2015 John Wiley & Sons, Ltd.     

Now or Later? Attentional Processing and Intertemporal Choice

The tendency to discount future prospects in lieu of smaller immediate outcomes is known as temporal discounting. The current work used eye‐tracking methodology to examine attentional processing to different elements of choice during an intertemporal decision task. Our findings reveal that those who tend to prefer the immediate option demonstrate attentional biases that were predictive of choice. When losses were at stake, selective attention biases also predicted unique variance in self‐report measures of risk taking, impulsivity, and self‐control beyond what was accounted for by a discounting parameter (k), a typical method for summarizing intertemporal choice data. Overall, our findings suggest that eye‐tracking measures of selective attention may allow for a better theoretical understanding of the mechanisms and processes involved in intertemporal choice. Copyright © 2015 John Wiley & Sons, Ltd.     

Mothers' Attention‐getting Utterances During Shared Book Reading: Links to Low‐income Preschoolers' Verbal Engagement,Visual Attention,and Early Literacy

This study examined associations among low‐income mothers' use of attention‐getting utterances during shared book reading, preschoolers' verbal engagement and visual attention to reading, and their early literacy skills (N = 51). Mother–child shared book reading sessions were videotaped and coded for each utterance, including attention talk, contextualized talk, de‐contextualized talk, and print talk. Preschoolers' attention during book reading was assessed using two measures: verbal engagement by using a rating scale of preschoolers' involvement in book reading discussion and visual attention by coding visual gaze. Findings indicated that mothers' attention talk was positively associated with children's verbal engagement, while maternal print talk was associated with children's visual attention. Further, low‐level maternal print talk was associated with higher early decoding scores of children when it was accompanied with high‐level maternal attention talk. Copyright © 2015 John Wiley & Sons, Ltd.     

Comparing OECD PISA Reading in English to Other Languages: Identifying Potential Sources of Non-Invariance

The use of the Programme for International Student Assessment (PISA) across nations, cultures, and languages has been criticized. The key criticisms point to the linguistic and cultural biases potentially underlying the design of reading comprehension tests, raising doubts about the legitimacy of comparisons across economies. Our research focused on the type and magnitude of invariance or non-invariance in the PISA Reading Comprehension test by language, culture, and economic development relative to performance of the Australian English-speaking reference group used to develop the tests. Multi-Group Confirmatory Factor Analysis based on means and covariance structure (MACS) modeling was used to establish a d_MACS effect size index for each economy for the degree of non-invariance. Only three wealthy, English-speaking countries had scalar invariance with Australia. Moderate or large effects were observed in just 31% of the comparisons. PISA index of economic, social and cultural status had a moderate inverse correlation with dMACS suggesting that socioeconomic resourcing of education played a significant role in measurement invariance, while educational practice and language factors seemed to play a further small role in non-invariance. Alternative approaches to reporting PISA results consistent with non-invariance are suggested.     

Empowering and legitimizing the fundamental attribution error: Power and legitimization exacerbate the translation of role‐constrained behaviors into ability differences

Our daily interactions are influenced by the social roles we endorse. People however underestimate these role constraints in their everyday explanation relying on individual dispositions to make sense of behaviors. Two studies investigated whether this bias is exacerbated when role structure is legitimated and when power matches the advantages conferred by the social roles of a quiz game. Legitimacy as well as power increased the tendency for both advantaged (questioner) and disadvantaged (answerer) actors (Study 1) as well as naïve observers of the quiz game (Study 2) to attribute to ability the behaviors elicited by social roles. These results extend previous findings. People are more prone to explain constrained behaviors by differences in ability when role structure is legitimated and when power asymmetry matches role structure. Legitimacy and power may then play an important role in the translation of role constraints into inferences about ability.     

Faking revisited: Exerting strategic control over performance on the Implicit Relational Assessment Procedure

Across four studies, we demonstrate that effects obtained from the Implicit Relational Assessment Procedure, like those obtained from other indirect procedures, are not impervious to strategic manipulation. In experiment 1, we found that merely informing participants to “fake” their performance without providing a concrete strategy to do so did not eliminate, reverse, or in any way alter the obtained outcomes. However, when those same instructions orientated attention toward the core parameters of the task, participants spontaneously derived a strategy that allowed them to eliminate their effects (experiment 2). When the participants were provided with a viable response strategy, they successfully reversed the direction of their overall Implicit Relational Assessment Procedure effect (experiment 3). By refining the nature of those instructions, we managed to target and alter individual trial‐type effects in isolation with some success (experiment 4).