Are there gender differences in cognitive reflection? Invariance and differences related to mathematics

ABSTRACT

Cognitive reflection is recognized as an important skill, which is necessary for making advantageous decisions. Even though gender differences in the Cognitive Reflection test (CRT) appear to be robust across multiple studies, little research has examined the source of the gender gap in performance. In Study 1, we tested the invariance of the scale across genders. In Study 2, we investigated the role of math anxiety, mathematical reasoning, and gender in CRT performance. The results attested the measurement equivalence of the Cognitive Reflection Test – Long (CRT- L), when administered to male and female students. Additionally, the results of the mediation analysis showed an indirect effect of gender on CRT-L performance through mathematical reasoning and math anxiety. The direct effect of gender was no longer statistically significant after accounting for the other variables. The current findings suggest that cognitive reflection is affected by numerical skills and related feelings.     

The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT)

The cognitive reflection test (CRT) is a short measure of a person's ability to resist intuitive response tendencies and to produce a normatively correct response, which is based on effortful reasoning. Although the CRT is a very popular measure, its psychometric properties have not been extensively investigated. A major limitation of the CRT is the difficulty of the items, which can lead to floor effects in populations other than highly educated adults. The present study aimed at investigating the psychometric properties of the CRT applying item response theory analyses (a two‐parameter logistic model) and at developing a new version of the scale (the CRT‐long), which is appropriate for participants with both lower and higher levels of cognitive reflection. The results demonstrated the good psychometric properties of the original, as well as the new scale. The validity of the new scale was also assessed by measuring correlations with various indicators of intelligence, numeracy, reasoning and decision‐making skills, and thinking dispositions. Moreover, we present evidence for the suitability of the new scale to be used with developmental samples. Finally, by comparing the performance of adolescents and young adults on the CRT and CRT‐long, we report the first investigation into the development of cognitive reflection. Copyright © 2015 John Wiley & Sons, Ltd.     

The illusion of replacement in research into the development of thinking biases: the case of the conjunction fallacy

The conjunction fallacy is a violation of a very basic rule of probability. Interestingly, although committing the fallacy seems irrational, adults are no less susceptible to the fallacy than young children. In Experiment 1, by employing tasks where the conjunctive response option involved two non-representative items, we found a large reduction in fallacy rates as compared to traditional conjunction fallacy problems. Nevertheless, fallacy rates remained relatively high in both adolescents and adults, although adults showed more consistency in their normative responses. In Experiment 2, we demonstrated that children’s relatively good performance on the task was not the consequence of their missing knowledge of social stereotypes. Additionally, children were more strongly affected by explicitly presented frequency information than adults. Indeed, adults only took frequency information into account when frequencies were made relevant by a training in probabilistic reasoning. Overall, the results suggest that whereas the potential for normative reasoning increases with development, this potential is often overshadowed by a pervasive tendency in adolescence and adulthood to rely on contextual information, knowledge, and beliefs, even when conflicting information is available. By contrast, children are more strongly influenced by explicitly presented information than relevant knowledge cued by the tasks.     

Why Women Take Fewer Risk Than Men Do: The Mediating Role of State Anxiety

Gender studies have showed that women take fewer risks than men do. Previous research has also provided evidence for a link between negative affect (anxiety and depressive mood) and risk-taking. Little is known about the relationships among these factors. We examined the role of state anxiety in the relationship between gender and risk-taking. Fully 149 undergraduate students filled out the State-Trait Anxiety Inventory (STAI) and the Beck Depression Inventory–II (BDI) before playing the hot version of the Columbia Card Task (hot CCT), which is designed to measure emotionally based risk-taking behavior. Hierarchical regression analysis showed that gender and state anxiety were associated with risk-taking even when controlling for age, depressive mood, and trait anxiety. Moreover, results pointed out that gender is related to risk-taking through state anxiety. These results offer insights into gender research, as well as affective and decision science. Implications for future studies and applied interventions are discussed.     

Are systemizing and autistic traits related to talent and interest in mathematics and engineering? Testing some of the central claims of the empathizing–systemizing theory

In two experiments, we tested some of the central claims of the empathizing–systemizing (E‐S) theory. Experiment 1 showed that the systemizing quotient (SQ) was unrelated to performance on a mathematics test, although it was correlated with statistics‐related attitudes, self‐efficacy, and anxiety. In Experiment 2, systemizing skills, and gender differences in these skills, were more strongly related to spatial thinking styles than to SQ. In fact, when we partialled the effect of spatial thinking styles, SQ was no longer related to systemizing skills. Additionally, there was no relationship between the Autism Spectrum Quotient (AQ) and the SQ, or skills and interest in mathematics and mechanical reasoning. We discuss the implications of our findings for the E‐S theory, and for understanding the autistic cognitive profile.     

The Accuracy of the Life Orientation Test–Revised (LOT–R) in Measuring Dispositional Optimism: Evidence From Item Response Theory Analyses

The accuracy of the Life Orientation Test–Revised (LOT–R) in measuring dispositional optimism was investigated applying item response theory (IRT). The study was conducted on a sample of 484 university students (62% males, M age = 22.79 years, SD = 5.63). After testing the 1-factor structure of the scale, IRT was applied to evaluate the functioning of the LOT–R along the pessimism–optimism continuum. Item parameter estimates and the test information function showed that each item and the global scale satisfactorily measured the latent trait. Referring to the IRT estimated trait levels, the validity of the LOT–R was studied examining the relationships between dispositional optimism and psychological well-being, sense of mastery, and sense of coherence. Overall findings based on IRT analyses provide evidence of the accuracy of the LOT–R and suggest possible modifications of the scale to improve the assessment of dispositional optimism.     

Retroactive inhibition as a function of the locus of categorized response sets

The effects which list-level taxonomic attributes should have upon retroactive inhibition (RI) producing mechanisms in both response-set interference theory (Postman & Stark, 1969) and Petrich’s (1975) retrieval model are discussed. A test of the theories was performed by manipulating the presence (1) or absence (0) of categorized response sets in both original learning (OL) and interpolated learning IIL), and comparing their predictions concerning the relative degree of RI expected in the four conditions (0-0, 0-1, 1-0, 1-1). In line with Petrich’s predictions, OL categorization significantly reduced RI, IL categorization significantly increased RI, and 0-1 produced significantly greater RI than 1-0. Moreover, the obtained ranking of the means for the experimental groups in degree of RI (0–1>0-0>1-0 ? 1-1) was in close agreement with the ranking predicted by Petrich’s (1975) model. The results provide support for Petrich’s (1975) retrieval model and pose explanatory problems for response-set interference theory (Postman & Stark, 1969).     

Picture-word differences in decision latency: An analysis of single and dual memory models

Semantic and perceptual size decision times for pictorial and verbal material were analyzed in the context of a unitary memory model and several dual memory models. Experiment 1 involved a same-different categorical judgment task. The results showed that picture-picture response latencies were 185 msec faster than the corresponding word-word latencies, and word-picture and picture-word latencies equaled the mean of these two extremes. Similarity of subcategory for “same” judgments led to faster decision latency for all presentation conditions. Additionally, a linear relationship was found between picture-picture and word-word latencies for individual item pairs. Experiment 2 involved a comparison of pictures and words across a. categorical judgment and a size judgment task. Pictures produced faster decision latencies in both tasks, and the latency diflerence between pictures and words was comparable across tasks. These data fit the predictions of a unitary memory model. Several variants of a dual memory model are rejected and those which fit the data require assumptions about storage and/or transfer time values which result in a functional regression to the unitary memory model.     

Developmental changes in probabilistic reasoning: The role of cognitive capacity,instructions, thinking styles,and relevant knowledge

In three experiments we explored developmental changes in probabilistic reasoning, taking into account the effects of cognitive capacity, thinking styles, and instructions. Normative responding increased with grade levels and cognitive capacity in all experiments, and it showed a negative relationship with superstitious thinking. The effect of instructions (in Experiments 2 and 3) was moderated by level of education and cognitive capacity. Specifically, only higher-grade students with higher cognitive capacity benefited from instructions to reason on the basis of logic. The implications of these findings for research on the development of probabilistic reasoning are also discussed.     

Measuring Probabilistic Reasoning: The Construction of a New Scale Applying Item Response Theory

Probabilistic reasoning skills are important in various contexts. The aim of the present study was to develop a new instrument (the Probabilistic Reasoning Scale – PRS) to accurately measure low levels of probabilistic reasoning ability in order to identify people with difficulties in this domain. Item response theory was applied to construct the scale, and to investigate differential item functioning (i.e., whether the items were invariant) across genders, educational levels, and languages. Additionally, we tested the validity of the scale by investigating the relationships between the PRS and several other measures. The results revealed that the items had a low level of difficulty. Nonetheless, the discriminative measures showed that the items can discriminate between individuals with different trait levels, and the test information function showed that the scale accurately assesses low levels of probabilistic reasoning ability. Additionally, through investigating differential item functioning, the measurement equivalence of the scale at the item level was confirmed for gender, educational status, and language (i.e., Italian and English). Concerning validity, the results showed the expected correlations with numerical skills, math‐related attitudes, statistics achievement, IQ, reasoning skills, and risky choices both in the Italian and British samples. In conclusion, the PRS is an ideal instrument for identifying individuals who struggle with basic probabilistic reasoning, and who could be targeted by specific interventions. Copyright © 2017 John Wiley & Sons, Ltd.