Reflexivity in quantitative research: A rationale and beginner's guide

Reflexivity is the act of examining one's own assumption, belief, and judgement systems, and thinking carefully and critically about how these influence the research process. The practice of reflexivity confronts and questions who we are as researchers and how this guides our work. It is central in debates on objectivity, subjectivity, and the very foundations of social science research and generated knowledge. Incorporating reflexivity in the research process is traditionally recognized as one of the most notable differences between qualitative and quantitative methodologies. Qualitative research centres and celebrates the participants' personal and unique lived experience. Therefore, qualitative researchers are readily encouraged to consider how their own unique positionalities inform the research process and this forms an important part of training within this paradigm. Quantitative methodologies in social and personality psychology, and more generally, on the other hand, have remained seemingly detached from this level of reflexivity and general reflective practice. In this commentary, we, three quantitative researchers who have grappled with the compatibility of reflexivity within our own research, argue that reflexivity has much to offer quantitative methodologists. The act of reflexivity prompts researchers to acknowledge and centre their own positionalities, encourages a more thoughtful engagement with every step of the research process, and thus, as we argue, contributes to the ongoing reappraisal of openness and transparency in psychology. In this paper, we make the case for integrating reflexivity across all research approaches, before providing a ‘beginner's guide’ for quantitative researchers wishing to engage reflexively with their own work, providing concrete recommendations, worked examples, and reflexive prompts.     

Pain in the eye of the beholder: Variations in pain visual representations as a function of face ethnicity and culture

Pain experienced by Black individuals is systematically underestimated, and recent studies have shown that part of this bias is rooted in perceptual factors. We used Reverse Correlation to estimate visual representations of the pain expression in Black and White faces, in participants originating from both Western and African countries. Groups of raters were then asked to evaluate the presence of pain and other emotions in these representations. A second group of White raters then evaluated those same representations placed over a neutral background face (50% White; 50% Black). Image-based analyses show significant effects of culture and face ethnicity, but no interaction between the two factors. Western representations were more likely to be judged as expressing pain than African representations. For both cultural groups, raters also perceived more pain in White face representations than in Black face representations. However, when changing the background stimulus to the neutral background face, this effect of face ethnic profile disappeared. Overall, these results suggest that individuals have different expectations of how pain is expressed by Black and White individuals, and that cultural factors may explain a part of this phenomenon     

The relationship between numerical mapping abilities,maths achievement and socioeconomic status in 4- and 5-year-old children

Background

Early numeracy skills are associated with academic and life-long outcomes. Children from low-income backgrounds typically have poorer maths outcomes, and their learning can already be disadvantaged before they begin formal schooling. Understanding the relationship between the skills that support the acquisition of early maths skills could scaffold maths learning and improve life chances.

Aims

The present study aimed to examine how the ability of children from different SES backgrounds to map between symbolic (Arabic numerals) and non-symbolic (dot arrays) at two difficulty ratios related to their math performance.

Sample

Participants were 398 children in their first year of formal schooling (Mean age = 60 months), and 75% were from low SES backgrounds.

Method

The children completed symbolic to non-symbolic and non-symbolic to symbolic mapping tasks at two difficulty ratios (1:2; 2:3) plus standardized maths tasks.

Results

The results showed that all the children performed better for symbolic to non-symbolic mapping and when the ratio was 1:2. Mapping task performance was significantly related to maths task achievement, but low-SES children showed significantly lower performance on all tasks.

Conclusion

The results suggest that mapping tasks could be a useful way to identify children at risk of low maths attainment.     

An explanation of conservatism in the bookbag-and-pokerchips situation

An experiment is described in which subjective probability revisions were obtained in a standard probability estimation task, the ‘bookbag-and-pokerchips’situation. Three aspects of probability revision were examined: conservatism, sequential effects, and coherence. Under two experimental conditions, the conservatism effect obtained was closely related to subjects' use of a simple strategy. A recency effect was also obtained. Coherence of the probability estimates was excellent. Conditions under which the observed strategy leads to conservatism are explored and previously published results are reconsidered in the light of this strategy. Conservatism in the bookbag- and-pokerchips situation is explained as an artefact of subjects' strategies     

Status faking on the SVIB-M

A study and replication of students faking interest in high status occupations on the Strong Vocational Interest Blank for Men. In general, the faking was successful in shifting the specific target occupational scales and especially the occupational level scale. Other scales are affected, many with decisive upward or downward shifts. Demonstration is made of the extent to which the faking condition led to differences in the overall test results. Various aspects of the general problem of test faking are reviewed.     

An individual difference model for the multidimensional analysis of preference data

A model for the analysis of paired comparison data is presented which combines features of the BTL-model with features of the Unfolding model. The model is metric, mathematically tractable, and has an exact algebraic solution. Since it is multidimensional and allows for individual differences, it is thought to be more realistic for some choice situations than either the Thurstone model or the BTL-model. No claim is made that the present model will be appropriate for all conceivable choice situations. Rather, it is argued that the fact that it is explicitly falsifiable is a point in its favor.This work was supported by a grant of the United States Public Health Service (1 R03 MH19139 01 MSM) and a David Ross (XR) grant of the Purdue Research Foundation (PRF 2132), both of which are gratefully acknowledged. We also owe thanks to Dr. Terry Cooper, whose careful scrutiny of an earlier draft of this paper allowed us to reduce the number of errors from n to n-1.     

Some new results on factor indeterminacy

Some relations between maximum likelihood factor analysis and factor indeterminacy are discussed. Bounds are derived for the minimum average correlation between equivalent sets of correlated factors which depend on the latent roots of the factor intercorrelation matrix . Empirical examples are presented to illustrate some of the theory and indicate the extent to which it can be expected to be relevant in practice.