Empirical tests of scientific realism: A quantitative framework

The scientific realism debate in philosophy of science raises some intriguing methodological issues. Scientific realism posits a link between a scientific theory's observational and referential success. This opens the possibility of testing the thesis empirically, by searching for evidence of such a link in the record of theories put forward in the history of science. Many realist philosophers working today propose case study methodology as a way of carrying out such a test. This article argues that a qualitative method such as case study methodology is not adequate for this purpose, for two reasons: to test scientific realism is to pose an effects-of-causes question, and observational and referential success are quantities that theories possess to a greater or lesser degree. The article concludes that an empirical test of scientific realism requires a quantitative method.     

A Model for Adapting Evidence-Based Interventions to Be LGBQ-Affirmative: Putting Minority Stress Principles and Case Conceptualization Into Clinical Research and Practice

The mental health field now possesses clinical trials attesting to the efficacy of affirmative practice with sexual minority individuals. With the goal of efficiently moving the results of these clinical trials into real-world clinical practice, this paper offers a model for adapting existing evidence-based practices originally developed for the general population to be lesbian, gay, bisexual, and queer (LGBQ)-affirmative. The adaptation model presented here guides clinicians to incorporate six LGBQ-affirmative transtheoretical principles of change into practice. These principles facilitate raising awareness of the impact of minority stress on sexual minority clients’ mental health and on client self-evaluation while drawing upon sexual minority resilience and intersectional experiences to build empowering coping skills and validating relationships. The adaptation model also provides a transtheoretical approach to case conceptualization that directs clinicians to consider the role of early and ongoing minority stress on sexual minority clients’ cognitive, affective, motivational, behavioral, and self-evaluative experiences that maintain current distress. This case conceptualization approach highlights common associations among these experiences, suggesting clear routes of interventions for many sexual minority client presentations. Case examples from recent clinical trials of LGBQ-affirmative cognitive-behavioral therapy illustrate how these principles and this case conceptualization can be effectively utilized in practice. While the principles and case conceptualization are meant to be transtheoretical and therefore applicable across therapeutic techniques, to date they have been tested only in clinical trials for cognitive-behavioral treatments. Therefore, this paper concludes with a call for future research to determine the effectiveness of implementing this adaptation model across diverse therapeutic modalities and client presentations.     

Effect of perceived public stigma on internalized homophobia,anticipated stigma,shame, and guilt: Outness as a moderator

Although previous studies found that distal minority stress contributes to proximal minority stress and shame/guilt among the lesbian, gay, and bisexual (LGB) population, it is unclear whether the extent to which LGB individuals' open display and discussion their sexual orientation moderates these relationships. A total of 1,452 Chinese LGB adults provided demographic information and completed measures of outness, perceived public stigma, internalized homophobia, anticipated stigma, shame, and guilt. Structural equation modelling was conducted to test the hypothesized moderation analyses. Perceived public stigma had positive associations with internalized homophobia, anticipated stigma, shame, and guilt. Outness played a moderating role in the associations of perceived public stigma with internalized homophobia, anticipated stigma, shame, and guilt. Specifically, when LGB individuals had higher levels of outness, the effects of perceived public stigma on internalized homophobia, anticipated stigma, shame, and guilt were lower. Moreover, such moderating effect did not differ by sexual orientation. The degree to which sexual minority individuals' sexual orientation is known by and openly discussed with others may lower the extent to which LGB individuals internalize sexual stigma, expect rejection after coming out, and develop shame and guilt as a result of perceived social prejudice and discrimination.     

Reflexivity in quantitative research: A rationale and beginner's guide

Reflexivity is the act of examining one's own assumption, belief, and judgement systems, and thinking carefully and critically about how these influence the research process. The practice of reflexivity confronts and questions who we are as researchers and how this guides our work. It is central in debates on objectivity, subjectivity, and the very foundations of social science research and generated knowledge. Incorporating reflexivity in the research process is traditionally recognized as one of the most notable differences between qualitative and quantitative methodologies. Qualitative research centres and celebrates the participants' personal and unique lived experience. Therefore, qualitative researchers are readily encouraged to consider how their own unique positionalities inform the research process and this forms an important part of training within this paradigm. Quantitative methodologies in social and personality psychology, and more generally, on the other hand, have remained seemingly detached from this level of reflexivity and general reflective practice. In this commentary, we, three quantitative researchers who have grappled with the compatibility of reflexivity within our own research, argue that reflexivity has much to offer quantitative methodologists. The act of reflexivity prompts researchers to acknowledge and centre their own positionalities, encourages a more thoughtful engagement with every step of the research process, and thus, as we argue, contributes to the ongoing reappraisal of openness and transparency in psychology. In this paper, we make the case for integrating reflexivity across all research approaches, before providing a ‘beginner's guide’ for quantitative researchers wishing to engage reflexively with their own work, providing concrete recommendations, worked examples, and reflexive prompts.     

Mapping physical characteristics in face images to social judgements

Sutherland and Young (Br. J. Psychol., 113, 2022, 1056) provide a comprehensive and timely overview of recent developments in research on social judgements of faces, emphasizing the utility of data-driven approaches. Here, we expand on this theme, focusing on how data-driven approaches can provide new insights into the physical characteristics in face images that best predict social judgements.     

Linking qualitative and quantitative methods in cross-cultural survey research: Techniques from cognitive science

Survey research with diverse cultural and ethnic minority groups is a complex and challenging endeavor that confronts the researcher with problems related to linguistic and conceptual equivalence and measurement as well as problems related to difficulties that respondents have with the sociocultural dimensions of the survey/interview process. One way to improve the quality of cross-cultural surveys and to insure that the findings are culturally relevant and accurate is to combine qualitative and quantitative methods. This paper proposes that certain qualitative techniques from cognitive science, specifically cognitive anthropology and cognitive psychology, are particularly well suited to being combined with survey research. These techniques provide information corresponding to the underlying thought processes of respondents and enable researchers to better understand how different cultural and ethnic groups construe the world. The information obtained can be used improve the formulation of survey questions, design and structure questionnaire formats to coincide with the way particular groups organize concepts, and help researchers understand difficulties respondents may have with the survey/interview process. In addition, the techniques produce data that are easily codifiable and more manageable than traditional qualitative techniques including participant observation and in-depth interviews.     

Use and misuse of metrics in research evaluation

This paper addresses some critical issues in the applicability of quantitative performance measures (including bibliometric, economic, and co-occurrence measures) to the assessment of basic research. The strengths and weaknesses of metrics applied as research performance measures are examined. It is concluded that metrics have a useful role to play in the evaluation of research. Each metric employed, whether bibliometric, economic, co-occurrence, or others, brings a new dimension of potential insight to the complex problem of research assessment. However, when used in a stand-alone mode, metrics can be easily misinterpreted and result in misleading conclusions. Metrics should be an integral part of a more comprehensive approach to research evaluation, in which the leading role is assumed by expert peer review. Under this structure, the reviewers must be broadly constituted, so that the technical correctness of the research approaches being taken (doing the job right) can be evaluated by technical experts and the correctness of the research target (doing the right job) can be evaluated as well. This comprehensive approach insures quality in the implementation of existing research paradigms and allows the introduction of revolutionary new research paradigms as well. The views contained in this paper are solely those of the author and do not represent the views of the Department of the Navy. Ronald Kostoff received a Ph.D. from Princeton University, performed technical and economic research at Bell Laboratories, managed energy programs at U.S. Department of Energy, was Director of Technical Assessment at the Office of Naval Research for many years and presently manages the Navy’s In-House Laboratory Independent Research Program.     

The relationship between qualitative and quantitative research: Lessons from feminist psychology

The dominant methodological approach in psychological research has involved the use of quantitative methods within a positivist framework. In this article we argue that both qualitative and quantitative methods have their strengths and limitations, depending on the research question under investigation. We examine some of the advantages of qualitative methods, paying particular attention to the value of such methods for feminist researchers. We challenge the positivist assumption that all research should be apolitical and value-free, arguing that the political context in which all research studies take place plays an important role in decisions about the appropriate research methods to use. Despite the value attached to qualitative methods by feminist researchers, there may be projects for which quantitative methods, or a combination of qualitative and quantitative techniques, are more suitable. We draw on examples from our research on the transition from school to the job market for young people, and a study of 16- to 19-year-old first time mothers to illustrate these points, examining the practical implications of our arguments for applied social psychology research.     

On the base-free measure of change proposed by Tucker,Damarin and Messick

Tucker, Damarin and Messick proposed a base-free measure of change which involves the computation of residual scores that are uncorrelated with true scores on the pretest. The present note discusses this change measure and demonstrates that, because of an incorrect derivation by the authors, properties they attribute to (the coefficient for the regression of true scores from the second testing on true scores from the first testing) are, in fact, properties ofb, the ordinary regression coefficient. A correct derivation of the initial position—change correlation in terms of is obtained, and Tucker et al.'s discussion of the law of initial values is reconsidered.The preparation of this paper was supported by the Learning Research and Development Center supported in part as a research and development center by funds from the National Institute of Education.