A Review of Best Practice Recommendations for Text Analysis in R (and a User-Friendly App)

In recent decades, the amount of text available for organizational science research has grown tremendously. Despite the availability of text and advances in text analysis methods, many of these techniques remain largely segmented by discipline. Moreover, there is an increasing number of open-source tools (R, Python) for text analysis, yet these tools are not easily taken advantage of by social science researchers who likely have limited programming knowledge and exposure to computational methods. In this article, we compare quantitative and qualitative text analysis methods used across social sciences. We describe basic terminology and the overlooked, but critically important, steps in pre-processing raw text (e.g., selection of stop words; stemming). Next, we provide an exploratory analysis of open-ended responses from a prototypical survey dataset using topic modeling with R. We provide a list of best practice recommendations for text analysis focused on (1) hypothesis and question formation, (2) design and data collection, (3) data pre-processing, and (4) topic modeling. We also discuss the creation of scale scores for more traditional correlation and regression analyses. All the data are available in an online repository for the interested reader to practice with, along with a reference list for additional reading, an R markdown file, and an open source interactive topic model tool (topicApp; see https://github.com/wesslen/topicApp, https://github.com/wesslen/text-analysis-org-science, https://dataverse.unc.edu/dataset.xhtml?persistentId=doi:10.15139/S3/R4W7ZS).     

Has Society Grown More Hostile Towards Conservative Christians? Evidence from ANES Surveys

Several conservative Christian activists have complained of increasing hatred directed towards them and a majority of Christians today believe that persecution against them has increased in the United States. To date there has not been an empirical assessment of whether there are increasing levels of anti-Christian animosity with two groups as representative of conservative Christians: Christian fundamentalists and evangelicals. Levels of anti-Christian hostility has not significantly risen over the past few decades, however those with this hostility have become wealthier. Furthermore, there has not been a coalescing or lessening of support for conservative Christians by other Christians, as seen in the persistent level of mildly negative score by progressive Christians. One may envision hostility against conservative Christians in the twentieth century as something possessed by highly educated progressives with cultural influence but little ability to punish conservative Christians economically. The ability to threaten conservative Christians’ material well-being and the lack of support of conservative Christians by other Christians augments those with hostility towards conservative Christians in the twenty-first century. Conservative Christians are incorrect asserting that Christian hostility recently dramatically increased but may be correct in asserting that they face more problems due to that hostility.     

Beliefs About the True Self Explain Asymmetries Based on Moral Judgment

Past research has identified a number of asymmetries based on moral judgments. Beliefs about (a) what a person values, (b) whether a person is happy, (c) whether a person has shown weakness of will, and (d) whether a person deserves praise or blame seem to depend critically on whether participants themselves find the agent's behavior to be morally good or bad. To date, however, the origins of these asymmetries remain unknown. The present studies examine whether beliefs about an agent's “true self” explain these observed asymmetries based on moral judgment. Using the identical materials from previous studies in this area, a series of five experiments indicate that people show a general tendency to conclude that deep inside every individual there is a “true self” calling him or her to behave in ways that are morally virtuous. In turn, this belief causes people to hold different intuitions about what the agent values, whether the agent is happy, whether he or she has shown weakness of will, and whether he or she deserves praise or blame. These results not only help to answer important questions about how people attribute various mental states to others; they also contribute to important theoretical debates regarding how moral values may shape our beliefs about phenomena that, on the surface, appear to be decidedly non‐moral in nature.