Anchoring and Adjusting in Questionnaire Responses

Do survey designers bias respondents' answers on attitude/opinion questionnaires through the organization of their survey items? We hypothesize that respondents often employ an anchoring and adjusting strategy in which their response to an initial survey item provides a cognitive anchor from which they insufficiently adjust in answering the subsequent item. Three experiments indicate that respondents often anchor and insufficiently adjust in certain situations. Ultimately, this tendency can affect reliability estimates of scales and the resultant correlations with other measures. In organizing their surveys, researchers may wish to combat this bias by intermixing items designed for different but related constructs.     

Profiling active and passive nonrespondents to an organizational survey

In this field study (N = 405) population profiling was introduced to examine general and specific classes of nonresponse (active vs. passive) to a satisfaction survey. The active nonrespondent group (i.e., purposeful nonresponders) was relatively small (approximately 15%). Active nonrespondents, in comparison with respondents, were less satisfied with the entity sponsoring the survey and were less conscientious. Passive nonrespondents (e.g., forgot), who represented the majority of nonrespondents, were attitudinally similar to respondents but differed with regard to personality. Nonresponse bias does not appear to be a substantive concern for satisfaction type variables--the typical core of an organizational survey. If the survey concerns topics strongly related to Conscientiousness and Agreeableness, the respondent sample may not be representative of the population.     

Sensitive questions in surveys

Psychologists have worried about the distortions introduced into standardized personality measures by social desirability bias. Survey researchers have had similar concerns about the accuracy of survey reports about such topics as illicit drug use, abortion, and sexual behavior. The article reviews the research done by survey methodologists on reporting errors in surveys on sensitive topics, noting parallels and differences from the psychological literature on social desirability. The findings from the survey studies suggest that misreporting about sensitive topics is quite common and that it is largely situational. The extent of misreporting depends on whether the respondent has anything embarrassing to report and on design features of the survey. The survey evidence also indicates that misreporting on sensitive topics is a more or less motivated process in which respondents edit the information they report to avoid embarrassing themselves in the presence of an interviewer or to avoid repercussions from third parties.     

Misremembering colostomies? Former patients give lower utility ratings than do current patients.

Community members often evaluate health conditions more negatively than do the patients who have them. The authors investigated whether experience with a health condition reduces this discrepancy by surveying colostomy patients by mail (n = 195), some of whom (n = 100) had their colostomies reversed and normal bowel function restored. The authors also surveyed a community sample recruited via the Internet (n = 567). They then compared all 3 groups' utility value for life with a colostomy by using the time trade-off utility measure and by examining ratings of current quality of life. Despite having direct experience with the health condition, former colostomy patients provided much lower utility valuations than did current patients. In fact, their valuations were similar to those given by a community sample. Rather than accurately remembering their actual experiences with colostomies, the former patients may have applied a theory of how colostomies had influenced their lives; this is consistent with other research on theory driven recall bias.     

Monetary Valuations of Life Conditions in a Consistent Framework: The Life Satisfaction Approach

The life satisfaction approach (LSA) enables researchers to attach monetary values to nonmarket circumstances that affect people’s life satisfaction. Previous studies employ LSA to examine how the environment, health, and social capital, etc. affect life satisfaction. This study focuses on the OECD Better Life Index and intends to evaluate more comprehensive socioeconomic characteristics. Considering comprehensive factors about life enables us to avoid biased estimation. This study also considers more consistent estimation methods. Previous studies tend to attach monetary valuations in different settings. Thus, it is difficult to compare the effects of different socioeconomic circumstances. This study employs LSA to estimate the happiness functions of Japanese survey respondents by incorporating extensive socioeconomic characteristics as explanatory variables. Controlling for multiple factors affecting subjective wellbeing, we more accurately attach monetary values to each factor within a consistent analytical framework. By doing so, we assess factors’ relative comparable influence on subjective wellbeing. We adopt three estimation procedures to check robustness against model specifications. Results indicate that respondents value small changes in their socioeconomic circumstances more highly than other factors. Especially, circumstances surrounding quality of life carry higher equivalent monetary valuations than material living standards.     

Revisiting the “Art Bias” in Lay Conceptions of Creativity

This article explores the art bias—the pervasive association between creativity and art in implicit theories of creativity. It also attempts to connect creativity research in this area with literature on the theory of social representations. The data comes from an online survey completed by 195 participants mainly from the United States and the United Kingdom. The survey included two main tasks: The first asked respondents to generate as many questions as they can to determine whether an object is creative; the second invited them to rate whether creativity is a key requirement for a list of 16 professions from 4 different domains and recorded the creativity score as well as reaction time. In the end, findings offer partial support for the existence of an art bias. Although artistic professions were scored both the highest and fastest in terms of creativity, participants rarely formulated art-related questions and focused more on aspect, utility, and audience features. This discrepancy is discussed in the end in relation to the polyphasic nature of social knowledge.     

Scientists Still Behaving Badly? A Survey Within Industry and Universities

Little is known about research misconduct within industry and how it compares to universities, even though a lot of biomedical research is performed by–or in collaboration with–commercial entities. Therefore, we sent an e-mail invitation to participate in an anonymous computer-based survey to all university researchers having received a biomedical research grant or scholarship from one of the two national academic research funders of Belgium between 2010 and 2014, and to researchers working in large biomedical companies or spin-offs in Belgium. The validated survey included questions about various types of research misconduct committed by respondents themselves and observed among their colleagues in the last three years. Prevalences of misconduct were compared between university and industry respondents using binary logistic regression models, with adjustments for relevant personal characteristics, and with significance being accepted for p < 0.01. The survey was sent to 1766 people within universities and an estimated 255 people from industry. Response rates were 43 (767/1766) and 48% (123/255), and usable information was available for 617 and 100 respondents, respectively. In general, research misconduct was less likely to be reported by industry respondents compared to university respondents. Significant differences were apparent for one admitted action (gift authorship) and three observed actions (plagiarism, gift authorship, and circumventing animal-subjects research requirements), always with lower prevalences for industry compared to universities, except for plagiarism. This survey, based on anonymous self-report, shows that research misconduct occurs to a substantial degree among biomedical researchers from both industry and universities.     

A statistical review of the literature concerning the self-serving attribution bias in interpersonal influence situations1

Based upon his review of the self-serving attribution bias literature, Zuckerman (1979) concluded that research employing an interpersonal influence setting was less likely than other research paradigms to produce significant differences in self-attribution for success and failure. A survey of the research reviewed by Zuckerman as well as a more current survey of the relevant literature were undertaken. Statistical combinations of these two sets of evidence revealed Zuckerman's assessment may have been too conservative, at least with respect to two of three experimental paradigms. Additionally, a general tendency of individuals to assume more personal responsibility for success than failure on interpersonal influence tasks was found in the more comprehensive survey. Finally, the evidence concerning interactions of performance outcome with either contextual variables or individual differences indicated that the self-serving bias may be stronger under certain conditions than others and for certain types of individuals. Discussion centered on the conceptual distinctions between interpersonal influence and other achievement settings.     

How to Define Your (Mental) Terms

The discovery that the universe is fine-tuned for life ? a discovery to which the phrase ?the anthropic principle? is often applied ? has prompted much extra-cosmic speculation by philosophers, theologians, and theoretical physicists. Such speculation is referred to as extra-cosmic because an inference is made to the existence either of one unobservable entity that is distinct from the cosmos and any of its parts (God) or of many such entities (multiple universes). In this article a case is mounted for the sceptical position that cosmic fine-tuning does not support an inference to anything extra-cosmic. To that end three definitions of ?fine-tuned for life? are proposed: the ?slight difference? definition, the (unconditional) probability definition, and John Leslie?s conditional probability definition. These three definitions are the only ones suggested by the relevant literature on fine-tuning and the anthropic principle. Since on none of them do claims of fine-tuning warrant an inference to something extracosmic, it is concluded that there is no definition of ?fine-tuned for life? serving this function.     

Examining Parental Alienation in Child Custody Cases: A Survey of Mental Health and Legal Professionals

An Internet survey was conducted to examine the views of mental health and legal professionals about parental alienation (PA) in child custody cases. Findings from 448 respondents revealed much awareness about the PA concept and controversies, along with the need for further research in the field. In general, respondents were cautious and conservative/moderate in their view of PA and very reluctant to support the concept of Parental Alienation Syndrome (PAS). Also, they did not view PAS as meeting admissibility standards. Respondents viewed domestic violence (DV) as an important issue to assess, although they did not usually find/suspect DV in such cases. Further, respondents varied according to professional role (evaluators, trial attorneys/judges, and court facilitators) on the relative importance attributed to various assessment factors. Moreover, evaluators' assessment procedures and the frequency of recommended interventions by trial attorneys/judges and evaluators closely paralleled those typically used in child custody cases. Results are compared to past literature in the field, with hopes of clarifying misconceptions.     

Old dogs,new tricks – Rethinking country‐image studies

In international marketing, countries are often conceptualised as image constructs that have an influence on product image formation. Destination image and country of origin image are held to account for bias in consumer perceptions towards products because of the country from which they originate. Studies in these areas are typically underpinned by attitude‐based Likert or semantic differential scale methods, analysed using structural equation models. This paper achieves two key outcomes. Firstly, it adds to the small but growing body of literature that looks at the impact of tourism on post‐tour, export product evaluations. Secondly, it compares this traditional attitude‐based approach to country‐image studies with an alternative associative network theory approach, operationalised with a free‐choice, pick‐any survey method, which is popular within the branding literature. We compare the two methods by applying each to the same set of respondents to establish if the two methods are complementary, and find they produce different outcomes that could have critical implications for how country‐image studies are conceptualised and executed. Copyright © 2013 John Wiley & Sons, Ltd.     

Measurement equivalence of the Big Five: Shedding further light on potential causes of the educational bias

Rammstedt, Goldberg, and Borg (2010) demonstrated that the Big Five factor structure is sensitive to educational bias and that this bias seems to be due to a more pronounced tendency for acquiescent responding among less well-educated respondents. The present follow-up study investigated whether using an interview assessment mode in which the item presentation is standardized and thus differences in reading ability are controlled for, reduces the bias in the factorial structures. Results based on a large and heterogeneous sample clearly contradict this assumption: The findings unambiguously replicate those reported by Rammstedt et al. in that lower educated respondents have a higher and more variable tendency for acquiescent responding which directly affects the factor structure of the Big Five measure.     

Is It Real or Is It Fiction? Children's Bias Toward Reality

Children aged 3 to 8 years old and adults were tested on a reality–fantasy distinction task. They had to judge whether particular entities were real or fantastical, and response times were collected. We further manipulated whether the entity is a specific character or a generic fantastical entity. The results indicate that children, unlike adults, show a tendency to err by judging fantastical entities as real (response bias toward reality). All children were significantly slower when categorizing fantastical stimuli compared with real stimuli. We conclude that the process of classifying items into real versus fantastical categories develops at least until children are 7 to 8 years old.     

Intelligence and selective attrition in a nationally representative and longitudinal sample of Americans

Selective attrition is a potentially serious problem that can bias the findings that are generated from longitudinal samples. Although the extent to which IQ might be involved in selective attrition has been studied, the results from these studies have been decidedly mixed. The current study adds to the literature examining the link between IQ and selective attrition by examining four waves of data from the National Longitudinal Study of Adolescent Health. Analysis of these data revealed that IQ is related to attrition, with lower IQ respondents more likely to drop out of the study when compared against higher IQ respondents. The evidence suggests that dropouts score about 4.5 IQ points lower than subjects who did not drop out. Limitations of the study are noted and directions for future research are discussed.     

Instrument Development With Web Surveys and Multiple Imputations

This article outlines the development of a tool to assess psychosocial needs in U.S. Air Force (USAF) units. Instrument development began with the construction of an item taxonomy, pretesting procedures (Q-sort; cognitive interviews), and a pilot web survey to document internal consistency and test-retest reliability, followed by two large-scale Web surveys to derive a viable factor structure. Because certain items (e.g., child care) were not relevant to all respondents, multiple imputations to replace missing values were necessary before factor analyses could proceed. Exploratory factor analyses of data from the first Web survey revealed an eight-factor solution; and data from the second Web survey confirmed that the eight-factor solution could be replicated on an independent sample. Developed in accordance with psychometric principles, the final assessment tool tapped a range of psychosocial factors spanning quality of work life, community life, family functioning, and personal well-being.     

Property and prejudice: How racial attitudes and social‐evaluative concerns shape property appraisals

Property evaluations rarely occur in the absence of social context. However, no research has investigated how intergroup processes related to prejudice extend to concepts of property. In the present research, we propose that factors such as group status, prejudice and pressure to mask prejudiced attitudes affect how people value the property of racial ingroup and outgroup members. In Study 1, White American and Asian American participants were asked to appraise a hand‐painted mug that was ostensibly created by either a White or an Asian person. Asian participants demonstrated an ingroup bias. White participants showed an outgroup bias, but this effect was qualified. Specifically, among White participants, higher racism towards Asian Americans predicted higher valuations of mugs created by Asian people. Study 2 revealed that White Americans' prejudice towards Asian Americans predicted higher valuations of the mug created by an Asian person only when participants were highly concerned about conveying a non‐prejudiced personal image. Our results suggest that, ironically, prejudiced majority group members evaluate the property of minority group members whom they dislike more favourably. The current findings provide a foundation for melding intergroup relations research with research on property and ownership.     

Hypothesis generation, sparse categories, and the positive test strategy

We consider the situation in which a learner must induce the rule that explains an observed set of data but the hypothesis space of possible rules is not explicitly enumerated or identified. The first part of the article demonstrates that as long as hypotheses are sparse (i.e., index less than half of the possible entities in the domain) then a positive test strategy is near optimal. The second part of this article then demonstrates that a preference for sparse hypotheses (a sparsity bias) emerges as a natural consequence of the family resemblance principle; that is, it arises from the requirement that good rules index entities that are more similar to one another than they are to entities that do not satisfy the rule.     

Clustering preference data in the presence of response-style bias

Preference data, such as Likert scale data, are often obtained in questionnaire-based surveys. Clustering respondents based on survey items is useful for discovering latent structures. However, cluster analysis of preference data may be affected by response styles, that is, a respondent's systematic response tendencies irrespective of the item content. For example, some respondents may tend to select ratings at the ends of the scale, which is called an ‘extreme response style’. A cluster of respondents with an extreme response style can be mistakenly identified as a content-based cluster. To address this problem, we propose a novel method of clustering respondents based on their indicated preferences for a set of items while correcting for response-style bias. We first introduce a new framework to detect, and correct for, response styles by generalizing the definition of response styles used in constrained dual scaling. We then simultaneously correct for response styles and perform a cluster analysis based on the corrected preference data. A simulation study shows that the proposed method yields better clustering accuracy than the existing methods do. We apply the method to empirical data from four different countries concerning social values.