Short assessment of the Big Five: robust across survey methods except telephone interviewing

We examined measurement invariance and age-related robustness of a short 15-item Big Five Inventory (BFI-S) of personality dimensions, which is well suited for applications in large-scale multidisciplinary surveys. The BFI-S was assessed in three different interviewing conditions: computer-assisted or paper-assisted face-to-face interviewing, computer-assisted telephone interviewing, and a self-administered questionnaire. Randomized probability samples from a large-scale German panel survey and a related probability telephone study were used in order to test method effects on self-report measures of personality characteristics across early, middle, and late adulthood. Exploratory structural equation modeling was used in order to test for measurement invariance of the five-factor model of personality trait domains across different assessment methods. For the short inventory, findings suggest strong robustness of self-report measures of personality dimensions among young and middle-aged adults. In old age, telephone interviewing was associated with greater distortions in reliable personality assessment. It is concluded that the greater mental workload of telephone interviewing limits the reliability of self-report personality assessment. Face-to-face surveys and self-administrated questionnaire completion are clearly better suited than phone surveys when personality traits in age-heterogeneous samples are assessed.     

How to push someone's buttons: A comparison of four anger-induction methods

This study compared the effects of four ways of inducing anger: film, stress interview, punishment, and harassment. Sixty-four healthy participants were randomly assigned to one of these conditions. Effects were examined by means of self-report and physiological measures (blood pressure, heart rate, skin conductance level, and skin conductance response). All four methods produced comparable levels of self-reported anger, while harassment and interview produced the largest cardiovascular effects, and electrodermal activity increased more in reaction to harassment, interview, and punishment conditions compared to film. Thus, physiological reactivity was especially increased by anger-induction methods that included personal contact (harassment and interview). Regarding specificity of self-reported emotions, fear and frustration were the only emotions out of nine non-target emotions that increased in comparable degree to anger following film, interview, and punishment, while harassment produced more self-reported anger than fear. Possible explanations and further recommendations are discussed.     

Sex differences in reporting sensitive behavior: A comparison of interview methods

While telephone surveys generally are considered to be comparable to in-person interviews for the collection of survey data, their utility for the acquisition of sensitive information from respondents remains in question. This paper examines the effect of interview method upon self-reports of a threatening topic—substance use—for male and female college students. It is hypothesized that males may be less likely to admit sensitive behaviors in telephone interviews, compared to face-to-face encounters, due to an interaction of a characteristic of the telephone medium (i.e., the lack of balanced exchange of identifying information between the interviewer and respondent) and aspects of the male sex role, which discourages self-revelation. Findings indicate that differences in reported use of both legal and illegal substances by interview method were greater among males than females. These gender differences in reporting behavior by survey method remained after statistical controls were applied.     

A comparison of four methods of constructing factor scores

Four least-squares methods for constructing factor scores have been described in the literature. The formal properties of these scores are developed, and they are compared in terms of four generally desirable properties of constructed factor scores. In particular, it is shown that two of the methods yield scores that are conditionally unbiassed, and univocal in the sense of Guilford and Michael, though not orthogonal, while one of the other methods yields orthogonal scores.It is shown that constructed factor scores cannot be simultaneously univocal and orthogonal, unless we choose the special basis in factor space given by Canonical Factor Analysis.The general problem of choosing between the methods is discussed, on the basis of the theoretical relations obtained.EDITOR'S NOTE: The reader will quickly discover that this article develops several of the generalizations given in the second part of the preceding article, On Factors and Factor Scores. Independent development of the same generalizations is, of course, not a new phenomenon. Because the Presidential Address automatically is accepted for publication and given space in the December issue, it was decided that the only fair thing to do was to print this article in the same issue.     

Methods of data collection,perceptions of risks and losses,and motivation to give truthful answers to sensitive survey questions

Two experiments examined survey respondents' concerns about risks and losses when answering sensitive questions in a survey. In Experiment 1 subjects watched one of eight different versions of a videotaped staged interview of a woman being asked about abortion and drunk driving. Experiment 2 was an actual survey interview about women's health issues, including abortion. In Experiment 2, a large proportion of the sample had a recent abortion for which validation information from the clinic was available. Results of both experiments indicate that, when responding to questions about sensitive topics, survey respondents are concerned about risks and losses other than those covered by standard confidentiality assurances and that these other concerns affect truthful reporting. Experiment 1 showed the importance of privacy in surveys of sensitive behaviours. The experiments suggest that under some circumstances interviewer‐administration of sensitive questions may produce data as good as or better than self‐administration. Copyright © 1999 John Wiley & Sons, Ltd.     

A direct comparison of four methods for eliminating a response

Thirty-two rats pressed one lever (lever A) on a VI 30-sec schedule of food reinforcement and were then shifted to one of four procedures for eliminating the lever A response: extinction, differential reinforcement of other behavior, reinforcement of a different response (pole pushing), and reinforcement of a similar response (pressing lever B). Effectiveness of a response-elimination procedure was measured by (1) how quickly lever A response rate fell to a low level when the procedure was in effect, (2) how much lever A responding recovered when the procedure was discontinued, and (3) how resistant lever A responding was to reinstatement when the VI reinforcement schedule was reimposed. No one method was superior by all three measures. Extinction produced the most variable behavior, while differential reinforcement of other behavior produced the least. Reinforcing alternative behavior produced the greatest recovery in the original lever A response when the response-elimination procedure was discontinued.     

Cues-pause-point language training: Structuring trainer statements to provide students with correct answers to questions

This study assessed the applicability of Cues-Pause-Point language training procedures in teaching students to obtain information from the statements of others. Two mentally retarded subjects, one of whom was echolalic, received training on one set of stimuli but not on another. During training the subjects were encouraged to remain quiet before, during, and briefly after the presentation of statements and then verbalize (i.e., answer a question) using the verbal cue(s) that had been presented in the statement. Correct responding reached 100% to the trained stimuli and both subjects' responding improved to the untrained stimuli. Posttests revealed that subjects used the trainer's statements to answer novel questions. The results suggest that Cues-Pause-Point procedures may be useful in teaching severely retarded individuals the functional use of observing and listening to others' verbal behavior.     

'Questions, questions, questions!' A comparison of therapist inferences and parental responses to systemic questions

Using a specially designed questionnaire, we examined the relationship between parental responses to systemic questions, therapists'views based upon these responses and parental reports of dysfunction in a member of the family. The questionnaire was completed by parents of a randomly selected population sample of adolescents and by experienced family therapists. Therapists made inferences that were predictable, coherent and reliable. They gave most salience to the concept of'enmeshment'and least to'hostile-discordant'functioning. Some enmeshed answers were favoured by substantial proportions of parents, suggesting that they may reflect normal variants of family functioning. However no associations between total enmeshment scores and reported mental health problems were found. Hostile-discordant functioning, as assessed in this study, was rare in the general population sample, but was associated with reported problems.     

A confirmatory factor analysis of the Bem Sex Role Inventory: Old questions,new answers

LISREL analyses of data from a sample of 671 adults (90% Caucasian, 10% Black) evaluated (a) item factor structure of the Bem Sex Role Inventory (BSRI), (b) second-order factor model for the item factors, and (c) structural equation models estimating age and gender differences in these factors. Seven first-order item factors were extracted and found to have equivalent factor loadings for males and females. Item factors were related to two second-order factors: Masculinity and Femininity. There were relatively small age and gender differences in the first- and second-order factors. There was a differential relationship between self-rated masculinity and femininity and the first-order BSRI item factors for males and females. Results suggest that the BSRI best assesses gender-related personality traits and represents only one component of the complex multidimensional construct of gender roles.We thank Herbert W. Marsh and an anonymous reviewer for valuable comments on previous drafts of this article.     

Response elimination: A comparison of four procedures

Four procedures for eliminating an operant response were compared within a multiple schedule. Response reduction was most rapid when reinforcement was provided for a specific alternative response. The decline in responding produced by extinction and differential reinforcement of other behavior was similar. Responding initially increased and then gradually decreased when reinforcers were delivered independently of responding at fixed times. Removal of reinforcement from the alternative-response and DRO procedures did not result in recovery of the target response. However, the shift from response-independent dilivery of reinforcers to extinction caused an initial increase in responding.     

Calendar interviewing: a mixed methods device for a biographical approach to migration

Biographical interviews are used in life stories research to elicit narratives on retrospective views of the self and the social world. Life calendars are used in life course research to collect standardized data in various domains of individual lives. Both instruments deal with autobiographical memory, which is a critical aspect for data quality and accuracy. This article presents a mixed methods use of life calendars and life stories for researching on migration called the Calendar Interviewing Device (CID). The CID consists of a life calendar for characterizing trajectories and collecting life stories through open-ended interviews. An analysis of 12 interviews examines the features of this particular research device, namely its flexibility on adapting to different interviewees, the strategies they used for recalling events and locating them in time, and the richness of the data obtained with the CID.     

Detecting correlation changes in multivariate time series: A comparison of four non-parametric change point detection methods

Change point detection in multivariate time series is a complex task since next to the mean, the correlation structure of the monitored variables may also alter when change occurs. DeCon was recently developed to detect such changes in mean and\or correlation by combining a moving windows approach and robust PCA. However, in the literature, several other methods have been proposed that employ other non-parametric tools: E-divisive, Multirank, and KCP. Since these methods use different statistical approaches, two issues need to be tackled. First, applied researchers may find it hard to appraise the differences between the methods. Second, a direct comparison of the relative performance of all these methods for capturing change points signaling correlation changes is still lacking. Therefore, we present the basic principles behind DeCon, E-divisive, Multirank, and KCP and the corresponding algorithms, to make them more accessible to readers. We further compared their performance through extensive simulations using the settings of Bulteel et al. (Biological Psychology, 98 (1), 29-42, 2014) implying changes in mean and in correlation structure and those of Matteson and James (Journal of the American Statistical Association, 109 (505), 334-345, 2014) implying different numbers of (noise) variables. KCP emerged as the best method in almost all settings. However, in case of more than two noise variables, only DeCon performed adequately in detecting correlation changes.     

Mood and realism of confidence judgements of one''s own answers to general knowledge questions

This study examines the effect of a depressed mood on the realism of subjects' confidence judgements of the correctness of answers to general knowledge questions. Research conducted on how mood influences cognitive processes gives reason to expect that a depressed mood might increase the realism of individuals' confidence ratings. Sixty subjects were divided into three conditions, two of which were given mood induction, one condition into an elated-happy mood and one condition into a depressed-sad mood. As evidenced by subjects' responses to mood scales only the depressed condition was affected by the mood induction. All subjects answered 93 general knowledge questions and rated their confidence in the correctness of the answer given. Subjects were instructed to think aloud when answering the last 31 questions. The conditions did not differ with respect to the proportion of questions answered correctly, mean level of confidence, nor with respect to three measures of the realism in subjects' confidence ratings (calibration, over/underconfidence and resolution). The results were the same when questions answered with and without think aloud instructions were analysed separately.     

Impact of the telephone motivational interviewing on the colorectal cancer screening participation. A randomized controlled study

IntroductionWhile high participation rates ensure the cost-effectiveness of colorectal cancer screening programs, it is well known that postal requests do not achieve acceptable levels of participation.ObjectiveThis randomized controlled study aimed to test the impact of individualized phone counseling to prompt people aged 50 to 74 to take a colorectal cancer test.MethodTwo phone strategies were compared. The first involved computer-aided individualized counseling while the second was based on motivational interviewing. A total of 49,972 people were randomly assigned to a control group (CG) and to the individualized counseling (IC) and motivational interviewing (MI) telephone groups.ResultsA simple call doubled the participation rate per protocol (19.2% > 9.2%; p < .001; r = .131; OR = 2.374), and tripled it when the interview was conducted (30.4% > 9.2%; p < .001; r = .219; OR = 4.321). In an intention-to-treat analysis, the benefit of calling by phone remained even higher than postal requests (10% > 9.2%; p < .01; r = .014; OR = 1.103). However, there was no impact of the type of interview on participation rates.ConclusionThe results are discussed for future research.