Short assessment of the Big Five: robust across survey methods except telephone interviewing

We examined measurement invariance and age-related robustness of a short 15-item Big Five Inventory (BFI-S) of personality dimensions, which is well suited for applications in large-scale multidisciplinary surveys. The BFI-S was assessed in three different interviewing conditions: computer-assisted or paper-assisted face-to-face interviewing, computer-assisted telephone interviewing, and a self-administered questionnaire. Randomized probability samples from a large-scale German panel survey and a related probability telephone study were used in order to test method effects on self-report measures of personality characteristics across early, middle, and late adulthood. Exploratory structural equation modeling was used in order to test for measurement invariance of the five-factor model of personality trait domains across different assessment methods. For the short inventory, findings suggest strong robustness of self-report measures of personality dimensions among young and middle-aged adults. In old age, telephone interviewing was associated with greater distortions in reliable personality assessment. It is concluded that the greater mental workload of telephone interviewing limits the reliability of self-report personality assessment. Face-to-face surveys and self-administrated questionnaire completion are clearly better suited than phone surveys when personality traits in age-heterogeneous samples are assessed.     

Sex differences in reporting sensitive behavior: A comparison of interview methods

While telephone surveys generally are considered to be comparable to in-person interviews for the collection of survey data, their utility for the acquisition of sensitive information from respondents remains in question. This paper examines the effect of interview method upon self-reports of a threatening topic—substance use—for male and female college students. It is hypothesized that males may be less likely to admit sensitive behaviors in telephone interviews, compared to face-to-face encounters, due to an interaction of a characteristic of the telephone medium (i.e., the lack of balanced exchange of identifying information between the interviewer and respondent) and aspects of the male sex role, which discourages self-revelation. Findings indicate that differences in reported use of both legal and illegal substances by interview method were greater among males than females. These gender differences in reporting behavior by survey method remained after statistical controls were applied.     

A comparison of four methods of constructing factor scores

Four least-squares methods for constructing factor scores have been described in the literature. The formal properties of these scores are developed, and they are compared in terms of four generally desirable properties of constructed factor scores. In particular, it is shown that two of the methods yield scores that are conditionally unbiassed, and univocal in the sense of Guilford and Michael, though not orthogonal, while one of the other methods yields orthogonal scores.It is shown that constructed factor scores cannot be simultaneously univocal and orthogonal, unless we choose the special basis in factor space given by Canonical Factor Analysis.The general problem of choosing between the methods is discussed, on the basis of the theoretical relations obtained.EDITOR'S NOTE: The reader will quickly discover that this article develops several of the generalizations given in the second part of the preceding article, On Factors and Factor Scores. Independent development of the same generalizations is, of course, not a new phenomenon. Because the Presidential Address automatically is accepted for publication and given space in the December issue, it was decided that the only fair thing to do was to print this article in the same issue.     

A direct comparison of four methods for eliminating a response

Thirty-two rats pressed one lever (lever A) on a VI 30-sec schedule of food reinforcement and were then shifted to one of four procedures for eliminating the lever A response: extinction, differential reinforcement of other behavior, reinforcement of a different response (pole pushing), and reinforcement of a similar response (pressing lever B). Effectiveness of a response-elimination procedure was measured by (1) how quickly lever A response rate fell to a low level when the procedure was in effect, (2) how much lever A responding recovered when the procedure was discontinued, and (3) how resistant lever A responding was to reinstatement when the VI reinforcement schedule was reimposed. No one method was superior by all three measures. Extinction produced the most variable behavior, while differential reinforcement of other behavior produced the least. Reinforcing alternative behavior produced the greatest recovery in the original lever A response when the response-elimination procedure was discontinued.     

Cues-pause-point language training: Structuring trainer statements to provide students with correct answers to questions

This study assessed the applicability of Cues-Pause-Point language training procedures in teaching students to obtain information from the statements of others. Two mentally retarded subjects, one of whom was echolalic, received training on one set of stimuli but not on another. During training the subjects were encouraged to remain quiet before, during, and briefly after the presentation of statements and then verbalize (i.e., answer a question) using the verbal cue(s) that had been presented in the statement. Correct responding reached 100% to the trained stimuli and both subjects' responding improved to the untrained stimuli. Posttests revealed that subjects used the trainer's statements to answer novel questions. The results suggest that Cues-Pause-Point procedures may be useful in teaching severely retarded individuals the functional use of observing and listening to others' verbal behavior.     

'Questions, questions, questions!' A comparison of therapist inferences and parental responses to systemic questions

Using a specially designed questionnaire, we examined the relationship between parental responses to systemic questions, therapists'views based upon these responses and parental reports of dysfunction in a member of the family. The questionnaire was completed by parents of a randomly selected population sample of adolescents and by experienced family therapists. Therapists made inferences that were predictable, coherent and reliable. They gave most salience to the concept of'enmeshment'and least to'hostile-discordant'functioning. Some enmeshed answers were favoured by substantial proportions of parents, suggesting that they may reflect normal variants of family functioning. However no associations between total enmeshment scores and reported mental health problems were found. Hostile-discordant functioning, as assessed in this study, was rare in the general population sample, but was associated with reported problems.     

Response elimination: A comparison of four procedures

Four procedures for eliminating an operant response were compared within a multiple schedule. Response reduction was most rapid when reinforcement was provided for a specific alternative response. The decline in responding produced by extinction and differential reinforcement of other behavior was similar. Responding initially increased and then gradually decreased when reinforcers were delivered independently of responding at fixed times. Removal of reinforcement from the alternative-response and DRO procedures did not result in recovery of the target response. However, the shift from response-independent dilivery of reinforcers to extinction caused an initial increase in responding.     

A confirmatory factor analysis of the Bem Sex Role Inventory: Old questions,new answers

LISREL analyses of data from a sample of 671 adults (90% Caucasian, 10% Black) evaluated (a) item factor structure of the Bem Sex Role Inventory (BSRI), (b) second-order factor model for the item factors, and (c) structural equation models estimating age and gender differences in these factors. Seven first-order item factors were extracted and found to have equivalent factor loadings for males and females. Item factors were related to two second-order factors: Masculinity and Femininity. There were relatively small age and gender differences in the first- and second-order factors. There was a differential relationship between self-rated masculinity and femininity and the first-order BSRI item factors for males and females. Results suggest that the BSRI best assesses gender-related personality traits and represents only one component of the complex multidimensional construct of gender roles.We thank Herbert W. Marsh and an anonymous reviewer for valuable comments on previous drafts of this article.     

Detecting correlation changes in multivariate time series: A comparison of four non-parametric change point detection methods

Change point detection in multivariate time series is a complex task since next to the mean, the correlation structure of the monitored variables may also alter when change occurs. DeCon was recently developed to detect such changes in mean and\or correlation by combining a moving windows approach and robust PCA. However, in the literature, several other methods have been proposed that employ other non-parametric tools: E-divisive, Multirank, and KCP. Since these methods use different statistical approaches, two issues need to be tackled. First, applied researchers may find it hard to appraise the differences between the methods. Second, a direct comparison of the relative performance of all these methods for capturing change points signaling correlation changes is still lacking. Therefore, we present the basic principles behind DeCon, E-divisive, Multirank, and KCP and the corresponding algorithms, to make them more accessible to readers. We further compared their performance through extensive simulations using the settings of Bulteel et al. (Biological Psychology, 98 (1), 29-42, 2014) implying changes in mean and in correlation structure and those of Matteson and James (Journal of the American Statistical Association, 109 (505), 334-345, 2014) implying different numbers of (noise) variables. KCP emerged as the best method in almost all settings. However, in case of more than two noise variables, only DeCon performed adequately in detecting correlation changes.     

Mood and realism of confidence judgements of one''s own answers to general knowledge questions

This study examines the effect of a depressed mood on the realism of subjects' confidence judgements of the correctness of answers to general knowledge questions. Research conducted on how mood influences cognitive processes gives reason to expect that a depressed mood might increase the realism of individuals' confidence ratings. Sixty subjects were divided into three conditions, two of which were given mood induction, one condition into an elated-happy mood and one condition into a depressed-sad mood. As evidenced by subjects' responses to mood scales only the depressed condition was affected by the mood induction. All subjects answered 93 general knowledge questions and rated their confidence in the correctness of the answer given. Subjects were instructed to think aloud when answering the last 31 questions. The conditions did not differ with respect to the proportion of questions answered correctly, mean level of confidence, nor with respect to three measures of the realism in subjects' confidence ratings (calibration, over/underconfidence and resolution). The results were the same when questions answered with and without think aloud instructions were analysed separately.     

EEG feedback training in the treatment of epilepsy: Some questions and some answers

A basic question in EEG feedback training of epileptic patients is whether the decrease in seizures is specifically due to the training or to other factors. Questions may also be raised as to what EEG changes are involved. Preliminary results in five patients suggest that seizure reductions can occur with training which are not due to placebo or nonspecific effects or to changes in medication compliance. These changes occurred rapidly during EEG-contingent feedback training but not when feedback was random in relation to the EEG. Reliable changes in the EEG were also observed, but the question of which mechanism accounts for these results has yet to be answered.     

A comparison of four measures of self-control skills

This study compares the psychometric characteristics of four questionnaires designed to assess self-control skills: the Self-Control Questionnaire, the Frequency of Self-Reinforcement Questionnaire, the Cognitive Self-Management Test, and the Lifestyle Approaches Inventory. Content validity was judged to be fairly comparable by three raters in Study 1. In Study 2, convergent and divergent validity support was obtained for all four questionnaires when administered to 369 multiethnic college students, but the relative degree of support varied across constructs. Hence, selection of a self-control instrument may be guided by the target behavior of interest.     

Children’s eyewitness memory: A comparison of two interviewing strategies as realized by forensic professionals

A critical issue for developmental psychology is how to obtain accurate and complete eyewitness memory reports from preschoolers without offering suggestions that might result in false allegations. We examined effects of two interviewing strategies (police/verbal interviews and clinician/prop-assisted interviews) on young children’s reports about a medical examination. A total of 58 4-year-olds participated in the study, which conformed to a 2 (Interview Type) × 2 (Number of Interviews) factorial design. Analyses revealed that interviewers spent less time off topic and asked more free recall questions in the police/verbal interviews than in the clinician/prop-assisted interviews. Compared with police/verbal interviews, clinician/prop-assisted interviews resulted in significantly more correct rejections and commission errors in children’s memory reports. However, on a final free recall test, error rates were comparable across conditions. Higher child verbal intelligence predicted memory accuracy in police/verbal interviews, and greater parental attachment anxiety predicted children being asked a higher number of misleading questions. The study provides new insights into interview techniques that promote preschoolers’ accurate eyewitness reports.