Beyond inference by eye: Statistical and graphing practices in JEAB, 1992‐2017

Debates about the utility of p values and correct ways to analyze data have inspired new guidelines on statistical inference by the American Psychological Association (APA) and changes in the way results are reported in other scientific journals, but their impact on the Journal of the Experimental Analysis of Behavior (JEAB) has not previously been evaluated. A content analysis of empirical articles published in JEAB between 1992 and 2017 investigated whether statistical and graphing practices changed during that time period. The likelihood that a JEAB article reported a null hypothesis significance test, included a confidence interval, or depicted at least one figure with error bars has increased over time. Features of graphs in JEAB, including the proportion depicting single‐subject data, have not changed systematically during the same period. Statistics and graphing trends in JEAB largely paralleled those in mainstream psychology journals, but there was no evidence that changes to APA style had any direct impact on JEAB. In the future, the onus will continue to be on authors, reviewers and editors to ensure that statistical and graphing practices in JEAB continue to evolve without interfering with characteristics that set the journal apart from other scientific journals.     

Contrast effects in judgmental forecasting when assessing the implications of worst and best case scenarios

Two experiments investigated whether individuals' forecasts of the demand for products and a stock market index assuming a best or worst case scenario depend on whether they have seen a single scenario in isolation or whether they have also seen a second scenario presenting an opposing view of the future. Normatively, scenarios should be regarded as belonging to different plausible future worlds so that the judged implications of one scenario should not be affected when other scenarios are available. However, the results provided evidence of contrast effects in that the presentation of a second “opposite” scenario led to more extreme forecasts consistent with the polarity of the original scenario. In addition, people were more confident about their forecasts based on a given scenario when two opposing scenarios were available. We examine the implications of our findings for the elicitation of point forecasts and judgmental prediction intervals and the biases that are often associated with them.     

No evidence that alcohol intoxication impairs judgments of learning in face recognition

Alcohol use is frequently involved in crime, making it crucial to understand the role of alcohol in facial recognition to maximize correct perpetrator identifications. Although the majority of the alcohol and face recognition research has investigated recognition with retrospective confidence judgments, we examined the effects of alcohol intoxication on face recognition with prospective metacognitive judgments. Participants (N = 54 university students without a history of hazardous alcohol/substance use) consumed either alcohol (mean breath alcohol concentration of 0.06 at pretest and 0.07 at post‐test) or a non‐alcoholic placebo drink. Participants then studied unfamiliar male and female faces and made judgments of learning (JOLs) for each face (i.e., predicted the likelihood of recognizing that face on a future memory test). After a brief distractor task, participants completed an old–new recognition test on which they attempted to distinguish the studied faces from new faces. It was found that the alcohol manipulation had minimal effect on face recognition performance or judgments of learning. Our results suggest that theory‐based cues about the effects of alcohol might play a greater role in retrospective judgments than prospective judgments. Although not a primary focus of the study, face recognition was better for male faces than female faces, and this occurred for both female and male participants. Limitations and implications of the research are discussed.     

Should you Sleep on it? The Effects of Overnight Sleep on Subjective Preference‐based Choice

Conventional wisdom and studies of unconscious processing suggest that sleeping on a choice may improve decision making. Although sleep has been shown to benefit several cognitive tasks, including problem solving, its impact on everyday choices remains unclear. Here we explore the effects of ‘sleeping on it’ on preference‐based decisions among multiple options. In two studies, individuals viewed several attributes describing a set of items and were asked to select their preferred item after a 12‐hour interval that either contained sleep or was spent fully awake. After an overnight period including sleep, individuals showed increases in positive perceptions of the choice set. This finding contrasts with previous research showing that sleep selectively enhances recall for negative information. In addition, this increase in positive recall did not translate into a greater desire to purchase their preferred item or into an overall benefit for choice satisfaction. Time‐of‐day controls were used to confirm that the observed effects could not be explained by circadian influences. Thus, we show that people may feel more positive about the choice options but not more confident about the choice after ‘sleeping on’ a subjective decision. We discuss how the valence of recalled choice set information may be important in understanding the effects of sleep on multi‐attribute decision making and suggest several avenues for future research. Copyright © 2015 John Wiley & Sons, Ltd.     

Exploring counsellor perceptions of the impact of counselling supervision on clients

This qualitative study explores counsellors’ experiences and perceptions of how counselling supervision impacts upon their clients. Data collection combined open‐ended questionnaires (n = 13) and semi‐structured interviews (n = 6). The findings indicate that supervision impacts client work both helpfully and unhelpfully. Areas that emerged as having the most direct impact on client work were the counselling relationship dynamics and self‐awareness, professional development, emotional support, clients not discussed in supervision and the quality of the supervisory relationship. Congruence and confidence were the most direct link between supervision and client work.     

单维测验合成信度元分析

元分析是根据现有研究对感兴趣的主题得出比较准确和有代表性结论的一种重要方法,在心理、教育、管理、医学等社会科学研究中得到广泛应用。信度是衡量测验质量的重要指标,用合成信度能比较准确的估计测验信度。未见有文献提供合成信度元分析方法。本研究在比较对参数进行元分析的三种模型优劣的基础上,在变化系数模型下推出合成信度元分析点估计及区间估计的方法;以区间覆盖率为衡量指标,模拟研究表明本研究提出的合成信度元分析区间估计的方法得当;举例说明如何对单维测验的合成信度进行元分析。     

When credibility attacks: The reverse impact of source credibility on persuasion

Recent research on the self-validation hypothesis suggests that source credibility identified after message processing can influence the confidence people have in their own thoughts generated in response to persuasive messages (Briñol, Petty, & Tormala, 2004). The present research explored the implications of this effect for the possibility that high credibility sources can be associated with more or less persuasion than low credibility sources. In two experiments, it is demonstrated that when people generate primarily positive thoughts in response to a message (e.g., because the message contains strong arguments) and then learn of the source, high source credibility leads to more favorable attitudes than does low source credibility. When people have primarily negative thoughts in response to a message (e.g., because it contains weak arguments), however, this effect is reversed—that is, high source credibility leads to less favorable attitudes than does low source credibility.     

Metacognition during unfamiliar face matching

Kruger and Dunning (1999) described a metacognitive bias in which insight into performance is linked to competence: poorer performers are less aware of their mistakes than better performers. Competence-based insight has been argued to apply generally across task domains, including a recent report investigating social cognition using a variety of face-matching tasks. Problematically, serious statistical and methodological criticisms have been directed against the traditional method of analysis used by researchers in this field. Here, we further illustrate these issues and investigate new sources of insight within unfamiliar face matching. Over two experiments (total N = 1077), where Experiment 2 was a preregistered replication of the key findings from Experiment 1, we found that insight into performance was multi-faceted. Participants demonstrated insight which was not based on competence, in the form of accurate updating of estimated performance. We also found evidence of insight which was based on competence: the difference in confidence on correct versus incorrect trials increased with competence. By providing ways that we can move beyond problematic, traditional approaches, we have begun to reveal a more realistic story regarding the nature of insight into face perception.     

Continuity in adolescent career preparation and its effects on adjustment

Career preparation represents a major developmental task of adolescence, which has not received sufficient attention in empirical research on career development. Thus, this study was designed to examine the structure, continuity, and change in adolescent career preparation and its relationships with adjustment. The data were collected from a diverse sample of 389 adolescents on four occasions beginning in Grade 11 in high school and ending 6 months after high school graduation. Using Structural Equations modeling, a four-wave, developmental model of adolescent career preparation indicated by career decidedness, planning, and confidence was shown to fit the empirical data very well. Career preparation was characterized by continuity and a consistent pattern of positive concurrent and prospective associations with various indicators of adjustment. The results of the study provide empirical support for the theoretical propositions about the adaptive role of adolescent career preparation, particularly in terms of its contribution to psychological well-being and social integration.