Peer Assessment of Aviation Performance: Inconsistent for Good Reasons

Research into expertise is relatively common in cognitive science concerning expertise existing across many domains. However, much less research has examined how experts within the same domain assess the performance of their peer experts. We report the results of a modified think‐aloud study conducted with 18 pilots (6 first officers, 6 captains, and 6 flight examiners). Pairs of same‐ranked pilots were asked to rate the performance of a captain flying in a critical pre‐recorded simulator scenario. Findings reveal (a) considerable variance within performance categories, (b) differences in the process used as evidence in support of a performance rating, (c) different numbers and types of facts (cues) identified, and (d) differences in how specific performance events affect choice of performance category and gravity of performance assessment. Such variance is consistent with low inter‐rater reliability. Because raters exhibited good, albeit imprecise, reasons and facts, a fuzzy mathematical model of performance rating was developed. The model provides good agreement with observed variations.     

Inventar zur therapeutischen Beziehung (ITB)

A successful psychotherapy requires a good therapeutic relationship. An adequate operationalization by German diagnostic instruments has to be improved. A new instrument for measuring the therapeutic relationship from the patient’s perspective is presented. It is suitable for various therapeutic orientations, integrates current empirical findings in a broad theoretical framework and corrects methodological deficits of the existing German questionnaires. The therapeutic relationship questionnaire (ITB) was developed with a sample of 44 therapists and 519 inpatient, outpatient and day clinic patients. The ITB findings confirm a very good reliability (internal consistency and retesting reliability). There is initial evidence for convergent, divergent and differential validity and for associations with therapy effects. The ITB is an economic instrument that in contrast to other questionnaires measures a general factor which could be replicated in several confirmatory and exploratory factor analyses.     

Distribution of Reported Durations of Behavior in Applied Behavioral Research

Duration is a commonly measured dimension of behavior in behavioral research and clinical practice. An approach to studies of measurement in behavior analysis is to simulate streams of behavior from which samples can be extracted. It is therefore important to establish a typical range and distribution of behavioral durations on which simulated behavioral data should be based. We conducted an analysis of behavioral durations reported in the Journal of Applied Behavior Analysis between 2008 and 2012. The range and distribution of data points across different durations will be presented, as well as an analysis of the reliability of the software used to measure each data point. Copyright © 2015 John Wiley & Sons, Ltd.     

On Original Sin

This article sets out a constructive account of original sin that attempts to take seriously the Christian tradition (particularly, the Reformed tradition), and that avoids the serious theological drawback of the doctrine of original guilt. I dub this account the moderate Reformed doctrine of original sin. I also argue that an adequate understanding of original sin must be open‐textured enough to accommodate some version of the story of evolutionary human development. Although I do not offer an account of how original sin is consistent with evolutionary human development, the doctrine set out here is commensurate with several live options on this controversial theological topic, which I take to be a strength, rather than a weakness, of the view.