Computer‐based training to teach observers to accurately score problem behavior using fast forwarding at 5x normal speed

The current study evaluated whether a computer‐based training program could improve observers' accuracy in scoring discrete instances of problem behavior at 5x normal speed using a multiple‐baseline design across subjects. During pretraining and posttraining, observers attempted to score multiple examples of problem behavior at 5.0x without feedback. During training, participants scored multiple examples of problem behavior at 5.0x with automated feedback. Researchers measured omission (missing problem behavior) and commission (scoring other behavior as problem behavior) errors and the total duration of scoring time to determine the observers' accuracy and efficiency, respectively. After training, all participants scored instances of problem behavior with less than 11% error using 5.0x. The time required to score the videos across 90‐min observations was reduced by 66%. Results extend previous evaluations of fast forwarding by demonstrating that the training program could be used to teach observers to accurately score problem behavior using a speed faster than 3.5x.     

Hubert's multi-rater kappa revisited

There is a frequent need to measure the degree of agreement among R observers who independently classify n subjects within K nominal or ordinal categories. The most popular methods are usually kappa-type measurements. When R = 2, Cohen's kappa coefficient (weighted or not) is well known. When defined in the ordinal case while assuming quadratic weights, Cohen's kappa has the advantage of coinciding with the intraclass and concordance correlation coefficients. When R > 2, there are more discrepancies because the definition of the kappa coefficient depends on how the phrase ‘an agreement has occurred’ is interpreted. In this paper, Hubert's interpretation, that ‘an agreement occurs if and only if all raters agree on the categorization of an object’, is used, which leads to Hubert's (nominal) and Schuster and Smith's (ordinal) kappa coefficients. Formulae for the large-sample variances for the estimators of all these coefficients are given, allowing the latter to illustrate the different ways of carrying out inference and, with the use of simulation, to select the optimal procedure. In addition, it is shown that Schuster and Smith's kappa coefficient coincides with the intraclass and concordance correlation coefficients if the first coefficient is also defined assuming quadratic weights.     

Issues in Parent-Child Agreement: The Case of Structured Diagnostic Interviews

There are three primary purposes of this review. First, the review distinguishes among three types of reliability and describes the importance of evaluating the reliability of child psychopathology assessment instruments for clinical practice and research. Second, parent-child reliability findings from 5 of the more carefully studied and frequently used Structured (semi and highly) diagnostic interviews (The Schedule for Affective Disorders and Schizophrenia for School-age Children, The Child Assessment Scale, The Anxiety Disorders Interview Schedule for Children. The Diagnostic Interview for Children and Adolescents, and the Diagnostic Interview Schedule for Children) are examined. Finally, this review explores factors that have been implicated in terms of their potential effect on parent-child agreement. In addition, future directions for research and clinical practice within this area are identified and potential resolutions to the conundrum of parent-child discordance are discussed.     

The Impact of the Big Five Personality Traits on Reports of Child Behavior Problems by Different Informants

The present study compared ratings of a standardized sample of child behavior problems across informants and examined the effects of informant personality traits on child behavior ratings by mothers, teachers, and group-care workers. Participants were 55 clinic-referred children, aged 6–12 years. All informants watched and rated the same 17-min videotaped behavior sample of a familiar target child. Independent trained observers rated the same videotapes to provide criterion ratings. Informants personality traits were assessed using the NEO Five Factor Personality Inventory. Results showed that mothers reported fewer behavior problems than did the professionals, that the informants who were familiar with the child reported more behavior problems than did the independent observers, and that higher levels of informant neuroticism were related to higher ratings of child behavior problems in the case of the professionals, but not in the case of the mothers. In addition, group-care workers who were less extraverted and open were likely to report more child behavior problems than group-care workers with normal levels of extraversion and openness. Finally, no relations were found between agreeableness or conscientiousness and ratings of child behavior. Findings suggest that professionals who work with children are not immune to distortions based on their own personality.     

INFLUENCES OF RESPONSE RATE AND DISTRIBUTION ON THE CALCULATION OF INTEROBSERVER RELIABILITY SCORES

We examined the effects of several variations in response rate on the calculation of total, interval, exact‐agreement, and proportional reliability indices. Trained observers recorded computer‐generated data that appeared on a computer screen. In Study 1, target responses occurred at low, moderate, and high rates during separate sessions so that reliability results based on the four calculations could be compared across a range of values. Total reliability was uniformly high, interval reliability was spuriously high for high‐rate responding, proportional reliability was somewhat lower for high‐rate responding, and exact‐agreement reliability was the lowest of the measures, especially for high‐rate responding. In Study 2, we examined the separate effects of response rate per se, bursting, and end‐of‐interval responding. Response rate and bursting had little effect on reliability scores; however, the distribution of some responses at the end of intervals decreased interval reliability somewhat, proportional reliability noticeably, and exact‐agreement reliability markedly.     

OBSERVER TRAINING REVISITED: A COMPARISON OF IN VIVO AND VIDEO INSTRUCTION

We compared the effects of 2 observer‐training procedures. In vivo training involved practice during actual treatment sessions. Video training involved practice while watching progressively more complex simulations. Fifty‐nine undergraduate students entered 1 of the 2 training conditions sequentially according to an ABABAB design. Results showed that the 2 training methods produced almost identical scores on a posttraining observational test; however, the video method required fewer training sessions to complete.     

Personality perceptions and relationship satisfaction in couples

The present study investigates how perceptions of personality are related to relationship satisfaction in an age-heterogeneous sample of romantic couples. Self- and partner-perceptions as well as perceived similarity and self-other agreement were examined separately for the Big Five personality traits. Results of Actor–Partner-Interdependence Models revealed substantial effects of partner-perceived personality in all Big Five traits on both partners’ relationship satisfaction. In contrast, effects of self-perceived personality on relationship satisfaction were small. Over and above self- and partner-rated personality, perceiving one’s partner as similar to oneself made a small unique contribution to relationship satisfaction in couples. These results emphasize the importance of integrating self- and partner-perceptions of personality for relationships outcomes.     

Do People Use Their Implicit Theories of Creativity as General Theories?

This study examines whether people use the general implicit theories of creativity or not when applying them to themselves and others. On the basis of the actor–observer asymmetry theory, the authors propose that conception of creativity would be differently constructed depending on the targets of attention: general, self, and other. Three studies attempted to examine this hypothesis. In the preliminary study, a measure was developed to assess the characteristics that describe general creativity. In Study 1, exploratory and confirmatory factor analyses found the conceptual factors of general creativity. In Study 2, the common and specific factors of general, self, and others’ creativity concepts were compared through invariance tests. As a result, it was revealed that the invariance test failed, which means that the general conception of creativity may not be applicable to monitor self and others’ creativity in a consistent way. Implications and limitations of this study are discussed at the end of the study.     

Agreement and movement: a syntactic analysis of attraction

This paper links experimental psycholinguistics and theoretical syntax in the study of subject-verb agreement. Three experiments of elicited spoken production making use of specific characteristics of Italian and French are presented. They manipulate and examine its impact on the occurrence of 'attraction' errors (i.e. incorrect agreement with a word that is not the subject of the sentence). Experiment 1 (in Italian) shows that subject modifiers do not trigger attraction errors in free inverted VS (Verb Subject) structures, although attraction was found in VS interrogatives in English (Vigliocco, G., & Nicol, J. (1998). Separating hierarchical relations and word order in language production. Is proximity concord syntactic or linear? Cognition, 13-29) In Experiment 2 (in French), we report stronger attraction with preverbal clitic object pronouns than with subject modifiers. Experiment 3 (in French) shows that displaced direct objects in the cleft construction trigger attraction effects, in spite of the fact that the object does not intervene between the subject and the verb in the surface word order (OSV). Moreover, attraction is stronger in structures with subject-verb inversion (...). These observations are shown to be naturally interpretable through the tools of formal syntax, as elaborated within the Principles and Parameters/Minimalist tradition. Three important constructs are discussed: (1) the hierarchical representation of the sentence during syntactic construction, and the role of intermediate positions by which words transit when they move; (2) the role of specific hierarchical (c-command) but also linear (precedence) relations; and (3) the possibility that agreement involves two functionally distinct components. A gradient of computational complexity in agreement is presented which relates empirical evidence to these theoretical constructs.     

Leibniz's Concept of Substance and his Reception of John Calvin's Doctrine of the Eucharist

Leibniz saw the question of the eucharist as a crucial stumbling block to the agreement between Lutherans and Calvinists. Mandated together with Daniel Ernst Jablonsky to prepare working documents for the negotiations between Hanover and Brandenburg in 1697, Leibniz carefully read through the Calvinist Confessions of faith and the works of Calvin in their 1671 edition. He made an extensive collection of excerpts from the Confessions of faith and from Calvin's Institutes all intended to show that Calvinists admitted the substantial presence of Christ's body in the eucharist. (This collection of excerpts is analysed here for the first time and compared with another little-known document, the Unvorgreiffliches Bedencken). L. had argued previously in 1691/92 that, contrary to the assertions of Pellisson-Fontanier, his own conception of substance and of Christ's presence in the eucharist was completely different from Calvin's. However, by 1697, it was clear to Leibniz that Calvin's concept of substance, which was broadly speaking Aristotelian, was never defined clearly by the reformer, and could be made to coincide with Leibniz's own notion of substance as force rather than substance in its dimensional sense. At the same time L. dissociated Ubiquitarianism (doctrine characteristic of late sixteenth century Lutheranism, which defended the dimensional presence of Christ's body in heaven and in the eucharist, by arguing that Christ in his divine nature could cause his physical body to be present in several places at the same time) from Lutheranism. He also drove a wedge between the doctrines of Zwingli and Calvin. L. thus attempted to find religious union on a common ontology and he might well have succeeded if it were not for complex political circumstances, which ultimately caused the failure of the negotiations.