Judgments of moderator variables of agreement in person perception: A comparison of two cultures

Three moderators of agreement in person perception, behavioral consistency, observability and social desirability, were studied. The major hypothesis is that the moderators can be estimated using the standing of targets on traits; that is, that as targets vary on a given trait, they vary on how they are seen as on the moderators. Using Korean ( N  = 135) and US ( N  = 81) samples, we tested this approach for 80 traits. Analyses revealed that moderators varied by the combination of trait and target standing in different ways for the two samples. In judgment of behavioral consistency over target standings, linear and curvilinear trends were stronger for the US sample than for the Korean sample. For observability, judgments were similar, although curvilinear trends were larger for the Korean sample. Furthermore, being extremely positive was perceived as less desirable for the Korean judges. These findings were discussed in terms of cultural differences. Moreover, a new approach to the study of moderators was proposed.     

Meta-perception for pathological personality traits: do we know when others think that we are difficult?

The self allows us to reflect on our own behavior and to imagine what others think of us. Clinical experience suggests that these abilities may be impaired in people with personality disorders. They do not recognize the impact that their behavior has on others, and they have difficulty understanding how they are seen by others. We collected information regarding pathological personality traits--using both self and peer report measures--from groups of people who knew each other well (at the end of basic military training). In previous papers, we have reported that agreement between self-report and peer-report is only modest. In this paper, we address the question: Do people know that others disagree with their own perceptions of themselves? We found that expected peer scores predicted variability in peer report over and above self-report for all 10 diagnostic traits. People do have some incremental knowledge of how they are viewed by others, but they do not tell you about it unless you ask them to do so; the knowledge is not reflected in ordinary self-report data. Among participants who expect their peers to describe them as narcissistic, those who agree with this assessment are viewed as being less narcissistic by their peers than those who deny being narcissistic. It therefore appears that insight into how one is viewed by others can moderate negative impressions fostered by PD traits.     

Is action naming better preserved (than object naming) in Alzheimer's disease and why should we ask?

The present study compared object and action naming in patients with Alzheimer's dementia. We tested the hypothesis put forward in (some) previous studies that in Alzheimer's dementia the production of verbs, that is required in action naming, is better preserved than the production of nouns, that is required in object naming. The possible reason for the dissociation is that verbs are supported predominantly by frontal brain structures that may remain relatively better preserved in early Alzheimer's disease. Objects, on the other hand, are supported by temporal lobe structures that are affected early in the disease. An alternative hypothesis, which is supported by other studies, is that action naming is more impaired than object naming due to verbs being semantically more complex than nouns. In order to test these contrasting hypotheses, the present study used more stringent methodology than previous studies. We used a larger set of stimuli with carefully matched object and action items and we collected not only accuracy data but also naming latencies, a measure that is sensitive to even mild lexical retrieval problems. We compared the performance of 19 patients with mild to moderate Alzheimer's disease with that of 19 healthy age matched participants. We found that both the patients and the comparison group responded faster and made fewer errors on the object pictures than the action pictures. A qualitative analysis of the naming errors indicated that object and action naming pose different demands for the language system. The results overall suggest that the patients' performance is an exaggeration of the pattern present in the comparison participants.     

Semantic Factors in the Production of Number Agreement

This paper examines the role of semantic factors in the production of subject–verb number agreement. As an ostensibly grammatical process, number agreement provides an interesting case for examining the flow and interaction of semantic and syntactic information through the language-production system. Using a sentence-completion task, agreement errors can be elicited from subjects by presenting them with sentence fragments containing a complex noun-phrase, in which the nonhead noun is plural (e.g., The key to the cabinets...WERE missing.). Previous research has demonstrated that the probability of making an error can be affected by varying the properties of the nouns in the complex noun phrase. By investigating which variables do and do not affect error rates, constraints on the flow of information through the production system can be inferred. In three experiments, we investigated the possible effects of three different semantic manipulations of the nouns in the complex NP: animacy, semantic overlap, and plausibility of modification by the sentence predicate. We found that both animacy and semantic relatedness had reliable effects on error rates, indicating that the mechanism involved in implementing agreement cannot be blind to semantic information. However, the plausibility with which each noun could serve as the subject of the sentence predicate had no effect on error rates. Taken together, these results suggest that while semantic information is visible to the agreement mechanism, there are still constraints on when this information can affect the process. Specifically, it may be the case that only information contained within the complex NP is considered for the purposes of implementing agreement.     

Visual aids and structured criteria for improving visual inspection and interpretation of single-case designs

Because behavior analysis is a data-driven process, a critical skill for behavior analysts is accurate visual inspection and interpretation of single-case data. Study 1 was a basic study in which we increased the accuracy of visual inspection methods for A-B designs through two refinements of the split-middle (SM) method called the dual-criteria (DC) and conservative dual-criteria (CDC) methods. The accuracy of these visual inspection methods was compared with one another and with two statistical methods (Allison & Gorman, 1993; Gottman, 1981) using a computer-simulated Monte Carlo study. Results indicated that the DC and CDC methods controlled Type I error rates much better than the SM method and had considerably higher power (to detect real treatment effects) than the two statistical methods. In Study 2, brief verbal and written instructions with modeling were used to train 5 staff members to use the DC method, and in Study 3, these training methods were incorporated into a slide presentation and were used to rapidly (i.e., 15 min) train a large group of individuals (N = 87). Interpretation accuracy increased from a baseline mean of 55% to a treatment mean of 94% in Study 2 and from a baseline mean of 71% to a treatment mean of 95% in Study 3. Thus, Study 1 answered basic questions about the accuracy of several methods of interpreting A-B designs; Study 2 showed how that information could be used to increase the accuracy of human visual inspectors; and Study 3 showed how the training procedures from Study 2 could be modified into a format that would facilitate rapid training of large groups of individuals to interpret single-case designs.     

Are discrepancies among child,mother, and father reports on children's behavior related to parents' psychological symptoms and aspects of parent-child relationships?

Examined whether parents' symptoms and qualitative and quantitative aspects of parent–child relationships make unique contributions to mothers' and fathers' reports of, and mother–child, father–child, and father–mother discrepancies on, children's behavior. Participants were 100 children, aged 10–12, and their mothers and fathers. Parents' symptoms and parent–child relationships made unique contributions to both parents' ratings of externalizing behavior. Although parent–child relationship variables were related to both parents' ratings of internalizing behavior, only parents' symptoms made unique contributions. On mother–child and father–child discrepancies, differences emerged between mother and father, and internalizing and externalizing behaviors. Both fathers' and mothers' symptoms contributed to father–mother discrepancies on both behavior types, with parent–child relationships contributing unique variance to discrepancies on internalizing behavior. Results highlight the importance of each informant's symptoms and relationship variables in understanding informant discrepancies.     

A new Bayesian procedure for the estimation of the referees' decision thresholds and agreement. The case of professional handball refereeing

In double refereeing, agreement between referees is fundamental for the achievement of a flawless and smooth refereeing activity. Nonetheless, the agreeement can be affected by several external and internal factors, with a negative impact on the consistency of the refereeing and the fluidity of the game. The referee’s Decision Threshold (DT) is the limit above which the evidence of a foul results in the call of an infraction by the referee. It represents the individual refereeing style, and it is one of the factors that can contribute to low agreement between the referees. We present an application of a new Bayesian procedure to estimate referee’s DT in a typical refereeing task. To this end, 56 italian professional handball (FIGH) referees were asked to evaluate 96 potential foul plays, belonging to four different infraction types: 7-m throw, passive play, offensive foul, disciplinary sanctions. The proposed method provides information about: (i) referee’s individual DT; (ii) the agreement between pairs of referees (i.e., one-to-one); (iii) the agreement between each referee and all the other referees (i.e., one-to-total); (iv) the agreement between each referee and a reference referee (i.e., one-to-expert); (v) the proportion of agreement between the referees and a reference referee for each potential foul play. Sport federations would profit by this procedure in different ways: by using the information about the DT to train referees, by detecting referees with a low agreement with their colleagues or with the reference referee, by focusing training on specific plays to improve the arbitration class internal consistency.     

Cross-Informant Agreement in the Assessment of Social Phobia in Youth

In the present study involving children and adolescents with a principal diagnosis of social phobia, we measured parent–child agreement regarding social anxiety symptoms. Additionally, we examined variables related to the severity of the children's social phobia symptoms as reported by children and as rated by clinicians. Examination of cross-informant agreement indicated little difference between mean parent and children ratings of the children's social fears. In contrast, there was a significant difference in parent and children ratings of the children's avoidance, with parents endorsing greater degrees of social avoidance. Children's report of social avoidance was negatively related to scores on a measure of self-presentational concerns (i.e., social desirability). Clinicians' determination of the severity of the children's social phobia was also influenced by the children's self-presentation as well as parent report of social avoidance and children's depression scores. Thus, this differential weighting by the clinician of parent versus child report may be related to the finding that children's self-reported social avoidance was negatively related to their concerns regarding positive self-presentation. Results suggest the need to consider the impact of social desirability when examining clinical characteristics of children and adolescents with social phobia.     

Nominal scale agreement among observers

Experiments are considered where each of a sample of subjects is assigned to one of C categories separately by each of a fixed or varying group of observers. Building on earlier publications, general procedures are proposed to analyze agreements and disagreements among observers. In the case of a varying group of observers, it is shown that it is not necessary to demand a constant number of observers per subject. In the case of a fixed group of observers, the problem of missing data is considered.The procedures are illustrated within the context of two clinical diagnosis examples. In the first example it is investigated which categories are relatively hard to distinguish from one another; a new theorem is applied that shows a useful property of the statistic kappa. In the second example it is investigated if a subgroup of observers can be found with a significantly higher degree of interobserver agreement.The author gratefully acknowledges the valuable suggestions by W. Molenaar, R. van Strik, R. Popping and the referees.