Youth-parent consistencies on ratings of difficulties and prosocial behavior: exploration of an at-risk sample

Low informant agreement is of particular concern in clinical settings, since diagnoses and interventions are largely based on reports from parents and/or youths. This study explores youth-parent consistencies in an at-risk sample of youths (n = 42), several from immigrant and refugee families, all with stressful background experiences. Data from a community sample (n = 165) was used to contrast the clinical results. Results showed that correlations between clinical youths and parents were within the same range as those in the community sample. Consistencies concerning absolute level of behavior were higher in the clinical sample. However, interesting differences in informant consistencies were found on difficulties and resources between the two samples. This study adds to the picture that there is no simple relationship between severity of behavior deviance and informant agreement. Asking about behavioral resources as well as difficulties may provide valuable additional information regarding differences in the perspectives of at-risk youths and parents.     

On the limits of infants' quantification of small object arrays

Recent work suggests that infants rely on mechanisms of object-based attention and short-term memory to represent small numbers of objects. Such work shows that infants discriminate arrays containing 1, 2, or 3 objects, but fail with arrays greater than 3 [Feigenson, L., & Carey, S. (2003). Tracking individuals via object-files: Evidence from infants' manual search. Developmental Science, 6, 568-584; Feigenson, L., Carey, S., & Hauser, M. (2002). The representations underlying infants' choice of more: Object files versus analog magnitudes. Psychological Science, 13(2), 150-156]. However, little is known about how infants represent arrays exceeding the 3-item limit of parallel representation. We explored possible formats by which infants might represent a 4-object array. Experiment 1 used a manual search paradigm to show that infants successfully discriminated between arrays of 1 vs. 2, 2 vs. 3, and 1 vs. 3 objects. However, infants failed to discriminate 1 vs. 4 despite the highly discriminable ratio, providing the strongest evidence to date for object-file representations underlying performance in this task. Experiment 2 replicated this dramatic failure to discriminate 1 from 4 in a second paradigm, a cracker choice task. We then showed that infants in the choice task succeeded at choosing the larger quantity with 0 vs. 4 crackers and with 1 small vs. 4 large crackers. These results suggest that while infants failed to represent 4 as “exactly 4”, “approximately 4”, “3”, or as even as “a plurality”, they did represent information about the array, including the existence of a cracker or cracker-material and the size of the individual objects in the array.     

A double-dissociation in infants' representations of object arrays

Previous studies show that infants can compute either the total continuous extent (e.g. Clearfield, M.W., & Mix, K.S. (1999). Number versus contour length in infants' discrimination of small visual sets. Psychological Science, 10(5), 408-411; Feigenson, L., & Carey, S. (2003). Tracking individuals via object-files: evidence from infants' manual search. Developmental Science, 6, 568-584) or the numerosity (Feigenson, L., & Carey, S. (2003). Tracking individuals via object-files: evidence from infants' manual search. Developmental Science, 6, 568-584) of small object arrays. The present experiments asked whether infants can compute both extent and number over a given array. Experiment 1 used a habituation procedure to show that 7-month-old infants can compute numerosity when the objects in the array contrast in color, pattern, and texture. Experiment 2 revealed that, with these heterogeneous arrays, infants no longer represent the array's total continuous extent. Since previous work shows that infants compute continuous extent but not numerosity when objects have identical rather than contrasting properties, these results form a double dissociation. Infants computed number but not extent over representations of contrasting objects, and computed extent but not number over representations of identical objects.     

Reliability in the context of the experiment: A commentary on two articles by Birkimer and Brown

Two sources of variability must each be considered when examining change in level between two sets of data obtained by human observers; namely, variance within data sets (phases) and variability attributed to each data point (reliability). Birkimer and Brown (1979a, 1979b) have suggested that both chance levels and disagreement bands be considered in examining observer reliability and have made both methods more accessible to researchers. By clarifying and extending Birkimer and Brown's papers, a system is developed using observer agreement to determine the data point variability and thus to check the adequacy of obtained data within the experimental context.     

A graphical judgmental aid which summarizes obtained and chance reliability data and helps assess the believability of experimental effects

Interval by interval reliability has been criticized for "inflating" observer agreement when target behavior rates are very low or very high. Scored interval reliability and its converse, unscored interval reliability, however, vary as target behavior rates vary when observer disagreement rates are constant. These problems, along with the existence of "chance" values of each reliability which also vary as a function of response rate, may cause researchers and consumers difficulty in interpreting observer agreement measures. Because each of these reliabilities essentially compares observer disagreements to a different base, it is suggested that the disagreement rate itself be the first measure of agreement examined, and its magnitude relative to occurrence and to nonoccurrence agreements then be considered. This is easily done via a graphic presentation of the disagreement range as a bandwidth around reported rates of target behavior. Such a graphic presentation summarizes all the information collected during reliability assessments and permits visual determination of each of the three reliabilities. In addition, graphing the "chance" disagreement range around the bandwidth permits easy determination of whether or not true observer agreement has likely been demonstrated. Finally, the limits of the disagreement bandwidth help assess the believability of claimed experimental effects: those leaving no overlap between disagreement ranges are probably believable, others are not.     

A method for combining occurrence and nonoccurrence interobserver agreement scores

Various statistics have been proposed as standard methods for calculating and reporting interobserver agreement scores. The advantages and disadvantages of each have been discussed in this journal recently but without resolution. A formula is presented that combines separate measures of occurrence and nonoccurrence percentages of agreement, with weight assigned to each measure, varying according to the observed rate of behavior. This formula, which is a modification of a formula proposed by Clement (1976), appears to reduce distortions due to "chance" agreement encountered with very high or low observed rates of behavior while maintaining the mathematical and conceptual simplicity of the conventional method for calculating occurrence and nonoccurrence agreement.     

A demonstration of the value of interchangeable observers

The remarkably high agreement between observers using the SRIC, the TSBC, and the CFRS makes the observers interchangeable. This agreement is a product of the intensive and extensive training and monitoring of full-time observers, the use of categories rather than continua, the low degree of interpretation required by the procedures, the use of lay language, the immediate recording after short observational periods, and the familiar and standard setting. Other important features include use of rates, emphasis on time, concern for positive behavior, and close linkages between concepts and categories so that concepts are explicitly specified. Taken together, these characteristics make these systems powerful instruments for the guidance of treatment and the prediction of outcomes. The key to their success seems to be the recording of simple actions and action sequences (the basic phenomena of psychology) as the basic data from which a variety of useful indexes can be readily formed.Preparation of this article was supported by Grant MH-30654 from the National Institute of Mental Health to S. Duncan and D. Fiske.Presented at the 87th Annual Meetings of the American Psychological Association, New York City, September 1979, as part of a symposium on New assessment systems for residential treatment, management, research, and evaluation.     

A probability-based formula for calculating interobserver agreement

Estimates of observer agreement are necessary to assess the acceptability of interval data. A common method for assessing observer agreement, per cent agreement, includes several major weaknesses and varies as a function of the frequency of behavior recorded and the inclusion or exclusion of agreements on nonoccurrences. Also, agreements that might be expected to occur by chance are not taken into account. An alternative method for assessing observer agreement that determines the exact probability that the obtained number of agreements or better would have occurred by chance is presented and explained. Agreements on both occurrences and nonoccurrences of behavior are considered in the calculation of this probability.     

状元殿试对策的文化内涵

状元殿试对策有着深厚的文化底蕴。它既是对当时性文化现象的全面把握,又是对历时性文化内涵的深刻理解和灵活化用。状元殿试对策作为传统文化的重要载体之一,有着重要的文化研究价值,对当今考试文体也有着诸多启示和借鉴。