Iterative techniques for unbiased rating scales

Three iterative techniques for neutralizing the effects of stimulus bias in category rating experiments were examined with a wide variety of stimulus variables. Under all conditions examined, the iterative techniques quickly led to a stable category estimation. This result was obtained for stimulus variables with strong measurement properties, e.g. length and weight; for stimulus variables with only ordinal properties, e.g. emery papers; and for stimulus variables with only nominal properties, where an ordered set is obtained only in the course of the category scaling, e.g. female profiles.     

Computer-administered interviews and rating scales

To evaluate the value of computer-administered interviews and rating scales, the following topics are reviewed in the present article: (a) strengths and weaknesses of structured and unstructured assessment instruments, (b) advantages and disadvantages of computer administration, and (c) the validity and utility of computer-administered interviews and rating scales. Computer-administered evaluations are more comprehensive and reliable and less biased than evaluations routinely conducted in clinical practice. Also, the use of continuous monitoring systems, which increasingly entail the use of computer administration, has been related to improved treatment outcome. However, the use of computer-administered interviews and rating scales will sometimes lead to false positive diagnoses, and for this reason, it is recommended that computer assessment be combined with clinical judgment.     

Effects of instructions and rating scales on item selection for the BSRI scales

Walkup and Abbott (1978) stated that Edwards and Ashworth's (1977) failure to replicate Bem's (1974) selection of items for the Masculinity and Femininity Scales of the Bern Sex Role Inventory (BSRI) may be attributed to differences in the instructions and anchored rating scales used in the two studies. The present study tested the hypothesis that presence of various interaction effects involving instructions and rating scales would influence the acceptability of items for the BSRI Masculinity and Femininity Scales. Results based on the evaluation of individual items by Bem's item selection criteria in each of the four experimental conditions obtained by systematically manipulating two instructions (Bem's and Edwards' instructions) and two rating scales (Bem's and Edwards' rating scales) and also those based on the analysis of variance of item mean desirability ratings from the four experimental conditions supported the hypothesis.     

Adaptive rating scales in sequential decisions

The benefits gained in decision research through the use of computer-controlled procedures, as opposed to the use of traditional pencil-and-paper techniques, can exceed the expected gains of efficiency and standardization. Computers extend the scope of a sequential decision making paradigm by enhancing (1) the strength of experimental design, (2) reliability of measurement, (3) procedural flexibility, and (4) single-subject data analysis. Data are reported that indicate the necessity of using computers to obtain reliable measurements and valid results for this type of decision research.     

On the history of rating scales

Rating scales constitute one of the most widely employed techniques in research on personality and individual differences. The historical background of rating scales is therefore a matter of considerable interest. Though Galton has generally been given credit for originating rating scale methodology, several applications of rating scales prior to Galton can be identified, and the seminal idea of rating scales can be traced back to Galen.     

Multiple anchoring of category rating scales

A psychophysical experiment compared the effects of two different kinds of anchoring upon category ratings of the sizes of squares: (1) single anchoring in which the same square was presented on every anchoring trial, and (2) multiple anchoring in which squares of different sizes were presented on anchoring trials. Subjects did not rate the anchors, only those squares presented on alternate trials as the series stimuli. The major finding was that the two kinds of anchoring have similar effects. As with the single anchor, the multiple anchor establishes a new endpoint for the scale of judgment. The previously demonstrated relationship of increasing and then decreasing contrast as a function of the remoteness of the single anchor (Sarris, 1967, 1976) was found also for multiple anchoring.     

Individually tailored behavioral rating scales: a possible alternative

Individually tailored behavioral ratings were introduced as a possible alternative to time sampling or counting each occurrence of the behavior. Interrater reliability was found to be good for the more specific behavior categories and reliability between ratings obtained from direct observation and those based on unit records was acceptable. The usefulness of individually tailored behavioral rating scales in demonstrating behavior change is demonstrated through the presentation of a representative case.     

Children's Sleep Behavior Scale: normative data on 870 children in grades 1 to 6

A 22-item Likert-type rating scale for parents was developed for screening a broad range of specific sleep-related behaviors of elementary school children. The prevalence of these behaviors was reported by parents for boys (n = 459) and girls (n = 411) in three age groups, less than 8.5 yr., between 8.5 and 11.5 yr., and greater than 11.5 yr. For all age groups, the most prevalent behaviors were restlessness, waking up at night, pleasant dreams, getting up to go to the bathroom, talking while asleep, and complaints about not being able to sleep, while the least frequent were rhythmical movements and crying while asleep. The self-reports suggest that many of the behaviors are underestimated in the literature. Some sex and age differences were found, but the number of siblings, birth order, change in family structure, and educational status of father and mother were unrelated to the sleep variables. Test-retest reliabilities of self-reports by these parents to individual items were adequate.     

Assessment battery for communication (ABaCo): normative data

The Assessment Battery for Communication (ABaCo) was introduced to evaluate pragmatic abilities in patients with cerebral lesions. The battery is organized into five evaluation scales focusing on separate components of pragmatic competence. In the present study, we present normative data for individuals 15-75?years of age (N = 300). The sample was stratified by age, sex, and years of education, according to Italian National Institute of Statistics indications in order to be representative of the general national population. Since performance on the ABaCo decreases with age and lower years of education, the norms were stratified for both age and education. The ABaCo is a valuable tool in clinical practice; the normative data provided here will enable clinicians to determine different kinds and specific levels of communicative impairments more precisely.     

SSRAT: The processing of rating scales for the determination of two-dimensional sociometric status

SSRAT is an MS-DOS computer program for two-dimensional sociometric status determination with rating scales. It classifies members of a population into five sociometric status groups, using 3-, 5-, 7-, or 9-point ratings in matrices of assessors and assessed. The processing of rating scales instead of nominations offers several advantages, including increased variability and reliability of the resulting scores. SSRAT is built on the null hypothesis of conditional random attribution of ratings, according to the particular probability distribution of an assessor. Output is available in the form of an ASCII SPSS data file for further statistical processing. Recent studies show that SSRAT, in comparison with nomination methods, (1) is superior in determining popular persons while it detects rejected persons as well, and (2) probably yields classifications that have a higher temporal stability.     

Action verbal fluency normative data for the elderly

An emerging body of literature points to the prominent role of the frontal lobes in the retrieval of verbs, whereas production of common and proper nouns arguably is mediated primarily by posterior and anterior temporal regions, respectively. Although the majority of studies examining the neuroanatomic distinctions between verb and noun retrieval have relied on action naming tasks (naming depicted activities, e.g., running) as indicators of verb retrieval abilities, recent studies have utilized an action (verb) verbal fluency measure, the Action Fluency Test (AFT), to assess verb retrieval. Findings from these studies suggest that action fluency is sensitive to the integrity of fronto-subcortical neural circuitry and that it is a valid measure of executive and language functions. The AFT is an easily administered executive function measure, but no normative data for the AFT or other action fluency tasks has been published. This study was undertaken to provide initial AFT normative data for a sample of 145 healthy elderly subjects. As education is significantly correlated with AFT scores, the normative data are stratified by educational level.     

A latent class model for rating data

A latent class model for rating data is presented which is the analogue of Andrich's binomial Rasch model for Lazarsfeld's latent class analysis (LCA). The response probabilities for the rating categories follow a binomial distribution and depend on class-specific item parameters. The EM-algorithm for parameter estimation as well as goodness of fit tests for the model are described. An example using questionnaire items on interest in physics illustrates the use of the model as an alternative to the latent trait approach of analyzing test data.I would like to thank Clifford Clogg and the anonymous reviewers for their helpful comments.