Psychometric instability of measures in novel settings: Use of psychiatric rating scales in nursing homes

Researchers have become increasingly concerned about problems of the quality of measurement in applied evaluation settings. Of particular importance is change in both the reliability and the validity of a measure that is used in a novel setting. This problem is illustrated by an attempt to use psychiatric rating scales to assess the behavior of chronic mental patients currently residing in nursing homes. Methods for assessing changes in both reliability and validity are presented, along with suggestions for how to deal with these problems.This research was supported in part by an Extramural Research Grant from the State of Illinois Department of Mental Health and Developmental Disabilities.     

Development and psychometric properties of the Children's Assertive Behavior Scale

The purpose of this paper is to present the psychometric properties and individual items comprising the Children's Assertive Behavior Scale (CABS). The CABS is a behaviorally designed self-report instrument for children which measures general and specific social skills and covers many socially relevant situations which are problematic for children. Acceptable psychometric properties of the 27-item test were obtained in several independent investigations across both geographical regions and grade levels. The CABS showed significant concurrent validity with peer, parent, and teacher measures of social competency. The CABS also discriminated trained versus untrained children participating in social skills versus a placebo discussion group. The instrument is presented, along with recommendations for future applications and research.Both authors share equal responsibility for the development and evaluation of the Children's Assertive Behavior Scale.     

The Marital Communication Rating Schedule: An instrument for clinical assessment

The Marital Communication Rating Schedule (MCRaS) is presented as an observationally based clinical rating system for assessing verbal behavior in marital communication. Data from 35 response display discussions lasting from 20 to 30 min each, which took place between 11 married couples, were used to examine aspects of the reliability and validity of the instrument. Three raters made independent ratings of 37 MCRaS categories for each husband and wife for each discussion period. Reliability among the raters was shown to be high when calculated within one scale point. Concurrent validity was assessed by comparing MCRaS ratings for four categories with observationally based validation criteria independently coded and measured. Results indicated that for three categories — negative statements, overgeneralizations, and amount of talk — ratings produced results that were similar to those yielded by laborious coding of audiotapes. For one category, opinions requested, a relationship between the ratings and coded data was not found. The validation results were discussed in terms of possible differences in the basis of ratings for the categories subjected to validation. Although further research is needed, it was concluded that MCRaS has many of the desirable qualities needed in a clinically useful, observationally based rating system.This investigation was conducted in connection with the Sociobehavioral Research Project at The University of Michigan when Joyce Borkin and Claude L. Walter were affiliated with the project.     

Assessment of social skills using a Thurstone Equal-Appearing Interval scale

Although Likert ratings of social skill are widely used in behavioral assessment, such ratings may have limited replicability potential and social validity. The present study compared the reliability of Likert and Thurstone Equal-Appearing Interval scales. The Thurstone-derived scale was slightly more reliable than its Likert counterpart. Moreover, the empirical and clinical potential of Thurstone scaling substantially exceeds that of Likert and other rating methods.     

Communicating safety with drivers via dynamic message signs

In recent years numerous transportation agencies have begun displaying creative safety messages like “get your head out of your apps” on dynamic message signs (DMS). DMS have been used traditionally to provide real-time information about travel times, weather conditions, construction, and incidents. Applying emotional and consequential concepts from protection motivation theory, which has a track record of leading to behavioral changes from public awareness campaigns, this study evaluates how the use of safety messages on DMS impacts driver perceptions. We find that emotions, but not consequences, impact self-reported driving behavior. Further, while drivers reported negative emotions would change their driving habits, positive messages were recalled far more often. Cell phone related messages were recalled most frequently despite being rarely displayed along roadways in Michigan where the study is conducted. Thus, the results support the use of positively themed messages with consequences that drivers perceive as realistic.     

Sexual promiscuity & self-control: A behavior genetic explanation to an evolutionary question

Within separate academic disciplines there exist two consistent findings that have emerged. Behavior geneticists, on one hand, continue to uncover moderate to high heritability estimates for virtually every human trait measurable. Evolutionary psychologists, on the other hand, have thoroughly documented species-wide universality in various human traits, suggesting that natural (or sexual) selection may have directly favored such outcomes. The goal of the current study, then, is to explore ways in which these lines of inquiry can be united via the use of behavior genetic methodologies coupled with evolutionary thought. Additionally, we attempt to unite our findings in a framework that can both account for the existence of heritable individual differences, while also understanding the importance of species-wide characteristics.     

Validation of the Cycling Behavior Questionnaire: A tool for measuring cyclists' road behaviors

IntroductionEven though cycling is an activity whose benefits in terms of urban mobility and health are globally recognized, its disproportional growth during the past few decades has led to some unexpected dynamics. In fact, the increasing number of traffic injuries and deaths involving cyclists has a high cost for public health systems. Considering the available empirical evidence, aberrant and positive behaviors on the road constitute relevant predictors for the injuries suffered by road users. Nevertheless, the scarcity of tools that measure and evaluate the behavior of road users, especially in the case of cyclists, constitutes a serious lack in terms of explaining, intervening and preventing traffic crashes through behavioral approaches.ObjectiveThis study had two essential purposes: first, to describe in detail the validation of measurement of risky and positive road user behaviors of cyclists using the Cycling Behavior Questionnaire. Second, to compare the mean scores of the validated version of the CBQ according to demographic and cycling-related factors.MethodAs a part of a larger collaborative research project, our data was collected from 1064 Spanish-speaking cyclists (between 17 and 80 years old) from 20 countries, who filled out an anonymous electronic survey on their riding behaviors. The data was analyzed using competitive Confirmatory Factor Analyses (CFA), thus obtaining basic psychometric values and an optimized structure for the scale.ResultsThe obtained results suggest that the CBQ has a clear factorial structure, items with high factorial weight, and good internal consistency. In particular, the results of the latent variable model with three factors, which were labeled errors, violations and positive behaviors, show that the CBQ is satisfactorily adjusted.ConclusionThe findings of this research support the idea that the CBQ may have important applications in the improvement of road safety through the study of cyclists' behavioral factors and their relationship to demographic and cycling-related factors.     

Conscious and unconscious discriminations between true and false memories

When subjects give higher confidence or memory ratings to a test word in a recognition test, do they simply raise their criterion without making better discrimination, or do they raise both criterion and true discrimination between the studied words (SW) and the lures? Given that previous studies found subjects’ false alarm responses to lures slower than to SW, and recognition latency inversely correlated with the confidence rating, can the latency difference between the lures and SW be accounted for by confidence or memory ratings? The present results showed that when subjects gave higher confidence or memory ratings, both their bias and sensitivity were raised, indicating that they could consciously distinguish the lures from the SW. However, a latency difference between true and false recognitions persisted after confidence and memory ratings were held constant, suggesting an unconscious source of discrimination between the two types of memory.