A general model for the analysis of multilevel data

A general model is developed for the analysis of multivariate multilevel data structures. Special cases of the model include repeated measures designs, multiple matrix samples, multilevel latent variable models, multiple time series, and variance and covariance component models.We would like to acknowledge the helpful comments of Ruth Silver. We also wish to thank the referees for helping to clarify the paper. This work was partly carried out with research funds provided by the Economic and Social Research Council (U.K.).     

The importance of assessing treatment integrity: An example in the anxiety disorders

One purpose of this investigation was to examine the importance of assessing treatment integrity in a study evaluating a treatment for specific anxiety disorders. Three subjects, two social phobics and one simple phobic, received self-instruction training (Phase I) followed by exposure and self-instruction training (Phase II) in a multiple baseline across subjects design. All subjects were assessed during a pretreatment baseline and throughout treatment using measures of treatment integrity and measures of change in phobic severity. Improvement took place at different times for different subjects. Measures of treatment integrity, which consisted of monitoring of self-statements as well as practice outside the session, indicated that treatment was not always received as intended and that improvement was correlated with practice. The usefulness of measures of treatment integrity in both clinical and research settings is highlighted.     

Accountability amplifies the status quo effect when change creates victims

This study assesses the impact of accountability, the status quo, and anticipated costs and benefits on judgement of the acceptability of a drug in the US pharmaceuticals market. Several effects are documented: (1) subjects were more accepting of a drug, the lower the anticipated risks of side effects and the greater the anticipated benefits; (2) subjects were especially unwilling to accept risk when the drug was not yet on the market and when they felt accountable for their decisions; (3) accountable subjects confronted by an off-the-market drug that posed moderate or high risk were also especially likely to procrastinate, to buckpass, and to think in integratively complex ways about the problem, notwithstanding the fact that many more lives would be saved than lost. We explain these results by positing that perceptual-cognitive processes (loss aversion) and political processes (blame avoidance) mutually reinforce each other when decision makers are accountable for choices that raise the possibility of changing the status quo in ways that impose losses on identifiable constituencies. We conclude by commenting on the complex normative issues that arise in labelling response tendencies as biases. Choices that look irrational within one ethical or political framework sometimes appear quite reasonable with another.     

Evaluating children's mental health service systems: An analysis of critical behaviors and events

A lack of studies which evaluate system change by tracking client outcomes is noted in the children's mental health area. This deficit may be a result of the inability of researchers to define outcomes and to draw conclusions about which measures reflect the efficacy of services and service delivery systems. This paper reviews five social validation surveys which examined children's mental health outcome measures. Based on the results of the five surveys, a model of critical behaviors and events is presented. This model will assist evaluators and researchers in understanding which critical events and behaviors should be measured to assess the impact of community-based mental health services for children.     

Factor analysis of the social performance survey schedule

There are several studies suggesting that the Social Performance Survey Schedule (SPSS) is a reliable and valid measure of social skill. However, the factorial structure of the SPSS has never been examined. In the present study, SPSSs taken by 652 college students were factor analyzed by the method of principal components and the resulting factors were rotated according to the varimax criterion. Separate factor analyses were conducted for men and women. Seven factors, which accounted for a little over a third of the total variance, were retained for each sex. A large general factor labeled Prosocial Competence emerged for both sexes. Beyond this, the factorial solutions for the two sexes tended to diverge, with males showing a large negative factor (Social Offensiveness) and three smaller negative factors and females showing five relatively small negative factors. Suggestions were made concerning additional factor analytic studies of the SPSS and the ways in which derived factors might be used in research and clinical work.This research was supported by funds from the Rutgers University Research Council. Thanks are due to Leona Aiken for her statistical consultation.     

APPLICATION OF A SOCIAL SKILLS TRAINING PROGRAM IN THE MODIFICATION OF INTERPERSONAL DEFICITS AMONG RETARDED ADULTS: A CLINICAL REPLICATION

Six mentally retarded adults, equally divided into two treatment groups, were provided with individualized social skills training programs. Treatment, evaluated via a multiple-baseline design strategy, was sequentially and cumulatively applied across target behaviors over a four-week intervention period. Behavioral observation probes and social validation measures served as the primary dependent variables. Results indicated that (a) treatment was effective for virtually all behaviors across all subjects, (b) improvements occurred for both training and generalization scenes, and (c) behavioral performance was maintained one month following the termination of treatment.     

ANALYSIS OF THE CONSISTENCY OF OBJECTIVE MEASURES OF SEXUAL AROUSAL IN WOMEN

Eight adult women volunteers viewed the same erotic film in two different sessions. Their resulting genital responses were recorded simultaneously by three different measures: vaginal pressure pulse, vaginal blood volume, and labial temperature change. During the erotic stimulation, the vaginal pressure pulse and labial responses always increased, and the vaginal blood volume response increased on all but two occasions. Although there was considerable intersubject variability in each genital measure, all three measures were found to have some intrasubject consistency over sessions with respect to either their response amplitudes or patterns, with labial temperature being the most consistent on both parameters. The relationship between the response patterns of the three measures during the film was also relatively consistent across sessions, as was the correspondence between subjective ratings of arousal and both vaginal pressure pulse and labial responses but not vaginal blood volume response. To overcome the problem of considerable intrasubject variability of response amplitudes, it was suggested that the inclusion in the data analysis of several parameters of response patterns, which were relatively stable over sessions, might facilitate the evaluation of a treatment.     

Considerations in the choice of interobserver reliability estimates

Two types of interobserver reliability values may be needed in treatment studies in which observers constitute the primary data-acquisition system: trial reliability and the reliability of the composite unit or score which is subsequently analyzed, e.g., daily or weekly session totals. Two approaches to determining interobserver reliability are described: percentage agreement and "correlational" measures of reliability. The interpretation of these estimates, factors affecting their magnitude, and the advantages and limitations of each approach are presented.     

Resilience of children in disasters: A multisystem perspective

Interest in resilience is surging in research, policy and practice as threats from disasters rise and humanity confronts a global pandemic. This commentary highlights the importance of defining resilience for portability across system levels and disciplines in order to integrate knowledge and prepare adequately for the challenges posed to children and youth by multisystem disasters. A scalable definition of resilience is recommended: The capacity of a dynamic system to adapt successfully to challenges that threaten the function, survival or development of the system. Major determinants of adaptation among young people in the context of disaster are highlighted, including variations in adversity exposure dose, developmental timing, individual differences and the socio-ecological systems of children's lives that can be mobilised in response. Adaptation of children in disasters depends on the resilience of interconnected systems, including families, schools, communities and policy sectors. Implications of a multisystem perspective for disaster risk reduction and preparedness are discussed with a focus on nurturing the resilience of children and their societies for challenges in the near term and long into the future.