A general model for the analysis of multilevel data

A general model is developed for the analysis of multivariate multilevel data structures. Special cases of the model include repeated measures designs, multiple matrix samples, multilevel latent variable models, multiple time series, and variance and covariance component models.We would like to acknowledge the helpful comments of Ruth Silver. We also wish to thank the referees for helping to clarify the paper. This work was partly carried out with research funds provided by the Economic and Social Research Council (U.K.).     

The importance of assessing treatment integrity: An example in the anxiety disorders

One purpose of this investigation was to examine the importance of assessing treatment integrity in a study evaluating a treatment for specific anxiety disorders. Three subjects, two social phobics and one simple phobic, received self-instruction training (Phase I) followed by exposure and self-instruction training (Phase II) in a multiple baseline across subjects design. All subjects were assessed during a pretreatment baseline and throughout treatment using measures of treatment integrity and measures of change in phobic severity. Improvement took place at different times for different subjects. Measures of treatment integrity, which consisted of monitoring of self-statements as well as practice outside the session, indicated that treatment was not always received as intended and that improvement was correlated with practice. The usefulness of measures of treatment integrity in both clinical and research settings is highlighted.     

Evaluating children's mental health service systems: An analysis of critical behaviors and events

A lack of studies which evaluate system change by tracking client outcomes is noted in the children's mental health area. This deficit may be a result of the inability of researchers to define outcomes and to draw conclusions about which measures reflect the efficacy of services and service delivery systems. This paper reviews five social validation surveys which examined children's mental health outcome measures. Based on the results of the five surveys, a model of critical behaviors and events is presented. This model will assist evaluators and researchers in understanding which critical events and behaviors should be measured to assess the impact of community-based mental health services for children.     

Athlete doping confrontation efficacy and confrontation likelihood

Evidence supports the role of coach doping confrontation efficacy (DCE; Sullivan et al., 2015) as a deterrent against athletes’ doping cognitions (Boardley et al., 2019; Sullivan & Razavi, 2017), but the role of the athlete has largely been ignored. Current anti-doping campaigns encourage athletes to report doping misconduct (i.e., whistleblowing), but some athletes would prefer to confront the athlete directly (Erickson et al., 2017). Thus, it is important to consider what may contribute to athletes’ likelihood to confront a doping teammate or opponent. The purpose of this study was to determine whether DCE could predict an athlete’s likelihood to confront a doping teammate or opponent. Additionally, doping moral disengagement (MD) was included as a possible moderator of this relationship. Surveys were completed by 155 college athletes (n_male = 145) to measure their perceived DCE, doping MD, likelihood to confront a teammate, and likelihood to confront an opponent. Separate linear regression analyses were run for the two targets of confrontation. In the teammate model, both DCE and doping MD were significant predictors of confrontation likelihood. DCE was the only significant predictor in the opponent model. Neither model presented with a significant interaction, suggesting no moderation effect. Results suggest perceived DCE is associated with a greater likelihood to confront a doping athlete, regardless of whether they are a teammate or opponent; however, moral disengagement plays a greater role if the athlete is a teammate. These findings imply that confrontation may be the first line of defense against doping before whistleblowing action is taken. Research should continue to explore antecedents and consequences of athlete doping confrontation, providing greater insight into the whistleblowing process.     

The Flow-Clutch Scale: Development and preliminary validation in sport and exercise

ObjectivesThe Integrated Model of Flow and Clutch States describes two overlapping psychological states that underlie exceptional performance and rewarding exercise experiences. However, research based on this model is currently hampered because no validated measure has yet been developed. Therefore, the aim of this multi-study paper was to develop and provide preliminary validation of the Flow-Clutch Scale in sport and exercise.DesignUsing two independent adult samples (n = 280; n = 264), three studies were conducted to develop and establish preliminary validity of the Flow-Clutch Scale.MethodIn Study 1, we developed an initial version of the scale and established content validity using an expert panel. In Study 2, we employed exploratory factor analysis to: identify the most appropriate factor structure; examine the scale’s internal consistency; test whether the scale differentiated between individuals who experience flow, clutch, or neither state; and examine relationships with the Flow State Scale-2. In Study 3, we aimed to replicate findings of Study 2 with an independent sample, and employed confirmatory factor analysis to confirm the factor structure, internal consistency, and relationships with the Flow State Scale-2.ResultsThe results provide preliminary validation of the four-factor, 22-item Flow-Clutch Scale.ConclusionsThese studies indicate the Flow-Clutch Scale represents a useful scale for researchers interested in examining flow and/or clutch states in sport and exercise. Recommendations are provided for further research to continue testing, and accumulating evidence for, the validity and reliability of the Flow-Clutch Scale.     

A signal detection framework for the evaluation of probabilistic forecasts

In this paper I formulate an approach for evaluating probabilistic forecasts in terms of signal detection theory. Signal detection theory provides a powerful perspective for this type of problem, and a rich empirical background including methodological tools as well as an extensive body of research in many domains. I propose procedures which emphasize the maximization of expected utility for the decision maker who uses the forecasts. Further, I suggest approaches to obtaining indices of calibration and resolution within this framework. I also present arguments that the proposed indices will exhibit the same basic properties as do decompositions of Brier's (1950, Monthly Weather Review, 78, 1–3) mean probability score. However, the properties may be reflected in different ways, and hence, the present methods may lead to different conclusions about forecasting ability. Finally, I argue that the use of an expected utility loss function makes this approach more appropriate for practical applications as well as for theoretical research than other procedures with more arbitrary loss functions.     

Factor analysis of the social performance survey schedule

There are several studies suggesting that the Social Performance Survey Schedule (SPSS) is a reliable and valid measure of social skill. However, the factorial structure of the SPSS has never been examined. In the present study, SPSSs taken by 652 college students were factor analyzed by the method of principal components and the resulting factors were rotated according to the varimax criterion. Separate factor analyses were conducted for men and women. Seven factors, which accounted for a little over a third of the total variance, were retained for each sex. A large general factor labeled Prosocial Competence emerged for both sexes. Beyond this, the factorial solutions for the two sexes tended to diverge, with males showing a large negative factor (Social Offensiveness) and three smaller negative factors and females showing five relatively small negative factors. Suggestions were made concerning additional factor analytic studies of the SPSS and the ways in which derived factors might be used in research and clinical work.This research was supported by funds from the Rutgers University Research Council. Thanks are due to Leona Aiken for her statistical consultation.     

Comparative judgments with numerical reference points

A model of subjective magnitude comparisons is explored, which assumes that subjects compare symbolic stimulus magnitudes with respect to a reference point. The reference point may be established implicitly by the question (e.g., “Which is larger?” vs “Which is smaller?”) or be presented explicitly (e.g., “Choose the stimulus closer to X.”). The model was tested in five experiments in which subjects judged which of two comparison digits was closer to (or further from) a reference digit. Regression analyses in three experiments revealed that reaction time depended on the ratio of the distances from the comparison items to the reference point. The other two experiments provided evidence that subjects can strategically vary the processes by which they compare stimuli to a reference point. The results indicated that subjects can perform various types of “analog arithmetic” using either the linear number scale or a nonlinear scale of subjective digit magnitude.     

APPLICATION OF A SOCIAL SKILLS TRAINING PROGRAM IN THE MODIFICATION OF INTERPERSONAL DEFICITS AMONG RETARDED ADULTS: A CLINICAL REPLICATION

Six mentally retarded adults, equally divided into two treatment groups, were provided with individualized social skills training programs. Treatment, evaluated via a multiple-baseline design strategy, was sequentially and cumulatively applied across target behaviors over a four-week intervention period. Behavioral observation probes and social validation measures served as the primary dependent variables. Results indicated that (a) treatment was effective for virtually all behaviors across all subjects, (b) improvements occurred for both training and generalization scenes, and (c) behavioral performance was maintained one month following the termination of treatment.