The Validation of a Provider-Reported Fidelity Measure for the Transdiagnostic Sleep and Circadian Intervention in a Community Mental Health Setting

Monitoring treatment fidelity is essential to check if patients receive adequate doses of treatment and to enhance our theoretical understanding of how psychosocial treatments work. Developing valid and efficient measures to assess fidelity is a priority for dissemination and implementation efforts. The present study reports on the psychometric properties of the Provider-Rated TranS-C Checklist—a provider-reported fidelity measure for the Transdiagnostic Sleep and Circadian Intervention (TranS-C). Adults with severe mental illness (SMI; N = 101) seeking treatment in a community mental health setting received eight sessions of TranS-C. Therapists completed the Provider-Rated TranS-C Checklist at the end of each treatment session (N = 808) to indicate which modules they delivered during that session. To assess convergent validity, independent raters scored modules delivered from audio recordings of a subset of sessions (n = 257) for the modules delivered using the Independent-Rater TranS-C Checklist. Using exploratory factor analysis, a unidimensional scale composed of TranS-C’s modules was identified. Provider-Rated TranS-C Checklist scores were positively associated with the Independent-Rater TranS-C Checklist scores demonstrating convergent validity. Results indicate that the Provider-Rated TranS-C Checklist yields reliable and valid scores of providers’ delivery of TranS-C.