A pragmatic approach to measuring adherence in treatment delivery in psychotherapy

ABSTRACT

Measuring therapists’ adherence to treatment manuals is recommended for evaluating treatment integrity, yet ways to do this are poorly defined, time consuming, and costly. The aims of the study were to develop a Therapy Component Checklist (TCC) to measure adherence to manualised CBT; to test its application in research and clinical practice; to determine its validity; and consider its cost benefits. We conducted a randomised trial in 230 people with cancer evaluating effectiveness of CBT for depression. In this, therapists delivered manualised treatment. Experts agreed on key components of therapy and therapists were asked to record these after therapy sessions by ticking a TCC. Inter-rater reliability was tested using an independent rater. Therapists delivered 543 CBT sessions. TCCs were completed in 293, of which 39 were assessed by the independent rater. Self-reported TCC data suggested close adherence to the manual. Prevalence-adjusted and bias-adjusted kappa scores suggested substantial agreement, (>0.60) in 38 out of 46 items. Self-rating of adherence saved around £96 per rating. In conclusion the TCC provides a quick and cost effective way of evaluating the components of therapy delivered. This approach could be applied to other psychological treatments and may help with linking therapeutic interventions with outcome.     

Investigating the Reliability of the Sentence Verification Technique

Reading comprehension plays an important role in achievement for all academic domains. The purpose of this study is to describe the sentence verification technique (SVT) (Royer, Hastings, &; Hook, 1979 Royer, J. M., Hastings, C. N., &; Hook, C. (1979). A sentence verification technique for measuring reading comprehension. Journal of Reading Behavior, 11(4), 355–363. doi:10.1080/10862967909547341[Crossref] , [Google Scholar]) as an alternative method of assessing reading comprehension, which can be used with a variety of texts and across diverse populations and educational contexts. Additionally, this study adds a unique contribution to the extant literature on the SVT through an investigation of the precision of the instrument across proficiency levels. Data were gathered from a sample of 464 fourth-grade students from the Northeast region of the United States. Reliability was estimated using one, two, three, and four passage test forms. Two or three passages provided sufficient reliability. The conditional reliability analyses revealed that the SVT test scores were reliable for readers with average to below average proficiency, but did not provide reliable information for students who were very poor or strong readers.     

Formal assessment of reliability specifications in embedded cyber-physical systems

Reliability has become an integral component of the design intent of embedded cyber-physical systems. Safety-critical embedded systems are designed with specific reliability targets, and design practices include the appropriate allocation of both spatial and temporal redundancies in the implementation to meet such requirements. With increasing complexity of such systems and considering the large number of components in such systems, redundancy allocation requires a formal scientific basis. In this work, we profess the analysis of the redundancy requirement upfront with the objective of making it an integral part of the specification. The underlying problem is one of synthesizing a formal specification with built-in redundancy artifacts, from the formal properties of the error-free system, the error probabilities of the control components, and the reliability target. We believe that upfront formal analysis of redundancy requirements is important in budgeting the resource requirements from a cost versus reliability perspective. Several case-studies from the automotive domain highlight the efficacy of our proposal.     

Psychometric properties of the Turkish version of the Flourishing Scale and the Scale of Positive and Negative Experience

ABSTRACT

The Flourishing Scale (FS) and the Scale of Positive and Negative Experience (SPANE) are scales that are newly introduced to evaluate well–being. The present study aims to assess the psychometric distinctive features of two scales by utilising two different Turkish samples: university students (n?=?320), and employees (n?=?180). Confirmatory factor analysis results demonstrate that a one-factor model of the FS and a two–factor model of the SPANE yield significant findings in those samples. Scales’ factorial structures are valid for gender groups also they have good internal consistency. Concurrent validity, and discriminant validity with the use of several conceptually related and unrelated measures in two samples reveal satisfactory validity results for both the FS and the SPANE. The results of the present study show the utility of these scales in Turkish culture.     

Reliability in Dream Research: A Methodological Note

The coefficients of internal consistency and retest reliability had been rarely investigated within the methodology of dream content analysis. Analyzing a dream series of elderly, healthy persons obtained from weekly telephone interviews, the internal consistency of a series of 20 dreams and retests after 4 or 22 weeks, respectively, had been computed. The findings indicate that dream recall and dream length are quite stable, but dream characteristics such as bizarreness and emotional tone underlie large intraindividual fluctuations. In order to obtain reliable measures for these variables which will be important for correlational studies, including waking-life trait measures, one has to obtain as many dreams as possible (about 20) in a very short time period. Further research is needed to extend the present findings to diary dreams and laboratory dreams.     

Replies to comments on "Which method delivers greater signal-to-noise ratio: Structural equation modelling or regression analysis with weighted composites?" by Yuan and Fang (2023)

Observational data typically contain measurement errors. Covariance-based structural equation modelling (CB-SEM) is capable of modelling measurement errors and yields consistent parameter estimates. In contrast, methods of regression analysis using weighted composites as well as a partial least squares approach to SEM facilitate the prediction and diagnosis of individuals/participants. But regression analysis with weighted composites has been known to yield attenuated regression coefficients when predictors contain errors. Contrary to the common belief that CB-SEM is the preferred method for the analysis of observational data, this article shows that regression analysis via weighted composites yields parameter estimates with much smaller standard errors, and thus corresponds to greater values of the signal-to-noise ratio (SNR). In particular, the SNR for the regression coefficient via the least squares (LS) method with equally weighted composites is mathematically greater than that by CB-SEM if the items for each factor are parallel, even when the SEM model is correctly specified and estimated by an efficient method. Analytical, numerical and empirical results also show that LS regression using weighted composites performs as well as or better than the normal maximum likelihood method for CB-SEM under many conditions even when the population distribution is multivariate normal. Results also show that the LS regression coefficients become more efficient when considering the sampling errors in the weights of composites than those that are conditional on weights.     

Methods,minds, memory,and kinds

ABSTRACT

The acquisition of a skill, or knowledge-how, on the one hand, and the acquisition of a piece of propositional knowledge on the other, appear to be different sorts of epistemic achievements. Does this difference lie in the nature of the knowledge involved, marking a joint between knowledge-how and propositional knowledge? Intellectualists say no: All knowledge is propositional knowledge. Anti-intellectualists say yes: Knowledge-how and propositional knowledge are different in kind. What resources or methods may we legitimately and fruitfully employ to adjudicate this debate? What is (or are) the right way(s) to show the nature of the knowledge knowers know? Here too there is disagreement. I defend the legitimacy of the anti-intellectualist appeal to cognitive neuroscientific findings against a recent claim that anti-intellectualists conflate the scientific categories of procedural and declarative knowledge with the mental kinds of skill (knowledge-how) and propositional knowledge, respectively. I identify two kinds of arguments for this claim and argue that neither succeeds.