Accounting for Patient Engagement in Randomized Controlled Trials Evaluating Digital Cognitive Behavioral Therapies
Source abstract
Abstract
Background: Cognitive behavioral therapy (CBT) can be a useful treatment option for various mental health disorders. Modern advances in information technology and mobile communication enable delivery of state-of-the-art CBT programs via smartphones, either as stand-alone or as an adjunct treatment augmenting traditional sessions with a therapist. Experimental CBTs require careful assessment in randomized clinical trials (RCTs). Methods: We investigate some statistical issues for an RCT comparing efficacy of an experimental CBT intervention for a mental health disorder against the control. Assuming a linear model for the clinical outcome and patient engagement as an influential covariate, we investigate two common statistical approaches to inference—analysis of covariance (ANCOVA) and a two-sample t-test. We also study sample size requirements for the described experimental setting. Results: Both ANCOVA and a two-sample t-test are appropriate for the inference on treatment difference at the average observed level of engagement. However, ANCOVA produces estimates with lower variance and may be more powerful. Furthermore, unlike the t-test, ANCOVA allows one to perform treatment comparison at the levels of engagement other than the average level observed in the study. Larger sample sizes may be required to ensure experiments are sufficiently powered if one is interested in comparing treatment effects for different levels of engagement. Conclusions: ANCOVA with proper adjustment for engagement should be used for the for the described experimental setting. Uncertainty on engagement patterns should be taken into account at the study design stage.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Mental Health Research Topics · Digital Mental Health Interventions · Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Novartis Pharmaceuticals Corporation, East Hanover, NJ 07936, USA
AstraZeneca, 43183 Mölndal, Sweden
References (19)
Show source-provided references
1. Sverdlov, O., and vam Dam, J. (2022). Sector perspective: Digital therapeutics in behavioral health. Digital Therapeutics: Scientific, Statistical, Clinical and Regulatory Development Aspects, CRC Press. [1st ed.].
2. Digital Therapeutics: An Integral Component of Digital Innovation in Drug Development10.1002/cpt.1036 ↗
3. Sverdlov, O., and van Dam, J. (2022). Designing and delivering a DTx clinical research program: No need to re-invent the wheel. Digital Therapeutics: Scientific, Statistical, Clinical and Regulatory Development Aspects, CRC Press. [1st ed.]. Chapter 4.
4. Digital therapeutics and clinical pharmacology10.12793/tcp.2019.27.1.6 ↗
5. Understanding and Promoting Effective Engagement With Digital Behavior Change Interventions10.1016/j.amepre.2016.06.015 ↗
6. A Smartphone-Based Intervention as an Adjunct to Standard-of-Care Treatment for Schizophrenia: Randomized Controlled Trial10.2196/29154 ↗
7. Patient expectations of assigned treatments impact strength of randomised control trials10.3389/fmed.2021.648403 ↗
8. A New Depression Scale Designed to be Sensitive to Change10.1192/bjp.134.4.382 ↗
9. Relationship Between Patient Engagement and Depressive Symptoms Among People Living with HIV in a Mobile Health Intervention: Secondary Analysis of a Randomized Controlled Trial10.2196/20847 ↗
10. Palmier-Claus, J.E., Ainsworth, J., Machin, M., Barrowclough, C., Dunn, G., Barkus, E., Rogers, A., Wykes, T., Kapur, S., and Buchan, I. (2012). The feasibility and validity of ambulatory self-report of psychotic symptoms using a smartphone software application. BMC Psychiatry, 12.10.1186/1471-244X-12-172 ↗
11. Development and Feasibility Testing of a Smartphone Intervention to Improve Adherence to Antipsychotic Medications10.3371/CSRP.KRRE.070816 ↗
12. Actissist: Proof-of-concept trial of a theory-driven digital intervention for psychosis10.1093/schbul/sby032 ↗
13. Myers, R.H. (1990). Classical and Modern Regression with Applications, Duxbury Press. [2nd ed.].
14. European Medicines Agency (EMA) (2022, May 09). Guideline on Adjustment for Baseline Covariates in Clinical Trials, Available online: https://www.fda.gov/media/148910/download.
15. U.S. Food & Drug Administration (2022, May 09). Adjusting for Covariates in Randomized Clinical Trials for Drugs and Biological Products, Available online: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/adjusting-covariates-randomized-clinical-trials-drugs-and-biological-products.
16. Fuller, W.A. (1987). Measurement Error Models, Wiley.10.1002/9780470316665 ↗
17. Carroll, R.J., Ruppert, D., Stefanski, L.A., and Crainiceanu, C.M. (2006). Measurement Error in Nonlinear Models. A Modern Perspective, Chapman and Hall/CRC. [2nd ed.].10.1201/9781420010138 ↗
18. Mediation analysis when a continuous mediator is measured with error and the outcome follows a generalized linear model10.1002/sim.6295 ↗
19. A Machine Learning Approach to Understanding Patterns of Engagement with Internet-Delivered Mental Health Interventions10.1001/jamanetworkopen.2020.10791 ↗