To cite: Naudet F, Gillibert A, Mintzes B, et al. A mirror-image trial or smoke and mirrors? phase 3b study on digital aripiprazole. J Clin Psychiatry. 2022;83(5):22lr14503.
aUniv Rennes, CHU Rennes, Inserm, Centre d’Investigation Clinique de Rennes (CIC1414), Service de Pharmacologie Clinique, Institut de Recherche en Santé, Environnement et Travail (Irset), UMR S 1085, EHESP, Rennes, France bDepartment of Biostatistics, CHU Rouen, Rouen, France cFaculty of Medicine and Health, School of Pharmacy and Charles Perkins Centre, The University of Sydney, Sydney, New South Wales, Australia dSchool of Population and Public Health, University of British Columbia, Vancouver, British Columbia, Canada eRetired senior consultant, Amiens, France fCounseling Psychology Department, Applied Ethics Center, University of Massachusetts-Boston, Boston, Massachusetts
*Corresponding author: Florian Naudet, MD, PhD, Clinical Investigation Center (INSERM 1414), University Hospital, 2 rue Henri Le Guilloux, 35000 Rennes, France ([email protected]).
To the Editor: In November 2017, the US Food and Drug Administration approved a version of a second-generation antipsychotic, aripiprazole, embedded with a sensor (AS; Abilify MyCite) despite a clear lack of rigorous evidence of benefit,1 with no controlled trial. Only 3 non-comparative uncontrolled cohorts were found. None provided data on any clinical efficacy outcome.
The authors of a recent phase 3b study published in this journal2 claim to have addressed this gap for adults with schizophrenia. However, the flaws in design and reporting of this study provide a false impression of the efficacy of AS, compounded by the uncritical comment published concurrently.3 We offer the following methodological and ethical critique.
First, this uncontrolled cohort compares “retrospective” and “prospective” follow-up of the same patients, with no randomization, which is very low in the hierarchy of evidence, especially when a randomized controlled trial comparing AS versus aripiprazole is feasible and desirable.
Second, results are reported for only a subset of patients. The analysis population is defined as “participants who completed the month 3 visit or had ≥ 80% of their study medication ingestions recorded by the AS system during prospective months 1–3.”2(p e3) This is not a modified intention to treat (mITT), as stated, but rather a per protocol analysis including 113 of 277 enrolled patients (41%). The others were withdrawn, were lost to follow-up, or failed to take medication. Attempting to draw conclusions about medication adherence when fewer than half of the participants remained in the study flies in the face of common sense. Additionally, 50 patients were excluded from the analysis based on results of an interim analysis. Both post hoc exclusions and interim analyses are best avoided, especially in a single-arm trial.
Third, the study compares past hospitalization rates when patients took standard oral therapy versus when they used digital aripiprazole. However, the main selection criterion (≥ 1 inpatient psychiatric hospitalization in the preceding 48 months) overlaps with the primary outcome definition (difference in proportions of participants with ≥ 1 inpatient psychiatric hospitalization between prospective and retrospective months 1–3). Regression toward the mean during follow-up is expected to artificially generate lower hospitalization rates. Therefore, the difference observed on the primary outcome reflects bias rather than a genuine efficacy of digital aripiprazole. This is confirmed by the high “efficacy” found in patients with poor adherence or lost to follow-up at 3 months, obtained by subtraction of the ITT and mITT samples. In this subsample of 164 patients, there were 3 (1.8%) hospitalizations in the 3-month prospective period vs 15 (9.1%) in the retrospective period.
Such major flaws in design, conduct, and analysis and the central involvement of the sponsor are features of trials driven by marketing interests.4 Small numbers of patients were recruited from 58 study sites over most American states. For such a common disease, this suggests a “seeding” trial5 done to familiarize doctors with use of a drug rather than a scientific study.
Digital drugs raise ethical issues,6 especially about coercion. Members from disadvantaged communities are more frequently subjected to involuntary and coercive psychiatric treatment. Balancing these potential harms deserves adequate evidence before recommendations of AS are made.
Dr Reuteman-Fowler was shown this letter and declined to reply.
Univ Rennes, CHU Rennes, Inserm, Centre d’Investigation Clinique de Rennes (CIC1414), Service de Pharmacologie Clinique, Institut de Recherche en Santé, Environnement et Travail (Irset), UMR S 1085, EHESP, Rennes, France
Corresponding author: Florian Naudet, MD, PhD, Clinical Investigation Center (INSERM 1414), University Hospital, 2 rue Henri Le Guilloux, 35000 Rennes, France ([email protected]).
Department of Biostatistics, CHU Rouen, Rouen, France
Faculty of Medicine and Health, School of Pharmacy and Charles Perkins Centre, The University of Sydney, Sydney, New South Wales, Australia
School of Population and Public Health, University of British Columbia, Vancouver, British Columbia, Canada
Retired senior consultant, Amiens, France
Counseling Psychology Department, Applied Ethics Center, University of Massachusetts-Boston, Boston, Massachusetts
References (6)
Cosgrove L, Cristea IA, Shaughnessy AF, et al. Digital aripiprazole or digital evergreening? a systematic review of the evidence and its dissemination in the scientific literature and in the media. BMJ Evid Based Med. 2019;24(6):231–238. PubMedCrossRef
Cohen EA, Skubiak T, Hadzi Boskovic D, et al. Phase 3b multicenter, prospective, open-label trial to evaluate the effects of a digital medicine system on inpatient psychiatric hospitalization rates for adults with schizophrenia. J Clin Psychiatry. 2022;83(3):21m14132. PubMedCrossRef
Freudenreich O. What is the role of digital medicine for adherence monitoring in patients with serious mental illness? J Clin Psychiatry. 2022;83(3):22com14443. PubMedCrossRef
Barbour V, Burch D, Godlee F, et al. Characterisation of trials where marketing purposes have been influential in study design: a descriptive study. Trials. 2016;17(1):31. PubMedCrossRef
Sox HC, Rennie D. Seeding trials: just say “no.” Ann Intern Med. 2008;149(4):279–280. PubMedCrossRef
Chevance A, Fortel A, Jouannin A, et al. Acceptability of and willingness to take digital pills by patients, the public, and health care professionals: qualitative content analysis of a large online survey. J Med Internet Res. 2022;24(2):e25597. PubMedCrossRef