- Matters Arising
- Open access
- Published:
Inappropriate study inclusion in meta-analysis of sham-controlled rTMS for treatment-resistant depression
BMC Psychiatry volume 24, Article number: 247 (2024)
Abstract
Dr. Vida and colleagues have published an important meta-analysis on a critical topic in psychiatry: the efficacy of double-blind, sham-controlled rTMS in treatment-resistant depression (TRD) [1]. The primary reported finding was a significant effect of rTMS on remission and response (RR 2.25 and 2.78 respectively) compared to sham rTMS. A close evaluation of the studies included in this meta-analysis raises concerns about the accuracy of these findings.
Dr. Vida and colleagues have published an important meta-analysis on a critical topic in psychiatry: the efficacy of double-blind, sham-controlled rTMS in treatment-resistant depression (TRD) [1]. The primary reported finding was a significant effect of rTMS on remission and response (RR 2.25 and 2.78 respectively) compared to sham rTMS. A close evaluation of the studies included in this meta-analysis raises concerns about the accuracy of these findings.
In both the abstract and methods sections, the authors specify that only randomized, sham-controlled trials of patients with at least two antidepressant treatment failures were included. The abstract specifies that included studies were double-blind, but this is not explicitly listed as inclusion criteria in the methods section.
Of the 19 studies included in the random-effects meta-analysis, the study by Filipčić et al. was weighed as 43.48% for response and 33.56% for remission, by far the largest and most impactful study in each analysis [2]. This study reported significant positive findings for rTMS for response (RR 2.35) and remission (RR 4.59). However, it did not meet the stated inclusion criteria and should not have been included in the meta-analysis.
This study was a single-blind comparison between two active FDA-approved rTMS modalities with a control group that received standard pharmacotherapy without sham TMS. To quote directly from the study: “228 MDD patients were randomized to 20 sessions of H1-coil or 8-coil as an adjunct to standard-of-care pharmacotherapy, or standard-of-care pharmacotherapy alone” and “we did not use a sham-control TMS coil.” Aside from the lack of double-blinding and sham-control, subjects in the rTMS arms were monitored daily while the pharmacotherapy arm only received an evaluation at baseline and at 4-weeks.
There is evidence that TMS can induce a large placebo response that can only be controlled for by a high-quality sham and appropriate blinding [3, 4]. The inclusion of this heavily-weighted study risks inflating the overall estimate of efficacy for rTMS in TRD, given that its highly positive findings may have been caused by the single-blind design and absence of a sham-control (much less other fundamental differences, like the frequency of visits).
Given the importance of this subject, this meta-analysis would benefit from a re-analysis that excluded the Filipčić et al. study to reflect the outcomes only of double-blind, sham-controlled trials, in accordance with the meta-analysis’s stated inclusion criteria. At a minimum, this study should be removed from the meta-analysis so that researchers and clinicians have an accurate understanding of the number of patients included in the highest-quality studies of rTMS in TRD—those that are truly double-blinded and sham-controlled. Readers should be aware that most rTMS trials for TRD have been quite small–only two had more than 45 subjects in this meta-analysis, excluding Filipčić–and many have had unclear (rather than low) risk of bias [5].
Data availability
Not relevant.
References
Vida RG, Sághy E, Bella R, Kovács S, Erdősi D, Józwiak-Hagymásy J, et al. Efficacy of repetitive transcranial magnetic stimulation (rTMS) adjunctive therapy for major depressive disorder (MDD) after two antidepressant treatment failures: meta-analysis of randomized sham-controlled trials. BMC Psychiatry. 2023;23(1):545.
Filipčić I, Šimunović Filipčić I, Milovac Ž, Sučić S, Gajšak T, Ivezić E, et al. Efficacy of repetitive transcranial magnetic stimulation using a figure-8-coil or an H1-Coil in treatment of major depressive disorder; a randomized clinical trial. J Psychiatr Res. 2019;114:113–9.
Burke MJ, Kaptchuk TJ, Pascual-Leone A. Challenges of Differential Placebo effects in Contemporary Medicine: the Example of Brain Stimulation. Ann Neurol. 2019;85(1):12–20.
Duecker F, Sack AT. Rethinking the role of sham TMS. Front Psychol. 2015;6.210.
Razza LB, Moffa AH, Moreno ML, et al. A systematic review and meta-analysis on placebo response to repetitive transcranial magnetic stimulation for depression trials. Prog Neuropsychopharmacol Biol Psychiatry. 2018;81:105–13.
Acknowledgements
Not relevant.
Funding
Not relevant.
Author information
Authors and Affiliations
Contributions
K.K. conceived of and wrote the full manuscript.
Ethics declarations
Ethics approval and consent to participate
not relevant.
Consent for publication
not relevant.
Competing interests
The authors declare no competing interests.
Authors’ information
Not relevant.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Kennedy, K.P. Inappropriate study inclusion in meta-analysis of sham-controlled rTMS for treatment-resistant depression. BMC Psychiatry 24, 247 (2024). https://doi.org/10.1186/s12888-024-05703-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12888-024-05703-5