Vagus nerve stimulation for treatment-resistant mood disorders: a long-term naturalistic study
© Albert et al.; licensee BioMed Central. 2015
Received: 8 April 2014
Accepted: 9 March 2015
Published: 31 March 2015
Limited therapeutic options are available for patients with treatment-refractory major depression who do not respond to routinely available therapies. Vagus nerve stimulation showed adjunctive antidepressant effect in chronic treatment resistant depression, even though available studies rarely exceed 2-year follow up.
We report a naturalistic 5-year follow up of five patients who received VNS implant for resistant depression (3 patients with major depressive disorder and 2 with bipolar disorder).
Response was defined as a reduction of the 17-item HDRS total score ≥50% with respect to baseline, remission as a score ≤7.
Response and remission rates were both 40% (2/5) after 1 year, and 60% (3/5) at 5 years. Two patients withdrew from the study because of side effects or inefficacy of stimulation.
Our case series showed that long-term VNS may be effective in reducing severity of depression in a small but significant minority of patients, although two patients had stimulation terminated because of adverse effects and/or refusal to continue the study.
KeywordsTreatment resistant depression Vagus nerve stimulation Long-term follow-up Neuromodulation
Major Depressive Episode (MDE) is a clinical condition affecting about 350 million people worldwide, carries a high morbidity and mortality and imposes significant costs on patients, their families, caregivers, employers, and insurance payers .
Despite considerable efforts made over the past decades, there are a large proportion of patients who still do not respond to currently available treatments [2,3]. Up to 50% of subjects with a MDE who receive an antidepressant treatment do not respond satisfactorily to the first trial and another 50% of them do not fully respond to a second antidepressant medication [4,5]. Furthermore, patients often show relapses despite treatment with conventional medication .
There is not a general consensus on how many unsuccessful trials are required to meet criteria for treatment-resistant depression (TRD), and there are several ways of staging this condition [7-10]. Despite the lack of a unique definition, TRD can be defined as the absence of response to at least two antidepressant trials given in succession at adequate doses and duration in compliant subjects . Rates of TRD range from 2-3%  to 30%  and vary according to the threshold of unsuccessful trials. Treatment-resistant depression (TRD) remains however a significant clinical challenge, irrespective of the definition used.
Vagus Nerve Stimulation (VNS) is currently approved both in Europe and in the USA as an adjunctive long-term treatment of chronic (actual episode ≥2 years) or recurrent depression for patients aged 18 years or older who are experiencing a MDE (both unipolar and bipolar) and have not had a sufficient response to four or more adequate antidepressant treatments .
VNS therapy® (Cyberonics, Inc, Houston, TX, USA) consists in implanting a generator in the left chest and connecting it to the left vagus nerve with a bipolar lead . After generally 2 weeks from surgery, a wand connected to a hand-held computer activates the device telemetrically. The device provides intermittent stimulation to the left vagus nerve; the electrical signals are in turn processed in the nucleus tractus solitarius and relayed to various regions of the brain to provide relief of depressive symptoms through mechanisms not yet fully understood .
In recent years, several studies have been performed examining VNS efficacy in MDEs, and reviews are already available on several clinical and experimental issues concerning VNS in TRD [15,16]. VNS appears to be effective acutely in a small but significant proportion of patients (15.2-57%); moreover, response rates increase from 3 months to 1 or 2 years [5,17-34].
The time course for the clinical response to VNS suggests that when clinical improvement occurs, it requires weeks or months to become evident. As such, VNS may prove more useful as a long-term maintenance therapy for chronic depression rather than for acute stabilization of an episode.
The effectiveness of long-term VNS in clinical practice remains, however, to be determined; the question of whether VNS is helpful to non-research, treatment-seeking patients is still open. Moreover, there is a lack of knowledge regarding long-term follow-up of patients who underwent VNS therapy: available data do not exceed 2 years, except a case report of a 38-year old woman with a six-year follow-up  and a case series recently published with 7 patients who were re-evaluated 48–60 months after surgery .
The aim of the present paper is to present data of a naturalistic 5-year follow-up of patients who received VNS as an adjunctive treatment for resistant depression.
Participants were recruited consecutively from January 2007 to May 2008 among subjects referred to the Mood and Anxiety Disorders Unit of the Department of Neuroscience, University of Turin (Italy); this is a tertiary referral centre located within the University Hospital and specialized in the treatment of patients with Mood Disorders.
The aims of the study as well as study procedures were thoroughly explained to potential participants who gave written consent before participation. The study design was reviewed and approved by the local ethics committee (Comitato Etico Interaziendale A.O.U. Città della Salute e della Scienza di Torino - A.O. Ordine Mauriziano - A.S.L. TO1).
To be enrolled in the study, patients fulfilled the following inclusion criteria: a) a current Major Depressive Episode, chronic (actual episode ≥2 years) or recurrent (history of at least 4 lifetime MDEs), according to the Structured Clinical Interview for Axis I Disorders (SCID-I/P – DSM IV TR) ; b) 18 years of age or older; c) during the current MDE, failure to respond to at least two adequate trials of antidepressant treatments; d) a minimum total score of 20 on the HDRS; and e) stable psychopharmacological medication for at least 4 weeks before baseline. We defined non-responder a patient who failed to show a reduction of the 17-item HDRS total score ≥50% with respect to the beginning of the pharmacological trial. We considered an adequate antidepressant trial, according to Sackeim , a full-dosage antidepressant given for at least 4 weeks. We also required that patients took two antidepressants of different pharmacological classes.
Exclusion criteria were: 1) past or current presence of psychotic features; 2) suicide attempt requiring medical treatment within the previous twelve months; 3) history of schizophrenia, schizoaffective disorder or rapid cycling bipolar disorder; 4) severe Axis II disorders (such as borderline or antisocial); 5) alcohol or substance dependence within the previous twelve months or abuse of a substance other than nicotine during the previous six months; 6) diagnosis or signs of delirium, dementia, or amnestic and other cognitive disorders; 7) previous head injuries, cardiac or neurological diseases, and surgical implantation-related risks.
All patients were on antidepressants (with or without mood-stabilizers depending on the diagnosis of MDD or BD), which were not withdrawn after surgery. Throughout the follow-up period, the dosage of antidepressant medications was adjusted according to clinical condition, while no change of type of antidepressant treatment or mood-stabilizer was performed during the first year after surgery.
Unmasked clinical outcome measures included the 17-item Hamilton Rating Scale for Depression (HDRS-17), the Montgomery-Asberg Depression Rating Scale (MADRS), and the Clinical Global Impressions-Severity of Illness (CGI-S) scale. These measurements were obtained at pre-treatment (baseline), at post-surgery (2 weeks after implantation), every three months for the first two years and then annually. During the first 12 months, a self-report measure of quality of life was also administered: the Medical Outcomes Study 36-Item Short-Form Health Survey (SF-36). The SF-36 contains 8 scales for assessing physical functioning, role limitations due to physical health, bodily pain, general health, vitality, social functioning, role limitations due to emotional problems, and mental health. Summary scales include a physical composite and a mental composite that are expressed as t scores (mean = 50, SD = 10).
Response was defined as a reduction of the 17-item HDRS total score ≥50% with respect to baseline, remission as a score ≤7.
In addition, tolerability and side effects were recorded. Adverse events were defined as events occurring on or after the date of implantation, events not reported as signs or symptoms at baseline and/or worsening in severity or frequency. Presence of mania was monitored using the Young Mania Rating Scale (YMRS): a score of 12 was used as the threshold for the diagnosis of mania.
The device component consists of a pulse generator with a lithium battery and a lead wire with two helical electrodes and a tethering anchor. Under operating microscope the helical electrodes and the anchor tether coil were wrapped around the left cervical vagus nerve and a strain relief bend of lead to provide slack during movement of the neck was created. The lead connector pin was attached to a generator situated subcutaneously in the left thoracic region. The electrical connections of the whole device were then checked with a system diagnostic performed with the wand and programming computer. During the electro-diagnostic test the pulse generator delivered 1 mA output current at 20 Hz with a pulse width of 500 μsec and measured the impedance. At this moment the heart rate was monitored to highlight a possible bradycardia. The pulse generator was then inserted into the subcutaneous pocket and the two wounds closed in anatomical layers using absorbable suture and paying attention to a good cosmetic result. The generator was switched off for two weeks postoperatively to allow postsurgical edema to resolve.
Subjects’ characteristics were summarized as mean and SD for continuous variables and frequency and percentage for categorical variables. A repeated measures ANOVA was performed on total scores of the HDRS, MADRS and CGI-S scales before (baseline, surgery) and after 3, 6, 9 and 12 months from VNS implant.
One hundred-fifty-nine subjects were interviewed through telephone in order to assess eligibility criteria for inclusion into the study; of them, 39 were asked to present for a face-to-face clinical interview. Thirty-three patients were excluded because of not having a current Major Depressive Episode (N = 7), not having a chronic (actual episode ≥2 years) or recurrent (history of at least 4 lifetime MDEs) disorder (N = 20), having a medical illness that contraindicated surgery (N = 4), or having a current Substance Use Disorder (N = 2). One additional patient, fulfilling eligibility criteria, first accepted to undergo surgical procedure, and then refused after the screening visit.
Socio-demographic and clinical characteristics of patients included
Sample (N = 5)
Actual age (years) (Mean ± SD)
56.6 ± 7.3
Gender: males, N (%)
Educational level (years) (Mean ± SD)
13.4 ± 5.3
Marital status: married, N (%)
Currently working, N (%)
Age at onset (years) (Mean ± SD)
30.6 ± 4.2
Duration of illness (years) (Mean ± SD)
26.8 ± 5.5
Duration of current MDE (months), (Mean ± SD)
18.4 ± 14.0
Familial history for psychiatric disorders, N (%)
Diagnosis, N (%)
Major depressive disorder
Number of medications at the time of the implant, (Mean ± SD)
3.0 ± 1.4
Number of antidepressant treatments received before the implant, (Mean ± SD)
8.4 ± 2.7
Number of antidepressant classes received before the implant, (Mean ± SD)
3.6 ± 0.9
Number of MDEs before the implant, (Mean ± SD)
9.4 ± 4.9
Number of hospitalizations before the implant, (Mean ± SD)
7.0 ± 2.4
Number of patients with a history of suicidal attempts before implant, N (%)
Prior ECT, N (%)
Outcome measures for Intent-to-Treat sample in the first 12 months (N = 5)
Repeated measures ANOVA
SF-36 physical summary
SF-36 mental summary
Side effects of Vagus Nerve Stimulation
Sample (N = 5)
Hoarseness, N (%)
Neck pain, N (%)
Sore throat, N (%)
Headache, N (%)
Paresthesia, N (%)
Anxiety, N (%)
Dysphagia- Dyspepsia, N (%)
Others (cough, dyspnoea, chest tightness, stridor, laryngism, reflux, nausea, sweating, earache, snoring), N (%)
Our study shows that VNS effectiveness in a clinical practice devoted to the care of individuals with TRD was comparable to the efficacy outcomes reported from prior controlled and uncontrolled clinical trials: the 1-year response and remission rates (based upon the HDRS-17) were 40% and 40% respectively in our case series. Our response rate at 1 year is comparable to the 31.8% response rate (23.2 to 41.8%) after a mean of 20 weeks found in a recent meta-analytical study .
To our knowledge, the present study is one of the few prospective ones with a long (5-year for three patients) follow-up of patients who underwent VNS implant for TRD. Findings from our case series indicate a progressive symptom reduction over the first year, although statistical analyses were not significant; moreover, the analysis of individual rating scales scores over time shows that VNS, when effective (not in all patients), is associated with a reduction of the number of depressive recurrences. As already shown by previous reports [21,22,36,39], the present 5-year follow-up study suggests that VNS may prove more useful as a long-term maintenance therapy for chronic depression rather than for acute stabilization of an episode. Preliminary evidence suggests that adjunctive VNS has two principal effects: first, it reduces depressive symptoms in a small but significant proportion of patients who otherwise would be unresponsive to standard treatments, and, second, it reduces exacerbations over the long-term for the vast majority of patients who responded to VNS addition (sustained response) . This long-term effect, however, appears from naturalistic studies or longitudinal pivotal trials without a control or comparison group [22,26,28,36]; long-term observations, being very few in the literature, also small case series like the present one, may be then of interest to clinicians.
Caution has to be used in interpreting our results, as we observed no statistically significant changes in HDRS or MADRS scores (nor in SF-36 scores) in the first 12 months of treatment (see Table 2); moreover, two patients dropped out by 12–18 months. Conclusions about long-term effectiveness (and/or tolerability), being based on the three subjects who remained on treatment, have to be mitigated on the basis of these limitations.
VNS is not a procedure devoid of side effects; one patient from our case series was unable to tolerate hoarseness, sore throat and neck pain, and the VNS generator had to be switched off. Moreover, the majority of patients reported stimulation-related adverse effects, although to a lesser degree. A careful screening of subjects with TRD is then indicated, with particular attention not only to the history of resistant depression (number of previous failed antidepressant trials, compliance, etc.) but also to the history of side effects of previous treatments and to the ability of the patient to tolerate such side effects. Unfortunately, we did not change stimulation settings (e.g. reduced pulse-width) during the treatment phase in order to counterbalance reported adverse effects; we then acknowledge this as a limitation to be kept in mind when interpreting our results concerning side effects of VNS.
One patient refused to attend follow-up assessments after 12 months of treatment, being depressive symptoms unchanged. We acknowledge that a 12-month VNS treatment may be too short to conclude that this procedure is ineffective. Despite several efforts by the psychiatrist in charge of that patient to maintain him in the study, he withdrew the consent and dropped out. Although it is unusual for someone to consent to having a neurosurgical procedure and then refuse to be followed up, he did so and told the psychiatrist that he was willing to try transcranial magnetic stimulation at another University hospital. This case underlines, to our opinion, that a careful screening of subjects with treatment-resistant mood disorders is compulsory before implementing neurosurgical procedures, with a particular attention to motivations to attend complex and expensive procedures such as VNS implantation.
Our study, even though limited by its small sample size and by its observational nature, shows that VNS may be effective in clinical practice in a small but significant minority of patients. The investigation of potential predictors of VNS response is strongly needed and future studies in larger samples should focus on this matter. Further long-term follow-up studies are also strongly needed in order to confirm the putative stabilizing property of VNS.
- American Psychiatric Association. Diagnostic and statistical manual of mental disorders (4th ed., Text Revision). Washington DC: American Psychiatric Association; 2000.Google Scholar
- Sackeim HA. The definition and meaning of treatment-resistant depression. J Clin Psychiatry. 2001;62 suppl 16:10–7.PubMedGoogle Scholar
- Trivedi MH, Rush AJ, Wisniewski SR, Nierenberg AA, Warden D, Ritz L, et al. Evaluation of outcomes with citalopram for depression using measurement-based care in STAR-D: implications for clinical practice. Am J Psychiatry. 2006;163:28–40.View ArticlePubMedGoogle Scholar
- Nemeroff CB. Prevalence and management of treatment-resistant depression. J Clin Psychiatry. 2007;68(8):17–25.PubMedGoogle Scholar
- Rush AJ, Marangell LB, Sackeim HA, George MS, Brannan SK, Davis SM, et al. Vagus nerve stimulation for treatment-resistant depression: a randomized, controlled acute phase trial. Biol Psychiatry. 2005;58:347–54.View ArticlePubMedGoogle Scholar
- Rush AJ, Trivedi MH, Wisniewski SR, Nierenberg AA, Stewart JW, Warden D, et al. Acute and longer-term outcomes in depressed outpatients requiring one or several treatment steps: a STAR*D report. Am J Psychiatry. 2006;163:1905–17.View ArticlePubMedGoogle Scholar
- Berlim MT, Turecki G. Definition, assessment, and staging of treatment-resistant refractory major depression: a review of current concepts and methods. Can J Psychiatry. 2007;52(1):46–54.PubMedGoogle Scholar
- Fekadu A, Wooderson SC, Markopoulou K, Cleare AJ. The Maudsley Staging Method for treatment-resistant depression: prediction of longer-term outcome and persistence of symptoms. J Clin Psychiatry. 2009;70(7):952–7.View ArticlePubMedGoogle Scholar
- Souery D, Papakostas GI, Trivedi MH. Treatment-resistant depression. J Clin Psychiatry. 2006;67 suppl 6:16–22.PubMedGoogle Scholar
- Wijeratne C, Sachdev P. Treatment-resistant depression: critique of current approaches. Aust N Z J Psychiatry. 2008;42(9):751–62.View ArticlePubMedGoogle Scholar
- Kennedy SH, Giacobbe P, Rizvi SJ, Placenza FM, Nishikawa Y, Mayberg HS, et al. Deep brain stimulation for treatment-resistant depression: follow-up after 3 to 6 years. Am J Psychiatry. 2011;168:502–10.View ArticlePubMedGoogle Scholar
- Center for Devices and Radiological Health, Food and Drug Administration: 2005, Available at http://www.accessdata.fda.gov/cdrh_docs/pdf/p970003s050a.pdf.
- Schlaepfer TE, George MS, Mayberg H. WFSBP guidelines on brain stimulation treatments in psychiatry. World J Biol Psychiatry. 2010;11:2–18.View ArticlePubMedGoogle Scholar
- Schachter SC, Schmidt D. Vagus Nerve Stimulation. London: Martin Dunitz; 2001.Google Scholar
- Daban C, Matinez-Aran A, Cruz N, Vieta E. Safety and efficacy of vagus nerve stimulation in treatment-resistant depression. A systematic review. J Affect Disord. 2008;110:1–15.View ArticlePubMedGoogle Scholar
- Rush AJ, Siefert SE. Clinical issues in considering vagus nerve stimulation for treatment-resistant depression. Exp Neurol. 2009;219:36–43.View ArticlePubMedGoogle Scholar
- Armitage R, Husain M, Hoffmann R, Rush AJ. The effects of vagus nerve stimulation on sleep EEG in depression: a preliminary report. J Psychosom Res. 2003;54(5):475–82.View ArticlePubMedGoogle Scholar
- Bajbouj M, Merkl A, Schlaepfer TE, Frick C, Zobel A, Maier W, et al. Two-year outcome of vagus nerve stimulation in treatment-resistant depression. J Clin Psychopharmacol. 2010;30:273–81.View ArticlePubMedGoogle Scholar
- Conway CR, Chibnall JT, Gangwani S, Mintun MA, Price JL, Hershey T, et al. Pretreatment cerebral metabolic activity correlates with antidepressant efficacy of vagus nerve stimulation in treatment resistant major depression: a potential marker for response? J Affect Disord. 2012;139(3):283–90.View ArticlePubMedPubMed CentralGoogle Scholar
- Corcoran CD, Thomas P, Phillips J, O’Keane V. Vagus nerve stimulation in chronic treatment-resistant depression: preliminary findings of an open-label study. Br J Psychiatry. 2006;189:282–3.View ArticlePubMedGoogle Scholar
- Cristancho P, Cristancho MA, Baltuch GH, Thase ME, O’Reardon JP. Effectiveness and safety of vagus nerve stimulation for severe treatment-resistant major depression in clinical practice after FDA approval: outcome at 1 year. J Clin Psychiatry. 2011;72(10):1376–82.View ArticlePubMedGoogle Scholar
- Dell’Osso B, Oldani L, Palazzo MC, Balossi I, Ciabatti MT, Altamura AC. Vagus nerve stimulation in treatment-resistant depression acute and follow-up results of an Italian case series. J ECT. 2013;29:41–4.PubMedGoogle Scholar
- George MS, Rush AJ, Marangell LB, Sackeim HA, Brannan SK, Davis SM, et al. A one-year comparison of vagus nerve stimulation with treatment as usual for treatment-resistant depression. Biol Psychiatry. 2005;58:364–73.View ArticlePubMedGoogle Scholar
- Kosel M, Brockmann H, Frick C, Zobel A, Schlaepfer TE. Chronic vagus nerve stimulation for treatment-resistant depression increases regional cerebral blood flow in the dorsolateral prefrontal cortex. Psychiatr Res. 2011;191(3):153–9.View ArticleGoogle Scholar
- Marangell LB, Rush AJ, George MS, Sackeim HA, Johnson CR, Husain MM, et al. Vagus nerve stimulation (VNS) for major depressive episodes: one year outcomes. Biol Psychiatry. 2002;51:280–7.View ArticlePubMedGoogle Scholar
- Nahas Z, Marangell LB, Husain MM, Rush AJ, Sackeim HA, Lisanby SH, et al. Two-year outcome of vagus nerve stimulation (VNS) for treatment of major depressive episodes. J Clin Psychiatry. 2005;66:1097–104.View ArticlePubMedGoogle Scholar
- Neuhaus AH, Luborzewski A, Rentzsch J, Brakemeier EL, Opgen-Rhein C, Gallinat J, et al. P300 is enhanced in responders to vagus nerve stimulation for treatment of major depressive disorder. J Affect Disord. 2007;100:123–8.View ArticlePubMedGoogle Scholar
- Nierenberg AA, Alpert JE, Gardner-Schuster EE, Seay S, Mischoulon D. Vagus nerve stimulation: 2-year outcomes for bipolar versus unipolar treatment-resistant depression. Biol Psychiatry. 2008;64:455–60.View ArticlePubMedGoogle Scholar
- Rush AJ, George MS, Sackeim HA, Marangell LB, Husain MM, Giller C, et al. Vagus nerve stimulation (VNS) for treatment-resistant depression: a multicenter study. Biol Psychiatry. 2000;47:276–86.View ArticlePubMedGoogle Scholar
- Rush AJ, Sackeim HA, Marangell LB, George MS, Brannan SK, Davis SM, et al. Effects of 12 months of vagus nerve stimulation in treatment-resistant depression: a naturalistic study. Biol Psychiatry. 2005;58:355–63.View ArticlePubMedGoogle Scholar
- Sackeim HA, Rush AJ, George MS, Marangell LB, Husain MM, Nahas Z, et al. Vagus nerve stimulation (VNS) for treatment-resistant depression: efficacy, side effects, and predictors of outcome. Neuropsychopharmacology. 2001;25:713–28.View ArticlePubMedGoogle Scholar
- Schlaepfer TE, Frick C, Zobel A, Maier W, Heuser I, Bajbouj M, et al. Vagus nerve stimulation for depression: efficacy and safety in a European study. Psychol Med. 2008;4:1–11.Google Scholar
- Aaronson ST, Carpenter LL, Conway CR, Reimherr FW, Lisanby SH, Schwartz TL, et al. Vagus nerve stimulation therapy randomized to different amounts of electrical charge for treatment-resistant depression: acute and chronic effects. Brain Stimul. 2013;6:631–40.View ArticlePubMedGoogle Scholar
- Christmas D, Steele JD, Tolomeo S, Sam Eljamel M, Matthews K. Vagus nerve stimulation for chronic major depressive disorder: 12-month outcomes in highly treatment-refractory patients. J Affect Disord. 2013;150:1221–5.View ArticlePubMedGoogle Scholar
- Yuan W, Williams BN. Long-term vagus nerve stimulation for severe refractory depression: a case study with a six-year follow-up. J Neuropsychiatry Clin Neurosci. 2012;24(4):E50–1.View ArticlePubMedGoogle Scholar
- Tisi G, Franzini A, Messina G, Savino M, Gambini O. Vagus nerve stimulation therapy in treatment-resistant depression: a series report. Psychiatry Clin Neurosci. 2014;68:606–11.View ArticlePubMedGoogle Scholar
- First MB, Spitzer RL, Gibbon M, Williams JBW. Structured Clinical Interview for DSM-IV Axis I Disorders – Patient edition (SCID-I/P, Version 2.0). New York: New York Psychiatric Institute, Biometrics Research Department; 1996.Google Scholar
- Martin JLR, Martin-Sanchez E. Systematic review and meta-analysis of vagus nerve stimulation in the treatment of depression: variable results based on study designs. Eur Psychiatry. 2012;27:147–55.View ArticlePubMedGoogle Scholar
- Marangell LB, Suppes T, Zboyan HA, Prashad SJ, Fischer G, Snow D, et al. A 1-year pilot study of vagus nerve stimulation in treatment-resistant rapid-cycling bipolar disorder. J Clin Psychiatry. 2008;69:183–9.View ArticlePubMedGoogle Scholar
- Lanotte MM, Albert U, Ducati A, Maina G. Vagus nerve stimulation in resistant major depression. In: Lavano A, Landi A, Lanotte MM, editors. Handbook of stereotactic and functional neurosurgery. Torino: Edizioni Minerva Medica; 2011. p. 173–82.Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.