Skip to main content

Effects of ECT in treatment of depression: study protocol for a prospective neuroradiological study of acute and longitudinal effects on brain structure and function

Abstract

Background

Major depression can be a serious and debilitating condition. For some patients in a treatment resistant depressive episode, electroconvulsive treatment (ECT) is the only treatment that is effective. Although ECT has shown efficacy in randomized controlled trials, the treatment is still controversial and stigmatized. This can in part be attributed to our lack of knowledge of the mechanisms of action. Some reports also suggest potential harmful effects of ECT treatment and memory related side effects have been documented.

Methods/design

The present study will apply state of the art radiology through advanced magnetic resonance imaging (MRI) techniques to investigate structural and functional brain effects of ECT. As a multi-disciplinary collaboration, imaging findings will be correlated to psychiatric response parameters, neuropsychological functioning as well as neurochemical and genetic biomarkers that can elucidate the underlying mechanisms. The aim is to document both treatment effects and potential harmful effects of ECT.

Sample: n = 40 patients in a major depressive episode (bipolar and major depressive disorder). Two control groups with n = 15 in each group: age and gender matched healthy volunteers not receiving ECT and patients undergoing electrical cardioversion (ECV) for atrial fibrillation (AF). Observation time: six months.

Discussion

The study will contribute to our understanding of the pathophysiology of major depression as well as mechanisms of action for the most effective treatment for the disorder; ECT.

Peer Review reports

Background

Bipolar and major depressive disorder

Bipolar disorder and major depressive disorder (MDD) are mental disorders with a 12-month prevalence in the EU of about 1 and 7%, respectively [1]. They are associated with a reduced quality of life, an increased mortality risk, and are a major cause of inability to work [2,3].

The management of depression includes psychosocial treatment approaches, pharmacotherapy and, for the most severe and treatment resistant patients, electroconvulsive treatment (ECT).

Electroconvulsive treatment

The idea that convulsions could treat mental illness can be traced to the 16th century, when camphor oil was used to induce convulsions. Seizure-induction by application of electrical current to the human brain was introduced by the Italians Cerletti and Bini in 1938 [4]. Since its introduction, ECT has been applied to various psychiatric and some somatic conditions. Modern ECT has fewer indications and has been developed with the aim to reduce side effects [5].

For some patients in a treatment resistant depressive episode, ECT is the only treatment that is effective. ECT is generally considered to be safe and has shown efficacy in randomized controlled trials [6]. A recent randomized controlled trial found ECT to be more effective than pharmacological treatment for treatment-resistant bipolar depression [7]. However, the treatment is still controversial and stigmatized [8]. This can in part be attributed to our lack of knowledge, since the mechanisms of action is still largely unknown.

Some have compared ECT to lobotomy [9] or hypothesize that ECT affects the brain in a manner similar to severe stress or trauma [10]. Others regard it as a safe treatment that is underused [11], and a systematic review found no persistent cognitive deficits after ECT [12]. A recent randomized controlled trial of right unilateral ECT in treatment resistant depression found no changes in general neurocognitive function, but reduced autobiographical memory consistency after ECT [13]. This finding is in line with subjective patient reports [14], and further research is required.

The NICE guidelines states: “Consider ECT for acute treatment of severe depression that is life-threatening and when a rapid response is required, or when other treatments have failed” [15]. This is in line with the Norwegian national guidelines that recommend ECT in major depression when other treatments have been ineffective (Evidence level A, [16]), and there has been an increase in its use in recent years [17].

Increased knowledge gained through thorough scientific investigations can reduce stigmata and inform patients and health care providers to make appropriate use of ECT. Better understanding of ECT and its mechanisms of action may help patients to cope with side effects and contribute to the development of new treatment options.

Possible mechanisms of action of ECT

More than one hundred theories have been suggested for the effects of ECT [5]. Although changes to brain structure in major depression have been confirmed by several meta-analysis [18-20] and ECT-induced structural and functional changes have been characterized (for recent reviews see [21-23]) we still lack a unifying theory for its mechanisms of action. The project will focus on three suggested effects of ECT, each reflecting proposed pathophysiological changes and mechanisms of action, see below. As a multidisciplinary study, results from the neuroradiological measures can be correlated to biomarkers in blood and behavioral parameters; e.g. improvement/remission after ECT should be correlated to improved performance on neuropsychological testing. For dichotic listening, improved scores in the forced left condition would indicate better cognitive control.

Hippocampal volume

The human nervous system adapts to challenges. It can be changed by learning as well as by pathological conditions, such as psychiatric disorders. One structure that has been studied in large detail in this regard is the hippocampus; a structure that is important for learning and memory. Hippocampal volumes are reduced in major depressive disorder [19,24,25] and in a number of other psychiatric and somatic disorders (reviewed in [26]). The volume reduction of the hippocampus has been associated with duration of untreated depression [27]. On the other hand, increased hippocampal volumes can occur after extensive learning, e.g. studying to become one of London’s taxi drivers [28,29]. The increase in hippocampal volumes may be related to neurogenesis, which has been shown to occur in animal models [30,31]. In primates, the proliferation of granular cells in the dentate gyrus of the hippocampus was shown to be reduced by stress [30]. Seizures induce neurogenesis in rodents [32], and animal models have shown electroconvulsive seizures to have effects on neurotransmitters, gene expression, growth factors (such as Brain derived neurotrophic factor - BDNF, Vascular endothelial growth factor - VEGF, Fibroblast Growth Factor - FGF) and neuropeptides (such as neuropeptide Y - NPY, Thyrotropin-releasing hormone - TRH, VGF) and lead to synaptic remodeling and cellular proliferation (reviewed in [33]). Research from animal models also indicate that electroconvulsive shocks can reverse the effect of cortisol and even cause an increase of hippocampal volumes (reviewed in [5]).

Increased levels of BDNF has been reported following ECT [34], and BDNF has been suggested as a potential biomarker for depression [35]. Neurogenesis has been shown to occur in the dentate gyrus of the hippocampus in adult humans [36], and ECT-induced neuroplasticity is gaining more focus as a framework for understanding the effects of ECT [23]. A few studies of humans have reported increased hippocampal volumes and/or other structural changes following ECT [37-41]. Nordanskog et al. [39,41] performed manual segmentation without complete blinding of the MRI time point that was traced (before or after ECT), introducing a potential observer bias. Dukart et al. [38] used voxel-based morphometry, while Tendolkar et al. [40] and Abbot et al. [37] both used FreeSurfer [42] for volumetric segmentation and analysis. Compared with these studies we will recruit more patients, use state of the art automatic segmentation procedures, and radiology readers will be blinded to study group and the time point of MRI scans. In addition, by applying multimodal imaging, structural changes can be assessed with respect to changes in diffusion properties, susceptibility weighted imaging (SWI) and fluid attenuated inversion recovery (FLAIR) imaging. Our design will allow longitudinal tracking of brain changes; 1-2 hours after the first ECT, after treatment completion and at 6 months follow up.

Gamma-Aminobutyric acid (GABA) and connectivity

ECT has anticonvulsive effects and is sometimes used in the treatment of status epilepticus [43]. One hypothesis suggests that the magnitude of increase in seizure threshold, induced by ECT, is important for the antidepressant efficacy [44]. Drugs that enhance GABAergic neurotransmission are known for their anticonvulsant effect, and the role of amino acid neurotransmission systems, particularly reduced function of GABAergic neurotransmission has been increasingly appreciated in major depression (for reviews, see [45,46]). Tiagabine, a selective GABA reuptake inhibitor was shown to be effective in treatment of depression with anxiety [47]. A post mortem study of gene expression in elderly depressed patients found alterations in GABA and glutamate pathways markers indicating diminished activity in the anterior cingulate cortex (ACC) [48]. A recent meta-analysis suggested increased resting-state activity in the rostral ACC as a biomarker for treatment response in major depression, and a shift from GABA- to glutamate-mediated modulation was suggested [49].

Interestingly, one early study found increased concentrations of cortical GABA after ECT in depressed patients by use of proton magnetic resonance spectroscopy (1H-MRS) [50], however this finding has to our knowledge not been reproduced by other groups.

It has recently been suggested that “hyperconnectivity” in networks involved in mood regulation can be reduced after a course of ECT [51,52]. This finding may seem contrary to findings of increased fractional anisotropy (FA) in frontal limbic projections after a course of ECT [53,54]. FA is often regarded as a measure of white matter tract integrity and increased axonal integrity may seem contra-intuitive if one expects reduced connectivity after ECT. Possible explanations could be that the projections that are “enhanced” by ECT are GABAergic, or that improved integrity of certain projections may lead to more coordinated electrical activity in these projections, which overall is detected as “reduced connectivity”.

Our project will encompass measures of neurotransmitters (GABA and glutamate by 1H-MRS) and diffusion parameters (e.g. fractional anisotropy, mean diffusivity and separation of restricted and hindered water by Restriction Spectrum Imaging, RSI [55]), enabling longitudinal investigations of GABA- and glutamate levels as well as white matter properties in the same patients.

ECT and harmful effects

ECT has been a controversial treatment from its introduction. The most important side effects are related to memory impairments [6] and it is recommended that the patients’ cognitive functioning is monitored both during and after treatment [16]. A recent randomized controlled trial in treatment-resistant bipolar depression found reduced autobiographic memory consistency after ECT but no deterioration of general neurocognitive function [13]. Structural damage to the human brain has to our knowledge, never been documented to be caused by ECT. Case studies with rare complications, such as subdural hematoma, have been published [56], however a study using cerebral Computer Tomography in 40 patients before and after ECT detected no changes caused by ECT, even with convulsions lasting several minutes [57]. Both conventional MRI and diffusion weighted imaging (DWI; a sequence that is sensitive to edema) have failed to find structural damage [58]. However, changes on DWI have been shown for patients after status epilepticus [59]. If brain injury occurs as a consequence of ECT, one may expect to find micro hemorrhages. SWI is extremely sensitive to hemorrhages, and is routinely used in imaging of stroke [60]. However, SWI, as an indicator of microvascular dis-integrity, has to our knowledge never been applied after ECT. In addition, by using 1H-MRS we will measure N-acetylaspartate (NAA), which is primarily localized in neurons and considered a marker for neuronal integrity [61].

Our project will use high field strength, state of the art MRI and combine RSI, SWI and 1H-MRS which should enable detection of more subtle post-ECT effects.

Hypotheses and aims

Based on the above discussions, the following main hypotheses define the outline and aims of this project:

  1. 1.

    Hippocampal volumes increase after ECT treatment. A) Specifically there is increased volume of the dentate gyrus, which would suggest that the increase is caused by neurogenesis. B) Changes in hippocampal structure correlate with treatment response, neurocognitive measures and increased concentrations of neurotrophic factors in blood samples.

  2. 2.

    ECT causes increased levels of the neurotransmitter GABA and changes the glutamate/GABA balance. A) GABA concentrations correlate with treatment response. B) Genes regulating GABA synthesis and cycling are up-regulated or activated. C) A subset of cortical projections is strengthened; a possible mechanism causing reduced connectivity in frontal areas.

  3. 3.

    ECT does not cause measurable signs of harmful effects to the brain. A) No changes are detected on microvascular (SWI) and microstructural (RSI) imaging. NAA (measurend in the ACC) is unaffected. B) Possible immediate post-ECT effects, e.g. edema, that is detectable by diffusion weighted imaging, are reversible.

Methods and design

The study is prospective and observational, and all patients will receive the standard ECT treatment, as it is provided at the ECT-department at the Haukeland University Hospital.

A flow chart of the study design is shown in Figure 1, and details on study measures and variables are listed in Table 1.

Figure 1
figure 1

Flow Chart of Study Design.

Table 1 Variable overview

Relevant patients with depression are addressed in order to establish whether they are willing to be screened for the study. The patients must be assigned a patient number and sign the consent form after receiving oral and written information about the study prior to undergoing any study procedures.

Patients

Forty patients accepted for ECT at Haukeland University Hospital will be included. After inclusion of 8 patients, the protocol was slightly revised and the remaining 32 patients will follow the protocol as described here.

Inclusion criteria

Patients (age > 18) referred to the ECT-unit and accepted for treatment because of moderate and severe depression, fulfilling the criteria for the following ICD-10 diagnoses: F31.3 and F31.4; F32.1 and F32.2 and F32.3; F33.1 and F33.2 and F33.3. In addition the symptom intensity must be verified by a score ≥ 25 on the Montgomery and Åsberg Depression Rating Scale (MADRS). There is no upper age for participation; however, the responsible clinician will consider if patients are eligible for inclusion (functioning, enable to give written informed consent).

Exclusion criteria

ECT treatment within the last 12 months. Pregnancy. Patients unable to give written informed consent (according to the responsible clinician or ECT responsible). Patients who cannot participate in the MRI scanning because of contraindications to MRI.

Control groups

There will be two control groups; a group of patients undergoing ECV for AF (controls 1) and healthy controls undergoing the same investigations as the ECT patient group, but not receiving ECT or anesthesia (controls 2).

Controls 1

In order to control for the potential effect of anesthesia on MRI images (particularly with regard to the spectroscopy) and blood samples, 15 patients referred for ECV of AF will be recruited. This is a patient group that receives similar anesthesia to ECT patients. This control group will have 2 MRI scans; one 1-2 hours before ECV and another MRI 1-2 hours after ECV. Blood samples will also be collected for the biobank at time points indicated in Figure 1. In addition to being a control group, data that is acquired will be used in a pilot investigation of potential effects of ECV of AF, if there are silent emboli to the brain. Such emboli would readily be detected on the diffusion images. Antithrombotic treatment must be Warfarin with an INR value above 2,0 at all measurements for the last 3 weeks prior to DC cardioversion or absolute compliant everyday use of Non-vitamin K antagonist oral anticoagulants (NOACs) for 3 weeks. There will be no changes in the treatment of their AF, patients are only asked to participate in additional examinations (MRI, blood samples) before and after ECV.

Controls 2

When analyzing longitudinal MRI data, it is important to control for effects on imaging parameters that are a consequence of repeated measurements/time, rather than effects of the treatment. 15 healthy, age and gender-matched volunteers will be recruited for repeated MR imaging, blood samples and neuropsychological testing; following the protocol for the ECT patients (see Figure 1) but with no ECT or anesthesia.

ECT treatment

ECT will be administered with a Thymatron System IV Somatics Inc. providing brief-pulse, square wave, constant current.

Anesthesia

Anesthesia will be obtained with either the short acting anesthetic thiopental or propofol. All patients will be hyperoxygenated with oxygen-enriched air 1 to 2 minutes before and during the initiation of anesthesia to optimize induction of seizures [62,63]. Other medication necessary during anesthesia (e.g. for premedication or termination of prolonged seizure) will be left to decision by the anesthesiologist.

Stimulation electrodes placement

Stimulation electrodes will be placed ad modem d’ Elia [64] (Right unilateral electrode placement, RUL), as high dosage ECT with unilateral placement of stimulation electrodes has shown to be as effective as bilateral placement [65,66]. Three sessions per week will be given until remission, with a maximum of 18 sessions.

Stimulus

The duration of the stimulus pulse will be set to 0.5 ms. The initial stimulus energy will be determined by an age based method, where the energy (E) is calculated as following [67]: Patient’s age in years × 5  stimulus charge in mC. The Thymatron delivers a charge of 25.2 to 504 mC in 20 equal steps, set by the % Energy dial. According to the above formula this makes: Patient’s age in years  % Energy. In order to consider gender specific differences in seizure threshold, the % Energy was adapted as following: For male patients: % Energy + 5 to 10%. For female patients: % Energy - 5 to 10%.

Seizure adequacy

The adequacy of each seizure will be evaluated by the ECT-clinician based on seizure duration, δ-waves, reorientation time and clinical effect. The treatment should be followed by a comatose state, from which consciousness is gradually regained [68]. If a sufficient seizure was not obtained in one session the patient will be either re-stimulated in the same session or/and stimulus parameter will be adjusted in the next session.

Clinical assessments and Neuropsychological tests

Clinical assessments and monitoring will be performed largely in accordance with a recently used protocol [69], as detailed below and summarized in Table 1.

Patients will be diagnosed on the basis of a clinical interview supported by information from hospital records. The diagnoses will be subsequently verified by the Mini-International Neuropsychiatric Interview (MINI; specifically the MINI-Plus) [70]. Symptom intensity will be measured with MADRS [71] and the Clinical Global Impression (CGI) [72].

Patients will be assessed before the treatment, and weekly during the ECT-series with the Mini-Mental State (MMS) by their treating clinician.

A neuropsychological test battery that includes both standardized and normalized tests and experimental methods to assess memory, attention, psychomotor speed and executive functions, will be applied at inclusion, after treatment and at follow up, as listed in Table 1. The neuropsychological assessment will consist of standardized tests measuring cognitive functioning within verbal and visual memory with California Verbal Learning Test-II (CVLT-II) Rey Complex Figure Test (RCFT) and Digit span from Wechsler Adult Intelligence Scale, Revised (WAIS-R), executive functioning with Wisconsin Card Sorting Test (WCST), and test from the Delis –Kaplan Executive Function System (D-kefs): Color-Word Interference Test (CWIFT), Verbal fluency (VF), Tower, Trailmaking test (TMT), attention measured with Conners’ Continuous Performance Test-II (CPT), Digit symbol from WAIS-R and motor speed (Pegboard), in addition to general levels of intellectual ability Wechsler’s Abbreviated Scales of Intelligence (WASI). Autobiographical memory will be assessed by using the Autobiographical Memory Interview-Short Form (AMI-SF).

Dichotic listening task

Placement of electrodes on the non-dominant side (unilateral stimulation) is important to reduce cognitive impairment as a side effect of ECT treatment [65,73]. Traditionally, hemispheric dominance is evaluated by handedness measures, which however is a crude measurement when it comes to subtle differences in function between the cerebral hemispheres. It is therefore suggested to use a neuropsychological task, dichotic listening, which has been shown to be comparable in sensitivity to reveal functional differences between the hemispheres to the Wada test [74,75]. We will apply the Bergen dichotic listening test [76] both as a measure of language dominance and as an effect parameter, i.e. as a measure of cognitive control since it has been shown that varying instructions about attention focus while performing the dichotic listening task reveals capacity for cognitive control [77]. A recent development makes it possible to deliver the test bedside, by use of an application on a hand held device; iDichotic, Bergen fMRI group [78]. The prediction is that treatment response correlates with improved results for the instruction condition that requires highest cognitive control.

MRI acquisition and post processing

Imaging will be performed at 4 time points: ~1-2 hours before and ~1-2 hours after ECT, ~ 7-14 days after ended treatment and at follow-up 6 months after ended treatment. The same MRI protocol will be applied at each time point (Figure 1).

MRI Protocol

Initial imaging will be performed on a 3T GE Signa HDxt system with 8 channel head coil, but most of the subjects will be scanned on a 3T Discovery MR750 system with 32 channel head coil. The protocol (details specified for the MR750 system) includes a T1-weighted fast spoiled gradient echo, FSPGR (TE/TR = 2.9/6.7 ms; TI = 600 ms, flip angel = 8°; FOV = 25.6 cm; voxel size = 1.0 × 1.0 × 1.0 mm3, acquisition time = 10:32 min.); a T2-weighted CUBE FLAIR sequence (TE/TR = 129/6000 ms; TI = 1855 ms; FOV = 25.6 cm; voxel size = 1.0 × 1.0 × 1.0 mm3, acquisition time = 08:51 min.); for RSI, a single-shot pulsed-field gradient spin-echo EPI sequence (TE/TR = 85/7000 ms; FOV = 24 cm, matrix = 96 × 96 × 55 with 4 b-values (b = 0, 500, 1000 and 4000 s/mm2 and 6, 6 and 15 unique directions for the nonzero b-values, respectively), acquisition time = 3:30 min.); for SWI a gradient recalled echo 3D Ax SWAN sequence (TE/TR, 23/37 ms; slice thickness 2 mm; acquisition time 3:30 min.). For 1H-MRS, both single-voxel point-resolved spectroscopy, SV PRESS, and a spectral editing method, MEGA-PRESS [79], will be used. The SV-PRESS (TR = 1500 ms, TE = 35, 128 scans; acquisition time = 3:48 min.) voxel will measure 2 × 2 × 2 cm3 and the placement alternate between right and left anterior cingulate cortex (ACC) for each new patient. For MEGA-PRESS (TR = 1500 ms, TE = 68 ms, 192 scans, acquisition time = 10:06 min.) the voxel will measure 3 × 3 × 3 cm3 and cross the mid-line, covering both right and left ACC in every patient.

Image processing and analysis

Structural data will be analyzed using FreeSurfer [42] and Quarc [80]. In a preprocessing step, structural images will be corrected for distortions caused by gradient non-linearity [81], diffusion weighted (DW) images will be corrected for motion, eddy currents and magnetic susceptibility artifacts [82,83] and the DW volume will be co-registered to the structural volumes. SWI data will be analyzed using Statistical Parametrical Mapping (SPM8/SPM12) analysis software package (Wellcome Department of Cognitive Neurology) running under MATLAB (Mathworks). RSI data will be analyzed using custom made software and processing and/or with FSL [84,85] and MRS data by using LCModel Software [86]. SPSS will be used for statistical analyses.

Analysis methods and software may change if newer versions or other software is found to be more suitable than the above mentioned.

Blood samples and biobank

We will analyze multiple peripheral blood biomarkers relevant for the hypotheses outlined in the introduction. Due to the constant progress in the field, the decision on the specific markers to analyze and how to perform the analysis should not be taken too early. However, candidate markers include neurotrophic factors (e.g. BDNF), pro-inflammatory cytokines, neurotransmitter related amino acids, monoamines and related metabolites (e.g. GABA, glutamate, kynurenines, neopterin) and S100B (a marker of damage to the blood-brain barrier). Measurements of peripheral biomarker levels will be supplemented by analyses of DNA variants and peripheral blood mRNA levels (array based genome wide DNA genotyping, methylation profiling of target genes and real-time reverse transcription polymerase chain reaction mRNA measurements). Blood samples (up to 30 ml) will be collected and stored as whole blood, serum and on an RNA stabilization medium at -80°C for later analysis. A dedicated research biobank “Imaging and Depression - ImDep” has been generated for the project using existing infrastructure (storage, alarm and registration) established in a previous project.

Power analysis

Only one study has measured GABA changes after ECT by MRS in humans, and found an increase from 0.85 (SD = 0.34) to 1.51 (SD = 048) mmol/kg brain tissue, N = 8 [50]. Using a mean difference of 0.6 and a SD of 0.5, α = 0.05 and power of 0.8 the total sample size needed would be 8 (calculated using G*Power 3.1.3, paired t-test, two-tailed).

For analysis of hippocampal volumes, data from Nordanskog et al. [41] were used. For the right hippocampus the mean difference in volumes after a course of ECT was 133 μL with a SD of 123 μL, similar analysis as above indicates that the sample size needs to be at least 9.

We found no studies on SWI and DWI imaging that could be used to estimate power of the suggested study protocol. Based on the analysis above, a total of 10 patients is a minimum. Due to wide inclusion criteria, expected heterogeneity of the sample population and in order to increase the robustness we intend to include 40 patients.

Ethical considerations

The study is based on written informed consent. Patients will receive standard ECT treatment. The study, and the specific Biobank, are approved by the Regional Committee for Medical and Health Research Ethics, REC South East, Norway.

For patients and controls

Participation in the project will for the patients include MRI scans (4 time points) and blood samples (5 time points) as well as neuropsychological testing (3 time points) that are not part of the standard treatment regimen. For controls1 (AF-ECV) participation will include MRI (2 time points) and blood samples (2 time points) that is not part of the standard clinical treatment. For controls2 participation will require MRI scans (4 time points) and blood samples (5 time points) as well as neuropsychological testing (3 time points). Controls2 will be economically compensated for participating.

There are no known adverse effects related to MRI scanning when standard safety procedures are followed. However, scanners are noisy and scans will last up to one hour. Blood samples will require venous puncture. A neuroradiologist will screen the first MRI scan for each participant. In the case of incidental findings of relevant pathology, the participant will be offered referral to medical consultation.

For science and society

As health care professionals we are obliged to ensure that our treatments are well documented and safe. Thorough investigations of ECT effects will improve patients’ feeling of safety and possibly reduce stigmata related to the condition. Depression is a common disorder with substantial costs for individuals, employers, and health and welfare systems. New knowledge about the pathophysiology of major depression as well as mechanisms of action and possible harmful effects of ECT is crucial and may lead to new prospects for future treatments.

Discussion

By use of multimodal neuroradiological imaging as well as multidisciplinary investigations spanning from genes to behavior, the study aims at increasing knowledge about what ECT does to the brain, such as: a) Does ECT affect microvascular integrity? b) How are hippocampal volumes related to ECT parameters and treatment effects? c) Does GABA-levels increase after ECT?

Several of the measures have to our knowledge never before been applied in this setting, e.g. RSI, SWI, Dichotic listening, and a control group that receives a similar anesthesia and electrical stimulation to the chest. Strengths of the study are comprehensive investigations and a moderately large sample size. Potential weaknesses are the rather broad inclusion criteria and expected heterogeneity in the patients’ use of medications, both of which may increase the variance in study measures. However, ECT is an unspecific treatment and although we expect that its effects on the brain and the human physiology should be largely independent of diagnosis, medication use and age, it will be interesting to see how ECT-induced changes relate to treatment effects and clinical parameters.

Ethical approval

Regional Committee for Medical and Health Research Ethics, REC South East ID: 2013/1032 ECT and Neuroradiology. Approved first in June 2013, last revision December 2014.

References

  1. Wittchen HU, Jacobi F, Rehm J, Gustavsson A, Svensson M, Jonsson B, et al. The size and burden of mental disorders and other disorders of the brain in Europe 2010. Eur Neuropsychopharmacol. 2011;21(9):655–79.

    Article  CAS  PubMed  Google Scholar 

  2. Lepine JP, Briley M. The increasing burden of depression. Neuropsychiatr Dis Treat. 2011;7 Suppl 1:3–7.

    PubMed  PubMed Central  Google Scholar 

  3. Miller S, Dell'Osso B, Ketter TA. The prevalence and burden of bipolar depression. J Affect Disord. 2014;169S1:S3–11.

    Article  Google Scholar 

  4. Endler NS. The Origins of Electroconvulsive Therapy (ECT). Convuls Ther. 1988;4(1):5–23.

    PubMed  Google Scholar 

  5. Payne NA, Prudic J. Electroconvulsive therapy: Part I. A perspective on the evolution and current practice of ECT. J Psychiatr Pract. 2009;15(5):346–68.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Carney S, Cowen P, Dearness K, Eastaugh J. Efficacy and safety of electroconvulsive therapy in depressive disorders: a systematic review and meta-analysis. Lancet. 2003;361(9360):799–808.

    Article  Google Scholar 

  7. Schoeyen HK, Kessler U, Andreassen OA, Auestad BH, Bergsholm P, Malt UF, et al. Treatment-resistant bipolar depression: a randomized controlled trial of electroconvulsive therapy versus algorithm-based pharmacological treatment. Am J Psychiatry. 2015;172(1):41–51.

    Article  PubMed  Google Scholar 

  8. Payne NA, Prudic J. Electroconvulsive therapy: Part II: a biopsychosocial perspective. J Psychiatr Pract. 2009;15(5):369–90.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Sterling P. ECT damage is easy to find if you look for it. Nature. 2000;403(6767):242.

    Article  CAS  PubMed  Google Scholar 

  10. Fosse R, Read J. Electroconvulsive treatment: hypotheses about mechanisms of action. Front Psychol/Front Res Found. 2013;4:94.

    Google Scholar 

  11. Petrides G, Tobias KG, Kellner CH, Rudorfer MV. Continuation and maintenance electroconvulsive therapy for mood disorders: review of the literature. Neuropsychobiology. 2011;64(3):129–40.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Semkovska M, McLoughlin DM. Objective cognitive performance associated with electroconvulsive therapy for depression: a systematic review and meta-analysis. Biol Psychiatry. 2010;68(6):568–77.

    Article  PubMed  Google Scholar 

  13. Kessler U, Schoeyen HK, Andreassen OA, Eide GE, Malt UF, Oedegaard KJ, et al. The effect of electroconvulsive therapy on neurocognitive function in treatment-resistant bipolar disorder depression. J Clin Psychiatry. 2014;75(11):e1306–13.

    Article  PubMed  Google Scholar 

  14. Rose D, Fleischmann P, Wykes T, Leese M, Bindman J. Patients' perspectives on electroconvulsive therapy: systematic review. BMJ. 2003;326(7403):1363.

    Article  PubMed  PubMed Central  Google Scholar 

  15. NICE. Depression: the Treatment and Management of Depression in Adults (Update). In: NICE clinical guideline 90 London: National Institute for Health and Clinical Excellence. Leicester and London: The British Psychological Society and The Royal College of Psychiatrists; 2009. PMID: 22132433.

    Google Scholar 

  16. Berge T, Berge M, Gudim HB, Hortemo S, Malt UF, Nordahl HM, et al. National guidelines for diagnosis and treatment of adults suffering from depression in primary and secondary health care. Oslo: Helsedirektoratet; 2009. Report number: IS-1561. ISBN-nr. 978-82-8081-184-184-4.

    Google Scholar 

  17. Moksnes KM, Vatnaland T, Eri B, Torvik NH. [Electroconvulsive therapy in the Ullevaal region of Oslo 1988-2002]. Tidsskr Nor Laegeforen. 2006;126(13):1750–3.

    PubMed  Google Scholar 

  18. Alves GS, Carvalho AF, Sudo FK, Oertel-Knochel V, Knochel C, de Carvalho LA, et al. Structural neuroimaging findings in major depressive disorder throughout aging: a critical systematic review of prospective studies. CNS Neurol Disord Drug Targets. 2014;13(10):1846–59.

    Article  PubMed  Google Scholar 

  19. Kempton MJ, Salvador Z, Munafo MR, Geddes JR, Simmons A, Frangou S, et al. Structural neuroimaging studies in major depressive disorder: meta-analysis and comparison with bipolar disorder. Arch Gen Psychiatry. 2011;68(7):675–90.

    Article  PubMed  Google Scholar 

  20. Videbech P. MRI findings in patients with affective disorder: a meta-analysis. Acta Psychiatr Scand. 1997;96(3):157–68.

    Article  CAS  PubMed  Google Scholar 

  21. Abbott CC, Gallegos P, Rediske N, Lemke NT, Quinn DK. A review of longitudinal electroconvulsive therapy: neuroimaging investigations. J Geriatr Psychiatry Neurol. 2014;27(1):33–46.

    Article  PubMed  Google Scholar 

  22. Bolwig TG. Neuroimaging and electroconvulsive therapy: a review. J ECT. 2014;30(2):138–42.

    Article  PubMed  Google Scholar 

  23. Bouckaert F, Sienaert P, Obbels J, Dols A, Vandenbulcke M, Stek M, et al. ECT: its brain enabling effects: a review of electroconvulsive therapy-induced structural brain plasticity. J ECT. 2014;30(2):143–51.

    Article  PubMed  Google Scholar 

  24. McKinnon MC, Yucel K, Nazarov A, MacQueen GM. A meta-analysis examining clinical predictors of hippocampal volume in patients with major depressive disorder. J Psychiatry Neurosci. 2009;34(1):41–54.

    PubMed  PubMed Central  Google Scholar 

  25. Campbell S, Marriott M, Nahmias C, MacQueen GM. Lower hippocampal volume in patients suffering from depression: a meta-analysis. Am J Psychiatry. 2004;161(4):598–607.

    Article  PubMed  Google Scholar 

  26. Geuze E, Vermetten E, Bremner JD. MR-based in vivo hippocampal volumetrics: 2. Findings in neuropsychiatric disorders. Mol Psychiatry. 2005;10(2):160–84.

    Article  CAS  PubMed  Google Scholar 

  27. Sheline YI, Gado MH, Kraemer HC. Untreated depression and hippocampal volume loss. Am J Psychiatry. 2003;160(8):1516–8.

    Article  PubMed  Google Scholar 

  28. Maguire EA, Gadian DG, Johnsrude IS, Good CD, Ashburner J, Frackowiak RS, et al. Navigation-related structural change in the hippocampi of taxi drivers. Proc Natl Acad Sci U S A. 2000;97(8):4398–403.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Woollett K, Maguire EA. Acquiring "the Knowledge" of London's layout drives structural brain changes. Curr Biol. 2011;21(24):2109–14.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Gould E, Tanapat P, McEwen BS, Flugge G, Fuchs E. Proliferation of granule cell precursors in the dentate gyrus of adult monkeys is diminished by stress. Proc Natl Acad Sci U S A. 1998;95(6):3168–71.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Cameron HA, Woolley CS, McEwen BS, Gould E. Differentiation of newly born neurons and glia in the dentate gyrus of the adult rat. Neuroscience. 1993;56(2):337–44.

    Article  CAS  PubMed  Google Scholar 

  32. Ming GL, Song H. Adult neurogenesis in the mammalian central nervous system. Annu Rev Neurosci. 2005;28:223–50.

    Article  CAS  PubMed  Google Scholar 

  33. Segi-Nishida E. Exploration of new molecular mechanisms for antidepressant actions of electroconvulsive seizure. Biol Pharm Bull. 2011;34(7):939–44.

    Article  CAS  PubMed  Google Scholar 

  34. Bocchio-Chiavetto L, Zanardini R, Bortolomasi M, Abate M, Segala M, Giacopuzzi M, et al. Electroconvulsive Therapy (ECT) increases serum Brain Derived Neurotrophic Factor (BDNF) in drug resistant depressed patients. Eur Neuropsychopharmacol. 2006;16(8):620–4.

    Article  CAS  PubMed  Google Scholar 

  35. Yoshida T, Ishikawa M, Niitsu T, Nakazato M, Watanabe H, Shiraishi T, et al. Decreased Serum Levels of Mature Brain-Derived Neurotrophic Factor (BDNF), but Not Its Precursor proBDNF, in Patients with Major Depressive Disorder. PLoS One. 2012;7(8):e42676.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Eriksson PS, Perfilieva E, Bjork-Eriksson T, Alborn AM, Nordborg C, Peterson DA, et al. Neurogenesis in the adult human hippocampus. Nat Med. 1998;4(11):1313–7.

    Article  CAS  PubMed  Google Scholar 

  37. Abbott CC, Jones T, Lemke NT, Gallegos P, McClintock SM, Mayer AR, et al. Hippocampal structural and functional changes associated with electroconvulsive therapy response. Translat Psychiatry. 2014;4:e483.

    Article  CAS  Google Scholar 

  38. Dukart J, Regen F, Kherif F, Colla M, Bajbouj M, Heuser I, et al. Electroconvulsive therapy-induced brain plasticity determines therapeutic outcome in mood disorders. Proc Natl Acad Sci U S A. 2014;111(3):1156–61.

    Article  CAS  PubMed  Google Scholar 

  39. Nordanskog P, Larsson MR, Larsson EM, Johanson A. Hippocampal volume in relation to clinical and cognitive outcome after electroconvulsive therapy in depression. Acta Psychiatr Scand. 2014;129(4):303–11.

    Article  CAS  PubMed  Google Scholar 

  40. Tendolkar I, van Beek M, van Oostrom I, Mulder M, Janzing J, Voshaar RO, et al. Electroconvulsive therapy increases hippocampal and amygdala volume in therapy refractory depression: a longitudinal pilot study. Psychiatry Res. 2013;214(3):197–203.

    Article  PubMed  Google Scholar 

  41. Nordanskog P, Dahlstrand U, Larsson MR, Larsson EM, Knutsson L, Johanson A. Increase in hippocampal volume after electroconvulsive therapy in patients with depression: a volumetric magnetic resonance imaging study. J ECT. 2010;26(1):62–7.

    Article  PubMed  Google Scholar 

  42. FreeSurfer [http://surfer.nmr.mgh.harvard.edu]

  43. Lisanby SH, Bazil CW, Resor SR, Nobler MS, Finck DA, Sackeim HA. ECT in the treatment of status epilepticus. J ECT. 2001;17(3):210–5.

    Article  CAS  PubMed  Google Scholar 

  44. Sackeim HA. The anticonvulsant hypothesis of the mechanisms of action of ECT: current status. J ECT. 1999;15(1):5–26.

    Article  CAS  PubMed  Google Scholar 

  45. Sanacora G. Cortical inhibition, gamma-aminobutyric acid, and major depression: there is plenty of smoke but is there fire? Biol Psychiatry. 2010;67(5):397–8.

    Article  PubMed  Google Scholar 

  46. Luscher B, Shen Q, Sahir N. The GABAergic deficit hypothesis of major depressive disorder. Mol Psychiatry. 2011;16(4):383–406.

    Article  CAS  PubMed  Google Scholar 

  47. Carpenter LL, Schecter JM, Tyrka AR, Mello AF, Mello MF, Haggarty R, et al. Open-label tiagabine monotherapy for major depressive disorder with anxiety. J Clin Psychiatry. 2006;67(1):66–71.

    Article  CAS  PubMed  Google Scholar 

  48. Zhao J, Bao AM, Qi XR, Kamphuis W, Luchetti S, Lou JS, et al. Gene expression of GABA and glutamate pathway markers in the prefrontal cortex of non-suicidal elderly depressed patients. J Affect Disord. 2012;138(3):494–502.

    Article  CAS  PubMed  Google Scholar 

  49. Pizzagalli DA. Frontocingulate dysfunction in depression: toward biomarkers of treatment response. Neuropsychopharmacology. 2011;36(1):183–206.

    Article  PubMed  Google Scholar 

  50. Sanacora G, Mason GF, Rothman DL, Hyder F, Ciarcia JJ, Ostroff RB, et al. Increased cortical GABA concentrations in depressed patients receiving ECT. Am J Psychiatry. 2003;160(3):577–9.

    Article  PubMed  Google Scholar 

  51. Perrin JS, Merz S, Bennett DM, Currie J, Steele DJ, Reid IC, et al. Electroconvulsive therapy reduces frontal cortical connectivity in severe depressive disorder. Proc Natl Acad Sci U S A. 2012;109(14):5464–8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  52. Sheline YI, Price JL, Yan Z, Mintun MA. Resting-state functional MRI in depression unmasks increased connectivity between networks via the dorsal nexus. Proc Natl Acad Sci U S A. 2010;107(24):11020–5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  53. Nobuhara K, Okugawa G, Minami T, Takase K, Yoshida T, Yagyu T, et al. Effects of electroconvulsive therapy on frontal white matter in late-life depression: a diffusion tensor imaging study. Neuropsychobiology. 2004;50(1):48–53.

    Article  CAS  PubMed  Google Scholar 

  54. Lyden H, Espinoza RT, Pirnia T, Clark K, Joshi SH, Leaver AM, et al. Electroconvulsive therapy mediates neuroplasticity of white matter microstructure in major depression. Translat Psychiatry. 2014;4:e380.

    Article  CAS  Google Scholar 

  55. White NS, Leergaard TB, D'Arceuil H, Bjaalie JG, Dale AM. Probing tissue microstructure with restriction spectrum imaging: histological and theoretical validation. Hum Brain Mapp. 2013;34(2):327–46.

    Article  PubMed  Google Scholar 

  56. Kulkarni RR, Melkundi S. Subdural hematoma: an adverse event of electroconvulsive therapy-case report and literature review. Case Rep. 2012;2012:585303.

    Google Scholar 

  57. Bergsholm P, Larsen JL, Rosendahl K, Holsten F. Electroconvulsive therapy and cerebral computed tomography: a prospective study. Acta Psychiatr Scand. 1989;80(6):566–72.

    Article  CAS  PubMed  Google Scholar 

  58. Szabo K, Hirsch JG, Krause M, Ende G, Henn FA, Sartorius A, et al. Diffusion weighted MRI in the early phase after electroconvulsive therapy. Neurol Res. 2007;29(3):256–9.

    Article  PubMed  Google Scholar 

  59. Chatzikonstantinou A, Gass A, Forster A, Hennerici MG, Szabo K. Features of acute DWI abnormalities related to status epilepticus. Epilepsy Res. 2011;97(1-2):45–51.

    Article  PubMed  Google Scholar 

  60. Santhosh K, Kesavadas C, Thomas B, Gupta AK, Thamburaj K, Kapilamoorthy TR. Susceptibility weighted imaging: a new tool in magnetic resonance imaging of stroke. Clin Radiol. 2009;64(1):74–83.

    Article  CAS  PubMed  Google Scholar 

  61. Stagg CJ, Rothman DL, editors. Magnetic resonance spectroscopy: tools for neuroscience research and emerging clinical applications. Amsterdam: Academic; 2014.

    Google Scholar 

  62. Bergsholm P, Gran L, Bleie H. Seizure duration in unilateral electroconvulsive therapy: the effect of hypocapnia induced by hyperventilation and the effect of ventilation with oxygen. Acta Psychiatr Scand. 1984;69(2):121–8.

    Article  CAS  PubMed  Google Scholar 

  63. Chater SN, Simpson KH. Effect of passive hyperventilation on seizure duration in patients undergoing electroconvulsive therapy. Br J Anaesth. 1988;60(1):70–3.

    Article  CAS  PubMed  Google Scholar 

  64. d'Elia G. Unilateral electroconvulsive therapy. Acta Psychiatr Scand Suppl. 1970;215:1–98.

    PubMed  Google Scholar 

  65. McCall WV, Reboussin DM, Weiner RD, Sackeim HA. Titrated moderately suprathreshold vs fixed high-dose right unilateral electroconvulsive therapy: acute antidepressant and cognitive effects. Arch Gen Psychiatry. 2000;57(5):438–44.

    Article  CAS  PubMed  Google Scholar 

  66. Sackeim HA, Prudic J, Devanand DP, Nobler MS, Lisanby SH, Peyser S, et al. A prospective, randomized, double-blind comparison of bilateral and right unilateral electroconvulsive therapy at different stimulus intensities. Arch Gen Psychiatry. 2000;57(5):425–34.

    Article  CAS  PubMed  Google Scholar 

  67. Abrams R. Electroconvulsive therapy, vol. 4. New York: Oxford University Press; 2002.

    Google Scholar 

  68. d'Elia G, Ottosson JO, Stromgren LS. Present practice of electroconvulsive therapy in Scandinavia. Arch Gen Psychiatry. 1983;40(5):577–81.

    Article  PubMed  Google Scholar 

  69. Kessler U, Vaaler AE, Schoyen H, Oedegaard KJ, Bergsholm P, Andreassen OA, et al. The study protocol of the Norwegian randomized controlled trial of electroconvulsive therapy in treatment resistant depression in bipolar disorder. BMC Psychiatry. 2010;10:16.

    Article  PubMed  PubMed Central  Google Scholar 

  70. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59 Suppl 20:22–33. quiz 34-57.

    CAS  PubMed  Google Scholar 

  71. Montgomery SA, Asberg M. A new depression scale designed to be sensitive to change. Br J Psychiatry. 1979;134:382–9.

    Article  CAS  PubMed  Google Scholar 

  72. Guy W. Clinical Global Impressions. In: ECDEU Assessment Manual for Psychopharmacology, revised (DHEW Publ No ADM 76-338). Rockville, MD: National Institute of Mental Health; 1976. p. 218–22.

    Google Scholar 

  73. Sackeim HA, Prudic J, Fuller R, Keilp J, Lavori PW, Olfson M. The cognitive effects of electroconvulsive therapy in community settings. Neuropsychopharmacology. 2007;32(1):244–54.

    Article  PubMed  Google Scholar 

  74. Geffen G, Traub E, Stierman I. Language laterality assessed by unilateral ECT and dichotic monitoring. J Neurol Neurosurg Psychiatry. 1978;41(4):354–60.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  75. Hugdahl K, Carlsson G, Uvebrant P, Lundervold AJ. Dichotic-listening performance and intracarotid injections of amobarbital in children and adolescents: preoperative and postoperative comparisons. Arch Neurol. 1997;54(12):1494–500.

    Article  CAS  PubMed  Google Scholar 

  76. Hugdahl K. Dichotic listening in the study of auditory laterality. In: Hugdahl K, Davidson RJ, editors. The asymmetrical brain. Cambridge: MIT Press; 2004. p. 441–75.

    Google Scholar 

  77. Hugdahl K, Westerhausen R. Cognitive control of auditory laterality. In: Hugdahl K, Westerhausen R, editors. The two halves of the brain. London: MIT Press; 2010. p. 469–97.

    Chapter  Google Scholar 

  78. Bless JJ, Westerhausen R, Arciuli J, Kompus K, Gudmundsen M, Hugdahl K. "Right on all Occasions?" - on the feasibility of laterality research using a smartphone dichotic listening application. Front Psychol. 2013;4:42.

    Article  PubMed  PubMed Central  Google Scholar 

  79. Mescher M, Merkle H, Kirsch J, Garwood M, Gruetter R. Simultaneous in vivo spectral editing and water suppression. NMR Biomed. 1998;11(6):266–72.

    Article  CAS  PubMed  Google Scholar 

  80. Holland D, Dale AM. Nonlinear registration of longitudinal images and measurement of change in regions of interest. Med Image Anal. 2011;15(4):489–97.

    Article  PubMed  PubMed Central  Google Scholar 

  81. Jovicich J, Czanner S, Greve D, Haley E, van der Kouwe A, Gollub R, et al. Reliability in multi-site structural MRI studies: effects of gradient non-linearity correction on phantom and human data. Neuroimage. 2006;30(2):436–43.

    Article  PubMed  Google Scholar 

  82. Holland D, Kuperman JM, Dale AM. Efficient correction of inhomogeneous static magnetic field-induced distortion in Echo Planar Imaging. Neuroimage. 2010;50(1):175–83.

    Article  PubMed  Google Scholar 

  83. Hagler Jr DJ, Ahmadi ME, Kuperman J, Holland D, McDonald CR, Halgren E, et al. Automated white-matter tractography using a probabilistic diffusion tensor atlas: application to temporal lobe epilepsy. Hum Brain Mapp. 2009;30(5):1535–47.

    Article  PubMed  PubMed Central  Google Scholar 

  84. Smith SM, Jenkinson M, Woolrich MW, Beckmann CF, Behrens TE, Johansen-Berg H, et al. Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage. 2004;23 Suppl 1:S208–19.

    Article  PubMed  Google Scholar 

  85. Woolrich MW, Jbabdi S, Patenaude B, Chappell M, Makni S, Behrens T, et al. Bayesian analysis of neuroimaging data in FSL. Neuroimage. 2009;45(1 Suppl):S173–86.

    Article  PubMed  Google Scholar 

  86. Provencher SW. Estimation of metabolite concentrations from localized in vivo proton NMR spectra. Magn Reson Med. 1993;30(6):672–9.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

This study is supported by Western Norway Regional Health Authority, Haukeland University Hospital and the University of Bergen, Norway.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Leif Oltedal.

Additional information

Competing interests

Anders M. Dale is a Founder of and holds equity in CorTechs Labs, Inc, and serves on its Scientific Advisory Board. He is also a member of the Scientific Advisory Board of Human Longevity, Inc. (HLI), and receives funding through research agreements with General Electric Healthcare (GEHC) and Medtronic, Inc. The terms of these arrangements have been reviewed and approved by the University of California, San Diego in accordance with its conflict of interest policies. The other authors declare that they have no competing interests.

Authors’ contributions

LO and UK drafted the manuscript. LO conceived of the study and coordinated the work. UK, LE, RG, PIH, OAA, JH, AMD, ÅH, KH and KJO contributed to the background and/or design of the study. All the authors read and approved the final manuscript.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Oltedal, L., Kessler, U., Ersland, L. et al. Effects of ECT in treatment of depression: study protocol for a prospective neuroradiological study of acute and longitudinal effects on brain structure and function. BMC Psychiatry 15, 94 (2015). https://doi.org/10.1186/s12888-015-0477-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-015-0477-y

Keywords