The self-reported Montgomery-Åsberg depression rating scale is a useful evaluative tool in major depressive disorder
© Fantino and Moore; licensee BioMed Central Ltd. 2009
Received: 29 April 2008
Accepted: 27 May 2009
Published: 27 May 2009
The use of Patient-reported Outcomes (PROs) as secondary endpoints in the development of new antidepressants has grown in recent years. The objective of this study was to assess the psychometric properties of the 9-item, patient-administered version of the Montgomery-Åsberg Depression Rating Scale (MADRS-S).
Data from a multicentre, double-blind, 8-week, randomised controlled trial of 278 outpatients diagnosed with Major Depressive Disorder were used to evaluate the validity, reliability and sensitivity to change of the MADRS-S using psychometric methods. A Receiver Operating Characteristic (ROC) curve was plotted to identify the most appropriate threshold to define perceived remission.
No missing values were found at the item level, indicating good acceptability of the scale. The construct validity was satisfactory: all items contributed to a common underlying concept, as expected. The correlation between MADRS-S and physicians' MADRS was moderate (r = 0.54, p < 0.001) indicating that MADRS-S is complementary rather than redundant to the MADRS. Cronbach's alpha was 0.84, and the stability over time of the scale, estimated on a sub-sample of patients whose health status did not change during the first week of the study, was good (intraclass correlation coefficient of 0.78). MADRS-S sensitivity to change was shown. Using a threshold value of 5, the definition of "perceived remission" reached a sensitivity of 82% and a specificity of 75%.
Taking account of patient's perceptions of the severity of their own symptoms along with the psychometric properties of the MADRS-S enable its use for evaluative purposes in the development of new antidepressant drugs.
Depression is a disabling illness associated with considerable co-morbidity, risk of suicide and numerous adverse social and economic consequences [1–3]. The reported lifetime risk for Major Depressive Disorder (MDD) in the general population varies between 10% – 25% for women, and 5% – 12% for men . The pharmacological treatment of MDD is based on antidepressants, whose efficacy has been demonstrated in a large number of studies .
The use of patient-reported outcomes as a secondary endpoint in the development of new antidepressants has been of growing interest in recent years. Among these outcomes, health-related quality of life, medication compliance and subjective effectiveness (patients' perceptions of symptom severity) are the most commonly used [6–8]. One possible explanation for this growing interest is the fact that patients are increasingly becoming key players in the overall disease management process. In the subjective effectiveness questionnaire category, the main instruments are the Beck Depression Inventory (BDI) [9, 10], the Carroll Rating Scale for Depression (CRSD) [11–13], the Montgomery – Åsberg Depression Rating Scale – Self report (MADRS-S) , the Hamilton Depression Inventory (HDI) , and the Quick Inventory of Depressive Symptomatology – Self Report (QIDS-SR) .
The BDI is the most widely used self-rating instrument, and has been extensively validated in numerous studies . The CRSD and the HDI are the self-reported versions of the Hamilton Depression Rating Scale (HDRS) , while the MADRS-S is the patient version of the Montgomery-Åsberg Depression Rating Scale (MADRS) . From the conceptual and psychometric points of view, these questionnaires are quite different. The BDI is more concerned with depressive cognitive attitudes while the other scales pay more attention to somatic symptoms and functional impairment. The CRSD may discourage patients; completing its 52 questions is time consuming. This may also make it more difficult to implement in clinical research studies compared with the shorter 16-item QIDS-SR or 9-item MADRS-S.
These reasons led us to focus on the psychometric properties of the MADRS-S, particularly its sensitivity to change, since this is of major importance for evaluative purposes (e.g. in the comparison of treatment effects).
Patients and Methods
Study Design and Population
Data came from a multicentre, double blind, randomised clinical trial comparing escitalopram with citalopram in outpatients diagnosed with MDD . Eligible patients were aged between 18–65 years, fulfilled DSM-IV criteria for MDD, and had a baseline MADRS total score of at least 30.
Patients meeting DSM-IV criteria for primary diagnoses of any axis I other than MDD, or those with a history of mania, bipolar disorder, schizophrenia or other psychotic disorder, obsessive-compulsive disorder, or cognitive disorder were not eligible for the study. Patients who met DSM-IV criteria for substance abuse or dependence within the past 12 moths, or who used a depot antipsychotic within 6 months before study inclusion, or any antipsychotic, anxiolytic or anticonvulsant medications within 2 weeks before the first administration of study medication were also ineligible for inclusion.
The Regional review and Ethics committee approved the study protocol on September 3rd, 2003. All patients provided their written informed consent.
Study assessments were performed at baseline and at weeks 1, 4 and 8 after start of treatment. Sociodemographics and clinical data were collected at baseline, and the investigators administered the MADRS, the Clinical Global Impression of Severity (CGI-S) and Improvement (CGI-I) scales at each visit . Before these assessments, patients were asked to fill in the MADRS-S.
This scale consists of 9 items assessing patients' mood, feelings of unease, sleep, appetite, ability to concentrate, initiative, emotional involvement, pessimism and zest for life. Each item is scored between 0 and 3, with three intermediate levels (0.5, 1.5, 2.5). The total score is calculated by summing the answers of the nine items, ranging between 0 and 27 (higher scores indicate increased impairment).
Statistical analyses were performed using SAS version 8.2 , and all statistical tests were two-sided. The α risk was set to 0.05. Continuous variables were described using mean ± standard deviation (SD), while categorical variables were reported using frequency and percentage.
Item-level analysis consisted of assessing the number of missing values for each item and item-response distribution . Correlating each item with the MADRS-S total score after correction for overlap assessed item-internal consistency. A correlation of at least 0.40 is recommended as the standard for supporting item-internal consistency . We also calculated the percentage of respondents achieving the lowest (floor effect) and highest (ceiling effect) score to determine whether the range of MADRS-S was appropriate.
Construct validity was examined using several methods.
(1) Factor analysis was conducted to test the underlying dimensionality of the MADRS-S.
(2) The discriminative validity of the MADRS-S was determined by comparing mean scores across patient groups that were known to differ in their clinical features (known-groups methodology ). Since the recall period of the MADRS-S is the past three days, we did not expect it to be associated with medical history (i.e. number of episodes of depression, history of psychiatric hospitalisation), and we assumed the MADRS-S total score to be associated with the severity of the current episode.
(3) The Receiver Operating Characteristic (ROC) curve was plotted to define the optimal cut-off value for perceived remission, using the MADRS criteria of 12 or less for remission as the "gold standard".
Cronbach's alpha coefficient was used to estimate the internal consistency reliability of the MADRS-S score. A reliability of at least 0.70 is recommended to compare groups of patients, while at least 0.90 is required for comparing individuals . Test-retest reliability of the MADRS-S questionnaire was assessed in a sub-sample of 120 patients whose health status severity was declared unchanged between the baseline and week 1 visits using the CGI-I scale. The intraclass correlation coefficient (ICC) was computed between scale scores from both assessments.
The sensitivity to change of the MADRS-S questionnaire was assessed in a sub-sample of 132 patients whose MADRS total score at week 8 was lower or equal to 12 (remission state). Baseline and week 8 scores were compared using paired t-test. Effect sizes were also computed. According to Cohen , an effect size of at least 0.2 is recommended as the standard for supporting sensitivity to change.
Finally, the evaluative ability of the MADRS-S to discriminate between treatment groups was tested using an analysis of covariance (ANCOVA) model, predicting the mean MADRS-S change at week 8 from baseline, with investigator specialisation and treatment as factors, and baseline MADRS-S score as covariate. Perceived response rates, defined as a reduction of at least 50% from the baseline MADRS-S score at week 8, and perceived remission rates, defined using the cut-off value revealed in the ROC analysis, were also compared using a logistic model with the same explanatory factors and covariate as those used in the ANCOVA model described above.
Among the 280 patients, two (0.7%) refused to fill in the MADRS-S questionnaire and were excluded from the analyses. The mean patient age was 45.2 ± 11.0 years, 186 (66.9%) were females, 188 (67.6%) had a professional activity, and 218 (78.4%) lived in an urban area. One hundred and sixty-seven patients (60.1%) were recruited by psychiatrists; 137 patients (49.3%) were treated with escitalopram and the remaining 141 (50.7%) received citalopram.
Patients' clinical characteristics at baseline.
Overall Population (n = 278)
Age at first diagnosis of MDD, mean ± SD
39.5 ± 12.0
First episode of MDD, n (%)
History of psychiatric hospitalisation, n (%)
Clinical Global Impression of Severity, mean ± SD
5.1 ± 0.5
MADRS Total Score, mean ± SD
35.9 ± 4.5
MADRS Total Score ≥ 35, n (%)
Descriptive Statistics of the 9 MADRS-S Items and Total Score.
Mean ± SD
Item 1: Mood
1.86 ± 0.84
Item 2: Feelings of Unease
2.06 ± 0.63
Item 3: Sleep
1.94 ± 0.68
Item 4: Appetite
1.39 ± 0.93
Item 5: Ability to Concentrate
1.92 ± 0.66
Item 6: Initiative
1.91 ± 0.70
Item 7: Emotional Involvement
1.58 ± 0.75
Item 8: Pessimism
2.06 ± 0.72
Item 9: Zest for Life
1.44 ± 0.75
MADRS-S Total Score
16.2 ± 4.4
The results of the factor analysis confirmed the unidimensionality of the MADRS-S: each item contributed to the first factor axis with a factor loading of at least 0.50, explaining 45% of the total variance.
Clinical Discriminative Validity of the MADRS-S.
Mean ± SD
First episode of MDD
Yes (n = 153)
16.2 ± 4.4
No (n = 125)
16.1 ± 4.5
History of psychiatric hospitalisation
Yes (n = 46)
16.1 ± 5.1
No (n = 232)
16.2 ± 4.3
Severity of the current episode: Baseline MADRS ≥ 35
Yes (n = 160)
17.8 ± 4.0
No (n = 118)
14.0 ± 4.0
Internal consistency reliability of the MADRS-S was satisfactory, with a Cronbach's alpha of 0.84, allowing group comparisons. The deletion of any of the 9 items would not increase the internal consistency of the total score (Table 2).
Among the 120 patients whose CGI-I at week 1 was rated "No change" by physicians, the intraclass correlation coefficient was 0.78, indicating the satisfactory test-retest reliability of the MADRS-S.
Sensitivity to changes
In the sub-sample of 132 remitter patients (i.e. those whose MADRS total score at week 8 was less than or equal to 12), a statistically significant difference of -12.4 ± 4.2 points was found for the total MADRS-S between baseline and week 8. This difference led to an effect size of 2.8, which supported the sensitivity to change of the self-reported version of the MADRS.
When comparing the antidepressant effects of the two therapeutic strategies of the trial, we found that the mean MADRS-S score changes from baseline were in favour of escitalopram (-9.9 ± 5.1 for escitalopram versus -8.6 ± 5.9 for citalopram), the mean difference of 1.3 (standard error of 0.7) being statistically significant (p = 0.046). As a comparison, a mean MADRS difference of 2.1 was found between escitalopram and citalopram (p < 0.05).
The objective of this article was to investigate the psychometric properties of the MADRS-S, the patient-reported version of the MADRS. We demonstrated the validity, acceptability, reliability and sensitivity to change of the MADRS-S.
The lack of missing values illustrates good patient acceptance of the questionnaire, and indicates that it seems feasible to ask patients to rate their perception of nine symptoms of depression. Ceiling effects for six items were higher than floor effects, reflecting the initial severity level of the disease, as patients were only included in the study if they had a physician-reported MADRS score of at least 30. Results of the factor analysis supported the unique underlying concept assessed by the nine items. The reliability of the MADRS-S was satisfactory, with a test-retest intraclass correlation coefficient of 0.78 and a Cronbach's alpha of 0.84. Most importantly, the effect size of 2.8 in a sub-sample of improved patients after eight weeks of antidepressant treatment confirmed the ability of the scale to be sensitive to change, as is the original MADRS . These results clearly showed the ability of the patient-reported MADRS-S to detect differences between treatment regimens.
However, the association between physician and patient-reported scores was lower in our study (0.54) compared with those reported by Svanborg and Åsberg (0.70) , and by Mundt et al (0.82) . By comparison, Carroll et al  reported an association between the HDRS and the CRSD of 0.71. The more similar the scale, the higher the level of correlation found for assessment procedures (Mundt and colleagues compared the traditional clinician-rated MADRS with a telephone-based, interactive voice response technology); paper-and-pencil vs. interview-based ratings are known to only moderately correlate  and scales with slightly differing content and wording can be expected to show slightly lower correlations.
Patients were asked to fill the MADRS-S before any clinical assessments in order to provide the most accurate perception they have on their disease. It is noteworthy that response and remission rates based on the MADRS-S are always lower than those from the clinician-based MADRS, indicating that patients' and clinicians' perceptions of the disease are different, more complementary than redundant, and can provide additional useful information. This is of major interest for MDD management since taking into account patients' feelings may improve medication compliance, decrease time to symptom alleviation, and, as a result, improve patients' quality of life.
The growing focus on patient-reported outcomes  as a secondary endpoint in randomised clinical trials and the findings of our study lead us to recommend the concomitant use of the MADRS and MADRS-S during the development of new compounds.
H. Lundbeck A/S provided funding for this study through an unrestricted grant. The authors wish to thank Christophe Sapin, biostatistician, for his assistance in the statistical analysis of data and Mondher Toumi PhD, for his valuable support and input regarding the analyses conducted for this article.
- Coryell W, Scheftner W, Keller M, Endicott J, Maser J, Klerman GL: The enduring psychosocial consequences of mania and depression. Am J Psychiatry. 1993, 150 (5): 720-727.View ArticlePubMedGoogle Scholar
- Montgomery SA, Roberts A, Patel AG: Placebo-controlled efficacy of antidepressants in continuation treatment. Int Clin Psychopharmacol. 1994, 9 (suppl 1): 49-53. 10.1097/00004850-199403001-00008.View ArticlePubMedGoogle Scholar
- Bostwick JM, Pankratz VS: Affective disorders and suicide risk: a reexamination. Am J Psychiatry. 2000, 157 (12): 1925-1932. 10.1176/appi.ajp.157.12.1925.View ArticlePubMedGoogle Scholar
- American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders. 1994, Washington, DC: American Psychiatric Association, 4Google Scholar
- Committee for Proprietary Medicinal Products: Note for guidance on clinical investigation of medicinal products in the treatment of depression (CPMP/EWP/518/97, Rev 1). 2002, London: EMEAGoogle Scholar
- Thompson C, Peveler RC, Stephenson D, McKendrick J: Compliance with antidepressant medication in the treatment of major depressive disorder in primary care: a randomized comparison of fluoxetine and a tricyclic antidepressant. Am J Psychiatry. 2000, 157 (3): 338-43. 10.1176/appi.ajp.157.3.338.View ArticlePubMedGoogle Scholar
- Coon DW, Thompson LW: The relationship between homework compliance and treatment outcomes among older adult outpatients with mild-to-moderate depression. J Am Geriatr Psychiatry. 2003, 11: 53-61.View ArticleGoogle Scholar
- Trivedi MH, Pigotti TA, Perera P, Dillingham KE, Carfagno ML, Pitts CD: Effectiveness of low doses of paroxetine controlled release in the treatment of major depressive disorder. J Clin Psychiatry. 2004, 65 (10): 1356-64.View ArticlePubMedGoogle Scholar
- Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J: An inventory for measuring depression. Arch Gen Psychiatry. 1961, 4: 561-71.View ArticlePubMedGoogle Scholar
- Beck AT, Steer RA: Beck Depression Inventory Manual. 1993, San Antonio: Psychological CorporationGoogle Scholar
- Carroll BJ, Feinberg M, Smouse PE, Rawson SG, Greden JF: The Carroll rating scale for depression. I. Development, reliability and validation. Br J Psychiatry. 1981, 138: 194-200. 10.1192/bjp.138.3.194.View ArticlePubMedGoogle Scholar
- Smouse PE, Feinberg M, Carroll BJ, Park MH, Rawson SG: The Carroll rating scale for depression. II. Factor analyses of the feature profiles. Br J Psychiatry. 1981, 138: 201-4. 10.1192/bjp.138.3.201.View ArticlePubMedGoogle Scholar
- Feinberg M, Carroll BJ, Smouse PE, Rawson SG: The Carroll rating scale for depression. III. Comparison with other rating instruments. Br J Psychiatry. 1981, 138: 205-9. 10.1192/bjp.138.3.205.View ArticlePubMedGoogle Scholar
- Svanborg P, Asberg M: A comparison between the Beck Depression Inventory (BDI) and the self-rated version of the Montgomery-Asberg Depression Rating Scale (MADRS). J Affect Dis. 2001, 64 (2-3): 203-16. 10.1016/S0165-0327(00)00242-1.View ArticlePubMedGoogle Scholar
- Reynolds WM, Kobak KA: Reliability and validity of the Hamilton Depression Inventory: a paper-and-pencil version of the Hamilton Depression Rating Scale clinical interview. Psychol Assessm. 1995, 7 (4): 472-83. 10.1037/1040-35126.96.36.1992.View ArticleGoogle Scholar
- Rush AJ, Trivedi MH, Ibrahim HM, et al: The 16-item Quick Inventory of Depression Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression. Biol Psychiatry. 2003, 54 (5): 573-83. 10.1016/S0006-3223(02)01866-8.View ArticlePubMedGoogle Scholar
- Lambert MJ, Hatch DR, Kingston MD, Edwards BC: Zung, Beck, and Hamilton Rating Scales as measures of treatment outcome: a meta-analytic comparison. J Consult Clin Psychol. 1986, 54 (1): 54-9. 10.1037/0022-006X.54.1.54.View ArticlePubMedGoogle Scholar
- Hamilton M: A rating scale for depression. J Neurol Neurosurg Psychiatry. 1960, 23: 56-62. 10.1136/jnnp.23.1.56.View ArticlePubMedPubMed CentralGoogle Scholar
- Montgomery SA, Asberg M: A new depression scale designed to be sensitive to change. Br J Psychiatry. 1979, 134: 382-9. 10.1192/bjp.134.4.382.View ArticlePubMedGoogle Scholar
- Moore N, Verdoux H, Fantino B: Prospective, multicentre, randomized, double-blind study of the efficacy of escitalopram versus citalopram in outpatient treatment of major depressive disorder. Int Clin Psychopharmacol. 2005, 20 (3): 131-7. 10.1097/00004850-200505000-00002.View ArticlePubMedGoogle Scholar
- Guy W: Clinical Global Impressions. NCDEU Assessment Manual for Psychopharmacology. Edited by: Guy W. 1976, Rockville: National Institute of Health, 217-22.Google Scholar
- SAS Institute: SAS/Stat User's Guide version 8.2. 1999, Cary: SAS Institute IncGoogle Scholar
- Essink-Bot ML, Krabbe PF, Bonsel GJ, Aaronson NK: An empirical comparison of four generic health status measures: the Nottingham Health Profile, the Medical Outcomes Study 36-Short-Form Health Survey, the COOP/WONCA Charts, and the EuroQol Instrument. Med Care. 1997, 35 (5): 522-37. 10.1097/00005650-199705000-00008.View ArticlePubMedGoogle Scholar
- McHorney CA, Ware JE, Lu JF, Sherbourne CD: The MOS 36-item short-form health survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patients groups. Med Care. 1994, 32 (1): 40-66. 10.1097/00005650-199401000-00004.View ArticlePubMedGoogle Scholar
- Kerlinger FN: Foundation of Behavioral Research. 1964, New York: Holt, Rinehart & WinstonGoogle Scholar
- Nunnally JC: Psychometric Theory. 1994, New-York: Mc Graw-Hill, 3Google Scholar
- Cohen J: Statistical power Analysis for the Behavioral Sciences. 1988, Hillsdale: Lawrence Erlbaum Associates, 19-74. 2Google Scholar
- Mundt JC, Katzelnick DJ, Kennedy SH, et al: Validation of an IVRS version of the MADRS. J Psychiatr Res. 2006, 40 (3): 243-6. 10.1016/j.jpsychires.2005.05.002.View ArticlePubMedGoogle Scholar
- Murray E: Measurement issues in the evaluation of psychopharmacological therapy. The limits of Biological Treatments for Psychological Distress. Edited by: Fisher S, Greenberg RP. 1989, Hillsdale: Erlbaum, 39-68.Google Scholar
- Chassany O, Sagnier P, Marquis P: Patient-reported outcomes. The example of health-related quality of life – a European guidance document for the improved integration of health-related quality of life assessment in the drug regulatory process. Drug Inf J. 2002, 36: 1-10.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/9/26/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.