The Adolescent Depression Rating Scale (ADRS): a validation study
BMC Psychiatry volume 7, Article number: 2 (2007)
To examine the psychometric properties of the Adolescent Depression Rating Scale (ADRS), a new measure was specifically designed to evaluate adolescent depression.
The 11-item clinician-report and 44-item self-report versions of the ADRS were developed from a qualitative phase involving interviews of experts and adolescents. These two instruments were then administered to 402 French speaking adolescents with and without depressive disorders. Item distribution, internal consistency, convergent validity, discriminant validity and factorial structure were assessed.
After reduction procedures, a 10-item clinician version and a 10-item self-report version were obtained. The ADRS demonstrated good internal consistency (alpha Cronbach coefficient >.70). It also discriminated better between adolescents with and without depression than the Hamilton Depressive Rating Scale and the Beck Depression Inventory (BDI-13).
The ADRS is a useful, short, clinician-report and self-report scale to evaluate adolescent depression. Further studies to replicate our findings and evaluate ADRS sensitivity to effects of treatment and psychometric properties in populations of adolescents with several psychiatric disorders are warranted.
Standardized diagnostic criteria for depression have raised several questions regarding the classification of adolescents with depression. In fact, dichotomizing the population into cases and non-cases does not take into account that a substantial proportion of depressed adolescents have sub-syndromal depressive symptomatology . Yet these young people have significant morbidity and are at high risk of developing full-blown major depression .
Recent findings [4, 24] support the view that measures of depression in adolescence are best implemented in a dimensional model, where depressive disorders are conceptualized as a continuum of severity, from mild to severe. Thus, subjects who meet DSM-IV diagnostic criteria for MDD  represent the extreme of a continuum rather than a distinct group .
The feasibility of clinical trials in adolescent populations depends on the availability of valid measures . In fact, many studies have utilized depression scales despite limited data regarding their validity with young people. For adolescents aged 13 and older, the most widely used self-reports include the Centre for Epidemiological Studies Depression Scale (CES-D)  and the Beck Depression Inventory (BDI) . Likewise, the most frequently used clinician reports include the Hamilton Depression Rating Scale (HDRS) [8, 9], the Montgomery-Asberg Depression Rating Scale (MADRS) , and the Children's Depression Rating Scale CDRS-R . However, these instruments are not specific to adolescents, lack construct validity, and have limited or unknown reliability and validity in this age group [12–14].
Following the dimensional perspective outlined by Fergusson, the main aim of our study was to design and validate a dimensional scale, the Adolescent Depression Rating Scale (ADRS) to quantify the intensity of depression in adolescents aged from 13 to 20 years. On the basis of recommendations by Myers and Winters [13, 14] (construct validity as the core of depression rating scale development, the use of two scales – self report and clinician versions – to obtain a robust measure, both having short forms to facilitate reiterated and longitudinal assessments), the decision was made to develop two versions of the ADRS: a self-report and a clinician-report instrument. The clinician-report ADRS is designed to be used in clinical and research settings and the self-report ADRS for epidemiological studies.
This paper reports on the validation of the French version of the ADRS. This validation is based on a multi-centre study in France, Belgium and Switzerland. A validation study is presently in progress for the English, Spanish, Chinese, Arabic, and Hebrew versions of the instrument.
The first phase was qualitative and designed for item generation and construction; it was based on four steps:
1. Apprehension of depression in adolescents via detailed exploration of the literature (Medline, PsycInfo, from June 1993 to June 2003, keywords: adolescent, depressive disorders, psychometrics, rating scales).
2. Qualitative studies on research interviews of 11 experienced clinicians in adolescent psychiatry (from 15 to 25 years of experience in adolescent psychiatry) and 5 depressed adolescents, to identify facets of adolescent depression (question grid in Annex, see additional file 1). The task was 1/to apprehend psychiatrists' representations of depressive disorders in adolescents, 2/to get an idea of experiences and practice, 3/to describe decisional steps for each clinician, 4/to apprehend in as neutral a manner as possible the symptomatic expression of the depressive experience, from the adolescent patient verbatim. These qualitative data were analyzed using an adaptation of Colaizzi's method , pinpointing the categories of depressive experience that emerged from the interviews. Features identified were grouped into themes, and then into theme clusters with common traits, and finally into more general categories. Depression in adolescents appeared as a complex emotional state, involving irritability, a feeling of being overwhelmed by the depressive experience, negative perceptions of self, thoughts about death; it was also found to involve non-emotional manifestations: mental slowness, sleep disturbances, and manifestations through social interactions at school, in work, in leisure, and in relationships with others.
3. Construction of the measure on the basis of the two previous steps: drafting of the items, and selection of items using a consensus method.
The ADSR was constructed using the three domains derived from the qualitative phase : 1) emotional state involving irritability, a feeling of being overwhelmed by the depressive experience, negative perceptions of self, and thoughts about death; 2) non-emotional manifestations involving mental slowing, and sleep disturbances; 3) clinical manifestations through social interactions at school, in work and leisure, and in relationships with others. Two initial versions of the ADRS were constructed: 1) an 11-item clinician-report scale, the ADRS initial version for clinicians (ADRSic) with depression severity rated on a 7-point Likert scale from none to severe, for the previous two weeks; 2) a 44-item self-report scale, the ADRS initial version for patients (ADRSip) with true/false responses (Table 1).
An instruction manual was drafted for the ADRSic (Annex, see additional file 1).
Sample and instruments
Four-hundred and nine adolescents, aged 13–20 years, who attended outpatient clinics or were hospitalized between November and May 2004 at 15 medical centres in France, in Brussels (Belgium) and in Geneva (Switzerland) were included. The patients recruited were all receiving treatment but not necessarily for depression: they were attending either a psychiatric clinic or an adolescent medicine clinic (80%; 20%).
Subjects with mental retardation or psychosis were excluded. To widen our data to subjects with different levels of depression, care was taken to include a population with a wide range of disorders and different levels of depressive severity, from none to severe.
All investigators were senior child and adolescent psychiatrists who were trained and supervised by the principal investigator (ARL) to administer the ADRSic. During the first interview, subjects and their parents were introduced to the nature of the study and asked to sign the consent form. Since this validation study was only observational, according to French law no authorization from an ethics committee was necessary.
All adolescents completed the BDI 13-item version  and the ADRSip (44 items). The investigators completed the ADRSic (11 items), the HDRS 17-item version [8, 9], and the Clinical Global Impression Scale (CGI) severity scale . Following this, the investigators were asked to answer a question requiring a clinical judgment by the investigator: "Based on your experience, do you consider that this patient is depressed? Does he/she require treatment for this aspect of his/her psychopathology?" Finally, based on the clinical interview, the investigators completed the DSM-IV criteria for MDD.
The two variables DSM-IV criteria for MDD (Yes/No) and clinical judgment (Yes/No) were then used to classify patients in 3 groups:
1) No depression: the patients did not meet DSM-IV criteria for MDD and were not considered clinically depressed by the investigator.
2) Intermediate group: the patients did not meet the DSM-IV criteria for MDD, but they were considered clinically depressed according the clinical judgment. These patients were experiencing a form of depression other than MDD.
3) Depression: the patients met DSM-IV criteria for MDD and were judged clinically depressed.
As mentioned above, since we were interested in evaluating the ability of the ADRS to ascertain depressive symptomatology in different levels of depression, the analyses of our data were performed for these three groups.
First, an item analysis was carried out on the initial versions, with a close inspection of the distribution of each item to detect any floor or ceiling effect, or any item redundancy.
Internal consistency was measured by means of the Cronbach coefficient. Concurrent validity was assessed by Pearson correlations computed between the HDRS, CGI, BDI and the ADRSp and ADRSc scores after item reduction.
The factorial structure of the ADRS initial and final versions was studied with a maximum likelihood factor analysis with Varimax rotation. The number of factors was determined from the observation of the screeplot, eigenvalues greater than one, and from the clinical interpretability of factors [17, 18].
Using multiple group confirmatory factor analysis, the stability of the structure of the ADRS final versions was studied in relation to age, gender, and depression groups.
To assess the optimal cut-off scores derived from the total score so as to discriminate between levels of depression, the receiver operator curve (ROC) method was used . Sensitivity and specificity were computed.
The ability of the ADRS final versions to discriminate among the different diagnostic groups was explored by computing the effect sizes across the three groups of patients defined according to level of depression. HDRS, CGI, BDI and the ADRSc and ADRSp versions were compared on this basis. The pairwise statistical comparison of these effect sizes was performed using a bootstrap procedure .
The "minimum clinically relevant differences" in ADRSc and ADRSp scores were estimated from the slope coefficient of the linear regression of ADRS on CGI .
Statistical analyses were performed using the R 2.0 package with "psy" and "mva" packages. Most psychometric analyses were replicated by a second statistician using SAS 8.2. Multiple group confirmatory factor analysis was performed with Mplus 2.1 .
Four-hundred and two adolescents aged 16.5 (sd 2.0), 125 males (mean age 16.5 (sd 1.8)), 277 girls (mean age 16.6 (sd 1.9)) were assessed. One-hundred and twenty-six patients were depressed (mean age 16.4/sd 1.9; 32 males, 94 girls), 139 patients had a depressive experience but no MDD (mean age 16.6 (sd 1.8); 45 males; 94 girls) and 137 patients were not depressed (mean age 16.7 (sd2.1); 48 males, 89 girls). Seven patients out of 409 patients initially included were dropped because of missing data.
For both clinician and self-report initial versions of the ADRS, the proportion of missing data per item was low (<5%). There was no item responses with floor effect >50%, or ceiling effect >50%. Inter-item correlation was <0.70, meaning there was no redundancy.
For the initial version of the clinician-report ADRS over the whole sample of patients, the screeplot is in favour of a uni-dimensional instrument, since 44% of variance is contained in the first principal component while a second eigenvalue is approximately equal to 1 (1.05). This justifies the use of a single score as a summation of all items. To explore structure more precisely a factor analysis was conducted for a 2-factor solutions. This solution was clinically interpretable, with a factor that could be related to an "internal negative state" including irritability, feelings of being overwhelmed, negative perception of self, ideas of death, sleep disturbances and the empathetic perceptions of the clinician; and a second factor grouping "external manifestations" (including school, leisure activities and relationships). Most items were clearly attributable to a single factor except for the item "clinging relationships". Since this item was sometimes found difficult to rate by some investigators, it was discarded. On the remaining 10-item ADRSc (table 3), a new series of factor analyses was performed across the 3 groups defined according to a level of depression (table 4).
The stability of the two-factor solution was tested across age (under 16 or 16 and over), gender, and level of depression. There was no gender effect on the structure of the two versions of the ADRS. Factor loadings were however statistically significantly different across age and depression groups (all p values < 0.05).
Overall, the results are similar for the initial patient-report ADRS, especially with regard to the structure of the instrument. However, to be useful in epidemiological studies a self-report measure should be of a limited size. Therefore an item reduction procedure was carried out on the initial 44-item self-report. Items were removed on the basis of clinical considerations (clinical importance of the item itself), but also on the basis of readability, relevance, redundancy, item distribution across the different domains of the depressive experience derived from the qualitative phase, and statistical considerations (loading < 0.4, inter-item correlation > 0.6).
This procedure yielded a 10-item instrument, ADRSp (table 2). A factor analysis conducted on this shorter instrument confirmed a two-factor structure comparable to the structure of the clinician version reported above (table 5). We present the Factor analysis of the final ADRSc and ADRSp for the three groups of the sample.
Scale internal consistency
The internal consistency of the two final versions of the ADRS was good. The Cronbach alpha coefficient for ADRSp was 0.74 in the non-depressed group; 0.74 for the intermediate group and 0.79 for depression group. For the ADRSc, the Cronbach alpha was 0.78 in the non-depressed group, 0.75 for the intermediate group and 0.75 for the depression group
All instruments were significantly correlated. As shown in table 6, Pearson correlation coefficients between ADRSc and the HDRS, BDI and the CGI ranged from 0.62 to 0.8 (all p-values < 0.05). Pearson correlations between the ADRSp and the HDRS, BDI and the CGI ranged from 0.51 to 0.83 (all p-values < 0.05).
It is noteworthy that the CGI ratings are more strongly correlated with the ADRS (self or clinician-rated) than with the HDRS or the BDI-13 (statistically significant with a bootstrap procedure).
Discriminant validity: contrasted groups
As shown in Table 7, effect sizes of the HDRS, BDI, ADRSc and ADRSp were compared among the three groups. These effect sizes are intended to assess the sensitivity of the ADRS in differentiating groups with and without depression. The ADRSp shows a larger effect size than the BDI. This difference was statistically significant at the 5% level in differentiation of the non-depressed and depressed groups (including intermediate group). The ADRSc shows a larger effect size than the HDRS, and this difference was statistically significant in differentiating the groups [no depression] and [intermediate depression + depression] and in differentiating the groups [no depression + intermediate depression] and [depression].
Receiver operator curve analysis: sensitivity and specificity
The optimal cut-off point was determined by plotting sensitivity versus specificity for each possible cut-off and examining the point that maximized the summation of sensitivity and specificity. Here, two binary "gold standards" can be proposed to compute sensitivity and specificity: depression according the clinical judgment, or depression according to both clinical judgment and DSM-IV. Both analyses were performed. For the ADRSp, the cut-off corresponding to the clinical judgment of depression was 3 and the cut-off corresponding to the DSM-IV was 4. For the ADRSc, these cut-offs were 15 and 20, respectively. Sensitivity and specificity are reported in table 7.
Minimum clinically relevant difference
Finally, minimum clinically relevant variations in score on a scale are of major interest when interpreting results of clinical trials or epidemiological studies. This minimum variation can be estimated from the slope coefficient of the linear regression of ADRS on CGI (Norman et al. 2001) (Table 7). As a rule-of-thumb, a variation of 5 points on the ADRSc may be considered as the minimum clinically important difference, while a variation of 1 point is clinically important for the ADRSp.
Discussions and conclusions
The purpose of this study was to develop and validate a depression scale especially designed for adolescents. Our study showed that both the clinician and self-report versions of the ADRS had acceptable psychometric properties with good convergent, discriminant, and factorial validity, and good internal consistency.
The final 10-item versions of the clinician-report and self-report ADRS yielded two factors: "internal state" (items: irritability, overwhelmed by depression, negative perceptions of self, ideas of death, sleep and "external manifestations" (mental slowness, implication in school, leisure activities, relationships) (table 2). The factorial structure of the ADRS reinforces the construct validity of the scale since it is consistent with the preliminary qualitative phases of the development the ADRS scales. Depression in adolescents did indeed appear as a complex emotional state, involving irritability, a feeling of being overwhelmed by the depressive experience, negative perceptions of self, thoughts about death; this is accompanied by non-emotional manifestations: mental slowness, sleep disturbances, and manifestations through social interactions at school, work, in leisure, and in relationships with others.
From the psychometric point of view, the non-emotional manifestations are divided into two types: one is linked to the complex emotional state and forms the dimension "Internal state", the other is linked to manifestations through social interactions and forms the dimension "External manifestations". Internal state and external manifestations are dimensions that are already well known in depression, and they are described here in a way that is specific to adolescence. Although deficiencies in social relationships are not included in the definition of depression, any exploration of depression should place strong emphasis on the impact of social skill deficits and dysfunctional interpersonal behaviours .
It can be noted that in the ADRS the item "leisure" in the clinician version and the item "nothing really interests me or entertains me" in the self-report version explore manifestations of anhedonia, and the item "negative self-perception" explores one facet of a symptom often pointed to in depression: feelings of worthlessness. Recently, Wilcox and Anthony ) reported that persistent anhedonia during childhood or adolescence-was 17 times more prevalent in a sample of male adults with major depressive disorder than in a sample of controls, and this figure increased to 31–32 times in females. Feelings of worthlessness in childhood and adolescence were also associated with major depressive disorder in adulthood. Pine  and Murphy , also pointed to the prognostic significance of persistent anhedonia when it appears before early adulthood.
From a public health standpoint, identifying specific early clinical features might make it possible to provide anticipatory guidance or other early interventions that could prevent or reduce the impact of depressive disorders. In addition, the small number of items in the ADRS self-report involves little respondent burden, thereby allowing it to be combined with other short instruments that screen for different mental health conditions, enabling its use in epidemiological studies.
The results of this study need to be considered in light of the following limitations. First, only five adolescents were interviewed in the qualitative phase, this may be considered as a small number, even if a saturation of the verbatim collected appeared at this stage. Second, the sample under study was made up of psychiatric and medical outpatients or inpatients at multiple sites, even if this heterogeneity may be interesting in terms of generalisability, it may be criticised on scientific grounds. The strategy used to classify patients in the sample needs also to be discussed. A dimensional scale must be able to assess different levels of depression ranging from none to severe, for instance in clinical trials before and after treatment. Thus in our sample, three groups of depressive experience were formed: the non-depressed group, the intermediate group comprising patients who were depressed but not MDD (without consideration of the categories of depression), and the MDD group. We took the MDD form as the most severe form of depressive experience [4, 24].
Other limitations must be noted. Inter-rater agreement was not measured in this first validation study. Also, since there is substantial overlap between anxiety and depressive symptomatology, subsequent studies should evaluate whether the ADRS differentiates between young people suffering from anxiety alone and those with depression . These two points will be studied in a second validation step.
Finally, no standardized instruments were used to assess subjects' psychopathology. However, all interviewers were senior psychiatrists with vast experience in assessing and treating children with psychiatric disorders. In addition, to diagnose MDD they used the DSM-IV criteria. Perhaps a replication study could implement standardized strategies to classify the patients according to depression categories and to explore co-morbidities.
The ADRSp and ADRSc have been designed and validated in French (in France, Belgium and Switzerland). Translations have been made into English (Canadian, American, British), Spanish, Italian, Arabic and Hebrew. Back-translations have been performed for all these versions, and problems remain with the Arabic and Hebrew versions of the ADRSc and the English version of the ADRSp.
Lewinsohn PM, Solomon A, Seeley JR, Zeiss A: Clinical implications of "subthreshold" depressive symptoms. J Abnorm Psychol. 2000, 109: 345-351. 10.1037/0021-843X.109.2.345.
Lewinsohn PM, Rohde P, Seeley JR, Klein DN, Gotlib IH: Natural course of adolescent major depressive disorder in a community sample: predictors of recurrence in young adults. Am J Psychiatry. 2000, 157: 1584-1591. 10.1176/appi.ajp.157.10.1584.
APA: Diagnostic and Statistical Manual of Mental Disorders Fourth Edition Revision DSM-IV-R. Edited by: Association AP. 1994, Arlington, APA
Fergusson DM, Horwood LJ, Ridder EM, Beautrais AL: Subthreshold depression in adolescence and mental health outcomes in adulthood. Arch Gen Psychiatry. 2005, 62: 66-72. 10.1001/archpsyc.62.1.66.
McClellan JM, Werry JS: Evidence-based treatments in child and adolescent psychiatry: an inventory. J Am Acad Child Adolesc Psychiatry. 2003, 42: 1388-1400.
Radloff LS: The CES-D scale: A self report depression scale for research in the general population. App Psychol Measur. 1977, 1: 385-401.
Beck AT: An inventory for measuring depression. Archives of General Psychiatry. 1961, 561-571.
Hamilton M: A rating scale for depression. J Neurol Neurosurg Psychiatry. 1960, 23: 56-62.
Hamilton M: Development of a rating scale for primary depressive illness. Br J Soc Clin Psychol. 1967, 6: 278-296.
Montgomery SA, Asberg M: A new depression scale designed to be sensitive to change. Br J Psychiatry. 1979, 134: 382-389.
Poznanski EO, Grossman JA, Buchsbaum Y, Banegas M, Freeman L, Gibbons R: Preliminary studies of the reliability and validity of the children's depression rating scale. J Am Acad Child Psychiatry. 1984, 23: 191-197.
Brooks SJ, Kutcher S: Diagnosis and measurement of adolescent depression: a review of commonly utilized instruments. J Child Adolesc Psychopharmacol. 2001, 11: 341-376. 10.1089/104454601317261546.
Myers K, Winters NC: Ten-year review of rating scales. I: overview of scale functioning, psychometric properties, and selection. J Am Acad Child Adolesc Psychiatry. 2002, 41: 114-122. 10.1097/00004583-200202000-00004.
Myers K, Winters NC: Ten-year review of rating scales. II: Scales for internalizing disorders. J Am Acad Child Adolesc Psychiatry. 2002, 41: 634-659. 10.1097/00004583-200206000-00004.
Colaizzi PF: Psychological research as the phenomenologist views it. Existential phenomenological alternative for psychology. Edited by: Press OU. 1978, New York, Vails, R.,& King, M
Guy W, Bonato RR: CGI: Clinical Global Impressions. Manual for the ECDEU Assessment Battery2 Rev ed. 1976, Rockville, Chevy Chase, Md: National Institute of Mental Health
Catttell RB: The scree test for the number of factors. Multivariate Behavioral Research. 1966, 1: 245-276. 10.1207/s15327906mbr0102_10.
Guttman L: Some necessary conditions for factor common analysis. Psychometrika. 1954, 149-161. 10.1007/BF02289162.
Swets JA: Measuring the accuracy of diagnostic systems. Science. 1988, 240: 1285-1293. 10.1126/science.3287615.
Efron B, Tibshirani RR: An introduction to bootstrap. 1993, Chapman and Holl
Norman GR, Sridhar FG, Guyatt GH, Walter SD: Relation of distribution- and anchor-based approaches in interpretation of changes in health-related quality of life. Med Care. 2001, 39: 1039-1047. 10.1097/00005650-200110000-00002.
Muthen LK, Muthen BO: Mplus. Edited by: 2.1. 2002, Los Angeles,
Weissman MM, Wolk S, Goldstein RB, Moreau D, Adams P, Greenwald S, Klier CM, Ryan ND, Dahl RE, Wickramaratne P: Depressed adolescents grown up. Jama. 1999, 281: 1707-1713. 10.1001/jama.281.18.1707.
Wilcox HC, Anthony JC: Child and adolescent clinical features as forerunners of adult-onset major depressive disorder: retrospective evidence from an epidemiological sample. J Affect Disord. 2004, 82: 9-20. 10.1016/j.jad.2003.10.007.
Pine DS, Cohen E, Cohen P, Brook J: Adolescent depressive symptoms as predictors of adult depression: moodiness or mood disorder?. Am J Psychiatry. 1999, 156: 133-135.
Murphy H, Dickens C, Creed F, Bernstein R: Depression, illness perception and coping in rheumatoid arthritis. J Psychosom Res. 1999, 46: 155-164. 10.1016/S0022-3999(98)00073-7.
Birmaher B, Brent DA, Chiappetta L, Bridge J, Monga S, Baugher M: Psychometric properties of the Screen for Child Anxiety Related Emotional Disorders (SCARED): a replication study. J Am Acad Child Adolesc Psychiatry. 1999, 38: 1230-1236. 10.1097/00004583-199910000-00011.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/7/2/prepub
The study has been founded by the Assistance Publique-Hôpitaux de Paris (grant number CRC03020, AP-HP 2003).
ARL has been paid by this grand for the coordination of the project.
The other authors did not receive any financing for their participation to this work.
The authors would like to acknowledge the member of the ADRS European validation group for the acquisition of data in France (Dr. F Atger, Dr. I. Atger, Dr. P. Benoit, Dr. O Bricou, Dr. S. Campredon, Dr. T. Chaltiel, Dr. J. Chambry, Dr. D. Cohen, Dr. B. Dutray, Dr. P. Gerardin, Dr. O. Ginoux, Dr. O. Guilbaud, Dr. F. Lamidié, Pr. M.R. Moro, Dr. S. Pavoine, Dr. J. Payet, Dr. D. Périsse, Dr. M. Terral, Dr. A. Tuset and Dr. E. Weiss), in Belgium (Pr. V. Delvenne, Dr. A. François, D.r H. Nicolis and Pr. N. Zdanowicz) and in Switzerland (Dr. F. Narring and Dr. A. Meynard)
The author(s) declare that they have no competing interests.
ARL: initiation of the research, study concept and design, performing statistical analyses, interpretation of data, drafting the manuscript. This study was conducted as a thesis project for ARL under the supervision of BF.
BB and IG: participation in the interpretation of the results, and revision of the draft paper
BF: supervision of the statistical analysis and revision of the draft paper
All authors read and approved the final manuscript.
Electronic supplementary material
Additional File 1: Annex. The text provided comprises: A – Question grid: list of the questions used for semi-structured interview of the qualitative phase (patient and clinician version). B – Interview guide of the ADRSc (clinician version) (DOC 34 KB)
About this article
Cite this article
Revah-Levy, A., Birmaher, B., Gasquet, I. et al. The Adolescent Depression Rating Scale (ADRS): a validation study. BMC Psychiatry 7, 2 (2007). https://doi.org/10.1186/1471-244X-7-2