Validation of the depression anxiety stress scales (DASS) 21 as a screening instrument for depression and anxiety in a rural community-based cohort of northern Vietnamese women
© Tran et al.; licensee BioMed Central Ltd. 2013
Received: 17 October 2012
Accepted: 11 January 2013
Published: 12 January 2013
Depression and anxiety are recognised increasingly as serious public health problems among women in low- and lower-middle income countries. The aim of this study was to validate the 21-item Depression Anxiety and Stress Scale (DASS21) for use in screening for these common mental disorders among rural women with young children in the North of Vietnam.
The DASS-21 was translated from English to Vietnamese, culturally verified, back-translated and administered to women who also completed, separately, a psychiatrist-administered Structured Clinical Interview for DSM IV Axis 1 diagnoses of depressive and anxiety disorders. The sample was a community-based representative cohort of adult women with young children living in Ha Nam Province in northern Viet Nam. Cronbach’s alpha, Exploratory Factor Analyses (EFA) and Receiver Operating Characteristic (ROC) analyses were performed to identify the psychometric properties of the Depression, Anxiety, and Stress subscales and the overall scale.
Complete data were available for 221 women. The internal consistency (Cronbach’s alpha) of each sub-scale and the overall scale were high, ranging from 0.70 for the Stress subscale to 0.88 for the overall scale, but EFA indicated that the 21 items all loaded on one factor. Scores on each of the three sub-scales, and the combinations of two or three of them were able to detect the common mental disorders of depression and anxiety in women with a sensitivity of 79.1% and a specificity of 77.0% at the optimal cut off of >33. However, they did not distinguish between those experiencing only depression or only anxiety.
The total score of the 21 items of the DASS21-Vietnamese validation appears to be comprehensible and sensitive to detecting common mental disorders in women with young children in primary health care in rural northern Vietnam and therefore might also be useful to screen for these conditions in other resource-constrained settings.
KeywordsScreening Depression Anxiety Validation Women Vietnam
Depression and anxiety are the common non-psychotic mental disorders experienced most frequently by women living in resource-constrained low and lower-middle income countries [1, 2]. Early detection of these problems in primary health care is essential to identifying women who might be offered targeted treatments and therefore to improving prognosis among them and reducing disability in the community . As the competing health priorities of infectious illness and malnutrition are diminishing in these settings, awareness of mental health is growing. There is an increasing need for screening tools, which primary health care staff can use, to identify people experiencing common mental disorders in the community.
The relationship between depression and anxiety has been of longstanding interest to clinicians and researchers. Clark and Watson  proposed a tripartite model of anxiety and depression. This model suggests that both conditions share several symptoms of elevated negative effect (e.g. distress and irritability). Depression is characterised by low levels of positive effect including experiences of happiness, confidence, and enthusiasm, while physiological hyperarousal is unique to anxiety. Even though depression and anxiety are conceptually distinct, there is substantial overlap between the two states that makes them difficult to distinguish in screening.
The Depression Anxiety and Stress Scales (DASS, ) is a widely used screening tool to assess symptoms of depression, anxiety, and stress in community settings. This instrument comprises three sub-scales: (1) the Depression sub-scale which measures hopelessness, low self-esteem, and low positive affect; (2) the Anxiety scale which assesses autonomic arousal, musculo-skeletal symptoms, situational anxiety and subjective experience of anxious arousal; and (3) the Stress scale which assesses tension, agitation, and negative affect. There are two forms of the DASS, the full 42-item and the short 21-item versions. Both assess the same domains.
There is evidence of the validity of the DASS for the use in both clinical and community settings in English-speaking countries including Australia [6, 7], the United States of America , Canada , and England . This tool has also been translated and validated in other languages including Chinese , Malay , Italian , and Spanish . Both English and non-English versions have high internal consistency (Cronbach’s alpha scores of > 0.7). Previous investigations in English-speaking and non-English-speaking countries have found significant correlations between DASS scores and other measures including the Beck Anxiety and Beck Depression Scales (correlation coefficients, r, ranged from 0.58 to 0.78, ), the Positive and Negative Affect Scale (r = 0.69, ), and Symptom Checklist-90-R (r ranged from 0.57 to 0.84, ). However, there has not yet been a validation study of the DASS21 against a clinical diagnostic test to propose and verify cut-off scores to detect common mental disorders.
There is only a small set of psychometric instruments to detect symptoms of common mental disorders that have been validated for use in Vietnam. Our team has established the psychometric properties of Zung’s Self-rated Anxiety Scale, the Edinburgh Postnatal Depression Scale, and General Health Questionnaire 12 items for screening for common mental disorders including depression and anxiety during pregnancy and in the postpartum year  and the Self Reporting Questionnaire-20 items to establish psychiatric caseness in adult women . The Depression Anxiety and Stress Scale is a brief screening instrument, which is of particular value because it can assess multiple domains and is psychometrically sound in Anglophone and no-Anglophone settings, but its comprehensibility and psychometric properties in resource-constrained countries have not yet been established .
The aim of this study was to establish the comprehensibility and psychometric properties including internal reliability and criterion validity of the Depression, Anxiety and Stress Scale as a screening instrument for depression and / or anxiety in women with young children living in rural northern Vietnam.
The study used the gold-standard design for scale validation of comparing the responses to the instrument with an independently administered diagnostic interview.
Participants were women living in Ha Nam Province in rural northern Viet Nam who had participated in a prior study  which established the prevalence and determinants of perinatal common mental disorders among them and had agreed to be informed about subsequent follow up studies. Ha Nam is a rural province located approximately 50 km south of Hanoi, the national capital. Ha Nam has a population of 0.8 million inhabitants and, in 2011, an average annual per capita income of USD800. Most people earn income from rice farming and making handcrafts and some are employed in local industries. The original study recruited women in Ha Nam through a two-stage sampling procedure. First, six communes were selected randomly by an independent statistician from a list of all 108 rural communes in the province as study sites. Communes are the primary administrative subdivisions in Vietnam and each has a population of about 5,000 to 10,000 people in Ha Nam. In each study site, all women registered with the commune health centres in the previous month as being either at least 7 months pregnant or between the fourth and eighth week postpartum were eligible and invited to participate in the study. Finally, 234 perinatal women were recruited in the original study with a recruitment fraction of 92%. They constituted a representative sample of women with young children in this province. This validation study was initiated eighteen months after data collection for the prior study had been completed.
DASS21 sub-scale severity ratings suggested for Australian
It was validated against individual psychiatrist-administered Structured Clinical Interviews for DSM IV Axis 1 Diagnoses (SCID) modules for depression (mild, moderate, and severe Major Depression or Dysthymia) and anxiety (Generalised Anxiety Disorder and Panic Disorder) in this study .
The DASS21 was translated from English into Vietnamese, reviewed by a group of health professionals and research workers for appropriateness of language and cultural idioms and back-translated to English for verification. Participants completed the DASS21-V as an individual structured interview with a trained health researcher. In a separate process, a Vietnamese psychiatrist administered SCID interviews on the same day. All participants completed both interviews in private rooms at the commune health station on the on the same day. The psychiatrist was blinded to scores on the DASS21 and vice versa. Data collection was carried out in February 2008.
Cronbach’s alpha coefficients were calculated to measure the internal reliability for each sub-scale with a cut-off of 0.7 used to indicate high internal reliability. Exploratory Factor Analyses utilizing Varimax rotation (EFAs) were performed to investigate the internal structure of all items and of each sub-scale. The criterion chosen to determine that an extracted factor accounted for a reasonably large proportion of the total variance was based on an eigenvalue greater than one . The significance of an item factor loading was set at a coefficient level of 0.30 or greater .
Medians and interquartile ranges of DASS21 sub-scale scores and all items were calculated by diagnostic groups due to the skewed distributions. Nonparametric K-sample tests were performed to test the equality of medians. The Area Under the ROC Curves (AUROC) were calculated to determine the overall performance and optimal cut-offs of the sub-scales to predict depression, anxiety or both (common mental disorders, CMD) diagnosed by SCID. In this study, the criteria to select optimal cut-offs were (1) to maximize both Sensitivity (Se) and Specificity (Sp) and (2) to detect all potential cases by setting Se higher than Sp . Data were analysed in STATA version 11 (StataCorp LP, College Station, Texas, United States of America, 2009).
The study was approved by the University of Melbourne’s Human Research Ethics Committee and the Viet Nam Medical Association’s Scientific Committee. Participants were given a small gift to the value of USD5 in recognition of their time away from income-generating work to contribute to the study. All participants were given an oral and written plain language description of the study and either signed a consent form, or those who could not write provided a thumbprint or verbal consent witnessed by an independent observer.
Sociodemographic characteristics of 221 Vietnamese women
Age, mean years (SD)
Completed education, n (%)
Up to complete primary (years 1–5)
Complete secondary (years 6–9)
Complete high school (years 10–12)
Occupation, n (%)
Factory, handcraft worker or retailer
Government or private officer
Not currently engaged in income-generating activity
The internal consistency (Cronbach’s alpha) of each sub-scale was high (DASS21-D subscale 0.72; DASS21-A subscale 0.77; and DASS21-Ssubscale 0.70). The overall score, which includes all items, also had high consistency (Cronbach’s alpha = 0.88).
Correlation coefficients between DASS21-D and DASS21-A was 0.65, DASS21-D and DASS21-S was 0.63, and DASS21-S and DASS21-A was 0.72.
Validity and optimal cut-off points
Median scores and interquartile ranges of DASS21 sub–scales by diagnostic groups* in 221 Vietnamese women
No mental health problem (N)
People with depression (D)
People with anxiety (A)
Tests of median differences**
ROC analyses of DASS21 to predict depression and/or anxiety* in Vietnamese women
Combination of DASS21-D and DASS21-A predicts
Combination of DASS21-D and DASS21-S predicts
Combination of DASS21-A and DASS21-S predicts
Combination of three sub-scales predicts
This study used gold standard validation methods in a systematically recruited representative sample of women. It used standard analyses of internal reliability of psychometric instruments and means of establishing cut-off scores to detect clinically significant symptoms of depression and anxiety. We acknowledge the limitation that our sample was limited to women who had children of the same age. We used a sampling method which allowed us to recruit a representative sample of women with young children of Ha Nam, a typical rural northern province in Vietnam. The social-demographic characteristics of our sample are identical to that of rural women with young children in the North of Vietnam in The UNICEF Multiple Indicator Cluster Survey 2006 . Therefore we believe that the data can be generalised with confidence to rural northern Vietnamese women with young children.
The results of EFA, analyses of the median scores of the three sub-scales by diagnostic groups and ROC analyses are consistent in indicating that in this setting, there is only one dimension of psychological functioning underlying the 21 items of the DASS21-Vietnam Validation (DASS21-V). None of the subscales was able to distinguish women experiencing depression from those with an anxiety disorder. These findings, are similar to our previous validations of other psychometric instruments in this setting , and suggest that while screening tools are able to detect clinically significant psychological states, they are not able to distinguish which state an individual woman is experiencing. It is possible that the symptoms which distinguish between depression and anxiety in Vietnamese women were absent in the screening tools and this warrants further investigation in future studies.
The other interpretation is that non-psychotic psychological morbidity is more accurately conceptualised in this setting as a continuum, rather than a distinct series of separate conditions. The term “common mental disorders” which refers to depression and anxiety is widely used in existing research to indicate that these are not readily distinguishable from each other in resource-constrained settings [1, 2]. We have shown that in rural Vietnam there are the same risk factors for depressive and anxious states: intimate partner violence, low household wealth and coincidental adverse life events which are common among women in resource-constrained countries . At community level therefore it might not be necessary to distinguish between these states as interventions such as universal psycho-educational programs or targeted supportive therapy to address these risks will be similar.
Consistent with previous studies [15, 23], this study shows that psychological symptom screening tools have lower cut-offs in Vietnam compared with those in high-income settings. DASS21-D and DASS21-S which include only psychological items have optimal cut-offs in this study at the borderline of normal and mild levels of symptoms in the Australian classification (Table 1). DASS21-A in which three of the seven items are somatic symptoms has a cut-off score to detect anxiety in this study falling in the range of the moderate level in the Australian classification. The reason may be that women with depression and anxiety tend to endorse more somatic symptoms than negative emotions.
These data demonstrate that both the combination of DASS21-D subscale and DASS21-A subscale and the combination of all three sub-scales generate a sensitive tool to screen for common mental disorders among women with young children in this setting. We suggested the combination of 21 items of DASS21 for primary health care because it has higher sensitivity and specificity than either any of the single sub-scales or combinations of two sub-scales. The optimal cut-off score of this tool is equal to or more than 34 which yields optimal sensitivity (79.1%) and specificity (77.0%) to detect common mental disorders including depression and anxiety. Using the full scale with 42 items may have different results. However, it would increase the burden and there would be no difference in treatment.
In summary, our data indicate that DASS21-V as a single scale has good internal reliability and is sensitive to detect common mental disorders in rural northern Vietnamese women with young children. Using the sub-scales to distinguish between depression and anxiety is not however appropriate for this setting. Overall, the DASS 21-V is a comprehensible and psychometrically sound tool which can be used in primary health care, community interventions, or as a screening tool at clinical settings in rural Viet Nam.
The authors are grateful to the Myer Foundation who funded the study under its Beyond Australia scheme. They are also very grateful to Professor Margot Prior, Professor Dominic Lee, and Professor Doreen Rosenthal who made valuable contributions to the study design; Dr La Thi Buoi and the research staff from the Research and Training Centre for Community Development in Hanoi who collected the data; and the commune health workers in Hanoi and Ha Nam who assisted with recruitment and the participants who contributed their time and experiences.
Funding for this study was provided by Myer Foundation under its Beyond Australia scheme. The Myer Foundation had no further role in study design; in the collection, analysis and interpretation of data; in the writing of the report; and in the decision to submit the paper for publication.
- Goldberg D, Huxley P: Common Mental Disorders: A Biosocial Model. 1992, London: Tavistock / RoutledgeGoogle Scholar
- Fisher J, Mello MC, Patel V, Rahman A, Tran T, Holton S, Holmes W: Prevalence and determinants of common perinatal mental disorders in women in low- and lower-middle-income countries: a systematic review. Bull World Health Organ. 2012, 90 (2): 139-149G. 10.2471/BLT.11.091850.View ArticleGoogle Scholar
- WHO: World Health Report 2001. Mental Health: New Understanding, New Hope. 2001, Geneva: World Health OrganizationGoogle Scholar
- Clark LA, Watson D: Tripartite model of anxiety and depression: psychometric evidence and taxonomic implications. J Abnorm Psychol. 1991, 100 (3): 316-336.View ArticlePubMedGoogle Scholar
- Lovibond SH, Lovibond PF: Manual for the Depression Anxiety Stress Scales. 1995, Sydney: Psychology Foundation of Australia, 2Google Scholar
- Lovibond PF, Lovibond SH: The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav Res Ther. 1995, 33 (3): 335-343. 10.1016/0005-7967(94)00075-U.View ArticlePubMedGoogle Scholar
- Ng F, Trauer T, Dodd S, Callaly T, Campbell S, Berk M: The validity of the 21‐item version of the Depression Anxiety Stress Scales as a routine clinical outcome measure. Acta Neuropsychiatrica. 2007, 19 (5): 304-310. 10.1111/j.1601-5215.2007.00217.x.View ArticlePubMedGoogle Scholar
- Brown TA, Chorpita BF, Korotitsch W, Barlow DH: Psychometric properties of the Depression Anxiety Stress Scales (DASS) in clinical samples. Behav Res Ther. 1997, 35 (1): 79-89. 10.1016/S0005-7967(96)00068-X.View ArticlePubMedGoogle Scholar
- Antony MM, Bieling PJ, Cox BJ, Enns MW, Swinson RP: Psychometric properties of the 42-item and 21-item versions of the Depression Anxiety Stress Scales in clinical groups and a community sample. Psychol Assess. 1998, 10 (2): 176-181.View ArticleGoogle Scholar
- Henry JD, Crawford JR: The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. Br J Clin Psychol. 2005, 44: 227-239. 10.1348/014466505X29657.View ArticlePubMedGoogle Scholar
- Chan RC, Xu T, Huang J, Wang Y, Zhao Q, Shum DH, O’Gorman J, Potangaroa R: Extending the utility of the Depression Anxiety Stress scale by examining its psychometric properties in Chinese settings. Psychiatry Res. 2012, in pressGoogle Scholar
- Musa R, Fadzil MA ZZ: Translation, validation and psychometric properties of Bahasa Malaysia version of the Depression Anxiety and Stress Scales (DASS). ASEAN Journal of Psychiatry. 2007, 82 (2): 82-89.Google Scholar
- Severino GA, Haynes WDG: Development of an Italian version of the Depression Anxiety Stress Scales. Psychol Health Med. 2010, 15 (5): 607-621. 10.1080/13548506.2010.498889.View ArticlePubMedGoogle Scholar
- Bados A, Solanas A, Andres R: Psychometric properties of the Spanish version of depression, anxiety and stress scales (DASS). Psicothema. 2005, 17 (4): 679-683.Google Scholar
- Tran TD, Tran T, La B, Lee D, Rosenthal D, Fisher J: Screening for perinatal common mental disorders in women in the north of Vietnam: a comparison of three psychometric instruments. J Affect Disord. 2011, 133 (1–2): 281-293.View ArticlePubMedGoogle Scholar
- Tuan T, Harpham T, Huonh N: Validity and reliability of the self-reporting questionnnaire 20 items in Vietnam. Hong Kong J. 2004, 14 (3): 7-10.Google Scholar
- Fisher J, Tran T, La BT, Kriitmaa K, Rosenthal D, Tuan T: Common perinatal mental disorders in northern Viet Nam: community prevalence and health care use. Bull World Health Organ. 2010, 88 (10): 737-745. 10.2471/BLT.09.067066.View ArticlePubMedPubMed CentralGoogle Scholar
- First M, Gibbon M, Spitzer R, Williams J: User’s Guide for the Structured Interview for DSM-IV Axis 1 Disorders - Research Version. 1996, New York: Biometrics ResearchGoogle Scholar
- Maruyama G: Basics of structural equation modeling. 1997, Thousand Oaks, Calif: Sage PublicationsGoogle Scholar
- Kline P: An easy guide to factor analysis. 2002, London: RoutledgeGoogle Scholar
- Warner J: Clinicians’ guide to evaluating diagnostic and screening tests in psychiatry. Adv Psychiatr Treat. 2004, 10: 446-454. 10.1192/apt.10.6.446.View ArticleGoogle Scholar
- GSO: Viet Nam Multiple Indicator Cluster Survey 2006, Final Report. 2007, Ha Noi, Viet Nam: General Statistics OfficeGoogle Scholar
- Tran TD, Tran T, Fisher J: Validation of three psychometric instruments for screening for perinatal common mental disorders in men in the north of Vietnam. J Affect Disord. 2012, 136: 104-109. 10.1016/j.jad.2011.08.012.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/13/24/prepub