Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Psychometric properties of EURO-D, a geriatric depression scale: a cross-cultural validation study

BMC Psychiatry volume 15, Article number: 12 (2015) Cite this article

Abstract

Background

Many of the assessment tools used to study depression among older people are adaptations of instruments developed in other cultural setting. There is a need to validate those instruments in low and middle income countries (LMIC).

Methods

A one-phase cross-sectional survey of people aged [greater than or equal to] 65 years from LMIC. EURO-D was checked for psychometric properties. Calibration with clinical diagnosis was made using ICD-10. Optimal cutpoint was determined. Concurrent validity was assessed measuring correlations with WHODAS 2.0.

Results

17,852 interviews were completed in 13 sites from nine countries. EURO-D constituted a hierarchical scale in most sites. The most commonly endorsed symptom in Latin American sites was depression; in China was sleep disturbance and tearfulness; in India, irritability and fatigue and in Nigeria loss of enjoyment. Two factor structure (affective and motivation) were demonstrated. Measurement invariance was demonstrated among Latin American and Indian sites being less evident in China and Nigeria. At the 4/5 cutpoint, sensitivity for ICD-10 depressive episode was 86% or higher in all sites and specificity exceeded 84% in all Latin America and Chinese sites. Concurrent validity was supported, at least for Latin American and Indian sites.

Conclusions

There is evidence for the cross-cultural validity of the EURO-D scale at Latin American and Indian settings and its potential applicability in comparative epidemiological studies.

Peer Review reports

Background

Depression is a common and burdensome psychiatric disorder in older people [1-3]. In Low and Middle Income Countries (LMIC) it is difficult to assess its prevalence because of the lack of culturally adapted and validated assessments.

Clinical diagnostic criteria for depression including DSM-5 [4] and ICD-10 [5] are applied to adults of all ages. These may, however, miss clinically significant episodes among older people who do not meet these specific criteria. Some investigators have suggested a syndrome of depression without sadness, thought to be more common in older adults [6,7], and a depletion syndrome manifested by withdrawal, apathy, and lack of vigour [8,9].

Depression symptom scales have been widely used in population surveys to quantify depression burden as a continuum, or to screen for depression of clinical significance in the first phase of a two phase survey design [10-15]. However, only the Geriatric Depression Scale [10,11] and the EURO-D [12] were developed specifically for use in older people, and evidence for their validity comes mainly from high income countries [16-21] [12,22].

We set out to assess the construct validity of the EURO-D in large population-based survey samples of older people living in Latin America, India, China and Nigeria, aiming to assess whether this scale measures the same construct in low and middle income countries with diverse cultures and languages. Measurement invariance would be supported by similar measurement properties, and a common ‘nomological net’ of proximate identifiers of the depression symptom score.

Methods

Setting, design and procedures

Comprehensive, one-phase, catchment area population-based surveys were conducted according to the same standardised protocol by the 10/66 Dementia Research Group. The full 10/66 study protocol has been published elsewhere [23]. Surveys were carried out in thirteen sites from nine countries (Cuba, Dominican Republic, Puerto Rico, Peru, Mexico, Venezuela, China, India and Nigeria). Peru, Mexico, China and India included both urban and rural catchment areas; the Nigerian catchment area was predominately rural, while in the other countries participants were recruited only from urban catchment areas. All assessments were carefully translated and adapted into the relevant local languages. All the EURO-D items are derived from the GMS, which is part of the 10/66 assessment. All aspects of assessment methodology, including translation and adaptation have been reported in detail in a previous publication [24]. In brief, the GMS was translated and back translated into Spanish, Mandarin, Hindi, Tamil and Ibo. Meta-analysis of 26 publications of exploratory factor analysis of the GDS reported ‘strong evidence of language differences in the factor structure of the GDS’, being language strongly confounded by other aspects of culture [25]. Acceptability and conceptual equivalence were assessed and reviewed by local informants. Interviews were carried out in participants’ own homes and lasted on average two to three hours. Interviewers were fully trained on the 10/66 protocol by the local principal investigator (PI) and the local study coordinator (SC). The study protocol and the consent procedures, including the witnessed consent procedure, were approved by the King's College London research ethics committee and in all local countries: 1- Medical Ethics Committee of Peking University the Sixth Hospital (Institute of Mental Health, China); 2- the Memory, Depression Institute and Risk Diseases (IMEDER) Ethics Committee (Peru); 3- Finlay Albarran Medical Faculty of Havana Medical University Ethical Committee (Cuba); 4- Hospital Universitario de Caracas Ethics Committee (Venezuela); 5- Ethics Committee of Nnamdi Azikiwe University Teaching Hospital (Nigeria); 6- Consejo Nacional de Bioética y Salud (CONABIOS, Dominican Republic); 7- Christian Medical College (Vellore) Research Ethics Committee (India); 8- Instituto Nacional de Neurología y Neurocirugía Ethics Committee (Mexico); 9-Nnamdi Azikiwe University Teaching Hospital Nnewi Anambra State Ethics Committee, Nigeria. Participants were recruited on the basis of informed signed or witnessed consent; 9-. Ethics committes approved the witnessed consent procedure. The use of the 10/66 Dementia Research Group dataset was approved by the 10/66 principal investigators.

Depression assessment

Depression was assessed using the Geriatric Mental State (GMS) [26]. Symptoms are ascertained with respect to the last one month. Internationally, the GMS is the most widely used comprehensive clinical mental health assessment for older people. A computerised diagnostic algorithm, the AGECAT (Automated Geriatric Examination for Computer Assisted Taxonomy), groups symptoms to form patterns recognised by a psychiatrist as illness, and identifies them as syndrome cases [27]. Items are later added together to generate affective disorder diagnoses according to ICD-10, and DSM-IV criteria [26,28]. The reliability and validity of the GMS has been demonstrated for in-patient, out-patient and community samples, and in various languages and cultures including Spanish and Chinese. The validity of the GMS/AGECAT algorithm has been investigated in several studies [29,30].

The EURO-D symptom scale was originally developed to compare symptoms of late-life depression across 11 European countries in the EURODEP Concerted Action Programme [12]. The 12 EURO-D items (depressed mood, pessimism, wishing death, guilt, sleep, interest, irritability, appetite, fatigue, concentration, enjoyment and tearfulness) were all taken from the Geriatric Mental State [31]; each item is scored 0 (symptom not present) or 1 (symptom present), generating a simple ordinal scale with a maximum score of 12. In the EURODEP study, internal consistency of the EURO-D, was moderately high with a Cronbach’s alpha ranging from 0.61 to 0.75. However, Principal Components Analysis generated two factors common to nearly every centre: an affective suffering factor (depression, tearfulness, pessimism and wishing death) and a motivation factor (interest, concentration and enjoyment) [12]. The optimum cut-point for the identification of DSM-IV major depression and GMS/AGECAT depression was > =4. Evidence for internal consistency and construct validity of the EURO-D scale was strengthened following its use in the 10 nation European Survey of Health, Ageing, and Retirement in Europe (SHARE) [32]. It was shown to be a hierarchical scale with similar rank ordering of item calibration values across countries. The previously observed two factor structure fitted well in all countries, with similar factor loadings.

Clinical diagnoses of depressive episode (mild, moderate or severe) were classified according to the International Classification of Disease-10 (ICD-10) as a mood disorder with symptoms of sadness, negative self-regard, loss of interest in life, and disruptions of sleep, appetite, thinking, and energy level for more than two weeks that interfere with daily living [5]. ICD-10 diagnoses were derived from the GMS interview, through the application of a computerised algorithm.

Concurrent validators

We used three indicators to assess the concurrent validity of the EURO-D:

  1. 1.

    Disability was assessed using the World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) [33]. It has high internal consistency, moderate to good test–retest reliability, and good concurrent validity in many clinical populations with chronic disease. The robust cross-cultural measurement properties of the WHODAS 2.0 have been demonstrated in the 10/66 Dementia Research Group population-based surveys [34]; items formed a unidimensional hierarchical scale in all sites, with a common underlying factor structure.

  2. 2.

    Happiness was assessed through the response to GMS question ‘in general, how happy would you say you are: very happy, fairly happy, not very happy, or not happy at all?

  3. 3.

    Subjective global health was assessed through the response to the introductory WHODAS 2.0 question (not used in the overall disability score) – ‘How do you rate your overall health in the past 30 days?’ Options were very good, good, moderate, bad and very bad.

Analyses

We used the 10/66 data archive (release 3.0) for all analyses.

EURO-D total scale score distributions were summarised according to their mean, median and interquartile range, after inspecting histograms and box plots. The internal consistency of the scale was assessed in each site using Cronbach’s alpha. For each site, the proportion of participants endorsing each of the 12 items (‘item difficulties’) was reported and ranked from 1 (the most frequently endorsed item) to 12 (the least frequently endorsed item) by site.

Mokken analysis was used to test the extent to which the EURO-D items conformed to hierarchical scaling principles in each site. Mokken scaling involves the application of a non-parametric item response model [35] to measure the hierarchical properties of items in a scale, assessing if the items can be ordered by degree of difficulty, so that any individual who endorses a particular item will also endorse all the items ranked lower in difficulty. Three basic assumptions are required for a monotone homogeneity model (MHM): 1) unidimensionality (one latent variable summarises the variation in the item scores in the questionnaire), 2) local independence (after conditioning on the position on the latent trait, the item scores are statistically independent), and 3) monotonicity (for all items the probability of a positive response increases monotonically with increasing values of the latent trait). These assumptions being met, an individual’s position on the latent trait can conveniently be estimated as the rank of the highest item in the hierarchy that they endorse, or their total number of positive responses [36]. Double monotonicity models (DMM) require in addition that for any value of the latent trait, the probability of a positive response decreases with the difficulty of the item. This means that the order of item difficulties remains invariant over all values of the latent trait and thus, that the item response function curves do not intersect [37,38]. To assess single monotonicity, we estimated Loevinger coefficients for each item (Hi) and for the whole scale (H), where values between 0.3 and 0.4 suggest weak scalability, values between 0.4 and 0.5 moderate, and values above 0.5 strong scalability. We also tested for violations of monotonicity (using the StataloevH monotonicity command) and non-intersection (using the StataloevH nipmatrix command) between pairs of items (minimum violation 0.03, alpha = 0.05), using overall criteria values as an indication of the likelihood of assumption violation; ≤40 ‘satisfactory’, 40 to 79 ‘questionable violation’, 80 and over ‘strongly suggesting an assumption violation’ [39]. Measurement invariance, with respect to hierarchical scale properties was assessed according to the Spearman (non-parametric) correlation between item difficulty ranks between all pairs of sites.

Principal component analysis (PCA) of EURO-D items was carried out using PASW version 18, and confirmatory factor analysis (CFA) using AMOS version 4.0. For PCA varimax rotation was carried out with an Eigenvalue of one as initial extraction criterion. The cut off used to assume that an item loaded on a given factor was 0.60, with a threshold of 0.50 signifying borderline loading. Given the a priori hypothesis of an underlying two-factor solution [40] we then tested and compared between sites the goodness-of-fit of the two factor solution identified in the European SHARE survey, using confirmatory factor analysis. CFA models contain parameters that are (a) fixed to a certain value, (b) constrained to be equal to other parameters, and (c) free to take on any unknown value [41]. In testing for psychometric invariance across sites, two models were fitted and then compared for goodness-of-fit; one in which the factor loadings are unconstrained, that is estimated separately for all countries, and the second in which they are constrained to be equal across countries, the null hypothesis being that items load to a similar extent on the same latent trait or traits across countries. Markedly superior fit of the first model would challenge the hypothesis of measurement invariance. We assessed goodness-of-fit using Akaike’s Information Criterion (AIC) [40], the Tucker-Lewis Index (TLI) [42] and the Root Mean Square Error of Approximation (RMSEA). The lower the AIC value, the better the fit of the model [42]; for the TLI values near 1.0 indicate good fit and those greater than 0.90 are considered satisfactory [43,44]; for the RMSEA values of less than 0.05 indicate close fit and 0.05 to 0.08 reasonable fit for the model [45]. In the final stage of the analysis, we compared the goodness of fit of the two factor solution derived from the European SHARE study with that of a one factor solution, with loadings constrained across sites.

We assessed the psychometric properties of the EURO-D scale, in each site, running receiver operating characteristic (ROC) curve analyses using ICD-10 depressive episode as the reference criterion, plotting sensitivity against false positive rate (1-sensitivity) and estimated the area under the ROC curve (AUROC) with 95% confidence intervals. To calibrate the EURO-D score against ICD-10 depressive episode diagnosis, we used maximum Youden’s index ((sensitivity + specificity)-1) as the criterion for determining the optimal cut-point in each site. The optimal cutpoint for most sites was then applied to all sites, and the sensitivity, specificity and Youden’s index at that cut-point was reported against ICD-10 depressive episode. It is important to note that the EURO-D scale score and ICD-10 diagnosis were both derived from a single GMS interview, administered by the same research worker, with some overlap in the symptoms ascertained. Therefore, this does not represent an independent validation of the EURO-D scale, but rather an attempt to compare its calibration with ICD-10 clinical diagnosis among sites.

The concurrent validity of the EURO-D scale in each site was assessed by measuring Spearman rank correlations with global self-rated health (an inverse correlation hypothesised), WHODAS 2.0 disability (a positive correlation hypothesised) and happiness (an inverse correlation hypothesised).

Results and discussion

Results

Sample characteristics

Overall, 17,852 interviews were completed in 13 sites from nine countries. A high response rate was obtained, at least 80% in all sites, and exceeding 90% in several sites. Table 1 summarizes the sample demographic characteristics, by country. Women predominate over men in all sites. Educational levels varied widely between sites, the proportion not completing primary education was higher in sites in India, China and Nigeria in comparison to those in Latin America, and was also generally higher in rural than urban sites.

Table 1 Response proportion, sociodemographic characteristics and EURO-D score distributions by site
Full size table

Histograms of EURO-D score distributions (data not provided) indicated that the modal score in all sites, other than urban India, was zero, indicating no depression symptoms. In all sites the distribution was markedly positively skewed. In rural India, the score distribution was biphasic, with peaks at zero to one and five to seven. Mean scores ranged between 1.7 and 3.2, other than in urban China (0.5) and rural China (0.2). Median scores ranged between 1 and 3, and 75th centiles between 3 and 6, other than in urban China (1) and rural China (0). Relatively high score distributions were seen in the Dominican Republic, and India.

The internal consistency of the EURO-D scale Cronbach’s alpha ranged from 0.64 to 0.87, and exceeded 0.70 in almost all sites.

EURO-D hierarchical scaling properties

Loevinger’s H coefficients indicated a weak hierarchical scale in Cuba, Dominican Republic, Puerto Rico and China, a moderate hierarchical scale in India and a strong hierarchical scale in Nigeria (Table 2). In Peru, Venezuela and Mexico, Loevinger’s H coefficient fell just below the threshold to support hierarchality. In none of the countries were any significant violations of monotonicity assumptions noted. There were several statistically significant violations of the more stringent double monotone homogeneity (non-intersection) assumptions, but strong evidence of violation was only seen for a minority of symptoms in certain sites. The pattern of item-specific Loevinger’s H coefficients and non-intersection violations did not suggest that any particular items could be omitted to generate a more effective hierarchical scale across countries.

Table 2 Mokken analysis
Full size table

The proportion of participants in each site endorsing each of the EURO-D symptoms is summarized in Table 3. The symptoms are ranked, within each site, in order of frequency of endorsement. The prevalence of individual symptoms and their rank order were similar across Latin American and Indian sites. The prevalence of all symptoms was strikingly lower in Chinese sites, other than tearfulness, which was commonly endorsed in the rural Chinese site. The rank order of symptoms was also somewhat different from that observed in Latin American and Indian sites. The rank order of symptoms in the Nigerian site was strikingly different from those in all other sites. Thus, depressed mood was the most commonly endorsed symptom in all Latin American sites, and the second or third most endorsed symptom in Indian sites. Sleep disturbance and tearfulness were the other commonly endorsed symptoms in those sites. However, in China depressed mood was the fifth endorsed symptom, while the more commonly endorsed symptoms were sleep disturbance, fatigue and irritability in urban China and tearfulness, loss of concentration and loss of interest in rural China. In Nigeria, depressed mood was the fourth most commonly endorsed item, the most frequently endorsed items being loss of enjoyment, loss of interest and fatigue. There was more communality across sites as regards the least frequently endorsed symptoms, which tended to be guilt, wishing death, and (other than Nigeria) loss of enjoyment. The correlations between pairs of sites in the rank orders of item prevalences are presented in Table 4. Spearman rank correlations generally exceed 0.70 among Latin American sites. While the correlation between rank orders for the two Chinese sites is high and statistically significant (0.69), those with Latin American sites lie generally in the range 0.40 to 0.60. Correlations between the rank order of symptom endorsement in Nigeria and those in other sites are generally close to zero, although those with urban China (0.45) and rural China (0.35) are somewhat higher.

Table 3 Prevalence (%) of EURO-D symptoms, by site and rank order of item difficulties
Full size table
Table 4 Non-parametric correlations between pairs of sites for rank orders of EURO-D item difficulties
Full size table

Factor structure

Bartlett’s tests of sphericity and Kaiser-Meyer-Olkin Measure of Sampling Adequacy suggested that factor analysis was appropriate and feasible in all countries (Table 5). The principal components factor analysis yielded three factors with eigenvalues over one in most countries, with a two factor solution in Cuba, and a four factor solution in Mexico. The first two factors dominated in all countries (cumulative variance 36.4-45.8%). The third factors contributed between 8.4% and 9.3% of scale variance, with eigenvalues between 1.0 and 1.1. In most countries, the first factor was dominated by loadings of the depression and tearfulness items (seven countries), accompanied by lower level and less consistent loadings from items addressing suicidality (five countries), and sleep, appetite and pessimism (four countries each). The second factor was most commonly dominated by loadings of interest and enjoyment items (eight countries), with occasional lower level loadings of concentration (three countries). In Venezuela the second factor was dominated by depression and tearfulness, and the third by enjoyment and interest, while in Nigeria the pattern was reversed. In both of these countries the first factor was dominated by pessimism and concentration, with guilt and suicidality also loading in Nigeria. In other sites, the third factor was loaded on by a variety of items; guilt, with or without suicidality and irritability (five countries). In China, the third factor was loaded upon by somatic items, sleep, appetite and fatigue.

Table 5 Principal components analysis (eigenvalues greater than one) by country
Full size table

Given that the findings from the PCA were broadly consistent with the two factor (affective suffering and motivation) model previously identified and found to fit well across European SHARE study countries, we formally tested the goodness of fit of this factor structure across 10/66 countries, using confirmatory factor analysis (Table 6). This two factor model showed a moderately good fit across sites according to RMSEA (<0.05), although less convincingly so according to TLI (0.77, much lower than 0.90, considered acceptable) (Table 7). The models in which loadings were constrained to be equal across countries, and which were freely estimated in each country varied little in terms of AIC, TLI or RMSEA, suggesting measurement invariance. Variance in factor loadings was reduced for affective suffering items when Nigeria (a clear outlier) was omitted, and the model fit of the two factor solution was clearly improved. When the model fit of the constrained two factor model (omitting Nigeria) was compared with that of a one factor solution (omitting Nigeria), the two factor solution was clearly superior according to all absolute and relative goodness of fit indices.

Table 6 Confirmatory factor analysis for affective and motivation factors
Full size table
Table 7 Confirmatory factor analysis model fit
Full size table

Calibration against clinical diagnoses

The calibration of the EURO-D depression against ICD-10 clinical diagnosis is summarized in (Table 8). The Area Under the Receiver Operating Characteristic curve (AUROC) ranged from 0.89 and 1.00. The optimal cutpoint for the EURO-D against the reference criterion of ICD-10 depressive episode (using the criterion of maximizing Youden’s index), was 4/5 (a score of five or more) in all of the Latin American sites, rural China and Nigeria. While a lower cutpoint (3/4) would have been selected in rural India, and a higher cutpoint in urban China (6/7) and urban India (5/6), there was actually little difference between Youden’s index at these cutpoints and at the 4/5 cutpoint that was

Table 8 Psychometric properties of EURO-D depression scale, by site, with respect to clinical criteria
Full size table

optimal for other sites. At the 4/5 cutpoint, the sensitivity for ICD-10 depressive episode was 86% or higher in all sites and the specificity exceeded 84% in all Latin American and Chinese sites. However, specificity was lower in urban India (74.1%), rural India (69.5%) and Nigeria (79.3%), indicating a relatively high false positive rate using that cutpoint in those sites.

Concurrent validity

As hypothesized, EURO-D scores were positively correlated with WHODAS 2.0 disability scores in all sites (+0.15 to +0.48, P < 0.001), Table 9. EURO-D depression scores were inversely associated with global self-rated health in all sites, but at a much lower level in urban China (−0.10, p = 0.001) and rural China (−0.06, p = 0.06) than in other sites (−0.27 to −0.43, p < 0.001). EURO-D scores were inversely associated with happiness in all sites (−0.17 to −0.49, p < 0.001) other than China urban (−0.05, p = 0.12) and rural (−0.01, p = 0.70), and Nigeria (+0.01, p = 0.68)

Table 9 Construct (concurrent) validity of EURO-D scale
Full size table

.

Discussion

The results of these analyses extend the evidence for the cross-cultural validity of the EURO-D scale, at least to Hispanic Latin American and Indian settings. We were able to replicate the two factor structure (‘affective suffering’ and ‘motivation’) previously demonstrated in two studies in continental Europe [12,32]. Measurement invariance (common factor loadings and rank order of item difficulties) was demonstrated among Latin American and Indian sites, but the evidence for this was less compelling for Chinese sites, and measurement properties were quite different in Nigeria. Concurrent validity (hypothesized positive correlations with disability scores, and negative correlations with subjective health ratings and happiness) was strongly supported for the Latin American and Indian sites. However, correlations with subjective health ratings were weak in China, and the hypothesised negative correlations with happiness were absent in China and Nigeria.

We assessed the construct validity of the EURO-D in large, population-based surveys in diverse low and middle income country settings, including both rural and urban catchment areas. We used advanced psychometric techniques – confirmatory factor analysis and item response models, as well as concurrent validity and calibration with clinical diagnosis to evaluate cross-cultural construct validity. Findings are directly comparable with similar analyses conducted in continental Europe [32,46]. The main limitations of this study are that we did not carry out a criterion validation using an independent clinical interview, and we did not assess test-retest, inter-interviewer or inter-rater reliability for the EURO-D scale items.

Findings from this study are most directly comparable with those from the SHARE survey [22] and the EURODEP consortium studies [47], in which the EURO-D was administered to as part of the GMS (EURODEP, nine sites in eight European countries, older adults aged 65 years and over), or as a free-standing scale (SHARE, 11 European countries, older adults aged 50 years and over) in cross-sectional population-based surveys. In EURODEP, the mean EURO-D score ranged from 1.3 to 3.6 among countries, and in SHARE from 1.8 to 3.1, similar to the range observed in our 10/66 studies of 1.7 to 3.2 (excluding the low outlier of China). Cronbach’s alpha ranging from 0.61 to 0.75 in EURODEP, and from 0.62 to 0.78 in SHARE, similar to the range from 0.64 to 0.77 observed in most 10/66 sites. The unusually high internal consistency in rural India and Nigeria (Cronbach’s alpha, 0.87) may suggest a problem with response set bias in those sites. The EURO-D demonstrated stronger hierarchical scaling properties in the European countries included in the SHARE survey [32] than in the 10/66 sites in Latin America and India. Nevertheless, the rank of item difficulties was similar, with depression, sleep disturbance and fatigue being among the most commonly endorsed items (low item difficulty), and guilt and wishing death among the least commonly endorsed (high item difficulty). In Nigeria, EURO-D item responses were strongly hierarchical but with a strikingly different rank order of item difficulties than that observed in the other 10/66 sites and in the European SHARE survey countries. Principal Components Analysis generated similar factor structures (affective suffering and motivation) in the current study as in the EURODEP studies [46], the SHARE surveys [32], and in convenience samples of depressed and older people from the general population in the 10/66 Dementia Research Group pilot studies in Latin America, India and China [24]. The two factor solution derived in the European SHARE study fitted moderately well in our current sample, particularly when the Nigerian site was excluded.

As in the SHARE study, depression and tearfulness consistently loaded on Affective Suffering. However, in contrast to the SHARE study interest and enjoyment rather than enjoyment and pessimism dominated the Motivation factor. The clinical diagnosis of ICD-10 depressive episode in the current study was derived from the same GMS interview, using many of the same items that were used to score the EURO-D, the distinction being that particular combinations of symptoms (which needed to be persistent and pervasive) were required to meet the ICD-10 criteria. As such, the favourable validity coefficients cannot be taken as evidence of criterion validity. Such evidence is available from independent clinical assessments in some of the EURODEP studies [12], a clinical validation of the EURO-D scale in Spain [48] and high sensitivity for the detection of severe depression in the 10/66 Dementia Research Group pilot studies in Latin America, India and China [24]. We were, however, able to calibrate the EURO-D scale score against a ICD-10 clinical diagnosis of depressive episode; the optimal cutpoint was 4/5 in most sites, one point higher than the 3/4 cutpoint identified as optimal in the EURODEP consortium studies [12,46]. Concurrent validity of the EURO-D scale has not been assessed in previous studies. Depression among older people has been previously shown to be strongly associated with disability [49-51] and inversely associated with self-reported global health [12]. Although happiness is undoubtedly more than the absence of depression, recent analyses of population-based survey data from the United Kingdom, Germany and Australia indicate that mental ill health accounts for by far the largest component of the variance in lack of life satisfaction, dominating the effects of physical health, demographic and socioeconomic factors [52]. As such, the failure to observe the predicted inverse correlation with self-reported happiness in China and Nigeria does not support the construct validity of the EURO-D in those settings.

Several factors may have contributed to the discrepant measurement characteristics of the EURO-D in China and particularly Nigeria. In the Chinese sites the prevalence of nearly all depression symptoms was strikingly low. This may have impeded the elucidation of the factor structure and assessment of hierarchality, as well as limiting the variance to be explained in correlation with concurrent validators. In China the once popular and prevalent diagnosis of shenjing shuairuo, a neurasthenia like syndrome comprising weakness, fatigue, concentration problems, headache and other somatic symptoms seems in recent years to have been supplanted as the most common diagnosis in epidemiological surveys and clinical practice by depressive and anxiety disorders [53]. This has led some to allege an inappropriate importation of western nosologies that do not match well with Chinese cultural idioms of expression of psychological distress [53]. An alternative standpoint is that ‘mental health literacy’, judged by recognition and appropriate attribution of vignettes of depression and anxiety, is low in Chinese populations both inside and outside of China [54]. In this context, it is perhaps noteworthy that in our study depression was not a common symptom in either the urban or rural Chinese sites, and the sleep disturbance, fatigue and irritability were the three commonest symptoms in the urban site, and tearfulness, lack of concentration and loss of interest in the rural site. The EURO-D factor structure derived from the Chinese sample is consistent with previous observations from rural Thailand [55] where a high prevalence of fatigue was also observed, and where in addition to affective suffering and motivation, sleep and appetite constituted a separate third factor.

Cultural differences in the experience, attribution and communication of psychological distress might also have mediated some of the observed differences in measurement properties in Nigeria. Brain Fag Syndrome, comprising a tetrad of somatic complaints, cognitive impairments, sleep related complaints, and other somatic impairments was recognised as a West African culture bound syndrome in DSM-IV [56]. While originally recognised among students in the early 1960s, it is likely that this reflects enduring and widespread tendencies for the expression of psychological distress, informed by cultural norms and traditional medicine services. In our study, loss of enjoyment and interest, and fatigue were the most commonly endorsed symptoms in Nigeria; however, the rank orders of sleep disturbance and concentration problems were similar to those in other sites. Site-specific factors, some of which may have been culture related, may also have influenced the interaction between the older respondent and the interviewer, impacting on the assessment, ascertainment and recording of symptoms. In Nigeria, interviewers were local school leavers as opposed to graduates (often health professionals) in other sites, and levels of education and literacy among participants were the lowest of any of the 10/66 survey sites. While training for interviewing using the GMS was carried out using standardized and rigorous procedures in all sites, this may have been a particularly challenging task for the young interviewers in Nigeria. Finally, in both Nigeria and China, suboptimal translations and or cultural adaptions for either the happiness question or the EURO-D may have led to an underestimation of the correlations between these variables.

Conclusions

In conclusion, more work needs to be done to establish the validity of the EURO-D scale, and by extension the GMS interview, when used across cultures as a tool for assessing depression symptom severity, and generating clinical diagnoses. While its cross-cultural measurement properties are for the most part favourable, the case for measurement invariance with respect to its European origins weakens progressively with increasing cultural distance and disparity in levels of human development. Different questions, asked in different ways, may have served better to elicit symptoms of depressed mood in certain cultures. Ethnographically informed qualitative research might help to identify culture-specific idioms of psychological distress (not captured by depression nosologies), among older adults in China and Nigeria. With globalisation, and progressive economic and human development, it may be that cultures will tend to converge around a western consensus of ‘mental health literacy’. If so, one might hypothesise that, through a cohort effect, cross-cultural challenges may be most evident in the assessment of the mental health of older adults.

References

  1. Mulsant BH, Ganguli M. Epidemiology and diagnosis of depression in late life. J Clin Psychiatry. 1999;60 Suppl 20:29–15.

    Google Scholar 

  2. Beekman ATF, Deeg DJH, van Tilburg T, Smit JH, Hooijer C, van Tilburg W. Major and minor depression in later life: a study of prevalence and risk factors. J Affect Disord. 1995;36:65–75.

    Article  CAS  PubMed  Google Scholar 

  3. Blazer D. Depression in late life: review and commentary. J Gerontol A Biol Sci Med Sci. 2003;58(3):249–65.

    Article  PubMed  Google Scholar 

  4. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders FE, (DSM - 5). Washington, DC: APA; 2013.

    Book  Google Scholar 

  5. World Health Organization. The ICD-10 Classification of Mental and Behavioral Disorders. Diagnostic Criteria for Research. Geneva: WHO; 1992.

    Google Scholar 

  6. Gallo JJ, Rabins PV, Lyketsos CG, Tien AY, Anthony JC. Depression without sadness: functional outcomes of nondysphoric depression in later life. J Am Geriatr Soc. 1997;45(5):570–8.

    Article  CAS  PubMed  Google Scholar 

  7. Gallo JJ, Rabins PV, Anthony JC. Sadness in older persons: 13-year follow-up of a community sample in Baltimore. Maryland Psychol Med. 1999;29:341–50.

    Article  CAS  PubMed  Google Scholar 

  8. Adams KB. Depressive symptoms, depletion or developmental change? Withdrawal, apathy, and lack of vigor in the geriatric depression scale. Gerontologist. 2001;41(6):768–77.

    Article  CAS  PubMed  Google Scholar 

  9. Newman J. Aging and depression. Psychol Aging. 1989;4:150–65.

    Article  Google Scholar 

  10. Yesavage JA, Brink TL. Development and validation of a geriatric depression screening scale: a preliminary report. J Psychiatr Res. 1982;17(1):37–49.

    Article  PubMed  Google Scholar 

  11. Sheikh JI, Yesavage JA. Geriatric Depression Scale (GDS): Recent evidence and development of a shorter version. In: Clinical Gerontology: A Guide to Assessment and Intervention. NY: The Haworth Press; 1986. p. 165–73.

    Google Scholar 

  12. Prince MJ, Reischies F, Beekman ATF, Fuhrer C, Jonker SL, Kivela BA, et al. Development of the EURO-D scale–a European, Union initiative to compare symptoms of depression in 14 European centres. Br J Psychiatry. 1999;174:330–8.

    Article  CAS  PubMed  Google Scholar 

  13. Radloff LS. The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977;1(3):385–401.

    Article  Google Scholar 

  14. Goldberg D, Williams P. A Users Guide to the General Health Questionnaire. Windsor: NEFER, Nelson; 1988.

    Google Scholar 

  15. Zung WWK. A self-rating depression scale. Arch Gen Psychiatry. 1965;12:63–70.

    Article  CAS  PubMed  Google Scholar 

  16. Wu W, Zhang MY. Application of depression scale CES-D among the elderly people in the community. Shangai Shangai Arch Psychiatry. 1989;7(3):139–42.

    Google Scholar 

  17. Meng C, Tang Z. Analysis and comparison urban and rural elderly depressive symptoms in Beijing. Chin J Gerontol. 2000;20(4):196–9.

    Google Scholar 

  18. Pan A, Franco OH, Wan Y, Yu Z, Ye X, Lin X. Prevalence and geographic disparity of depressive symptoms among middle-aged and elderly in China. J Affect Disord. 2008;105:167–75.

    Article  PubMed  Google Scholar 

  19. Zunzunegui MV, Alvarado BE, Beland F, Vissandjee B. Explaining health differences between men and women in later life: a cross-city comparison in Latin America and the Caribbean. Soc Sci Med. 2009;68(2):235–42.

    Article  PubMed  Google Scholar 

  20. Alvarado BE, Zunzunegui MV, Beland F, Sicotte M, Tellechea L. Social and gender inequalities in depressive symptoms among urban older adults of latin america and the Caribbean. J Gerontol B Psychol Sci Soc Sci. 2007;62B(4):S226–36.

    Article  Google Scholar 

  21. Chi I,DSW, Yip P, Chiu H, Chou KL, Chan KS, Kwan CW, et al. Prevalence of depression and its correlates in Hong Kong's Chinese older adults. Am J Geriatr Psychiatry. 2005;13(5):409–16.

    Article  PubMed  Google Scholar 

  22. Castro Costa E, Dewey M, Stewart R, Banerjee S, Huppert F, Mendonca-Lima C, et al. Ascertaining late-life depressive symptoms in Europe: an evaluation of the EURO-D scale in10 nations.The SHARE project. Int J Methods Psychiatr Res. 2008;17(1):12–29.

    Article  PubMed  Google Scholar 

  23. Prince M, Ferri C, Acosta D, Albanese E, Arizaga R, Dewey M, et al. The protocols for the 10/66 dementia research group population-based research programme. BMC Public Health. 2007;7:165.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Prince M, Acosta D, Chiu H, Scazufca M, Varghese M. Dementia diagnosis in developing countries: a cross-cultural validation study. Lancet. 2003;361:909–17.

    Article  PubMed  Google Scholar 

  25. Giyeon K, Jamie DC, Chao Hui H, Bryant AN. A meta-analysis of the factor structure of the geriatric depression scale (GDS): the effects of language. Int Psychogeriatr. 2013;25(1):71–81.

    Article  Google Scholar 

  26. Copeland JRM, Prince M, Wilson KCM, Dewey ME, Payne J, Gurland B. The geriatric mental state examination in the 21st century. Int J Geriatr Psychiatry. 2002;17(8):729–32.

    Article  CAS  PubMed  Google Scholar 

  27. Copeland JRM, Kelleher MJ, Kellett JM, Gourlay AJ, Gurland BJ, Fleiss JL, et al. A semi-structured clinical interview foar the assessment of diagnosis and mental state in the elderly: the geriatric mental state schedule: I. Development and reliability. Psychol Med. 1976;6(3):439–49.

    Article  CAS  PubMed  Google Scholar 

  28. Copeland JRM, Dewey ME, Henderson AS, Kay DWK, Neal CD, Harrison MAM, et al. The Geriatric Mental State (GMS) used in the community: replication studies of the computerized diagnosis AGECAT. Psychol Med. 1988;18(1):219–23.

    Article  CAS  PubMed  Google Scholar 

  29. Livingston G, Sax K, Willison J, Blizard B, Mann A. The Gospel Oak Study stage II: the diagnosis of dementia in the community. Psychol Med. 1990;20(4):881–91.

    Article  CAS  PubMed  Google Scholar 

  30. Collighan G, Macdonald A, Herzberg J, Philpot M, Lindesay J. An evaluation of the multidisciplinary approach to psychiatric diagnosis in elderly people. BMJ. 1993;306(6881):821–4.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Copeland JRM, Dewey ME, Griffiths Jones HM. A computerized psychiatric diagnostic system and case nomenclature for elderly subjects: GMS and AGECAT. Psychol Med. 1986;16(1):89–99.

    Article  CAS  PubMed  Google Scholar 

  32. Castro-Costa E, Dewey M, Stewart R, Banerjee S, Huppert F, Mendonca-Lima C, et al. Prevalence of depressive symptoms and syndromes in later life in ten European countries: the SHARE study. Br J Psychiatry. 2007;191:393–401.

    Article  CAS  PubMed  Google Scholar 

  33. Ustun T, Kostanjsek N, Chatterji S, Rehm J. Measuring health and disability: Manual for WHO Disability Assessment Schedule (WHODAS 2.0). Geneva: World Health Organization; 2010.

    Google Scholar 

  34. Sousa RM, Dewey ME, Acosta D, Sousa RM, Dewey ME, Acosta D, et al. Measuring disability across cultures--the psychometric properties of the WHODAS II in older people from seven low- and middle-income countries. The 10/66 Dementia Research Group population-based survey. Int J Methods Psychiatr Res. 2010;19(1):1–17.

    PubMed  PubMed Central  Google Scholar 

  35. Mokken R. A Theory and Procedure of Scale Analysis. Berlin, Germany: De Gruyter; 1971.

    Book  Google Scholar 

  36. Dijkstra A, Buist G, Moorer P, Dassen T. Construct validity of the nursing care dependency scale. J Clin Nurs. 1999;8(4):380–8.

    Article  CAS  PubMed  Google Scholar 

  37. Sijtsma K, Emons WHM, Bouwmeester S, Nyklicek I, Roorda LD. Nonparametric IRT analysis of quality of life scales and its application to the World Health Organization Quality of Life Scale. Qual Life Res. 2008;17(2):275–90.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Van der Ark LA. Mokken scale analysis in R. J Stat Softw. 2007;20(11):1–19.

    Article  Google Scholar 

  39. Molenaar IW, Sijtsma K. MPS5 for Windows. A program for Mokken scale analysis for polytomous items. 2000.

    Google Scholar 

  40. Akaike H. Factor analysis and AIC. Psychometrika. 1987;52:317–32.

    Article  Google Scholar 

  41. Tucker L. A reliability coefficient for maximum likelihood factor analysis. Psychometrika. 1973;38:1–10.

    Article  Google Scholar 

  42. Burnham KP, Anderson DR. Multimodel Inference: understanding AIC and BIC in model selection. Sociol Methods Res. 2004;33(2):261–304.

    Article  Google Scholar 

  43. Dunn G, Everitt B, Pickles. Modelling Covariances and Latent Variables using EQS. 1st ed. London: Chapman & Hall; 1993.

    Google Scholar 

  44. Marsh HW, Balla JR, Jau KT. An evaluation of incremental fit indices : a clarification of mathematical and empiracal properties. In: Advanced Structural Equation Modelling: Issues and Techniques, vol. 11. 1996. p. 315–55.

    Google Scholar 

  45. Browne MW, Cudeck R. Alternative ways of assessing model fit. Sociol Methods Res. 1992;21:230–58.

    Article  Google Scholar 

  46. Prince MJ, Beekman AT, Deeg DJ, Fuhrer R, Kivela SL, Lawlor BA, et al. Depression symptoms in late life assessed using the EURO-D scale. Effect of age, gender and marital status in 14 European centres. Br J Psychiatry. 1999;174:339–45.

    Article  CAS  PubMed  Google Scholar 

  47. Copeland JR, Beekman ATF, Braam AW, Deway ME, Delespau P, Fuhrer R, et al. Depression among older people in Europe. The EURODEP studies. World Psychiatry. 2004;3(1):45–9.

    PubMed  PubMed Central  Google Scholar 

  48. Larraga L, Saz P, Dewey ME, Marcos G, Lobo A, ZARADEMP Workgroup. Validation of the Spanish version of the EURO-D scale: an instrument for detecting depression in older people. Int J Geriatr Psychiatry. 2006;21(12):1199–205.

    Article  PubMed  Google Scholar 

  49. Braam AW, Prince MJ, Beekman AT, Delespaul P, Dewey ME, Geerlings S, et al. Physical health and depressive symptoms in older Europeans. Results from EURODEP. Br J Psychiatry. 2005;187:35–42.

    Article  CAS  PubMed  Google Scholar 

  50. Barry L, Allore HG, Bruce ML, Gill TM. Longitudinal association between depressive symptoms and disability burden among older persons. J Gerontol A Biol Sci Med Sci. 2009;64A(12):1325–32.

    Article  PubMed Central  Google Scholar 

  51. Barry LC, Murphy TE, Gill TM. Depressive symptoms and functional transitions over time in older persons. Am J Geriatr Psychiatry. 2011;19(9):783–91.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Layard R, Chisholm, D, Patel, V, Saxena S. ‘Mental illness and unhappiness’ in Helliwell J.F., Layard,R. and Sachs, J. (eds), World Happiness Report 2013.New York: Sustainable Development Solutions Network; 2013a.38-53

  53. Lee S. Diagnosis postponed: Shenjing Shuairuo and the transformation of psychiatry in Post-Mao China. Cult Med Psychiatry. 1999;23:349–80.

    Article  CAS  PubMed  Google Scholar 

  54. Wong D, Xuesong H, Poon A, Lam AY. Depression literacy among Chinese in Shanghai, China: a comparison with Chinese-speaking Australians in Melbourne and Chinese in Hong Kong. Soc Psychiatry Psychiatr Epidemiol. 2012;47(8):1235–42.

    Article  PubMed  Google Scholar 

  55. Jirapramukpitak TN, Darawuttimaprakorn Punpuing S, Abas M. Validation and factor structure of the Thai version of the EURO-D scale for depression among older psychiatric patients. Aging Mental Health. 2009;13(6):899–904.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Ola BA, Morakinyo O, Adewuya AO. Brain Fag syndrome - a myth or a reality. Aff J Psychiatry (Johannesbg). 2009;12(2):135–43.

    CAS  Google Scholar 

Download references

Acknowledgements

We thank the 10/66 DRG investigators for their substantial contributions to acquisition of data.

Investigators: Daisy Acosta (Dominican Republic); Ana Luisa Sosa (Mexico); Richard Uwakwe (Alambra, Nigeria); Aquiles Salas (Venezuela); Yueqin Huang (China); Ivonne Jimenez (Puerto Rico); Joseph D Williams, KS Jacob (India).

We also thanks those institutions who funded the study of the 10/66 dementia prevalence whose data was used for this study: Wellcome Trust (UK) (GR066133); WHO; US Alzheimer’s Association (IIRG–04–1286); FONACIT - Venezuela and Puerto Rico State Legislature.

Author information

Authors and Affiliations

  1. Institute of Memory, Depression and Disease Risk, Avda Constructores 1230, Lima, 12, Peru

    Mariella Guerra

  2. Centre for Global Mental Health, Health Service and Population Research Department, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK

    Mariella Guerra, Cleusa Ferri, Juan Llibre & A Matthew Prina

  3. Peruvian University, Cayetano, Heredia, Lima, Peru

    Mariella Guerra

  4. Federal University of Sao Paulo, UNIFESP, Sao Paulo, Brasil

    Cleusa Ferri

  5. Medical University of Havana, Havana, Cuba

    Juan Llibre

  6. Centre for Global Mental Health, Health Service and Population Research Department, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK

    Martin Prince

Authors
  1. Mariella Guerra
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cleusa Ferri
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Juan Llibre
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. A Matthew Prina
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Martin Prince
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mariella Guerra.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

MG participated in the design of the study; acquisition of data; performed part of the statistical analysis and interpretation of data; drafted the manuscript. CF participated in its design, analysis and interpretation of data. JLL has been involved in revising the manuscript critically for important intellectual content. M Prina helped to draft the manuscript revising it critically for important intellectual content. M Prince participated in the conception, and design of the study; performed some statistical analyses, and assisted in the drafting of the manuscript. All authors read and approved the manuscript.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guerra, M., Ferri, C., Llibre, J. et al. Psychometric properties of EURO-D, a geriatric depression scale: a cross-cultural validation study. BMC Psychiatry 15, 12 (2015). https://doi.org/10.1186/s12888-015-0390-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-015-0390-4

Keywords

BMC Psychiatry

ISSN: 1471-244X

Contact us