Skip to main content

Validation and optimal cut-off score of the World Health Organization Well-being Index (WHO-5) as a screening tool for depression among patients with schizophrenia

Abstract

Background

The utility of the World Health Organization Wellbeing Index (WHO-5) as rapid screening tool for depression has not yet been researched in the context of schizophrenia. The goals of this study were twofold: (1) to test the psychometric properties of the WHO-5 in a sample of Arabic-speaking patients with schizophrenia from Lebanon, with particular emphasis on validating the WHO-5 as a screening tool for wellbeing and depression in patients with schizophrenia; and (2) to determine the optimal cut-off point to identify schizophrenia patients with depression.

Methods

Chronic, remitted patients with schizophrenia took part in this cross-sectional study between August and October 2023 (n = 117; mean age of 57.86 ± 10.88 years and 63.3% males). The Calgary Depression Scale for Schizophrenia (CDSS) was included as index of validity. For the validation of the WHO-5 scale, we performed a confirmatory factor analysis (CFA) using the original structure of the scale. To assess the discriminatory validity of the Arabic version of the WHO-5 as a screening tool for depression, we conducted a Receiver operating characteristic (ROC) curve analysis, taking the WHO-5 reversed score against the dichotomized CDSS score at a cut off value of 6.

Results

The results of CFA supported the originally proposed unidimensional structure of the measure, with good internal consistency reliability (α = 0.80), concurrent validity, and cross-sex measurement invariance. The WHO-5 showed a sensitivity of 0.8 and a specificity of 0.7 in the detection of depression with a cut-off point of 9.5. The validity of the WHO-5 as a screening tool for depression was supported by the excellent discrimination AUC value of 0.838. Based on this WHO-5 cut-off value, 42.6% of the patients were screened as having a depression.

Conclusion

The study contributes to the field by showing that the WHO-5 is a concise and convenient self-report measure for quickly screening and monitoring depressive symptoms in patients with schizophrenia. It is therefore highly recommended to apply this cut-off point for screening and follow-up assessments. The current findings will hopefully encourage clinicians and researchers working in Arab settings, who are often confronted with significant time and resource constraints, to start using the WHO-5 to aid their efforts in mitigating depression in this vulnerable population and fostering research in this under-researched area.

Peer Review reports

Introduction

Schizophrenia is one of the leading causes of disability worldwide [1]. It is now largely acknowledged that depression is considered to be a separate entity that is commonly encountered in schizophrenia, with an estimated pooled prevalence of 28.6% [2].

Depression in schizophrenia

The occurrence of depression in patients with schizophrenia causes substantial family, social, and economic burdens. Depression in schizophrenia negatively affects quality of life [3], and leads to increased suicide risk [4], as well as higher utilization of health services and criminal justice systems [5]. In addition, there is evidence that depression is commonly comorbid with anxiety, and that both conditions are significantly correlated with each other in patients with schizophrenia [6]. Prior research has also demonstrated that depression is a significant predictor of social functioning decline [7] and worse long-term global functional outcomes [8] in people diagnosed with schizophrenia. Despite its high prevalence and significant clinical and socioeconomic impacts, it remains under-detected and inadequately treated [9]. According to a recent meta-analysis [10], the severity of depressive symptoms remains persistent and shows no more than modest improvement in the course of illness regardless of the follow-up length for patients with schizophrenia spectrum disorders. According to the British Association for Psychopharmacology guidelines on the treatment of schizophrenia, the treatment of comorbid depressive symptoms is not receiving the warranted attention given how often they occur [11]. The National Institute for Health and Care Excellence (NICE) guidelines have pointed to the importance of routinely monitoring patients with schizophrenia for a possible coexisting depression [12]. This suggests that strategies for more effective monitoring, evaluation and management of depression in schizophrenia, especially in resource-limited settings, is needed. To this end, accurate measurement instruments which enable assessing depression in this specific population are essential.

Measurement instruments of depression in patients with schizophrenia

A systematic review of instruments available to evaluate depression occurring in the context of schizophrenia could identify five clinician-rated (i.e., the Montgomery Asberg Depression Rating Scale, the Hamilton Rating Scale for Depression, the Brief Psychiatric Rating Scale—Depression subscale, the Positive and Negative Syndrome Scale—Depression subscale, the Calgary Depression Scale for Schizophrenia [CDSS]) and only one self-report (i.e., the Beck Depression Inventory) measures reliable [13]. Although strong evidence indicates that the CDSS outperforms other depression tools in terms of validity and reliability in patients with schizophrenia [13, 14], it may require a considerable amount of time and interviewers’ training to be completed. For this reason, and despite recommending the use the CDSS as the most reliable and valid for the assessment of depressive symptoms of patients with schizophrenia in both daily clinical practice and in research, Lako et al. [13] called in their meta-analysis for the development of a novel valid self-report measure that can be more expedient for use in clinical practice. A more adequate and efficient alternative that could be considered for repeated assessments in which time and resources are critical factors is the self-report Five-item World Health Organization Well-being Index (WHO-5) [15].

The psychometric potential of the WHO-5 in patients with schizophrenia

The WHO-5 is a validated global rating measure initially designed to evaluate self-reported well-being in primary health care patients [15]. This shorter version was created from a longer 28-item original version [16] which was employed in a WHO multicentre study conducted in eight European countries [17]. The WHO-5 is composed of five positively phrased items (e.g., “I woke up feeling fresh and rested”) with the aim of measuring positive well-being, and scored on a five-point scale rated from 5 (all of the time) to 0 (none of the time). After its release, the WHO-5 has been translated into over 30 languages and became a widely used instrument in research projects around the globe, with considerable evidence supporting its good psychometric properties and utility [18]. The use of the WHO-5 has considerably increased in mental health settings, as it has been growingly considered a valuable patient-reported outcome assessment in a large array of medical settings and an important research measurement instrument in clinical studies [19]. However, the number of research conducted on psychometric properties of the WHO-5 in patients with schizophrenia spectrum disorders remains very limited, despite the measure having been previously applied in schizophrenia research (e.g [20, 21]). The few psychometric research conducted among this patient population showed that the WHO-5 has good validity, reliability and an invariant unidimensional structure across age, sex, and outpatient/inpatient status [22, 23].

Beyond its usefulness in the measurement and monitoring of well-being, the WHO-5 was found to be one of the main measures which has extensively demonstrated sufficient validity to screen for and early detect depression in different clinical and non-clinical populations across several settings, cultures and countries. Indeed, the WHO-5 showed clinical utility in the screening for depressive symptoms in community adults [24], healthcare workers during the COVID-19 [25], older adults residing in nursing homes [26], as well as in various clinical populations, such as patients with diabetes [27], people diagnosed with Parkinson’s disease [28], and adolescents with major depressive disorder [29]. A systematic review of the literature by Topp et al. [18] encompassing 213 studies revealed that the WHO-5 is sensitive and specific screening instrument for depression, and has a very high applicability across research fields. Surprisingly however, the utility of the WHO-5 as rapid screening tool for depression has not yet been researched in the context of schizophrenia. There is evidence to show that cut-off scores for the WHO-5 when used as a screening tool for depression cannot be generalized to different populations and settings [18]. For this reason, there appears the need to validate and determine the best cut-off score of the WHO-5 that predicts schizophrenia patients at risk for depression. As a brief and simple-to-administer tool in busy clinical services, the WHO-5 can help clinicians prevent an additional burden of depression among patients with schizophrenia by early detecting it, especially in low-resources settings in Arab countries like Lebanon.

Rationale of the present study

Comorbid depression in schizophrenia is found to be more prevalent in middle-income compared to high-income countries [2]. This can be explained by the fact that risk factors for comorbid depression in schizophrenia, such as trauma, social adversity, and medical conditions [8, 30], occur highly frequently in Low-Middle-Income Countries (such as the Arab Middle East and North Africa region [31,32,33]). For instance, studies found prevalence rates of depression in patients with schizophrenia of 25.6% in Saudi Arabia [34], 30% in Egypt [35], 36.3% in Qatar [34]. More particularly, Lebanon has been witnessing years of conflicts and continuing social, political and economic unrest. The 2020 Beirut blast and the COVID-19 pandemic further deteriorated the situation in Lebanon and significantly impacted people’s mental health [36]. The multilayered crisis has led to multiple negative consequences in Lebanese clinical populations, including an increase in the rates of depressive symptoms [37]. At the same time, prevention and research efforts regarding depression in schizophrenia are still poorly developed or inappropriate in this part of the world [38]. This considerable early detection and intervention gap may be mainly attributed to a very limited number of mental health professionals and a budget allowed for mental health that is “far below the range to promote mental health services” [39].

Providing evidence for the validity (sensitivity and specificity) and cultural appropriateness of an Arabic-language, user-friendly tool such as the WHO-5 in predicting depression in Arab patients with schizophrenia could aid in the planning and implementation of assessments, prevention and interventions throughout the disease course. Therefore, the goals of this study were twofold: (1) to test the psychometric properties of the WHO-5 (in terms of factor structure, internal consistency, sex invariance, and concurrent validity) in a sample of Arabic-speaking patients with schizophrenia from Lebanon, with particular emphasis on validating the WHO-5 as a screening tool for wellbeing and depression in patients with schizophrenia; and (2) to determine the optimal cut-off point to identify schizophrenia patients with depression. To achieve the second objective, the clinician-rated schizophrenia-specific outcome measure “Calgary Depression Scale for Schizophrenia” (CDSS [40]), is included as index of validity.

Methods

Sample and procedure

This cross-sectional study has been conducted during August and October 2023 using convenience sampling. The target sample was set as inpatients of the Psychiatric Hospital of the Cross, Jal Eddib (suburbs of the capital Beirut), Lebanon, with the following inclusion criteria: (1) age of 18 years and over, (2) with a schizophrenia or a schizoaffective disorder diagnosis following the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) criteria; (3) at chronic stage of the disease, defined as with more than 1 year of illness duration [41]; and institutionalized in the above-mentioned long-stay hospital for more than one year (The detailed description of the study population can be found elsewhere [32, 42]); (4) experiencing either partial or total recovery, this choice has been made as personal recovery represents a longitudinal process occurring in stages [43]; and (5) able to give their free and informed consent to participate after study objectives and general instructions were thoroughly explained to them (in case of inability to consent a family member did). This target population was chosen so that potential confounding effects of some factors, such as severity of psychotic symptoms, treatment adherence and substance use, are reduced or eliminated.

Minimal sample size calculation

A sample between 15 and 100 participants was needed for the confirmatory factor analysis based on a previous study that suggested a minimum sample ranging from 3 to 20 times the number of the scale’s variables [44].

Measures

Demographic and clinical characteristics

Data were gathered during a face-to-face interview of around 30–45 min with all participants. The questionnaire consisted of a first section containing demographic and clinical information, including age, sex, education level, marital status, duration of illness, and duration of hospitalization. In addition, four measures were either self- or interviewer-administered to all participants, including the Arabic validated version of the WHO [45]. The other three measures are the following:

The Calgary Depression Scale for Schizophrenia (CDSS)

This is a clinician-administered measure containing a total of 9 items with descriptive anchor points [46]. It specifically assesses depression among patients with schizophrenia and related psychoses. Its validity is well-known in strongly correlating with other measurement instruments of depression. The CDSS has also proven to accurately distinguish between depressive symptoms and extrapyramidal side effects and negative symptoms. The Arabic validated version of the CDSS was used [47] (ω = 0.82 / α = 0.81).

The 10-item Staden Schizophrenia anxiety rating scale (S-SARS)

This is a clinician-rated measure composed of ten items, five items measure general anxiety and five other items measure specific anxiety [48]. Each item has six narrative anchor points scored on a scale from 0 to 5, and indicating anxiety severity over the past week and is accompanied by guided questions for use during the interview as to inform the ratings. The Arabic validated version of the S-SARS was used [49] (ω = 0.90 / α = 0.89).

The Global Assessment of Functioning Scale (GAF)

This measure evaluates social functioning [50]. A number between 0 and 100 is assigned to each patient, summarizing the rater’ s view of the current degree of impairment in terms of educational, occupational, and/or psychosocial function.

Data Analysis

We performed a CFA on the total sample using the original structure of the scale. The method of estimation used was Maximum Likelihood. To check if the model was adequate, several fit indices were calculated: the normed model chi-square (χ²/df), the Steiger-Lind root mean square error of approximation (RMSEA), the Tucker-Lewis Index (TLI) and the comparative fit index (CFI). Values ≤ 5 for χ²/df, and ≤ 0.08 for RMSEA, and 0.95 for CFI and TLI indicate good fit of the model to the data [51]. Multivariate normality was not verified (Bollen-Stine bootstrap p = .002), therefore Bootstrap analysis was conducted. In case of high modification indices between two items, a correlation was added between the residuals of those items. Adding a correlation between those two residuals is done to improve the model fit when the assumption of uncorrelated errors is violated. It suggests that there are shared sources of variance not accounted for by the specified factors in the model. By adding this correlation, the model becomes more flexible and can better capture the underlying relationships in the data, leading to more accurate representation of the relationships between the observed variables and the latent factors being measured.

Sex invariance

To examine sex invariance of the WHO-5 scores, we conducted multi-group CFA [52] using the total sample. Measurement invariance was assessed at the configural, metric, and scalar levels [53]. Configural invariance implies that the latent scales variable(s) and the pattern of loadings of the latent variable(s) on indicators are similar across gender (i.e., the unconstrained latent model should fit the data well in both groups). Metric invariance implies that the magnitude of the loadings is similar across gender; this is tested by comparing two nested models consisting of a baseline model and an invariance model. Lastly, scalar invariance implies that both the item loadings and item intercepts are similar across gender and is examined using the same nested-model comparison strategy as with metric invariance [54]. We accepted ΔCFI ≤ 0.010 and ΔRMSEA ≤ 0.015 or ΔSRMR ≤ 0.010 as evidence of invariance [55].

Further analysis

We used Cronbach’s α coefficient and McDonald’s ω and Cronbach’s α coefficients to examine reliability since these two coefficients are used when the data show a normal distribution [56], with values greater than 0.70 reflecting adequate composite reliability. Missing values were replaced by the mean of the item. The WHO-5 scores were considered normally distributed according to their skewness and kurtosis values varying between ± 1 [57]. Consequently, the Student t test was used to compare two means. Pearson test was used to correlate those scores with other scores.

Screening accuracy for depression

To assess the discriminatory validity of the Arabic version of the WHO-5 as a screening tool for depression, we conducted a Receiver operating characteristic (ROC) curve analysis using the SPSS software v.26, taking the WHO-5 reversed score against the dichotomized CDSS score 6 [46]. “This curve plays a central role in evaluating diagnostic ability of tests to discriminate the true state of subjects, finding the optimal cut off values, and comparing two alternative diagnostic tasks when each task is performed on the same subject” [58]. The sensitivity and specificity values that show the highest area under the curve (AUC) correspond to the cut off value.

Results

One hundred seventy-seven patients filled the survey, with a mean age of 57.86 ± 10.88 years and 63.3% males. The majority (30.4%) had a primary and a complementary level of education, whereas 88.1% were single. The mean duration of illness was 35.22 ± 37.34 years, whereas that of the duration of hospitalization was 13.25 ± 10.92 years. Other characteristics of the sample can be found in Table 1.

Table 1 Sociodemographic and other characteristics of the patients (n = 177)

Confirmatory Factor Analysis (CFA) of the WHO-5 scale

The unidimensional model was tested via a CFA in the total sample; results indicated that the fit of the scale was excellent: χ2/df = 40.49/5 = 8.10, RMSEA = 0.220 (90% CI 0.160, 0.285), SRMR = 0.082, CFI = 0.856, TLI = 0.712 (Table 2). We noticed a high modification index between items 3 and 4 (= 33.21); when adding a correlation between those residuals, fit indices became excellent as follows: χ2/df = 2.75/4 = 0.69, RMSEA = 0.001 (90% CI < 0.001, 0.105), SRMR = 0.020, CFI = 1.000, TLI = 1.013. The reliability was excellent as shown via the alpha (= 0.80) and the omega (= 0.80) coefficients.

Table 2 Standardised estimates of factor loadings from the confirmatory factor analysis of the five-item World Health Organization Well-being Index (WHO-5)

Sex invariance of the WHO-5 scale

We were able to show partial invariance across gender at the configural, metric, and scalar levels (Table 3). No statistically significant difference between males and females was found in terms of WHO-5 scores (M = 16.78, SD = 7.28 vs. M = 15.24, SD = 6.85, t(146) = 1.24, p = .218).

Table 3 Measurement invariance of the five-item World Health Organization Well-being Index (WHO-5) across sex in the total sample

Concurrent validity

Higher anxiety (r = − .50; p < .001) and depression (r = − .66; p < .001) were significantly associated with lower WHO-5 scores, whereas higher levels of functioning (r = .55; p < .001) were significantly associated with greater WHO-5 scores.

ROC analysis of the WHO-5 tested against the CDSS

The ROC curve illustrating depression prediction using the WHO-5 scale is depicted in Fig. 1. It exhibited a substantial area under the curve of 0.838 [95% CI 0.773; 0.903]. Notably, one significant cut-off point was discerned at 9.5, which yielded a sensitivity of 81.1% and a specificity of 70.3%. In selecting this cut-off, higher sensitivity was favoured over specificity. The reason for this choice is that the objective of the WHO-5 as a screening tool in this context is to correctly capture most depressed patients with schizophrenia. As such, a sufficiently high sensitivity is likely to be of significance in screening for depression in this population. Using a WHO-5 cut-off score of 9.5, 42.6% of the patients were screened as having a depression.

Fig. 1
figure 1

ROC curve for the prediction of WHO-5 scores against CDSS

Discussion

The WHO-5 is one of the main measures which has extensively demonstrated sufficient validity to screen for and early detect depression in different clinical and non-clinical populations across several settings, cultures and countries around the globe. Our study offers two new insights. First, it examines psychometric properties of the WHO-5 for the first time in schizophrenia patients from a non-Western developing country and an Arab culture. Second, this is the first research to investigate the potential of the WHO-5 as a screening tool for depression in this clinical population. Our findings demonstrated that the WHO-5 measure in its Arabic version meets the required validity and reliability criteria. In addition, the WHO-5 showed a sensitivity of 0.81 and a specificity of 0.70 in the detection of depression with a cut-off point of 9.5. The validity of the WHO-5 as a screening tool for depression was supported by the excellent discrimination AUC value of 0.838.

Psychometric properties of the WHO-5 in patients with schizophrenia

First, the goodness of fit for the one-factor model of the Arabic WHO-5 was examined using CFA. The results of these analyses were in agreement with evidence of unidimensionality of the WHO-5 obtained by several validation studies carried-out in various clinical populations, including patients with epilepsy [59], diabetes [27], patients in primary care [60], as well as those in specialised community mental health settings [61]. A recently published validation study among Danish patients with schizophrenia spectrum disorders [22] provided support to the originally proposed unidimensional structure of the measure and good internal consistency reliability (Cronbach’s alpha was 0.80 in our Arabic-speaking Lebanese sample versus 0.826 in the Danish sample). Consistently, previous studies performed among individuals in mental health settings indicated good internal consistency, with Cronbach’s alpha coefficients ranging from 0.83 [62] to 0.92 [63]. Second, and consistent with the same study, measurement invariance of the WHO-5 was established between male and female patients, implying that no differential item functioning exists for sex [22]. Third, the concurrent validity findings revealed that WHO-5 scores were positively correlated with levels of functioning, and inversely correlated with anxiety and depression symptoms’ severity, thereby confirming the findings of earlier research studies [64,65,66]. Altogether, our psychometric findings were in line with the limited existing literature. A study performed among a sample of Spanish outpatients drawn from specialised community mental health centres (among them, 11.5% were diagnosed with schizophrenia) found that the WHO-5 was feasible to administer, yielded a good fit in a one-factor solution, and showed an excellent internal consistency (Cronbach’s α = 0.923) [61]. Another study involving 84 Chinese individuals diagnosed with schizophrenia, schizotypal and delusional disorders found that the Hong Kong Cantonese Version of the WHO-5 exhibited a single-factor structure and satisfactory internal consistency (Cronbach’s alpha coefficient of 0.86) [23]. Acceptable psychometric parameters of the Farsi WHO-5 were also found among Iranian psychiatric outpatients, with a one-factor structure identified, a Cronbach’s α value of 0.91 and negative correlations with depression measures [67].

Performance of the WHO-5 as a screening test for depression in patients with schizophrenia

A score of 6 on the CDSS, which is adopted as a valid cut-off indicating levels of depression at which treatment is needed (major depression) [46], corresponded to a WHO-5 score of 9.5. The area under the curve (AUC) values were greater than 0.80, indicating that the WHO-5 is successful as a screening tool to discriminate between patients who are at high risk and low risk for depression [68]. At this cut-off point, the sensitivity and specificity values were 0.81 and 0.70, respectively. Achieving sufficiently high sensitivity for a screening tool such as the WHO-5, so as to be able to correctly identify as many depressed patients as possible as screening positive, is a crucial target and a main challenge of depression detection. However, reaching high specificity, which refers to identifying as few “false positives” as possible (i.e., non-depressed patients who screen positive on the WHO-5) has less importance. This is because the rates of false positives can easily be controlled by a two-step approach screening, with an initial step consisting of an administration of the self-report WHO-5, followed by a structured diagnostic interview administered by trained clinicians. As this is the first study to investigate the optimal cut-off point of the WHO-5 to screen depression among patients with schizophrenia, comparison with previous findings in the same population is not possible. However, similar results were observed in other populations, such as adolescents, in whom cut-off point of nine was recommended, and yielded sensitivity and specificity values of 0.74-0.79 and 0.71-0.89, respectively [69, 70].Using a WHO-5 cut-off score of 9.5, 42.6% of the patients were screened as having a depression. This finding is consistent with that of a meta-analysis of 53 observational studies which highlighted high prevalence estimates of comorbid depression in schizophrenia ranging from 4.6 to 65.1%, with rates being greater in Middle-income than High-income countries (30.2% versus 27.1%, respectively) [2]. Depression is present in all phases of schizophrenia [71], and may have heavy detrimental effects on the course and prognosis of the disease (including more severe psychotic symptoms, longer disease duration [2], and high suicidality risk [4]). However, depression can also be effectively prevented and managed when timely detected [72]. This underscores the high relevance of using the WHO-5 as a brief, reliable, and valid scale, which is suitable for use in routine clinical practice for rapid screening of depression in people with schizophrenia.

Study limitations

To the best of our knowledge, the present study is among the very few to examine the psychometric properties of the WHO-5 in patients with schizophrenia, and the first to suggest a cut-off value of this tool in this population. Another important strength of this study is that a trained interviewer conducted structured interviews using the CDSS, which is considered a gold standard [73], to determine each patient’s depression level after administration of the self-report WHO-5. In addition, by involving an under-researched population from the Middle-East and the Arab world, our study makes a valuable contribution to the literature. The study has also limitations that need to be recognized. Patients were gathered from a single centre and country by the convenience sampling method; therefore, our findings lack generalisability. To address this limitation, further research should be performed in patients recruited by random sampling and from different countries/settings. Besides, the study sample was composed of a majority of males (63.3%). Future research needs to use a sex-proportionate sample to confirm our findings. In addition, only chronic inpatients residing a long-stay mental hospital were involved, and cannot be representative of the overall schizophrenia population. Future studies need to include outpatients, and those in the early stages of the disease. Another limitation lies to the adoption of a cross-sectional design. As follow-up data was not collected in this study, the test-retest reliability was not assessed. Researchers need to consider collecting data at multiple time points to remedy this limitation.

Current perspectives and future implications

The present findings provided additional evidence of good psychometric qualities of the WHO-5 in patients with schizophrenia, including good structural validity (unidimensionality), adequate internal consistency, and appropriate concurrent validity. Analyses also demonstrated that measurement equivalence across sexes was achieved, indicating that the WHO-5 measures the same underlying construct in male and female patients with schizophrenia, and that inferences of sex differences in WHO-5 scores are accurate. Overall, findings support the suitability and usefulness of the Arabic version of the WHO-5 in patients with schizophrenia for both clinical and research practices. In addition, the performance of the Arabic-language WHO-5 as a screening tool for depressive symptoms in patients with schizophrenia was tested and supported. It is therefore highly recommended to apply this cut-off point for screening and follow-up assessments. The current findings will hopefully encourage clinicians and researchers working in Arab settings, who are often confronted with significant time and resource constraints, to start using the WHO-5 to aid their efforts in mitigating depression in this vulnerable population and fostering research in this under-researched area. In particular, the WHO-5 can be an appropriate screening and monitoring tool for schizophrenia patients with an elevated vulnerability to depression, therefore enhancing the quality of care provided to this population. Indeed, detecting and monitoring patients’ depression can inform treatment decisions, and subsequently have major positive impact on their clinical outcomes [74]. The brevity of the WHO-5, its ease of use, and validity with the clinician-administered CDSS imply that the scale could be a valuable measure for recognizing comorbid depression in patients with schizophrenia using a cut-point of 9.5.

As for future research perspectives, future studies with larger and more representative samples of patients with schizophrenia in different stages of the disease and originating from different Arab countries are still warranted to confirm our conclusions about the good psychometric qualities of the WHO-5 as a screening tool for depression, and enable its widespread use among Arabic-speaking schizophrenia patients in different parts of the world. Such research might help advance knowledge regarding the prevalence, epidemiology, and cause of depression in patients with schizophrenia, and gain cross-cultural insights into factors that influence the expression of depressive symptoms, their diagnosis and treatment among Arabic-speaking schizophrenia patients.

Conclusion

The study contributes to the field by offering a brief self-report scale for depression screening and monitoring, the Arabic WHO-5, which is easily accessible, quick-to-administer, simple to understand and practical for use in routine clinical and research practices. As expected, findings suggest that the WHO-5 is an applicable and accurate tool for screening of depression among patients with schizophrenia. Analyses showed that a cut-off score of 9.5 on the WHO-5 can be considered to identify schizophrenia patients with depression. is the study’s results are expected to raise awareness about the necessity to consider depression as a key predictor of outcome and an important therapeutic target in patients with schizophrenia in Arab settings. Henceforth, clinicians and researchers working and dealing with Arabic-speaking schizophrenia patients in different clinical settings worldwide could feel more secure making informed decisions based on this tool.

Data availability

All data generated or analyzed during this study are not publicly available. The dataset supporting the conclusions is available upon request to the corresponding author.

References

  1. Collaborators GMD. Global, regional, and national burden of 12 mental disorders in 204 countries and territories, 1990–2019: a systematic analysis for the global burden of Disease Study 2019. Lancet Psychiatry. 2022;9(2):137–50.

    Article  Google Scholar 

  2. Li W, Yang Y, An F-R, Zhang L, Ungvari GS, Jackson T, Yuan Z, Xiang Y-T. Prevalence of comorbid depression in schizophrenia: a meta-analysis of observational studies. J Affect Disord. 2020;273:524–31.

    Article  PubMed  Google Scholar 

  3. Gardsjord ES, Romm KL, Røssberg JI, Friis S, Barder HE, Evensen J, Haahr U, ten Velden Hegelstad W, Joa I, Johannessen JO. Depression and functioning are important to subjective quality of life after a first episode psychosis. Compr Psychiatry. 2018;86:107–14.

    Article  PubMed  Google Scholar 

  4. Cassidy RM, Yang F, Kapczinski F, Passos IC. Risk factors for suicidality in patients with Schizophrenia: a systematic review, Meta-analysis, and Meta-regression of 96 studies. Schizophr Bull. 2018;44(4):787–97.

    Article  PubMed  Google Scholar 

  5. Conley RR, Ascher-Svanum H, Zhu B, Faries DE, Kinon BJ. The burden of depressive symptoms in the long-term treatment of patients with schizophrenia. Schizophr Res. 2007;90(1–3):186–97.

    Article  PubMed  Google Scholar 

  6. Li W, Zhao N, Yan X, Zou S, Wang H, Li Y, Xu X, Du X, Zhang L, Zhang Q. The prevalence of depressive and anxiety symptoms and their associations with quality of life among clinically stable older patients with psychiatric disorders during the COVID-19 pandemic. Translational Psychiatry. 2021;11(1):75.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Häfner H, Löffler W, Maurer K, Hambrecht M, Heiden Wad. Depression, negative symptoms, social stagnation and social decline in the early course of schizophrenia. Acta Psychiatrica Scandinavica. 1999;100(2):105–18.

    Article  PubMed  Google Scholar 

  8. Upthegrove R, Marwaha S, Birchwood M. Depression and schizophrenia: cause, consequence, or trans-diagnostic issue? Schizophr Bull. 2017;43(2):240–4.

    PubMed  Google Scholar 

  9. Lako IM, Taxis K, Bruggeman R, Knegtering H, Burger H, Wiersma D, Slooff CJ. The course of depressive symptoms and prescribing patterns of antidepressants in schizophrenia in a one-year follow-up study. Eur Psychiatry. 2012;27(4):240–4.

    Article  CAS  PubMed  Google Scholar 

  10. de Winter L, Vermeulen JM, Couwenbergh C, van Weeghel J, Hasson-Ohayon I, Mulder CL, Boonstra N, Veling W, de Haan L. Short-and long-term changes in symptom dimensions among patients with schizophrenia spectrum disorders and different durations of illness: a meta-analysis. J Psychiatr Res 2023.

  11. Barnes TR, Psychopharmacology, SCGotBAf. Evidence-based guidelines for the pharmacological treatment of schizophrenia: recommendations from the British Association for Psychopharmacology. J Psychopharmacol. 2011;25(5):567–620.

    Article  CAS  PubMed  Google Scholar 

  12. Health NCCM. Psychosis and schizophrenia in adults: treatment and management. 2014.

  13. Lako IM, Bruggeman R, Knegtering H, Wiersma D, Schoevers RA, Slooff CJ, Taxis K. A systematic review of instruments to measure depressive symptoms in patients with schizophrenia. J Affect Disord. 2012;140(1):38–47.

    Article  PubMed  Google Scholar 

  14. Scholes B, Martin C. Measuring depression in schizophrenia with questionnaires. J Psychiatr Ment Health Nurs. 2013;20(1):17–22.

    Article  CAS  PubMed  Google Scholar 

  15. Staehr JK. The use of well-being measures in primary health care-the DepCare project. World Health Organization, Regional Office for Europe: well-being measures in Primary Health Care-the DepCare Project Geneva. World Health Organization; 1998.

  16. Warr P, Banks M, Ullah P. The experience of unemployment among black and white urban teenagers. Br J Psychol. 1985;76(1):75–87.

    Article  PubMed  Google Scholar 

  17. Johansen K. World Health Organization multicentre continuous subcutaneous infusion pump feasibility and acceptability study experience. In.: WHO; 1989.

  18. Topp CW, Østergaard SD, Søndergaard S, Bech P. The WHO-5 well-being index: a systematic review of the literature. Psychother Psychosom. 2015;84(3):167–76.

    Article  PubMed  Google Scholar 

  19. Lara-Cabrera ML, Bjørkly S, De las Cuevas C, Pedersen SA, Mundal IP. Psychometric properties of the five‐item World Health Organization Well‐being Index used in mental health services: protocol for a systematic review. J Adv Nurs. 2020;76(9):2426–33.

    Article  PubMed  Google Scholar 

  20. Baandrup L, Fagerlund B, Glenthoj B. Neurocognitive performance, subjective well-being, and psychosocial functioning after benzodiazepine withdrawal in patients with schizophrenia or bipolar disorder: a randomized clinical trial of add-on melatonin versus placebo. Eur Arch Psychiatry Clin Neurosci. 2017;267(2):163–71.

    Article  PubMed  Google Scholar 

  21. Schöttle D, Janetzky W, Luedecke D, Beck E, Correll CU, Wiedemann K. The use of long-acting Aripiprazole in a multi-center, prospective, uncontrolled, open-label, cohort study in Germany: a report on global assessment of functioning and the WHO wellbeing index. BMC Psychiatry. 2020;20:1–11.

    Article  Google Scholar 

  22. Nielsen CM, Lauridsen HH, Østergaard SD, Kølbæk P. Structural validity of the 5-item World Health Organization Well-being Index (WHO-5) in patients with schizophrenia spectrum disorders. J Psychiatr Res. 2024;170:387–93.

    Article  PubMed  Google Scholar 

  23. Kong C-L, Lee C-C, Ip Y-C, Chow L-P, Leung C-H, Lam Y-C. Validation of the Hong Kong Cantonese version of World Health Organization five well-being index for people with severe mental illness. Eas as Psyc. 2016;26(1):18–21.

    CAS  Google Scholar 

  24. Low K-Y, Pheh K-S, Tan C-S. Validation of the WHO-5 as a screening tool for depression among young adults in Malaysia. Curr Psychol. 2023;42(10):7841–4.

    Article  Google Scholar 

  25. Seb-Akahomen OJ, Okogbenin EO, Obagaye OM, Erohubie PO, Aweh BE. The 5-Item WHO well-being index as a Screening Tool for Depression in a Population of doctors and nurses in Nigeria during the COVID-19 pandemic. Open J Depress. 2021;10(2):43–53.

    Article  Google Scholar 

  26. Allgaier AK, Kramer D, Saravo B, Mergl R, Fejtkova S, Hegerl U. Beside the geriatric Depression Scale: the WHO-Five well‐being Index as a valid screening tool for depression in nursing homes. Int J Geriatr Psychiatry. 2013;28(11):1197–204.

    Article  PubMed  Google Scholar 

  27. Cichoń E, Kiejna A, Kokoszka A, Gondek T, Rajba B, Lloyd CE, Sartorius N. Validation of the Polish version of WHO-5 as a screening instrument for depression in adults with diabetes. Diabetes Res Clin Pract. 2020;159:107970.

    Article  PubMed  Google Scholar 

  28. Schneider CB, Pilhatsch M, Rifati M, Jost WH, Wodarz F, Ebersbach G, Djundja D, Fuchs G, Gies A, Odin P. Utility of the WHO-five well‐being index as a screening tool for depression in Parkinson’s disease. Mov Disord. 2010;25(6):777–83.

    Article  PubMed  Google Scholar 

  29. Blom EH, Bech P, Högberg G, Larsson JO, Serlachius E. Screening for depressed mood in an adolescent psychiatric context by brief self-assessment scales – testing psychometric validity of WHO-5 and BDI-6 indices by latent trait analyses. Health Qual Life Outcomes. 2012;10(1):149.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Golubović B, Gajić Z, Ivetić O, Milatović J, Vuleković P, Đilvesi Đ, Golubović S, Vrban F, Subašić A, Rasulić L. FACTORS ASSOCIATED WITH DEPRESSION IN PATIENTS WITH SCHIZOPHRENIA. Acta Clin Croat. 2020;59(4):605–14.

    PubMed  PubMed Central  Google Scholar 

  31. Fekih-Romdhane F, Cheour M, Hallit S. Aggressive and violent behaviors in people with severe mental illness in arab countries. Handbook of anger, aggression, and violence. edn.: Springer; 2022. pp. 1–16.

  32. Rahme C, El Kadri N, Haddad C, Fekih-Romdhane F, Obeid S, Hallit S. Exploring the association between lifetime traumatic experiences and positive psychotic symptoms in a group of long-stay patients with schizophrenia: the mediating effect of depression, anxiety, and distress. BMC Psychiatry. 2023;23(1):29.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Ibrahim NK. Epidemiology of Mental Health Problems in the Middle East. In: Handbook of Healthcare in the Arab World edn. Edited by Laher I. Cham: Springer International Publishing; 2021: 133–149.

  34. Al-Ruwais N, AlHarbi Y, Abalkhail B, Ibrahim Y, Abounaem W, Heweidy S, Ahmaed R, Zaki NF, Zaki J. Screening for Depression among Schizophrenia patients: a cross-sectional study. Screening 2020, 23(1).

  35. El-Bahy M, Mohamed WM. Prevalence of depression in schizophrenic patients evaluated by the Calgary Depression Scale in Shebin El-Kom, Menoufiya. Middle East Curr Psychiatry. 2013;20(4):191–6.

    Article  Google Scholar 

  36. Hashim HT, Uakkas S, Reda A, Ramadhan MA, Al Mostafa MY. Beirut Explosion effects on COVID-19 Situation in Lebanon. Disaster Med Public Health Prep. 2022;16(5):1703–4.

    Article  PubMed  Google Scholar 

  37. Kassab A, Hachem CE, Raad G, Cordahi C, Richa S. Effects of a multilayered crisis on psychiatric hospitalizations in a university hospital in Lebanon; a retrospective study. Psychiatry Res. 2022;318:114940.

    Article  CAS  PubMed  Google Scholar 

  38. Fekih-Romdhane F, Abassi B, Ghrissi F, Loch AA, Cherif W, Damak R, Ellini S, Hallit S, Cheour M. Suicide risk among individuals at Ultra-high Risk (UHR) of psychosis in a developing north African country: a 12-month naturalistic prospective cohort study from the TRIP project. Psychiatry Res. 2023;327:115409.

    Article  PubMed  Google Scholar 

  39. Okasha A, Karam E, Okasha T. Mental health services in the arab world. World Psychiatry. 2012;11(1):52–4.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Addington D, Addington J, Maticka-Tyndale E, Joyce J. Reliability and validity of a depression rating scale for schizophrenics. Schizophr Res. 1992;6(3):201–8.

    Article  CAS  PubMed  Google Scholar 

  41. Hwang W, Weller W, Ireys H, Anderson G. Out-of-pocket medical spending for care of chronic conditions. Health Aff. 2001;20(6):267–78.

    Article  CAS  Google Scholar 

  42. Beainy C, Haddad C, Fekih-Romdhane F, Hallit S, Haddad G. Decreased insight, but not self-stigma or belief about medicine, is associated with greater severity of delusions in a sample of long-stay patients with schizophrenia: a cross-sectional study. BMC Psychiatry. 2023;23(1):222.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Davidson L, Roe D. Recovery from versus recovery in serious mental illness: one strategy for lessening confusion plaguing recovery. J Mental Health. 2007;16(4):459–70.

    Article  Google Scholar 

  44. Mundfrom DJ, Shaw DG, Ke TL. Minimum sample size recommendations for conducting factor analyses. Int J Test. 2005;5(2):159–68.

    Article  Google Scholar 

  45. Fekih-Romdhane F, Cherif W, Alhuwailah A, Fawaz M, Shuwiekh HAM, Helmy M, Hassan IHM, Naser AY, Zarrouq B, Chebly M et al. Cross-country validation of the arabic version of the WHO-5 well-being index in non-clinical young adults from six Arab countries. 2023. Available from: https://assets.researchsquare.com/files/rs-2988215/v1/5799c643-381c-4ce6-8a3e-ca1c5faeb1fa.pdf?c=1686241144

  46. Addington D, Addington J, Schissel B. Calgary Depression Scale for Schizophrenia (CDSS). American Psychiatric Association Task Force for the Handbook of Psychiatric Measures American Psychiatric Association Washington DC (2000) 2000:504–507.

  47. Hani Y, Ghuloum S, Mahfoud Z, Opler M, Khan A, Yehya A, Abdulhakam A, Hammoudeh S, Al-Mujalli A, Elsherbiny R. Validation of the arabic version of Calgary depression scale for schizophrenia. PLoS ONE. 2016;11(9):e0162304.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Van Staden W, Dlagnekova A, Naidu K. Validity and reliability of the Staden schizophrenia anxiety rating scale. Diagnostics. 2022;12(4):831.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Fekih-Romdhane F, Al Mouzakzak F, Abilmona G, Dahdouh O, Hallit S. Arabic translation and validation of the Clinician Administered Staden Schizophrenia Anxiety Rating Scale (S-SARS), 12 February 2024, PREPRINT. https://doi.org/10.21203/rs.3.rs-3950459/v1.

  50. Jones SH, Thornicroft G, Coffey M, Dunn G. A brief mental health outcome scale: reliability and validity of the Global Assessment of Functioning (GAF). Br J Psychiatry. 1995;166(5):654–9.

    Article  CAS  PubMed  Google Scholar 

  51. Hu Lt, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equation Modeling: Multidisciplinary J. 1999;6(1):1–55.

    Article  Google Scholar 

  52. Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equation Modeling: Multidisciplinary J. 2007;14(3):464–504.

    Article  Google Scholar 

  53. Vadenberg R, Lance C. A review and synthesis of the measurement in variance literature: suggestions, practices, and recommendations for organizational research. Organ Res Methods. 2000;3:4–70.

    Article  Google Scholar 

  54. Fekih-Romdhane F, Malaeb D, Fawaz M, Chammas N, Soufia M, Obeid S, Hallit S. Psychometric properties of an arabic translation of the multidimensional assessment of interoceptive awareness (MAIA-2) questionnaire in a non-clinical sample of Arabic-speaking adults. BMC Psychiatry. 2023;23(1):577.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Swami V, Todd J, Azzi V, Malaeb D, El Dine AS, Obeid S, Hallit S. Psychometric properties of an arabic translation of the functionality appreciation scale (FAS) in Lebanese adults. Body Image. 2022;42:361–9.

    Article  PubMed  Google Scholar 

  56. Trizano-Hermosilla I, Alvarado JM. Best Alternatives to Cronbach’s alpha reliability in realistic conditions: congeneric and asymmetrical measurements. Front Psychol. 2016;7:769.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Hair JF Jr, Sarstedt M, Ringle CM, Gudergan SP. Advanced issues in partial least squares structural equation modeling. saGe; 2017.

  58. Hajian-Tilaki K. Receiver operating characteristic (ROC) curve analysis for medical diagnostic test evaluation. Casp J Intern Med. 2013;4(2):627–35.

    Google Scholar 

  59. Chongwo E, Ssewanyana D, Nasambu C, Mwangala PN, Mwangi PM, Nyongesa MK, Newton CR, Abubakar A. Validation of a Swahili version of the World Health Organization 5-item well-being index among adults living with HIV and Epilepsy in rural coastal Kenya. Global Health Res Policy. 2018;3:1–7.

    Article  Google Scholar 

  60. Eser E, Çevik C, Baydur H, Güneş S, Esgin TA, Öztekin ÇS, Eker E, Gümüşsoy U, Eser GB, Özyurt B. Reliability and validity of the Turkish version of the WHO-5, in adults and older adults for its use in primary care settings. Prim Health care Res Dev. 2019;20:e100.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Lara-Cabrera ML, Mundal IP, De Las Cuevas C. Patient-reported well-being: psychometric properties of the world health organization well-being index in specialised community mental health settings. Psychiatry Res. 2020;291:113268.

    Article  PubMed  Google Scholar 

  62. Bonnín C, Yatham L, Michalak E, Martínez-Arán A, Dhanoa T, Torres I, Santos-Pascual C, Valls E, Carvalho A, Sánchez-Moreno J. Psychometric properties of the well-being index (WHO-5) Spanish version in a sample of euthymic patients with bipolar disorder. J Affect Disord. 2018;228:153–9.

    Article  PubMed  Google Scholar 

  63. Krieger T, Zimmermann J, Huffziger S, Ubl B, Diener C, Kuehner C, Holtforth MG. Measuring depression with a well-being index: further evidence for the validity of the WHO Well-Being Index (WHO-5) as a measure of the severity of depression. J Affect Disord. 2014;156:240–4.

    Article  PubMed  Google Scholar 

  64. Strauss GP, Sandt AR, Catalano LT, Allen DN. Negative symptoms and depression predict lower psychological well-being in individuals with schizophrenia. Compr Psychiatry. 2012;53(8):1137–44.

    Article  PubMed  Google Scholar 

  65. Hochstrasser L, Borgwardt S, Lambert M, Schimmelmann BG, Lang UE, Stieglitz R-D, Huber CG. The association of psychopathology with concurrent level of functioning and subjective well-being in persons with schizophrenia spectrum disorders. Eur Arch Psychiatry Clin Neurosci. 2018;268(5):455–9.

    Article  PubMed  Google Scholar 

  66. Vaingankar JA, Abdin E, Chong SA, Sambasivam R, Seow E, Jeyagurunathan A, Picco L, Stewart-Brown S, Subramaniam M. Psychometric properties of the short Warwick Edinburgh mental well-being scale (SWEMWBS) in service users with schizophrenia, depression and anxiety spectrum disorders. Health Qual Life Outcomes. 2017;15(1):153.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Dadfar M, Momeni Safarabad N, Asgharnejad Farid AA, Nemati Shirzy M, Ghazie pour Abarghouie F. Reliability, validity, and factorial structure of the World Health Organization-5 Well-Being Index (WHO-5) in Iranian psychiatric outpatients. Trends. 2018;40:79–84.

    Google Scholar 

  68. de Hond AA, Steyerberg EW, van Calster B. Interpreting area under the receiver operating characteristic curve. Lancet Digit Health. 2022;4(12):e853–5.

    Article  PubMed  Google Scholar 

  69. Allgaier AK, Pietsch K, Frühe B, Prast E, Sigl-Glöckner J, Schulte-Körne G. Depression in pediatric care: is the WHO-Five well-being Index a valid screening instrument for children and adolescents? Gen Hosp Psychiatry. 2012;34(3):234–41.

    Article  PubMed  Google Scholar 

  70. Ghazisaeedi M, Mahmoodi H, Arpaci I, Mehrdar S, Barzegari S. Validity, reliability, and optimal cut-off scores of the WHO-5, PHQ-9, and PHQ-2 to screen depression among University students in Iran. Int J Ment Health Addict. 2022;20(3):1824–33.

    Article  PubMed  Google Scholar 

  71. Naguy A. Depression in schizophrenia–A good or bad omen? Asia-Pacific Psychiatry. 2018;10(2):e12312.

    Article  PubMed  Google Scholar 

  72. Gregory A, Mallikarjun P, Upthegrove R. Treatment of depression in schizophrenia: systematic review and meta-analysis. Br J Psychiatry. 2017;211(4):198–204.

    Article  PubMed  Google Scholar 

  73. Kontaxakis V, Havaki-Kontaxaki B, Stamouli S, Margariti M, Collias C, Christodoulou G. Comparison of four scales measuring depression in schizophrenic inpatients. Eur Psychiatry. 2000;15(4):274–7.

    Article  CAS  PubMed  Google Scholar 

  74. Upthegrove R. Depression in schizophrenia and early psychosis: implications for assessment and treatment. Adv Psychiatr Treat. 2009;15(5):372–9.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank all patients who participated in this study.

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

FFR and SH involved in the study design. FFR wrote the manuscript; FAM and GA were responsible for the data collection. SH involved in data analysis and interpretation. OD revised the paper for intellectual content. All authors approved its final version.

Corresponding authors

Correspondence to Feten Fekih-Romdhane or Souheil Hallit.

Ethics declarations

Ethics approval and consent to participate

The Ethics and Research Committee of the Psychiatric Hospital of the Cross approved this study protocol. A written informed consent was obtained from all patients. All methods were performed in accordance with the relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fekih-Romdhane, F., Al Mouzakzak, F., Abilmona, G. et al. Validation and optimal cut-off score of the World Health Organization Well-being Index (WHO-5) as a screening tool for depression among patients with schizophrenia. BMC Psychiatry 24, 391 (2024). https://doi.org/10.1186/s12888-024-05814-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-024-05814-z

Keywords