Mapping the PHQ-8 to EQ-5D, HUI3 and SF6D in patients with depression
BMC Psychiatry volume 21, Article number: 451 (2021)
There is limited evidence of mapping clinical instruments to a generic preference-based instrument in Asian patient populations. The current study aims to map the eight-item Patient Health Questionnaire depression scale (PHQ-8) onto the EuroQol Five-Dimension (EQ-5D), the Health Utilities Index Mark 3 (HUI3) and the Short Form Six-Dimension (SF-6D) which helps to inform future cost-utility analyses of treatments for depression.
A total of 249 participants who had completed PHQ-8, EQ-5D, SF-6D and HUI3 questionnaires were included in the analyses. A beta regression mixture model was used to map the utility scores as a function of PHQ-8 total scores, PHQ-squared, age and gender. The predictive accuracy of the models was examined using mean absolute error and root mean square error.
The results were compared against two common regression methods including Ordinary Least Square (OLS) and Tobit regression models. The mean age of the sample was 36.2 years (SD = 11.1). The mean EQ-5D-3L, EQ-5D-5L, HUI3 and SF-6D utility scores were 0.615, 0.709, 0.461 and 0.607, respectively. The EQ-5D-3L, EQ-5D-5L and SF-6D utility scores were best predicted by the beta mixture regression model consisting of PHQ-8 total sores, PHQ-squared, and covariates including age and gender. The HUI3 was best predicted by the OLS regression model.
The current study provides important evidence to clinicians and researchers about the mapping algorithms that can be used in economic evaluation among patients with depression.
Depression is a severe mental disorder that causes substantial impairment to the individual and a significant burden to their family members and society. It is a highly prevalent mental disorder affecting 264 million of the global population. The total direct excess costs of depression per person ranges from USD$124 to USD$18,174 in adults and between $2868 and $2883 in adolescents . The cost of lost productivity in terms of absenteeism and presenteeism varies across countries. The absenteeism costs associated with depression were the highest in Japan ($2674), while presenteeism costs were $5524 in the United States and $5788 in Brazil . Depression has been strongly linked to an increased risk of suicide which is the leading cause of death among adolescents . Due to increasing efforts worldwide to develop more effective treatment options and strategies for people with depression, there is a growing need for conducting health technology assessments such as cost-effectiveness analysis (CEA) and cost-utility analysis (CUA) to assess the quality, safety, efficacy, and cost-effectiveness of services.
The EuroQol Five-Dimension (EQ-5D), Short Form Six-Dimension (SF-6D), and Health Utilities Index Mark 3 (HUI3) are commonly used generic preference-based instruments to measure health-related quality of life among patients with depression in the literature [4, 5]. These instruments are used to calculate quality-adjusted life-years (QALYs) in CEA and CUA. In the clinical setting, however, these instruments are often not used. Therefore, mapping a clinical instrument to a generic preference-based instrument to generate statistical formulas or functions that allow the clinical instruments to estimate utility scores provides an alternative solution to generate QALYs for CEA and CUA in clinical studies [5, 6]. The Patient Health Questionnaire (PHQ)  is one of the most widely used clinical instruments to measure symptom severity of depression in a clinical setting. Hence, developing a mapping function based on PHQ that can produce accurate utility scores would help clinicians and psychiatrists address the unmet needs for CEA and CUA among patients with depression. These mapping functions are particularly useful when comparing QALYs results of patients with depression across treatments, interventions, and care programs. Clinicians and psychiatrists from public hospitals as well as policymakers would find this helpful in identifying needs when planning healthcare services, setting priorities, allocating resources, and evaluating outcomes and effectiveness of the treatments, interventions, and care programs in the clinical setting and community. Given that there is limited data on mapping studies using the PHQ to estimate the utility scores among people with depression, the current study aims to map the PHQ onto the EQ-5D, HUI3, and SF-6D to inform cost-utility analyses of treatment for depression.
The study was conducted between August 2016 and November 2017 at a tertiary psychiatric hospital, which serves the majority of psychiatric patients in Singapore. Patients were included in the study if they were Singapore citizens or permanent residents, aged 21 years and above, literate in English, and had a clinical diagnosis of depressive disorder. A total of 249 participants who had completed PHQ-8, EQ-5D, SF-6D and HUI3 questionnaires were included in the analyses.
The relevant institutional ethics review board approved the study (National Healthcare Group Domain Specific Review Board (DSRB) (Reference no: 2016/00215). Written informed consent was obtained from all study participants.
The eight-item Patient Health Questionnaire (PHQ-8) is a self-reported questionnaire designed to measure depressive symptom severity in research and clinical care . It assesses how often in the past 2 weeks, participants experienced eight depressive symptoms. Each symptom is rated on a 4-point Likert scale ranging from 0 (not at all) to 3 (nearly every day), with total scores ranging from 0 to 24. The PHQ-8 has been widely used to measure the severity of depressive symptoms in psychiatric patients in Singapore [8, 9].
The EQ-5D is a generic preference-based measure for subjectively describing and valuing health-related quality of life that has been developed by the EuroQol Group . It comprises two versions – EQ-5D-3L and EQ-5D-5L. The EQ-5D-3L includes five questions on mobility, self-care, pain, usual activities, and psychological status with three possible answers for each item (1 = no problem, 2 = moderate problem, 3 = severe problem). The utility scores of EQ-5D-3L were calculated using the scoring algorithm developed in Singapore . The EQ-5D-5L is a new version of the EQ-5D comprising five questions on mobility, self-care, pain, usual activities, and psychological status with five possible responses for each item (1 = no problem, 2 = slight problems, 3 = moderate problems, 4 = severe problems, 5 = extreme problems). The utility scores of EQ-5D-5L were developed by van Hout et al. using a crosswalk project that maps EQ-5D-5L utility scores from the EQ-5D-3L .
The HUI3 is a generic comprehensive health status classification instrument . It generates utility scores using a utility scoring function derived from a representative sample of the general Canadian population based on the Standard Gamble and visual analogue scale methods . The utility score ranged between − 0.36 and 1. The HUI3 comprises eight domains: vision, hearing, speech, ambulation, dexterity, emotion, cognition, and pain. Per attribute, 5 to 6 levels are derived from 15-multiple choice questions. The utility scores obtained from Chinese and Malay versions of the HUI3 have been found to be equivalent and valid in Singapore .
The Short Form-36 Health Survey is a generic instrument that can be used to generate SF-6D utility scores using a utility scoring function derived from a representative sample of the general UK population . The utility score ranged between 0.29 and 1. It has six domains: physical functioning, role limitation, social functioning, pain, mental health, and vitality, with 4–6 levels for each domain. The utility scores derived from Chinese and English versions of the SF-6D have been demonstrated to be equivalent and valid in Singapore .
Statistical analyses were carried out using the STATA software version 13 (StataCorp LP, College Station, TX). The overlap between the source and the target instruments were calculated using the Spearman correlation coefficient. Since the distribution of utility scores derived from generic preference-based measures such as EQ-5D are often not normally distributed and have a higher ceiling effect at a value of 1 , we used a beta regression mixture model (betamix) to map the utility scores. In this study, a beta mixture regression model was used as a primary statistical model to predict different points of health instruments. The model has an advantage over other regression models in terms of its flexibility and ability to capture different points of health utility scores, including negative values (health state worse than death), the peak of observation at full health or death, the gap between boundary values and a mixture of number components of beta distributions. The results were compared against two common regression methods, including Ordinary Least Square (OLS) and Tobit regression models . The beta regression mixture model is a two-part model that incorporates a multinomial logit model and a beta mixture model in their algorithms. Studies have increasingly suggested that this regression method outperforms the linear regression model [20,21,22]. In order to determine the best performance of the prediction model, three regression methods with 18 different model specifications consisting of three model specifications in each OLS and Tobit, and 12 model specifications in the beta mixture regression models with up to two components with and without truncation and probability mass at full health and truncation point were included in the current analyses. The first model included only PHQ-8 total scores as a main predictor for the utility score; the second model included PHQ-8 total scores, age, and gender. The third model included PHQ-8 total scores, PHQ-squared, age, and gender. The performance of regression methods was assessed using the following criteria. Both mean absolute error (MAE) and root mean square error (RMSE) were used as the main criterion to compare the performance of regression methods. Values from both indices were ranked and summed to get an average ranking. The regression model with the lowest average ranking values (ARV) was considered to be the best prediction model [6, 22, 23].
The descriptive statistics are presented in Table 1. The sample included 249 participants with depression. The mean age of the overall sample was 36.2 years (SD = 11.1), 69.9% were Chinese, 13.7% were Malays, 14.4% were Indians, and 2% belonged to other ethnicities. The EQ-5D-3L showed a mean (SD) index score of 0.615 (0.317) with minimum and maximum scores of − 0.2999 and 1, while the mean (SD) EQ-5D-5L index was 0.709 (0.212) with minimum and maximum scores of − 0.027 and 1, respectively. The mean (SD) HUI3 index score was 0.461 (0.331) with minimum and maximum scores of − 0.289 and 1, while the mean SF-6D was 0.607 (0.105) with minimum and maximum scores of 0.385 and 0.958, respectively. The distribution of the EQ-5D-3L, EQ-5D-5L, and HUI3 utilities showed a substantial skew to the right, that is, toward a better quality of life (Fig. 1). The mean (SD) PHQ-8 total score was 11.526 (6.590), with minimum and maximum scores of 0 and 24, respectively.
Correlations between source and target instruments
Table 2 shows the Spearman ‘s correlation coefficient results between the source and the target instruments. A strong inverse correlation was observed between the source instrument, i.e., PHQ-8, and the four target instruments (EQ-5D-3L, EQ-5D-5L, HUI3, and SF-6D). The correlation coefficient ranged between -0.61 and -0.78, suggesting a significant overlap between the source and the target instruments.
Mapping on EQ-5D-3L
Table 3 shows the performance of three regression methods (beta mixture regression, OLS, and Tobit) for mapping PHQ-8 to the EQ-5D-3L utility scores. Among the three regression methods and 18 model specifications, beta mixture regression method with two components with truncation, probability mass at full health (1), and the truncation point (0.8538) was the most parsimonious prediction model for the EQ-5D-3L utility scores. It produced the smallest average ranking of MAE (0.1765) and RMSE (0.2326) values compared to other regression methods and model specifications (Table 3). This regression model revealed that PHQ-squared scores were significantly and negatively associated with EQ-5D-3L utility scores in the first component and found that the PHQ-8 total scores and PHQ-squared were negatively and positively associated with the full health (Supplementary Table 1).
Mapping on EQ-5D-5L
Table 4 shows the performance of three regression methods for mapping the PHQ-8 to the EQ-5D-5L utility scores. Among the three regression methods and 18 model specifications, beta mixture regression method with two components with truncation and probability mass at full health (1) and truncation point (0.879) was the most parsimonious prediction model for the EQ-5D-5L utility scores. It produced the best prediction performance index (MAE = 0.1208 and RMSE = 0.1620) than other regression methods and other model specifications. In this regression model (Supplementary Table 2), age was significantly and negatively associated with the EQ-5D-5L utility scores in the first component utility scores. In contrast, PHQ-squared was significantly and negatively associated with the EQ-5D-5L utility scores in the second component and PHQ-squared and age were significantly and negatively associated with the full health (Supplementary Table 2).
Mapping on HUI3
Table 5 shows the performance of three regression methods for mapping the PHQ-8 to the HUI3 utility scores. Among the three regression methods and 18 model specifications, the OLS regression method with model 3 specification performed as the most parsimonious prediction model for the HUI3 utility scores. It produced the best prediction performance index (MAE = 0.1584 and RMSE = 0.2024). In this regression model, those with lower PHQ-8 total scores and of younger age were significantly associated with higher HUI3 scores (Supplementary Table 3).
Mapping on SF-6D
Table 6 shows the performance of three regression methods for mapping the PHQ-8 to the SF-6D utility scores. Among the three regression methods and 18 model specifications, beta mixture regression method with two components without truncation and probability mass at full health (1) was found to be the most parsimonious prediction model for the SF-6D utility scores. It produced the smallest average ranking of MAE (0.0519) and RMSE (0.0683). In this regression model, PHQ-8 total scores and age were significantly and negatively associated with the SF-6D utility scores in both components. Meanwhile, the female gender was significantly and negatively associated with the SF-6D utility scores in the first component (Supplementary Table 4).
The current study is among the few that have been conducted to map PHQ-8 scores on four common utility scores, the EQ-5D-3L, EQ-5D-5L, HUI3, and SF-6D, among people with depression in a multiethnic Asian population. In the current study, three different regression methods with 18 model specifications were explored to find the most parsimonious prediction model to develop mapping functions from the PHQ-8. The findings provide evidence that different predictive models should be used for mapping EQ-5D-3L, EQ-5D-5L, HUI3, and SF-6D in our sample. Our analyses showed that both versions of the EQ-5D utility scores were best predicted by the beta mixture regression model, consistently reported in other studies [20,21,22]. Our mapping algorithm for the HUI3 was best predicted by the ordinary least square model with minimal MSE and MAE values. We found PHQ-8 total scores, PHQ-squared scores, as well as age and gender to play a significant role in mapping the utility scores in the expected direction in the depression sample. For example, our findings show that the PHQ-8 total scores were significantly and negatively associated with the HUI3 and SF6D utility scores, while the quadratic term of the PHQ-8 total scores (i.e., PHQ-squared) was significantly and negatively associated with both the EQ-5D-3L and EQ-5D-5L. This reflects significant concave relationships between PHQ-8 total scores and EQ-5D utility scores. Our findings also show that age was significantly and negatively associated with the EQ-5D-5L, HUI3, and SF-6D utility scores, while the female gender was significantly and negatively associated with the SF-6D utility scores. These findings suggest that it is important to include patient’s key demographic characteristics such as age and gender to map the utility scores in the depression sample. It is important to note that the primary intention of the study is to develop a mapping function that best predicts utility scores derived from EQ-5D-3L, EQ-5D-5L, HUI3, and SF-6D, so whether the regression coefficients are statistically significant is of secondary consideration . In the current study, model selection was primarily determined by the MAE and MSE. In order to avoid bias, the choice of the best model was based on the average ranking of both indices instead of focusing exclusively on one fit index.
Several limitations should be acknowledged in the current study. Firstly, the utility values for EQ-5D-5L were based on a crosswalk project that maps EQ-5D-5L utility scores from the EQ-5D-3L. Secondly, due to the small sample size, we were unable to test whether the model works equally well in sub-samples of the overall sample. However, a recent guideline by the ISPOR Good Practice for Outcomes Research Task Force has not recommended splitting the sample to validate results on part of the sample . Hence, further validation of the current mapping findings using an external dataset is recommended. Nonetheless, to our knowledge, this is the first study to use beta mixture regression model against the Tobit and linear regression methods to map the PHQ-8 scale onto widely used generic preference-based measures specifically for depression patients.
In conclusion, we have generated the algorithm for converting PHQ-8 scores into utility scores that are easily applicable in the clinical setting when the EQ-5D-3L, EQ-5D-5L, HUI3, and SF-6D data are not available. The current study provides necessary details to clinicians and researchers on mapping algorithms that can be used in economic evaluations among patients with depression.
Availability of data and materials
Data are available upon reasonable request. Raw data from this study are currently not publicly available but can be made available upon reasonable request from the corresponding author.
Konig H, Konig HH, Konnopka A. The excess costs of depression: a systematic review and meta-analysis. Epidemiol Psychiatr Sci. 2019;29:e30. https://doi.org/10.1017/S2045796019000180.
Evans-Lacko S, Knapp M. Global patterns of workplace productivity for people with depression: absenteeism and presenteeism costs across eight diverse countries. Soc Psychiatry Psychiatr Epidemiol. 2016;51(11):1525–37. https://doi.org/10.1007/s00127-016-1278-4.
Bilsen J. Suicide and youth: risk factors. Front Psychiatry. 2018;9:540. https://doi.org/10.3389/fpsyt.2018.00540.
Longworth L, Yang Y, Young T, Mulhern B, Hernandez Alava M, Mukuria C, et al. Use of generic and condition-specific measures of health-related quality of life in NICE decision-making: a systematic review, statistical modelling and survey. Health Technol Assess. 2014;18(9):1–224. https://doi.org/10.3310/hta18090.
Brazier J, Connell J, Papaioannou D, Mukuria C, Mulhern B, Peasgood T, et al. A systematic review, psychometric analysis and qualitative assessment of generic preference-based measures of health in mental health populations and the estimation of mapping functions from widely used specific measures. Health Technol Assess. 2014;18:1–188 vii-viii, xiii-xxv.
Brazier JE, Yang Y, Tsuchiya A, Rowen DL. A review of studies mapping (or cross walking) non-preference based measures of health to generic preference-based measures. Eur J Health Econ. 2010;11(2):215–25. https://doi.org/10.1007/s10198-009-0168-z.
Kroenke K, Strine TW, Spitzer RL, Williams JB, Berry JT, Mokdad AH. The PHQ-8 as a measure of current depression in the general population. J Affect Disord. 2009;114(1-3):163–73. https://doi.org/10.1016/j.jad.2008.06.026.
Jeyagurunathan A, Vaingankar JA, Abdin E, Sambasivam R, Seow E, Pang S, et al. Gender differences in positive mental health among individuals with schizophrenia. Compr Psychiatry. 2017;74:88–95. https://doi.org/10.1016/j.comppsych.2017.01.005.
Shahwan S, Abdin E, Zhang Y, Sambasivam R, Fauziana R, Mahesh M, et al. Deliberate self-harm in psychiatric outpatients aged 14-35 years in Singapore. Ann Acad Med Singap. 2018;47:360–72.
EuroQol G. EuroQol--a new facility for the measurement of health-related quality of life. Health Policy. 1990;16(3):199–208. https://doi.org/10.1016/0168-8510(90)90421-9.
Luo N, Wang P, Thumboo J, Lim Y-W, Vrijhoef HJM. Valuation of EQ-5D-3L health states in Singapore: modeling of time trade-off values for 80 empirically observed health states. Pharmacoeconomics. 2014;32(5):495–507.
van Hout B, Janssen MF, Feng YS, Kohlmann T, Busschbach J, Golicki D, et al. Interim scoring for the EQ-5D-5L: mapping the EQ-5D-5L to EQ-5D-3L value sets. Value Health. 2012;15(5):708–15. https://doi.org/10.1016/j.jval.2012.02.008.
Feeny D, Furlong W, Boyle M, Torrance GW. Multi-attribute health status classification systems. Health Utilities Index. Pharmacoeconomics. 1995;7(6):490–502.
Horsman J, Furlong W, Feeny D, Torrance GW. The Health Utilities Index (HUI): concepts, measurement properties and applications. Health Qual Life Outcomes. 2003;16:1–54.
Luo N, Seng B-K, Thumboo J, Feeny D, Li S-C. A Study of the Construct Validity of the Health Utilities Index Mark 3 (HUI3) in Patients with Schizophrenia. Qual Life Res. 2006;15(5):889–98.
Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21(2):271–92.
Wee H-L, Cheung Y-B, Fong K-Y, Luo N, Machin D, Thumboo J. Are English- and Chinese-language versions of the SF-6D equivalent? A comparison from a population-based study. Clin Ther. 2004;26(7):1137–48.
Xie F, Pullenayegum EM, Li SC, Hopkins R, Thumboo J, Lo NN. Use of a disease-specific instrument in economic evaluations: mapping WOMAC onto the EQ-5D utility index. Value Health. 2010;13(8):873–8. https://doi.org/10.1111/j.1524-4733.2010.00770.x.
Tobin J. Estimation of relationships for limited dependent variables. Econometrica. 1985;26(1):24–36. https://doi.org/10.2307/1907382.
Gray LA, Hernandez Alava M, Wailoo AJ. Development of methods for the mapping of utilities using mixture models: mapping the AQLQ-S to the EQ-5D-5L and the HUI3 in patients with asthma. Value Health. 2018;21(6):748–57. https://doi.org/10.1016/j.jval.2017.09.017.
Gray LA, Wailoo AJ, Hernandez Alava M. Mapping the FACT-B instrument to EQ-5D-3L in patients with breast Cancer using adjusted limited dependent variable mixture models versus response mapping. Value Health. 2018;21(12):1399–405. https://doi.org/10.1016/j.jval.2018.06.006.
Kiadaliri A, Alava MH, Roos EM, Englund M. Mapping EQ-5D-3L from the knee injury and osteoarthritis outcome score (KOOS). Qual Life Res. 2020;29(1):265–74. https://doi.org/10.1007/s11136-019-02303-9.
Yang F, Wong CKH, Luo N, Piercy J, Moon R, Jackson J. Mapping the kidney disease quality of life 36-item short form survey (KDQOL-36) to the EQ-5D-3L and the EQ-5D-5L in patients undergoing dialysis. Eur J Health Econ. 2019;20(8):1195–206. https://doi.org/10.1007/s10198-019-01088-5.
Cheung YB, Luo N, Ng R, Lee CF. Mapping the functional assessment of cancer therapy-breast (FACT-B) to the 5-level EuroQoL Group’s 5-dimension questionnaire (EQ-5D-5L) utility index in a multiethnic Asian population. Health Qual Life Outcomes. 2014;12(1):180. https://doi.org/10.1186/s12955-014-0180-6.
Wailoo AJ, Hernandez-Alava M, Manca A. al. E: mapping to estimate health-state utility from non-preference-based outcome measures: an ISPOR good practices for outcomes research task force report. Value Health. 2017;20(1):18–27. https://doi.org/10.1016/j.jval.2016.11.006.
The authors would like to acknowledge and thank Dr. Monica Hernández Alava and her colleagues for their generosity in sharing the user-written Stata command “betamix.”
EA performed all analyses for the current manuscript. In collaboration with SAC, ES, KBT, and MS, EA formulated the research question and wrote the manuscript. In addition, EA, SAC, ES, and MS contributed to the data collection. All authors have read and approved the final manuscript.
Funding: This research is supported by the Singapore Ministry of’ ‘Health’s National Medical Research Council under the Health Services Research-New Investigator Grant.
(Grant No.: NMRC/HSRNIG/0014/2016).
Ethics approval and consent to participate
The relevant institutional ethics review board approved the study (National Healthcare Group Domain Specific Review Board (DSRB) (Reference no: 2016/00215). Written informed consent was obtained from all study participants. All study-related procedures were performed in accordance with the relevant guidelines and regulations.
Consent for publication
No individual person’s data is published in any form.
The authors do not have any Conflict of Interest to declare.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Abdin, E., Chong, S.A., Seow, E. et al. Mapping the PHQ-8 to EQ-5D, HUI3 and SF6D in patients with depression. BMC Psychiatry 21, 451 (2021). https://doi.org/10.1186/s12888-021-03463-0