- Research article
- Open Access
- Open Peer Review
Utility of the PHQ-9 to identify major depressive disorder in adult patients in Spanish primary care centres
BMC Psychiatryvolume 17, Article number: 291 (2017)
The prevalence of major depressive disorder (MDD) in Spanish primary care (PC) centres is high. However, MDD is frequently underdiagnosed and consequently only some patients receive the appropriate treatment. The present study aims to determine the utility of the Patient Health Questionnaire-9 (PHQ-9) to identify MDD in a subset of PC patients participating in the large PsicAP study.
A total of 178 patients completed the full PHQ test, including the depression module (PHQ-9). Also, a Spanish version of the Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I) was implemented by clinical psychologists that were blinded to the PHQ-9 results. We evaluated the psychometric properties of the PHQ-9 as a screening tool as compared to the SCID-I as a reference standard.
The psychometric properties of the PHQ-9 for a cut-off value of 10 points were as follows: sensitivity, 0.95; specificity, 0.67. Using a cut-off of 12 points, the values were: sensitivity, 0.84; specificity, 0.78. Finally, using the diagnostic algorithm for depression (DSM-IV criteria), the sensitivity was 0.88 and the specificity 0.80.
As a screening instrument, the PHQ-9 performed better with a cut-off value of 12 versus the standard cut-off of 10. However, the best psychometric properties were obtained with the DSM-IV diagnostic algorithm for depression. These findings indicate that the PHQ-9 is a highly satisfactory tool that can be used for screening MDD in the PC setting.
Current Controlled Trials ISRCTN58437086. Registered 20 May 2013.
Major depressive disorder in Spanish primary care
The vast majority of mental disorders in Spain are diagnosed in primary care (PC), which serves as a gateway to treatment and to the entire public health system . In this context, emotional disorders are often misdiagnosed, with rates of up to 78% for depression, 71% for generalized anxiety disorder (GAD), and 86% for panic disorder . Moreover, even among patients who are correctly diagnosed, only 35.8% of those with depression and 30.7% of those with any anxiety disorder receive adequate treatment  (i.e., most patients receive primarily pharmacological treatment, which is not recommended in clinical practice guidelines ). These mental disorders impose an important economic and societal burden on European countries, including Spain [5, 6].
Major depressive disorder (MDD) is highly prevalent in Spanish PC centres, with 9.6% of attendees suffering from this disorder each year , although this figure is lower than the mean prevalence rate (19%) in European countries . Nevertheless, due to the absence of systematic screening tests, general practitioners (GPs) only recognize about 60% of cases of MDD , partly because this condition is frequently comorbid with other physical, somatic, and/or psychological problems such as anxiety disorders or alcohol abuse . Based on international guideline recommendations (such as the NICE) to manage depression, it is clear that improved assessment methods (for both screening and diagnosis) are needed to improve MDD identification in order to refer these individuals to the appropriate therapeutic intervention . For this reason, screening tests are very helpful to obtain a quick, initial identification of a possible case of MDD; however, such tools are not sufficiently reliable to be used as the sole detection instrument [10, 11]. Thus, clinical interviews are required as a second step to confirm diagnoses. The use of these screening tools followed by clinical interviews should increase the efficiency of PC centres and improve overall public health outcomes for MDD.
One screening test that could be used in PC centres to identify MDD is the PHQ-9 . This self-report instrument is derived from the Primary Care Evaluation of Mental Disorders (PRIME-MD), which was originally developed to identify five mental disorders: depression, anxiety, alcohol abuse, somatoform disorder, and eating disorder. A systematic review of 16 studies that were carried out to identify depression  concluded that although there are many valid tools, the PHQ-9 is equal or superior to other instruments. In this context, given that the operating characteristics of these instruments are similar, selection of the optimal tool to identify MDD should depend on its feasibility, administration and scoring times, and the capability of the instrument to serve additional purposes, such as monitoring depression severity or response to therapy. Indeed, several meta-analyses recommended the PHQ-9 to identify depression in the PC setting because, it can be administered easily, quickly, and in a wide range of clinical contexts [14, 15]. For instance, Gilbody et al.  analysed 17 validation studies (> 5000 participants), concluding that the PHQ-9 has good psychometric properties (sensitivity 0.80, specificity 0.92) using either the ≥10 cut-off score or the “diagnostic algorithm” method. Manea, Gilbody and Mcmillan  analysed a total of 18 studies (7180 patients, 927 with MDD confirmed by diagnostic interviews), concluding that the PHQ-9 shows acceptable psychometric properties for MDD. In that study, using the widely-recommended cut-off score of 10, sensitivity was 0.85 and specificity 0.89, with no substantial differences in pooled sensitivity and specificity for cut-off scores ranging from 8 to 11.
The PHQ-9 items closely follow the nine criteria specified in the DSM-IV diagnostic manual (the core criteria for MDD have not changed in the DSM-5). Patients use Likert scales to rate the presence of symptoms in the prior two weeks. Depending on frequency (“not at all”, “several days”, “more than half of the days”, and “almost every day”), the nine items are scored from 0 to 3 points (total severity scores range from 0 to 27 points). Total scores of 10–14 points, 15–19 points, and 20–27 points indicate, respectively, moderate, moderately severe, and severe levels of depressive symptoms. When the PHQ-9 is used as a screening test, the most widely recommended cut-off value is 10, as previous research has demonstrated that this cut-off value provides the best combination of sensitivity (0.88) and specificity (0.88) . The PHQ-9 has also been proposed for use as a diagnostic tool using a specific coding algorithm based on the DSM-IV criteria for MDD in which MDD is diagnosed if at least one of the two first symptoms (items) is rated with a 2 (more than half of the days) or a 3 (most days) and four of the remaining items are also rated with a score of 2 or 3 (with the exception of item 9 [suicide], in which a rating of 1 is sufficient). However, the general consensus is that the PHQ-9 can be used as a screening test but not as a diagnostic test [12,13,14,15].
The construct validity of the PHQ-9 has been demonstrated in PC patients in many countries, including Spain , Brazil , China , East-Africa , Holland , South-Africa , the US  and others. These studies indicate that the PHQ has a high convergent validity with other depression measures. However, questions have been raised with regard to the optimal cut-off scores for screening to obtain the most accurate results on the PHQ-9. For example, a meta-analysis  suggested that the PHQ-9 presented good screening properties with both the ≥10 cut-off and the “diagnostic algorithm” method, but that the cut-off point may be increased to ≥11 or ≥12 to obtain optimum specificity in some community-based studies. In a recent review, Kroenke et al.  argued against using an inflexible adherence to a single cut-off score; rather, those authors argue that the cut-off should be adjusted to the target population. Manea et al.  found no significant differences in sensitivity or specificity between a cut-off score of 10 and other cut-off scores (ranging from 8 to 11), but suggested that a cut-off of 11 may represent the best trade-off between sensitivity and specificity. Although the optimal cut-off point is controversial and may depend on the target population, the PHQ-9 presents a reasonably good sensitivity and specificity when used as a screening tool, regardless of the precise cut-off point. By contrast, in studies conducted to assess the validity of the “diagnostic algorithm”, results have been more ambiguous. A recent meta-analyses performed to assess 27 validation studies of the PHQ-9 algorithm scoring method in various settings concluded that—in most cases—sensitivity was low but specificity was good . Similarly, Mitchell et al.  conducted a meta-analysis of 26 publications reporting on 40 individual studies (n = 26,902 patients), finding that the best estimates of sensitivity and specificity for the PHQ-9 algorithm were 0.57 and 0.93, respectively. So, the PHQ-9 can be used as a screening test using different cut-off scores but the psychometric properties of the “diagnostic algorithm” were not as good.
Few studies have evaluated the Spanish version of the PHQ-9. The first study by Diez-Quevedo et al.  was conducted to validate the Spanish version of the whole PHQ (including the 9 items for depression) in an inpatient setting, finding that this 9-item part of the PHQ-9 yielded satisfactory sensitivity (0.84) and excellent specificity (0.92) for MDD compared to the gold standard at that time (i.e., the Structured Clinical Interview for DSM-III-R). However, the profile of patients in PC centres is likely to differ substantially from those treated in a psychiatric inpatient setting. A Spanish version of the PHQ-9 has also been evaluated for use in PC centres in Honduras, with all of the linguistic and cultural differences implied by that setting . However, only one study has focused on a Spanish version of the PHQ-9 for Spain . In that study, although the sample was obtained from Spanish PC centres, the PHQ-9 was administered by telephone, and thus reported internal consistency of the PHQ-9 applies only to telephone administration. Consequently, little is known about how the PHQ9 performs in Spanish PC centres, nor do we know the optimal cut-off criteria that would be most appropriate in this context in Spain.
The aim of the present study was to assess the utility of the PHQ-9 as a screening test to identify MDD in patients at Spanish PC centres. We performed psychometric analyses to identify the sensitivity and specificity of the PHQ-9 total score to obtain the optimal cut-off value based on diagnoses obtained with the standardized clinical interview (Structured Clinical Interview for DSM-IV Axis I Disorders; SCID-I). Additionally, we tested sensitivity and specificity of the “diagnostic algorithm”.
The study was conducted from January to December 2014 at five PC centres participating in the larger PsicAP study , a clinical trial designed to evaluate the diagnosis and treatment of emotional disorders among PC patients in Spain. The centres are located in several cities in Spain (two in Valencia, and one each in Albacete, Vizcaya, and Mallorca).
Patient health questionnaire (PHQ)
The PHQ is a self-report screening test derived from the PRIME-MD test . The PHQ also includes modules to assess somatization (PHQ-15), depressive disorder (PHQ-9), panic disorder (PHQ-PD), generalized anxiety disorder (GAD-7), eating disorders, and alcohol-related disorders. In this study, we used the Spanish GAD-7 validation by García-Campayo et al. , which contains the 7 GAD items.
The PHQ-9  is part of the PHQ and consists of nine items to assess for the presence of the nine diagnostic criteria for major depression according to DSM-IV. The PHQ-9 evaluates the presence of the following symptoms over the previous two-week period: (a) depressed mood; (b) anhedonia; (c) sleep problems; (d) feelings of tiredness; (e) changes in appetite or weight; (f) feelings of guilt or worthlessness; (g) difficulty concentrating; (h) feelings of sluggishness or worry; (i) suicidal ideation. Items are answered on a four-point Likert scale from 0 to 3 as follows: 0 (never), 1 (several days), 2 (more than half of the days), and 3 (most days). Internal consistency was satisfactory in the current sample (McDonald’s ω = .89) and all item-test correlations were >.40. A public version of the PHQ-9, written in Spanish for use in Spain, provided by the authors of the PHQ was used in this study.
Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I)
The Spanish Version of this semi-structured interview  was conducted by clinical psychologists (7 in total) who had received intensive training by an expert clinical psychologist (see Cano-Vindel et al.  for more details). The interview sessions were supervised by the same clinical psychologist for the duration of the study. Patients were diagnosed with MDD when they presented at least five of the DSM-IV criteria during the last two weeks: that is ≥ one of the first two symptoms and ≥ four of the remaining symptoms.
Patients with anxious, depressive or physical symptoms without a clear biological basis were asked by the GPs to participate in the PsicAP clinical trial (see Cano-Vindel et al. ). They received the Patient Information Sheet and provided informed consent. Next, an individual meeting was arranged to review the study details with the participants and to complete the PHQ and the other tests. Computerized versions of these tests were used in most cases. Patients with impaired vision received help in completing the questionnaires. Paper versions of the measures were provided to patients with difficulties using the computer. After completing the PHQ-9, participants were asked to participate in the SCID-I interview, which was then scheduled within a maximum of 2 weeks from completion of the PHQ-9. Prior to administration of the SCID-I, all participants received a Patient Information Sheet of this sub-study and signed an informed consent form. All clinical psychologists conducting the interviews were blinded to the results of the PHQ-9.
This study was approved by the Corporate Clinical Research Ethics Committee of Primary Care of Valencia (CEIC-APCV) (as the national research ethics committee coordinator) and the Spanish Medicines and Health Products Agency (AEMPS) (N EUDRACT: 2013–001955-11 and Protocol Code: ISRCTN58437086).
A receiver operating characteristic (ROC) curve analysis was performed using data from the 178 patients that completed the PHQ-9 and were interviewed with the SCID-I; this statistical analysis was performed using the pROC package  for the statistical programming environment R . The following ratios were calculated: sensitivity, specificity, positive and negative predictive values, and positive and negative likelihood ratios. To evaluate the test’s screening properties, we used the sum scores of the PHQ-9 and the “diagnostic algorithm”. The optimal cut-off value to balance sensitivity and specificity was defined as the value corresponding to the maximum value of the Youden’s index, calculated as (sensitivity + specificity – 1) .
All patients between 18 and 65 years (inclusive) who presented at one of these five PC centres for somatic or psychological complaints during the study inclusion period were invited to participate (n = 298). Of these, 260 participants (186 females) completed the PHQ and 178 (125 females) were interviewed using the SCID-I. In terms of socio-demographic variables, no differences were observed between the whole sample and the subset of participants who completed the SCID-I interview (as indicated by t-tests or chi-squared tests, depending on variable type; all p ≥ .35). The Vizcaya centre, however, had a slightly higher dropout rate. Table 1 shows the socio-demographic variables and data on prescription medications taken by the patients.
Of the 260 patients included in our study, 178 completed the clinical interviews with the SCID-I. The prevalence of MDD seen in our PC population was high: 129 of 178 patients (72.5%) met the criteria for MDD on the SCID-I, while 49 patients (27.5%) did not fulfil these criteria.
Of the 260 patients who completed the PHQ, 141 (54%) met the criteria for somatization disorder (SD; (PHQ-15 ≥ 5), 68% for MDD (n = 178) according to the DSM-IV “diagnostic algorithm” or 78% PHQ-9 for scores ≥10 (n = 203) and 69% for GAD (GAD-7 ≥ 10; n = 180). 110 participants (42%) met the criteria for panic disorder according to the modified algorithm of the PHQ-PD and 22% (n = 57) met panic disorder criteria according to the original algorithm of the PHQ-PD. Finally, 17% (n = 45) met criteria for eating disorder) and 14% (n = 38) for alcohol-related disorder. As expected, comorbidity between disorders was high, particularly for comorbid MDD and GAD (n = 150; 57%), SD and MDD (n = 115; 44%), and GAD and SD (n = 117; 45%). Overall, 40% of the participants with MDD presented comorbidity with either GAD or SD (n = 104). We found no differences between the total sample of PHQ-9 respondents (n = 260) and the subsample of PHQ-9 and SCID-I respondents (n = 178) in terms of the proportion of participants that met criteria for one or more of the aforementioned disorders, nor with regard to comorbidities (all p > .61). See Table 2 for details.
Operating characteristics of the PHQ-9 using different cut-off scores
The ROC curve analysis showed that the PHQ-9 had an area under the curve of 0.89 (Fig. 1). The most widely used cut-off value for correctly identifying cases with MMD is ≥10. In our study, of the patients diagnosed with MDD according to SCID-I, 95% had scores >10 on the PHQ-9 while 67% of patients without a SCID-I diagnosis of MDD scored below the cut-off level (< 10). As a result, the PHQ-9 had a sensitivity of 0.95, a specificity of 0.67, positive and negative predictive values of 0.88 and 0.83, respectively, and positive and negative likelihood ratios, respectively, of 2.90 and 0.08. Increasing the PHQ-9 cut-off point to 12 yielded the following values: sensitivity, 0.84; specificity, 0.78; positive and negative predictive values of 0.91 and 0.66, respectively; and positive and negative likelihood ratios of 3.76 and 0.20, respectively. Most (84%) depressed patients (SCID-I diagnosis) had scores of 12 or higher, whereas 78% of patients without a depression diagnosis scored below the cut-off point. Moreover, according to the Youden’s index, which offers the optimal cut-off value balancing sensitivity and specificity (sensitivity + specificity – 1), the most appropriate cut-off value was 14 (J = 0.66), whereas these values were lower when other cut-off scores were used, as follows: 10 (J = 0.62), 11 (J = 0.63), 12 (J = 0.62). With a cut-off score of 14, the PHQ-9 showed the following psychometric properties: sensitivity, 0.78; specificity, 0.88; positive and negative predictive values, 0.94 and 0.60, respectively; and positive and negative likelihood ratios, 6.33 and 0.26, respectively (Table 3 shows other possible cut-off points and confidence intervals).
Operating characteristics of the PHQ-9 using the “diagnostic algorithm”
Of the patients with a SCID-I diagnosis of MDD, 88% were also identified as having major depression according to the PHQ-9 “diagnostic algorithm”. By contrast, 80% of non-depressed patients (SCID-I) did not reach the diagnostic cut-off point. Based on these data, the PHQ-9 presented a sensitivity of 0.88, a specificity of 0.80, positive and negative predictive values, respectively, of 0.92 and 0.72, and positive and negative likelihood ratios of 4.33 and 0.15, respectively. The highest value for the Youden’s index (J = 0.68) was obtained for the PHQ-9 “diagnostic algorithm”. (Table 3 provides mores details, including confidence intervals and alternative cut-off points).
In this study, we assessed the utility of the PHQ-9 as a screening tool to identify MDD in users of Spanish PC services. The main appeal of the PHQ-9 is that it is an easy to administer and inexpensive self-report measure. Our main finding is that the PHQ-9 is of value in identifying MDD in patients at Spanish PC centres, but our findings suggest that a higher cut-off value (12 or more) or the “diagnostic algorithm” might be better than the standard 10-point cut-off value in order to improve specificity in this patient population.
Our results show that the PHQ-9 is a sensitive screening instrument for MDD, and in most cases it correctly identified individuals with MDD when the most common cut-off point (10 points) was used [12, 13, 35]. Unexpectedly, the specificity of the PHQ-9 in our study was much lower than reported in previous studies, suggesting more false positive diagnoses of MDD. Increasing the cut-off point to 12 resulted in a slight decrease in sensitivity but specificity improved to a more satisfactory value, yielding a more acceptable trade-off. At the 12-point cut-off, the positive predictive value increased while the negative predictive value decreased. According to the Youden’s index, the most appropriate cut-off score was 14 (J = 0.66) compared to a cut-off score of 10 (J = 0.62), 11 (J = 0.63), 12 (J = 0.62). Using a cut-off point of 14, the sensitivity was 0.78 and the specificity 0.88. To reduce false negatives, an important characteristic of a good screening tool is a high sensitivity. For this reason, we suggest a cut-off score of 12 in the context of Spanish PC centres due to the high sensitivity (0.84) achieved with this cut-off level. However, the optimal cut-off in other populations may vary and other authors have recommended adjusting the cut-off point to suit the target population [13, 14]. Given that sensitivity is vital in the PC setting, we believe that a moderate specificity (found in the cut-off score of 10) is acceptable. Thus, rather than strictly following the Youden’s index, we believe that our recommendations are more appropriate for clinicians in this setting.
Using the original DSM-IV algorithm to identify MDD, the results of the PHQ-9 were satisfactory, with a very high sensitivity (0.88) and good specificity (0.80). Consequently, the positive predictive value was quite high, the negative predictive value was acceptable, and the positive and negative likelihood ratios were, therefore, also good. Moreover, the Youden’s index showed the best index value (J = 0.68) when using the “diagnostic algorithm” compared to other cut-off scores. Overall, these results indicate that, from a psychometric perspective, the DSM-IV “diagnostic algorithm” is superior to most common cut-off scores of 10 or the other suggested values (ranging from 12 to 14 points), with an excellent ability to correctly differentiate between depressed and non-depressed individuals. Furthermore, the satisfactory positive and negative predictive values of the PHQ-9 show that the test is excellent for ruling out non-MDD cases but can also adequately confirm MDD. These findings are also consistent with the Spanish validation study , which also found high sensitivity and specificity under these conditions, as the “diagnostic algorithm” was used in the depression section. Based on these findings, we believe the DSM-IV algorithm should be used with the PHQ-9. In contrast to some previous research [24, 25, 36], these results suggest that the PHQ-9 can be used as a screening test when the DSM-IV “diagnostic algorithm” is used. That said, it is important to stress that the “diagnostic algorithm” used for screening purposes should not be confused with a diagnosis of MDD. We agree with Mitchell et al.  that the PHQ-9 should not be used as the only source of information to confirm a clinical diagnosis. Thus, the “diagnostic algorithm” for the PHQ-9 may serve as a useful screening method to quickly and efficiently identify MDD or other depressive symptoms in the PC setting. However, patients with suspected MDD should be referred for a clinical interview performed by an experienced clinician to confirm the diagnosis and to determine secondary causes.
This study presents some limitations that may have contributed to the discrepant results compared with other studies. To start with, patient recruitment required a referral by the GP, who informed patients about this clinical trial involving psychological treatment. This recruitment approach likely resulted in some degree of selection bias, which may have partially affected our results. This influence may have been negative because it seems probable that the low specificity of the PHQ-9 observed in our sample using a 10-point cut-off value may be attributable to some participants exaggerating their symptoms on the questionnaire to ensure eligibility for treatment. This hypothesis is supported by the fact that many patients with scores >20 (indicative of severe depression) were diagnosed as only mildly depressed on the SCID-I interview. Additionally, in previous studies, patients scoring >20 on that test did not present severe MDD . In fact, based on those findings, Zimmerman et al.  called for caution in using the PHQ-9 to guide treatment selection until the thresholds to define severity ranges have been empirically established. Importantly, based on these findings, we have since modified the protocol of the PsicAP study  to prevent misuse: patients with PHQ-9 scores above 20 are automatically interviewed with the SCID-I to confirm the severity of their depression. Another limitation is that many patients that participated in our study presented symptoms of other emotional disorders, such as anxiety, somatizations, and mood disorders. Given that anxiety and depression share common features , this may explain the high rates of comorbidity. Thus, it is possible that patients suffering from anxiety or somatizations may have depressive symptoms that did not meet DSM-IV criteria for MDD on the SCID-I. In turn, this would have affected specificity estimates in our data. In fact, it is possible that the “diagnostic algorithm” performed better than other cut-off values because it is better adapted to these circumstances that are typically observed in the applied clinical setting. Therefore, the PHQ-9 may have some ecological validity for PC settings, where comorbidity is high and resources and available time are scarce. However, more studies are needed in Spanish PC centres to replicate these results and to identify possible boundary conditions. Additionally, given that the DSM-5 and DSM-IV use the same algorithm to diagnose MDD, a fertile area for future research would be to investigate the relationship between the PHQ and the restructured broader diagnoses of DSM-5 affective disorders.
This is the first study to assess the PHQ-9 to obtain the optimal cut-off values for screening patients with MDD in the PC setting in Spain. The findings presented in this study indicate that the PHQ-9 is a valuable tool to help to identify suspected cases of MDD among patients treated at Spanish PC centres. Based on our results, in this population we recommend using a cut-off value of 12 or the DSM-IV “diagnostic algorithm” instead of the most common cut-off value of 10. Patients identified by the PHQ-9 screening tool with suspected MDD must be referred to specialised clinicians to confirm the diagnosis with other diagnostic measures and/or clinical interviews.
Spanish Medicines and Health Products Agency
Corporate Clinical Research Ethics Committee of Primary Care of Valencia
Fifth Edition of the Diagnostic and Statistical Manual of Mental Disorders
Fourth Edition of the Diagnostic and Statistical Manual of Mental Disorders
Generalized anxiety disorder
7-item Generalized Anxiety Disorder
Major depressive disorder
Patient Health Questionnaire
15-item Patient Health Questionnaire
9-item Patient Health Questionnaire
Patient Health Questionnaire-Panic Disorder
Primary Care Evaluation of Mental Disorders
Psicología en Atención Primaria
Receiver operating characteristic
Structured Clinical Interview for DSM Axis-I Disorders
Cano-Vindel A. Los desórdenes emocionales en Atención Primaria [Emotional disorders in primary care]. Ansiedad y Estrés. 2011;17(1):75–97.
Fernández A, Pinto-Meza A, Bellón JA, et al. Is major depression adequately diagnosed and treated by general practitioners? Results from an epidemiological study. Gen Hosp Psychiatry. 2010;32(2):201–9.
Fernández A, Haro JM, Codony M, et al. Treatment adequacy of anxiety and depressive disorders: primary versus specialised care in Spain. J Affect Disord. 2006;96:9–20.
National Institute for Health and Clinical Excellence (NICE). Common mental health problems: identification and pathways to care. London, UK: National Institute for Health and Clinical Excellence (NICE); 2011.
Parés-Badell O, Barbaglia G, Jerinic P, et al. Cost of disorders of the brain in Spain. PLoS One. 2014;9(8):e105471.
Gili M, Roca M, Basu S, McKee M, Stuckler D. The mental health risks of economic crisis in Spain: evidence from primary care centres, 2006 and 2010. Eur J Pub Health. 2013;23(1):103–8.
Mitchell AJ, Vaze A, Rao S. Clinical diagnosis of depression in primary care: a meta-analysis. Lancet. 2009;374(9690):609–19.
Serrano-Blanco A, Palao DJ, Luciano JV, et al. Prevalence of mental disorders in primary care: results from the diagnosis and treatment of mental disorders in primary care study (DASMAP). Soc Psychiatry Psychiatr Epidemiol. 2010;45(2):201–10.
Cano A, Salguero JM, Wood CM, Dongil E, Latorre JM. La depresión en atención primaria: prevalencia, diagnóstico y tratamiento. Pápeles del Psicólogo. 2012;33(1):2–11.
National Collaborating Centre for Mental Health (UK). Depression: the treatment and management of depression in adults (updated edition). British Psychological Society. 2010.
Malpass A, Dowrick C, Gilbody S, Robinson J, Wiles N, Duffy L, et al. Usefulness of PHQ-9 in primary care to determine meaningful symptoms of low mood: a qualitative study. Br J Gen Pract. 2016;66(643):e78–84.
Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.
Williams JW, Pignone M, Ramirez G, Perez SC. Identifying depression in primary care: a literature synthesis of case-finding instruments. Gen Hosp Psychiatry. 2002;24(4):225–37.
Gilbody S, Richards D, Brealey S, Hewitt C. Screening for depression in medical settings with the patient health questionnaire (PHQ): a diagnostic meta-analysis. J Gen Intern Med. 2007;22(11):1596–602.
Manea L, Gilbody S, McMillan D. Optimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): A meta-analysis. CMAJ. 2012;184(3):E191-6.
Pinto-Meza A, Serrano-Blanco A, Peñarrubia MT, Blanco E, Haro JM. Assessing depression in primary care with the PHQ-9: can it be carried out over the telephone? J Gen Intern Med. 2005;20(8):738–42.
de Lima OF, Vilela Mendes A, Crippa JA, Loureiro SR. Study of the discriminative validity of the phq-9 and phq-2 in a sample of Brazilian women in the context of primary health care. Perspect Psychiatr Care. 2009;45(3):216–27.
Chen I-P, Liu S-I, Huang H-C, et al. Validation of the Patient Health Questionnaire for Depression Screening Among the Elderly Patients in Taiwan. Int J Gerontol. 2016;10(4):193–7.
Gelaye B, Williams MA, Lemma S, et al. Validity of the patient health questionnaire-9 for depression screening and diagnosis in east Africa. Psychiatry Res. 2013;210(2):653–61.
Phelan E, Williams B, Meeker K, et al. A study of the diagnostic accuracy of the PHQ-9 in primary care elderly. BMC Fam Pract. 2010;11:63.
Cholera R, Gaynes BN, Pence BW, et al. Validity of the patient health questionnaire-9 to screen for depression in a high-HIV burden primary healthcare clinic in Johannesburg, South Africa. J Affect Disord. 2014;167:160–6.
Löwe B, Kroenke K, Herzog W, Gräfe K. Measuring depression outcome with a brief self-report instrument: sensitivity to change of the patient health questionnaire (PHQ-9). J Affect Disord. 2004;81(1):61–6.
Kroenke K, Spitzer RL, Williams JBW, Löwe B. The patient health questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. Gen Hosp Psychiatry. 2010;32(4):345–59.
Manea L, Gilbody S, McMillan D. A diagnostic meta-analysis of the patient health questionnaire-9 (PHQ-9) algorithm scoring method as a screen for depression. Gen Hosp Psychiatry. 2015;37(1):67–75.
Mitchell AJ, Yadegarfar M, Gill J, Stubbs B. Case finding and screening clinical utility of the patient health questionnaire (PHQ-9 and PHQ-2) for depression in primary care: a diagnostic meta-analysis of 40 studies. British Journal of Psychiatry Open. 2016;2(2):127–38.
Diez-Quevedo C, Rangil T, Sanchez-Planell L, Kroenke K, Spitzer RL. Validation and utility of the patient health questionnaire in diagnosing mental disorders in 1003 general hospital Spanish inpatients. Psychosom Med. 2001;63(4):679–86.
Wulsin L, Somoza E, Heck J. The feasibility of using the Spanish PHQ-9 to screen for depression in primary Care in Honduras. Prim Care Companion J Clin Psychiatry. 2002;4(5):191–5.
Cano-Vindel A, Muñoz-Navarro R, Wood CM, et al. Transdiagnostic cognitive behavioral therapy versus treatment as usual in adult patients with emotional disorders in the primary care setting (PsicAP study): protocol for a randomized controlled trial. JMIR Res Protoc. 2016;5(4):e246.
Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary care evaluation of mental disorders. Patient health questionnaire. JAMA. 1999;282(18):1737–44.
García-Campayo J, Zamorano E, Ruiz MA, et al. Cultural adaptation into Spanish of the generalized anxiety disorder-7 (GAD-7) scale as a screening tool. Health Qual Life Outcomes. 2010;8(1):8.
First M, Spitzer R, Gibbon M, Williams J. Entrevista clínica estructurada para los trastornos del eje I del DSM-IV: SCID-I. Barcelona, Spain, Masson; 1999.
Robin X, Turck N, Hainard A, et al. pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics. 2011;12(1):77.
R Development Core Team R. R: A Language and Environment for Statistical Computing. Vol 1.; 2011.
Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3(1):32–5.
Muñoz-Navarro R, Cano-Vindel A, Wood CM, et al. The PHQ-PD as a screening tool for panic disorder in the primary care setting in Spain. PLoS One. 2016;11(8):e0161145.
Wittkampf K, van Ravesteijn H, Baas K, et al. The accuracy of patient health questionnaire-9 in detecting depression and measuring depression severity in high-risk groups in primary care. Gen Hosp Psychiatry. 2009;31(5):451–9.
Zimmerman M, Martinez JH, Friedman M, Boerescu DA, Attiullah N, Toba C. How can we use depression severity to guide treatment selection when measures of depression categorize patients differently? J Clin Psychiatry. 2012;73(10):1287–91.
Brown TA, Barlow DH. A proposal for a dimensional classification system based on the shared features of the DSM-IV anxiety and mood disorders: implications for assessment and treatment. Psychol Assess. 2009;21(3):256.
We thank the Ministerio de Economía y Competitividad, Psicofundación, Spanish Foundation for the Promotion and Development of Scientific and Professional Psychology, the Colegio Oficial de Psicólogos de Madrid, the Colegio Oficial de Psicólogos de Valencia and Fundación Mutua Madrileña who kindly helped this project with support funding.
We thank all the PsicAP Research Group who kindly participated in this large project.
We also thank Bradley Londres for his assistance in editing and improving the manuscript.
Ministerio de Economía y Competitividad, Psicofundación, Spanish Foundation for the Promotion and Development of Scientific and Professional Psychology, the Colegio Oficial de Psicólogos de Madrid, the Colegio Oficial de Psicólogos de Valencia and Fundación Mutua Madrileña.
Availability of data and materials
The study data are only available upon request. The name(s) of the contact person(s) to request data are available upon request to all interested researchers. Legal and ethical restrictions make data available upon request and are in accordance with the nature of the data collection. Data are available from the promoter (Spain) for researchers who meet the criteria for access to confidential data. Contact: Psicofundación (Spanish Foundation for the Promotion and Development of Scientific and Professional Psychology). Address: Calle Conde de Peñalver, 45, 5o izquierda, 28,006 Madrid, Spain.
The study is conducted in accordance with the Spanish Data Security Law. All professionals participating in the study agreed to adhere to the Helsinki Declaration and to Spanish law. All health care professionals participating in the study are required to sign a form indicating their agreement to adhere to the above-mentioned declaration and Spanish law.
The patient names and all other confidential information fall under medical confidentiality rules and are treated according to Spanish Data Security Law. The patient questionnaires are stored on a protected central server and saved in an encrypted database. The project complies with current guidelines in Spain and EU for patient protection in clinical trials with regards to the collection, storage and the keeping of personal data. Only direct members of the internal study team can access the data.
Ethics approval and consent to participate
The sample of this study comes of a multi-centre Randomized Clinical Trial with medication (N EUDRACT: 2013–001955-11 and Protocol Code: ISRCTN58437086) promoted by the Psicofundación (Spanish Foundation for the Promotion and Development of Scientific and Professional Psychology) and approved by the Corporate Clinical Research Ethics Committee of Primary Care of Valencia (CEIC-APCV) (as the national research ethics committee coordinator) and the Spanish Medicines and Health Products Agency. Approval was received by both agencies in November 2013, prior to study initiation in December 2013.
Patient informed consent: Prior to study participation, all patients receive written and oral information in the Patient Information Sheet about the content and extent of the planned study. This includes information about the potential benefits and risks for their health. Patients who agree to participate are required to sign the informed consent form. In the case of patients who withdraw from the study, all data will be destroyed or the patient will be asked if he/she agrees to allow the use of existing data for analysis in the study.
Patient participation in the study is completely voluntary and participants can withdraw at any time with no need to provide reasons and without negative consequences for their future medical care. The protocols used in this study pose no risk whatsoever to the participants. CBT is non-invasive at the cognitive level, except with regards to learning or teaching.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.