- Study protocol
- Open Access
Blended care vs. usual care in the treatment of depressive symptoms and disorders in general practice [BLENDING]: study protocol of a non-inferiority randomized trial
BMC Psychiatry volume 17, Article number: 218 (2017)
The majority of patients with depressive disorders are treated by general practitioners (GPs) and are prescribed antidepressant medication. Patients prefer psychological treatments but they are under-used, mainly due to time constraints and limited accessibility. A promising approach to deliver psychological treatment is blended care, i.e. guided online treatment. However, the cost-effectiveness of blended care formatted as an online psychological treatment supported by the patients’ own GP or general practice mental health worker (MHW) in routine primary care is unknown. We aim to demonstrate non-inferiority of blended care compared with usual care in patients with depressive symptoms or a depressive disorder in general practice. Additionally, we will explore the real-time course over the day of emotions and affect, and events within individuals during treatment.
This is a pragmatic non-inferiority trial including 300 patients with depressive symptoms, recruited by collaborating GPs and MHWs. After inclusion, participants are randomized to either blended care or usual care in routine general practice. Blended care consists of the ‘Act and Feel’ treatment: an eight-week web-based program based on behavioral activation with integrated monitoring of depressive symptomatology and automatized feedback. GPs or their MHWs coach the participants through regular face-to-face or telephonic consultations with at least three sessions. Depressive symptomatology, health status, functional impairment, treatment satisfaction, daily activities and resource use are assessed during a follow-up period of 12 months. During treatment, real-time fluctuations in emotions and affect, and daily events will be rated using ecological momentary assessment. The primary outcome is the reduction of depressive symptoms from baseline to three months follow-up. We will conduct intention-to-treat analyses and supplementary per-protocol analyses.
This trial will show whether blended care might be an appropriate treatment strategy for patients with depressive symptoms and depressive disorder in general practice.
Netherlands Trial Register: NTR4757; 25 August 2014. http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=4757. (Archived by WebCite® at http://www.webcitation.org/6mnXNMGef)
Depressive disorders are common. Up to 15% of people in high-income countries experience a major depressive episode at least once in their lifetime [1, 2] Depressive disorders cause high personal and economic burden of disease through their effects on many aspects of life such as participation and functioning [3–5]
The majority of patients (65% to 80%) with mild and moderate depression are treated by general practitioners (GPs) [6–11]. GPs in many countries including the Netherlands are recommended to use a (collaborative) stepped care management approach in the treatment of depression with antidepressants appearing only in the second step [12, 13]. Nevertheless, in routine general practice an estimated 70% of cases are primarily treated with antidepressants worldwide [9, 14–16]. This is worrisome as there is increasing evidence that antidepressants, while bringing about side effects, are ineffective in patients with mild to moderate depressive disorders which are particularly common in general practice [17–19]. This contrasts with psychological treatments that have convincingly shown effectiveness in these patients . Moreover, most patients prefer psychological treatment .
Clear barriers for the implementation of psychological treatment in general practice exist. First, most GPs have too little time and experience to offer psychological treatment themselves [22, 23]. Second, referral for psychological treatment is hampered by limited accessibility due to practical barriers, such as high costs of treatment, limited availability of trained professionals and transportation issues [22, 24, 25]. Next, patients may experience emotional barriers such as feared stigmatization .
Referral by GPs to web-based programs for the treatment of depression circumvents these problems effectively by providing direct availability of psychological treatment at home. Several systematic reviews demonstrated the effectiveness of online psychological treatment in the treatment of depression [27–29]. Interventions without therapist guidance, however, showed small mean effect size and low adherence. In contrast, web-based interventions guided by a therapist (blended care) displayed relatively large mean effect size and better adherence [27–29], even comparable to face-to-face psychological treatment [30, 31]. Better adherence to treatment is important also for psychological interventions, as it is associated with greater response to treatment . Therefore, guidance seems essential in the online treatment of depression. Importantly, it can be delegated to less trained or less experienced professionals (i.e. task-sharing) .
In previous trials on blended care in general practice, experienced professionals such as clinical psychologists or psychiatrist guided the patients [34–42]. In none of these studies were participants guided by their own GP or mental health worker (MHW). This may impair the generalizability of the results of these studies to Dutch general practice or similar settings. MWHs support primary care in delivering good quality mental health care by providing brief and simplified psychological treatment, blended care or self-help [43, 44]
In previous studies mainly online psychological interventions based on cognitive behavioral therapy (CBT) have been studied [38, 42, 45–47]. In a recent study behavioral activation has been shown as effective and more cost-effective compared to CBT  and it has been experienced as less complicated and more accessible to patients and therapists . MHWs can learn this technique relatively quickly and its effectiveness is comparable to behavioral activation delivered by more specialist staff with more training . Therefore in this trial we evaluate a blended behavioral activation treatment (guided ‘Act and Feel’ treatment).
Blended care has been expected to reduce costs, because part of the psychological treatment is provided online. However, a limited number of studies assessed the cost-effectiveness of blended care in general practice [50, 51].
To our knowledge, this is the first study investigating the effectiveness and cost-effectiveness of a blended behavioral activation treatment for depressive symptoms and disorders as performed in routine general practice.
Study design and aims
This study is a pragmatic, two-arm non-inferiority randomized controlled trial with an economic evaluation in general practice. The primary aim is to study the short-term (i.e. three months) effectiveness of a blended behavioral activation treatment compared to care as usual (CAU) for patients with depressive symptoms or disorders in general practice. Secondary aims include the short- and long-term (i.e. 12 months) cost-effectiveness and effects of blended care on daily activities, treatment satisfaction, medication use and other related resource use. In addition, we will explore the effects of the blended behavioral activation treatment and CAU on the course of real-time experiences of emotion, affect and events over the day.
Adults (18 years or over) with a GP diagnosis of depressive symptoms or a depressive disorder for whom the GP considers a next step in the treatment of depression will be included . Patients who fulfill the following criteria will be excluded: a) severe depression requiring prompt referral to specialized mental health service according to the GP (e.g. acute suicidality); b) current/past severe mental illness: schizophrenia, psychotic episode, bipolar disorder, depression with psychotic features; c) current anxiety disorder as primary diagnosis; d) current substance abuse (alcohol, drugs); e) current psychological treatment for depression; such as (online) cognitive behavioral therapy; f) no access to internet; g) insufficient computer skills; h) insufficient proficiency of Dutch language.
Study setting and recruitment
This trial will be conducted in approximately 45 general practices in the Netherlands, located both in cities and in villages. This is a closed trial, i.e. GPs and MHWs recruit participants among their registered patients only. Informed consent will be obtained from each patient. Baseline assessments include the Structured Clinical Interview for DSM-IV disorders I (SCID-I). Modules A (mood episode), D (mood disorders) and F (anxiety disorders) allowing for diagnosing depressive disorders and anxiety disorders. The before-mentioned exclusion criteria are verified using the screening questions of the SCID-I; if screened positive than the total concerning section is administered. A trained interviewer telephonically conducts the SCID. Agreement between telephonic and face-to-face assessment is excellent (90% agreement) .
Sequence generation and allocation
After baseline assessment participants are 1:1 randomly assigned to one of the treatment groups, stratified by sex, diagnosis (depressive symptoms or depressive disorder) and general practice (availability of a MHW). The randomization sequence is computer-generated with randomly varying block sizes and is concealed by an independent research department. After randomization, the researchers inform the general practice about the treatment allocation. The GP/MHW shares this information with the participant during the follow-up consultation. This trial is single-blinded, i.e. the treatment allocation is concealed from the outcome assessor and participants are asked not to reveal the treatment allocation (Fig. 1).
Guided ‘act and feel’ treatment
The guided ‘Act and Feel’ treatment is an online self-management program blended with direct contacts (face-to-face or telephonic) with a MHW [53, 54]. The content of Act and Feel is based on the face-to-face behavioral activation by Lewinsohn  and focuses on depressive symptoms. Behavioral activation is based on the behavioral theory stating that depressive behavior is a consequence of low rates of response-contingent positive reinforcement . Therefore, behavioral activation concentrates on activating individuals by increasing activities that are potentially reinforcing for the individual. ‘Act and Feel’ consists of eight modules with integrated monitoring of depressive symptomatology (including suicidality) and automatized feedback in a secure online environment. First, it provides psycho-education about depression and the rationale behind behavioral activation. Second, participants are given insight in their daily mood and behavior/activities using daily activity mood monitoring. Preplanned potential pleasurable activities are mood-independent increased to increase the sense of satisfaction and enhance mood in the long term. There is additionally attention for the role of avoidant behavior in depression and how to turn this to proactive behavior. Finally, it concludes with the development of a personal relapse prevention strategy.
Every module has a fixed structure, starting with a visual analogue scale (VAS) mood assessment (on a Likert scale from 1 to 10); the rationale of that module and specific exercises and it concludes with a summary and evaluation of that module. The ‘Act and Feel’ treatment provides automatically produced graphs of self-ratings mood score and depressive symptomatology.
The MHW supports the participants with consultations of a targeted 30 min at two, four and six weeks. The purposes of these consultations are to motivate and support the participants during the activation process and to enhance adherence. In addition, participants receive e-mail reminders when inactive on the online environment for two weeks. The MHWs who guide Act and Feel follow a one-day training session on guidance of Act and Feel and behavioral activation and on-demand supervision of cases by the psychologist research assistant. Before implementation of this treatment, the usability of the ‘Act and Feel’ treatment was evaluated in a pilot study with twenty healthy volunteers. By means of this feedback the treatment was adjusted and after adjustment retested in a second pilot.
Care as usual
The control group receives CAU for depression, left at the discretion of the GP. Patients with depressive disorders in routine usual general practice care are offered mostly pharmacological treatment and receive alongside some psychological treatment, such as non-directive counseling [56, 57]. We will not interfere with CAU but document it carefully. Nevertheless, GPs (or delegated to the MHW) are asked to plan consultations (telephonic or face-to-face) with the participant at two, four and six weeks as recommended by the guideline of the Dutch College of GPs thus mirroring the intervention arm . In addition, patients are monitored for depressive symptomatology and acute suicidality.
Given the trial’s pragmatic nature, the aim is to quantify the real life difference in the course of depressive symptoms between blended behavioral activation and usual care. Consequently, all participants in both arms are allowed to continue or to start any medical or non-medical concomitant treatment, except for psychological treatment, which we ask not to offer in the intervention group during the first three months. For both groups, the use of all forms of formal health care during the trial is carefully documented.
Participant timeline and assessments
Both clinical and economical outcomes are measured (Table 1). Interviewer-rated assessments are performed telephonically (i.e. SCID-I and HRSD-17) and the online self-report assessments through an online environment (ResearchOnline®). Follow-up assessments are at 3, 6 and 12 months.
Random real-time assessments will be done in the first ten weeks of participation. In addition to the assessments, all patients are monitored for severe depression and acute suicidality by filling in the self-report questionnaire QIDS weekly during ten weeks.
The primary outcome is the reduction of depressive symptoms from baseline to three months follow-up, as measured with the Hamilton Depression Scale 17-items (HRSD-17) [58–60]. This is a clinician-rated scale consisting of 17 items. This scale has been widely used in clinical trials and serves as gold standard for assessment of depression. It has been found valid and reliable measurement outcome with a higher inter-rater reliability and test-retest reliability [59, 61].
Depression related outcomes
The reduction of depressive symptoms on the HRSD-17 is assessed from baseline to 12 months of follow-up. Additionally, response defined as a 50% reduction on the HRSD-17 is evaluated at 3 and 12 months. Furthermore, depressive symptoms are assessed weekly using the self-reported measurement Quick Inventory of Depressive symptoms self-reported 16 items (QIDS-SR 16). The QIDS-SR 16 are used to monitor depressive symptoms and to signal acute suicidality and severe depression during the first ten weeks of treatment. When exceeding the threshold of severe depression (i.e. HRSD-17 score 16 or higher) or acute suicidality (i.e. score of 2 or 3 on the suicidality item of the QIDS-R), all patients receives an automatic message to contact their GP and MHW and the researcher informs the GP.
Treatment satisfaction is assessed using a self-developed questionnaire, consisting of five items. Each question is scored on a Likert-type scale from 1 to 4. The questionnaire addresses overall service satisfaction; i.e. satisfaction with treatment, recommendation of treatment, satisfaction about effectiveness of treatment and willingness to repeat treatment if needed. This questionnaire is shown in Additional file 1.
General health status is assessed with the EuroQol (EQ-5D), which is a validated self-administered questionnaire that contains a descriptive section and a valuation section. The descriptive section consists of five dimensions: mobility, self-care, usual activities, pain/discomfort and anxiety/depression. Each of these five dimensions has three levels of severity: no problems, some/moderate problems and extreme problems. Values of the five dimensions are linearly transformed into one single score, ranging from 0 to 1 (lower scores represent more problems). The valuation section of the EQ-5D contains a visual analogue scale; this vertical visual scale ranges between ‘best imaginable health state = perfect health’ (score of 100) and ‘worst imaginable health state = death’ (score of 0). The EQ-5D valuation section has been shown to be efficient and easy to use .
Functional impairment and activity limitations
Functional impairment and activity limitations are assessed using the 12-item self-report World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0). The WHODAS 2.0 is based on the conceptual framework of the International Classification of Functioning, Disability and Health (ICF). It provides a global measure of disability and 7 domain-specific scores. It assesses health and disability on six dimensions, namely cognition, mobility, self-care, getting along, life activities and participation. WHODAS 2.0 has been validated in 1119 patients across 7 European centers with 13 chronic conditions and it has been shown to have good metric properties 
Daily activities are assessed using part of the Health Questionnaire of the Utrecht Health project  This part of the questionnaire assesses daily activity level during a regular week in the past months, i.e. the kind and duration of these activities. The blended care treatment focuses on activating participants, by increasing their potential pleasurable activities. By assessing daily activities we study a potential prognostic mediating factor in the recovery of depression.
Ecological momentary assessment (EMA)
We will capture real-time momentary ratings of cognitions as well as affect and emotions with so-called Ecological Momentary Assessment (EMA). Compared to conventional questionnaires, potential advantages of prospective precise measurement with EMA are less recall bias and increased detection of vulnerable patients with adverse disease trajectories .
Specifically, using a smart phone application called ‘DE Free’ (Bockting, used software TEMPEST, Batalas & Markopoulos) (Fig. 2), auditory cue signals will be sent to participants’ cellphones. Thereupon, participants will be asked to rate their momentary states. These include an appraisal of positive affect (i.e. being cheerful, content, and energetic) and negative affect (i.e. feeling gloomy, nervous, insecure, lonely, irritated, helpless, and guilty), and activity levels (i.e. being active, pleasantness of activity, and energy involved in performing activity). Momentary states are rated on visual analogue scales, which are either numerical and ranging from 0 to 100 or ordinal and ranging from e.g. “not at all” to “very much”. Furthermore, participants will be asked to indicate the specific activities they were undertaking and the specific situation they were in while rating these momentary states (e.g. being at home and doing household chores). Participants will be asked to rate their momentary states in the following time schedule: every other day, 5 times per day, over the course of a 10-week period. Auditory signals will be sent at random moments during the following time intervals: equally spread between 8.30 a.m. and 7.30 p.m.
Costs related to the intervention
To calculate costs related to the internet treatment, we include costs of running the website platform and costs of the guidance by the GP or MHW.
Direct and indirect costs
We will measure health care costs in general (direct costs) as well as productivity losses (indirect costs) with the revised version of the Trimbos and iMTA Questionnaires on Costs Associated with Psychiatric Illness (TiC-P) [66, 67]. Direct costs are measured by investigating, which contact with health professionals has occurred and which type of medication has been prescribed. Indirect costs are measured by work absenteeism and reduced productivity. The TiC-P questions cover the previous six months; it is administrated at 6 and 12 months follow-up.
The sample size is based on demonstrating non-inferiority of blended care compared to usual care for the primary outcome, i.e. the reduction on HRSD-17 from baseline to three months follow-up. An acceptable non-inferiority margin has been defined as the maximum clinically irrelevant difference between treatments . The non-inferiority margin is set to be the half of minimal clinical important difference of 3 points on the HRSD-17 scale as advised by the FDA [60, 69, 70]; i.e. a non-inferiority margin of 1.5 points at the HRSD-17 (0.31 SD). The sample size was calculated with one-sided t-test with a power of 80% (α = 0.025) to detect a non-inferiority margin of 1.5. We compensated for an expected loss to follow-up of 20%. We adjusted for covariance, as advised to reduce required sample sizes and costs [71, 72]. In this correction we assumed a correlation coefficient (ρ) of 0.5, as recommended when the correlation coefficient is unknown [71, 73]. The number of participants needed is then corrected with design factor (1 − ρ 2), where ρ is the correlation coefficient. This resulted in a calculated design factor of 0.75. The final number calculated necessary to complete the trial is 151 participants per condition (a total of N = 302).
First, we will compare demographic characteristics of the trial population, to assure whether the randomization procedure has been successful.
The principle analysis will follow an intention-to-treat (ITT) strategy including all patients analyzed according to their randomized group. Supplementary analyses will be done on a ‘per protocol’ basis, meaning that they will be restricted to those participants that completed a minimum of three sessions in the intervention group.
The primary outcome, i.e. reduction in symptoms of depression from baseline to the 3 months follow-up, will be analyzed using a linear regression approach to analysis of covariance (ANCOVA) with the follow-up value of the outcome as the dependent variable and treatment and baseline value of the outcome as the independent variables. Secondary outcomes that were measured more than twice will be analyzed using linear mixed models for fixed (e.g. treatment) and random effects (e.g. patient). These models are superior for the analysis of longitudinally correlated data and can optimally deal with missing values . In these analyses, a treatment*time variable indicating the magnitude of the effect of the intervention on the change of the outcome variable will be included as an independent variable. If important baseline differences exist in prognostic important variables, despite randomization, we will adjust the analyses by including variables as covariates in additional analyses. Potential baseline differences will be reexamined before the per protocol analyses. Dichotomous outcome variables measured more than twice will be analyzed using generalized linear mixed models (mixed-effects logistic regression).
All effect parameters will be supplied with a 95% confidence interval. Statistical significance level will be set at 0.025, one-sided, as appropriate with the chosen non-inferiority design.
EMA data of real time momentary ratings will be examined in a bivariate vector-autoregressive Bayesian dynamic analysis and related analytic approaches to model the time structure of the data [Krone in preparation 2016; Krone submitted]. Feasibility and tolerability of EMA assessment by participants will be examined by assessing how many participants will be able to complete at least 70% of the EMA ratings. Based on the literature we will exclude participants with 30% or more missing on the EMA ratings (Krone in preparation, [74, 75]).
The cost-effectiveness and cost-utility of blended care will be studied from a societal perspective, using a time horizon of 12 months. To determine the cost-effectiveness of both treatments, we will estimate costs in both treatment groups. To calculate the total direct medical costs we will estimate the resource use. The resource use will be valued according to the Dutch guidelines for cost studies . Costs of blended care will be estimated by true resources used. Medication use will be valued based on costs a provided by The National Health Care Institute (Zorginstituut Nederland, ZIN). Total costs for both interventions will be summed-up over the 12-month study period. An incremental cost effectiveness ratio (ICER) will be calculated using the primary measure of effect: HDRS-17. In addition, a secondary analysis will be performed using the number of patients with a response as defined under secondary outcomes. In order to be able to compare the effects of blended care to other health care interventions, also a cost-utility analysis will be done; using EQ-5D defined utilities. Bootstrapping will be performed to depict the 95% confidence intervals surrounding the cost effectiveness, and cost utility ratios. Cost-effectiveness planes will be plotted in order to represent the cost-effectiveness graphically.
There is a need to investigate accessible ways to offer psychological treatment in general practice as both GPs and patients prefer psychological treatment [21–23]. However, barriers to psychological treatment in general practice such as time constraints and lack of experience of the GP (28–30), result in GPs prescribing pharmacological treatment even as a first step . This contrasts sharply with the guidelines recommending non-pharmacological treatment as the first step [12, 13] and is unwanted in view of the side effects, poor adherence, and long-term use after remission associated with antidepressant use [77–79]. Blended care interventions may provide GPs a feasible instrument to offer structured psychological treatment.
The current paper presents the design of a pragmatic non-inferiority trial to study the effectiveness and cost-effectiveness of a blended behavioral activation treatment for depressive symptoms and disorders in general practice.
While previous studies mainly used online psychological interventions based on cognitive behavioral therapy (CBT) [28, 32, 80], behavioral activation has been shown as effective and more cost-effective compared to CBT(50). In addition, it has been experienced as less complicated and more accessible to patients and therapists . MHWs can learn the technique required quickly and its effectiveness is comparable to behavioral activation delivered by more specialist staff with more training . It is expected that blended behavioral activation will provide an accessible and easier way to provide psychological treatment in general practice.
To our knowledge, this is the first trial of blended care based on behavioral activation in general practice provided by patients’ own GP or MHWs including assessments of real-time experiences during treatment by the EMA. An important strength of this trial is that it is conducted in routine general practice. Patients are recruited and coached by their own GPs and MHWs during treatment, hereby mirroring routine general practice and increasing the study’s generalizability. Another strength is that the EMA has the advantage of reducing memory distortions compared to conventional questionnaires. It gives insight into actual experiences during treatment . In future, knowledge of patients’ real-time experiences may enable the development of more personalized blended care for depression . This randomized controlled trial will show whether a blended behavioral activation treatment is a non-inferior treatment strategy for patients with depressive symptoms and depressive disorder in general practice.
Care as usual
Cognitive behavioral therapy
Ecological Momentary Assessments
EuroQol five dimensions questionnaire
Federal Drug Administration
Hamilton Rating Scale for Depression, 17 items
Incremental Cost-Effectiveness Ratio
International Classification of Functioning, Disability and health
Intention To Treat
Mental health worker
Quick inventory of depressive symptomatology, 16 items
Structured Clinical Interview for DSM disorders
Trimbos and iMTA questionnaire on Costs associated with Psychiatric illness
Visual analogue scale
WHO Disability Schedule 2.0; EQ-5D
Kruijshaar ME, Barendregt J, Vos T, de Graaf R, Spijker J, Andrews G. Lifetime prevalence estimates of major depression: an indirect estimation method and a quantification of recall bias. Eur J Epidemiol. 2005;20(1):103–11.
Kessler RC, Bromet EJ. The epidemiology of depression across cultures. Annu Rev Public Health. 2013;34:119–38.
Wells KB, Stewart A, Hays RD, Burnam MA, Rogers W, Daniels M, et al. The functioning and well-being of depressed patients. Results from the medical outcomes study. JAMA. 1989;262(7):914–9.
Von Korff M, Ormel J, Katon W, Lin EH. Disability and depression among high utilizers of health care. A longitudinal analysis. Arch Gen Psychiatry. 1992;49(2):91–100.
Ustun TB, Ayuso-Mateos JL, Chatterji S, Mathers C, Murray CJ. Global burden of depressive disorders in the year 2000. Br J Psychiatry. 2004;184:386–92.
Alonso J, Angermeyer MC, Bernert S, Bruffaerts R, Brugha TS, Bryson H, et al. Use of mental health services in Europe: results from the European study of the epidemiology of mental disorders (ESEMeD) project. Acta Psychiatr Scand Suppl. 2004;(420):47–54.
Bijl RV, Ravelli A. Psychiatric morbidity, service use, and need for care in the general population: results of The Netherlands mental health survey and incidence study. Am J Public Health. 2000;90(4):602–7.
Verhaak PF, Prins MA, Spreeuwenberg P, Draisma S, van Balkom TJ, Bensing JM, et al. Receiving treatment for common mental disorders. Gen Hosp Psychiatry. 2009;31(1):46–55.
Verhaak PF, van Dijk CE, Nuijen J, Verheij RA, Schellevis FG. Mental health care as delivered by Dutch general practitioners between 2004 and 2008. Scand J Prim Health Care. 2012;30(3):156–62.
Wang PS, Berglund P, Kessler RC. Recent care of common mental disorders in the United States : prevalence and conformance with evidence-based recommendations. J Gen Intern Med. 2000;15(5):284–92.
Kovess-Masfety V, Alonso J, Brugha TS, Angermeyer MC, Haro JM, Sevilla-Dedieu C, et al. Differences in lifetime use of services for mental health problems in six European countries. Psychiatr Serv. 2007;58(2):213–20.
Weel-Baumgarten V, van Gelderen MG, Grundmeijer HGLM, et al. NHG-Standaard Depressie (tweede herziening). Huisarts Wet. 2012;55(6):252–9.
National Collaborating Centre for Mental Health (UK). Depression: the treatment and Management of Depression in adults (updated edition). 2010.
Olfson M, Blanco C, Marcus SC. Treatment of adult depression in the United States. JAMA Intern Med. 2016;176(10):1482–91.
Bushnell J, McLeod D, Dowell A, Salmond C, Ramage S, Collings S, et al. The treatment of common mental health problems in general practice. Fam Pract. 2006;23(1):53–9.
Sleath BL, Rubin RH, Huston SA. Antidepressant prescribing to Hispanic and non-Hispanic white patients in primary care. Ann Pharmacother. 2001;35(4):419–23.
Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008;358(3):252–60.
Katon W, Schulberg H. Epidemiology of depression in primary care. Gen Hosp Psychiatry. 1992;14(4):237–47.
Fournier JC, DeRubeis RJ, Hollon SD, Dimidjian S, Amsterdam JD, Shelton RC, et al. Antidepressant drug effects and depression severity: a patient-level meta-analysis. JAMA. 2010;303(1):47–53.
Bortolotti B, Menchetti M, Bellini F, Montaguti MB, Berardi D. Psychological interventions for major depression in primary care: a meta-analytic review of randomized controlled trials. Gen Hosp Psychiatry. 2008;30(4):293–302.
van Schaik DJ, Klijn AF, van Hout HP, van Marwijk HW, Beekman AT, de Haan M, et al. Patients' preferences in the treatment of depressive disorder in primary care. Gen Hosp Psychiatry. 2004;26(3):184–9.
Saltini A, David A, Trentini A, Marchi J, Pioli R. Clinical practice in mental health and educational needs in general practice. Recenti Prog Med. 2002;93(7–8):410–5.
Hermens ML, Muntingh A, Franx G, van Splunteren PT, Nuyen JS, et al. BMC Fam Pract. 2014;15(5):2296-15-5.
Mohr DC, Hart SL, Howard I, Julian L, Vella L, Catledge C, et al. Barriers to psychotherapy among depressed and nondepressed primary care patients. Ann Behav Med. 2006;32(3):254–8.
Alvidrez J, Azocar F. Distressed women's clinic patients: preferences for mental health treatments and perceived obstacles. Gen Hosp Psychiatry. 1999;21(5):340–7.
Barney LJ, Griffiths KM, Christensen H, Jorm AF. Exploring the nature of stigmatising beliefs about depression and help-seeking: implications for reducing stigma. BMC Public Health. 2009;9(61):2458-9-61.
Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012;6;32(4):329–42.
Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One. 2010;5(10):e13196.
Spek V, Cuijpers P, Nyklicek I, Riper H, Keyzer J, Pop V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med. 2007;37(3):319–28.
van Ballegooijen W, Cuijpers P, van Straten A, Karyotaki E, Andersson G, Smit JH, et al. Adherence to internet-based and face-to-face cognitive behavioural therapy for depression: a meta-analysis. PLoS One. 2014;9(7):e100674.
Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry. 2014;13(3):288–95.
Karyotaki E, Riper H, Twisk J, Hoogendoorn A, Kleiboer A, Mira A, et al. Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data. JAMA Psychiatry. 2017;22
Titov N, Andrews G, Davies M, McIntyre K, Robinson E, Solley K. Internet treatment for depression: a randomized controlled trial comparing clinician vs. technician assistance. PLoS One. 2010;5(6):e10939.
Moreno FA, Chong J, Dumbauld J, Humke M, Byreddy S. Use of standard webcam and internet equipment for telepsychiatry treatment of depression among underserved Hispanics. Psychiatr Serv. 2012;63(12):1213–7.
Hilty DM, Marks S, Wegelin J, Callahan EJ, Nesbitt TS. A randomized, controlled trial of disease management modules, including telepsychiatric care, for depression in rural primary care. Psychiatry (Edgmont). 2007;4(2):58–65.
Burton C, Szentagotai Tatar A, McKinstry B, Matheson C, Matu S, Moldovan R, et al. Pilot randomised controlled trial of Help4Mood, an embodied virtual agent-based system to support treatment of depression. J Telemed Telecare. 2016;22(6):348–55.
Hoifodt RS, Lillevoll KR, Griffiths KM, Wilsgaard T, Eisemann M, Waterloo K, et al. The clinical effectiveness of web-based cognitive behavioral therapy with face-to-face therapist support for depressed primary care patients: randomized controlled trial. J Med Internet Res. 2013;15(8):e153.
Kivi M, Eriksson MC, Hange D, Petersson EL, Vernmark K, Johansson B, et al. Internet-based therapy for mild to moderate depression in Swedish primary care: short term results from the PRIM-NET randomized controlled trial. Cogn Behav Ther. 2014;43(4):289–98.
Levesque DA, Van Marter DF, Schneider RJ, Bauer MR, Goldberg DN, Prochaska JO, et al. Randomized trial of a computer-tailored intervention for patients with depression. Am J Health Promot. 2011;26(2):77–89.
Simon GE, Ralston JD, Savarino J, Pabiniak C, Wentzel C, Operskalski BH. Randomized trial of depression follow-up care by online messaging. J Gen Intern Med. 2011;26(7):698–704.
Salisbury C, O'Cathain A, Edwards L, Thomas C, Gaunt D, Hollinghurst S, et al. Effectiveness of an integrated telehealth service for patients with depression: a pragmatic randomised controlled trial of a complex intervention. Lancet Psychiatry. 2016;3(6):515–25.
Montero-Marin J, Araya R, Perez-Yus MC, Mayoral F, Gili M, Botella C, et al. An internet-based intervention for depression in primary Care in Spain: a randomized controlled trial. J Med Internet Res. 2016;18(8):e231.
England E, Lester H. Implementing the role of the primary care mental health worker: a qualitative study. Br J Gen Pract. 2007;57(536):204–11.
Bower P. Primary care mental health workers: models of working and evidence of effectiveness. Br J Gen Pract. 2002;52(484):926–33.
Gilbody S, Littlewood E, Hewitt C, Brierley G, Tharmanathan P, Araya R, et al. Computerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): large scale pragmatic randomised controlled trial. BMJ. 2015;351:h5627.
Hallgren M, Kraepelien M, Ojehagen A, Lindefors N, Zeebari Z, Kaldo V, et al. Physical exercise and internet-based cognitive-behavioural therapy in the treatment of depression: randomised controlled trial. Br J Psychiatry. 2015;207(3):227–34.
Kessler D, Lewis G, Kaur S, Wiles N, King M, Weich S, et al. Therapist-delivered internet psychotherapy for depression in primary care: a randomised controlled trial. Lancet. 2009;374(9690):628–34.
Richards DA, Ekers D, McMillan D, Taylor RS, Byford S, Warren FC, et al. Cost and outcome of Behavioural activation versus cognitive Behavioural therapy for depression (COBRA): a randomised, controlled, non-inferiority trial. Lancet. 2016;388(10047):871–80.
Ekers D, Richards D, McMillan D, Bland JM, Gilbody S. Behavioural activation delivered by the non-specialist: phase II randomised controlled trial. Br J Psychiatry. 2011;198(1):66–72.
Littlewood E, Duarte A, Hewitt C, Knowles S, Palmer S, Walker S, et al. A randomised controlled trial of computerised cognitive behaviour therapy for the treatment of depression in primary care: the randomised evaluation of the effectiveness and acceptability of computerised therapy (REEACT) trial. Health Technol Assess. 2015;viii(101):xxi-171.
Hollinghurst S, Peters TJ, Kaur S, Wiles N, Lewis G, Kessler D. Cost-effectiveness of therapist-delivered online cognitive-behavioural therapy for depression: randomised controlled trial. Br J Psychiatry. 2010;197(4):297–304.
Simon GE, Revicki D, VonKorff M. Telephone assessment of depression severity. J Psychiatr Res. 1993;0;27(3):247–52.
Bockting CLH, van Valen E. Act and feel online: internet-based behavioral activation in Dutch. Treat Mod. 2015;
Arjadi R, Nauta MH, Scholte WF, Hollon SD, Chowdhary N, Suryani AO, et al. Guided act and feel Indonesia (GAF-ID) - internet-based behavioral activation intervention for depression in Indonesia: study protocol for a randomized controlled trial. Trials. 2016;17(1):455,016-1577-9.
Lewinsohn PM. A behavioral approach to depression. In: Coyne JC, editor. Essential papers on depression. New York: New York University Press; 1985. p. 150–80.
van Rijswijk E, Borghuis M, van de Lisdonk E, Zitman F, van Weel C. Treatment of mental health problems in general practice: a survey of psychotropics prescribed and other treatments provided. Int J Clin Pharmacol Ther. 2007;45(1):23–9.
Rijswijk van E. Mental health problems in general practice. UMC St Radboud: Nijmegen; 2005.
Morriss R, Leese M, Chatwin J, Baldwin D, THREAD Study Group. Inter-rater reliability of the Hamilton depression rating scale as a diagnostic and outcome measure of depression in primary care. J Affect Disord. 2008;111(2–3):204–13.
Zimmerman M, Martinez JH, Young D, Chelminski I, Dalrymple K. Severity classification on the Hamilton depression rating scale. J Affect Disord. 2013;150(2):384–8.
Walker R. Understanding the Hamilton depression scores. 2012.
Helmreich I, Wagner S, Mergl R, Allgaier AK, Hautzinger M, Henkel V, et al. Sensitivity to changes during antidepressant treatment: a comparison of unidimensional subscales of the inventory of depressive Symptomatology (IDS-C) and the Hamilton depression rating scale (HAMD) in patients with mild major, minor or subsyndromal depression. Eur Arch Psychiatry Clin Neurosci. 2012;262(4):291–304.
Brazier J, Connell J, Papaioannou D, Mukuria C, Mulhern B, Peasgood T, et al. A systematic review, psychometric analysis and qualitative assessment of generic preference-based measures of health in mental health populations and the estimation of mapping functions from widely used specific measures. Health Technol Assess. 2014;18(34):vii,viii, xiii-xxv):1–188.
Garin O, Ayuso-Mateos JL, Almansa J, Nieto M, Chatterji S, Vilagut G, et al. Validation of the "World Health Organization disability assessment schedule, WHODAS-2" in patients with chronic diseases. Health Qual Life Outcomes. 2010;8(51):7525-8-51.
Grobbee DE, Hoes AW, Verheij TJ, Schrijvers AJ, van Ameijden EJ, Numans ME. The Utrecht health project: optimization of routine healthcare data for research. Eur J Epidemiol. 2005;20(3):285–7.
Wichers M, Peeters F, Geschwind N, Jacobs N, Simons CJ, Derom C, et al. Unveiling patterns of affective responses in daily life may improve outcome prediction in depression: a momentary assessment study. J Affect Disord. 2010;124(1–2):191–5.
Bouwmans C, De Jong K, Timman R, Zijlstra-Vlasveld M, Van der Feltz-Cornelis C, Tan Swan S, et al. Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P). BMC Health Serv Res. 2013;13(217):6963-13-217.
Handleiding Trimbos/iMTA questionnaire for Costs associated with Psychiatric illness (TiC-P), Rotterdam. 2013. Available from: www.imta.nl.
Hida E, Tango T. On the three-arm non-inferiority trial including a placebo with a prespecified margin. Stat Med. 2011;30(3):224–31.
Mynors-Wallis LM, Gath DH, Day A, Baker F. Randomised controlled trial of problem solving treatment, antidepressant medication, and combined treatment for major depression in primary care. BMJ. 2000;320(7226):26–30.
Guidance for Industry Non-Inferiority Clinical Trials. 2010. Available at: https://www.fda.gov.
Vickers AJ, Altman DG. Statistics notes: Analysing controlled trials with baseline and follow up measurements. BMJ. 2001;323(7321):1123–4.
Borm GF, Fransen J, Lemmens WA. A simple sample size formula for analysis of covariance in randomized clinical trials. J Clin Epidemiol. 2007;60(12):1234–8.
Follmann D, Elliott P, Suh I, Cutler J. Variance imputation for overviews of clinical trials with continuous response. J Clin Epidemiol. 1992;45(7):769–73.
West M, Harrison J. Bayesian forecasting and dynamic models. second ed. Springer-Verlag New York: New York, NY, USA; 1999.
Delespaul PAEG. Assessing schizophrenia in daily life : the experience sampling method. Maastricht: UPM, Universitary Press Maastricht, Maastricht; 1995.
van Marwijk HW, Bijl D, Ader HJ, de Haan M. Antidepressant prescription for depression in general practice in The Netherlands. Pharm World Sci. 2001;23(2):46–9.
van Geffen EC, Gardarsdottir H, van Hulten R, van Dijk L, Egberts AC, Heerdink ER. Initiation of antidepressant therapy: do patients follow the GP's prescription? Br J Gen Pract. 2009;59(559):81–7.
van Geffen EC, van Hulten R, Bouvy ML, Egberts AC, Heerdink ER. Characteristics and reasons associated with nonacceptance of selective serotonin-reuptake inhibitor treatment. Ann Pharmacother. 2008;42(2):218–25.
Moore M, Yuen HM, Dunn N, Mullee MA, Maskell J, Kendrick T. Explaining the rise in antidepressant prescribing: a descriptive study using the general practice research database. BMJ. 2009;339:b3999.
Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012;32(4):329–42.
Ekers DM, Dawson MS, Bailey E. Dissemination of behavioural activation for depression to mental health nurses: training evaluation and benchmarked clinical outcomes. J Psychiatr Ment Health Nurs. 2013;20(2):186–92.
Bos FM, Schoevers RA, aan het Rot M. Experience sampling and ecological momentary assessment studies in psychopharmacology: a systematic review. Eur Neuropsychopharmacol. 2015;25(11):1853–64.
The authors would like to thank the GPs and MHWs for their contribution to the recruitment of participants and Welmoed Dekker, Rosanne Dokkum, Agnes Diemers and Lianne Dijkstra for their contribution in the training and supervision of the GPs and MHWs.
This trial was funded by the Netherlands Organization for Health Research and Development ZonMw (83911000). In addition we received a private donation from Mr. J.J. van der Werff. This paper has partly been written by CLHB as part of a fellowship at the Netherlands Institute for Advances Study in the Humanities and Social Science Study (NIAS).
Availability of data and materials
Not applicable, still ongoing.
HB, MHB, and CLB designed the trial. CLB and EvV designed the Act and Feel treatment. BM tested the Act and Feel platform, performed the pilot of the platform with volunteers and partly recruited practices and participants. HW manages the conduction of the trial. All authors read and approved the final manuscript.
Co-authors EVV and CLHB have written the content of the behavioral activation treatment ‘Act and Feel’.
Consent for publication
Ethics approval and consent to participate
The protocol of this trial has been approved by the Medical Ethics Committee of the University Medical Center Groningen, University of Groningen, the Netherlands (registration number 2014/346). All participants were provided study information through a study brochure and a telephonically explanation of the study before written informed consent was obtained.
Ongoing, collecting participants and data.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Questionnaire overall service satisfaction; i.e. satisfaction with treatment, recommendation of treatment, satisfaction about effectiveness of treatment and willingness to repeat treatment if needed. (DOCX 1224 kb)
About this article
Cite this article
Massoudi, B., Blanker, M.H., van Valen, E. et al. Blended care vs. usual care in the treatment of depressive symptoms and disorders in general practice [BLENDING]: study protocol of a non-inferiority randomized trial. BMC Psychiatry 17, 218 (2017). https://doi.org/10.1186/s12888-017-1376-1
- Blended care
- Internet-based treatment
- Depressive symptoms
- Depressive disorders
- General practice
- Primary care