Skip to main content
Download PDF
  • Study protocol
  • Open access
  • Published:

Blended CBT versus face-to-face CBT: a randomised non-inferiority trial

BMC Psychiatry volume 16, Article number: 432 (2016) Cite this article

Abstract

Background

Internet based cognitive behavioural therapy (iCBT) has been demonstrated to be cost- and clinically effective. There is a need, however, for increased therapist contact for some patient groups. Combining iCBT with traditional face-to-face (ftf) consultations in a blended format (B-CBT) may produce a new treatment format with multiple benefits from both traditional CBT and iCBT such as individual adaptation, lower costs than traditional therapy, wide geographical and temporal availability, and possibly lower threshold to implementation. The primary aim of the present study is to compare directly the clinical effectiveness of B-CBT with face-to-face CBT for adult major depressive disorder.

Methods/Design

The study is designed as a two arm randomised controlled non-inferiority trial comparing blended CBT for adult depression with treatment as usual (TAU). In the blended condition six sessions of ftf CBT is alternated with six to eight online modules (NoDep). TAU is defined as 12 sessions of ftf CBT. The primary outcome is symptomatic change of depressive symptoms on the patient-health questionnaire (PHQ-9). Additionally, the study will include an economic evaluation. All participants must be 18 years of age or older and meet the diagnostic criteria for major depressive disorder according to the Diagnostic and Statistical Manual of Mental disorders 4th edition. Participants are randomised on an individual level by a researcher not involved in the project. The primary outcome is analysed by regressing the three-month follow-up PHQ-9 data on the baseline PHQ-9 score and a treatment group indicator using ancova. A sample size of 130 in two balanced groups will yield a power of at least 80% to detect standardised mean differences above 0.5 on a normally distributed variable.

Discussion

This study design will compare B-CBT and ftf CBT in a concise and direct manner with only a minimal of the variance explained by differences in therapeutic content. On the other hand, while situated in routine care, ecological validity is somewhat compromised by the controlled manner in which the study is conducted.

Trial registration

ClinicalTrials.gov NCT02796573. Registered June 1st 2016. Currently recruiting participants.

Peer Review reports

Background

Depression is a prevalent and disabling disorder with a high risk of relapse and large individual and societal costs [1–6]. Effective treatments exist [7], but there is a large gap between the need for and use of treatments [8]. Evidence based psychotherapies such as CBT, may help to bridge this gap. The reach of face-to-face (ftf) CBT is limited [9] however, which has led researchers to explore alternative modes of delivery of CBT such as Internet based guided self-help (iCBT) [10–16]. In spite of the evidence for the effect of iCBT, there is a need for increased therapist contact among some patient groups to overcome some of the shortcomings of iCBT [17–20].

Combining iCBT with traditional face-to-face consultations in a blended CBT format (B-CBT) may alleviate some of the difficulties associated with iCBT (such as lack of clinician contact), while still preserving some of the advantages of iCBT and face-to-face CBT alike. In B-CBT, online modules and face-to-face consultations are combined in one coherent treatment manual. This format could hold multiple benefits. Firstly, by providing face-to-face sessions, the therapist can individualise the therapy by taking the personal profile of the patient, the disorder, and possible co-morbidity into account. Secondly, since B-CBT only provides half the number of sessions as traditional face-to-face CBT, the capacity of the treating clinician is increased compared to traditional CBT. Third, the burden and cost of travel by the patient can be reduced. Fourth, the online modules are available at the time and place needed by the patients - and they can be re-viewed multiple times. Fifth, the inherently structured format of the online modules secures the same level of psycho-education and exercises to be delivered to all patients. Finally, one of the principal barriers for the uptake of iCBT seems to be skepticism from clinicians towards leaving the majority of therapy to a computer [21], a barrier possibly alleviated by the blended format in B-CBT.

Few studies have investigated the use of blended care combining internet based psychotherapeutic modules and face-to-face sessions into one coherent treatment manual [22–26]. Generally, however, they do indicate positive outcomes. In a randomised controlled trial conducted in primary care in Tromsø, Norway clinical psychologists delivered 30 min sessions following each online module [24]. They were able to document a significant difference with a moderate to large effect size (d = 0.65) on depressive symptoms (BDI-II) favouring blended care over waiting list. The intervention predominantly received positive evaluations suggesting acceptability and satisfaction with the treatment. Additionally, a qualitative study found that the face-to-face consultations increased motivation to persist with the iCBT programme [27]. Another recent example is the development and initial evaluation of a programme for B-CBT in The Netherlands. This was tested in an outpatient clinic of a specialised mental health care centre in Amsterdam. The study was designed as a feasibility study and included only nine patients. However, the patients perceived the intervention as positive although the authors rightly note that no conclusion can be derived from such a small sample [26].

Aims and hypotheses

The primary aim of the present study is to compare the clinical effectiveness of blended cognitive behavioural therapy (B-CBT) for major depressive disorder (MDD) in adults with treatment as usual (TAU) defined as 12 sessions of face-to-face CBT. It is hypothesised that B-CBT will be no less clinically effective than TAU, and that it will be acceptable and satisfactory to patients and clinicians.

Methods

Design

The study is designed as a two arm randomised controlled non-inferiority trial comparing B-CBT for adult depression to treatment as usual (TAU) with an economic evaluation alongside. The present trial is part of the national project ENTER located and coordinated from the Center for Telepsychiatry and is additionally affiliated with the EU-study E-COMPARED [28].

Participants

Inclusion criteria

All participants must be 18 years of age or older and meet the diagnostic criteria for major depressive disorder according to the Diagnostic and Statistical Manual of Mental disorders 4th edition (DSM-IV) [29]. Additionally, the participants must score ‘5’ or higher on the Patient Health Questionnaire-9 (PHQ-9) [30].

Exclusion criteria

Patients will be excluded in case of current high risk of suicide or if they suffer from a co-morbid substance dependence, bipolar affective disorder, psychotic illness, or obsessive compulsive disorder. Additionally, participants will be excluded if they currently receive psychological treatment for depression in primary or specialised mental health care. Finally, they will be excluded if they are unable to comprehend Danish or if they do not have access to a PC and Internet connection.

Recruitment

Participants are recruited from the Centre for Telepsychiatry in specialised mental health care at the Mental Health Services of the Region of Southern Denmark, where they are referred to the study by clinicians. Initially, however, patients are self-referred to the Centre for Telepsychiatry.

The diagnosis will be confirmed by telephone administered interviews using the International Neuropsychiatric Interview version 5.0 (M.I.N.I.) [31] administered via telephone by trained masters students in psychology. Additionally, the participants are asked for permission from the research team to obtain the results of the PHQ-9 questionnaire from their application form to minimise the burden on the patients. Patients are asked to keep eventual antidepressant medication stable during treatment. If changes should occur, they are asked to report it.

Randomisation and blinding

An independent researcher who is not involved in the trial performs the randomisation (centrally from Amsterdam) at an individual level, stratified by country after eligibility and baseline measurement. A computerised random number generator (Random Allocation Software) will be applied with an allocation ratio of 1:1. Block randomisation will be used with variable block sizes that vary between eight and fourteen allocations per block.

The assessors for eligibility will be blinded to group allocation. During treatment, blinding of participants and clinicians are naturally impossible. Researchers and statisticians involved in the analyses will be blinded to group allocations. The groups will be numbered in the dataset without revealing which treatment was given. The questionnaires administered solely to the B-CBT group will be analysed in a separate dataset.

Interventions

Blended treatment (B-CBT)

B-CBT combines (blends) six individual face-to-face CBT sessions with six to eight online CBT modules delivered through an Internet based treatment programme. The face-to-face consultations will be provided by a psychologist at the Centre for Tele-Psychiatry.

The programme is a recently developed iCBT programme (NoDep) based on CBT for depression which includes six mandatory modules and two optional ones. The core components of the mandatory modules are: psycho-education, cognitive restructuring, behavioural activation, behaviour experiments, and relapse prevention. The optional modules comprise: coping with rumination, and restructuring of core beliefs. The decision whether to add any optional modules are taken jointly by the patient and the psychologist based on patient needs, motivation, and possible time constraints. See Table 1 for an overview of the intervention. All modules are delivered via multimedia elements including video, audio, interactive exercises, calendar, and pdf summaries. The program has a build in workflow predetermining the order in which the modules are presented. All data is stored in Europe and is encrypted during storage and transmission.

Table 1 Interventions
Full size table

For technical support to the participants, the existing procedures at Internetpsykiatrien are used, which consists of two levels: the first is handled by the clinicians, the second goes through an error report system to the company providing the software (Context Consulting).

Treatment as usual (TAU)

TAU will be defined as 12 sessions of face-to-face CBT including the same core components as the B-CBT condition. Additionally, interventions on core beliefs and rumination can be included according to the same criteria as in the B-CBT condition. See Table 1 for an overview of the intervention.

Patients in either condition is monitored weekly for symptoms of depression including suicidal ideation and -intent. Should any participant deteriorate or show signs of suicidal intent, an assessment interview will be conducted and the patient will be discontinued if necessary and referred to relevant treatment.

Adherence

Participants will receive automated sms and/or e-mail reminders of homework assignments and questionnaires. In case a patient is inactive for more than two days without prior agreement with the treating psychologist, the patient is contacted via e-mail and telephone. Additionally, a computer is setup at the clinic, for participants to engage with the online programme in case they are for some reason not able to do so at home. This includes lack of adherence even if they do not suffer technical difficulties.

Treatment fidelity

All therapists are clinical psychologists. To ensure treatment fidelity (1) detailed treatment manuals, one for each treatment condition, has been developed to guide therapists through the treatment, (2) regular supervision is provided by the research coordinator to prevent drift, (3) therapists will register the number of sessions, the frequency of the sessions, the main strategies used in each sessions and the length of each contact, and finally (4) all sessions will be audio recorded and approximately 5% of the sessions in each condition will be randomly selected and evaluated by an external CBT expert (Fig. 1).

Fig. 1
figure 1

Patient flow diagramme

Full size image

Outcome measurements

Baseline measures will be administered after consent has been granted prior to randomisation. The participants will be followed up three-, six-, and twelve months after baseline measurement. In case of drop-out, a short questionnaire regarding reasons for drop-out will be administered. All questionnaires for the participants will be administered online. A secure web application for building and managing online surveys (RedCap) will be used for all questionnaire packages except the weekly monitoring for the B-CBT group, which will be administered from within the treatment programme. See Table 2 for an overview of measurements and time points. Data is stored by Odense Patient data Exploratory Network. Data is managed by a local data manger with training and prior experience in datamangement. The datamanager quality checks data continuously. Data is collected, transferred, and stored securely electronically and is approved by the Danish Data Protection Agency (J.nr.: 14/26634 Reg. nr.: 2008-58-0035).

Table 2 Overview of measurements
Full size table

Primary outcome

The Patient Health Questionnaire-9 (PHQ-9) [30] will be used as primary outcome measurement to evaluate change in severity of depressive symptoms. It is a nine items questionnaire which can be used to screen and diagnose patients with depressive disorders. The nine items are each scored on a 0–3 point scale with a total score ranging from 0–27 with higher scores indicating more severe depression. The PHQ-9 has been shown to have good psychometric properties [32].

Secondary outcomes

The Quick Inventory of Depressive Symptomatology Self-Report (QIDS-16-SR) [33] is used in addition to the PHQ-9 because it is a promising questionnaire for assessing depressive symptoms especially in specialised mental health care, whereas the PHQ-9 is developed for use in primary care. The QIDS-16-SR is a questionnaire that screens for depressive symptoms and assesses depression severity. It consists of 16 items each scored on a 0–3 point scale and includes symptom domains of MDD based on DSM-IV. The QIDS-16-SR has shown good psychometric properties [33, 34].

The Client Satisfaction Questionnaire (CSQ-8) [35] is used to measure the patients’ satisfaction with the treatments. The questionnaire consists of eight items measured on a four point scale with total scores ranging from 8–32 and has shown good psychometric properties [36]. Clinician satisfaction with the treatment will be assessed by the short form of the Client Satisfaction Questionnaire including only the three core questions of the csq-8.

To measure the patients’ expectancy and judgement of credibility of the treatments the Credibility and Expectancy Questionnaire (CEQ) [37] is used. The CEQ is a two part questionnaire measuring credibility and expectancy respectively. Both factors have been shown to be stable across different populations, with high internal consistency within each factor [37].

To indicate whether a difference is seen in the therapeutic alliance the short version of the Working Alliance Inventory (WAI-SR) is used. WAI-SR is a 12 item self-report questionnaire with responses on a five point Likert scale ranging from 1 (never) to 5 (always) [38, 39]. The questionnaire covers three dimensions of working alliance: (1) therapeutic goals, (2) tasks, and (3) bond and the sub scales have demonstrated good internal consistencies [40]. Both the patient and the ten items therapist version of the questionnaire will be administered. The alliance between the patient and the programme will be assessed with the WAI Online Therapy (TAI)(Labpsitec, 2014).

Finally, to measure the patients’ perception of the usability of the software, the System Usability Scale (SUS) [41] is used. It is a simple ten item scale giving a global view of subjective assessments of usability of a technology system. All items are measured on a 5-point scale ranging from ‘strongly disagree’ to ‘strongly agree’. Total SUS scores have a range from 0–100. The questionnaire has been found to be reliable and robust [42].

Sample size and statistical analyses

The primary outcome is analysed by regressing the three-month follow-up PHQ-9 data on the baseline PHQ-9 score and a treatment group indicator. We will use an ancova model for this purpose. Missing values are handled using a full-information maximum likelihood estimator. In case of dropout, we will use the last observed values in a supplementary intention-to-treat analysis. Missingness sensitivity will be assessed with a best-/worst-case comparison, where missing values are replaced with the minimum and maximum values observed at follow-up.

The primary hypothesis is that the blended care intervention will be no less effective than the TAU intervention in reducing depression symptoms. A sample size of 130 in two balanced groups will yield a power of at least 80% to detect standardised mean differences above 0.5 on a normally distributed variable. This equivalence interval is slightly narrower than other estimates of minimally clinically important differences [43].

In addition, we will compare the development of PHQ-9 in the two groups using the weekly measurements in a mixed effects model. We will model the individual trajectories as random slopes, and then let the treatment group predict the slopes. Significant slope differences between groups will indicate either faster or slower treatment effects in the blended care group. In case of non-normal data, we will use an appropriate measure of transformation or a generalised linear model. Variables with significant variations between groups at baseline are introduced as control variables.

Secondary outcomes will be analysed using t-tests or a rank sum test. Where appropriate, differences between baseline and follow-up scores are used as outcomes instead of only comparing the follow-up score.

Discussion

The present study aims to investigate the clinical effectiveness of CBT delivered in a format in which face-to-face consultations are alternated with online self-help modules, since this could hold promise to combine advantages of Internet based guided self-help and traditional CBT while preserving the clinical effectiveness and broad applicability of traditional CBT.

It is a strength of the present study, that the treatment in the two conditions have similar therapeutic content given that both treatments are captured in one coherent treatment manual detailing each intervention. Consequently, the study will reveal a very direct comparison with a minimum of the variance explained by differences in therapeutic methods.

The study is limited, however, by the fact that even though it is situated in specialised mental health care, patients are recruited from a clinic offering self-referral. Consequently, the results may be hard to generalise with regards to future implementation.

The present study will contribute to the knowledge in the field by comparing, in a direct and concise manner, B-CBT to the well known and well investigated traditional face-to-face CBT, which in many settings is considered the golden standard of psychotherapeutic treatment of depression.

References

  1. Mueller TI, Leon AC, Keller MB, Solomon DA, Endicott J, Coryell W, et al. Recurrence after recovery from major depressive disorder during 15 years of observational follow-up. Am J Psychiatry. 1999;156(7):1000–6.

    CAS  PubMed  Google Scholar 

  2. Kessing LV, Hansen MG, Andersen PK, Angst J. The predictive effect of episodes on the risk of recurrence in depressive and bipolar disorders--A life-long perspective. Acta Psychiatr Scand. 2004;109(5):339–44.

    Article  CAS  PubMed  Google Scholar 

  3. Olsen LR, Mortensen EL, Bech P. Prevalence of major depression and stress indicators in the Danish general population. Acta Psychiatr Scand. 2004;109(2):96–103.

    Article  CAS  PubMed  Google Scholar 

  4. Kessler RC, Chiu WT, Demler O, Walters EE. Prevalence, Severity, and Comorbidity of 12-Month DSM-IV Disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):617–27.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Alonso J, Lepine JP. Overview of key data from the European Study of the Epidemiology of Mental Disorders (ESEMeD). J Clin Psychiatry. 2007;68 Suppl 2:3–9.

    PubMed  Google Scholar 

  6. WHO. The Global Burden of Disease: 2004 update. Geneva: World Health Organization; 2008.

    Google Scholar 

  7. Huhn M, Tardy M, Spineli LM, Kissling W, Förstl H, Pitschel-Walz G, et al. Efficacy of pharmacotherapy and psychotherapy for adult psychiatric disorders: A systematic overview of meta-analyses. JAMA Psychiatry. 2014;71(6):706–15.

    Article  PubMed  Google Scholar 

  8. Alonso J, Codony M, Kovess V, Angermeyer MC, Katz SJ, Haro JM, et al. Population level of unmet need for mental healthcare in Europe. Br J Psychiatry. 2007;190(4):299–306.

    Article  PubMed  Google Scholar 

  9. Shafran R, Clark DM, Fairburn CG, Arntz A, Barlow DH, Ehlers A, et al. Mind the gap: Improving the dissemination of CBT. Behav Res Ther. 2009;47(11):902–9.

    Article  CAS  PubMed  Google Scholar 

  10. Barak A, Hen L, Boniel-Nissim M, Shapira N. A Comprehensive Review and a Meta-Analysis of the Effectiveness of Internet-Based Psychotherapeutic Interventions. J Technol Hum Serv. 2008;26(2):109–60.

    Article  Google Scholar 

  11. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One. 2010;5(10), e13196.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Hedman E, Ljotsson B, Lindefors N. Cognitive behavior therapy via the Internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Rev Pharmacoecon Outcomes Res. 2012;12(6):745–64.

    Article  PubMed  Google Scholar 

  13. Richards D, Richardson T. Computer-based psychological treatments for depression: A systematic review and meta-analysis. Clin Psychol Rev. 2012;32(4):329–42.

    Article  PubMed  Google Scholar 

  14. Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry. 2014;13(3):288–95.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Arnberg FK, Linton SJ, Hultcrantz M, Heintz E, Jonsson U. Internet-delivered psychological treatments for mood and anxiety disorders: A systematic review of their efficacy, safety, and cost-effectiveness. PLoS One. 2014;9(5), e98118.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Cuijpers P, Riper H. Internet interventions for depressive disorders: An overview. Rev Psicopatol Psicol Clin. 2014;19(3):209–16.

    Article  Google Scholar 

  17. Knowles SE, Toms G, Sanders C, Bee P, Lovell K, Rennick-Egglestone S, et al. Qualitative meta-synthesis of user experience of computerised therapy for depression and anxiety. PLoS ONE. 2014;9(1), e84323.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Rozental A, Boettcher J, Andersson G, Schmidt B, Carlbring P. Negative effects of Internet interventions: A qualitative content analysis of patients' experiences with treatments delivered online. Cogn Behav Ther. 2015;44(3):223–36.

    Article  PubMed  Google Scholar 

  19. Mathiasen K, Riper H, Ehlers LH, Valentin JB, Rosenberg NK. Internet-based CBT for social phobia and panic disorder in a specialised anxiety clinic in routine care: Results of a pilot randomised controlled trial. Invent. 2016;4:92–8. Part 1.

    Google Scholar 

  20. Berger T, Caspar F, Richardson R, Kneubühler B, Sutter D, Andersson G, et al. Internet-based treatment of social phobia: A randomized controlled trial comparing unguided with two types of guided self-help. Behav Res Ther. 2011;49(3):158–69.

    Article  PubMed  Google Scholar 

  21. Waller R, Gilbody S. Barriers to the uptake of computerized cognitive behavioural therapy: A systematic review of the quantitative and qualitative evidence. Psychol Med. 2009;39(5):705–12.

    Article  CAS  PubMed  Google Scholar 

  22. Kessler D, Lewis G, Kaur S, Wiles N, King M, Weich S, et al. Therapist-delivered Internet psychotherapy for depression in primary care: a randomised controlled trial. Lancet (London, England). 2009;374(9690):628–34.

    Article  Google Scholar 

  23. Hickie IB, Davenport TA, Luscombe GM, Moore M, Griffiths KM, Christensen H. Practitioner-supported delivery of internet-based cognitive behaviour therapy: evaluation of the feasibility of conducting a cluster randomised trial. Med J Aust. 2010;192(11 Suppl):S31–5.

    PubMed  Google Scholar 

  24. Hoifodt RS, Lillevoll KR, Griffiths KM, Wilsgaard T, Eisemann M, Waterloo K, et al. The clinical effectiveness of web-based cognitive behavioral therapy with face-to-face therapist support for depressed primary care patients: randomized controlled trial. J Med Internet Res. 2013;15(8), e153.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Volker D, Zijlstra-Vlasveld MC, Anema JR, Beekman AT, Brouwers EP, Emons WH, et al. Effectiveness of a blended web-based intervention on return to work for sick-listed employees with common mental disorders: results of a cluster randomized controlled trial. J Med Internet Res. 2015;17(5), e116.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Kooistra LC, Ruwaard J, Wiersma JE, van Oppen P, van der Vaart R, van Gemert-Pijnen JEWC, et al. Development and initial evaluation of blended cognitive behavioural treatment for major depression in routine specialized mental health care. Invent. 2016;4:61–71. Part 1.

    Google Scholar 

  27. Wilhelmsen M, Lillevoll K, Risor MB, Hoifodt R, Johansen ML, Waterloo K, et al. Motivation to persist with internet-based cognitive behavioural treatment using blended care: a qualitative study. BMC Psychiatry. 2013;13:296.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Kleiboer A, Smit J, Bosmans J, Ruwaard J, Andersson G, Topooco N, et al. European COMPARative Effectiveness research on blended Depression treatment versus treatment-as-usual (E-COMPARED): study protocol for a randomized controlled, non-inferiority trial in eight European countries. Trials. 2016;17(1):387.

    Article  PubMed  PubMed Central  Google Scholar 

  29. American Psychiatric Association. Diagnostic and Statistical Manual of Metal Disorders. 4th ed. Washington DC: Amercian Psychiatric Association; 2000.

    Google Scholar 

  30. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: Validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59 Suppl 20:22–33.

    PubMed  Google Scholar 

  32. Wittkampf KA, Naeije L, Schene AH, Huyser J, van Weert HC. Diagnostic accuracy of the mood module of the Patient Health Questionnaire: A systematic review. Gen Hosp Psychiatry. 2007;29(5):388–95.

    Article  PubMed  Google Scholar 

  33. Rush AJ, Trivedi MH, Ibrahim HM, Carmody TJ, Arnow B, Klein DN, et al. The 16-item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): A psychometric evaluation in patients with chronic major depression. Biol Psychiatry. 2003;54(5):573–83.

    Article  PubMed  Google Scholar 

  34. Rush AJ, Gullion CM, Basco MR, Jarrett RB, Trivedi MH. The Inventory of Depressive Symptomatology (IDS): Psychometric properties. Psychol Med. 1996;26(3):477–86.

    Article  CAS  PubMed  Google Scholar 

  35. Nguyen TD, Attkisson CC, Stegner BL. Assessment of patient satisfaction: Development and refinement of a service evaluation questionnaire. Eval Program Plan. 1983;6(3-4):299–314.

    Article  CAS  Google Scholar 

  36. Attkisson CC, Zwick R. The Client Satisfaction Questionnaire: Psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Program Plan. 1982;5(3):233–7.

    Article  CAS  Google Scholar 

  37. Devilly GJ, Borkovec TD. Psychometric properties of the credibility/expectancy questionnaire. J Behav Ther Exp Psychiatry. 2000;31(2):73–86.

    Article  CAS  PubMed  Google Scholar 

  38. Horvath AO, Greenberg LS. Development and validation of the Working Alliance Inventory. J Couns Psychol. 1989;36(2):223–33.

    Article  Google Scholar 

  39. Hatcher RL, Gillaspy JA. Development and validation of a revised short version of the Working Alliance Inventory. Psychoter Res. 2006;16(1):12–25.

    Article  Google Scholar 

  40. Munder T, Wilmers F, Leonhart R, Linster HW, Barth J. Working Alliance Inventory-Short Revised (WAI-SR): Psychometric properties in outpatients and inpatients. Clin Psychol Psychoter. 2010;17(3):231–9.

    Google Scholar 

  41. Brooke J. SUS - a quick and dirty usability scale. Usability Eval Ind. 1996;189:4–7.

    Google Scholar 

  42. Bangor A, Kortum PT, Miller JT. An empirical evaluation of the System Usability Scale. Int J Hum Comput Interact. 2008;24(6):574–94.

    Article  Google Scholar 

  43. Lowe B, Unutzer J, Callahan CM, Perkins AJ, Kroenke K. Monitoring depression treatment outcomes with the patient health questionnaire-9. Med Care. 2004;42(12):1194–201.

    Article  PubMed  Google Scholar 

  44. World Medical Association. Declaration of Helsinki ethical principles for medical research involving human subjects. 2013.

    Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the E-Compared project. Also we would like to acknowledge Odense Patient data Exploratory Network. Finally, the authors would like to acknowledge the Mental Health Services of Southern Denmark and Centre for Telepsychiatry.

Funding

Funding has been granted from the Research Fund of the Mental Health Services of Southern Denmark, J.B. Winsløvs Vej 20 indg. 220B, 5000 Odense C.

And from the Innovation Fund Denmark, Østergade 26 A, 4. sal, DK – 1100 København K as part of the project ENTER (ID nr.: 5159-00002B).

Both are public funds. None of the funds have had any role in the design of the study nor in collection of data, analysis of data, interpretation of data, or writing the manuscript.

Availability of data and materials

Data will not be publicly available due to restrictions by law of sensitive information. The ENTER project and the E-Compared project will have access to the dataset for scientific analyses and publications.

Authors’ contributions

KM: Main author. TEA: Co-supervisor. Contributed to study design and statistical analysis plan. AAMK: Author of the E-Compared generic protocol, which formed the foundation for the present protocol. HR: Co-main supervisor. Co-author of E-Compared generic protocol and contributor to study design of the present study. KKR: Main supervisor. Contributor to study design and assisting the process of authoring the present article in its entirety. All contributors have, in addition to the above, proof read the article.

Authors’ information

Not Applicable.

Competing interests

The software NoDep was developed jointly by the Region of Southern Denmark and the private partner Context Consulting. Kim Mathiasen participated in the development process as representative of the public partner Region of Southern Denmark. Kim Mathiasen has no affiliations to any of the private vendors involved in the project including Context Consulting and gains no economic income from sales of licenses.

The authors declare that they have no competing interests.

Ethics approval and consent to participate

The project has been approved by the Ethics Committee of the Region of Southern Denmark (registration number S-20150150). The project follows the declaration of Helsinki on Ethical Principles for Medical Research Involving Human Subjects [44]. All participants receive both written and oral information about the project and signed written informed consent is provided by all participants in the study. Additionally, the study is registered in ClinicalTrials.gov including all items from the WHO Trial Registration Data Set Version 1.2.

Dissemination of results

The primary results will be published in a relevant scientific journal independent of outcome. Additionally, main findings will be published in the final reporting on the ENTER project by Innovation Fond Denmark.

Author information

Authors and Affiliations

  1. Department of Psychology, University of Southern Denmark, Campusvej 55, Odense M, 5230, Denmark

    Kim Mathiasen, Tonny E. Andersen & Kirsten K. Roessler

  2. Centre for Telepsychiatry, Mental Health Services of Southern Denmark, Heden 11, Odense C, 5000, Denmark

    Kim Mathiasen

  3. Department of Clinical Psychology, VU University of Amsterdam, Van der Boechorststraat 1, Amsterdam, 1081HV, The Netherlands

    Heleen Riper & Annet A. M. Kleiboer

Authors
  1. Kim Mathiasen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tonny E. Andersen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Heleen Riper
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Annet A. M. Kleiboer
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kirsten K. Roessler
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kim Mathiasen.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mathiasen, K., Andersen, T.E., Riper, H. et al. Blended CBT versus face-to-face CBT: a randomised non-inferiority trial. BMC Psychiatry 16, 432 (2016). https://doi.org/10.1186/s12888-016-1140-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-016-1140-y

Keywords

BMC Psychiatry

ISSN: 1471-244X

Contact us