Skip to main content
Download PDF
  • Study protocol
  • Open access
  • Published:

The therapist’s role in the implementation of internet-based cognitive behavioural therapy for patients with depression: study protocol

BMC Psychiatry volume 16, Article number: 338 (2016) Cite this article

Abstract

Background

Internet-based Cognitive Behavioural Therapy (iCBT) for the treatment of depressive disorders is innovative and promising. Various studies have demonstrated large effect sizes up to 2.27, but implementation in routine practice lags behind. Mental health therapists play a significant role in the uptake of internet-based interventions. Therefore, it is interesting to study factors that influence the therapists in whether they apply internet-based therapy or not. This study, as part of the European implementation project MasterMind, aims to identity the factors that promote or hinder therapists in the use of iCBT in depression care.

Methods/Design

The uptake of iCBT by therapists in routine mental health care practice for the treatment of depression will be evaluated by a mixed method approach, to provide an understanding of the implementation factors (quantitative), and to ascertain the facilitating and hindering factors in the involvement of therapists in the implementation of iCBT (qualitative). The involvement of therapists in the implementation of iCBT is analysed following the RE-AIM framework on the five dimensions Reach, Efficacy/Effectiveness, Adoption, Implementation, and Maintenance. This enables us to evaluate the reach of therapists, the impact of iCBT on depression care, the extent to which therapists adopt iCBT, the extent to which iCBT is delivered as intended, and how iCBT can be maintained over time.

Discussion

The results will provide valuable insight into the role of therapists in the implementation of iCBT for depression in secondary mental health care settings. They will result in concrete recommendations for how therapists can be facilitated in implementing and up-scaling iCBT for depression.

Peer Review reports

Background

Despite its potential advantages and the evidence for its effectiveness, the implementation of internet-based Cognitive Behavioural Therapy (iCBT) for depression [1] in routine mental health care is lower than expected. Since 2000 more than 100 trials on iCBT have been conducted for various clinical disorders, such as depression, anxiety and chronic pain [2]. Most of the included studies focussed on clinical efficacy, and a small minority on cost effectiveness. The results from these various studies are promising, with large within-group effect sizes in the treatment of depression ranging from 0.38 to 2.27, with a mean of 0.94. Treatment with iCBT showed equivalent effects compared to conventional CBT. However, the use of iCBT is not scaled up to the extent that it actually helps to reduce the disease burden of depression. In the yearly national report on eHealth in the Netherlands only 6 % of a representative sample of mental health patients used online treatment in combination with usual care in 2015 [3]. The low uptake of iCBT is recognised by multiple health care organisations and policy makers across different countries but is not yet well understood.

The MasterMind project (Management of mental health disorders through advanced technology and services-telehealth for the MIND) [4] aims to provide understanding of the factors that promote or hinder the uptake of iCBT for depression throughout Europe from a broad perspective. MasterMind explores the role of different stakeholders that are involved in the successful implementation of the intervention (e.g. patients, therapists, mental healthcare organisations, regional mental healthcare systems) [5]. In Mastermind videoconferencing services will also be implemented in routine mental healthcare. In the current study protocol we focus specifically on the role of therapists in implementing iCBT in routine practice in the Netherlands.

To evaluate the role of the therapists in interaction with other barriers and facilitators at multiple levels of mental health care, the use of a framework and mixed method approach is needed [6, 7]. In this study the RE-AIM framework [8, 9] is used to structure the evaluation of the different implementation factors [10]. RE-AIM is widely used in implementation research, especially in e-mental health research. RE-AIM stands for: Reach, Efficacy or Effectiveness, Adoption, Implementation, and Maintenance. Together these dimensions help shed light on the barriers and facilitators and can ease the transition from research to practice. The RE-AIM framework is applied for evaluations at an individual level and an organizational level, as each level can provide valuable independent information on intervention impact. Reach and Effectiveness have individual levels of impact, whereas Adoption and Implementation have organisational levels of impact. Maintenance can have both an individual and an organisational level of impact [11].

The current situation in the Netherlands is that most mental health care organisations have adopted iCBT; there are many different providers for online platforms to choose from and almost every mental health care organisation already has on online platform in use for the internet-based treatment of mental disorders. However, mental health care organisations have different developmental levels regarding the implementation of iCBT in their care system. Some organisations have worked with online interventions for several years now, while others have just started implementing iCBT. Although many therapists in the mental health care organisations have been trained in using an online platform, a recent naturalistic study on the implementation of iCBT in a mental health service organisation in the Netherlands showed that only 3.6 % of the patients with depression or anxiety were offered iCBT (in a blended format: face-to-face and online sessions) by 18 % of the trained therapists over a time period of 3 years [12]. Thus, the reach of the intervention is still limited. A similar result was found by Carper and others [13] who showed that in the US there is a lack of awareness of iCBT in depression care among patients and clinicians. The findings concluded that a more widespread dissemination of iCBT interventions is needed.

In the literature some attention has already been paid to therapist related factors that play a role in the implementation of iCBT. Donovan et al. [14] found that knowledge of iCBT among mental health care professionals can play a role in the uptake of iCBT: greater knowledge of the intervention’s effectiveness was associated with fewer perceived disadvantages of iCBT in general, and more circumstances under which iCBT was perceived to be useful. Wilhemsen and others [15] indicated that lack of time, varied practice, inadequate knowledge of the program and changing professional’s habits are hindering factors in the implementation of iCBT. A qualitative study conducted by Kivi et al. [16] with four therapists identified similar barriers to implementing iCBT in mental health care. Therapists perceived a lack of knowledge, skills, resources and time and they had the feeling that they never fully mastered the protocol. Another explorative qualitative study with 11 therapists showed that several therapists see “iCBT as focused, structured, evidence-based, clear and safe” [17]. Although they feel that iCBT in general can provide the therapist more work-time control because of the structured nature, several therapists view iCBT as inferior to face-to-face CBT and think that a working alliance in the latter is achieved faster and more easily.

It is important to take clinical implications and therapists’ concerns into account when implementing iCBT in routine practice. These considerations may provide more insight in how to optimise the uptake by therapists. In this study we will further explore factors regarding the therapists’ role in implementing iCBT for depression in adults in secondary mental health care

Study objectives

There is a need for more information about the barriers therapists experience in adopting and implementing iCBT and how to overcome these barriers. To this end we focus on the needs of the therapist and (patient and organisation-related) facilitating and impeding factors. The MasterMind study provides an excellent opportunity to study these therapist factors. The objectives of this study are:

  1. 1.

    To gain insight into the extent to which therapists integrate iCBT in their routine practice.

  2. 2.

    To increase insight into the factors that promote or hinder the use of iCBT by therapists in depression care.

  3. 3.

    To provide recommendations on how to overcome barriers for therapists in the implementation of iCBT in routine depression care.

In order to obtain insight into strategies for optimising therapist uptake of iCBT we use the RE-AIM framework to answer the following questions:

  • Reach: What is the proportion and representativeness of therapists in the participating mental health organisations that offer iCBT for depression during the study?

  • Effectiveness: What is the (positive and negative) impact of iCBT on the therapists regarding perceived effectiveness, satisfaction and usability? How is this related to patient outcomes regarding symptom reduction, satisfaction and usability?

  • Adoption: To what extent do mental health care organisations adopt iCBT; how is the therapist facilitated in this and which efforts are made to this end in the participating mental health organisations?

  • Implementation: To what extent is iCBT implemented as intended in routine practice? What are implementation barriers and facilitators from therapists’ perspective?

  • Maintenance: To what extent does iCBT become a sustained part of routine practice, and what are facilitating and hindering factors in maintenance?

Methods and design

Study design

To reach the study objectives, the uptake of iCBT for depression in several mental health care practices in the Netherlands will be monitored. This multicentre evaluation will assess the involvement of therapists in the implementation of iCBT in interaction with organisational and patient factors. The study will investigate how implementation is reflected in the extent to which organisations adopt the intervention, and how the therapist’s perspective is affected by patient related factors such as changes in symptoms, satisfaction and perceived usability of the iCBT. A mixed-method approach will be used in order to provide an understanding of the implementation factors (quantitative) and to evaluate the facilitating and hindering factors in the involvement of therapists in the implementation of iCBT (qualitative) [8, 18, 19].

Sample

For the MasterMind study on an European level, the target number of 5230 participants is based on purposive quota sampling meaning the number of participants needed to be enrolled to regard the interventions as being implemented in routine practice after the study is finished, for the study in the Netherlands the target number is 300 participants and their therapists [5]. With estimating the sample size, feasibility and service delivery characteristics of iCBT in routine care in the Netherlands are taken into account. Ten mental health care organisations spread throughout the Netherlands will be approached. The selection of organisations is based on purposive sampling, meaning the organisations have different stages of iCBT implementation, as measured by the number of trained therapists and patients treated with iCBT; the organisations are located in different parts of the Netherlands and may use different iCBT treatment platforms for depression in secondary mental health care. The diversity of the participating organisations is necessary to enrich the (qualitative) data needed for the evaluation of the therapists’ involvement in the Netherlands. In the participating organisations we will approach key stakeholders at different levels such as eHealth project managers and directors.

Therapists

The therapists who are trained in iCBT will be invited to participate in the study. The therapists can be psychologists, mental health nurses or psychiatrists. Some of them are already experienced in delivering iCBT for depression; others are trained but not yet experienced.

Patients

Inclusion criteria

Patients from the participating mental health care organisations will be invited for participation if they are aged 18 years or older, have a mild, moderate or severe depression as a primary diagnosis according to the clinician, and are indicated for cognitive behavioural treatment for depression following routine care procedures. All patients need to explicitly consent to taking part in the study. Patients may provide electronic consent to use their data for the evaluation study.

Exclusion criteria

Patients will be excluded from the study if they a) do not have a valid email address and do not have a computer with internet access b) do not have adequate Dutch language skills; verbal and written.

Representatives of the mental healthcare organisations

From each mental healthcare organisation representatives will be invited to take part in the study.

The representatives are persons who have a substantive decision-making position in the implementation of iCBT in the organisation’s mental healthcare practice.

Intervention

Cognitive behavioural therapy relies on cognitive input and behavioural change and is well structured. This makes it suitable for an innovative information-technology based application [20]. In such an application an online treatment platform provides patient and therapist with an overview of the treatment sessions, information and exercises. Through the platform the patient can access psycho-education, treatment information and exercises at any time within the home environment. Furthermore, the therapist can monitor the progress of the patient online. With the integration of technology, iCBT can have several promising advantages; iCBT may improve access to treatment, because it can lower the barriers to seeking mental health care; iCBT can promote self-monitoring and self-management of the patient; iCBT might reduce treatment costs because of a reduction in face-to-face time [21]; the online platform is available for the patient 24 h, 7 days a week; and the online sessions can be repeated [22]. Furthermore, iCBT may improve the quality of delivery of the treatment, because of the standardised nature that gives a clear overview of the treatment, for both therapist and patient.

Most mental health care organisations in the Netherlands have contracts with providers of web-based treatments for common mental disorders and are therefore able to offer iCBT for depression. The organisations use various secure web-based online treatment platforms. In routine secondary mental health care, iCBT is mostly delivered in a blended format, consisting of the combination of online treatment modules and face-to-face sessions. The iCBT treatment modules are based on evidence based treatment protocols for face-to-face cognitive behavioural therapy and are in agreement with the Dutch multidisciplinary guidelines for depression [23]. The core components of the treatment are: 1) psycho-education, 2) cognitive restructuring, 3) behavioural activation, and 4) relapse prevention. As there is a distinction in secondary healthcare in the Netherlands between basic mental health care (mild to moderate depression), and specialised mental health care (more complex moderate to severe depression) the number of iCBT sessions differs between these health care levels: up to a maximum of 10–15 sessions in basic mental health care and usually 15–20 sessions in specialised mental health care. At both health care levels, in blended treatment, the number of face-to-face sessions is reduced because half or more of the face-to-face sessions are replaced by online treatment sessions [24, 25].

Outcome measures

The outcomes will be structured according to the RE-AIM framework. The concepts of the multidisciplinary assessment outcomes will be used to obtain a better understanding of the change in mental health care delivery and to help make decisions about the implementation more explicit and transparent. In this study the RE-AIM framework was somewhat adapted to fit to our focus on the therapists’ role, as was done earlier by Boersma et al. [26, 27]. Reach is the proportion and representativeness of therapists in the participating mental health organisations that offer iCBT for depression. Effectiveness is the impact of iCBT on therapists regarding perceived effectiveness, satisfaction and usability of iCBT and the impact of iCBT on patients regarding symptom reduction, satisfaction and usability. Adoption is the extent to which mental health care organisations adopt iCBT and how the therapist is facilitated in this. Implementation is the extent to which iCBT is implemented as intended in routine practice, including implementation barriers and facilitators from the therapist’s perspective. Maintenance is the extent to which iCBT becomes part of the normal routine of therapists. In other words, to have an impact on depression care, iCBT must be adopted by the mental health care organisations and therapists, reach the therapists who deliver the intervention, be implemented as intended, effectively improve outcomes and be maintained over time. The definitions of the RE-AIM frame work are presented in Table 1. In Table 2 an overview is given of the RE-AIM dimensions, the related content, factors and measures.

Table 1 Definitions of the five RE-AIM dimensions and the definitions in this study
Full size table
Table 2 Overview of the RE-AIM dimensions, the related content and measures
Full size table

Measurements

Qualitative and quantitative measures will be used to help understand the factors related to the implementation of iCBT according to the RE-AIM framework. Focus-group interviews and semi-structured interviews with the therapists will be conducted face-to-face at the end of the study (after 24 months of data collection). The interviews with therapists will focus on the experiences and perceptions of the trained therapists who participated in delivering iCBT in their daily work. In addition, interviews will be held with trained therapists who do not deliver the treatment, in order to explore their reasons and their perceptions of iCBT. In the focus groups with the therapists discussion on the following themes will be held: the patient (needs, profile, safety), the therapist (needs and profile), implementation barriers and facilitators and usability and satisfaction with iCBT. Prior to the focus-group interviews and semi-structured interviews, participants will be asked to fill out a short questionnaire to obtain general information about the interviewees and to prepare them for the interviews. If therapists stop working with iCBT (due to other jobs, positions), they will be asked for their input at an earlier time point.

The semi-structured interviews with key figures of the participating mental health care organisations will be conducted face-to-face and they will also take place at the end of study. In the interviews the focus will be on implementation barriers and facilitators, usability, satisfaction and maintenance, from an organisational perspective.

Interviewers and moderators for the focus groups will be provided with training and comprehensive interview guides including tips for interview techniques as well as suitable questions. In addition, relevant documents provided by the mental health care organisations will be reviewed (e.g. implementation and quality improvement plans, treatment protocols).

Quantitative data will be collected at baseline and at the end of treatment from patients, and from therapists at the end of the study. Information on demographic characteristics of the therapists that will be collected comprises age, gender, education, profession, years of professional experience, number of hours working and experience with iCBT. From patients demographic characteristics will be collected about age, gender, education, employment, marital status and use of antidepressant medication. In addition, to measure symptoms of depression, we will adhere to routine practice and this will be registered in terms of several symptom questionnaires, depending on the questionnaires used at the participating organisation. Health care organisations in the Netherlands use Routine Outcome Measurements (ROM). ROM consists of a broad selection of validated instruments to monitor treatment effects. The use of ROM is a mandatory component of treatment as required by health insurance companies. The most frequently used questionnaires are the Patient Health Questionnaire (PHQ-9) [28], the Inventory of Depressive Symptoms (IDS-SR) [29, 30] and the Quick Inventory of Depressive Symptomatology (QIDS) [31].

Perceived usability and satisfaction with iCBT will be measured from both therapists’ and patients’ perspective. Patient treatment satisfaction will be measured with the 8 item Client Satisfaction Questionnaire (CSQ-8) [32]. System usability will be measured with the System Usability Scale (SUS) [33]. The perceived satisfaction and usability of iCBT by patients will be measured at the end of treatment. In addition, therapist satisfaction and usability of iCBT will be measured at the end of the study; satisfaction will be measured with the 3 items CSQ and usability will be measured with the SUS.

To assess the extent to which the treatment is delivered by protocol, the usage data from the online platforms will be gathered (e.g. number of online sessions and usage of other platform functionalities).

Statistical analyses

Analysis will be of a summative nature combining quantitative data with qualitative data [34, 35] to draw a broad picture of implementation and to describe the role of the therapist in the uptake of iCBT in connection with the patient and the organisation. On a patient level, data of all participants will be included in the statistical analysis when they are eligible and agree to receiving treatment, regardless whether the participants complete their treatment or not.

The evaluation of the implementation will be performed by using the outcomes as described above following the RE-AIM dimensions. Descriptive analyses (frequencies, means and percentages) of the quantitative data (demographics of patients and therapists, depressive symptoms, perceived satisfaction and perceived usability) will be performed with the Statistical Package for the Social Sciences (SPSS), version 22.0. The qualitative data collected during the focus groups (including field notes) and the semi-structured interviews will be audiotaped and transcribed verbatim. We will use standard thematic content analysis techniques by the following steps: 1) familiarising and summarising the data 2) identifying codes and themes 3) coding the data and 4) organising the codes and themes [36]. In order to ensure reliability, agreement on codes and concepts between the members of the research team will be sought. Qualitative data analyses will be performed by using the software Atlas-ti.7.

Discussion

The primary aim of the study is to gain insight into the extent to which therapists integrate internet-based Cognitive Behavioural Therapy (iCBT) in routine depression care in the Netherlands. The second aim is to gather insight into the factors that promote or hinder the implementation of iCBT. More specifically, we want to gain knowledge on the role of the therapist in the implementation of iCBT, in relation to patient and organisational factors; how do therapists evaluate iCBT, what resources are available and are needed, and what decision-making processes are important? The third aim is to provide recommendations for implementing iCBT in different contexts and organisations, in order to make high quality treatment more widely available for adults with depression.

The strength of this protocol is its multifaceted evaluation with a focus on the role of the therapist in relation to the organisation and the patients with depression. A second key strength is the mixed method approach to incorporate quantitative and qualitative aspects of the implementation outcomes. Glasgow [8] argues that qualitative data can help in interpreting quantitative results, “such as why potential users decline participation or why they do not remain engaged over time” and that “qualitative measures can be very helpful in understanding contextual issues”. The focus groups and interviews with therapists will give us more insight into how to implement iCBT in routine practice. Furthermore, the semi-structured interviews with representatives of the mental health care organisations will contribute to a better understanding of the implementation on an organisational level. The use of multiple data sources will provide a detailed understanding of how iCBT can be implemented. The RE-AIM framework helps to guide data collection and analysis for the evaluation. To our knowledge, this is one of the first studies to examine the implementation of iCBT for depression in routine mental health care systematically.

In sum, the findings of this study will provide a number of implications for future practice. When we know more about the barriers and facilitators for up-scaling and maintaining interventions and have more knowledge about the effective strategies that will help identify and characterise these, it will help us make mental health care for depression more widely available and effective in future practice.

Abbreviations

CSQ:

Client satisfaction questionnaire

EPD:

Electronic patient dossier

iCBT:

Internet-based cognitive behavioural therapy

IDS-SR:

Inventory of depressive symptoms

PHQ:

Patient health questionnaire

RE-AIM:

Reach, effectiveness, adoption, implementation, maintenance

ROM:

Routine outcome measurement

SUS:

System usability scale

References

  1. Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry. 2014;13:288–95.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Hedman E, Ljótsson B, Lindefors N. Cognitive behavior therapy via the Internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Rev Pharmacoecon Outcomes Res. 2012;12:745–64.

    Article  PubMed  Google Scholar 

  3. Krijgsman J, Peeters J, Burghouts A, Brabers A, de Jong J, Moll T, et al. Tussen vonk en vlam: eHealth-monitor 2015. 2015. Nictiz en het NIVEL.

    Google Scholar 

  4. Management of mental health disorders through advanced technology and services-telehealth for the MIND. (2014). http://mastermind-project.eu/. Accessed 22 Aug 2016.

  5. Vis C, Kleiboer A, Prior R, Bønes E, Cavallo M, Clark SA, et al. Implementing and up-scaling evidence-based eMental health in Europe: the study protocol for the MasterMind project. Internet Interv. 2015;2:399–409.

    Article  Google Scholar 

  6. Gaglio B, Shoup JA, Glasgow RE. The RE-AIM framework: a systematic review of use over time. Am J Public Health. 2013;103:38–46.

    Article  Google Scholar 

  7. Cochrane LJ, Olson CA, Murray S, Dupuis M, Tooman T, Hayes S. Gaps between knowing and doing: understanding and assessing the barriers to optimal health care. J Contin Educ Health Prof. 2007;27:94–102.

    Article  PubMed  Google Scholar 

  8. Glasgow RE. eHealth evaluation and dissemination research. Am J Prev Med. 2007;32:119–26.

    Article  Google Scholar 

  9. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89:1322–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10:53.

    Article  PubMed  PubMed Central  Google Scholar 

  11. RE-AIM framework. (2016). http://www.re-aim.org/. Accessed 22 Aug 2016.

  12. Kenter RMF, van de Ven PM, Cuijpers P, Koole G, Niamat S, Gerrits RS, et al. Costs and effects of Internet cognitive behavioral treatment blended with face-to-face treatment: results from a naturalistic study. Internet Interv. 2015;2:77–83.

    Article  Google Scholar 

  13. Carper MM, McHugh RK, Barlow DH. The dissemination of computer-based psychological treatment: a preliminary analysis of patient and clinician perceptions. Adm Policy Ment Heal. 2013;40:87–95.

    Article  Google Scholar 

  14. Donovan CL, Poole C, Boyes N, Redgate J, March S. Australian mental health worker attitudes towards cCBT: What is the role of knowledge? Are there differences? Can we change them? Internet Interv. 2015;2:372–81.

    Article  Google Scholar 

  15. Wilhelmsen M, Hoifodt RS, Kolstrup N, Waterloo K, Eisemann M, Chenhall R, et al. Norwegian general practitioners’ perspectives on implementation of a guided web-based cognitive behavioral therapy for depression: a qualitative study. J Med Internet Res. 2014;16:9.

    Article  Google Scholar 

  16. Kivi M, Eriksson MCM, Hange D, Petersson E-L, Björkelund C, Johansson B. Experiences and attitudes of primary care therapists in the implementation and use of internet-based treatment in Swedish primary care settings. Internet Interv. 2015;2:248–56.

    Article  Google Scholar 

  17. Bengtsson J, Nordin S, Carlbring P. Therapists’ experiences of conducting cognitive behavioural therapy online vis-à-vis face-to-face. Cogn Behav Ther. 2015;6073:1–10.

    Google Scholar 

  18. Landsverk J, Brown H, Chamberlain P, Palinkas LA, Horwitz SM. Design and analysis in dissemination and implementation research. In: Brownson R, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice. Oxford: Oxford Univ Press; 2012. p. 225–60.

    Chapter  Google Scholar 

  19. Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Adm Policy Ment Heal Ment Heal Serv Res. 2010;38:44–53.

    Article  Google Scholar 

  20. Proudfoot JG. Computer-based treatment for anxiety and depression: is it feasible? Is it effective? Neurosci Biobehav Rev. 2004;28:353–63.

    Article  PubMed  Google Scholar 

  21. Kaltenthaler E, Brazier J, De Nigris E, Tumur I, Ferriter M, Beverley C, et al. Computerised cognitive behaviour therapy for depression and anxiety update: a systematic review and economic evaluation. Health Technol Assess. 2006;10:1–70.

    Article  Google Scholar 

  22. National Institute for Clinical Excellence. Computerised cognitive behaviour therapy for depression and anxiety. London: NICE. Technology Appraisal Guidance [TA97]; 2013.

    Google Scholar 

  23. Spijker J, Bockting C, Meeuwissen J, van Vliet I, Emmelkamp P, Hermens M, et al. Multidisciplinaire richtlijn Depressie (Derde revisie). Richtlijn voor de diagnostiek, behandeling en begeleiding van volwassen patiënten met een depressieve stoornis [Multidisciplinary Guideline for Depression (Third Revision)]. Utrecht: Guideline for Diagnostics; 2013.

    Google Scholar 

  24. Kooistra LC, Wiersma JE, Ruwaard J, van Oppen P, Smit F, Lokkerbol J, et al. Blended vs. face-to-face cognitive behavioural treatment for major depression in specialized mental health care: study protocol of a randomized controlled cost-effectiveness trial. BMC Psychiatry. 2014;14:290.

    Article  PubMed  PubMed Central  Google Scholar 

  25. van der Vaart R, Witting M, Riper H, Kooistra L, Bohlmeijer ET, van Gemert-Pijnen LJ. Blending online therapy into regular face-to-face therapy for depression: content, ratio and preconditions according to patients and therapists using a Delphi study. BMC Psychiatry. 2014;14:355.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Boersma P, van Weert JCM, Lakerveld J, Dröes R-M. The art of successful implementation of psychosocial interventions in residential dementia care: a systematic review of the literature based on the RE-AIM framework. Int Psychogeriatr. 2015;27:19–35.

    Article  PubMed  Google Scholar 

  27. Boersma P, van Weert JCM, van Meijel B, Dröes RM. Implementation of the Veder contact method in daily nursing home care for people with dementia: a process analysis according to the re-aim framework. J Clin Nurs. 2016. doi:10.1111/jocn.13432.

    PubMed  Google Scholar 

  28. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9. J Gen Intern Med. 2001;16:606–13.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. John Rush A, Giles DE, Schlesser MA, Fulton CL, Weissenburger J, Burns C. The inventory for depressive symptomatology (IDS): preliminary findings. Psychiatry Res. 1986;18:65–87.

    Article  Google Scholar 

  30. Rush A, Gullion C, Basco M, Jarrett R, Trivedi M. The inventory of depressive symptomatology (IDS): psychometric properties. Psychol Med. 1996;26:477–86.

    Article  CAS  PubMed  Google Scholar 

  31. Rush AJ, Trivedi MH, Ibrahim HM, Carmody TJ, Arnow B, Klein DN, et al. The 16-Item quick inventory of depressive symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression. Biol Psychiatry. 2003;54:573–83.

    Article  PubMed  Google Scholar 

  32. Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD. Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann. 1979;2:197–207.

    Article  CAS  PubMed  Google Scholar 

  33. Brooke J. SUS-A quick and dirty usability scale. Usabil Eval Ind. 1996;189:4–7.

    Google Scholar 

  34. Caracelli V, Greene J. Data analysis strategies for mixed-method evaluation designs. Educ Eval Policy Anal. 1993;15:195–207.

    Article  Google Scholar 

  35. Gaglio B, Glasgow R. Evaluation approaches for dissemination and implementation research. In: Brownson R, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice. Oxford: Oxford Univ Press; 2012. p. 327–58.

    Chapter  Google Scholar 

  36. Green J, Thorogood N. Qualitative methods for health research. 3rd ed. London: Sage; 2013.

    Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

The MasterMind project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme (CIP) by the European Commission (Grant Agreement number: 621000).

Availability of data and materials

Not applicable.

Authors’ contributions

HR and JS obtained funding for this study. HR, JS, ED, DvS and CV contributed to the design of the study. ED and MM coordinate the recruitment of health care organisations, therapists and patients and the data collection. HR, JS, ED and DvS are responsible for the overall design and supervision. MM wrote the manuscript. All authors read, contributed and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The Medical Ethics Committee confirmed that the “Medical Research Involving Human Subjects Act” (WMO) does not apply to the MasterMind study in the Netherlands (registration number 2014.580), because the patients in this study are not required to follow certain procedures on behalf of the research (no randomization) and we follow routine practice. An internal scientific research committee approved the research proposal (CWO 2015–005). All participants need to sign an (online) informed consent form.

Study status

Inclusion of therapists and patients is in the ongoing recruitment phase. Recruitment started in February 2015. The interviews and focus groups are planned for end of 2016. Analyses will be finalised in 2017 and reporting follows subsequently.

Author information

Authors and Affiliations

  1. Department of Research & Innovation, GGZ inGeest, A.J. Ernststraat 1187, 1081 HL, Amsterdam, The Netherlands

    Mayke Mol, Els Dozeman, Digna J. F. van Schaik, Heleen Riper & Jan H Smit

  2. EMGO Institute for Health Care and Research and Department of Psychiatry, VU University Medical Centre, Van der Boechorststraat 1, 1081 BT, Amsterdam, The Netherlands

    Mayke Mol, Els Dozeman, Digna J. F. van Schaik, Christiaan P. C. D. Vis, Heleen Riper & Jan H Smit

  3. Department of Clinical Psychology, VU University Amsterdam, Van der Boechorststraat 1, 1081 BT, Amsterdam, The Netherlands

    Christiaan P. C. D. Vis & Heleen Riper

Authors
  1. Mayke Mol
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Els Dozeman
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Digna J. F. van Schaik
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Christiaan P. C. D. Vis
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Heleen Riper
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jan H Smit
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mayke Mol.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mol, M., Dozeman, E., van Schaik, D.J.F. et al. The therapist’s role in the implementation of internet-based cognitive behavioural therapy for patients with depression: study protocol. BMC Psychiatry 16, 338 (2016). https://doi.org/10.1186/s12888-016-1045-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-016-1045-9

Keywords

BMC Psychiatry

ISSN: 1471-244X

Contact us