Efficacy and cost-effectiveness of a web-based intervention with mobile phone support to treat depressive symptoms in adults with diabetes mellitus type 1 and type 2: design of a randomised controlled trial
A diagnosis of diabetes mellitus types 1 or 2 doubles the odds of a comorbid depressive disorder. The combined diseases have a wide range of adverse outcomes, such as a lower quality of life, poorer diabetes outcomes and increased healthcare utilisation. Diabetes patients with depression can be treated effectively with psychotherapy, but access to psychological care is limited. In this study we will examine the efficacy and cost-effectiveness of a newly developed web-based intervention (GET.ON Mood Enhancer Diabetes) for people with diabetes and comorbid depressive symptoms.
Methods/Design
A two-arm randomised controlled trial will be conducted. Adults with diabetes (type 1 or type 2) with increased depression scores (> 22 on the German version of the Center for Epidemiological Studies Depression Scale (CES-D)) will be included. Eligible participants will be recruited through advertisement in diabetes patient journals and via a large-scale German health insurance company. The participants will be randomly assigned to either a 6-week minimally guided web-based self-help program or an online psychoeducation program on depression. The study will include 260 participants, which will enable us to detect a statistically significant difference with a group effect size of d = 0.35 at a power of 80% and a significance level of p = 0.05. The primary outcome measure will be the level of depression as assessed by the CES-D. The secondary outcome measures will be: diabetes-specific emotional distress, glycaemic control, self-management behaviour and the participants’ satisfaction with the intervention. Online self-assessments will be collected at baseline and after a 2 months period, with additional follow-up measurements 6 and 12 months after randomisation. The data will be analysed on an intention-to-treat basis and per protocol. In addition, we will conduct an economic evaluation from a societal perspective.
Discussion
If this intervention is shown to be cost-effective, it has considerable potential for implementing psychological care for large numbers of people with diabetes and comorbid depression in routine practice and improve health outcomes.
Trial registration
German Clinical Trial Register (DRKS): DRKS00004748.
Diabetes is highly prevalent. The International Diabetes Federation (IDF) estimates that in 2012, more than 371 million people worldwide were adversely affected by diabetes. It is estimated that 5.2 million people in Germany suffer from diabetes [1]. A meta-analysis found that approximately 11% of all people with diabetes, that were assessed through standardised diagnostic interviews, suffered from depression. However, 31% of all people with diabetes reported themselves as depressive when assessed through self-report questionnaires [2]. In comparison to the general population, a diagnosis of diabetes type 1 or type 2 doubles the odds of a comorbid depressive disorder [2]. The combination of diabetes and depression is associated with poor mental health and harmful medical outcomes. People affected by comorbid depression exhibit lower quality of life [3, 4], poorer adherence to diabetes self-care practises [5], worse glycaemic control [6] and greater risk of diabetes-related complications [7]. Furthermore, comorbid depression in diabetes is associated with excess mortality [8, 9]. Studies have shown that indirect and direct health care costs are greater among adults with diabetes and depression compared with adults with diabetes only [10–13].
Psychotherapy has been demonstrated to be as effective for people with diabetes and co-morbid depression as for those without diabetes [14, 15]. However, depression is poorly recognised in general [16] and depression in diabetes is often undetected and untreated [17]. The reasons are manifold, for example due to the overlap of the symptoms of diabetes and depression, depression is not always diagnosed [18, 19], or due to perceived stigmatisation of depression [20]. Using the Internet to provide guided self-help interventions may help to overcome some of the limitations of traditional treatment services. The Internet exhibits anonymity and time-independent access to treatment at low costs [21, 22].
Meta-analyses have shown that web-based interventions are effective for treating mental disorders such as depression, anxiety or problem drinking [23–29] and may be successfully implemented in routine practice [30, 31]. There are few web-based treatment studies for comorbid disorders, but the results are promising [32, 33]. Van Bastelaar et al. (2011) conducted a study to test the efficacy of a web-based diabetes-specific cognitive behavioural therapy (CBT) intervention for persons with diabetes and depression. They showed that the web-based CBT program was efficacious in reducing depressive symptoms in persons with diabetes type 1 or type 2 (effect size d = 0.29) [32]. Moreover, a secondary analysis found that clinical severity was not a significant effect modifier [34]. Thus, web-based interventions may be effective for people with diabetes and comorbid sub-threshold or major depression (according to Diagnostic and Statistical Manual of Mental Disorders (DSM-IV)). This result aligns with the meta-analysis by Andrews and colleagues about the potential of web-based interventions for treating severe mental depression and anxiety [26].
Non-compliance and low adherence to physical treatments or medication regiments are common problems among people with diabetes [35], people with depression [36, 37] and participants in web-based interventions in general [38]. As van Bastelaar et al. [32] noted, it is important to consider ways to minimise attrition rates.
After considering the findings of van Bastelaar et al. [32, 34, 39, 40], we developed a minimally guided, diabetes-specific web-based intervention with mobile phone support to reduce depressive symptoms in the German speaking population of diabetes patients. Subsequently, we will determine whether the findings of van Bastelaar et al. [32] can be replicated and whether short-term improvement can be sustained in the long-term. We hypothesise that the intervention group (IG), which will have access to the online program GET.ON Mood Enhancer Diabetes (GET.ON M.D.), will have significantly lower levels of depressed mood than the control group (CG).
Web-based depression interventions appear to be cost-effective for the general population as shown in a small number of studies [41–44]. Although, a web-based diabetes-specific intervention has shown to be effective in reducing depressive symptoms, it is unclear whether it is also cost-effective [32]. Hence, the present trial will evaluate the economic impact of GET.ON M.D.. We hypothesise that from a societal perspective, the GET.ON. M.D. will be a cost-effective program for reducing depressive symptoms of people with diabetes in comparison to the control group.
Methods/Design
Study design
This study is designed as a randomised controlled trial with two parallel groups. The IG will receive access to the diabetes-specific, web-based online program (GET.ON M.D.). The CG will receive general online psychoeducation about depression. Moreover, the CG will have the opportunity to work with an unguided version of the online program 12 months after baseline assessment. The participants in both conditions will have unrestricted access to treatment as usual during the study.
Measurement points are scheduled equally for both groups, at baseline and 8 weeks after randomisation. In addition, there will be follow-up measurements 6 and 12 months after randomisation (Figure 1).
Figure 1
Study flow.
This study was approved by the Psychology Ethics Committee of the Philipps-University of Marburg, Germany.
Recruitment
Firstly, we will advertise the study in German journals for people with diabetes. Secondly, we cooperate with a large-scale German health insurance company: insurants with diabetes will be informed via post about the possibility of participating in this study. Furthermore, we will contact large-scale diabetes patients organisations with the request to inform their members about our study on their websites. In addition, the study will be advertised on social networks such as Facebook and Twitter.
The recruitment message for the study focuses on the opportunity for people with diabetes mellitus (type 1 or type 2) to help reduce depression. Recruitment is still ongoing (start March 2013) with a total recruitment time of 8 months.
Study procedures
The open access website (https://geton-training.de) contains detailed information about the study. Interested visitors may leave their email addresses on this website. Afterwards, they will be registered in a secured web-based platform and invited for an online screening. The people who do not pass the screening will receive an explanation for their exclusion along with the German patient guidelines for depression [45] via email. The people who report suicidal ideation will receive an email with the advice to seek professional help and detailed information on available services. The participants who pass the screening will be asked for informed consent via email and will have to fill out a baseline questionnaire. These participants will also be invited to complete the Structured Clinical Interview (SCID-I for DSM IV, by telephone) [46]. The SCID is used to assess whether the included participants have major or minor depression at baseline and whether they have had episodes of depression in the past. The SCID also includes a suicide protocol that enables us to identify people who are currently suffering from suicidal ideation. The telephone SCID is comparable to a face-to-face interview [47] and administered by a trained interviewer. After the telephone interview, the participants will be randomised.
To increase the probability that the participants will complete the follow-up procedure (8 weeks, 6 months and 12 months after baseline), they are offered a monetary incentive for completing each online survey (50 Euros for the completion of all follow-up surveys). Payment will be arranged after each complete questionnaire has been received.
Study population
This study focuses on adults with diabetes mellitus type 1 or type 2 and depressive symptoms.
The following inclusion criteria apply
Aged 18 or above; German language skills; presence of diabetes mellitus type 1 or type 2 diagnosed more than 3 months prior to the study; depressed mood, as indicated by a value of 23 or higher [48, 49] on the Center for Epidemiological Studies Depression Scale (CES-D); access to the Internet and an email address.
The following exclusion criteria apply
A risk of suicide as measured by item 9 of the Beck Depression Inventory II (BDI II) (value > 1) [50]; a risk of suicide as measured by the SCID [46] and an attached suicide protocol; current psychotherapeutic treatment or being present on a waiting list for such treatment; or pregnancy.
Sample size
Informed by previous studies [25, 32], the sample size is based on the expected difference in the primary outcome (CES-D) between the intervention group and the control group at post-test. This sample size provides 80% power to detect a mean difference of d = 0.35 in the effect sizes for the primary outcome (alpha = 0.05, two-tailed test; calculated using Power Analysis and Sample Size Software (PASS 12)). We will need 130 participants per group; hence a total of 260 participants will be included.
Randomisation
An automated, web-based randomisation program (randomisation.eu) will assign the participants to either the intervention or the control group in a ratio of 1:1.
Description of the two groups
Intervention group
The GET.ON M.D. program consists of 6 minimally guided online sessions. Each session has an average duration of 45 minutes and includes homework assignments and a mood diary. The participants will be advised to work on one or two sessions each week. Guidance will be provided by graduate students and psychologists (trainers). Trainers are supervised by an experienced clinical psychologist. The communication between the participants and the trainers will take place via the internal messaging function on the GET.ON M.D. platform.
The primary task of the trainer is to reflect on the processed sessions to increase the participants’ motivation and adherence. The trainer will spend approximately three hours in total with each participant. The web-based program is designed to be flexible, and the participants will be able to follow the program on the Internet – also on a tablet or on a mobile phone. An integrated read-aloud function will allow the participants to follow the audio-narration of each session.
Intervention content
GET.ON M.D. is based on two main evidence-based components: systematic behavioural activation [51] and problem solving [52]. In addition, the program also focuses on relevant diabetes-specific topics, including worries about diabetes complications, physical training, blood glucose, the physician-patient relationship and sexuality [53, 54]. The program was developed by consolidating our body of research, clinical experience and input from a diabetes medical specialist (Table 1).
Table 1
Overview of the sessions
Session
Depression-specific topics
Diabetes-specific topics added
1
Psychoeducation
Connection diabetes and depression
2
Behavioural activation
Worrying about diabetes-related complications
3
Problem solving I
Diabetes and relationship/sexuality
4
Problem solving II
Rumination about diabetes
5
Behavioural activation, focus on physical activity and self-esteem
Physical activity and diabetes
6
Plan for the future
Conversation with a general practitioner
Additional components
Session
Depression-specific topics
Diabetes-specific topics added
7
Overweight/obesity
Diabetes and nutrition
8
Insomnia
---
Session
Depression-specific topics
Diabetes-specific topics added
Booster
Summary: Behavioural activation; Problem solving
Choice of the known topics (1-6)
Psychoeducation (session 1)
The first session consists of psychoeducation [55]. The participants are informed that diabetes and depression are linked and can impact each other. In two videos, they are provided psychoeducational information, and they receive an overview of the whole program. After defining their goals concerning depression and diabetes, the participants choose a first positive activity for the next day.
Behavioural activation (sessions 2 and 5)
The concept of behavioural activation is introduced with a video. The participants are familiarised with the connection between pleasant activities and mood. With the help of examples, the participants create an individual list of activities. Based on the principles of action planning and coping planning, the participants schedule pleasant activities for a few days [51]. Starting with session 2, this scheduling component is integrated into each session.
In session 5, the key focus is on physical activity. Based on the transtheoretical model of health behaviour change [56], the participants can reflect on their own stage of change and receive adapted information and tasks.
Problem solving (sessions 3 and 4)
Throughout sessions 3 and 4, the main focus is on problem solving [52]. After listing experienced problems, the participants are prompted to classify their problems as solvable or unsolvable. Following a video, the participants become familiar with a six-step plan to handle solvable problems. Next, they are encouraged to apply this plan to one of their problems. In session 4, the participants retrospectively review their plans and choose to either continue to work on the specific problem or start to work on a new one. In addition, they learn techniques to reduce rumination on unsolvable problems.
Plan for the future (session 6)
In the last session, the participants assess whether they have seen improvements in mood. They can learn about additional ways to get help, if needed. In addition, the participants reflect on which techniques suit them, and are encouraged to make a plan for the future. At the end, they write a letter to themselves about what they want to achieve during the next four weeks.
Optional sessions and booster session
The participants are offered two optional sessions (healthy sleep and coping with obesity) that are available at the end of sessions 2 through 5. It is known that insomnia is a predictor and a symptom of depression [57]. The sleep session offers information on the principles of sleep hygiene, sleep restriction and stimulus control [58]. There is also a relationship between obesity and depression [59]. In particular, people with diabetes type 2 often suffer from obesity [60]. The aim of this session is to cope with the psychological consequences of obesity, for example frustration, feelings of self-blame and guilt.
Four weeks after finishing the intervention, the participants have the opportunity to work on an optional booster session. The aim of this session is to evaluate progress and to strengthen their newly acquired skills.
Improving efficacy and adherence
Taking into account that non-compliance presents as a problem in web-based programs [38], in many depressed people [36, 37] and people with diabetes [35], we developed two ways to increase the number of sessions completed by the intervention group.
Improving efficacy and adherence I: text message coach
Preliminary results have shown that mobile phone-based interventions and mobile phone supportive messages have the potential to improve psychological wellbeing and decrease stress or depression [61]. A pilot study demonstrated that daily text messaging, as a supplement to face-to-face CBT, is feasible and acceptable to patients. Positive experiences with the text messages were reported by 65% of the participants [62]. Studies have also indicated that text messages about diabetes self-management can also lead to benefits in some cases [63, 64]. The participants in this study will have the opportunity to apply for a standardised text message coach: they will receive daily text messages to support their efforts to integrate the techniques they learn within the program into everyday life. The text messages address four different areas: behavioural activation, problem solving, diabetes and motivation enhancement.
Improving efficacy and adherence II: phone call
Clarke et al. (2005) have demonstrated that reminders (by telephone or postcards) are a pivotal factor in effectiveness and attrition [65]. In the GET.ON M.D. study, a participant who does not complete a session within one week will receive a reminder email from his or her personal trainer. If a participant does not log in to the program during the next seven days after receiving this reminder, he or she will receive a phone call from his or her trainer.
The aim of this call is both to motivate the participant to proceed with the training and to identify the exact reasons for not logging in (e.g. forgetfulness, technical problems, lack of interest).
Control group - psychoeducation
The CG will have access to online psychoeducation based on the German S3-Guideline/National Disease Management Guideline “Unipolar Depression” [45]. Psychoeducation is helpful in reducing depressive symptoms [55]. It informs the participants about the nature of depression including information about symptoms and sources of help. After the last measurement point (12 months after baseline), the CG will have access to an unguided version of the GET.ON M.D. program.
Outcome assessment
For an overview of the assessments at baseline, after treatment and during the follow-up phase see Table 2.
Table 2
Overview of the assessments
T0
T1
T2
T3
T4
Measurements for the efficacy evaluation
Center for epidemiological studies depression Scale
x
x
x
x
x
Hospital anxiety and depression scale (Depression)
-
x
x
x
x
Penn state worry questionnaire
-
x
x
x
x
Behavioural activation depression scale
-
x
x
x
x
Social problem solving inventory - Revised
-
x
x
x
x
Haemoglobin A1c
-
x
x
x
Problem areas in diabetes
-
x
x
x
x
Acceptance and action diabetes questionnaire
-
x
x
x
x
Diabetes self-management questionnaire
-
x
x
x
x
Kessler psychological distress scale
-
x
-
-
-
Negative effects of online health trainings
-
-
(x)
-
-
Attitudes towards seeking psychological help scale
-
x
x
-
-
Measurements for the economic evaluation
Trimbos/iMTA questionnaire for costs associated with Psychiatric Illness
-
x
-
x
x
Quality of life (EuroQol, SF-12)
-
x
x
x
x
Additional measurements
Demographic variables questionnaire
x
-
-
-
-
Lifestyle data
x
-
-
-
-
Data on diabetes
x
-
-
-
-
Patient questionnaire on therapy expectation and evaluation (Online-Training)
-
x
-
-
-
Client Satisfactory Questionnaire
-
-
(x)
-
-
Way of recruitment and familiarity with the Internet
Assessments: x = intervention and control group, (x) = intervention group only.
Primary outcome measures
The primary outcome is the level of depression, which is measured by the CES-D, a well-validated self-report depression questionnaire that will be administered online [48, 49]. The CES-D consists of 20 items that are answered on a 4-point Likert scale; the total score ranges between 0 and 60. The internal consistency is reported to be α = 0.89, and the split-half reliability is r = 0.91 [48].
Secondary outcome measures
The secondary outcome measures include the depression subscale of the Hospital Anxiety and Depression Scale (HADS [66, 67]); the Penn State Worry Questionnaire (PSWQ [68], 3-item short version [69]); the Behavioural Activation Depression Scale (BADS [70], 9-item short version [71]); the Social Problem Solving Inventory-Revised (SPSI-R [72]); the long-term blood sugar level (self-reported haemoglobin A1c values (HbA1c)); the Problem Areas in Diabetes questionnaire (PAID [73], German 5-item short version [74]); the Acceptance and Action Diabetes Questionnaire (AADQ [75], German version [76]); the Diabetes Self-Management Questionnaire (DSMQ [77]); the negative effects of online health trainings questionnaire ([78], self-adapted version for online health trainings); the Kessler Psychological Distress Scale (K10 [79]); and the Attitudes Towards Seeking Psychological Help Scale (ATSPHS, [80], 10-item short version [81]).
Additional measurements
We will collect socio-demographic data (age, gender, education and occupation); lifestyle data (body mass index, smoking and alcohol use); data on diabetes (type, duration of illness and comorbidity); Patient Questionnaire on Therapy Expectation and Evaluation (PATHEV [82]); data on satisfaction with the program (a self-designed questionnaire based on the German version of the Client Satisfaction Questionnaire [83, 84]); data about the method of recruitment (for example through a diabetes journal or Facebook) and additional information about the participant’s familiarity with the Internet.
Measurements for the economic evaluation
Cost measures
We will use the Dutch Cost Questionnaire “Trimbos Institute and Institute of Medical Technology Questionnaire for Costs Associated with Psychiatric Illness” (TiC-P) [85] adapted for the German health care system. We will include the costs of any type of health care and medicines (direct medical costs), travel expenses and also those for parking (direct non-medical costs), and the costs related to production losses (indirect costs) [86].
Quality of life
Quality-adjusted life years (QALYs) will be calculated based on the EuroQol (EQ-5D) [87] and the Short Form Health Survey 12 (SF-12) [88]. The EQ-5D is a validated tool for measuring general health-related quality of life. It consists of five items (mobility, self-care, usual activities, pain/discomfort and anxiety/depression), each of which is rated as causing “no problems”, “some problems” or “extreme problems” [89]. Moreover, to generate the QALYs, a visual analogue scale (VAS) ranging from 0 (worst imaginable health state) to 100 (best imaginable health state) is also an integral part of the EQ-5D.
The SF-12 is based on the 36-item Short Form Health Survey (SF-36), a health-related quality-of-life questionnaire [90]. The SF-12 focuses on eight dimensions of health (physical functioning, role-physical, bodily pain, general health, vitality, social functioning, role-emotional and mental health).
Statistical analysis
Clinical analysis
The analysis will be performed according to the Consolidated Standards of Reporting Trials (CONSORT) statement regarding eHealth [91]. The data will be analysed on an intention-to-treat (ITT) basis. Group differences in the baseline values of the primary outcome will be compared using t tests to assess whether randomisation was successful. Missing data will be addressed following the recommendations of Little and Rubin [92] and Schafer [93]. We will analyse the CES-D data at two months post-treatment using between-group analyses of covariance (ANCOVAs) on the individual baseline depression scores, adjusting for sex, age and socio-economic status. We will use Cohen’s d to measure the between-group effect size. Cohen’s d will be calculated as the difference between the mean post-test scores of the intervention group and the control group divided by the pooled standard deviation [94]. All of the other secondary outcomes will be analysed in the similar way.
We will also conduct clinical significance change analyses as described by Jacobson and Truax [95, 96]. In the first step, we will test whether the changes from pre-test to post-test are statistically reliable and build a reliable change index (RCI). In the second step, we will calculate the clinical significance. Based on the reliable change index, the participants who display a reliable positive change, no change or a reliable deteriorated change will be classified as responders, non-responders or deteriorated, respectively [95].
As secondary analyses, we will also conduct per-protocol (PP) and completers-only analyses.
To show the long-term effect on the primary outcome after 6 months and 12 months, we will use mixed models.
Economic evaluation
The economic analysis will be performed from a societal perspective. We will conduct a cost-effectiveness analysis (CEA) and a cost-utility analysis (CUA). Using the incremental cost-effectiveness ratio (ICER), we will show the differences in the costs and benefits between the two groups. The robustness of the ICER will be determined using non-parametric bootstrapping. Furthermore, we will also use bootstrapping to quantify the uncertainty around the ICER, which will be shown on the cost-effectiveness plane [97] and as a cost-effectiveness acceptability curve [98, 99]. To perform the CUA, we calculate QALYs from the EQ-5Q and also from the SF-12.
Discussion
In the present study, we aim to compare a web-based program with mobile phone support and minimal guidance with a control group, receiving psychoeducation only. We expect the depression level of the participants in the intervention group to be significantly lower immediately after the intervention and also after 6 and 12 months compared with the control group. Our planned analyses will enable us to assess whether the outcomes are sustained over time.
Depressive symptoms in people with diabetes have an adverse impact on mental health, quality of life and on medical outcomes such as blood glucose [3–7]. Compared to the comprehensive body of evidence concerning web-based interventions for depression, very little is known about the efficacy of web-based interventions in persons with comorbid (somatic) disorders. This study will contribute to the evaluation of evidence concerning web-based interventions for participants with diabetes and co-morbid depression.
Depression treatments for adults with diabetes produce economic benefits [100]. Until now, there has been no evidence about the cost-effectiveness of web-based treatments for diabetes with comorbid depression. We will conduct CEA und CUA from a societal perspective. If the intervention is cost-effective, these findings may encourage the health care system (including health insurance companies) to integrate those web-based programs into routine diabetes care.
Because adherence to recommendations involving treatment recommendations and lifestyle changes is often a problem with diabetes patients [35], depressive people [36, 37] and with participants in web-based interventions [38], we will use two methods to improve the efficacy of the intervention by increasing the number of sessions completed by the intervention group. Firstly, all of the participants can receive daily text message support [61–64]. Secondly, all of the participants who have not logged in to the program seven days after an email reminder will be contacted by their trainer by phone [65]. The trainer will then try to motivate the participant to continue with the intervention. We decided to focus on these two methods; however there are other approaches such as the concept of persuasive technology [101]. It is unknown which methods should be recommended, so further studies should examine which ones are effective concerning web-based interventions.
Limitations
One limitation of this study design is that many diabetes patients are elderly, especially those with diabetes type 2 and may have limited access to the Internet. In 2002, only 8% of the Germans 60 or older had access to the Internet: this number increased to 39% ten years later [102]. The results from this study cannot be generalised to the overall population of patients with diabetes (especially type 2) and comorbid depression.
Furthermore, it is known that lower social status and lower education are associated with an increased risk for diabetes [103] and that women (28%) have significantly higher rates of depression compared to men (18%) [2]. As studies show, web-based interventions are mostly used by higher educated persons and females [32, 104, 105]. Therefore, we expect selection bias, restricting the external validity, particularly with regard to lower educated and males with diabetes.
Conclusions
Given the high prevalence of comorbid diabetes and depression, web-based interventions may have great potential to lower the threshold and increase access to the treatment of these co-morbid disorders. If GET.ON M.D. is shown to be cost- effective, it has great potential to be integrated into routine care and so to improve the well-being of people with diabetes and comorbid depression. This is of high importance given the negative impact of co-occurrence of diabetes and depression on psychological and medical outcomes, as well as on the health care system [3–7, 10, 12, 14, 100].
Further research is necessary to establish whether interventions that integrate diabetes and depression are more effective in the long term compared with conventional depression interventions.
Abbreviations
AADQ:
Acceptance and action diabetes questionnaire
ANCOVAs:
Analyses of covariance
ATSPHS:
Attitudes toward seeking psychological help scale
BADS:
Behavioural activation depression scale
BDI II:
Beck depression inventory II
CBT:
Cognitive behavioural therapy
CEA:
Cost-effectiveness analysis
CES-D:
Center for epidemiological studies depression scale
CG:
Control group
CONSORT:
Consolidated standards for reporting trials
CUA:
Cost-utility analysis
DRKS:
Deutsches register für klinische studien (German register for clinical trials)
DSM-IV:
Diagnostic and statistical manual of mental disorders IV
DSMQ:
Diabetes self-management questionnaire
EQ-5D:
EuroQol
GET.ON M.D.:
GET.ON mood enhancer diabetes
HADS:
Hospital anxiety and depression scale
HbA1c:
Haemoglobin A1c
ICER:
Incremental cost-effectiveness ratio
IDF:
International diabetes federation
IG:
Intervention group
ITT:
Intention-to-treat
K10:
Kessler psychological distress scale
PAID:
Problem areas in diabetes
PASS 12:
Power analysis and sample size software
PP:
Per-protocol
PSWQ:
Penn state worry questionnaire
PATHEV:
Patient questionnaire on therapy expectation and evaluation
QALYS:
Quality adjusted life years
RCI:
reliable change index
SCID:
Structured clinical interview for DSM IV
SF-12:
Short form health survey 12
SF-36:
Short form health survey 36
SPSI-R:
Social problem solving inventory-revised
TIC-P:
Trimbos institute and institute of medical technology questionnaire for costs associated with psychiatric illness
VAS:
Visual analogue scale.
Declarations
Acknowledgements
We would like to acknowledge the European Union for funding this project (EFRE: CCI 2007DE161PR001) and the BARMER GEK for supporting the recruitment of this study.
Authors’ Affiliations
(1)
Division of Online Health Training, Innovation Incubator, Leuphana University Lüneburg
(2)
Department of Clinical Psychology and Psychotherapy, Philipps-University Marburg
(3)
Albert-Ludwigs-University Freiburg
(4)
Department of General Medicine/Family Medicine, Philipps-University Marburg
(5)
Department of Medical Psychology, VU University Medical Centre
(6)
Department of Clinical Psychology, VU University
(7)
Institute for Health and Care Research (EMGO), VU University Medical Centre
Anderson RJ, Freedland KE, Clouse RE, Lustman PJ: The prevalence of comorbid depression in adults with diabetes: a meta-analysis. Diabetes Care. 2001, 24: 1069-1078. 10.2337/diacare.24.6.1069.PubMedGoogle Scholar
Baumeister H, Hutter N, Bengel J, Härter M: Quality of life in medically ill persons with comorbid mental disorders: a systematic review and meta-analysis. Psychother Psychosom. 2011, 80 (5): 275-86. 10.1159/000323404.PubMedGoogle Scholar
Schram MT, Baan CA, Pouwer F: Depression and quality of life in patients with diabetes: a systematic review from the European Depression in Diabetes (EDID) Research Consortium. Curr Diabetes Rev. 2009, 5: 112-119. 10.2174/157339909788166828.PubMedPubMed CentralGoogle Scholar
Gonzalez JS, Peyrot M, McCarl LA, Collins EM, Serpa L, Mimiaga MJ, Safren SA: Depression and diabetes treatment nonadherence: a meta-analysis. Diabetes Care. 2008, 31: 2398-2403. 10.2337/dc08-1341.PubMedPubMed CentralGoogle Scholar
Papelbaum M, Moreira RO, Coutinho W, Kupfer R, Zagury L, Freitas S, Appolinário JC: Depression, glycemic control and type 2 diabetes. Diabetol Metab Syndr. 2011, 3: 26-10.1186/1758-5996-3-26.PubMedPubMed CentralGoogle Scholar
de Groot M, Anderson R, Freedland KE, Clouse RE, Lustman PJ: Association of depression and diabetes complications: a meta-analysis. Psychosom Med. 2001, 63: 619-630.PubMedGoogle Scholar
Katon W, Fan M, Unützer J, Taylor J, Pincus H, Schoenbaum M: Depression and diabetes: a potentially lethal combination. J Gen Intern Med. 2008, 23: 1571-1575. 10.1007/s11606-008-0731-9.PubMedPubMed CentralGoogle Scholar
Katon WJ, Rutter C, Simon G, Lin EH, Ludman E, Ciechanowski P, Kinder L, Young B, von Korff M: The association of comorbid depression with mortality in patients with type 2 diabetes. Diabetes Care. 2005, 28: 2668-2672. 10.2337/diacare.28.11.2668.PubMedGoogle Scholar
Hutter N, Schnurr A, Baumeister H: Healthcare costs in patients with diabetes mellitus and comorbid mental disorders—a systematic review. Diabetologia. 2010, 53: 2470-2479. 10.1007/s00125-010-1873-y.PubMedGoogle Scholar
Lehnert T, Konnopka A, Riedel-Heller S, König HH: Diabetes und komorbide depression: systematische Literaturübersicht gesundheitsökonomischer Studien. Psychiat Prax. 2011, 38 (8): 369-375. 10.1055/s-0031-1276934.Google Scholar
Egede LE, Ellis C: Diabetes and depression: global perspectives. Diabetes Res Clin Pract. 2010, 87: 302-312. 10.1016/j.diabres.2010.01.024.PubMedGoogle Scholar
Simon GE, Katon WJ, Lin EHB, Ludman E, VonKorff M, Ciechanowski P, Young BA: Diabetes complications and depression as predictors of health service costs. Gen Hosp Psychiatry. 2005, 27: 344-351. 10.1016/j.genhosppsych.2005.04.008.PubMedGoogle Scholar
Baumeister H, Hutter N, Bengel J: Psychological and pharmacological interventions for depression in patients with diabetes mellitus and depression. Cochrane Database Syst Rev. 2012, 12;12: CD008381Google Scholar
Petrak F, Herpertz S: Treatment of depression in diabetes: an update. Curr Opin Psychiatry. 2009, 22: 211-217. 10.1097/YCO.0b013e3283207b45.PubMedGoogle Scholar
Mitchell AJ, Vaze A, Rao S: Clinical diagnosis of depression in primary care: a meta-analysis. Lancet. 2009, 374: 609-619. 10.1016/S0140-6736(09)60879-5.PubMedGoogle Scholar
Katon WJ, Simon G, Russo J, von Korff M, Lin EHB, Ludman E, Ciechanowski P, Bush T: Quality of depression care in a population-based sample of patients with diabetes and major depression. Med Care. 2004, 42: 1222-1229. 10.1097/00005650-200412000-00009.PubMedGoogle Scholar
Cepoiu M, McCusker J, Cole MG, Sewitch M, Belzile E, Ciampi A: Recognition of depression by Non-psychiatric physicians—a systematic literature review and meta-analysis. J Gen Intern Med. 2008, 23: 25-36. 10.1007/s11606-007-0428-5.PubMedGoogle Scholar
Coventry PA, Hays R, Dickens C, Bundy C, Garrett C, Cherrington A, Chew-Graham C: Talking about depression: a qualitative study of barriers to managing depression in people with long term conditions in primary care. BMC Fam Pract. 2011, 12: 10-10.1186/1471-2296-12-10.PubMedPubMed CentralGoogle Scholar
Barney LJ, Griffiths KM, Jorm AF, Christensen H: Stigma about depression and its impact on help-seeking intentions. Aust N Z J Psychiatry. 2006, 40: 51-54. 10.1080/j.1440-1614.2006.01741.x.PubMedGoogle Scholar
Andersson G, Cuijpers P: Pros and cons of online cognitive-behavioural therapy. Br J Psychiatry. 2008, 193: 270-271. 10.1192/bjp.bp.108.054080.PubMedGoogle Scholar
Mitchell J, Vella-Brodrick D, Klein B: Positive psychology and the internet: a mental health opportunity. EJAP. 2010, 6 (2): 30-41.Google Scholar
Spek V, Cuijpers P, Nyklícek I, Riper H, Keyzer J, Pop V: Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med. 2007, 37: 319-328. 10.1017/S0033291706008944.PubMedGoogle Scholar
Andersson G, Cuijpers P: Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther. 2009, 38: 196-205. 10.1080/16506070903318960.PubMedGoogle Scholar
Richards D, Richardson T: Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012, 32: 329-342. 10.1016/j.cpr.2012.02.004.PubMedGoogle Scholar
Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N, Baune BT: Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS ONE. 2010, 5: e13196-10.1371/journal.pone.0013196.PubMedPubMed CentralGoogle Scholar
Cuijpers P, Donker T, van Straten A, Li J, Andersson G: Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies. Psychol Med. 2010, 40: 1943-1957. 10.1017/S0033291710000772.PubMedGoogle Scholar
Riper H, Spek V, Boon B, Conijn B, Kramer J, Martin-Abello K, Smit F: Effectiveness of E-self-help interventions for curbing adult problem drinking: a meta-analysis. J Med Internet Res. 2011, 13: e42-10.2196/jmir.1691.PubMedPubMed CentralGoogle Scholar
Barak A, Hen L, Boniel-Nissim M, Shapira N: A comprehensive review and a meta-analysis of the effectiveness of internet-based psychotherapeutic interventions. J Technol Hum Serv. 2008, 26: 109-160. 10.1080/15228830802094429.Google Scholar
Riper H, Kramer J, Conijn B, Smit F, Schippers G, Cuijpers P: Translating effective web- based self-help for problem drinking into the real world. Alcohol Clin Exp Res. 2009, 33 (8): 1401-8. 10.1111/j.1530-0277.2009.00970.x.PubMedGoogle Scholar
Ruwaard J, Lange A, Schrieken B, Dolan CV, Emmelkamp P: The effectiveness of online cognitive behavioral treatment in routine clinical practice. PLoS One. 2012, 7 (7): e40089-10.1371/journal.pone.0040089.PubMedPubMed CentralGoogle Scholar
van Bastelaar KMP, Pouwer F, Cuijpers P, Riper H, Snoek FJ: Web-based depression treatment for type 1 and type 2 diabetic patients: a randomized, controlled trial. Diabetes Care. 2011, 34: 320-325. 10.2337/dc10-1248.PubMedPubMed CentralGoogle Scholar
Kay-Lambkin FJ, Baker AL, Lewin TJ, Carr VJ: Computer-based psychological treatment for comorbid depression and problematic alcohol and/or cannabis use: a randomized controlled trial of clinical efficacy. Addiction. 2009, 104: 378-388. 10.1111/j.1360-0443.2008.02444.x.PubMedGoogle Scholar
van Bastelaar KMP, Pouwer F, Cuijpers P, Riper H, Twisk JWR, Snoek FJ: Is a severe clinical profile an effect modifier in a Web-based depression treatment for adults with type 1 or type 2 diabetes? Secondary analyses from a randomized controlled trial. J Med Internet Res. 2012, 14: e2-10.2196/jmir.1657.PubMedPubMed CentralGoogle Scholar
Ciechanowski PS, Katon WJ, Russo JE: Depression and diabetes: impact of depressive symptoms on adherence, function, and costs. Arch Intern Med. 2000, 160: 3278-3285. 10.1001/archinte.160.21.3278.PubMedGoogle Scholar
DiMatteo MR, Lepper HS, Croghan TW: Depression is a risk factor for noncompliance with medical treatment: meta-analysis of the effects of anxiety and depression on patient adherence. Arch Intern Med. 2000, 160: 2101-2107. 10.1001/archinte.160.14.2101.PubMedGoogle Scholar
van Bastelaar K, Cuijpers P, Pouwer F, Riper H, Snoek FJ: Development and reach of a web-based cognitive behavioural therapy programme to reduce symptoms of depression and diabetes-specific distress. Patient Educ Couns. 2011, 84: 49-55. 10.1016/j.pec.2010.06.013.PubMedGoogle Scholar
van Bastelaar KMP, Pouwer F, Cuijpers P, Twisk JWR, Snoek FJ: Web-based cognitive behavioural therapy (W-CBT) for diabetes patients with co-morbid depression: design of a randomised controlled trial. BMC Psychiatry. 2008, 8: 9-10.1186/1471-244X-8-9.PubMedPubMed CentralGoogle Scholar
Kaltenthaler E, Brazier J, de Nigris E, Tumur I, Ferriter M, Beverley C, Parry G, Rooney G, Sutcliffe P: Computerised cognitive behaviour therapy for depression and anxiety update: a systematic review and economic evaluation. Health Technol Assess. 2006, 10 (iii, xi-xiv): 1-168.Google Scholar
Lokkerbol J, Adema D, Cuijpers P, Reynolds CF, Schulz R, Weehuizen R, Smit F: Improving the cost-effectiveness of a healthcare system for depressive disorders by implementing telemedicine: a health economic modeling study. Am J Geriatr Psychiatry. 2013, in pressGoogle Scholar
Smit F, Lokkerbol J, Riper H, Majo MC, Boon B, Blankers M: Modeling the cost-effectiveness of health care systems for alcohol use disorders: how implementation of eHealth interventions improves cost-effectiveness. J Med Internet Res. 2011, 13 (3): e56-10.2196/jmir.1694.PubMedPubMed CentralGoogle Scholar
Warmerdam L, Smit F, van Straten A, Riper H, Cuijpers P: Cost-utility and cost-effectiveness of internet-based treatment for adults with depressive symptoms: randomized trial. J Med Internet Res. 2010, 12 (5): e53-10.2196/jmir.1436.PubMedPubMed CentralGoogle Scholar
First MB, Spitzer RL, Gibbon M, Williams JBW: User guide for the structured clinical interview for DSM-IV axis 1 disorders. 1996, American Psychiatric Association: Washington, DCGoogle Scholar
Rohde P, Lewinsohn PM, Seeley JR: Comparability of telephone and face-to-face interviews in assessing axis I and II disorders. Am J Psychiatry. 1997, 154: 1593-1598.PubMedGoogle Scholar
Allgemeine Depressionsskala. Manual. Edited by: Hautzinger M, Bailer M. 1993, Göttingen: Beltz Test GmbHGoogle Scholar
Radloff LS: The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977, 1: 385-401. 10.1177/014662167700100306.Google Scholar
Hautzinger M, Keller F, Kühner C, BDI-II: Beck depressions-inventar revision. Frankfurt am Main: Harcourt Test Services. 2006Google Scholar
Cuijpers P, van Straten A, Warmerdam L: Behavioral activation treatments of depression: a meta-analysis. Clin Psychol Rev. 2007, 27: 318-326. 10.1016/j.cpr.2006.11.001.PubMedGoogle Scholar
Cuijpers P, van Straten A, Warmerdam L: Problem solving therapies for depression: a meta-analysis. Eur Psychiatry. 2007, 22: 9-15. 10.1016/j.eurpsy.2006.11.001.PubMedGoogle Scholar
Piette JD, Richardson C, Valenstein M: Addressing the needs of patients with multiple chronic illnesses: the case of diabetes and depression. Am J Manag Care. 2004, 10: 152-162.PubMedGoogle Scholar
Donker T, Griffiths KM, Cuijpers P, Christensen H: Psychoeducation for depression, anxiety and psychological distress: a meta-analysis. BMC Med. 2009, 7: 79-10.1186/1741-7015-7-79.PubMedPubMed CentralGoogle Scholar
Prochaska JO, Velicer WF: The transtheoretical model of health behavior change. Am J Health Promot. 1997, 12: 38-48. 10.4278/0890-1171-12.1.38.PubMedGoogle Scholar
Baglioni C, Battagliese G, Feige B, Spiegelhalder K, Nissen C, Voderholzer U, Lombardo C, Riemann D: Insomnia as a predictor of depression: a meta-analytic evaluation of longitudinal epidemiological studies. J Affect Disord. 2011, 135: 10-19. 10.1016/j.jad.2011.01.011.PubMedGoogle Scholar
Morin CM, Bootzin RR, Buysse DJ, Edinger JD, Espie CA, Lichstein KL: Psychological and behavioral treatment of insomnia: update of the recent evidence (1998-2004). Sleep. 2006, 29: 1398-1414.PubMedGoogle Scholar
Dong C, Sanchez LE, Price RA: Relationship of obesity to depression: a family-based study. Int J Obes Relat Metab Disord. 2004, 28: 790-795. 10.1038/sj.ijo.0802626.PubMedGoogle Scholar
Ginter E, Simko V: Type 2 diabetes mellitus, pandemic in 21st century. Adv Exp Med Biol. 2012, 771: 42-50.PubMedGoogle Scholar
Harrison V, Proudfoot J, Wee PP, Parker G, Pavlovic DH, Manicavasagar V: Mobile mental health: review of the emerging field and proof of concept study. J Ment Health. 2011, 20: 509-524. 10.3109/09638237.2011.608746.PubMedGoogle Scholar
Aguilera A, Muñoz RF: Text messaging as an adjunct to CBT in low-income populations: a usability and feasibility pilot study. Prof Psycho: Res Pract. 2011, 42: 472-478.Google Scholar
de Jongh T, Gurol-Urganci I, Vodopivec-Jamsek V, Car J, Atun R: Mobile phone messaging for facilitating self-management of long-term illnesses. Cochrane Database Syst Rev. 2012, 12: CD007459Google Scholar
Ferrer-Roca O, Cárdenas A, Diaz-Cardama A, Pulido P: Mobile phone text messaging in the management of diabetes. J Telemed Telecare. 2004, 10: 282-285. 10.1258/1357633042026341.PubMedGoogle Scholar
Clarke G, Eubanks D, Reid E, Kelleher C, O’Connor E, DeBar LL, Lynch F, Nunley S, Gullion C: Overcoming depression on the internet (ODIN) (2): a randomized trial of a self-help depression skills program with reminders. J Med Internet Res. 2005, 7: e16-10.2196/jmir.7.2.e16.PubMedPubMed CentralGoogle Scholar
Zigmond AS, Snaith RP: The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983, 67: 361-370. 10.1111/j.1600-0447.1983.tb09716.x.PubMedGoogle Scholar
Herrmann C, Buss U: Vorstellung und validierung einer deutschen version der “hospital anxiety and depression scale” (HAD-skala). ein fragebogen zur erfassung des psychischen befindens bei patienten mit körperlichen beschwerden. Diagnostica. 1994, 40: 143-154.Google Scholar
Meyer TJ, Miller ML, Metzger RL, Borkovec TD: Development and validation of the Penn state worry questionnaire. Behav Res Ther. 1990, 28: 487-495. 10.1016/0005-7967(90)90135-6.PubMedGoogle Scholar
Berle D, Starcevic V, Moses K, Hannan A, Milicevic D, Sammut P: Preliminary validation of an ultra-brief version of the Penn state worry questionnaire. Clin Psychol Psychother. 2011, 18: 339-346. 10.1002/cpp.724.PubMedGoogle Scholar
Kanter JW, Mulick PS, Busch AM, Berlin KS, Martell CR: The behavioral activation for depression scale (BADS): psychometric properties and factor structure. J Psychopathol Behav Assess. 2007, 29: 191-202. 10.1007/s10862-006-9038-5.Google Scholar
Manos RC, Kanter JW, Luo W: The behavioral activation for depression scale-short form: development and validation. Behav Ther. 2011, 42: 726-739. 10.1016/j.beth.2011.04.004.PubMedGoogle Scholar
D’Zurilla TJ, Nezu AM: Development and preliminary evaluation of the social problem-solving inventory. Psychol Assess. 1990, 2: 156-163.Google Scholar
Polonsky WH, Anderson BJ, Lohrer PA, Welch G, Jacobson AM, Aponte JE, Schwartz CE: Assessment of diabetes-related distress. Diabetes Care. 1995, 18: 754-760. 10.2337/diacare.18.6.754.PubMedGoogle Scholar
Ehrmann D, Hermanns N, Kulzer B, Krichbaum M, Mahr M, Haak T: Kurzform des PAID-fragebogens zur Erfassung diabetesbezogener Belastungen. Diabetologie und Stoffwechsel. 2010, 5: FV14-Google Scholar
Gregg JA, Callaghan GM, Hayes SC, Glenn-Lawson JL: Improving diabetes self-management through acceptance, mindfulness, and values: a randomized controlled trial. J Consult Clin Psychol. 2007, 75: 336-343.PubMedGoogle Scholar
Gahr A, Schmitt A, Hermanns N, Haak T, Kulzer B: Psychometrische Eigenschaften der deutschen Fassung eines Fragebogens zur Diabetesakzeptanz. Diabetologie und Stoffwechsel. 2011, 6:Google Scholar
Schmitt A, Gahr A, Hermanns N, Kulzer B, Huber J, Haak T: The Diabetes Self-Management Questionnaire (DSMQ): development and evaluation of an instrument to assess diabetes self-care activities associated with glycaemic control. Health Qual Life Outcomes. 2013, 11 (1): 138-10.1186/1477-7525-11-138.PubMedPubMed CentralGoogle Scholar
Ladwig I, Rief W, Nestoriuc Y: Hat psychotherapie auch Nebenwirkungen? – Entwicklung des Inventars zur Erfassung Negativer Effekte von Psychotherapie. Verhaltenstherapie. in pressGoogle Scholar
Andrews G, Slade T: Interpreting scores on the Kessler psychological distress scale (K10). Aust N Z J Public Health. 2001, 25: 494-497. 10.1111/j.1467-842X.2001.tb00310.x.PubMedGoogle Scholar
Fischer EH, Turner JL: Orientations to seeking professional help: development and research utility of an attitude scale. J Consult Clin Psychol. 1970, 35: 79-90.PubMedGoogle Scholar
Elhai JD, Schweinle W, Anderson SM: Reliability and validity of the attitudes toward seeking professional psychological help scale-short form. Psychiatry Res. 2008, 159: 320-329. 10.1016/j.psychres.2007.04.020.PubMedGoogle Scholar
Schulte D: Messung der Therapieerwartung und Therapieevaluation von Patienten (PATHEV). Z Klin Psychol Psychother. 2005, 34: 176-187. 10.1026/1616-3443.34.3.176.Google Scholar
Schmidt J, Lamprecht F, Wittmann WW: Zufriedenheit mit der stationären Versorgung. Entwicklung eines Fragebogens und erste Validitätsuntersuchungen. Psychother Psychosom Med Psychol. 1989, 39: 248-255.PubMedGoogle Scholar
Attkisson CC, Zwick R: The client satisfaction questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Program Plann. 1982, 5: 233-237. 10.1016/0149-7189(82)90074-X.PubMedGoogle Scholar
Hakkaart-van Roijen L: Manual Trimbos/iMTA questionnaire for costs associated with psychiatric illness (in Dutch). 2002, Rotterdam: Institute for Medical Technology AssessmentGoogle Scholar
Krauth C: Methoden der Kostenbestimmung in der gesundheitsökonomischen Evaluation. Cost estimation methods in health economic evaluation. Gesundheitsökonomie & Qualitätsmanagement. 2010, 15 (5): 251-259.Google Scholar
Group EQ: EuroQol–a new facility for the measurement of health-related quality of life. The EuroQol group. Health Policy. 1990, 16: 199-208.Google Scholar
Ware J, Kosinski M, Keller SD: A 12-item short-form health survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996, 34: 220-233. 10.1097/00005650-199603000-00003.PubMedGoogle Scholar
Drummond MF: Methods for the economic evaluation of health care programmes. 2007, Oxford: Oxford Univ. Press, [Oxford medical publications], 3Google Scholar
Brazier J, Usherwood T, Harper R, Thomas K: Deriving a preference-based single index from the UK SF-36 health survey. J Clin Epidemiol. 1998, 51: 1115-1128. 10.1016/S0895-4356(98)00103-6.PubMedGoogle Scholar
Eysenbach G: CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res. 2011, 13: e126-10.2196/jmir.1923.PubMedPubMed CentralGoogle Scholar
Little RJA, Rubin DB: Statistical analysis with missing data. 2nd Edition. 2002, Hoboken N.J: Wiley, Wiley series in probability and statisticsGoogle Scholar
Schafer JL: Analysis of incomplete multivariate data. 2000, Boca Raton: Chapman & Hall/CRC, [Monographs on statistics and applied probability, vol. 72], 1Google Scholar
Cohen J: Statistical power analysis for the behavioral sciences. 1988, Hillsdale, NJ: Erlbaum, 2Google Scholar
Jacobson NS, Truax P: Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol. 1991, 59: 12-19.PubMedGoogle Scholar
Lambert MJ, Ogles BM: Using clinical significance in psychotherapy outcome research: The need for a common procedure and validity data. Psychother Res. 2009, 19: 493-501. 10.1080/10503300902849483.PubMedGoogle Scholar
Black WC: The CE plane: a graphic representation of cost-effectiveness. Med Decis Making. 1990, 10: 212-214. 10.1177/0272989X9001000308.PubMedGoogle Scholar
Fenwick E, Claxton K, Sculpher M: Representing uncertainty: the role of cost-effectiveness acceptability curves. Health Econ. 2001, 10: 779-787. 10.1002/hec.635.PubMedGoogle Scholar
Fenwick E, O’Brien BJ, Briggs A: Cost-effectiveness acceptability curves–facts, fallacies and frequently asked questions. Health Econ. 2004, 13: 405-415. 10.1002/hec.903.PubMedGoogle Scholar
Simon GE, Katon WJ, Lin EHB, Rutter C, Manning WG, von Korff M, Ciechanowski P, Ludman EJ, Young BA: Cost-effectiveness of systematic depression treatment among people with diabetes mellitus. Arch Gen Psychiatry. 2007, 64: 65-72. 10.1001/archpsyc.64.1.65.PubMedGoogle Scholar
Fogg BJ: Persuasive technology: using computers to change what we think and do. 2003, Amsterdam, Boston: Morgan Kaufmann Publishers, [The Morgan Kaufmann series in interactive technologies]Google Scholar
Leone T, Coast E, Narayanan S, de Graft Aikins A: Diabetes and depression comorbidity and socio-economic status in low and middle income countries (LMICs): a mapping of the evidence. Global Health. 2012, 8: 39-10.1186/1744-8603-8-39.PubMedPubMed CentralGoogle Scholar
Meyer B, Berger T, Caspar F, Beevers CG, Andersson G, Weiss M: Effectiveness of a novel integrative online treatment for depression (Deprexis): randomized controlled trial. J Med Internet Res. 2009, 11: e15-10.2196/jmir.1151.PubMedPubMed CentralGoogle Scholar
Christensen H, Griffiths KM, Mackinnon AJ, Brittliffe K: Online randomized controlled trial of brief and full cognitive behaviour therapy for depression. Psychol Med. 2006, 36: 1737-1746. 10.1017/S0033291706008695.PubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
