Is computerised CBT really helpful for adult depression?-A meta-analytic re-evaluation of CCBT for adult depression in terms of clinical implementation and methodological validity
© So et al.; licensee BioMed Central Ltd. 2013
Received: 15 October 2012
Accepted: 15 March 2013
Published: 15 April 2013
Depression is a major cause of disability worldwide, and computerised cognitive behavioural therapy (CCBT) is expected to be a more augmentative and efficient treatment. According to previous meta-analyses of CCBT, there is a need for a meta-analytic revaluation of the short-term effectiveness of this therapy and for an evaluation of its long-term effects, functional improvement and dropout.
Five databases were used (MEDLINE, PsycINFO, EMBASE, CENTRAL and CiNii). We included all RCTs with proper concealment and blinding of outcome assessment for the clinical effectiveness of CCBT in adults (aged 18 and over) with depression. Using Cohen’s method, the standard mean difference (SMD) for the overall pooled effects across the included studies was estimated with a random effect model. The main outcome measure and the relative risk of dropout were included in the meta-analysis.
Fourteen trials met the inclusion criteria, and sixteen comparisons from these were used for the largest meta-analysis ever. All research used appropriate random sequence generation and Intention-to-Treat analyses (ITT), and employed self-reported measures as the primary outcome. For the sixteen comparisons (2807 participants) comparing CCBT and control conditions, the pooled SMD was −0.48 [95% IC −0.63 to −0.33], suggesting similar effect to the past reviews. Also, there was no significant clinical effect at long follow-up and no improvement of function found. Furthermore, a significantly higher drop-out rate was found for CCBT than for controls. When including studies without BDI as a rating scale and with only modern imputation as sensitivity analysis, the pooled SMD remained significant despite the reduction from a moderate to a small effect. Significant publication bias was found in a funnel plot and on two tests (Begg’s p = 0.09; Egger’s p = 0.01). Using a trim and fill analysis, the SMD was −0.32 [95% CI −0.49 to −0.16].
Despite a short-term reduction in depression at post-treatment, the effect at long follow-up and the function improvement were not significant, with significantly high drop-out. Considering the risk of bias, our meta-analysis implied that the clinical usefulness of current CCBT for adult depression may need to be re-considered downwards in terms of practical implementation and methodological validity.
KeywordsCCBT Web-based CBT Cognitive-behavioural therapy Depression Systematic review Meta-analysis
Depression is recognised as a major cause of disability all over the world . It has also been recently emphasised that it is not a highly recoverable disorder, even when treated with established pharmacotherapy , challenging previously widely-held ideas on its treatability . Therefore, there is a great amount of expectation placed on evidence-based cognitive-behavioural therapy (CBT)  as an alternative or addition to pharmacotherapy [5, 6]. It is hypothesised that reconstructing distorted cognition or inadaptable behaviour with CBT is likely to lead to the reduction of symptoms . In fact, there has been increasing attention paid to CBT because of several of its advantages, including its significant effectiveness against mild-to-moderate depression , the enhancement of quality of life , increase in adherence to pharmacotherapy , comparative advantage for pregnant women  and patients’ preferences . Also, CBT seems to be beneficial as an early intervention or relapse prevention measure  and CBT is recommended by the National Institute for Health and Clinical Excellence (NICE) in preference over routine pharmacotherapy as a treatment for milder depression . Nevertheless, making CBT widely used requires addressing inevitable resource allocation problems, including accessibility and cost-effectiveness . Therefore, the advantages and practicality of self-help treatments including computerised CBT (CCBT), i.e. self-help CBT using a programme on a website or on a computer without an online network, have been attractive, and it is believed that self-help CBT will be an efficacious intervention, especially for mild-to-moderate depression . There are now even greater expectations of CCBT, owing to its increased potential due to technological progress in terms of interactivity, multimedia functions and flexibility . Since the first randomised controlled trial (RCT) reported by Selmi in 1990 , the number of papers published on CCBT has increased markedly. Also, to date, there have been five meta-analyses [18–22] which specifically looked at the effect of CCBT on adult depression, and all of them found that CCBT was of benefit with moderate effect sizes.
However, these systematic reviews cannot be considered to provide definitive and compelling support for CCBT due to both the lack of two significant perspectives from clinical implementation and the four issues of methodological validity.
From the perspective of clinical implementation, one point is that they have never dealt with functionality. Indeed, all of the three RCTs carried out to date on the cost-utility of CCBT [23–25] could not find significant QALY increases due to the lack of functional improvement. In addition to functionality, on the other hand, it seems to be also insufficient that even long-term effectiveness has not been meta-analysed at all.
Considering methodological aspects, it seems that past meta-analyses have crucial limitations in quality. The first issue is the heterogeneity of both targeted disorders and intervention. In the former, three meta-analytic studies [18, 19, 21] dealt with depression and other disorders (such as anxiety disorders) as common target disorders, implying a critical bias in the results due to considerable diagnostic heterogeneity, as CBT for depression and that for other disorders, such as anxiety disorders, are theoretically different interventions. Indeed, in these three, the effect sizes of CCBT for anxiety were generally greater than CCBT for depression.
In contrast, two other meta-analyses [22, 20] exclusively dealt with depression. Nevertheless, there still remain the heterogeneous problems of intervention. Gellatly et al. included not only ten CCBT research studies but also twenty nine studies with non-CCBT interventions, such as bibliotherapy, indicating that the results of this meta-analysis cannot be accepted as those of solely CCBT-intervention. Compared to this review, Andrews et al. used the largest number to date (eleven) of RCTs on depression-only CCBT. Even so, this meta-analysis included two inappropriate studies [17, 26], as mentioned below under Results.
Secondly, the published systematic reviews have not paid due attention to the problem of dropouts. Some studies suggest that CCBT has higher attrition rates than other therapies. However, one meta-analysis by Waller and Gilbody  indicated that there was no significant difference between CCBT users and controls, but this meta-analysis had substantial diagnostic heterogeneity (two depression-specific studies and seven studies specific to other disorders). Since uneven attrition between or among intervention arms can be a significant cause of bias , more rigorous consideration needs to be given to this factor.
Thirdly, the published meta-analyses have not examined publication bias in the available literature on CCBT.
Lastly, there have been an increasing number of new studies published since the most recent systematic review.
Therefore, we conducted a meta-analysis of clinical effectiveness of single CCBT for adult depression, taking the above methodological factors into consideration with an additional evaluation of functional outcomes and long-term follow-up effects.
Identification and selection of studies
All RCTs completed and analysed by 11 July, 2011 were eligible for inclusion in this review. Five bibliographic databases were used [MEDLINE (1948 to July 2011), PsycINFO (1806 to July 2011), EMBASE (1980 to 2011), CENTRAL (Cochrane Library, 2011 latest issue), and CiNii (until July 2011)]. We also searched http://www.controlled-trials.com. Multiple search terms were used (Appendix) and modified for each database, as necessary. The search was performed on 11 July, 2011.
We included 1) randomised trials 2) in which the effects of guided and unguided CCBT specific to depression 3) were compared with one or more control conditions 4) in individuals aged 18 years or older 5) with depression, and in which 6) reliable and standardised rating-scales were equally used both at baseline and follow-up. Also, we only included studies 7) with proper allocation, concealment, and single or greater blinding of outcome assessment; and 8) trials using medications or other psychotherapies were included. We excluded studies on 1) inpatients, because we excluded patients with severe symptoms from self-help intervention, and those with 2) comorbidities such as psychotic disorders, manic status, dementia and severe physical conditions. In fact, we had originally intended to distinguish between patients on waitlists from treatment as usual (TAU), because we considered there to be restrictions on administration of medications to patients on waitlists. Nevertheless, the proportion of subjects taking medication at waitlist baseline was very similar to that with TAU, and medication was mostly not controlled. Therefore, we decided to group together both of these, and checked the influence of this factor on outcomes through a subgroup analysis. This grouping seemed to be justified because the above past five meta-analyses had treated data likewise. Studies had to have a primary endpoint including a measure of depression at the outcome assessment immediately after intervention and at long follow-up (if applicable). We defined long follow-up as follow-up where the final assessment was more than six months after treatment, because this is a recovery period associated with low future recurrence of depression . Function at post-treatment and the number of total dropouts were adopted as secondary endpoints.
Intervention effects were expressed using various types of rating scales for common outcomes, thus the effect sizes using standardized mean differences (SMDs) with 95% confidence intervals for post-treatment were computed, and then incorporated into the meta-analysis and presented with 95% confidence intervals. Where trials used a number of different tools to assess depression, we included the main outcome measure following our hierarchy, including the primary endpoint or endpoint first reported in the results.
Statistical heterogeneity was evaluated through a SMD forest plot. Cochrane’s Q statistic (chi-squared test) was performed with a significance level of 0.10. Furthermore, the I-squared (I ) statistic for heterogeneity was also used for confirmation of Cochrane’s Q statistic. A random-effect model was selected due to the large heterogeneity of each clinical design and participants. All meta-analyses were performed using Review Manager (RevMan ver. 5.1). Subgroup analyses were performed for the type of control (Waitlist and TAU). Also, we re-evaluated the clinical effectiveness through a sensitivity analysis by excluding Beck Depression Inventory I, BDI- I , and II , or according to the difference in attrition rates and imputation techniques. The reason for the former is that, particularly in CCBT studies primarily relying on self-rating scales, measurement bias is suspected due to differences between the scales employed, and it is necessary to avoid this giving rise to underestimation. The reason for the latter is that high dropout rates were expected , thus we also performed an analysis excluding research with attrition rates higher than 20% (such rates probably had an influence on the results irrespective of ITT according to Cochran handbook) , significantly higher dropout RRs or non-modern imputation processing.
A funnel plot was used as a test of the main outcome to detect publication or reporting bias through visual inspection. Begg’s  and Egger’s  tests were also conducted for statistical checking. When a significant small study effect was noted, we assessed its influence through the trim-and-fill method .
It seems that adequate missing value management is useful in carrying out appropriate CCBT evaluation, because we expect overall attrition rates to be high. Although it was physically unfeasible for us to collect all the original data without imputation, in the present meta-analysis we considered the potential impact on the review result through a sensitivity analysis in terms of the influence of imputation. Also, the modern imputation was defined as an imputation needing more complex processing than classic and comparatively simple imputations such as last observation carried forward (LOCF) or mean imputation (MI).
Characteristics of included studies
Selected characteristics of randomised controlled studies examining the effect s of CCBT for adult depression
First author and year of publication
Intervention, number of modules
Attrition rate (%)
Andersson (2005) 
guided iCBT, 5
WL (online discussion group)
Christensen (2004) 
unguided iCBT, 5
Clarke (2002) 
unguided iCBT, 7
unguided iCBT, 7 + postcard-reminder
unguided iCBT, 7 + telepone-reminder
Clarke (2009) 
unguided iCBT, 4
de Graaf (2009) 
unguided iCBT, 8 or 9
Meyer (2009) 
guided iCBT, 8
replaced by pretreatment scores
Perini (2009) 
guided iCBT, 8
replaced by pretreatment scores
Ruwaard (2009) 
guided iCBT, 11Weeks
Spek (2007) 
unguide iCBT, 8
technician-guided iCBT, 8
clinician-guided iCBT, 8
van Straten (2008) 
guided iCBT, 4
Venrnmark (2010) 
guided iCBT, 8
Warmerdam (2008) 
guided iCBT, 8
Data and analyses
Comparison 1. CBT versus control
Outcome or subgroup
No. of comparisons
No. of participants
1 Reduction in depression symptoms post treatment
Std. Mean Difference (IV, Random, 95% CI)
−0.48 [−0.63. -0.33]
2 Reduction in depression symptoms at long follow-up
Std. Mean Difference (IV, Random, 95% CI)
−0.05 [−0.19, 0.09]
3 Improvement in function at post-treatment
Std. Mean Difference (IV, Random, 95% CI)
−0.05 [−0.31, 0.22]
4 Relative risk of attrition at post-treatment
Risk Ratio (M-H, Random, 95% CI)
1.68 [1.31, 2.16]
There were more women than men subjects, and the mean age ranged from 22.6 years (Clarke 2009) to 55 years  (see the Characteristics of included studies table). The majority of CCBT programmes were based on standard CBT, while combined CBT with other therapies was used in two trials. All studies used a self-reported measure of depression as their primary outcome, and eight trials mainly used BDI. All studies stated that allocation concealment and ITTs were adequately performed. There were follow-up data beyond six months after the interventions for 7 trials, one study (Titov 2009)  finished the follow-up of only the intervention group, and thus control data were not available. Another study  presented the results of the follow-up at 18 months by transforming a waiting-list group into an intervention group after a first-phase trial, and therefore could not be included in the current meta-analysis. Ten clinical-effectiveness studies recorded functional change as well as mood. Also, all 14 studies showed the post-intervention attrition rate. Two studies (Clarke 2005  and Titov 2009 ) that each had three branches in the original research were respectively divided into two comparisons, and they were identified as Clarke 2005a and Clarke 2005b (post-card reminder or telephone reminder with CCBT) in the former, and as Titov 2009a and Titov 2009b (either technician-assisted or clinician-assisted CCBT) in the later, thereby giving a total of 16 comparisons from 14 original studies for the meta-analysis.
Primary and secondary outcomes
Sensitivity analyses were conducted as show below.
Rating scales except BDI
For the seven comparisons that employed neither BDI -I nor -II as the primary outcome measure [37–39, 45, 47, 49], the SMD was −0.32 [95% CI −0.48 to −0.17], indicating a small clinical effect in favour of CCBT.
Acceptable attrition rate (<20%)
For the seven comparisons that were reported to have an acceptable dropout rate (<20%) [37, 40, 43, 45, 46, 48], the SMD was −0.59 [−0.85, -0.34], showing a moderate clinical effect in favour of CCBT.
For the nine comparisons without a significant difference in attrition rate between intervention and control at post-treatment [37, 39, 40, 42–44, 46, 48], the SMD was −0.50 [95% CI −0.73 to −0.27], showing a moderate clinical effect in favour of CCBT. On the other hand, for the eight comparisons from seven trials with modern imputation techniques [38, 39], [43–45, 47, 49], the SMD was −0.34 [95% CI −0.51 to −0.18], indicating a small clinical effect (of borderline significance) in favour of CCBT.
We analysed 16 comparisons from 14 publications, targeting the largest size and highest quality meta-analysis. Consequently, this review found that CCBT has apparently a moderate post-treatment effect size (SMD −0.48, 95% CI −0.63 to −0.33) for adult depressive symptoms compared with control conditions, indicating almost the same result as those of past meta-analyses. Nevertheless, we further found a possibility that this result may have to be re-considered downward in terms of practical implementation and research methodology. Thus, we would like to examine these two aspects.
Considering the lack of the endurance of effectiveness, functional improvement and the high dropout rate, our result inevitably casts doubt on the actual practicability of the current CCBT for depression.
To begin with, the attenuation of long-term effectiveness with CCBT seems to be a serious issue from a clinical point of view. In fact, although one of the past reviewers  implied this tendency, long follow-up has not been clearly reviewed in meta-analyses until today. In this context, ours is the first review to meta-analyse long follow-up outcomes. This was paradoxical from the perspective that it has been reported that the effect of standard face-to-face CBT on depression does not usually attenuate sharply after intervention even without maintenance sessions. For example, the latter view has been advocated by the Annual Review of Psychology , which mentions that the effectiveness of CBT appears to be at least more enduring than that of antidepressants for depressive patients. However, it is still unclear why such variance could arise according to differences in modality, while van Londen et al. raised this question in the context of bibliotherapy .
In addition to long follow-up outcomes, it also has not been meta-analysed until our study about whether CCBT can contribute to functional improvement, even though this outcome is critically important in view of evaluating cost-utility, which is referred to as a distinctive advantage of CCBT . In our analysis, CCBT intervention did not provide a significant effect in terms of function. There are a few possible reasons for this. Firstly, current CCBT may not be fundamentally good enough to improve function. The attainment of social functions such as returning to work has been commonly recognised as being more difficult than simply reducing depressive symptoms . Secondly, we may have to consider the scale-sensitivity of function. Revicki et al. also referred to the property of generic measures that improvements in those scores are less sensitive in less depressive patients . They suggested that such generic scales were even more unlikely to change amongst mild-to-moderate depressive patients than in severe depressive patients, often resulting in little change in utility and problematic utility assessment.
The third issue with practical implementation is that more than half of included studies had high overall dropout rates. It is clear that the higher dropout is unavoidable, especially for depression remediation, in that poor motivation is one of the fundamental symptoms. Indeed, even in the NHS, the dropout rate from CCBT is also high, with up to 50% of users starting the programme for depression not completing it, and it seems that this needs to be addressed as a serious issue .
Despite the above substantial limitations of CCBT, it is still used on the premise that it is significantly effective, at least as measured immediately following treatment with it. However, by addressing methodological issues, our analysis further revealed some findings that may raise a more fundamental question of whether CCBT is really effective for adult depression even following treatment.
The first finding is the ambiguous definition of control conditions. In all previous systemic reviews of CCBT, there was little clarification of the influence of grouping results from studies with TAU and the waitlist as controls. Unlike research on medications or psychotherapy, all RCTs on CCBT effectively did not restrict the usage of medications for waitlist groups. Therefore, we had held that this confusion between groups without sufficient presentation is a considerable problem, and set up a protocol to separate subjects on waitlists from those undergoing TAU. However, we found that the proportion of patients taking medication at baseline for TAU groups was in the range from 0% to 76%, and the range for control groups was from 37% to 74%. When considering the virtually undistinguishable rates of medication intake, we concluded that it was difficult to clearly separate TAU from waitlist data, and that is why we classified TAU and waitlist subjects into the same control group in a post-hoc decision, adding a subgroup analysis on the influence of doing this.
In the subgroup analysis, our results showed that the effects were significantly greater when the control group was a waitlist as opposed to TAU. Only a meta-regression  had an identical finding to ours, although the analysis was conducted by using only four (10.2%) reliable studies with depression-specific CCBT intervention. In general, this type of difference seems rational because TAU is more therapeutically intensive than a waitlist. However, another likely cause is that the reason for this is due to the tendency for it to be fundamentally easier for an intervention group to indicate a greater effect size relative to a waitlist than active placebo in psychotherapy research . Therefore, it has been recently recommended to not use waitlists in research designs because of overestimation of intervention. Either way, this issue should be treated more carefully in general RCT settings as well as in RCTs of CCBT.
The second issue was that a high attrition rate was also considered to lead to a significant bias despite the conduct of ITT throughout all included studies. In practice, Cochran states that attrition rates higher than 20% may even affect outcomes analysed using ITT . Also, extremely uneven attrition between or among branches of intervention can be an impermissible cause of bias . Only one meta-analysis by Waller and Gilbody has dealt with this attrition issue, finding that subjects treated with CCBT dropped out approximately twice as frequently as control subjects, but this finding was not statistically significant .
In relation to the high dropout rate, we focused on the fact that a variety of imputation techniques were implemented for ITT in order to cover attrition in each study, but there was no research on CCBT which examined this risk by this kind of imputation. Rickels and Schweizer mentioned that ITT takes account of dropouts, usually by LOCF . However, Shao et al.  and Unnebrink et al.  claim that old-type imputations, such as LOCF, mean imputation and worst observation carry-forward (WOCF), can cause significant differences in results when the attrition rate is higher than 20%. By contrast, modern imputation can be thought as being more appropriate. Moreover, there can be significant differences even among imputations, and if so, this issue is serious for research especially where there is a high level of attrition. For example, Warmerdam demonstrated that newer imputation led to significantly different results . Therefore, we investigated the probability of bias due to the method of imputation. In fact, when only trials with modern imputation techniques were included, the effect size decreased from moderate to mild. The influence of imputation has not been seriously discussed in psychotherapy, including self-help. In particular, research on CCBT should give more consideration to this because of its high attrition rate relative to other psychotherapies.
Thirdly, our study was the first to detect significant publication bias specific to CCBT, and this suggested the necessity of careful re-consideration in evaluating the usefulness of CCBT. Indeed, the trim-and-fill method suggested that the SMD reduced from −0.48 [95% CI −0.63 to −0.33] to −0.32 [95% CI −0.49 to −0.16], but still indicating significant effectiveness at least at post-treatment.
Finally, we cannot overlook the fact that there has been a remarkable dominance of self-rating scales used as the primary endpoints of past CCBT research. In our analysis, self-rating scales were used as the primary outcome in all studies. Although all the adopted scales were academically reliable as screening tools, excessive expectations as to self-rating measures could lead to significant bias in the results because self-report ratings from depressed patients are not necessarily a reliable or definitive estimate of the severity especially during the acute phase including before symptomatological improvement .
Our sensitivity analysis also demonstrated that the effect size at post-treatment reduced from moderate to small without BDI. This can be explained by the characteristic of BDI that the score tends to be significantly influenced by cognitive factors rather than other instrumentals due to the different conceptualisation of depression among scales [60, 61]. Indeed, CCBT is more likely to improve BDI scores than other measures probably because CCBT programmes strategically target cognitive change. Further, it has been also discussed that BDI is inaccurate as a way of appraising treatment outcomes due to overreactivity [62, 63]. The frequent use of BDI can be theoretically justified as an efficacy study aiming at the efficacious maximisation of intervention. Even so, in terms of generalisablity, we may need to keep in mind the risk of overestimation when using self-rating scales, including BDI, when actually adopting CCBT for clinical use.
It is seemingly reasonable to expect that self-help CCBT can be a clinically- and cost-effective intervention, considering prior wholly-supportive reviews; however, the use of CCBT, even for mild to moderate depression, may be less practical and efficacious than believed at present. This can be supported by the poor results of three available cost-utility analyses of depression CCBT [23–25]. Nevertheless, it would be too extreme to conclude that CCBT is an inefficacious intervention for adult depression for a few reasons. Firstly, we could distinguish indications for which CCBT is appropriate. In fact, it has been reported that applying CCBT to patients with a personality suitable for it  or to those from a technologically-literate generation  may contribute to better outcomes. Also, further development of CCBT in terms of sophistication and attractiveness accompanying the rapid progress of information technology  might enhance the effectiveness of and adherence to CCBT, such as in the format of a therapeutic computer game .
Our review has a few limitations. Firstly, we should have ideally recalculated the effect size (SMD) of each outcome from the original research data in order to enhance the review quality . However, we could not do this due to physical and time restrictions. Secondly, we could not include unpublished data or data from on-going trials even though we attempted to collect them using several ways.
This review found that CCBT seems to improve depressive symptoms at post-intervention among adults following treatment. However, the effect at long follow-up and the improvement of function were not significant, and a considerable dropout rate was also found. Also, there was significant publication bias and other influential methodological problems including with self-rating, control condition and imputation. This may imply a probability of overestimation of the effect of CCBT and the need to further improve it. Nevertheless, it is possible that we do not need to be too pessimistic about CCBT, since we might be just midway on a long journey of low intensity intervention, of which CCBT is one part . More careful research is required for CCBT to develop more substantially.
Appendix: The search terms used and search process
exp Depressive Disorder/
(Depression or depressive or depressed).tw.
exp Dysthymic Disorder/
exp Depressive Disorder, Major/
exp Mental Disorders/
exp Therapy, Computer-Assisted/
exp Cognitive Therapy/
exp Primary Health Care/
exp Mental Health Services/
exp Cognitive Therapy/
Medical informatics computing.mp.
exp Medical Informatics Computing/
exp Computer-Assisted Instruction/
Computer assisted instruction.mp.
exp Decision Making, Computer-Assisted/
Therapy, computer assisted.tw.
Beating the blues.mp.
Beating the blues.tw.
exp Psychotherapy, Multiple/
exp Psychotherapy, Group/
exp Psychotherapy, Brief/
(Cognitive adj2 therap$).tw.
((Behaviour& or behavior&) adj2 therap&).tw.
Treatment as usual.tw.
exp Drug Therapy/
exp Waiting Lists/
exp Randomized Controlled Trial/
Randomized controlled trial.mp.
Randomized controlled trial$.tw.
exp Randomized Controlled Trials as Topic/
9 and 38 and 63 and 71
exp "Depression (Emotion)"/
exp Major Depression/
(Depression or depressive or depressed).af.
dysthymia.mp. or exp Dysthymic Disorder/
Internet.mp. or exp Internet/or exp Internet Usage/
exp Cognitive Therapy/
exp Computer Applications/
exp Computer Assisted Therapy/
exp Computer Assisted Instruction/
exp Computer Software
exp Computer Assisted Therapy/
exp Self Help Techniques/
Bibliotherapy.mp. or exp Bibliotherapy/
exp Online Therapy/or self-help.mp.
Beating the blues.af.
exp Brief Psychotherapy/
exp Group Psychotherapy/
exp Analytical Psychotherapy/
exp Individual Psychotherapy/
exp Interpersonal Psychotherapy/
exp Psychodynamic Psychotherapy/
treatment as usual.af.
medication.mp. or exp Drug Therapy/
exp Clinical Trials/or exp Intervention/or randomized controlled trial.mp.
randomised controlled trial$.af.
(Cognitive adj2 therap$).af.
((Behaviour& or behavior&) adj2 therap&).af.
exp Cognitive Therapy/
exp Cognitive Therapy/
exp Cognitive Behavior Therapy/
6 and 25 and 44 and 49 and 57
MS MD, PhD is a visiting researcher of King’s College London Institute of Psychiatry whose specialty is modern psychotherapies including CBT or interpersonal psychotherapy, and who is engaged as a supervisor of CBT trainees in Japan. SY PSW PhD is a flexible researcher at the National Institute of Mental Health, National Center of Neurology and Psychiatry (NCNP) in Japan. His specialty is psychiatric rehabilitation and thus he is highly interested in low-intensity psychological intervention, including the usefulness of CCBT and bibliotherapy. SH MA is a lecturer at the Department of Psychology and Humanities, Edogawa University College of Sociology. Within his research, he has been engaged in self-help intervention for Japanese employees. Mitsuhiro Sado MD MSc is an instructor at Keio University School of Medicine whose major area of interest is the economic evaluation of psychological interventions such as CBT. He has a significant interest in CCBT, especially from the perspective of cost-effectiveness. TF MD PhD is a professor at Kyoto University Graduate School of Medicine/School of Public Health. He is not only a leading CBT supervisor in Japan but also a prominent epidemiologist in the country. PM PhD is a professor at the Centre for the Economics of Mental and Physical Health (CEMPH) at the Institute of Psychiatry King's College London. His specialty is the economic evaluation of mental health, and he has actually evaluated the cost-effectiveness of CCBT in the UK. http://www.iop.kcl.ac.uk/staff/profile/default.aspx?go=10869
We are grateful to Professor Mathew Hotopf, Dr William E Lee and Dr Kimio Yoshimura for their great help, including in statistical analysis.
- Moussavi S, Chatterji S, Verdes E, Tandon A, Patel V, Ustun B: Depression, chronic diseases, and decrements in health: results from the World Health Surveys. Lancet. 2007, 370 (9590): 851-858. 10.1016/S0140-6736(07)61415-9.View ArticlePubMedGoogle Scholar
- Busch FN, Sandberg LS: Combined Treatment of Depression. Psychiatric Clinics of North America. 2012, 35 (1): 165-179. 10.1016/j.psc.2011.10.002.View ArticlePubMedGoogle Scholar
- Pampallona S, Bollini P, Tibaldi G, Kupelnick B, Munizza C: Combined pharmacotherapyandpsychological treatment for depression: a systematic review. Arch Gen Psychiatry. 2004, 61 (7): 714-719. 10.1001/archpsyc.61.7.714.View ArticlePubMedGoogle Scholar
- Beck AT: Cognitive therapy and the emotional disorders. 1976, Oxford, England: International Universities Press, 356-Google Scholar
- Department of Health: Treatment choice in psychological therapies and counselling. Evidence-based clinical practice guideline. 2001, In. London: DOHGoogle Scholar
- Butler AC, Chapman JE, Forman EM, Beck AT: The empirical status of cognitive-behavioral therapy: A review of meta-analyses. Clin Psychol Rev. 2006, 26 (1): 17-31. 10.1016/j.cpr.2005.07.003.View ArticlePubMedGoogle Scholar
- Dimidjian S, Hollon SD, Dobson KS, Schmaling KB, Kohlenberg RJ, Addis ME, Gallop R, McGlinchey JB, Markley DK, Gollan JK: Randomized trial of behavioral activation, cognitive therapy, and antidepressant medication in the acute treatment of adults with major depression. J Consult Clin Psychol. 2006, 74 (4): 658-670.View ArticlePubMedGoogle Scholar
- Cuijpers P, Smit F, Van Straten A: Psychological treatments of subthreshold depression: a meta-analytic review. Acta Psychiatr Scand. 2007, 115 (6): 434-441. 10.1111/j.1600-0447.2007.00998.x.View ArticlePubMedGoogle Scholar
- IsHak WW, Ha K, Kapitanski N, Bagot K, Fathy H, Swanson B, Vilhauer J, Balayan K, Bolotaulo NI, Rapaport MH: The Impact of Psychotherapy, Pharmacotherapy, and Their Combination on Quality of Life in Depression. Harv Rev Psychiatry. 2011, 19 (6): 277-289. 10.3109/10673229.2011.630828.View ArticlePubMedGoogle Scholar
- Yonkers KA, Wisner KL, Stewart DE, Oberlander TF, Dell DL, Stotland N, Ramin S, Chaudron L, Lockwood C: The management of depression during pregnancy: a report from the American Psychiatric Association and the American College of Obstetricians andGynecologists. Gen Hosp Psychiatry. 2009, 31 (5): 403-413. 10.1016/j.genhosppsych.2009.04.003.View ArticlePubMedPubMed CentralGoogle Scholar
- Mergl R, Henkel V, Allgaier A-K, Kramer D, Hautzinger M, Kohnen R, Coyne J, Hegerl U: Are treatment preferences relevant in response to serotonergic antidepressants and cognitive-behavioral therapy in depressed primary care patients? Results from a randomized controlled trial including a patients’ choice arm. Psychother Psychosom. 2011, 80 (1): 39-47. 10.1159/000318772.View ArticlePubMedGoogle Scholar
- Cuijpers P, van Straten A, Smit F, Mihalopoulos C, Beekman A: Preventing the onset of depressive disorders: a meta-analytic review of psychological interventions. Am J Psychiatry. 2008, 165 (10): 1272-1280. 10.1176/appi.ajp.2008.07091422.View ArticlePubMedGoogle Scholar
- NICE: Common Mental Health Disorders: Identification and Pathways to Care. Clinical Guideline 123. 2011, London, UK: National Institute for Health and Clinical Excellence, [http://www.nice.org.uk]Google Scholar
- Lovell K, Richards D: Multiple Access Points and Levels of Entry (MAPLE): ensuring choice, accessibility and equity for cbt services. Behav Cogn Psychother. 2000, 28 (04): 379-391.Google Scholar
- Kaltenthaler E, Brazier J, De Nigris E, Tumur I, Ferriter M, Beverley C, Parry G, Rooney G, Sutcliffe P: Computerised cognitive behaviour therapy for depression and anxiety update: a systematic review and economic evaluation. Health Technol Assess. 2006, 10 (33): iii-xi-xiv, 1–168View ArticlePubMedGoogle Scholar
- Kaltenthaler E, Parry G, Beverley C: Computerized cognitive behaviour therapy: a systematic review. Behav Cogn Psychother. 2004, 32 (01): 31-55. 10.1017/S135246580400102X.View ArticleGoogle Scholar
- Selmi PM, Klein MH, Greist JH, Sorrell SP, Erdman HP: Computer-administered cognitive-behavioral therapy for depression. Am J Psychiatry. 1990, 147 (1): 51-56.View ArticlePubMedGoogle Scholar
- Andersson G, Cuijpers P: Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther. 2009, 38 (4): 196-205. 10.1080/16506070903318960.View ArticlePubMedGoogle Scholar
- Barak A, Hen L, Boniel-Nissim M, Shapira N: A Comprehensive Review and a Meta-Analysis of the Effectiveness of Internet-Based Psychotherapeutic Interventions. J Technol Human Serv. 2008, 26 (2–4): 109-160.View ArticleGoogle Scholar
- Gellatly J, Bower P, Hennessy S, Richards D, Gilbody S, Lovell K: What makes self-help interventions effective in the management of depressive symptoms? Meta-analysis and meta-regression. Psychol Med. 2007, 37 (9): 1217-1228. 10.1017/S0033291707000062.View ArticlePubMedGoogle Scholar
- Spek V, Cuijpers P, Nyklicek I, Riper H, Keyzer J, Pop V: Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med. 2007, 37 (03): 319-328. 10.1017/S0033291706008944.View ArticlePubMedGoogle Scholar
- Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N: Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One. 2010, 5 (10): e13196-10.1371/journal.pone.0013196.View ArticlePubMedPubMed CentralGoogle Scholar
- Gerhards SAH, de Graaf LE, Jacobs LE, Severens JL, Huibers MJH, Arntz A, Riper H, Widdershoven G, Metsemakers JFM, Evers SMAA: Economic evaluation of online computerised cognitive-behavioural therapy without support for depression in primary care: randomised trial. Br J Psychiatry. 2010, 196: 310-318. 10.1192/bjp.bp.109.065748.View ArticlePubMedGoogle Scholar
- McCrone P, Knapp M, Proudfoot J, Ryden C, Cavanagh K, Shapiro DA, Ilson S, Gray JA, Goldberg D, Mann A: Cost-effectiveness of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial. Br J Psychiatry. 2004, 185: 55-62. 10.1192/bjp.185.1.55.View ArticlePubMedGoogle Scholar
- Warmerdam L, Smit F, van Straten A, Riper H, Cuijpers P: Cost-utility and cost-effectiveness of internet-based treatment for adults with depressive symptoms: randomized trial. J Med Internet Res. 2010, 12 (5): e53-10.2196/jmir.1436.View ArticlePubMedPubMed CentralGoogle Scholar
- Wright JH, Wright AS, Albano AM, Basco MR, Goldsmith LJ, Raffield T, Otto MW: Computer-assisted cognitive therapy for depression: maintaining efficacy while reducing therapist time. Am J Psychiatry. 2005, 162 (6): 1158-1164. 10.1176/appi.ajp.162.6.1158.View ArticlePubMedGoogle Scholar
- Waller R, Gilbody S: Barriers to the uptake of computerized cognitive behavioural therapy: a systematic review of the quantitative and qualitative evidence. Psychol Med. 2009, 39 (5): 705-712. 10.1017/S0033291708004224.View ArticlePubMedGoogle Scholar
- Fewtrell MS, Kennedy K, Singhal A, Martin RM, Ness A, Hadders-Algra M, Koletzko B, Lucas A: How much loss to follow-up is acceptable in long-term randomised trials and prospective studies?. Arch Dis Child. 2008, 93 (6): 458-461. 10.1136/adc.2007.127316.View ArticlePubMedGoogle Scholar
- Thase ME, Sullivan LR: Relapse and Recurrence of Depression. A practical approach for prevention. CNS Drugs. 1995, 4: 261-277. 10.2165/00023210-199504040-00004.View ArticleGoogle Scholar
- Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J: An inventory for measuring depression. Arch Gen Psychiatry. 1961, 4 (6): 561-571. 10.1001/archpsyc.1961.01710120031004.View ArticlePubMedGoogle Scholar
- Beck AT, Steer RA, Ball R, Ranieri WF: Comparison of Beck Depression Inventories-IA and-II in Psychiatric Outpatients. J Pers Assess. 1996, 67 (3): 588-597. 10.1207/s15327752jpa6703_13.View ArticlePubMedGoogle Scholar
- Intention to treat issues: Special topic in statistics. [http://www.mrc-bsu.cam.ac.uk/cochrane/handbook/]
- Begg CB, Mazumdar M: Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994, 50 (4): 1088-1101. 10.2307/2533446.View ArticlePubMedGoogle Scholar
- Egger M, Smith GD, Schneider M, Minder C: Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997, 315 (7109): 629-634. 10.1136/bmj.315.7109.629.View ArticlePubMedPubMed CentralGoogle Scholar
- Duval S, Tweedie R: A nonparametric trim-and-fill method of accounting for publication bias in meta-analysis. J Am Stat Assoc. 2000, 95: 89-99.Google Scholar
- Andersson G, Bergstrom J, Hollandare F, Carlbring P, Kaldo V, Ekselius L: Internet-based self-help for depression: randomised controlled trial. Br J Psychiatry. 2005, 187: 456-461. 10.1192/bjp.187.5.456.View ArticlePubMedGoogle Scholar
- Christensen H, Griffiths KM, Jorm AF: Delivering interventions for depression by using the internet: randomised controlled trial. BMJ. 2004, 328 (7434): 265-10.1136/bmj.37945.566632.EE.View ArticlePubMedPubMed CentralGoogle Scholar
- Clarke G, Reid E, Eubanks D, O'Connor E, DeBar LL, Kelleher C, Lynch F, Nunley S: Overcoming depression on the Internet (ODIN): a randomized controlled trial of an Internet depression skills intervention program. J Med Internet Res. 2002, 4 (3): E14-10.2196/jmir.4.3.e14.View ArticlePubMedPubMed CentralGoogle Scholar
- Clarke G, Kelleher C, Hornbrook M, Debar L, Dickerson J, Gullion C: Randomized effectiveness trial of an Internet, pure self-help, cognitive behavioral intervention for depressive symptoms in young adults. Cogn Behav Ther. 2009, 38 (4): 222-234. 10.1080/16506070802675353.View ArticlePubMedPubMed CentralGoogle Scholar
- de Graaf LE, Gerhards SAH, Arntz A, Riper H, Metsemakers JFM, Evers SMAA, Severens JL, Widdershoven G, Huibers MJH: Clinical effectiveness of online computerised cognitive-behavioural therapy without support for depression in primary care: randomised trial. Br J Psychiatry. 2009, 195 (1): 73-80. 10.1192/bjp.bp.108.054429.View ArticlePubMedGoogle Scholar
- Meyer B, Berger T, Caspar F, Beevers CG, Andersson G, Weiss M: Effectiveness of a novel integrative online treatment for depression (Deprexis): randomized controlled trial. J Med Internet Res. 2009, 11 (2): e15-10.2196/jmir.1151.View ArticlePubMedPubMed CentralGoogle Scholar
- Perini S, Titov N, Andrews G: Clinician-assisted Internet-based treatment is effective for depression: randomized controlled trial. Aust N Z J Psychiatry. 2009, 43 (6): 571-578. 10.1080/00048670902873722.View ArticlePubMedGoogle Scholar
- Ruwaard J, Schrieken B, Schrijver M, Broeksteeg J, Dekker J, Vermeulen H, Lange A: Standardized web-based cognitive behavioural therapy of mild to moderate depression: a randomized controlled trial with a long-term follow-up. Cogn Behav Ther. 2009, 38 (4): 206-221. 10.1080/16506070802408086.View ArticlePubMedGoogle Scholar
- Spek V, Nyklicek I, Smits N, Cuijpers P, Riper H, Keyzer J, Pop V: Internet-based cognitive behavioural therapy for subthreshold depression in people over 50 years old: a randomized controlled clinical trial. Psychol Med. 2007, 37 (12): 1797-1806.View ArticlePubMedGoogle Scholar
- van Straten A, Cuijpers P, Smits N: Effectiveness of a web-based self-help intervention for symptoms of depression, anxiety, and stress: randomized controlled trial. J Med Internet Res. 2008, 10 (1): e7-10.2196/jmir.954.View ArticlePubMedPubMed CentralGoogle Scholar
- Vernmark K, Lenndin J, Bjarehed J, Carlsson M, Karlsson J, Oberg J, Carlbring P, Eriksson T, Andersson G: Internet administered guided self-help versus individualized e-mail therapy: A randomized trial of two versions of CBT for major depression. Behav Res Ther. 2010, 48 (5): 368-376. 10.1016/j.brat.2010.01.005.View ArticlePubMedGoogle Scholar
- Warmerdam L, van Straten A, Twisk J, Riper H, Cuijpers P: Internet-based treatment for adults with depressive symptoms: randomized controlled trial. J Med Internet Res. 2008, 10 (4): e44-10.2196/jmir.1094.View ArticlePubMedPubMed CentralGoogle Scholar
- Titov N, Andrews G, Davies M, McIntyre K, Robinson E, Solley K: Internet treatment for depression: a randomized controlled trial comparing clinician vs. technician assistance. PLoS ONE [Electronic Resource]. 2010, 5 (6): e10939-10.1371/journal.pone.0010939.View ArticlePubMed CentralGoogle Scholar
- Clarke G, Eubanks D, Reid E, Kelleher C, O'Connor E, DeBar LL, Lynch F, Nunley S, Gullion C: Overcoming Depression on the Internet (ODIN) (2): a randomized trial of a self-help depression skills program with reminders. J Med Internet Res. 2005, 7 (2): e16-10.2196/jmir.7.2.e16.View ArticlePubMedPubMed CentralGoogle Scholar
- Hollon SD, Stewart MO, Strunk D: enduring effects for cognitive behavior therapy in the treatment of depression and anxiety. Annu Rev Psychol. 2006, 57 (1): 285-315. 10.1146/annurev.psych.57.102904.190044.View ArticlePubMedGoogle Scholar
- Van Londen L, Molenaar RP, Goekoop JG, Zwinderman AH, Rooijmans HG: Three- to 5-year prospective follow-up of outcome in major depression. Psychol Med. 1998, 28 (3): 731-735. 10.1017/S0033291797006466.View ArticlePubMedGoogle Scholar
- Kennedy N, Foy K, Sherazi R, McDonough M, McKeon P: Long-term social functioning after depression treated by psychiatrists: a review. Bipolar Disord. 2007, 9 (1–2): 25-37.View ArticlePubMedGoogle Scholar
- Revicki DA, Wood M: Patient-assigned health state utilities for depression-related outcomes: differences by depression severity and antidepressant medications. J Affect Disord. 1998, 48 (1): 25-36. 10.1016/S0165-0327(97)00117-1.View ArticlePubMedGoogle Scholar
- MacLeod M, Martinez R, Williams C: Cognitive Behaviour Therapy self-help: who does it help and what are its drawbacks?. Cambridge Univ Press. 2009, 37 (1): 61-72.Google Scholar
- Watanabe N, Hunot V, Omori IM, Churchill R, Furukawa TA: Psychotherapy for depression among children and adolescents: a systematic review. Acta Psychiatr Scand. 2007, 116 (2): 84-95. 10.1111/j.1600-0447.2007.01018.x.View ArticlePubMedGoogle Scholar
- Rickels K, Schweizer E, Csanalosi I, Case G, Chung H: Long-term treatment of anxiety and risk of withdrawal. Prospective comparison of clorazepate and buspirone. Arch Gen Psychiatry. 1988, 45 (5): 444-450. 10.1001/archpsyc.1988.01800290060008.View ArticlePubMedGoogle Scholar
- Shao J, Zhong B: Last observation carry-forward and last observation analysis. Stat Med. 2003, 22 (15): 2429-2441. 10.1002/sim.1519.View ArticlePubMedGoogle Scholar
- Unnebrink K, Windeler J: Intention-to-treat: methods for dealing with missing values in clinical trials of progressively deteriorating diseases. Stat Med. 2001, 20 (24): 3931-3946. 10.1002/sim.1149.View ArticlePubMedGoogle Scholar
- Prusoff Ba KGLPES: Concordance between clinical assessments and patients’ self-report in depression. Arch Gen Psychiatry. 1972, 26 (6): 546-552. 10.1001/archpsyc.1972.01750240058009.View ArticleGoogle Scholar
- Moran PW, Lambert JM: A review of current assessment tools for monitoring changes in depression. The Measurement of Psychotherapy Outcome in Research and Evaluation. Edited by: Lambert MJ, Christensen ER, De Julio SS. 1983, New York: Wiley, 263-303.Google Scholar
- Lambert MJ, Hatch DR, Kingston MD, Edwards BC: Zung, Beck, and Hamilton Rating Scales as measures of treatment outcome: a meta-analytic comparison. J Consult Clin Psychol. 1986, 54 (1): 54-59.View ArticlePubMedGoogle Scholar
- Moran PW: A Review of Current Assessment Tools for Monitoring Changes in Depression. 1982, Brigham Young University: Department of PsychologyGoogle Scholar
- Edwards BC, Lambert MJ, Moran PW, McCully T, Smith KC, Ellingson AG: A meta-analytic comparison of the Beck Depression Inventory and the Hamilton Rating Scale for Depression as measures of treatment outcome. Br J Clin Psychol. 1984, 23 (2): 93-99. 10.1111/j.2044-8260.1984.tb00632.x.View ArticlePubMedGoogle Scholar
- Vangberg HCB, Lillevoll KR, Waterloo K, Eisemann M: Does personality predict depression and use of an internet-based intervention for depression among adolescents?. Depression Res Treatment. 2012, 2012: 11-View ArticleGoogle Scholar
- Mitchell N: Computerised CBT self-help for depression in Higher Education: Reflections on a pilot. Counselling and Psychotherapy Res. 2009, 9 (4): 280-286. 10.1080/14733140902993343.View ArticleGoogle Scholar
- Merry SN, Stasiak K, Shepherd M, Frampton C, Fleming T, Lucassen MFG: The effectiveness of SPARX, a computerised self help intervention for adolescents seeking help for depression: randomised controlled non-inferiority trial. BMJ. 2012, 18: 344:e2598-Google Scholar
- Clark DM: Implementing NICE guidelines for the psychological treatment of depression and anxiety disorders: the IAPT experience. Int Rev Psychiatry. 2011, 23 (4): 318-327. 10.3109/09540261.2011.606803.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/13/113/prepub