- Research article
- Open Access
- Open Peer Review
Meta-review of the effectiveness of computerised CBT in treating depression
BMC Psychiatryvolume 11, Article number: 131 (2011)
Several computerised cognitive behaviour therapy (cCBT) packages are now available to treat mild to moderate depression with or without anxiety. These have been usually been reviewed alongside cCBT for a wide range of psychological problems. Here, we single out the results of these reviews for the most common mental disorder, mild to moderate depression. The aim of this paper is to evaluate the quality of existing reviews and to enable reliable comparisons of alternative computer packages for the same patient group.
A thorough search and analysis of reviews of efficacy of cCBT published between 1999 and February 2011.
The search yielded twelve systematic reviews from ten studies covering depression. Their methodology is appraised and selected findings are presented here.
The meta-review supports the efficacy of cCBT for treatment of depression; however there is limited information on different approaches, whose relative cost-effectiveness remains to be demonstrated. Suggestions are made for future studies in the field.
Depression and anxiety are amongst the most prevalent psychiatric conditions, affecting up to 8.8% of the population in the UK . It is estimated that depression in adults could cost the nation over £9 billion a year and could lead to 109.7 million working days lost per year . To address the problem, there is a strong evidence base for psychological therapy featuring cognitive behaviour therapy (CBT) . However, conventional CBT is delivered face-to-face, meaning that the resources which would be needed to treat everyone who could potentially benefit for depression are vast.
The past decade has seen growing use of computers and the internet as an adjunct to face-to-face CBT, and in some cases as an alternative to individual contact with a clinician. A computer can be used in different ways; to provide information in written or audio/video formats; as a tool for screening or diagnosis; as a self-help tool, which entails following a structured programme on-line; to simulate situations and permit graded exposure in highly controlled conditions; and as a means of communication between patients and health care professionals for administrative or therapeutic purposes. The attractions of computer-mediated CBT (cCBT) include: its capacity to deliver structured input consistently with precision, low cost, easy accessibility and potential to offer a flexible approach in a non-stigmatising environment. Yet if best use of this resource is to be made, clear knowledge about the effectiveness and costs of alternative cCBT programmes is needed to guide planning and provision of care.
The main focus of this paper is on the delivery of computerised CBT (cCBT) for treating depression with or without anxiety. From a pragmatic perspective, users, clinicians and commissioners of health care are most likely to ask 'what works for people with depression?'. Since we were engaged in a study of MoodGYM, which is a publicly-available cCBT programme developed by the Centre for Mental Health Research at the Australian National University [4, 5], we wanted to place this study in the context of relevant literature concerning both MoodGYM and other similar programmes which are also primarily designed to treat depression. There have been different reviews on the topic, but their quality and comprehensiveness of their scope has not been studied yet. We therefore set out to review existing reviews, appraise these and draw together what they indicate regarding cCBT for depression, particularly if their results could help us to compare alternative cCBT packages for the same disorder.
The search strategy is given in the Additional file 1. The authors collaborated in the review and searched the following electronic data-bases: Medline, Embase, CINAHL (EBSCO), the British Nursing Index, the Cochrane Library, and PsycINFO. All systematic reviews examining efficacy of cCBT for depression with or without anxiety in adults were included at the outset, limited to the last ten years (initially searching 1999 to 2009, then updating to Feb 2011). The evolutionary development of cCBT and its reliance on ever-increasing speeds of internet communications make earlier reviews unlikely to be relevant to our aim. We also considered papers that were suggested to us via personal communications. We excluded books, chapters, commentaries and reviews whose methodology was not systematic or reviews whose methodology could not be ascertained, as well as systematic reviews that did not directly address effectiveness, e.g. those looking at patient acceptability or drop-out alone. To verify the methodology of articles, authors were consulted via email when necessary. The search was restricted to publications in English, since the cCBT packages of interest use the English language. The PRISMA statement guided the approach  and the Critical Appraisal Skills Programme (CASP) tool  was used to extract data from the papers identified.
The initial search identified 7031 studies, from which 6978 were excluded by screening the title and abstract. The remaining 52 papers were obtained and read; as a result 41 were excluded. Additional file 2 lists these and the reasons why. One paper identified through personal communication was included in the review. Twelve papers covering ten reviews of the effectiveness of cCBT for depression with or without anxiety in adults were included (Table 1 and additional file 3), and are summarised below (Figure 1).
Kaltenthaler et al. [8, 9] undertook two reviews for the National Institute of Health Research Health Technology Assessment Board; these comprised a wide range of computerised interventions based on CBT, and were also the basis for two other publications [10, 11]. They met all the criteria for inclusion in this meta-review, more than any of the other papers examined.
Spek et al  performed a meta-analysis to explore the effectiveness of internet-based CBTs. Although they searched only three electronic data bases, they identified and carefully investigated 12 RCTs. They admit that their results could be affected by the heterogeneity of studies. Similarly Andersson and Cuijpers  performed a meta-analysis on 12 RCTs to evaluate internet-based and computer-based treatments for depression in adults with depression, and they have also concerns about heterogeneity of treatments and samples.
Griffiths and Christensen  looked at all Internet interventions for mental disorders. They identified 15 RCTs, from which only three were related to depression, and one of these was undertaken by Christensen and Griffiths. The latter reported positive results for cCBT, but the other two studies did not. Nevertheless, Griffiths and Christensen concluded overall that RCTs have shown improvement in symptoms of depression. Griffiths and Christensen are also authors of the MoodGYM-related articles which they reviewed [14, 15].
Four other reviews [15–18] had a wider scope than cCBT for depression. They include other uses of the internet (e.g. for screening and educating), other interventions (e.g. internet based therapies), other health problems (e.g. anxiety and panic disorder), and other evaluative aspects (e.g. acceptability). One of these reviews had a search strategy that was limited to Medline . The most recent published review was undertaken by Titov , who summarized 13 RCTs and explored developments in the field of internet-delivered psychotherapies for depression.
Although it is desirable to compare different cCBT programmes and to summarise the reviews' findings in relation to different packages, there are considerable impediments to this (see table 1). Four reviews did not name the packages they examined [12, 15–17]. Where a review specifies packages for a specific disorder, it may not include all the available packages due to its limited search strategy , or more recent packages such as 'Colour Your Life', [8–11]. As highlighted by Kaltenthaler et al , most studies on depression-related packages were tested by non-comparative trials (i.e. according to improvement in individual measures against their baseline) rather than by comparison with alternative approaches.
Methodology of reviews
As discussed above, the reviews varied in their rigour and scope (Additional file 3). The number of electronic data-bases included varied from 1 to 17 (median: 5). The most commonly-searched databases were Medline, PsycINFO and the Cochrane Library. Reviews also varied in terms of the intervention programmes and target populations covered. Some had a broader definition of the intervention than cCBT; for example they looked at 'self-help approaches' . The diagnosis of interest of one review was depression only , but others included conditions such as anxiety disorders or broader categories, such as 'mental health problems'; thus results include for example obsessive compulsive disorder, insomnia and eating disorders . There was an average of two years between the searches and the publication dates of the reviews, which is a particular limitation in a rapidly-advancing field .
It is important to bear in mind that the price of an intervention is only one variable amongst several that determine its cost-effectiveness. The cost-effectiveness of cCBT depends on its results relative to the likely alternative treatment (or none), as well as on the costs of each option. Thus, any cCBT package which reduces therapist time, while being no less effective than therapist-led treatment, is likely to be cost-effective unless it costs more to use the cCBT than the time saved. To illustrate, the cost of one package, Beating the Blues, per quality-adjusted life-year is estimated to be £1250. This estimate comes from what, according to Kaltenthaler et al , is the only published paper on cost effectiveness of cCBT. However, the same review excluded 'commercially-sensitive' information, which highlights the fact that many cCBT packages compete in a market for sales and profits. For this reason, we may never have access to the information needed to compare the relative cost-effectiveness of rival packages.
As previously mentioned, reviews do not universally refer to the individual packages and reported studies are not always comparative. Together these factors make comparison of packages difficult. However, based on the available information, reviews have concluded that MoodGYM was effective in reducing symptoms of depression [9, 11, 13, 14, 18, 19], ODIN had moderate or no significant effect [9, 11, 14, 18], there is not enough data with good quality to support Overcoming Depression [8–11], Beating the Blues is judged to be effective [8–11], and 'Colour Your Life' is also reported to improve symptoms of depression .
Although there is limited information in the reviews that would permit comparison of individual packages, their results broadly agree that, for depression and anxiety disorders, cCBT has been found to be no less effective than therapist-led cognitive behaviour therapy (TCBT) [8–10]. Moreover, cCBT has been shown to reduce therapist time [8, 9], be more effective than 'treatment as usual' [8–10], and equally or less effective than bibliotherapy [8, 10]. There is also good evidence that self-help internet interventions improve symptoms , although the effect size was larger for anxiety than for depression .
Having critically appraised the quality of several reviews, we had to exclude 22 reviews that did not describe their methodology. Thirty-one other papers were excluded for reasons such as having a focus other than efficacy of cCBT on depression. Even the included reviews provided minimal information about individual packages, and their conclusions were based on only a small number of RCTs on each individual package (table 1). In effect we had to unpick even the better reviews to arrive at a conclusion about cCBT for depression.
By singling out the evidence pertaining to depression we have revealed reasonably consistent inferences drawn by from ten systematic reviews (twelve papers) of varying quality and relevance. Bearing in mind the (declared) interests of certain authors and the largely uncritical approach taken by some reviewers, we cautiously infer that certain cCBT packages, specifically MoodGYM, Beating the Blues and Colour Your Life, can have a positive effect on symptoms of depression. Yet there is limited information available to compare alternative packages, which is an important challenge given the differences in costs. The finding that cCBT reduces therapist time could have important implications for service organisation and costs, but the effect size of each intervention as well as the costs need to be compared before superior efficacy for cCBT can be claimed, which highlights the need for high-quality comparative studies as new packages are developed.
At present there is limited evidence which indicates the effectiveness of MoodGYM, Beating the Blues and Colour Your Life, but not enough of such evidence to prefer one package for depression over another. Two studies currently in the field will have an important bearing on this position. The Randomised Evaluation of the Effectiveness and Acceptability of Computerised Therapy (REEACT) Trial is due to end in 2013 (ISRCTN91947481) and Computerised CBT for Common Mental Disorders: RCT of a Workplace Intervention (ISRCTN 24529487) concludes in August, 2011. They will partly meet the need highlighted here for more RCTs on specific cCBT packages, both in relation to outcomes and in relation to costs. As new packages become available, their effectiveness will also need to be established, particularly if they charge for use.
(Critical Appraisal Skills Programme)
(Cognitive Behaviour Therapy)
(Computerised Cognitive Behaviour Therapy)
(Information and Communication Technology)
(Randomised Control Trials)
(Treatment As Usual)
(Therapist-led Cognitive Behaviour Therapy).
Singleton N, Bumpstead R, O'Brien M, Lee A, Meltzer H: Psychiatric morbidity among adults living in private households. National Statistics. 2001, 154:
Thomas CM, Morris S: Cost of depression among adults in England in 2000. The British Journal of Psychiatry. 2003, 183: 514-519. 10.1192/bjp.183.6.514.
National Collaborating Centre for Mental Health: THE NICE GUIDELINE ON THE TREATMENT AND MANAGEMENT OF DEPRESSION IN ADULTS. 2010, The British Psychological Society and The Royal College of Psychiatrists, access date: 01.09.2010, [http://www.nice.org.uk/nicemedia/live/12329/45896/45896.pdf]
Christensen H, Griffiths KM, Jorm AF: Delivering interventions for depression by using the internet: randomised controlled trial. BMJ. 2004, 328: 265-10.1136/bmj.37945.566632.EE.
Haldane D: MoodGYM: http://moodgym.anu.edu.au. Occupational Medicine. 2006, 56: 586-10.1093/occmed/kql121.
Moher D, Liberati A, Tetzlaff J, Altman DG: Reprint--Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. Physical Therapy. 2009, 89: 873-
The Public Health Resource Unit: 10 questions to help you make sense of reviews. OXFORD, access date: 15:08:2010, [http://www.phru.nhs.uk/Doc_Links/S.Reviews%20Appraisal%20Tool.pdf]
Kaltenthaler E, Shackley P, Stevens K, Beverley C, Parry G, Chilcott J: A systematic review and economic evaluation of computerised cognitive behaviour therapy for depression and anxiety. Health Technology Assessment. 2002, 6: 1-100. 10.1007/978-94-010-0481-7_1.
Kaltenthaler E, Brazier J, De Nigris E, Tumur I, Ferriter M, Beverly C, Parry G, Rooney G, Sutcliffe P: Computerized cognitive behavior theraphy for depression and anxiety update: A systematic review and economic evaluation. Health Technology Assessment. 2006, 10: 1-70.
Kaltenthaler E, Parry G, Beverley C: Computerized cognitive behaviour therapy: A systematic review. Behavioural and Cognitive Psychotherapy. 2004, 32: 31-55. 10.1017/S135246580400102X.
Kaltenthaler E, Parry G, Beverley C, Ferriter M: Computerised cognitive-behavioural therapy for depression: Systematic review. British Journal of Psychiatry. 2008, 193: 181-184. 10.1192/bjp.bp.106.025981.
Spek V, Cuijpers P, NykIicek I, Riper H, Keyzer J, Pop V: Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis. Psychological Medicine. 2007, 37: 319-328. 10.1017/S0033291706008944.
Andersson G, Cuijpers P: Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cognitive Behaviour Therapy. 2009, 38: 196-205. 10.1080/16506070903318960.
Griffiths KM, Christensen H: Review of randomised controlled trials of Internet interventions for mental disorders and related conditions. Clinical Psychologist. 2006, 10: 16-29. 10.1080/13284200500378696.
Griffiths KM, Farrer L, Christensen H: The efficacy of internet interventions for depression and anxiety disorders: a review of randomised controlled trials. Medical Journal of Australia. 2010, 192: S4-11.
Garcia-Lizana F, Munoz-Mayorga I: Telemedicine for depression: a systematic review. Perspectives in Psychiatric Care. 2010, 46: 119-126. 10.1111/j.1744-6163.2010.00247.x.
Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N: Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: A meta-analysis. PLoS ONE. 2010, 5:
Wade AG: Use of the internet to assist in the treatment of depression and anxiety: A systematic review. Primary Care Companion to the Journal of Clinical Psychiatry. 2010, 12: e1-e11.
Titov N: Internet-delivered psychotherapy for depression in adults. Current Opinion in Psychiatry. 2011, 24: 18-23. 10.1097/YCO.0b013e32833ed18f.
Marks IM, Cuijpers P, Cavanagh K, van Straten A, Gega L, Andersson G: Meta-analysis of computer-aided psychotherapy: Problems and partial solutions. Cognitive Behaviour Therapy. 2009, 38: 83-90. 10.1080/16506070802675239.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/11/131/prepub
This systematic review was funded by the British Occupational Health Research Foundation as part of a trial of cCBT in the workplace. The authors would like to acknowledge the contributions of all those who supplied additional information about their research and also the comments of peer reviewers. All opinions and errors are the authors' alone.
Justine Schneider is the chief investigator, and Pooria Sarrami was the trial coordinator of a study on effectiveness of cCBT for treatment of depression, anxiety and stress in workplaces, funded by the British Occupational Health Research Foundation.
PS contributed in searching and screening of papers, data extraction, producing summary tables and writing up; JS contributed in data extraction and writing up and NA contributed to the searching and screening of papers. All authors read and approved the final manuscript.
Electronic supplementary material
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.