This article has Open Peer Review reports available.
Correcting and interpreting the effect of cognitive therapy versus exposure in anxiety disorders
© Ebrahim and Bance; licensee BioMed Central Ltd. 2012
Received: 20 March 2012
Accepted: 15 October 2012
Published: 20 November 2012
Dr. Ougrin’s evaluation of cognitive therapy versus exposure in anxiety disorders reported a standardised mean difference [SMD] (95% confidence interval [CI]) of 0.52 (0.37, 0.74) for short-term outcomes and 0.46 (0.29, 0.73) for long-term outcomes in social phobia, and 0.88 (0.69, 1.11) for short-term outcomes and 1.05 (0.80, 1.37) for long-term outcomes in posttraumatic stress disorder (PTSD). These were incorrectly meta-analysed. Upon re-analysis, we found that the correct SMD (95% CI) was −0.66 (−1.19, -0.14) for short-term outcomes and mean difference (95% CI) of −29.66 (−46.13, -13.19) on the Social Phobia subscale from the Social Phobia Anxiety Inventory for long-term outcomes in Social Phobia. For PTSD, the SMD (95% CI) for short-term outcomes was −0.13 (−0.36, 0.11) and 0.05 (−0.22, 0.32) for long-term outcomes. However, correcting the errors did not change the interpretation of the findings considerably.
We read with great interest the systematic review evaluating the efficacy of exposure versus cognitive therapy (CT) in anxiety disorders, performed by Dr. Dennis Ougrin . The author meta-analysed 20 randomised controlled trials (RCTs) comparing CT versus exposure in four anxiety disorders and concluded the following: “there appears to be no evidence of differential efficacy between cognitive therapy and exposure in PD [panic disorder], PTSD [posttraumatic stress disorder] and OCD [obsessive compulsive disorder] and strong evidence of superior efficacy of cognitive therapy in social phobia” .
Additional errors identified by Professor Julio Sánchez-Meca
In Figure 3 in Ougrin (2011), the forest plot was incorrectly pooled as odds ratios when the effect sizes were in fact SMDs (see Table 2 in Ougrin). We found that the corrected SMD (95% CI) was −0.13 (−0.36, 0.11) for short-term outcomes in PTSD (Figure 3).
On page 4 in Ougrin (2011), second column, fifth paragraph, reporting the results of the meta-analysis for short-term outcomes in panic disorder, an I2 of 68% is reported. However, in Figure 5 in Ougrin (2011), an I2 of 62% is reported.
On page 4 in Ougrin (2011), second column, last paragraph, reporting the results of the meta-analysis for long-term outcomes in panic disorder, an I2 of 24% is reported. However, in Figure 6 in Ougrin (2011), an I2 of 69% is reported. In addition, the author reported that a fixed effects model was applied when actually, a random-effects model was employed.
In summary, after correcting and re-analysing the meta-analyses, we found a medium effect in CT improving social phobia in comparison to exposure. It is important to note, however, that correcting the errors did not change the interpretation of the findings considerably in Dr. Ougrin’s paper. Our paper stresses the importance of critically checking one’s data and analyses to ensure validity of results.
By Dennis Ougrin email@example.com
I would like to thank Ebrahim and Bance for confirming and essentially independently replicating the main results of the meta analysis evaluating the efficacy of exposure versus cognitive therapy (CT) in anxiety disorders . Ebrahim and Bance reviewed the short-term and long-term results of CT versus exposure in patients with social phobia and found a slightly different standardised mean difference (SMD) and standard error [SE] for the short-term outcomes in Hofmann (2004) : -0.19 (0.27) rather then −0.28 (0.26). Ebrahim and Bance did not state how their calculation was made. Since different formulae exist for this calculation it might be helpful if the authors provide the entirety of their calculations rather then only providing the final figure. The authors further used their calculation of the SMD in Hofmann (2004)  to re-calculate the pooled SMD, using random effects model instead of the original fixed effects model (due to the increased heterogeneity) and found the pooled SMD to be −0.66 (−1.19, -0.14), slightly greater then the original estimate but with wider confidence intervals. The recalculation of long-term outcomes for social phobia yielded essentially similar results. However, the authors substituted the SMD with the mean difference (MD) from the Social Phobia and Anxiety Inventory (SPAI) as the SPAI results were reported by all three studies used to calculate the pooled SMD [1–6]. This may be a preferred strategy in most cases, however for the purpose of the original meta analysis and a priori decision was made to use the main outcome measure in each study. In both Clark (2003) and Clark (2006) the main outcome measure was a social anxiety composite, hence the decision was to use the SMD instead of the MD. Ebrahim and Bance’s recalculation of the SMD in the PTSD [posttraumatic stress disorder] studies yielded essentially similar results as those in the original meta analysis. I would like to thank the authors for spotting several typos and some reporting inconsistencies which sadly even a very thorough peer review may miss. One important lesson is to check all default settings in the software used for meta analyses. Finally I would like to emphasise that confirmations and independent replications are extremely important and still quite rare in the field of psychological therapies. Both clinicians and researchers may feel more confident that extant literature does indeed indicate no overall difference between cognitive therapy (including behavioural experiments) and exposure for in PD [panic disorder], PTSD and OCD [obsessive compulsive disorder] and points to superior efficacy of cognitive therapy in social phobia.
SE is a doctoral candidate in the Department of Clinical Epidemiology and Biostatistics at McMaster University in Hamilton, Ontario, Canada. SB is a master’s student in the Department of Adult Education and Counselling Psychology at the University of Toronto in Toronto, Ontario, Canada.
We thank Professor Julio Sánchez-Meca, a reviewer of our article, who made important contributions in identifying additional errors in Dr. Ougrin’s paper. SE is supported by a Canadian Institutes of Health Research Doctoral Award.
- Ougrin D: Efficacy of exposure versus cognitive therapy in anxiety disorders: systematic review and meta-analysis. BMC Psychiatry. 2011, 11 (1): 200-10.1186/1471-244X-11-200.View ArticlePubMedPubMed CentralGoogle Scholar
- Hofmann S: Cognitive Mediation of Treatment Change in Social Phobia. J Consult Clin Psychol. 2004, 72 (3): 392-399.View ArticleGoogle Scholar
- Cohen J: Statistical Power Analysis for the Behavioral Sciences. 1988, Hillsdale, NJ: Lawrence Eribaum Associates, vol. 25, 2Google Scholar
- Clark DM, Ehlers A, Hackmann A, McManus F, Fennell M, Grey N, Waddington L, Wild J: Cognitive therapy versus exposure and applied relaxation in social phobia: A randomized controlled trial. J Consult Clin Psychol. 2006, 74 (3): 568-578.View ArticlePubMedGoogle Scholar
- Turner SM, Beidel DC, Dancu CV, Stanley MA: An empirically derived inventory to measure social fears and anxiety: The Social Phobia and Anxiety Inventory. Psychol Assess. 1989, 1: 35-40.View ArticleGoogle Scholar
- Clark DM, Ehlers A, McManus F, Hackmann A, Fennell M, Campbell H, Flower T, Davenport C, Louis B: Cognitive therapy versus fluoxetine in generalized social phobia: a randomized placebo-controlled trial. J Consult Clin Psychol. 2003, 71 (6): 1058-1067.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/12/202/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.