Study protocol: a dissemination trial of computerized psychological treatment for depression and alcohol/other drug use comorbidity in an Australian clinical service
© Kay-Lambkin et al.; Licensee BioMed Central Ltd. 2012
Received: 29 March 2011
Accepted: 25 June 2012
Published: 7 July 2012
The rise of the internet and related technologies has significant implications for the treatment of complex health problems, including the combination of depression and alcohol/other drug (AOD) misuse. To date, no research exists to test the real world uptake of internet and computer-delivered treatment programs in clinical practice. This study is important, as it is the first to examine the adoption of the SHADE treatment program, a DVD-based psychological treatment for depression and AOD use comorbidity, by clinicians working in a publicly-funded AOD clinical service. The study protocol that follows describes the methodology of this dissemination trial.
19 clinicians within an AOD service on the Central Coast of New South Wales, Australia, will be recruited to the trial. Consenting clinicians will participate in a baseline focus group discussion designed to explore their experiences and perceived barriers to adopting innovation in their clinical practice. Computer comfort and openness to innovation will also be assessed. Throughout the trial, current, new and wait-list clients will be referred to the research program via the clinical service, which will involve clients completing a baseline and 15-week follow-up clinical assessment with independent research assistants, comprising a range of mental health and AOD measures. Clinicians will also complete session checklists following each clinical session with a client, outlining the extent to which the SHADE computer program was used. Therapeutic alliance will be measured at intake and discharge from both the clinician and client perspectives.
This study will provide comprehensive data on the factors associated with the adoption of an innovative, computer-delivered evidence-based treatment program, SHADE, by clinicians working in an AOD service. The results will contribute to the development of a model of dissemination of SHADE, which could be applied to a range of technological innovations.
Clinical trials registry
Australian Clinical Trial Registration Number: ACTRN12611000382976.
Mounting pressure is exerted on the health system by the increasing prevalence of depression and alcohol/other drug (AOD) misuse. These disorders are ranked 3 and 17 in contribution to the global disease burden, with depression elevated to 1st place and alcohol abuse use to 5th among middle-high income countries such as Australia . Efficacious treatments have been tested with success for both depression  and AOD disorders , suggesting that this burden can be reduced.
Despite this, the gap between need for and receipt of these treatments is large, particularly for counselling , which is often preferred over pharmacotherapy . For example, in the US, 2.1 million people with a 12-month mental disorder did not use services for mental health problems but perceived they had an unmet need . Of these, the highest unmet need was for counselling . Comorbidity, or the co-occurrence of two or more disorders, is the rule rather than the exception in clinical practice , with up to 89% of people with AOD use disorders also experiencing depression . The presence of comorbid disorders compounds difficulties in treatment access and provision .
Mental health and AOD researchers and clinicians must respond to these issues, by developing and evaluating treatment programs that address depression and AOD use disorders, whilst minimising cost and maximising efficient use of clinician time and client outcomes. Available evidence-based treatments provide for single problems (e.g. depression or alcohol misuse) rather than the comorbidity with which clients typically present . Treatments are often high intensity, require specialist input and training, and are therefore only accessible to a minority of clients . For these reasons, many clinicians are not able, or willing, to implement these interventions in practice.
The increased availability and use of computer/internet-based programs as a supplement to health care is also a potential solution to well-documented treatment accessibility problems , particularly among people with depression and AOD use comorbidity. Interactive and multimedia options offer the potential for higher levels of engagement than other self-help modalities . Computers/the internet offer the opportunity for widespread dissemination of treatments, reaching a large audience in a cost effective and timely manner . Experts also suggest that the integration of internet/computer-delivered interventions into practice, will increase adherence to evidence-based treatment protocols, and increase the number of practitioners who can deliver highly specialized psychological treatments .
Internet/computerized CBT treatment programs have established efficacy for a range of mental disorders and other health conditions . Our previous work has reported on the efficacy of computerized psychological treatment for concurrent depression and AOD use disorders [SHADE treatment, 16]. In a recent randomized controlled clinical trial involving 97 participants, SHADE computerized treatment was associated with significantly greater reductions in depression relative to a one-session treatment, and equivalent reductions in depression to a face-to-face treatment combining cognitive behavioural therapy (CBT) and motivation enhancement (ME). There was a significant advantage of computerized SHADE for marijuana use over time, with participants in SHADE reporting twice the reduction in marijuana use as the face-to-face condition and approximately five times the reduction as the one-session treatment at 12 month follow-up . Computerized SHADE was also associated with similar reductions in alcohol use over 12 months as the equivalent face-to-face-delivered combination CBT/ME program .
Whilst it is generally accepted that internet/computer-delivered CBT programs are efficacious, with some indicating equivalent benefits to face-to-face-delivered programs, there is very little real world research that demonstrates the benefits and acceptability of these programs in practice and service settings . There is some evidence to suggest that, in the US, only 48% of primary care patients would consider using internet-delivered CBT, compared to 91% for traditional face-to-face therapy . However, other evidence suggests that clinicians, including psychologists and CBT practitioners, are more open to using these alternatives as supplements to the care they are able to provide . Consequently, the current study was commenced with the aim of exploring clinician and client uptake, accessibility and response to a computerized CBT/ME treatment for depression and AOD use (SHADE treatment) within a publicly-funded Drug and Alcohol Clinician Service in New South Wales, Australia.
The purpose of this original research is to test the effectiveness of the SHADE computerized treatment program, from both a clinician and client perspective, within the real world clinical setting. It is hypothesised that clients exposed to the SHADE program will report superior reductions in depression and AOD use relative to those who are not exposed, and that this response may be moderated by primary drug of concern (e.g. marijuana vs. other drug use), coercion into treatment and computer comfort. It is also hypothesised that there will be an association between clinician openness to innovation, clinician computer comfort and the use of SHADE in clinical practice.
This is a real world dissemination trial, conducted within a publicly-funded Drug and Alcohol Clinical Service (DACS) on the Central Coast of New South Wales, Australia. It forms part of the area’s general health service for a population of 306,257. The DACS forms part of a general health service, and provides a range of clinical interventions to residents within the catchment area with AOD use problems. Services include counselling, detoxification (hospital-based and outreach), needle and syringe programs, pharmacotherapy services, a diversion program for people with AOD use problems and legal issues (Magistrates Early Referral Into Treatment, MERIT), and a specialist service targeting clients with a primary drug of concern of marijuana. A central intake service acts as the point of initial contact for access to DACS, with subsequent referrals made to relevant services as appropriate. Client and Clinician participants will be recruited from the counselling services associated with the Central Coast DACS. There are three counselling teams within this service, AOD Counselling, Marijuana Clinic and MERIT. In a study conducted at the NSW Central Coast Cannabis Clinic, it was found that clients on average only attended 2.8 treatment sessions, which is lower than the Drug and Alcohol Counselling Team within the same service which had an average of 4.5 treatment sessions in 2006 . Clients attending the MERIT program are mandated to attend 12 sessions of treatment.
Participants – clinicians
Clinicians working within the Counselling, Marijuana Clinic and MERIT teams will be invited to participate in the study. At a minimum, these clinicians will have a tertiary education in a counselling-related field, with at least an undergraduate degree in nursing or psychology.
Participants – clients
All clients, new and ongoing, will be invited to partake in the study. Participants will be aged 18 years and over and residing on the Central Coast and surrounding areas of New South Wales. Participants will consist of individuals attending counselling with primary presenting issues related to substance abuse or dependence. No exclusion criteria will be applied to participants (e.g. comorbid conditions), and it is expected that at least 50% of the clients will be experiencing co-occurring depression or anxiety and many will be poly-drug users. In 2006-7, 2,632 calls were received by the central intake service for the Area Health Region in which the Central Coast DACS is located, with 64% of these being referred to Central Coast DACS. Within the service, 3,329 treatment episodes were commenced, with 73% of clients completing treatment . The majority of these (61%) were for males, aged 20-39 years (51%), with alcohol being the most common primary drug of concern (49%).
This study is designed to observe, and not prescribe, the use of the SHADE computerized treatment program within the Central Coast DACS. Ethics approval for the study has been obtained from several relevant Human Research Ethics Committees, led by the Northern Sydney Central Coast Human Research Ethics Committee (08/HARBR/78/79), and including the University of Newcastle Human Research Ethics Committee (H-2008-0271), and the Macquarie University Ethics Review Committee (Human Research, 0806-125M(R)).
Completion of a baseline focus group discussion regarding the use of innovation in clinical practice.
Completion of a baseline questionnaire regarding their openness to innovation and computer comfort.
Use of the SHADE treatment program with new and ongoing clients in whatever manner they choose, with delivery of the DVD content of the program either contained within the clinic session or provided to clients to complete in their own home in between clinic sessions.
Referral of contact details for new and ongoing clients to the client-data-collection phase throughout the study period, regardless of their exposure to the SHADE treatment program.
Completion of session checklists (see Appendix A) following every counselling session with new and ongoing clients, regardless of their exposure to the SHADE treatment program, and therapeutic alliance measures at intake and discharge for all clients.
“Prescribe” modules for homework in between in-person sessions;
Complete individual modules during the session, sitting side-by-side with clients;
Provide the SHADE resource on DVD-Rom to clients on the wait-list for the DACS;
Use the handouts and worksheets from SHADE to augment discussions about cognitive behavioural skills conducted between clients and clinicians during sessions;
Use of the video and audio material to supplement the relapse prevention group program conducted by the DACS.
Following the provision of contact details to the research team via their clinician, current and ongoing clients of the DACS are contacted to discuss consent to participate in the study. Once consent is established, clients complete a baseline and 12-week follow-up assessment delivered over the telephone by research assistants independent from the DACS. Clients are reimbursed $20 AUD for each completed assessment.
New referral to the DACS, via the centralized intake service, who have not been allocated to a clinician, will be contacted by AH, SW or MB (clinicians of the DACS) to discuss study participation and consent to release contact details to the research team. Once these details have been provided to the research team, wait-list clients consent to complete a baseline and 12-week telephone assessment in the same manner as current/ongoing clients. Wait-list clients are reimbursed $20 AUD for each completed assessment.
The SHADE treatment program
The SHADE treatment program has been described elsewhere [16, 20], and incorporates CBT and ME strategies to encourage reductions in depression and AOD use. The program is available in two formats: (i) a 10-session program designed to be completed in a linear fashion, once weekly for 10 weeks, with content pre-programmed for each session; and (ii) a skill module program, where a series of shorter modules are presented based on themes related to depression and AOD use problems (e.g. coping with cravings, taking charge of my thoughts, staying well) arising from the 10-week program. Clients and/or clinicians may choose to focus on just one skill module during a session, without having to complete the other skills and strategies contained in the resource. Both versions of the SHADE program appear on the one DVD-Rom from which the program operates. Text is pitched at a reading age of 14 years, with a voiceover available to read out all text contained in the resource. Video case scenarios guide clients through a range of skills and strategies, and a range of handouts and worksheets are also available for clients/clinicians to print out and use during a session or as a homework activity.
All assessment instruments are widely used in mental health and/or AOD treatment research and practice.
Clinician focus group protocol
What sources do you use to inform your clinical practice (e.g. journals, workshops, clinical guidelines)?
What influences you in deciding on when to use a particular strategy, technique, or resource during a session with a client? How do handouts, self-help books and other information for clients fit into this process?
Have you incorporated any technology into your sessions with clients already? How did you do that, and what was the result?
Are there any advantages to using technology, e.g. SHADE, as an adjunct to your clinical practice? And what might the disadvantages or concerns be? What are the main issues?
What are some of the supervision and supports you think that you might need to have in place to assist you in using technology in your clinical practice?
Innovativeness Scale : a 20-item measure using a 7-point Likert-type scale assessing the likelihood of an individual to adopt innovative strategies in their work.
Computer Opinion Survey : a 26-item measure using a 6-point Likert-type scale, developed as a measure of the trait of computer anxiety rather than the “state” of computer anxiety.
During the course of the study, clinicians complete a session checklist at the conclusion of each session with a client, which outlines the focus and content of the session, including whether or not SHADE or other technologies were used. The checklist was developed by the authors to specifically suit the Central Coast DACS and the range of counselling interventions applied by the clinicians. At the conclusion of each counseling session, clinicians complete a series of tick boxes to report on: the session orientation (initial appointment, assessment, scheduled appointment, non-scheduled client contact, discharge/final session), the intervention applied, whether multimedia was used during the session (if no, why not; if yes, specify the type, e.g. SHADE, and the way in which it was used), whether debriefing was held in relation to the multimedia used with the client, and an approximation of the length of time multimedia was discussed during the session. Please see Appendix A for a copy of the session checklist.
At intake and discharge with a client, clinicians also complete the therapist scale of the Agnew Relationship Measure . This scale asks clinicians to rate, on a 7-point Likert scale, 28 items relating to the extent to which they feel a bond, partnership, confidence, openness, and client initiative are features of the therapeutic relationship with their client.
Demographics: information includes age, gender, occupational and marital status, children, educational experience, ethnicity and current accommodation arrangements.
Service Utilisation: includes current and previous treatments, including self-reported hospitalisations, attendance at clinics, rehabilitation programmes, contact with community mental health teams, psychologists, psychiatrists, other health professionals, involvement in AOD detoxification and counselling, methadone maintenance, 12-step programmes, use of general practitioners, and use of medication (including compliance).
Opiate Treatment Index : a quantity/frequency index to estimate average daily use of 11 drug types (alcohol, marijuana, heroin, other opiates, amphetamines, cocaine, hallucinogens, barbiturates, tranquilisers, inhalants and tobacco) in the month prior to assessment.
Treatment Motivation Questionnaire: is a 26 item self-report measure, examining four components of motivation including internal and external motivation, help seeking and confidence in treatment. A 7-point Likert scale is used to examine the level of motivation.
Depression Anxiety Stress Scale 21-item version : a 21-item screening tool to for depression, anxiety and stress in the previous 7 days. A 4-point Likert-type scale is used to determine the extent to which a symptom applied to the person.
Global Assessment of Functioning : a clinician-rated assessment of current functioning.
Self-compassion Scale : is a 26-item measure using a 5-point Likert-type scale assessing the extent to which a person expresses self-compassion towards themselves in difficult times.
Agnew Relationship Measure – Client Version : this client-rated measure of therapeutic alliance is similar in content and structure to the therapist-rated version previously described.
We plan to report the cost of delivering the intervention in real world settings and the cost impacts of the outcomes achieved by calibration of selected instruments used in the study (e.g. Quality of Life Scale, Global Assessment of Functioning) with those achieved in other costing studies.
Sample size calculation
A 50% consent rate is estimated from the 250 eligible clients passing through the Central Coast DACS within the study timeframe (N = 125). Previous research conducted by the authors has achieved consent rates of 50% for participants recruited from the general community [e.g. via media advertisements, 16]. We obtained higher consent rates (i.e. 82%) when previously recruiting directly from DACS , however we have estimated our sample size recruitment rates based on the lowest figure. Previous research with the target population has resulted in an 80% retention rate over a 15-week period , translating to a final projected sample size of 100 retained participants at the 15-week follow-up for the current study.
All clinicians working with the Central Coast DACS are invited to participate in the study, providing a maximum of 19 clinician participants for the trial. Assuming clients are distributed equally between the clinicians, each clinician will see 13 clients during the study period (250/19). Service data from the Central Coast DACS indicate the average occasion of service for clients engaged with the service is three sessions. Assuming a 50% compliance rate with completion of session checklists by clinicians, we estimate having a pool of 342 session checklists for analysis.
For the client sample, primary outcome measures are changes in depression, alcohol and marijuana use between baseline and 12-week follow-up.
Previous research using the SHADE resource among substance users  has resulted in effect size differences of 0.42 between clients exposed to the SHADE resource versus not on depression, alcohol and marijuana use. Assuming similar effect size differences will apply to the current study, we estimate that a sample size of 72 is required at 15-week assessment to achieve adequate power (power = 0.81) to detect differences of this order using repeated measures analysis of variance with an alpha level of 0.05 (calculated using G*Power, version 3.1.2). Predictors of alcohol use, marijuana use and depression at 15-weeks relevant to the current study (e.g. client rated therapeutic alliance, internal and external motivation and coerced vs non coerced clients, exposure to SHADE) will be modelled using a linear regression analysis. This sample size will also enable us to examine an effect size of 0.15 for a linear multiple regression for these outcome variables, with up to 6 predictors, an alpha level of 0.05 and a power co-efficient of 0.80 (actual sample size required = 98).
Given the small sample size of clinicians associated with the DACS, descriptive analyses only will be performed on the clinician measures associated with innovation, computer comfort and reported use of the SHADE resource.
Reach: report on the number and percent of participants (eligible, consenting, representativeness);
Effectiveness: the change in key outcomes associated with the intervention;
Adoption: report on the number and representativeness of staff in the clinical setting who consent to participate in the dissemination trial;
Implementation: how the program is delivered, and whether there is consistency in delivery;
Maintenance – individual: long-term effects on individual outcomes; and
Maintenance – setting: sustainability of implementation of the program following completion of the trial.
The current study will cover the first four critical factors (Reach, Effectiveness, Adoption and Implementation), and over the longer term will seek approval to monitor continued use of the SHADE resource in the target Drug and Alcohol Clinical Service. In doing so, it will address several key recommendations important in achieving the goal of widespread dissemination of technology into clinical practice .
- WHO: The Global Burden of Disease: 2004 update. 2008, Geneva: World Health Organisation (WHO) Press
- APA: Practice guideline for the treatment of patients with major depressive disorder (Revision). Am J Psychiatry. 2000, 157: 1-45.View Article
- APA: Practice guideline for the treatment of patients with substance use disorders: Alcohol, cocaine, opiods. Am J Psychiatry. 1995, 152: 1-59.View Article
- ABS: National Survey of Mental Health and Wellbeing: Summary of Results, 2007. 2008, Canberra: Australian Bureau of Statistics, Publication No. 4326.0
- Tylee A: Major depressive disorder (MDD) fromthe patient’s perspective: overcoming barriers to appropriate care. Int J Psychiatry Clin Pract. 2001, 5: s37-s42. 10.1080/13651500152048432.View Article
- ABS: National Survey of Mental Health and Wellbeing: Summary of Results. 2007, Canberra, Australia: Australian Bureau of Statistics
- Kay-Lambkin FJ, Baker A, Lewin T: The 'co-morbidity roundabout': a framework to guide assessment and intervention strategies and engineer change among people with co-morbid problems. Drug Alcohol Rev. 2004, 23: 407-424. 10.1080/09595230412331324536.PubMedView Article
- Helmus TC, Downey KK, Wang LM, Rhodes GL, Schuster CR: The relationship between self-reported cocaine withdrawal symptoms and history of depression. Addict Behav. 2001, 26: 461-467. 10.1016/S0306-4603(00)00105-2.PubMedView Article
- Kavanagh DJ, Mueser K, Baker A: Management of co-morbidity. Co-morbid Mental Disorders and Substance Use Disorders: Epidemiology, Prevention and Treatment. Edited by: Teesson M. 2003, Canberra: Commonwealth of Australia, 78-107.
- Brown CH, Ten-Have TR, Jo B, Dagne G, Wyman PA, Muthen B, Gibbons RD: Adaptive Designs for Randomized Trials in Public Health. Annu Rev Public Health. 2009, 30: 1-25. 10.1146/annurev.publhealth.031308.100223.PubMedPubMed CentralView Article
- Kaltenthaler E, Parry G, Beverley C, Ferriter M: Computerised cognitive-behavioural therapy for depression: systematic review. Br J Psychiatry. 2008, 193: 181-184. 10.1192/bjp.bp.106.025981.PubMedView Article
- Christensen H, Griffiths KM, Korten A: Web-based Cognitive Behavior Therapy: Analysis of Site Usage and Changes in Depression and Anxiety Scores. J Med Internet Res. 2002, 4: e3-10.2196/jmir.4.1.e3.PubMedPubMed CentralView Article
- Bridgette M, Bewick A, Trusler A, Barkham C, Hill AJ, Cahill J, Mulhern B: The effectiveness of web-based interventions designed to decrease alcohol consumption — A systematic review. Prev Med. 2008, 47: 17-26. 10.1016/j.ypmed.2008.01.005.View Article
- Andersson G: The promise and pitfalls of the internet for cognitive behavioral therapy. BMC Med. 2010, 8: 82-10.1186/1741-7015-8-82.PubMedPubMed CentralView Article
- Proudfoot JG: Computer-based treatment for anxiety and depression: Is it feasible? Is it effective?. Neurosci Biobehav Rev. 2004, 28: 353-363. 10.1016/j.neubiorev.2004.03.008.PubMedView Article
- Kay-Lambkin FJ, Baker A, Lewin TJ, Carr VJ: Computer-based psychological treatment for comorbid depression and problematic alcohol and/or cannabis use: a randomized controlled trial of clinical efficacy. Addiction. 2009, 104: 378-388. 10.1111/j.1360-0443.2008.02444.x.PubMedView Article
- Wangberg SC, Gammon D, Spitznogle K: In the eyes of the beholder: exploring psychologists’ attitudes towards and use of e-therapy in Norway. Cyberpsychol Behav. 2007, 10: 418-423. 10.1089/cpb.2006.9937.PubMedView Article
- Akers A: The motivation and other characteristics of clients seeking treatment from an outpatient “Cannabis Clinic”. 2007, Psychology: University of Newcastle
- NSCCH: Northern Sydney Central Coast Health Clinical Services Strategic Plan: Shaping the Future of Acute Hospital Services. 2008, Sydney: New South Wales Health, http://www.nscchealth.nsw.gov.au/ clinicalservicesplan/ServicesPlan/2008
- Kay-Lambkin FJ, Baker A, Lewin TJ, Carr VJ: Acceptability of a clinician-assisted computerized psychological intervention for comorbid mental health and substance use problems: Treatment adherence data from a randomized controlled trial. J Med Internet Res. 2011, 13: e11p11-e11-p11.View Article
- Hurt HT, Joseph K, Cook CD: Scales for the measurement of innovativeness. Human Communication Research. 1977, 4: 58-65. 10.1111/j.1468-2958.1977.tb00597.x.View Article
- Maurer MM, Simonson MR: The reduction of computer anxiety: its relation to relaxation training, previous computer coursework, achievement, and need for cognition. Journal of Research on Computing in Education. 1994, 26: 205-View Article
- Agnew-Davies R, Stiles WB, Hardy GE, Barkham M, Shapiro DA: Alliance structure assessed by the Agnew Relationship Measure. British Journal of Clinical Psychiatry. 1998, 37: 155-172. 10.1111/j.2044-8260.1998.tb01291.x.View Article
- Darke S, Hall W, Wodak A, Heather N, Ward J: Development and validation of a multi-dimensional instrument for assessing outcome of treatment among opiate users: the Opiate Treatment Index. Br J Addict. 1992, 87: 733-742. 10.1111/j.1360-0443.1992.tb02719.x.PubMedView Article
- Lovibond SH, Lovibond PF: Manual for the depression anxiety stress scales. 1995, Psychology Foundation, Sydney
- APA: Global assessment of functioning scale. Diagnostic and Statistical Manual. 1994, Washington: American Psychiatric Association, Fourth Edition
- Neff KD: Development and validation of a scale to measure self-compassion. Self and Identity. 2003, 2: 223-250. 10.1080/15298860309027.View Article
- Bennett GG, Glasgow RE: The delivery of public health interventions via the Internet: Actualizing their potential. Annu Rev Public Health. 2009, 30: 273-292. 10.1146/annurev.publhealth.031308.100235.PubMedView Article
- Glasgow R, McKay H, Piette J, Reynolds K: The RE-AIM framework for evaluating interventions: What can it tell us about approaches to chronic illness management?. Patient Education and Counselling. 2001, 44: 119-127. 10.1016/S0738-3991(00)00186-5.View Article
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/12/77/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.