The ANU WellBeing study: a protocol for a quasi-factorial randomised controlled trial of the effectiveness of an Internet support group and an automated Internet intervention for depression
© Griffiths et al; licensee BioMed Central Ltd. 2010
Received: 2 February 2010
Accepted: 8 March 2010
Published: 8 March 2010
Recent projections suggest that by the year 2030 depression will be the primary cause of disease burden among developed countries. Delivery of accessible consumer-focused evidenced-based services may be an important element in reducing this burden. Many consumers report a preference for self-help modes of delivery. The Internet offers a promising modality for delivering such services and there is now evidence that automated professionally developed self-help psychological interventions can be effective. By contrast, despite their popularity, there is little evidence as to the effectiveness of Internet support groups which provide peer-to-peer mutual support.
Members of the community with elevated psychological distress were randomised to receive one of the following: (1) Internet Support Group (ISG) intervention, (2) a multi-module automated psychoeducational and skills Internet Training Program (ITP), (3) a combination of the ISG and ITP, or (4) an Internet Attention Control website (IAC) comprising health and wellbeing information and question and answer modules. Each intervention was 12 weeks long. Assessments were conducted at baseline, post-intervention, 6 and 12 months to examine depressive symptoms, social support, self-esteem, quality of life, depression literacy, stigma and help-seeking for depression. Participants were recruited through a screening postal survey sent to 70,000 Australians aged 18 to 65 years randomly selected from four rural and four metropolitan regions in Australia.
To our knowledge this study is the first randomised controlled trial of the effectiveness of a depression ISG.
Current Controlled Trials ISRCTN65657330.
It has been projected that depression will be the leading cause of disease burden in 2030 . Lifetime prevalence of depression is high  and depressive episodes are frequently persistent and recurrent . Moreover, only a minority of people with depression receive evidence-based treatment .
It is likely that the undertreatment of depression is due in part to lack of availability and accessibility of services , an unwillingness to seek help due to the stigma associated with depression  and a preference among some people with depression for employing self help methods for coping with the condition. One potential means for increasing treatment coverage and reducing burden is to facilitate the large scale dissemination of self help methods which reduce the need for the health workforce involvement and circumvent the stigma associated with seeking face-to-face help.
There is some evidence that self help interventions delivered online can be effective in reducing depressive symptoms . In particular, a number of studies have reported a reduction in depressive symptoms associated with the use of automated online programs in the absence of clinical input (e.g., [8–14]). Online programs have also been demonstrated to reduce the stigma associated with depression [15, 16] and to increase mental health literacy among people with elevated depressive symptoms [8, 17]. Less is known about the effect of these programs on other factors such as empowerment, quality of life, self esteem, disability, and service use. Further, although a frequently cited advantage of online psychological applications is their potential for use with under-served rural populations  there have been no direct comparative studies of the acceptability and effectiveness of these programs in rural compared to metropolitan regions .
Research into the effectiveness of online interventions for depression has been focused primarily on applications designed to deliver psychological skills training. However, the widespread availability of the Internet has stimulated the development of a large number of online 'mutual support' or 'self help support' groups. Such support groups have been estimated by Eysenbach to be used by 'millions' of consumers daily  and there is evidence that they are particularly popular among consumers with depression . However, the efficacy of such Internet support groups (ISGs) has not been established.
A recent systematic review of depression ISGs identified no randomised controlled trials of the effectiveness of the groups, for individuals with depression, in reducing depressive symptoms or in improving other psychological, mental health, service-related or other outcomes . However, there was some evidence that peer-to-peer support groups might be associated with a reduction in depressive symptoms. In particular, in a prospective cohort study, Houston  reported a reduction over 6 months in depressive symptoms among high frequency users of public internet support groups after controlling for initial severity of symptoms. In addition, a systematic review of efficacy trials of ISGs for consumers with a range of health conditions yielded some encouraging evidence that such ISGs may be effective in reducing depressive symptoms among women with breast cancer .
It is possible however, that the primary effect of depression support groups is on outcomes other than symptomatology. For example, it is often claimed that support groups increase consumer empowerment and social support [23, 24]. However, to date there have been no quantitative studies of the effect of depression ISGs on outcomes such as empowerment, self esteem, social support, quality of life or other factors such as depression knowledge and help seeking.
One potential limitation of fully automated online programs is the likelihood of substantial dropout during their unguided use . Automated messages and reminders might reduce attrition rates in such circumstances . It has also possible that participation in an ISG might facilitate adherence to online applications. Indeed, many online chronic disease management programs employ ISGs (e.g., see ). However, to our knowledge, to date there have been no systematic studies of the effect of online peer-to-peer support groups on adherence or outcomes among consumers receiving internet applications.
A final limitation of available research is that the majority of randomised controlled studies of e-mental health programs have employed wait list control groups . A small number of studies have employed an attention control group or a psychoeducational controls. However, these studies have some limitations. For example, Christensen and her collaborators used a telephone attention control but the control group did not receive an internet intervention [8, 9, 15]. Some studies have used an online psychoeducational website as a control (e.g., [28–30]). However, a recent meta-analysis demonstrated that the provision of mental health information may reduce depressive symptoms among adults with depression or depressive symptoms . To date no study of the efficacy of e-mental health intervention has employed an attention control condition which both comprised a website and contained plausible content not containing depressive or anxiety psychoeducational information.
Objectives of the ANU WellBeing study
The primary objectives of the study are to (i) evaluate the efficacy of a depression Internet Support Group (ISG) and an automated psychoeducational and skills Internet Training Program (ITP) for reducing depressive symptoms relative to a plausible Internet Attention Control condition (IAC); to evaluate the relative efficacy of the ITP, ISG and combined ITP and ISG interventions; and (iii) to ascertain if the adherence rates and magnitude of improvement in depressive symptoms is greater for the ISG and ITP interventions combined than for either condition alone.
Secondary objectives of the study are to (i) evaluate the effect of the two experimental interventions on anxiety, disability, social support, loneliness, self-esteem, empowerment, loneliness, depression literacy, stigma and help seeking in people with elevated depressive sympotms; and (ii) to compare the outcomes of these interventions in rural and metropolitan residents.
Quasi-factorial trial design and target sample sizes per cell.
Internet support group (ISG)
Automated skills training program (ITP)
Approval to conduct the trial was granted by The Australian National University Human Research Ethics Committee (Protocol 2007/2259). The study protocol is registered with the Controlled Clinical Trials registry (ISRCTN65657330).
Participants in the ANU WellBeing Study have been recruited via postal invitation and survey of 70,000 adults aged between 18 to 65 years who were randomly selected from the electoral rolls of four rural and four metropolitan Australian electoral divisions. Registration on the electoral roll is compulsory for all Australian citizens. Participants were selected from the division list using the 'select cases' random selection facility in SPSS. The metropolitan samples comprised registrants from one electoral division in Canberra, The Australian Capital Territory; two electoral divisions in Melbourne, Victoria (Maribyrnong, Higgins); and one division in Sydney, NSW (Bennelong). The rural divisions were located in Victoria (Indi, Murray) and New South Wales (Hume, Riverina). Divisions were selected from those which had a moderate (51%) to high proportion (>62.2%) of households with internet access . Participants were oversampled in the rural divisions to adjust for lower internet usage in these regions.
The screening survey was accompanied by a letter and brochure which described both an enclosed 'WellBeing' screening survey and an intervention project ("The Wellbeing Promotion Study"). The participant was informed that the WellBeing survey was designed to 'find out more about the mental health of Australians in the city as well as in rural areas' and that the WellBeing Promotion Study was designed to 'look at the usefulness of self help internet programs for improving emotional well being and preventing or reducing the symptoms of depression'.
Inclusion and exclusion criteria for the WellBeing trial
Age 18 to 65 years
Self-reported current or imminent treatment from a mental health professional or mutual support group at the time of recruitment.
Kessler Psychological distress (K10) score > 22
Current treatment with Cognitive Behaviour Therapy.
Home or work access to the Internet
Self-reported current or past experience with or diagnosis of psychosis, schizophrenia or bipolar disorder.
Consent to participate
Current or prior participation in another project conducted by the lead investigator's research centre.
Eligible individuals who agreed on the telephone to participate in the project were randomised (see below) to one of the four trial conditions and were sent an information sheet about the project and the intervention conditions together with a consent form. At this point, however, neither they, their interviewer nor the project coordinator were informed of their randomisation status. Randomisation prior to consent and completion of the pre-intervention was undertaken for pragmatic reasons as the trial required the participants in the internet support groups to commence simultaneously. Undertaking stratified randomisation post-consent and post-baseline survey would have either introduced a significant delay between screening and baseline measures and the commencement of the intervention or reduced the available pool of participants.
Those participants who returned consent forms were sent a letter informing them of the condition to which they had been randomised together with a 14 or 15 page user guide containing a week by week overview of their intervention, a 'Frequently Asked Questions' section and a 'Technical Tips' page.
Recruitment to the WellBeing Study was conducted in three waves (Pilot, Wave 1, Wave 2) between August 2008 and May 2009. A subsample of 7000 surveys (randomly selected from the two metropolitan divisions of Canberra and Maribyrnong and the two rural divisions of Murray and Indi) were employed to pilot the survey and protocol. After the successful completion of the intervention phase of the pilot, a further 28,000 surveys were sent to residents in the above divisions. Since these screening surveys did not yield the target sample size for the study, a further 35,000 surveys were sent to the divisions of Bennelong, Higgins, Murray and Riverina.
Summary of the WellBeing Trial topics for the intervention and control conditions.
ISG: WellBeing Board
IAC (Control): HealthWatch
Depression: What is depression? Risks & causes
How do you feel? (Your WellBeing category)
Environmental Health (Information)
Treatments: What works for depression
What helps? Who helps? (Feeling Better category)
Nutrition Myths (Information)
CBT: Thinking about thinking. (identifying thinking patterns that can lead to depression)
General chit-chat (General category)
Physical & Mental Activities (Questions)
Maintaining a Healthy Heart
CBT: Changing your thinking (changing your thoughts to change your mood)
Do they understand? (Your WellBeing forum)
Physical Health (Questions)
Energize Yourself (& Your Family) (Information)
CBT: Changing your behaviour (how to change your mood by doing things differently)
Positive things that happened to you today. (Feeling Better forum)
Social & Family Relationships (Questions)
Medicines in the Home (Information)
CBT review (work on your workbook)
Jokes (General forum)
Temperature Extremes (Information)
IPT: Role disputes and relationships
Causes and triggers (Your WellBeing forum)
Education & Post Education (Questions)
Oral Health (Information)
IPT: Role changes and grief
Your views on antidepressants & Connecting with others (Feeling Better forum)
Career & Work Relationships (Questions)
Blood Pressure & Cholesterol (Information)
Physical activity (Part 1)
Creative corner (General forum)
Music & The Arts (Questions)
Physical activity (Part 2)
Effects of stress and feeling bad (Your WellBeing forum)
Popular Culture & Movies (Qs)
Bacteria & Foodborne Illness (Information)
How to relax
Psychological therapy & improving your self-esteem (Feeling Better forum)
Alternative and lifestyle approaches (Feeling Better forum)
Back Pain (Information)
ITP: E-couch (depression stream)
This automated online psychological intervention is a research version of the depression stream of the online application e-couch http://ecouch.anu.edu.au. The intervention comprised a depression literacy module together with five interactive self help tools designed to reduce depressive symptoms.
ISG: WellBeing Board
The WellBeing Board is a research ISG which uses a bulletin board format to facilitate discussions. It was developed for the trial based on the primary author's experience in running a public ISG and a thematic analysis of a randomly selected subset of topics on that board. The WellBeing board was divided into three main categories: Your Wellbeing, Feeling Better and General. Each week one, or in the case of weeks 8 and 11, two new forums or topics were introduced for each category in turn (see Table 3).
Participants were instructed to login to the website at least twice a week, read any new messages that had been posted, and contribute a minimum of four posts/messages a week. They were also encouraged to login to the WellBeing Board website as often as they wished, to introduce additional topics for discussion and to continue discussions across weeks.
A detailed list of the WellBeing board rules appeared when the participant first registered on the board and was available at all times on the Board home page and in the participant's manual. Discussion of suicide, self harm and other traumatic topics was not permitted. Participants were requested to use pseudonyms and to refrain from posting any material that might identify them. Links and email addresses were filtered out of posts and signatures using an automated script.
ISG + ITP: WellBeing Board plus e-couch
The combined intervention involved the delivery of both e-couch and a dedicated WellBeing Board each week over the 12 week intervention period. The trial protocol including reminders was identical to that for the individual conditions. To prevent contamination across conditions separate ISGs were used for the combined intervention and ISG-only conditions. The combined condition ISG also differed from the single ISG intervention condition in that it incorporated an additional forum designed for participants to discuss their experiences on e-couch.
In the absence of a suitable existing web-based attention control condition, the HealthWatch website was purpose built for the WellBeing trial. It comprised 12 modules, each consisting of two online components.
The first component involved a series of online questions probing factors potentially related to depression and wellbeing. This component was modified and extended to 12 modules from a previously reported 5 module telephone control condition [9, 15, 33]. For example, the introduction to the humour topic (Week 11) commenced with the explanation: "Some people believe that humour and laughter can prevent depression and increase the enjoyment of life. Today we would like to ask you to think about humour and whether it is important to your mood". This introduction was followed by a series of 16 multiple choice and open-ended questions: e.g., Do you enjoy telling jokes? (Responses: Yes, No, I can never remember any); How often do you tell jokes (Responses: Never, Rarely, About once a month, at least once a week, Most days); What is the funniest joke you can remember? (Open ended response); Overall do you think your moods are affected by humour?
The second component of the each weekly website module contained online information about a series of 12 topics related to wellbeing. The content in this component of the modules was adapted for Australian use from publications of the National Institute of Health and other US government sources which permit public use. Material was chosen which addressed topics relevant to wellbeing but which contained no or minimal information about interventions for depression or stress.
Intervention Study Procedure
All participants who provided written consent were sent a user ID and password by automated email. A second automated email sent one week prior to the commencement of the intervention directed them to log onto the website to complete the online baseline survey.
Each of the four conditions was then delivered over a period of 12 weeks. Participants received a weekly automated email informing them when the next module of their program was available. Those who failed to log onto the module were sent an email reminder four days after the initial email. Those who failed to log in thereafter received a telephone reminder from their interviewer. The current week's module was only available after first completing the modules assigned in the preceding week or weeks.
Participants could withdraw from the study without explanation at any stage by informing the Trial Manager or their interviewer via email or telephone.
Randomization and allocation concealment
As required by ICH guideline E9 , randomisation was carried out by the trial biostatistician who was not involved in the day-to-day conduct of the trial.
Potential participants were randomised using a stratified block design with stratification by level of psychological distress (high/low distress level on K10), gender (male, female, uncommitted), and location of residence (metropolitan/rural). Randomization schemes with a fixed block size of four were generated for each strata using the web site Randomization.com http://www.randomization.com.
Measures employed in the screening and baseline, post intervention and follow-up phases of the WellBeing Study
Depressive symptoms (CES-D)
Anxiety symptoms (PSWQ)
Quality of Life
Perceived social support
User perceived utility of the Internet
Satisfaction & user perceived benefits/negative effects of intervention
Participation in healthcare
Psychological distress (K10)
User perceived mental health status
Depression & general anxiety symptoms (DASS-21)
Social anxiety screening (BSPS)
Intervention group preference
Primary outcome measure
Depressive symptoms: The primary outcome measure was the Centre for Epidemiological Studies Depression scale (CES-D; ). This 20-item self-report scale was used to measure change in the severity of depressive symptoms.
Secondary outcome measure(s)
The following secondary measures were used at baseline and in at least one subsequent survey to evaluate improvement or change in mental health, other outcomes and potential moderating or mediating factors:
Anxiety severity: The Penn State Worry Questionnaire (PSWQ); Quality of life: The EUROHIS QOL - 8 item index ; Disability: 'Days Out of Role' questions adapted from the US National Comorbidity Survey ; Self esteem: Rosenberg Self-esteem Scale ; Perceived social support: The 8-item Medical Outcomes Study Social Support Survey (MOS)/Emotional/informational support subscale . This scale was considered more relevant than others to online as opposed to face-to-face or telephone support. Loneliness: The UCLA Loneliness Scale ; Stigma: Depression Stigma Scale (DSS-Personal), a measure of personal, negative attitudes to depression [15, 42]; Depression knowledge: (i) a short 11-item version of the Depression Literacy Scale (D-Lit depression literacy scale; ); (ii) 33 depression treatment knowledge items evaluating the perceived helpfulness ('Helpful', 'Neither helpful nor harmful', 'Harmful', or 'Don't know') of three medications, five psychological treatments 21 lifestyle or alternative treatments and 4 formal and informal sources of help [8, 43]; Help seeking: Participants indicated (Yes or No) which of the above medication, psychological, lifestyle and alternative treatments or activities they had used or people they had consulted for depression in the past 3 months [8, 43]; Empowerment: Power-powerlessness subscale of the Empowerment Scale . This scale was developed in conjunction with mental health consumers; Perceived utility of the Internet: Two questions assessed participant's beliefs about the utility of the Internet for preventing and understanding depression ("I am confident that people could learn skills for preventing depression from a website" (Yes, No); "I am confident that a website could help people understand depression better" (Yes, No)).
In addition, the following measures were employed at one or more points post-intervention with a view to assessing their experience of the program: Satisfaction and perceived benefits/negatives: Satisfaction with the interventions was measured using 10 previously employed self-report items (e.g., 'How useful was the website?' (Very useful, useful, Not very useful, Not at all useful)) together with a series of questions based on items developed in a UK study of depression ISG users  (e.g., 'The website helped me to discuss subjects that I felt unable to discuss elsewhere.' (Strongly agree, Agree, Neither agree not disagree, Disagree, Strongly disagree) and the Consumer Reports CRES-4 scale [46, 47]; Perceived negative effects were measured with items specifically developed for the purposes of this study (e.g., 'Were any of the following a problem for you as a result of using the website? 'Feeling annoyed or upset by the comments made by other members on the board.' (Yes, No).); Participation in healthcare: A three item measure, modified from a study of a physical health internet support group  was employed at post intervention to assess participants' self-reported capacity to discuss treatments with their provider, feel in control and knowledgeable and be assertive with their healthcare provider; Adherence: measured in two ways for each individual: (i) completion of post-test surveys; (ii) number of modules completed (e-couch & Health Watch); (iii) frequency of logins and number of weeks logged onto the WellBeing ISG and activity level on each website (e-couch: number and percentage of exercises completed; number and percentage of pages downloaded; WellBeing Board: number of posts, number of threads started; HealthWatch: number and percentage of questions completed and pages downloaded).
Demographic and other measures
A number of other measures were collected in the screening survey. These included demographic data including gender, age, postcode, marital status, size of town of residence, level of primary and secondary education completed, current study being undertaken, and employment (status, main activity, usual job, past job). In addition, severity of general anxiety, depression and stress was measured using The Depression Anxiety Stress Scale (DASS-21; ), social anxiety symptoms were measured using the fear and avoidance subscales of the Brief Social Phobia Scale (BSPS; ) and panic symptoms were measured using The 5-item Patient Health Questionnaire (PHQ - Panic; ) scale. Participant perceived mental health status (stress, anxiety, panic, social anxiety, or depression), self reported professional help seeking for any such problem and perceived usefulness of seeking professional help for these problems were also collected. A series of purpose designed items were included in the screening survey to assess participant self reported need for information about depression. Finally, an item was included to measure participant randomisation preference at baseline.
Planned data analysis and sample size
The WellBeing trial aimed to recruit and randomise 500 participants to four conditions (125 per group). The primary analysis will be undertaken on an intent-to-treat basis. Mixed-model repeated measures (MMRM) analyses will be used because this method has been demonstrated to be superior to using the last observation carried forward method for handling missing data in longitudinal designs . For analyses of categorical outcomes, non-linear mixed modelling methods will be used. Based on previous studies,  we estimated pre-post effect sizes for the automated training program, the attention placebo and the ISG to be .6, .1, and .35 respectively. Power was set at 80% and calculations conservatively assumed a correlation of .5 between pre- and post-test measurements. Under these conditions the target sample size could detect a change from baseline of approximately .25 standard deviations in a priori contrasts of treatment arms conducted within the framework of omnibus test of condition by time mixed model repeated measures analysis. It is planned that the unique effect of the combined treatments will be tested by appropriate contrasts. It is possible that the combinations of treatment (e-couch and ISG) will prove no better than the individual programs. Conversely, cumulative effects or potentiation (synergy) may be observed. The target sample size ensured that the study is powered to detect an effect of .25 in either direction.
To our knowledge this study is the first RCT of the effectiveness of a depression ISG, the first to systematically investigate if participating in a peer-to-peer ISG improves adherence and outcomes and the first to investigate the comparative effectiveness for rural and metropolitan consumers of an automated psychological intervention. In addition, there have been no previous studies of effect of an automated online self-help program on consumer empowerment.
A second novel contribution of this trial is its use of a purpose constructed plausible, web-based attention control containing authoritative information. At the time of writing, we were not aware of any published RCTs of the efficacy of e-mental health interventions which employed such a control. As already noted, depression or mental health education websites are not the preferred control condition for studies of interventions for mental disorders as there is evidence that such information may improve mental health. We did consider referring control group users to existing websites with a 'wellbeing' theme. However, these websites were typically characterised by one or a number of limitations in that they contained content that: included potentially active components (such as exercise interventions); incorporated advertisements, which raises ethical issues when used in the context of a research trial; were typically not evidence-based, a further ethical concern; might change or be removed from the Internet; and was not subject to the control of the research team. Moreover, external websites could not be seamlessly integrated into our automated research trial processes and accordingly it would not have been possible to automatically track trial participant access and usage of these sites.
Status of the Trial
The trial was commenced in August 2008. Participants recruited in the pilot and wave 1 stages of the study have completed the 12-month follow-up. Participants recruited in the wave 2 stage have completed the 6-month follow-up with 12 month follow up due to be completed in May 2010.
This study was funded by a National Health and Medical Research Council Project Grant 471435 to KG, HC and AM. KG is supported by NHMRC Fellowship No. 525413 and HC is supported by Fellowship No. 525411. The authors wish to thank Lisa Barney, Alison Parsons, Anthony Bennett, Russell Reid, Julia Reynolds and Jennifer Norton for their contributions to the study.
- World Health Organization: The global burden of disease: 2004 update. 2008, Geneva: World Health Organization
- Malhi G, Adams D, Porter R, Wignall A, Lape L, O'Connor N, Paton M, Newton L, Walter G, Taylor A, et al: Clinical overview: Clinical practice recommendations for depression. Acta Psychiatrica Scandinavica. 2009, 119 (Suppl 439): 8-26. 10.1111/j.1600-0447.2009.01382.x.View Article
- National Institute for Clinical Excellence (NICE): Depression: Management of depression primary and secondary care. 2004, National Collaborating Centre for Mental Health, National Institute for Clinical Excellence
- Andrews G, Sanderson K, Slade T, Issakidis C: Why does the burden of disease persist? Relating the burden of anxiety and depression to effectiveness of treatment. Bulletin of the World Health Organization. 2000, 78: 446-454.PubMedPubMed Central
- Australian Institute of Health and Welfare: Rural, regional and remote health: Indicators of health. Rural Health Series. 2005, Canberra: Australian Institute of Health and Welfare
- Barney LJ, Griffiths KM, Jorm AF, Christensen H: Stigma about depression and its impact on help-seeking intentions. Australian and New Zealand Journal of Psychiatry. 2006, 40: 51-54.PubMedView Article
- Griffiths K, Farrer L, Christensen H: The efficacy of Internet interventions for depression and anxiety disorders: A review of randomised controlled trials. Med J Aust.
- Christensen H, Griffiths K, Jorm A: Delivering interventions for depression by using the internet: Randomised controlled trial. British Medical Journal. 2004, 328: 265-270. 10.1136/bmj.37945.566632.EE.PubMedPubMed CentralView Article
- Mackinnon A, Griffiths KM, Christensen H: Comparative randomised trial of online cognitive-behavioural therapy and an information website for depression: 12-month outcomes. British Journal of Psychiatry. 2008, 192: 130-134. 10.1192/bjp.bp.106.032078.PubMedView Article
- Christensen H, Griffiths K, Mackinnon A, Brittliffe K: Online randomized controlled trial of brief and full cognitive behaviour therapy for depression. Psychological Medicine. 2006, 36: 1737-1746. 10.1017/S0033291706008695.PubMedView Article
- Spek V, Cuijpers P, Nyklicek I, Smits N, Riper H, Keyzer J, Pop V: One-year follow-up results of a randomized controlled clinical trial on internet-based cognitive behavioural therapy for subthreshold depression in people over 50 years. Psychological Medicine. 2008, 38: 635-639. 10.1017/S0033291707002590.PubMedView Article
- Spek V, Nyklicek I, Smits N, Cuijpers PIM, Riper H, Keyzer J, Pop V: Internet-based cognitive behavioural therapy for subthreshold depression in people over 50 years old: a randomized controlled clinical trial. Psychological Medicine. 2007, 37: 1797-1806.PubMed
- Clarke G, Eubanks D, Reid E, Kelleher C, O'Connor E, DeBar L, Lynch F, Nunley S, Gullion C: Overcoming Depression on the Internet (ODIN) (2): A randomised trial of a self-help depression skills program with reminders. Journal of Medical Internet Research. 2005, 7: e16-10.2196/jmir.7.2.e16.PubMedPubMed CentralView Article
- Meyer B, Berger T, Caspar F, Beevers C, Andersson G, Weiss M: Effectiveness of a novel integrative online treatment for depression (Deprexis): Randomized controlled trial. Journal of Medical Internet Research. 2009, 11: e15-10.2196/jmir.1151.PubMedPubMed CentralView Article
- Griffiths KM, Christensen H, Jorm AF, Evans K, Groves C: Effect of web-based depression literacy and cognitive-behavioural therapy interventions on stigmatizing attitudes to depression: Randomised controlled trail. British Journal of Psychiatry. 2004, 185:
- Finkelstein J, Lapshin O: Reducing depression stigma using a web-based program. International Journal of Medical Informatics. 2007, 76: 726-734. 10.1016/j.ijmedinf.2006.07.004.PubMedView Article
- Griffiths KM, Christensen H: Internet-based mental health care programs: A powerful tool in the rural medical kit. Australian Journal of Rural Health. 2007, 15: 81-87. 10.1111/j.1440-1584.2007.00859.x.PubMedView Article
- Eysenbach G, Powell J, Englesakis M, Rizo C, Stern A: Health related virtual communities and electronic support groups: A systematic review of the effects of online peer to peer interactions. British Medical Journal. 2004, 328: 1166-10.1136/bmj.328.7449.1166.PubMedPubMed CentralView Article
- Davison K: Who talks? The social psychology of illness support groups. American Psychologist. 2000, 55: 205-217. 10.1037/0003-066X.55.2.205.PubMedView Article
- Griffiths KM, Calear AL, Banfield M, Tam A: Systematic review on Internet Support Groups (ISGs) and depression (2): What is known about depression ISGs?. Journal of Medical Internet Research. 2009, 11:
- Houston TK, Cooper LA, Ford DE: Internet support groups for depression: A 1-year prospective cohort study. American Journal of Psychiatry. 2002, 159: 2062-2068. 10.1176/appi.ajp.159.12.2062.PubMedView Article
- Winzelberg AJ, Classen C, Alperts GW, Roberts H, Koopman C, Adams RE, Ernst H, Dev P, Barr Taylor C: Evaluation of an Internet support group for women with primary breast cancer. Cancer. 2003, 97: 1164-1173. 10.1002/cncr.11174.PubMedView Article
- Barak A, Boniel-Nissim M, Suler J: Fostering empowerment in online support groups. Computers in Human Behaviour. 2008, 24: 1867-1883. 10.1016/j.chb.2008.02.004.View Article
- van Uden-Kraan CF, Drossaert CHC, Taal E, Shaw BR, Seydel ER, Laar van de MAFJ: Empowering processes and outcomes of participation in Online Support Groups for patients with breast cancer, arthritis, or fibromyalgia. Qualitative Health Research. 2008, 18: 10.1177/1049732307313429.
- Eysenbach G: The Law of Attrition. Journal of Medical Internet Research. 2005, 7: e11-10.2196/jmir.7.1.e11.PubMedPubMed CentralView Article
- Christensen H, Griffiths KM, Farrer L: Adherence in Internet interventions for anxiety and depression: Systematic review. Journal of Medical Internet Research. 2009, 11: 10.2196/jmir.1194.
- Griffiths KM, Farrer L, Christensen H: The efficacy of Internet interventions for depression and anxiety disorders: A review of randomised controlled trials. Medical Journal of Australia.
- Patten SB: Prevention of depressive symptoms through the use of distance technologies. Psychiatric Services. 2003, 54: 396-398. 10.1176/appi.ps.54.3.396.PubMedView Article
- Klein B, Richards J, Austin D: Efficacy of Internet therapy for panic disorder. Journal of Behavior Therapy & Experimental Psychiatry. 2006, 37: 213-238. 10.1016/j.jbtep.2005.07.001.View Article
- Richards J, Klein B, Austin D: Internet cognitive behavioural therapy for panic disorder: Does the inclusion of stress management information improve end-state functioning?. Clinical Psychologist. 2006, 10: 2-15. 10.1080/13284200500378795.View Article
- Donker T, Griffiths KM, Cuijpers P, Christensen H: Psychoeducation for depression, anxiety and psychological distress: A meta-analysis. BMC Medicine. 2009, 7: 79-10.1186/1741-7015-7-79.PubMedPubMed CentralView Article
- Australian Bureau of Statistics: Patterns of Internet access in Australia. 2006, Canberra, A.C.T.: Author
- Christensen H, Griffiths KM, Jorm AF: Delivering interventions for depression by using the internet: Randomised controlled trial. British Medical Journal. 2004, 328:
- ICH E9 Expert Working Group: Statistical principles for clinical trials: ICH harmonized tripartite guideline. Statistics in Medicine. 1999, 18: 1905-1942.
- Radloff LS: The CES-D scale: A self report depression scale for research in the general population. Applied Psychological Measurement. 1977, 1: 385-401. 10.1177/014662167700100306.View Article
- Meyers T, Miller M, Metzger R, Borkovec T: Development and validation of the Penn State Worry Questionnaire. Behaviour Research and Therapy. 1990, 28: 487-495. 10.1016/0005-7967(90)90135-6.View Article
- Schmidt S, Mühlan H, Power M: The EUROHIS-QOL 8-item index: Psychometric results of a cross-cultural field study. European Journal of Public Health. 2005, 16: 420-428. 10.1093/eurpub/cki155.PubMedView Article
- Kessler R, Frank G: The impact of psychiatric disorders on work loss days. Psychological Medicine. 1997, 27: 861-873. 10.1017/S0033291797004807.PubMedView Article
- Rosenberg M: Society and the adolescent self-image. Revised edn. 1989, Middletown, CT: Wesleyan University Press
- Sherbourne CD, Stewart AL: The MOS Social Support Survey. Social Science Medicine. 1991, 32: 705-714. 10.1016/0277-9536(91)90150-B.PubMedView Article
- Russell DW: UCLA Loneliness Scale (Version 3): Reliability, Validity, and Factor Structure. Journal of Personality Assessment. 1996, 66: 20-40. 10.1207/s15327752jpa6601_2.PubMedView Article
- Griffiths KM, Christensen H, Jorm AF: Predictors of depression stigma. BMC Psychiatry. 2008, 8: 25-10.1186/1471-244X-8-25.PubMedPubMed CentralView Article
- Jorm AF, Korten AE, Jacomb PA, Christensen H, Rodgers B, Pollitt P: "Mental health literacy": A survey of the public's ability to recognise mental disorders and their beliefs about the effectiveness of treatment. Medical Journal of Australia. 1997, 166: 182-PubMed
- Rodgers ES, Chamberlin J, Ellison MLE, Crean T: A consumer-constructed scale to measure empowerment among users of mental health services. Psychiatric Services. 1997, 48: 1042-1047.View Article
- Powell J, McCarthy N, Eysenbach G: Cross-sectional survey of users of Internet depression communities. BMC Psychiatry. 2003, 3: 19-10.1186/1471-244X-3-19.PubMedPubMed CentralView Article
- Seligman MEP: The effectiveness of psychotherapy: The Consumer Reports Study. American Psychologist. 1995, 50: 965-974. 10.1037/0003-066X.50.12.965.PubMedView Article
- Nielsen SL, Smart DW, Isakson RL, Worthen VE, Gregersen AT, Lambert MJ: The consumer reports effectiveness score: What did consumers report?. Journal of Counseling Psychology. 2004, 51: 25-37. 10.1037/0022-018.104.22.168.View Article
- Gustafson DH, Hawkins R, Boberg E, Pingree S, Serline RE, Graziano F, Lung Chan C: Impact of a patient-centered, computer-based health information/support system. American Journal of Preventive Medicine. 1999, 16: 1-9. 10.1016/S0749-3797(98)00108-1.PubMedView Article
- Henry JD, Crawford JR: The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. British Journal of Clinical Psychology. 2005, 44: 227-239. 10.1348/014466505X29657.PubMedView Article
- Davidson JRT, Potts NLS, Richichi EA, Ford SM, Krishnan KRR, Smith RD, Wilson W: The brief social phobia scale. Journal of Clinical Psychiatry. 1991, 52: 48-51.PubMed
- Spitzer RL, Kroenke K, Williams JBW: Patient Health Questionnaire Study Group. Validity and utility of a self-report version of PRIME-MD: The PHQ Primary Care Study. Journal of the American Medical Association. 1999, 282: 1737-1744. 10.1001/jama.282.18.1737.PubMedView Article
- Verbeke G, Molenberghs G: Linear mixed models for longitudinal data. 2000, New York: Springer-Verlag
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/10/20/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.