- Study protocol
- Open Access
- Open Peer Review
Collaborative care for patients with bipolar disorder: a randomised controlled trial
© van der Voort et al; licensee BioMed Central Ltd. 2011
- Received: 2 February 2011
- Accepted: 17 August 2011
- Published: 17 August 2011
Bipolar disorder is a severe mental illness with serious consequences for daily living of patients and their caregivers. Care as usual primarily consists of pharmacotherapy and supportive treatment. However, a substantial number of patients show a suboptimal response to treatment and still suffer from frequent episodes, persistent interepisodic symptoms and poor social functioning. Both psychiatric and somatic comorbid disorders are frequent, especially personality disorders, substance abuse, cardiovascular diseases and diabetes. Multidisciplinary collaboration of professionals is needed to combine all expertise in order to achieve high-quality integrated treatment. 'Collaborative Care' is a treatment method that could meet these needs. Several studies have shown promising effects of these integrated treatment programs for patients with bipolar disorder. In this article we describe a research protocol concerning a study on the effects of Collaborative Care for patients with bipolar disorder in the Netherlands.
The study concerns a two-armed cluster randomised clinical trial to evaluate the effectiveness of Collaborative Care (CC) in comparison with Care as usual (CAU) in outpatient clinics for bipolar disorder or mood disorders in general. Collaborative Care includes individually tailored interventions, aimed at personal goals set by the patient. The patient, his caregiver, the nurse and the psychiatrist all are part of the Collaborative Care team. Elements of the program are: contracting and shared decision making; psycho education; problem solving treatment; systematic relapse prevention; monitoring of outcomes and pharmacotherapy. Nurses coordinate the program. Nurses and psychiatrists in the intervention group will be trained in the intervention. The effects will be measured at baseline, 6 months and 12 months. Primary outcomes are psychosocial functioning, psychiatric symptoms, and quality of life. Caregiver outcomes are burden and satisfaction with care.
Several ways to enhance the quality of this study are described, as well as some limitations caused by the complexities of naturalistic treatment settings where not all influencing factors on an intervention and the outcomes can be controlled.
The Netherlands Trial Registry, NTR2600.
- Bipolar Disorder
- Informal Caregiver
- Collaborative Care
- Brief Symptom Inventory
- Problem Solve Treatment
Bipolar disorder is a severe mental illness with an estimated lifetime prevalence of 1.5 to 2%. It is characterized by recurrent episodes of extreme mood changes. Several studies [2–4] show that on average patients suffer from manic, depressive, hypomanic or mixed symptoms for about half of the time despite treatment. Even during so-called euthymic periods, i.e. when they are formally not in a mood episode, many patients suffer from subsyndromal symptoms that negatively influence their quality of life . Informal caregivers also suffer a substantial burden by the illness, not only during episodes [6, 7].
Treatment of bipolar disorders in the Netherlands primarily consists of pharmacotherapy, supportive treatment, and psycho education, sometimes combined with improvement of self-management skills or psychotherapy. Many patients respond well to this treatment and may stabilize for longer periods. However, a substantial number of patients do not respond adequately to these treatment efforts. They suffer from frequent episodes, persisting symptoms, cognitive problems, limited social support and poor social functioning. Comorbid psychiatric disorders, such as personality disorders and substance abuse, are common, as are somatic disorders i.e. cardiovascular disease, partly associated with prolonged use of maintenance medication [8, 9].
Multidisciplinary collaboration of professionals is needed to involve optimal specialist skills on all aspects of the disorder, and to properly combine all expertise in order to achieve an optimally integrated care . The Dutch guideline for the treatment of bipolar disorders  recommends such an integrated treatment. The guideline advises that treatment be targeted at reducing symptoms, acceptance of the illness, promoting treatment adherence, stabilising social rhythm, recognising early signs and symptoms and take proper actions when these occur, diminishing social problems and maximising social participation. It is advised to actively engage caregivers or family members in this treatment. Although it is widely acknowledged that integrated treatment programs can be of great value for patients with bipolar disorder, research on the effectiveness of such programs for patients with a bipolar disorder is scarce.
Collaborative Care (CC) programs have been developed to integrate multidisciplinary care for complex disorders and to date, three research projects show promising results with bipolar patients. Bauer et al. [12, 13] have implemented a CC model for patients with bipolar disorder and measured the effects in two randomised controlled trials. Patients participated in the Life Goals Program. The intervention consisted of improving patients' self-management skills through psycho education; supporting providers' decision making through simplified practice guidelines; and enhancing access to care and continuity of care. The care manager, a nurse or a social worker, provided actively outreaching care when a patient was at risk of losing contact with mental health workers. Each patient made a 'relapse prevention plan', aimed at the early recognition of relapses. The care manger contacted the patient at least every three months. The program also provides guidelines for specific pharmacotherapy. Bauer et al. [12, 13] found significantly reduced number of weeks in manic episodes in the experimental group, although no significant effect was found on weeks depressed. Patients showed improved social functioning, quality of life and treatment satisfaction. Total costs were similar in both groups. The Life Goals Program was extended by Kilbourne et al. [14, 15], to address the many medical comorbidities present in patients with bipolar disorders.
Simon et al. [16, 17] have explored the effects of adding intensive nursing care to treatment of patients with bipolar disorder. This consisted of an emergency plan, monthly telephone calls in which symptoms were monitored, sharing of information between nurse and psychiatrist, and outreach interventions such as crisis intervention. Patients were given the choice of participation in the Life Goals Program, mentioned above. After receiving the intervention over a period of one or two years, patients in the experimental group showed significant less severe manic symptoms of shorter duration. Also in this study, there was no effect on depressive symptoms. Extra costs of this treatment were relatively low compared to the control group.
Suppes et al.  studied the effects of the Texas Medication Algorithm project in patients with bipolar disorder. This project aimed to develop and implement algorithms for pharmacotherapy for bipolar patients. Clinics implementing this guideline were compared in a RCT to clinics which did not use the guideline. In the experimental group, a coordinator was added to the care team. This coordinator provided psycho education to the patient and the family. He kept in contact with the patient, and assessed symptoms and side effects of medication prior to each consultation with the psychiatrist. The coordinator informed the psychiatrist about the results of these assessments. The aim was to achieve a higher efficiency of the psychiatric consultations. The results of the study show a significant improvement of psychiatric symptoms of patients in the intervention group in the first three months. During the next nine months, patients in the control group improved as well, but less than patients in the intervention group. Patients in the intervention group reported significant improvement of manic, but not depressive and psychotic symptoms.
It is striking that all three studies show improvement of manic but not depressive symptoms.
In the Netherlands, until now no studies have been performed on the effects of CC for patients with bipolar disorder. The current study will be the first to implement CC for patients with bipolar disorder, and moreover, to add a specific intervention to improve depression. Furthermore, CC appears to offer good possibilities to strengthen the position of the nurse in the care process for patients with a bipolar disorder, both at the organizational and content levels.
In this article we describe the study protocol for investigating the effectiveness of a CC program for patients with bipolar disorder. We set out the following three research questions to answer:
A What are the effects of a CC program, compared to Care as Usual (CAU), for patients with bipolar disorder, with regard to their psychosocial functioning, psychiatric symptoms, quality of life, attitudes towards medication, mastery, and satisfaction with care?
B What are the effects of a CC program, compared to CAU, for informal caregivers of patients with a bipolar disorder, with regard to the experienced burden and satisfaction with care?
C What is the cost effectiveness of a CC Program compared to CAU?
A pragmatic two-armed cluster randomized controlled trial (RCT) will be carried out in mental health outpatient clinics in the Netherlands. A Collaborative Care program will be executed in the experimental condition, whereas the control condition will continue to deliver Care as Usual (CAU). CC will be performed by the CC-team, with mental health nurses in a coordinating role. Baseline measurements will be obtained at inclusion and follow-up measurements will take place at 6 months and 12 months. The primary outcome measures are psychosocial functioning, symptoms, and quality of life. Secondary outcome measures are mastery, attitude towards medication and satisfaction with care. Family members or friends of patients will be asked to fill in questionnaires regarding perceived burden and satisfaction with care.
Study on Care as Usual
The level of CAU may vary considerably among the various outpatients clinics in the Netherlands, and there is a lack of clarity about the specific content of CAU for patients with bipolar disorder. However, there is more detailed knowledge available about care provided in some highly specialized centres for patients with bipolar disorder that may resemble CC. In the Netherlands, about 20.000 patients receive care for bipolar disorder but it is estimated that only 1500 patients receive this care in these specialized centres. Hence, about 18.500 patients receive CAU at a less specific level. Our presumption is that CC will differ considerably from CAU, which we expect to be mainly supportive and not systematically delivered. In order to increase our knowledge about the characteristics of CAU another study has started to describe current CAU for bipolar disorders in the Netherlands. In this study, psychiatrists and patients are being asked to describe the care actually delivered to patients with bipolar disorder, by means of questionnaires. These data will be used in the current study: (1) to objectively describe CAU; (2) to select sites (based on our inclusion criteria) that can be included in our CC-trial; and (3) to perform the matching of sites for the (cluster) randomization. Furthermore, if outpatient care teams are interested in participating in the CC-trial, we will interview two members of that team to investigate the nature and intensity of care currently delivered to patients with bipolar disorder. Clinics that currently have a level of CAU that does not already resemble CC can be considered for randomisation.
In this trial we will use clustered randomisation with outpatient clinic teams as clusters. Randomisation will be performed as follows: the CAU-study as well as the interviews with team members provide us with insight in the nature and intensity of CAU at that site. This enables us to describe CAU more precisely and formulate criteria for inclusion. Sites that meet the criteria for CAU will be invited to join in the CC-trial. Teams will be matched for characteristics of care offered to bipolar patients, as well as organisational characteristics such as team composition or type of organisation. One team of every pair will be randomly assigned to the experimental condition, and the other to the control condition. Patients in both teams who meet the inclusion criteria will be asked to participate in the study.
Patients who meet the following inclusion criteria will be included:
diagnosis of bipolar disorder according to DSM- IV-TR ;
age 18-65 years.
Acute phase of severe depression or mania (CGI-BP: degree of illness score 6 or score 7).
A very stable course of illness (during the last year) that allows low intensity of treatment (2-4 consults with the psychiatrist per year suffice), to be judged by the treating psychiatrist.
Insufficient command of the Dutch language.
Not able or willing to give informed consent.
If the patient consents, a family member or friend will also be asked to participate in the study, according to the following inclusion criteria:
The family member or friend is assigned by the patient.
The family member or friend is 18 years or older.
The family member or friend has a sufficient command of the Dutch language.
The family member or friend is able and willing to give informed consent.
Since the current study is a pragmatic intervention study, blinding of patients and professionals for care modality is not possible. However, blinding is performed in the procedure of randomisation and the statistical analysis. Furthermore, the research assistant who performs interviews by telephone to administer the Life Chart, will be blind to the condition of the respondent.
CC will be recovery-oriented, meaning that it supports the personal process of the patient towards redefining and achieving his goals in life despite the disorder. It will consist of the following systematically delivered elements of treatment:
The formation of a Collaborative Care team, including at least the patient, the nurse and the psychiatrist, were all decisions concerning treatment and care will be made, using shared decision making. If possible, a family member or friend will be engaged in the treatment and be part of the CC team. Teams meet every three months. Coordination of care and continuity of care is provided by the nurse.
Contracting. Agreement on the most important problems to be worked on, and on which treatment is needed to help the patient achieve his personal goals, will be striven for. A treatment plan will be made, formulated as a contract, in which goals and treatment activities are recorded.
Working with the treatment plan based on systematic care needs assessment, and that will focus specifically on recovery-oriented goals, defined by the patient. Systematic monitoring of outcomes.
Pharmacotherapy and somatic care, as usual. In addition, structured and continuous monitoring of the effects.
If indicated, specialised PST will be delivered (1) to patients who remain depressed, aimed at increasing the amount of pleasant or fulfilling activities, and (2) to patients with wishes or care needs on the subject of participation in society, aimed at rehabilitation.
These interventions will be tailored to the individual needs of the patient.
In the CC trial, CC will be implemented in the experimental teams by the use of the Replicating Effective Programs framework (REP) . This framework appears to be well-suited for the implementation of our program as it specifies steps needed to maximise fidelity while allowing opportunities for flexibility. REP consists of four phases: pre-conditions (e.g., identifying need, target population, and suitable intervention), pre-implementation (e.g., intervention packaging), implementation (e.g., package dissemination, training, technical assistance, and evaluation), and maintenance and evolution (e.g., preparing the intervention for sustainability). Key components of REP, including intervention packaging, training, technical assistance, and fidelity assessment are crucial to the implementation of effective interventions in health care.
A manual-based training program will be developed by the researchers with assistance of an expert panel consisting of expert nurses, psychiatrists, patients and family members. Nurses in the experimental condition will receive a three-day training program, and psychiatrists and psychologists will receive parts of this training. The trained teams will perform CC during one year. They will be primarily responsible for the coordination and continuity of treatment and care for patients with bipolar disorder. The primary investigator (TV) will supervise the nurses intensively during the performing stage of the intervention, by weekly contact by telephone and regular meetings in the facility with colleagues who also participate in the study. Fidelity will be assessed by means of checklists filled out by the nurses in the experimental group, and by randomly checking the electronic files of patients, by the primary investigator.
Nurses in the control group will be performing Care As Usual, of which the content will be assessed by the researcher at baseline, by means of the checklist mentioned before. The Care consumption will be measured with the TIC-P questionnaire in both groups.
Measures (Table 1)
Measures in experimental group as well as in control group
Filled in by
Primary outcomes are psychosocial functioning; course, prevalence and severity of psychiatric symptoms and quality of life.
Data will be analyzed according to the intention to treat-principle. Baseline comparability of the experimental and control groups in demographic and clinical variables will be evaluated with ANOVA/independent samples t-test and Chi-square tests. Differences in outcome between CC and CAU will be evaluated by means of (mixed model) analysis of covariance. A group*time-interaction term will be entered into the model to test for a difference in treatment effect over time. In analyzing a specific outcome variable, the baseline score of that variable will be used as covariate. The analysis will be extended using multilevel analysis that takes the nesting of measurements into account. In the multilevel analyses we consider location as the first level, patient as the second level, and the three measurements as a third level, using the principles of Twisk . Finally we will take into account to what extent patients were exposed to the intervention by analysing the dose-effect relationship.
The power calculation concerns the comparison at T12 compared to T0 between the two groups (CC vs. CAU). We were not able to detect studies sufficiently comparable to ours to find a basis for estimating an effect size. We assume the effect size Cohen's d = 0,5, because we consider this a clinically relevant effect. Setting α < .05 (two-tailed), and the power (1-β) = .80, the required sample size is 2 × 63 patients. In cases of clustered randomisation the standard is to add 25% to this amount (n = 2 × 79). Taking into account an expected loss of 30%, a sample of 103 patients in each group is needed.
This study protocol has been reviewed by the Scientific Committee of the EMGO Institute of VU University Medical Center in Amsterdam, The Netherlands, and by the Research Committee of Inholland University for Applied Sciences, Amsterdam, and has been approved for by the Medical Ethical Committee of the VU University Medical Centre for final approval. Patients will obtain oral and written information about the study and will be asked to sign an informed consent form if they are willing to participate. They will give informed consent for participation of a specific caregiver, who will also be asked to give separate informed consent.
This pragmatic trial will to our knowledge be the first to evaluate the effectiveness of recovery oriented Collaborative Care for patients with bipolar disorder outside the United States. Our study will assess primarily the effects of CC on functioning, psychiatric symptoms and quality of life. We expect that CC contributes to an increased quality of care for these patients.
The quality of the study is enhanced in four ways. Firstly, we included the expertise of patients, informal caregivers, psychiatrists and nurses during the process of development of the CC intervention. Secondly, we carefully planned implementation of CC in the experimental group, with the three days of training, weekly coaching for the nurses, regular meetings with the group of nurses that perform CC, and fidelity assessments. In this way we intend to improve intervention compliance in the experimental group. Thirdly, we apply very few a priori exclusion criteria, hence we will be able to generalise our findings to a large group of outpatients with bipolar disorder. Finally, the interviewing research assistant is blinded for the treatment condition of the respondents, while administering the Life Chart by telephone.
Besides these strong points, this study has some limitations, which should be acknowledged. The main limitation is that patients and professional care providers cannot be blinded for the treatment condition to which they will be randomised. This is a possible source of bias, as patients as well as nurses in the intervention group may be more actively involved in the treatment because they expect it to work, which may enhance the effect of the intervention we find. A second limitation is the possibility that participation in the study and being exposed to follow-up assessments may affect the outcome of the CAU control group. This may decrease the contrast between the two groups and thus the probability to find statistically significant differences between the CC and the CAU condition. The third limitation is that it is not possible to discern which component of CC contributed to the effect.
Limitations of this kind are inevitable in a pragmatic trial, because of the complexities of naturalistic treatment settings where not all influencing factors on our intervention and the outcomes can be controlled. Despite this, we hypothesize that this program will improve the quality of care for patients with bipolar disorder, thereby optimizing symptomatic recovery, level of functioning and in the end their quality of life.
- Pini S, de Queiroz V, Pagnin D, Pezawas L, Angst J, Cassano GB, et al: Prevalence and burden of bipolar disorders in European countries. Eur Neuropsychopharmacol. 2005, 15: 425-434. 10.1016/j.euroneuro.2005.04.011.View ArticlePubMedGoogle Scholar
- Kupka RW, Altshuler L, Nolen WA, Suppes T, Luckenbaugh DA, Leverich GS, et al: Three times more days depressed than manic or hypomanic in both bipolar I and bipolar II disorder. Bipolar Disord. 2007, 9: 531-535. 10.1111/j.1399-5618.2007.00467.x.View ArticlePubMedGoogle Scholar
- Judd LL, Akiskal HS, Schettler PJ, Endicott J, Maser JD, Solomon DA, et al: The long-term natural history of the weekly symptomatic status of bipolar I disorder. Arch Gen Psychiatry. 2002, 59: 530-537. 10.1001/archpsyc.59.6.530.View ArticlePubMedGoogle Scholar
- Judd LL, Akiskal HS, Schettler PJ, Coryell W, Endicott J, Maser JD, et al: A prospective investigation of the natural history of the long-term weekly symptomatic status of bipolar II disorder. Arch Gen Psychiatry. 2003, 60: 261-269. 10.1001/archpsyc.60.3.261.View ArticlePubMedGoogle Scholar
- Goossens PJJ, Hartong EG, Knoppert-van der Klein EAM, van Achterberg T: Self-reported psychopathological symptoms and quality of life in outpatients with bipolar disorder. Perspect Psychiatr Care. 2008, 44: 275-284. 10.1111/j.1744-6163.2008.00187.x.View ArticlePubMedGoogle Scholar
- Voort van der TYG, Goossens PJJ, van der Bijl JJ: Alone together: A grounded theory study of experienced burden, coping, and support needs of spouses of persons with a bipolar disorder. Int J Ment Health Nurs. 2009, 18: 434-443. 10.1111/j.1447-0349.2009.00634.x.View ArticleGoogle Scholar
- Goossens PJJ, van Wijngaarden B, Knoppert-van der Klein EAM, van Achterberg T: Family caregiving in bipolar disorder: caregiver consequences, caregiver coping styles, and caregiver distress. Int J Soc Psychiatry. 2008, 54: 303-316. 10.1177/0020764008090284.View ArticlePubMedGoogle Scholar
- McIntyre RS, Soczynska JK, Beyer JL, Woldeyohannes HO, Law CW, Miranda A, et al: Medical comorbidity in bipolar disorder: re-prioritizing unmet needs. Curr Opin Psychiatry. 2007, 20: 406-416. 10.1097/YCO.0b013e3281938102.View ArticlePubMedGoogle Scholar
- Fajutrao L, Locklear J, Priaulx J, Heyes A: A systematic review of the evidence of the burden of bipolar disorder in Europe. Clin Pract Epidemiol Ment Health. 2009, 5: 3-10.1186/1745-0179-5-3.View ArticlePubMedPubMed CentralGoogle Scholar
- Renes J, Prinsen J, Kupka RW: Multidisciplinaire behandeling. Handboek bipolaire stoornissen. Edited by: Nolen WA, Kupka RW, Schulte PFJ, Knoppert-van der Klein EAM, Honig A, Reichart CG, et al. 2008, Utrecht: de TijdstroomGoogle Scholar
- Nolen WA, Kupka RW, Schulte PFJ, Knoppert-van der Klein EAM, Honig A, Reichart CG, et al: Richtlijn bipolaire stoornissen (Guideline Bipolar Disorders) Tweede, herziene versie. 2008, De Tijdstroom UtrechtGoogle Scholar
- Bauer MS, McBride L, Williford WO, Glick H, Kinosian B, Altshuler L, et al: Collaborative care for bipolar disorder: part I. Intervention and implementation in a randomized effectiveness trial. Psychiatr Serv. 2006, 57: 927-936. 10.1176/appi.ps.57.7.927.View ArticlePubMedGoogle Scholar
- Bauer MS, McBride L, Williford WO, Glick H, Kinosian B, Altshuler L, et al: Collaborative care for bipolar disorder: Part II. Impact on clinical outcome, function, and costs. Psychiatr Serv. 2006, 57: 937-945. 10.1176/appi.ps.57.7.937.View ArticlePubMedGoogle Scholar
- Kilbourne AM, Post EP, Nossek A, Drill L, Cooley S, Bauer MS: Improving medical and psychiatric outcomes among individuals with bipolar disorder: A randomized controlled trial. Psychiatr Serv. 2008, 59: 760-768. 10.1176/appi.ps.59.7.760.View ArticlePubMedGoogle Scholar
- Kilbourne AM, Goodrich DE, Bauer MS: Collaborative Care for Bipolar Disorder. Bipolar Disorder: Clinical and Neurobiological Foundations. Edited by: Yatham LN, Maj M. 2010, Wiley-Blackwell, 453-462.View ArticleGoogle Scholar
- Simon GE, Ludman EJ, Unutzer J, Bauer MS, Operskalski B, Rutter C: Randomized trial of a population-based care program for people with bipolar disorder. Psychol Med. 2005, 35: 13-24.View ArticlePubMedGoogle Scholar
- Simon GE, Ludman EJ, Bauer MS, Unutzer J, Operskalski B: Long-term effectiveness and cost of a systematic care program for bipolar disorder. Arch Gen Psychiatry. 2006, 63: 500-508. 10.1001/archpsyc.63.5.500.View ArticlePubMedGoogle Scholar
- Suppes T, Rush AJ, Dennehy EB, Crismon ML, Kashner TM, Toprac MG, et al: Texas Medication Algorithm Project, phase 3 (TMAP-3): clinical results for patients with a history of mania. J Clin Psychiatry. 2003, 64: 370-382. 10.4088/JCP.v64n0403.View ArticlePubMedGoogle Scholar
- American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders, third Edition - Text Revision (DSMIV-TR). 2000, American Psychiatric Publishing IncorporatedView ArticleGoogle Scholar
- Hofman A, Honig A, Vossen M: Het manisch depressief syndroom; psycho-educatie als onderdeel van behandeling. Tijdschr Psychiatr. 1992, 34: 549-559.Google Scholar
- Honig A, Hofman A, Rozendaal N, Dingemans P: Psycho-education in bipolar disorder: effect on expressed emotion. Psychiatry Research. 1997, 72: 17-22. 10.1016/S0165-1781(97)00072-3.View ArticlePubMedGoogle Scholar
- Schreuders B, van Oppen P, van Marwijk HW, Smit JH, Stalman WAB: Frequent attenders in general practice: problem solving treatment provided by nurses. BMC Fam Pract. 2005, 12: 6-42.Google Scholar
- Schreuders B, van Marwijk HW, Smit J, Rijmen F, Stalman W, van Oppen P: Primary care patients with mental health problems: outcome of a randomised clinical trial. Br J Gen Pract. 2007, 57: 886-891. 10.3399/096016407782317829.View ArticlePubMedPubMed CentralGoogle Scholar
- Leverich GS, Post RM: Life Charting of affective disorders. CNS Spectrums. 1998, 3: 21-37.Google Scholar
- Goossens PJJ, Kupka RW, Beentjes TA, Achterberg T: Recognising prodromes of manic or depressive recurrence in outpatients with bipolar disorder: A cross-sectional study. Int J Nurs Stud. 2010, 47: 1201-1207. 10.1016/j.ijnurstu.2010.01.010.View ArticlePubMedGoogle Scholar
- Morriss RK, Faizal MA, Jones AP, Williamson PR, Bolton C, McCarthy JP: Interventions for helping people recognise early signs of recurrence in bipolar disorder. Cochrane Database Syst Rev. 2007, CD004854-Google Scholar
- Perry A, Tarrier N, Morriss R, McCarthy E, Limb K: Randomised controlled trial of efficacy of teaching patients with bipolar disorder to identify early symptoms of relapse and obtain treatment. BMJ. 1999, 318: 149-153.View ArticlePubMedPubMed CentralGoogle Scholar
- Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R: Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implementation Science. 2007, 2:Google Scholar
- Leverich GS, Nolen WA, Rush AJ, McElroy SL, Keck PE, Denicoff KD, et al: The Stanley Foundation Bipolar Treatment Outcome Network. I. Longitudinal methodology. J Affect Disord. 2001, 67: 33-44. 10.1016/S0165-0327(01)00430-X.View ArticlePubMedGoogle Scholar
- Suppes T, Leverich GS, Keck PE, Nolen WA, Denicoff KD, Altshuler LL, et al: The Stanley Foundation Bipolar Treatment Outcome Network. II. Demographics and illness characteristics of the first 261 patients. J Affect Disord. 2001, 67: 45-59. 10.1016/S0165-0327(01)00432-3.View ArticlePubMedGoogle Scholar
- Rosa AR, Sanchez-Moreno J, Martinez-Aran A, Salamero M, Torrent C, Reinares M, et al: Validity and reliability of the Functioning Assessment Short Test (FAST) in bipolar disorder. Clin Pract Epidemiol Ment Health. 2007, 3: 5-10.1186/1745-0179-3-5.View ArticlePubMedPubMed CentralGoogle Scholar
- Kupka RW, Knoppert-van der Klein EAM, Nolen WA, (red): Handboek Bipolaire Stoornissen. 2008Google Scholar
- Beurs E de, Zitman FG: De Brief Symptom Inventory (BSI): De betrouwbaarheid en validiteit van een handzaam alternatief voor de SCL-90. Maandblad Geestelijke Volksgezondheid. 2006, 61: 120-141.Google Scholar
- Altman EG, Hedeker D, Peterson JL, Davis JM: The Altman Self-Rating Mania Scale. Biol Psychiatry. 1997, 42: 948-955. 10.1016/S0006-3223(96)00548-3.View ArticlePubMedGoogle Scholar
- Denicoff KD, Leverich GS, Nolen WA, Rush AJ, McElroy SL, Keck PE, et al: Validation of the prospective NIMH-Life-Chart Method (NIMH-LCM-p) for longitudinal assessment of bipolar illness. Psychol Med. 2000, 30: 1391-1397. 10.1017/S0033291799002810.View ArticlePubMedGoogle Scholar
- Simon GE, Rutter CM: Accuracy of recall for mania symptoms using a three month timeline follow-back interview. J Affect Disord. 2008, 107: 271-274. 10.1016/j.jad.2007.08.020.View ArticlePubMedGoogle Scholar
- Trompenaars FJ, Masthoff ED, Van Heck GL, Hodiamont PP, De Vries J: Content validity, construct validity, and reliability of the WHOQOL-Bref in a population of Dutch adult psychiatric outpatients. Qual Life Res. 2005, 14: 151-160. 10.1007/s11136-004-0787-x.View ArticlePubMedGoogle Scholar
- Phelan M, Slade M, Thornicroft G, Dunn G, Holloway F, Wykes T, et al: The Camberwell Assessment of Need: the validity and reliability of an instrument to assess the needs of people with severe mental illness. Br J Psychiatry. 1995, 167: 589-595. 10.1192/bjp.167.5.589.View ArticlePubMedGoogle Scholar
- McCrone P, Leese M, Thornicroft G, Schene AH, Knudsen HC, Vazquez-Barquero JL, et al: Reliability of the Camberwell Assessment of Need--European Version. EPSILON Study 6. European Psychiatric Services: Inputs Linked to Outcome Domains and Needs. Br J Psychiatry Suppl. 2000, s34-s40.Google Scholar
- Trauer T, Tobias G, Slade M: Development and Evaluation of a Patient-rated Version Of the Camberwell Assessment of Need Short Appraisal Schedule (CANSAS-P). Community Mental Health Journal. 2008, 44: 113-124. 10.1007/s10597-007-9101-z.View ArticlePubMedGoogle Scholar
- Pearlin LI, Liebermann MA, Menaghan EG, Mullan JT: The stress proces. Journal of Health and Social Behaviour. 1981, 22: 337-356. 10.2307/2136676.View ArticleGoogle Scholar
- Hakkaart-van Roijen L: Trimbos/iMTA questionnaire for Costs associated with psychiatric illness (TIC-P). Institute for Medical Technology Assessment, Erasmus University Rotterdam. Trimbos. 2002Google Scholar
- Hogan TP, Awad AG, Eastwood R: A self-report scale predictive of drug compliance in schizophrenics: reliability and discriminative validity. Psychol Med. 1983, 13: 177-183. 10.1017/S0033291700050182.View ArticlePubMedGoogle Scholar
- Wijngaarden van B, Schene AH, Koeter M, Vazquez-Barquero JL, Knudsen HC, Lasalvia A, et al: Caregiving in schizophrenia: development, internal consistency and reliability of the Involvement Evaluation Questionnaire--European Version. EPSILON Study 4. European Psychiatric Services: Inputs Linked to Outcome Domains and Needs. Br J Psychiatry Suppl. 2000, s21-s27.Google Scholar
- Twisk J: Applied multilevel analysis; A Practical Guide for Medical Researchers. 2006, New York USA: Cambridge University PressView ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/11/133/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.