Recall of patients on community treatment orders over three years in the OCTET CTO cohort
BMC Psychiatry volume 16, Article number: 392 (2016)
Randomised studies consistently show that Community Treatment Orders (CTOs) do not have the intended effect of preventing relapse and readmissions of patients with severe and enduring mental illness. Critics suggest this in part can be explained by RCTs studying newly introduced CTO regimes and that patients therefore were not brought back to hospital for short-term observations (‘recall’) as frequently as intended. Our purpose was (i) to test the hypothesis that CTO practice as regards recall of patients to hospital in England and Wales was as rigorous under the OCTET trial period as in current routine use and (ii) to investigate the reasons for and outcomes of recalls and whether this changed over time.
Thirty six-month observational prospective study of 198 patients in the OCTET Follow-up Study.
Forty percent of patients were recalled, 19 % more than once. This is in line with current national use. Deterioration in clinical condition was the most common reason for recalls (49 %), and 68 % of recalls resulted in revocation of the order (i.e., retention in hospital under compulsion). This pattern remained stable over time.
The use of recall cannot explain why RCTs have not confirmed any benefits from CTOs, and their continued use should be reconsidered.
The OCTET Trial was retrospectively registered on 12 November 2009 (ISRCTN73110773)
Deinstitutionalisation of mental health services has resulted in severely ill patients increasingly being treated in the community. In response, legal regimes for involuntary out-patient treatment (Community Treatment Orders, CTOs) have been developed. First introduced in North America and Australasia, they are also becoming a feature of mental health legislations in much of Europe and are now available in more than 75 jurisdictions worldwide . CTOs permits compulsory treatment outside of hospital. They target patients deemed to need supervision but who are well enough for this to take place outside hospital. The aim is to break the pattern of repeated admissions by facilitating a period of stability so that the patient settles in the community and eventually returns to voluntary care.
CTOs were introduced into the amended Mental Health Act for England and Wales (MHA) in November 2008 . The legal criteria include that the patient suffers from a mental disorder for which they require treatment to protect their health and safety or that of others; that the treatment (which must be available) can continue in the community, and; that it is necessary for the responsible clinician to be able to exercise the power of rapid recall to hospital for observation . Recalls may take place when patients show signs of deterioration or they breach one of the two mandatory conditions of making themselves available for assessment. A recall to hospital for observation or treatment can last for up to 72 h after which there are three options. The order can be revoked and the patient remains in hospital for involuntary treatment; they return to the community on the CTO, or; they are discharged from involuntary treatment altogether. The recall mechanism is thus central to how CTOs were envisaged to work. Similar mechanisms exist in other CTO regimes .
Current evidence shows that CTOs are not effective in their stated purpose of reducing relapse and readmission [4–6]. Around 35 outcome studies and three RCTs have investigated the effect on hospitalisation (rates, duration and time to readmission following placement on CTO) and community service usage. While non-randomised studies vary in quality and have inconsistent findings, all analyses of randomised data found no effect of CTOs [4, 7–9]. A meta-analysis of the patients from the three RCTs also found no effect on admissions or bed days or any improvement in psychiatric symptoms or global functioning . Additionally, the OCTET trial testing the English regime  found no effect on subgroups  or any long-term (36 months) effect on hospital outcomes or on engagement with services .
One explanation advanced for the lack of observed positive effects of CTOs is that newly introduced regimes are not implemented as rigorously as intended [4, 13, 14], although there is little published data to support this proposal. Specifically it is suggested that clinicians were inexperienced in the use of CTOs when the studies were conducted and that recall to hospital was not used as often as intended, preventing patient improvement [14, 15]. There is very little evidence on which to base such claims of inadequate recalls because this data is not reported in effectiveness studies. National prevalence data in England and Wales show that on 31 March 2015, 5461 people were subject to a CTO. No data is available on how long these patients had been on CTO. In the preceding year, available incidence figures show that 2369 recalls and 1427 revocations were made. This would suggest that around 43 % of CTO patients in that period were recalled, but some may have been recalled more than once so the true figure is probably lower. Of these recalls, 60 % ended in revocation. These figures have remained stable over the last 5 years .
Aims of the study
To address the concern over the validity of the evidence base, we tested the hypothesis that early implementation of CTOs in England and Wales was equally rigorous in terms of recalling patients as is the case routinely now 8 years after their introduction. We used data from the three year follow-up of the OCTET cohort . A secondary aim was to examine the reasons for and outcomes of these recalls, and whether this changed over time.
The OCTET trial recruited patients in 32 National Health Service (NHS) hospitals across England and followed them up for 12 months. At randomisation, all were in involuntary hospital treatment, aged 18–65 years, with a psychosis diagnosis and considered to need CTO on discharge. Patients were randomly allocated (50:50) to leave hospital on a CTO or to voluntary status via Section 17 leave of absence . The OCTET Follow-Up Study then followed the cohort of 333 patients for a further 24 months (i.e., 36 months, 1095 days, in total) . For the present observational prospective cohort study we selected those patients from the OCTET Follow-up Study who at any time during the follow-up period were on a CTO. We applied no further inclusion or exclusion criteria.
For each patient we used data from the date of first placement on CTO until 36-months after randomisation in the original trial. Data were collected, by independent researchers, from NHS medical records, including trusts’ Mental Health Act Offices, in the period from November 2008 to February 2014. Socio-demographic and clinical characteristics were collected through patient interviews at baseline [10, 12].
The number of occurrences of recalls was counted. For each recall we classified the recorded reasons in pre-defined categories (deterioration in health; medication non-compliance; disengagement), and recorded their outcomes (continued CTO; revocation; discharge to voluntary care).
To allow investigation of whether practice changed over time, either with experience of individual patients or with increased familiarity with the CTO regime, we used two separate methods. First, we examined the reason for and outcome of patients’ first, second, third and fourth recall. Second, we divided the data on patients’ first ever recalls in two time periods: period 1, the 0–12 months of a patient’s participation in the study (0–365 days) and period 2, 13–36 months in the study (366–1095 days).
We report the number and percentage of observed values for binary and categorical variables and, depending on data distribution, mean with standard deviation (SD) or median with interquartile range (IQR) for continuous variables. The descriptive statistics are provided for the whole sample and by time period.
Sample and baseline characteristics
Of the 333 patients in the OCTET Follow-up study, 198 were subject to a CTO during the 36 months and so included in this analysis. Socio-demographic and clinical characteristics of the sample at baseline are displayed in Table 1.
Patients were predominantly male (68 %, 135/198) and the mean age was 39.6 (SD 11.2). They had a mean of 11.9 (SD 1.7) years of education (12 years of education is mandatory in the UK). Over half were White (58 %, 114/198), a quarter were Black (26 %, 51/198) and the remainder were Asian (10 %, 19/198) or of mixed or ‘other’ ethnic origin (7 %, 14/198). The majority of patients suffered from schizophrenia (84 %, 166/198) and the median duration of illness was 12 years (IQR 6, 20). The median level of symptoms, measured by the BPRS was 39 (IQR 33,45) and the median level of functioning as measured by the GAF was 38.5 (IQR 31,48.5), indicating a severely ill group of people. They had a median of 6 (IQR 3, 9) previous hospital admissions. Almost half the sample (42 %, 83/198) had criminal convictions and a third (28 %, 55/198) had been imprisoned.
Rate of recall to hospital
As shown in Table 2, a total of 136 recalls were made, around one for every two CTOs. 40 % of the patients (78/198) were recalled, and 19 % (37/198) were recalled twice. 8 % (15/198) were recalled three times and 3 % patients (6/198) had four to six recalls.
Reasons for and outcomes of recalls
The reasons for and outcomes of all recalls are presented in Table 2, which also presents this information on successive recalls and on first recalls in periods 1 and 2.
Deterioration of health was the recorded reason for half of all recalls (49 %, 67/136). Non-compliance with medication was the reason for 19 % of recalls (26/136) and disengagement in 8 % of cases (11/136). There was no reason recorded for 33 % (26/78) of first recalls.
Deterioration of health applied to 59 % (22/37) of patients experiencing a second recall. For those patients who had their first recall in period 2, this was even higher, with 76 % (25/33) compared with 24 % (11/45) of those recalled in period 1. Non-compliance as a reason remained stable for first recalls over time periods, but there was an increase in non-compliance as the recorded reason for recalling patients for the second or third time. Non-recording decreased with subsequent recalls and also between period 1 and 2 from 53 % (24/45) to 6 % (2/33).
Sixty eight percent of all recalls (92/136) ended in revocation and the patient returning to involuntary hospital treatment. Patients remained on CTO after 31 % of all recalls (42/136). Only 1 % of recalls (2/136) ended in discharge from involuntary treatment. Fewer recalls ended in revocation in period 1 (64 %, 29/45) than in period 2 (73 %, 24/33).
Our sample consisted of severely ill psychosis patients with long histories of hospital admissions. The characteristics of the sample are similar to those reported in national and international studies [4, 5, 19–22].
We found that 40 % of CTO patients were recalled to hospital at least once and 19 % more than once. As we have previously reported, the 198 patients stayed on CTO for one year on average (median 346 days, IQR 180–724) , which means our recall rate of 40 % is broadly comparable with the current national rate of around 43 % over 12 months . This supports our hypothesis that the use of recall to hospital during the OCTET trial was as rigorous as in the current, mature system.
These findings are in line with local studies: A 12 month follow-up of 65 CTOs in North England reported a 40 % recall rate over 12 months  and an audit of 50 CTOs in North Wales reported a 34 % recall rate . These studies reported very different rates of revocation, however, 96 %  and 34 %  respectively. Two 6-month follow-ups (of 104 and 67 patients respectively) saw lower recall rates of 19 %  and 13 % , possibly due to the short time frame. They also reported high revocation rates of 70 %  and 100 % . Nationally, 60 % of recalls ended in revocation during 2014/15 ; our rate of 68 % was slightly higher. There is a paucity of international studies of recall and revocation, but one small study from Victoria, Australia report a 62 % revocation level .
Half of all recalls in our study (49 %) were due to deterioration in the patients’ mental state and a fifth due to medication non-compliance. There was a large increase from period 1 to period 2 in clinical deterioration being recorded as the reason for first recalls. This could signify a change in use. However as the number of recalls with no recorded reason decreased from 53 % to 6 % it is more likely that this reflects improved record keeping. The majority of recalls (68 %) ended in revocation, and there was a slight increase over time. A third of recalls resulted in the patient returning to the community on the CTO. Only two recalls (1 %) resulted in discharge from compulsion. Overall, these findings suggest recalls were used as intended to intervene during relapse.
There has been some concern over clinicians’ understanding of when to use recall [26, 27], but even so, both our study and national figures suggest their use has remained stable over time. Our findings indicate that decisions to recall patients are based on judgements of the patient’s clinical state. This is also how psychiatrists explain their use of CTOs [28, 29], and it is in line with current legal understanding of how recall may be used .
Strength and weaknesses
This descriptive analysis is the first to investigate CTO recalls over a prolonged period of 36 months. A key strength is the degree of data completeness for a group of severely ill patients . They were recruited from 32 different NHS hospitals, covering both urban and rural areas . Information on the reasons for recall was not comprehensively recorded in patient records early in the process. Percentages calculated from small sub-samples should be interpreted with caution. Our sample consists of patients recruited to the OCTET trial, which means it is restricted to those deemed suitable for CTO by clinicians who were in equipoise about the benefit of CTO vs. the control condition.
Our findings support our hypothesis that the use of recall of CTO patients to hospital over the course of the OCTET RCT was in line with mature practice nationally. We have also shown that the use of recall, its reasons and outcomes did not change over time, contrary to what has been suggested as explanations for the absence of positive effects of CTOs in RCTs. There is a lack of published research on the rates, reasons and outcomes of short-term recalls of patients to hospital as part of the CTO process, and this should be a focus for future research, particularly to facilitate international comparisons.
Our findings lend support to the conclusions of existing RCTs by demonstrating that the CTOs in the OCTET trial were implemented in line with routine practice. This strengthens the evidence that CTOs do not achieve their stated aims of improving hospital outcomes and that their use should be urgently reconsidered.
Brief Psychiatric Rating Scale
Community Treatment Order
Global Assessment of Functioning
Mental Health Act
National Health Service
Oxford Community Treatment Order Evaluation Trial
Randomised controlled trial
Rugkåsa J, Molodynski A, Burns T. Introduction. In: Molodynski A, Rugkåsa J, Burns T, editors. Coercion in Community Mental Health Care International Perspectives. Oxford: Oxford University Press; 2016. p. 1–9.
Department of Health. Mental Health Act 2007: The Mental Health Act 2007 (Commencement No. 6 and After-care under Supervision: Savings, Modifications and Transitional Provisions) Order 2008 Available from http://www.legislation.gov.uk/uksi/2008/1210/article/6/made#article-6-j. Accessed 4 Nov 2016.
Swartz M, Swanson JW, Steadman HJ, Robbins PC, Monahan J. New York State Assisted Outpatient Treatment Program Evaluation. Durham NC: Duke University School of Medicine; 2009.
Churchill R, Owen G, Singh S, Hotopf M. International experiences of using Community Treatment Orders. London: Institute of Psychiatry; 2007.
Rugkåsa J. Effectiveness of Community Treatment Orders: The International Evidence. Canad J Pscyhiatr. 2016;61:15–24.
Dawson J. Community Treatment Orders: International Comparisons. Dunedin: Otago University; 2005.
Kisely S, Hall K. An updated meta-analysis of randomized controlled evidence for the effectiveness of community treatment order. Canad J Psychiatr. 2014;59:561–4.
Kisely S, Campbell LA, Scott A, Preston NJ, Xiao J. Randomized and non-randomized evidence for the effect of compulsory community and involuntary out-patient treatment on health service use: systematic review and meta-analysis. Psychol Med. 2007;37:3–14.
Maughan D, Molodynski A, Rugkåsa J, Burns T. A systematic review of the effect of community treatment orders on service use. Soc Psychiatr Psychiatr Epidemiol. 2014;49:651–63.
Burns T, Rugkåsa J, Molodynski A, et al. Community treatment orders for patients with psychosis (OCTET): A randomised controlled trial. Lancet. 2013;381:1627–33.
Rugkåsa J, Vazquez Montes M, Visser C, et al. Community treatment orders: Clinical and social outcomes, and a subgroup analysis from the OCTET RCT. Acta Psychiatri Scand. 2015;131:321–9.
Burns T, Yeeles K, Koshiaris C, et al. Effect of increased compulsion on readmission to hospital or disengagement from community services for patients with psychosis: follow-up of a cohort from the OCTET trial. Lancet Psychiatr. 2015;2:881–90.
Curtis D. OCTET does not demonstrate a lack of effectiveness for community treatment orders. Psychiatr Bulletin. 2014;38:36–9.
Mustafa FA. On the OCTET and supervised community treatment orders. Med Sci Law. 2014;54:116–7.
Swartz MS, Swanson JW. Involuntary outpatient commitment, community treatment orders, and assisted outpatient treatment: what’s in the data? Canad J Psychiatr. 2004;49:585–91.
HSCIC. Inpatients Formally Detained in Hospitals Under the Mental Health Act 1983 and Patients Subject to Supervised Community Treatment, England - 2014–2015, Annual figures: Health and Social Care Information Centre. 2016. Available from www.hscic.gov.uk. Accessed 15 August 2016.
Goldman HH, Skodol AE, Lave TR. Revising axis V for DSM-IV: a review of measures of social functioning. Am J Psychiatry. 1992;149:1148–56.
Lukoff D, Nuechterlein K, Ventura J. Manual for expanded brief psychiatric rating scale (BPRS). Schizophr Bull. 1986;12:594–602.
Evans R, Makala J, Humphreys M, Mohan CRN. Supervised community treatment in Birmingham and Solihull: first 6 months. The Psychiatrist. 2010;34:330–3.
Rawala M, Gupta S. Use of community treatment orders in an inner-London assertive outreach service. Psychiatric Bulletin. 2014;38:13–8.
Smith M, Branton T, Cardno A. Is the bark worse than the bite? Additional conditions used within community treatment orders. Psychiatric Bulletin. 2014;38:9–12.
Monnery D, Belgamwar RB. Use of Supervised Community Treatment in one UK healthcare district. Prog Neurol Psychiatr. 2011;15:8–13.
Lepping P, Malik M. Community treatment orders: current practice and a framework to aid clinicians. The Psychiatrist. 2013;37:54–7.
Malik M, Hussein N. Qualitative outcome for community treatment orders. The Psychiatrist. 2009;33:437–8.
O’Donoghue B, Brophy L, Owens N, et al. Rate of community treatment orders and readmission orders following reconfiguration of community mental health services. Australasian Psychiatr. 2016;24:278–81.
Dawson J. Lawfulness of preventive recall from a community treatment order. Br J Psychiatr. 2015;206:266–7.
Dudleston KE. Misunderstanding recall. Psychiatric Bulletin. 2014;38:139.
DeRidder R, Molodynski A, Manning C, McCusker P, Rugkåsa J. Community treatment orders in the UK 5 years on: a repeat national survey of psychiatrists. The Psychiatrist. 2015;40:119–23.
Canvin K, Rugkåsa J, Sinclair J, Burns T. Patient, psychiatrist and family carer experiences of community treatment orders: Qualitative study. Soc Psychiatry Psychiatr Epidemiol. 2014;49:1873–82.
This article presents independent research funded by the National Institute of Health Research (Program Grant for Applied Research, grant number RP-PG-0606-1006). The views expressed in this publication are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health. We are grateful to the OCTET researchers: Caroline Bennett, Kiki Burns, Krysia Canvin, Alexandra Forrest, Lindsey Johnston, Naomi Lewis, Sarah Masson, Andrew Molodynski, Lucy Murray, Helen Nightingale, Riti Patel, Stephen Puntis, Lisa Russell, Aonghus Ryan, Tanya Smith, Anna Sulman, Lucinda Turnpenny, Amy Mitchell, Maria Vazquez Montes, Francis Vergunst, Claire Visser and Sue Woods-Ganz.
National Institute of Health Research, Program Grant for Applied Research, grant number RP-PG-0606-1006.
Availability of data and material
The datasets collected and analysed in the current study is available from the corresponding author on reasonable request.
TB was PI on the study and it was managed by JR and KY. KY oversaw data management. CK conducted all statistical analyses. All authors contributed to the manuscript and agreed the final version.
JR is an Associate Editor of BMC Psychiatry.
Consent for publication
Ethics approval and consent to participate
Ethical approval was granted by the Staffordshire National Health Service Research Ethics Committee (reference 08/H1204/131). All patients gave their consent in writing prior to enrolment.
About this article
Cite this article
Rugkåsa, J., Yeeles, K., Koshiaris, C. et al. Recall of patients on community treatment orders over three years in the OCTET CTO cohort. BMC Psychiatry 16, 392 (2016). https://doi.org/10.1186/s12888-016-1102-4