Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

A randomized controlled trial of cognitive remediation for a national cohort of forensic patients with schizophrenia or schizoaffective disorder

BMC Psychiatry volume 19, Article number: 27 (2019) Cite this article

Abstract

Background

Evidence is accumulating that Cognitive Remediation Training (CRT) is effective for ameliorating cognitive deficits experienced by patients with schizophrenia and accompanying functional impairment. There has been no randomized controlled trial of CRT using a nationally representative population of forensic patients, despite the significant cognitive deficits frequently present within this group.

Methods

Sixty-five patients with schizophrenia or schizoaffective disorder were enrolled in a single blind randomized controlled trial of CRT versus treatment as usual (TAU); representing 94% of those eligible within a national forensic cohort. The primary outcome measure was the composite score of the MATRICS Consensus Cognitive Battery (MCCB). Secondary outcome measures included neurocognitive and social cognitive domains, symptoms, and ‘real world’ functioning. Patient satisfaction was examined using an exit interview. Participants were reassessed at 8 months follow up. All data were analyzed using an intention to treat design (ITT).

Results

For the primary outcome measure, the MCCB composite score, there were significant differences between those who participated in CRT and those receiving TAU at both end of treatment and 8 months follow up (Cohen’s d = 0.34. Significant improvements were observed in visual and working memory. Mediation analysis found that those who cognitively benefited from CRT had corresponding improved functioning, and more net positive therapeutic moves i.e. moves to units with lower security within the hospital. Ninety-six percent believed their cognitive gains positively affected their daily lives.

Conclusions

CRT may be an acceptable and efficacious intervention for forensic patients with schizophrenia or schizoaffective disorder.

Trial registration

ClinicalTrials.gov Identifier: NCT02360813. Trial registered Feb 4th 2015, last updated May 1st 2015.

Peer Review reports

Background

Only one in seven patients with schizophrenia achieves functional and symptomatic remission sustained over time [1]. One explanation for the rate of recovery is the degree of cognitive impairment associated with the disorder [2]. Approximately 85% of patients with schizophrenia experience cognitive impairment [3]. The magnitude of cognitive impairment is particularly pronounced when measured using composite scores derived from instruments like the MATRICS Consensus Cognitive Battery (MCCB), which aggregate deficits across cognitive domains affected by the illness [2, 4]. The development of the MCCB has also facilitated direct comparisons of groups of patients regarding the extent of their cognitive impairments [5, 6]. Within a sample of 2616 stable patients participating in North American clinical trials the mean score on the MCCB was approximately 2.5 SD below the nonclinical mean [7]. However, there may be groups of patients who are even more impaired. Forensic patients are detained under mental health legislation with histories of social dysfunction including violence and are often excluded from mainstream research on schizophrenia [8]. Amongst a national cohort of forensic patients, we found that the mean MCCB composite was more than 3 standard deviations (SD) below the nonclinical mean i.e. a level traditionally associated with moderate intellectual disability [6]. In line with systematic reviews of cognitive difficulties experienced by non-forensic patients, the cognitive impairments experienced by forensic patients are also associated with difficulties in ‘real-life’ functioning and impaired ability to benefit from psychosocial treatment programs [9,10,11]. Addressing the cognitive impairments experienced by forensic patients is therefore an important objective [8].

Cognitive remediation training (CRT) is a behaviorally based treatment for the cognitive deficits associated with schizophrenia. CRT purports to take advantage of ‘neuroplasticity’ through a process of learning known as ‘drill and practice’, in addition to explicitly teaching meta-cognitive strategies [8]. For community patients, there is evidence that CRT is effective for ameliorating cognitive impairment and the associated functional difficulties. A meta-analysis of randomized controlled trials involving 2104 participants found evidence of an effect size (Cohen’s d) of 0.44 on a composite measure of cognition and an effect size of 0.42 for ‘real world’ functioning [12]. There is also evidence that internet delivered cognitive training may be effective for some patients [13]. In keeping with stage-based theories of illness, forensic patients may require different interventions due to the magnitude of their cognitive impairment and social dysfunction, and because of the forensic context in which treatment is offered [8, 14]. However, a modified form of CRT could be particularly useful for this population. Specifically, within a forensic setting CRT may facilitate patients to assume the role of ‘customer’, in line with both research on the importance of goal consensus for the outcome of psychotherapy, and recovery theory [8, 15]. In contrast to many patients’ limited insight into their symptoms and violence risk [16], patients with schizophrenia often have an awareness of their cognitive impairments and are willing to engage in treatment [17]. Following successful completion of CRT forensic patients may be more likely to engage in programs targeting insight, substance misuse, and violence risk.

To date there has been limited investigation of the effectiveness of CRT for forensic patients [8]. Only two randomised controlled trails have been conducted [18, 19]. One study [18] investigated the feasibility of improving social cognition; the second study [19] mixed forensic patients with general mental health patients who were less cognitively impaired. Both trials reported cognitive gains. Neither of these studies adopted the use of a consensus measure of cognitive deficits such as the MCCB. Consequently, it is difficult to estimate the overall degree of cognitive impairment experienced by the participants. It is therefore unknown whether existing studies generalise to forensic patients who may be more severely impaired [8]. This study seeks to address these gaps by testing the efficacy of CRT using a national representative cohort of forensic patients with schizophrenia or schizoaffective disorder. This study may be regarded as an effectiveness study and a robust evaluation of the transportability of CRT to a ‘real-world’ setting [20, 21]. Our model of CRT is outlined in detail within our study protocol and has been specifically developed for forensic patients [8]. We operationalized CRT using nine treatment principles (Table 1). We chose to adopt flexible principles rather than a tightly manualized format in keeping with the common factors model of psychological therapies [8, 15, 22,23,24] in order to be sensitive to working with forensic patients who have variable levels of ability and unique problems and needs.

Table 1 Principles guiding cognitive remediation intervention
Full size table

Hypotheses

  1. 1)

    That patients allocated to CRT would improve on the primary outcome measure, cognition at the end of treatment, and at 8 months follow up.

  2. 2)

    That patients allocated to CRT would improve on specific neurocognitive and social cognitive domains at end of treatment and 8 months follow up.

  3. 3)

    That patients allocated to CRT would experience improvements in negative and disorganised symptoms.

  4. 4)

    That patients allocated to CRT would experience improvements in real world functioning, net moves to lower level of security, and that patients’ functional improvements or moves to lower levels of security would be mediated by cognitive gains.

  5. 5)

    That patients would experience CRT as a satisfactory and efficacious intervention.

Methods

Aim

This study aims to test the efficacy of cognitive remediation training (CRT) using a nationally representative cohort of forensic patients with schizophrenia or schizoaffective disorder.

Design

This study is a single blind randomized controlled trial of CRT versus treatment as usual (TAU) within a forensic setting.

Setting

The Republic of Ireland’s National Forensic Mental Health Service (NFMHS) provides care and treatment for adults who have a mental disorder and are at risk of harming themselves or others. At the time of the study the NFMHS had 94 secure inpatient beds located on a single campus (The Central Mental Hospital, CMH). The CMH is the only medium and high secure forensic hospital for the Republic of Ireland, a population of 4.7 million [25].

Participants

Criteria for inclusion in the trial were being a forensic inpatient with schizophrenia or schizoaffective disorder. The diagnosis of schizophrenia or schizoaffective disorder was established by a consultant psychiatrist using the Structured Clinical Interview for the Diagnostic and Statistical Manual IV (SCID-I) for axis I. Exclusion criteria were: being cared for on an acute unit, lacking capacity to consent, being too dangerous to participate in treatment (positive symptoms combined with aggressive or self-harming behavior in the last month), or being over 65 years of age. Capacity to consent to participation was assessed by the treating consultant psychiatrist. Inclusion criteria were broad and exclusion criteria were minimal because we were primarily interested in investigating the effectiveness of CRT for a nationally representative cohort of forensic patients with schizophrenia or schizoaffective disorder. Sixty-nine patients met inclusion criteria, of whom 65 (95%) provided consent. The Test of Pre-morbid Functioning UK Edition (TOPF-UK) [26] was used in combination with a developmental and educational history. None had a pre-morbid diagnosis of developmental intellectual disability and mean TOPF was within the normal range. All 65 patients who chose to participate had a history of violence and 46% had a history of homicide. Schizophrenia was the diagnosis for 50 (76%) and schizoaffective disorder for 15 (24%). DUNDRUM-1 mean item score was 2.9 (SD 0.46, range 2.2 to 3.8) in keeping with a medium secure level of need [27]. The DUNDRUM-1 triage security instrument is a static assessment of the need for therapeutic security at the time of admission. Socio-demographic and baseline characteristics of all participants are presented in Table 2. Of note, this sample was particularly cognitively impaired with a mean MCCB t-score of 21, 3 SD lower than a nonclinical population mean. The mean Historical Clinical Risk Management version 2 score [28] (HCR-20) for the total sample was 26, SD 5.7.

Table 2 Sample characteristics at baseline
Full size table

Randomization and treatment allocation

Following enrolment participants were randomized using SPSS V21 to CRT or a waiting list control group receiving treatment as usual (TAU). Figure 1 outlines patient allocation (CONSORT diagram). The research team was blinded to group allocation. The clinicians conducting the therapy sessions were different from the research team carrying out the assessments. All patients participating in the study were trained not to reveal their study condition prior to each assessment. Evaluators were tested for ability to ‘see through’ blinding at the end of the study and follow-up. For clinical reasons patient participation in CRT was shared with their treating psychiatrist.

Fig. 1
figure 1

CONSORT flow diagram

Full size image

After randomization, 29 (88%) of 33 patients in the control group met criteria for schizophrenia and 4 (12%) for schizoaffective disorder, while in the intervention group 21 (66%) met criteria for schizophrenia and 11 (34%) for schizoaffective disorder. However the two groups did not differ significantly for any measure of neurocognitive or social cognitive ability, symptom severity or functional ability (Table 2). A further sensitivity analysis showed that two groups defined by diagnosis (schizophrenia and schizoaffective disorder) did not differ significantly in any of the variables shown in Table 2.

Cognitive remediation training

CRT is designed to improve cognitive problems associated with schizophrenia and schizoaffective disorder [12]. Our cognitive remediation training is a principle driven intervention consisting of nine treatment principles, which are flexibly applied during delivery of the intervention ([8]; Table 1). Principle driven approaches are in keeping with the recommendations of a task force on Principles of Therapeutic Change that Work, sponsored by the American Psychological Association and the North American Society for Psychotherapy Research [22] and are also in keeping with a review of effectiveness and common factors [15]. Psychotherapy principle driven approaches integrate research concerning empirically supported treatments (EST) with research concerning the moderating influence of the therapeutic relationship [15, 22, 24]. Patients allocated to CRT received three individual sessions a week and one group session for approximately 14 weeks, 56 sessions in total. Most therapists were masters level psychologists, two therapists were psychiatrists, and another was an occupational therapist. Our CRT program has been extensively described in the study protocol and consisted of a combination of pen and paper and computerized materials [8]. Fidelity to the CRT principles was routinely assessed by randomly observing CRT therapists and by weekly supervision.

Treatment as usual TAU

Participants in both conditions received TAU from hospital clinicians. At a minimum, this consisted of antipsychotic pharmacotherapy and a therapeutically safe and secure environment appropriate to the individual patient’s needs [11, 25, 27, 29, 30]. The system for delivering ‘treatment as usual’ has been described and shown to be effective in reducing a measure of violence proneness, the HCR-20 [11]. This draws on principles of multi-modal treatment [23] and multi-systemic treatment [24]. Most patients were expected to be involved in a range of therapies. These interventions are organized under seven pillars of care that may be regarded as treatment as usual within a forensic setting: physical health, mental health, drugs and alcohol, problem behaviors, independent living, education-occupation-creativity, and family relationships [27, 30]. Medication was managed by psychiatrists responsible for the patients’ care. Antipsychotic dose CPZeq and anticholinergic burden ACB were measured at each assessment point [8].

Primary outcome measure: change in global cognitive functioning at end of treatment

Cognitive functioning among study participants was assessed at baseline and end of treatment using the MATRICS Consensus Cognitive Battery (MCCB) global composite score [5]. The MATRICS battery covers seven cognitive domains: processing speed; attention/ vigilance; working memory; verbal learning; visual learning; reasoning and problem solving; and social cognition. Like other cognitive remediation trials, we had trouble with the attentional-vigilance domain of the MCCB which is measured using a Continuous Performance Test [31]. The Continuous Performance Test is administered via computer and because of technical difficulties during the trial we excluded this task from our composite score. Consequently, the MCCB composite was created by averaging the scores over all other domains. In keeping with the recommendations in the MCCB manual we used age and gender corrected scores [5].

Secondary outcome measures

Cognitive functioning was also assessed at 8 months follow up using the MCCB composite.

Change in specific cognitive domains

The processing speed, working memory, visual learning, verbal learning, reasoning/ problem solving and social cognitive domains of the MCCB were used as secondary outcome measures.

Social cognitive measures

Changes in social cognition were assed using the Managing Emotions subtests of the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT) contained within the MCCB [32]. This was supplemented with the Reading the Mind in the Eyes Test [33] and the Faux Pas Recognition Test [34].

Psychiatric symptoms

A five-factor model of the Positive and Negative Syndrome Scale (PANSS) [35] consisting of positive, negative, disorganized, excitement and emotional dysfunction was used to evaluate outcomes because CRT is thought to have a specific impact on negative and disorganized symptoms [36].

Real world functioning

The Social and Occupational Functioning Assessment Scale (SOFAS) was used to assess real world functioning [37] (DSM–IV–TR 2000, 4th ed). Higher scores represent superior functioning. The SOFAS was completed by a member of the treating MDT as they were judged best placed to rate the patients functioning.

Positive moves from more secure to less secure units or discharge to community services

Patients at the CMH are stratified according to level of therapeutic security [29, 38]. Patients are moved from more secure wards to less secure wards and eventually to the community as they progress along the recovery pathway. The placements correspond to levels of risk, symptom severity, and the patient’s overall level of functioning. A positive move represented transfer from a higher to a lower level of security. A negative move represented a transfer from a lower to higher level of security. The net number of positive moves that occurred during the trial was summed for each patient over the duration of the study i.e. at 8 months follow up. For the male patients five positive moves separate the acute unit from living in the community. For female patients who reside on a single ward with acute and stable patients one positive move separates them from the community.

Patient satisfaction measure

A service-user developed interview for evaluating patient experience of CRT was used to explore patient satisfaction with the intervention [39]. The interview was administered at the end of treatment by a social worker who was independent of treatment and assessment teams and blind to the intervention and to other assessments. Patients were reassured that all responses were anonymously recorded i.e. that their names were not connected with the feedback they provided.

Statistical analysis

Data analysis was carried out using intention to treat methodology (ITT) [40]. Data from all enrolled participants were used in the analysis regardless of participants’ level of participation in the study using last observation carried forward. The ITT methodology was also utilized at the 8 months follow up to detect whether patients continued to benefit from participating in CRT. All data were analyzed using SPSS V 21. One patient who participated in CRT relapsed at the end of treatment. A decision was made to substitute this patient’s data from baseline for the patient’s end of treatment analysis in keeping with the ITT methodology.

ANOVA and chi-squared tests were used to examine baseline differences between CRT and TAU groups following randomization. At the end of treatment and at 8 months follow up ANCOVAs were carried out in which performance for the outcome of interest i.e. primary and secondary outcomes, was entered as the dependent variable, group (CRT or TAU) as independent variable, and baseline performance on the dependent variable was entered as covariate.

Three mediation analyses were also carried out in line with the study protocol. This was to clarify whether changes in cognition associated with CRT were linked to ‘real world’ functional outcomes including being moved to a unit with a lower level of security i.e. whether changes in cognition were associated with functional change. Mediation analyses were conducted using Hayes’s SPSS PROCESS Macro Model 4 [41]. Bootstrapping (10,000 bootstrap samples) was used with 95% bias corrected confidence intervals applied. In the first mediation analysis, (Table 4 model A) the dichotomous variable CRT vs TAU was the independent variable, real world functioning (SOFAS at end of treatment) was the dependent variable, and neurocognitive functioning (MCCB composite at end of treatment; primary outcome) was the mediating variable. For the second mediation analysis CRT vs TAU was the independent variable, MCCB at 8 months follow up (secondary outcome) was the mediator, and real world functioning (SOFAS at 8 month follow up), was the dependent variable (Table 4, model B). Baseline MCCB and baseline SOFAS were entered as covariates for both analyses. For the third mediation analysis (Table 4 model C) CRT vs TAU was the independent variable, net positive moves over the course of the study i.e. at 8 months follow up, was the dependent variable and neurocognitive functioning (MCCB composite at end of treatment; primary outcome) was the mediation variable to explore the impact that CRT vs TAU had on net positive moves over the course of the study. Because moves occurred throughout the study the MCCB at the end of treatment was entered at the mediator rather than the MCCB at 8 months follow up. Baseline MCCB and gender were entered as covariates for mediation analyses.

Results

At the end of treatment 29 patients remained in the CRT group (90%) and 28 patients remained in the TAU group (85%). At 8 months follow up 25 patients remained in both groups (78 and 76%). Table 3.

Table 3 Outcome measures comparing three time points, baseline, end of treatment period and 8 months follow-up after treatment
Full size table

Primary cognitive outcome measures at end of treatment, and outcome at 8 months follow up

Differences in MCCB composite scores were compared between the CRT and TAU groups at both end of treatment (primary outcome) and 8-month follow up, using ANCOVAs co-varying for baseline MCCB composite performance. A significant difference in favor of CRT was observed on the MCCB composite at end of treatment (Cohen’s d = 0.34). This difference in favor of CRT for the MCCB composite remained significant at 8 months follow up (Cohen’s d = 0.34) (Table 3).

Secondary cognitive outcome measures at end of treatment and 8 months follow up

Significant differences were found between CRT and TAU for the MCCB domains of working memory and visual memory at end of treatment; cognitive improvements were not solely attributable to change in the MCCB composite. At 8 months follow up the difference between CRT and TAU was at trend level for working memory, however, the significant difference for visual learning was maintained. There were no significant differences between the other neurocognitive domains at end of treatment or at 8 months follow up (Table 3).

Social cognitive outcome measures at end of treatment and 8 months follow up

There were no significant differences in the MCCB social cognition task at end of treatment or 8 months follow up. The general cognitive differences that were observed occurred in the absence of any changes in social cognition.

Symptom measures

There was no significant difference in any of the PANSS factors at end of treatment. At 8 months follow up a significant difference was found in favor of the TAU group for the PANSS excitement factor. There were no significant differences between the CRT and TAU groups for any other PANSS factors.

Functioning measures

There were no significant overall differences in the SOFAS scores at end of treatment or 8 months follow up, before mediation analysis.

Positive moves from more secure to less secure units or discharge to community services

There was no overall significant difference before mediation analysis in the number of net positive moves for the CRT group compared to the TAU group at 8 months follow up (Table 3).

Mediation analyses

In model A, neurocognitive function (MCCB composite at end of treatment) mediated the relationship between CRT and ‘real-world’ functioning (SOFAS) at end of treatment (Table 4) when controlling for baseline MCCB and baseline SOFAS. Improved cognition associated with CRT was associated with improved ‘real world’ functioning. For every one-unit increase in MCCB score associated with participating in CRT there was an increase of 1.60 points on the SOFAS. However, this association did not reach statistical significance at 8 months follow up (Model B) (Table 4).

Table 4 Hayes process mediation model 4: regression and mediation coefficients
Full size table

Participating in CRT and the net number of positive therapeutic moves by end of the study i.e. the 8 months follow up period, was also mediated by neurocognitive function as measured by the MCCB at the end of treatment, when controlling for baseline MCCB and gender (Model C). Those patients who participated in CRT and who benefited cognitively made more positive moves to lower levels of security within the hospital. For every one-unit increase in cognition associated with CRT there was an increase of 0.15 for the number of positive moves through the hospital (Table 4).

Patient experience of CRT

Twenty-seven of twenty-eight patients who remained in CRT participated in an anonymous interview evaluating patients’ experience of CRT [38]. One refused to participate, and one was discharged. Nearly all reported subjective improvements in cognition (96%) with most feeling the change was maintained at follow up (85%). Twenty-eight percent believed the change would last, 24% said it would change over time, and 24% said that if they did not practice their skills improvements would deteriorate. Ninety-six percent believed the cognitive gains they experienced had positively affected their daily lives. Subjective improvements were noted in a) social interaction, for example decreased interruptions and improving conversational skills; b) engagement in activities, for example participating in other psychosocial treatments; c) working with clinicians, for example remembering the content of multidisciplinary meetings; d) community functioning. Ninety-six percent said that participating had led to positive feelings about themselves and a sense of achievement or confidence. Patients reported that their experience of the relationship with the CRT therapists was important to them (89%). A minority noted aspects that they disliked. Seven mentioned disliking specific tasks (26%). A small number reported anxiety during tasks (7%), some disliked the repetitive nature of sessions (7%). One (4%) disliked the time commitment and tiredness they experienced after sessions. Most said that participating made them aware of their limitations and provided them with insight into their cognitive difficulties (89%). Finally, 26% reported a sense of loss when CRT ended.

Discussion

The primary aim of this study was to test the effectiveness of CRT within a ‘real world’ population of forensic mental health patients experiencing severe cognitive impairment. The mean score for the forensic patients who enrolled in this study was approximately three standard deviations lower than a nonclinical mean as assessed using the MCCB composite. We were also interested in the acceptability of CRT and patients’ experience of the intervention. Five main outcomes were observed. First, patients who participated in CRT obtained significant improvements in the primary outcome measure, a composite score of the MCCB both at end of treatment and at 8 months follow up. Second, there were significant improvements in specific cognitive domains including working and visual memory, but not social cognition. Third, there were no significant differences in symptoms (PANSS) apart from a difference in favor of the control group in the PANSS excitement factor. Fourth, there were no significant differences between CRT and TAU on routine measures of real world functioning ascertained by the multidisciplinary team (SOFAS) or net positive moves. However, mediation analysis revealed that those who benefited neurocognitively from CRT had related improvement in functioning at the end of treatment (SOFAS); and more net positive therapeutic moves at follow up; there were meaningful functional gains associated with CRT but these gains were predicated on having improved measures of cognitive function. Conversely, those who received CRT but did not have improved cognitive function failed to make ‘real world’ functional gains. Fifth, the patients who were randomly assigned to CRT appeared to value the intervention. Ninety-six percent reported that their subjective neurocognitive ability had improved because of participating in CRT. Importantly 96% percent reported that the cognitive gains they achieved had positively affected their daily lives.

This study contributes to a body of work suggesting that CRT is an effective intervention for patients with schizophrenia or schizoaffective disorder, improving both cognitive and functional outcomes [12, 18, 19]. Although over 40 studies have been conducted, this study overcomes a potential weakness associated with randomized controlled trials namely selection bias [20, 21]. Those who participate in trials may not always be representative of the general population of patients. We believe this study demonstrates ecological validity because of the magnitude of cognitive impairment within the group, and of the 69 patients who met the inclusion criteria in this national service, 65 agreed to take part representing a 94% uptake of those eligible to participate. This study also casts light on the mechanism of action of CRT using mediation analysis. Cognitive improvements associated with CRT were also associated with ‘real world’ functional improvements such as being moving to a unit with a lower level of security. CRT may have the potential to reduce length of stay in secure settings and create savings for services [42].

We controlled for baseline cognition and baseline SOFAS and showed non-the-less that improved cognition associated with CRT was associated with improved real world function (SOFAS). We also showed that when controlling for baseline MCCB and for gender, positive moves were non-the-less associated with improved neurocognition associated with CRT. It may be taken from this that baseline MCCB, SOFAS and gender were not predictors of response to CRT. To clarify the predictors of positive response however would require formal dismantling studies [43, 44].

To date there has only been a small number of RCTs evaluating the effectiveness of psychological interventions within forensic mental health settings [8, 45], and there has been an even smaller number evaluating CRT [18, 19]. This may arise from the misconception that interventions which are efficacious in community settings will be equally effective within forensic settings despite patients being legally detained and potentially more impaired [6, 8]. Forensic services typically have a legally defined dual role requiring care and treatment and in addition public protection [8]. Both roles may not always be aligned and in these cases, it is society and not the patient who is the ‘customer’, which is likely to affect engagement [8]. This study demonstrates that CRT has the potential to improve cognitive functioning for forensic patients in addition to helping patients adopt the role of ‘customer’ [8]. The forensic patients’ response to participating in CRT is particularly striking with the majority of patients regarding the intervention positively. Patients’ positive attitudes towards CRT are likely to be a result of our nine treatment principles, which emphasise the therapeutic relationship, and common factors associated with psychological interventions [15]. CRT may therefore play a useful role by engaging patients to participate in challenging psychological interventions like working on refractory symptoms, violence risk, substance misuse difficulties and pro-social attitudes.

There are limitations and strengths associated with this study. The primary limitation was the numbers of forensic patients available nationally. A robust evaluation of the effectiveness of CRT within forensic services will require a multicentre study involving international collaboration. A strength of this study is that it paves the way for such initiatives. Additional limitations were that medication could not be kept constant during the study, and the absence of an active control group. Additional strengths include having an appropriate dose of therapy [11, 12], the wide range of secondary outcome measures, and the ITT design.

Conclusion

CRT is an effective intervention for patient groups with schizophrenia experiencing severe cognitive impairments. Those who received CRT demonstrated improved global cognitive performance at the end of treatment and follow up. The high uptake of patients willing to participate, and the positive feedback received suggests that patients’ regarded CRT as an acceptable and valued intervention.

Abbreviations

95% CI:

95 percent confidence interval

ACB:

Anticholinergic burden

ANOVA:

Analysis of variance

CMH:

Central Mental Hospital

CONSORT:

Consolidated Standards of Reporting Trials

CPZeq:

Chlorpromazine equivalent

CRT:

Cognitive remediation training

DUNDRUM-1:

Dangerousness, Understanding, Recovery and Urgency Manual (The Dundrum Quartet)

HCR-20:

Historical Clinical Risk Management, Version 2

ITT:

Intention to treat

MCCB:

MATRICS Consensus Cognitive Battery

MSCEIT:

Mayer-Salovey-Caruso Emotional Intelligence Test

NFMHS:

National Forensic Mental Health Service

PANSS:

Positive and negative syndrome scale

SCID:

Structured Clinical Interview for the Diagnostic and Statistical Manual IV (SCID)

SD:

Standard deviation

SOFAS:

The social and occupational functioning assessment scale

SPSS:

Statistical package for the social sciences

TAU:

Treatment as usual

References

  1. Jääskeläinen E, Juola P, Hirvonen N, McGrath JJ, Saha S, Isohanni M, et al. A systematic review and meta-analysis of recovery in schizophrenia. Schizophr Bull. 2013;39:1296–306.

    Article  Google Scholar 

  2. Kahn RS, Keefe RS. Schizophrenia is a cognitive illness: time for a change in focus. JAMA Psychiatry. 2013;70(10):1107–12.

    Article  Google Scholar 

  3. Kontaxaki MI, Kattoulas E, Smyrnis N, Stefanis NC. Cognitive impairments and psychopathological parameters in patients of the schizophrenic spectrum. Psychiatriki. 2014;25(1):27–38.

    PubMed  Google Scholar 

  4. Joyce EM. Cognitive function in schizophrenia: insights from intelligence research. Br J Psychiatry. 2013;203:161–2.

    Article  Google Scholar 

  5. Nuechterlein KH, Green MF. MATRICS Consensus Cognitive Battery Manual. Los Angeles: MATRICS Assessment, Inc; 2006.

    Google Scholar 

  6. O’Reilly K, Donohoe G, Coyle C, O’Sullivan D, Rowe A, et al. Prospective cohort study of the relationship between neuro-cognition, social cognition and violence in forensic patients with schizophrenia and schizoaffective disorder. BMC Psychiatry. 2015;15:155. https://doi.org/10.1186/s12888-015-0548-0.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Georgiades A, Davis VG, Atkins AS, Khan A, Walker TW, et al. Psychometric characteristics of the MATRICS Consensus Cognitive Battery in a large pooled cohort of stable schizophrenia patients. Schizophr Res. 2017;190:172–9.

    Article  Google Scholar 

  8. O'Reilly K, Donohoe G, O'Sullivan D, Coyle C, Mullaney R, et al. Study protocol: a randomised controlled trial of cognitive remediation for a national cohort of forensic mental health patients with schizophrenia or schizoaffective disorder. BMC Psychiatry. 2016;16:5.

    Article  Google Scholar 

  9. Green MF. What are the functional consequences of neurocognitive deficits in schizophrenia? Am J Psychiatry. 1996;153:321–30.

    Article  CAS  Google Scholar 

  10. O’Reilly K, O’Connell P, Donohoe G, Coyle C, O’Sullivan D, et al. Anticholinergic burden in schizophrenia and ability to benefit from psychosocial treatment programmes: a 3-year prospective cohort study. Psychol Med. 2016;46(15):3199–211.

    Article  Google Scholar 

  11. Richter MS, O’Reilly, O’Sullivan D, O’Flynn O, Corvin A, Donohoe G, Coyle C, Davoren M, Byrne O, Nutley T, Nulty A, O’Connell P, Kennedy HG. Effectiveness of psychosocial treatment within a national cohort of forensic mental health patients with schizophrenia over four years. BMC Psychiatry. 2018;18:289. PMID: 30195335. https://doi.org/10.1186/s12888-018-1862-0.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Wykes T, Huddy V, Cellard C, McGurk SR, Czobor P. A meta-analysis of cognitive remediation for schizophrenia: methodology and effect sizes. Am J Psychiatry. 2011;168:472–85.

    Article  Google Scholar 

  13. Donohoe G, Dillon R, Hargreaves A, Mothersill O, Castorina M, et al. Effectiveness of a low support, remotely accessible, cognitive remediation training programme for chronic psychosis: cognitive, functional and cortical outcomes from a single blind randomised controlled trial. Psychol Med. 2018;48(5):751–64.

    Article  CAS  Google Scholar 

  14. McGorry P, Keshavan M, Goldstone S, Amminger P, Allott K, et al. Biomarkers and clinical staging in psychiatry. World Psychiatry. 2014;13(3):211–23.

    Article  Google Scholar 

  15. Wampold BE. How important are the common factors in psychotherapy? And update. World Psychiatry. 2015;14:270–7.

    Article  Google Scholar 

  16. Davoren M, Hennessy S, Conway C, Marrinan S, Gill P, et al. Recovery and concordance in a secure forensic psychiatry hospital – the self-rated DUNDRUM-3 programme completion and DUNDRUM-4 recovery scales. BMC Psychiatry. 2015;15:61.

    Article  Google Scholar 

  17. Gilleen J, Greenwood K, David AS. Domains of awareness in schizophrenia. Schizophr Bull. 2011;37:61–72.

    Article  CAS  Google Scholar 

  18. Taylor R, Cella M, Csipke E, Heriot-Maitland C, Gibbs C, et al. Tackling social cognition in schizophrenia: a randomized feasibility trial. Behav Cogn Psychother. 2016;44:306–17.

    Article  Google Scholar 

  19. Ahmed AO, Hunter KM, Goodrum NM, Batten NJ, Birgenheir D, et al. A randomized study of cognitive remediation for forensic and mental health patients with schizophrenia. J Psychiatr Res. 2015;68:8–18.

    Article  Google Scholar 

  20. Tunis SR, Stryer DB, Clancy CM. Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003;290:1624–32.

    Article  CAS  Google Scholar 

  21. Marchand E, Stice E, Rohde P, Becker CB. Moving from efficacy to effectiveness trials in prevention research. Behav Res Ther. 2011;49:32–41.

    Article  Google Scholar 

  22. Gastonguay LG, Beutler LE. Principles of therapeutic change. New York: Oxford University Press; 2006.

    Google Scholar 

  23. McGuire J. A review of effective interventions for reducing aggression and violence. Philos Trans R Soc B Biol Sci. 2008;363:2577–97. https://doi.org/10.1098/rstb.2008.0035 published online. 8th May 2008.

    Article  Google Scholar 

  24. Henggeler SW, Schoenwald KS, Borduin CM, Cunningham PB. Multisystemic treatment of antisocial behaviour in children and adolescents. New York. London: The Guilford press; 1998.

    Google Scholar 

  25. Flynn G, O’Neill C, McInerney C, Kennedy HG. The DUNDRUM-1 structured professional judgment for triage to appropriate levels of therapeutic security: retrospective-cohort validation study. BMC Psychiatry. 2011;11:43.

    Article  Google Scholar 

  26. Wechsler D. Test of pre-morbid functioning - UK version (TOPF UK). UK: Pearson Corporation; 2011.

    Google Scholar 

  27. Kennedy HG, O’Neill C, Flynn G, Gill P. The DUNDRUM toolkit. Dangerousness understanding, recovery and urgency manual (the DUNDRUM Quartet) V1.0.21 (18/03/10), Four structured professional judgment instruments for admission triage, urgency, treatment completion and recovery assessments. Dublin: Trinity College Dublin; 2010. http://hdl.handle.net/2262/39131

    Google Scholar 

  28. Webster CD, Douglas KS, Eaves D, Hart SD. HCR–20: assessing risk for violence. Burnaby: Mental Health Law and Policy Institute, Simon Fraser University; 1997.

    Google Scholar 

  29. Kennedy HG. Therapeutic uses of security: mapping forensic mental health services by stratified risk. Adv Psychiatr Treat. 2002;8:433–43.

    Article  Google Scholar 

  30. Davoren M, Abidin Z, Naughton L, Gibbons O, Nulty A, et al. Prospective study of factors influencing conditional discharge from a forensic hospital: the DUNDRUM-3 programme completion and DUNDRUM-4 recovery structured professional judgement instruments and risk. BMC Psychiatry. 2013;13:185.

    Article  Google Scholar 

  31. Fisher M, Holland C, Merzenich MM, Vinogradov S. Using neuroplasticity-based auditory training to improve verbal memory in schizophrenia. Am J Psychiatry. 2009;166:805–11.

    Article  Google Scholar 

  32. Mayer JD, Salovey P, Caruso DR, Sitarenios G. Measuring emotional intelligence with the MSCEIT V2.0. Emotion. 2003;3:97–105.

    Article  Google Scholar 

  33. Baron-Cohen S, Wheelwright S, Hill J, Raste Y, Plumb I. The “Reading the mind in the eyes” test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. J Child Psychol Psychiatry. 2001;42:241–51.

    Article  CAS  Google Scholar 

  34. Stone VE, Baron-Cohen S, Knight RT. Frontal lobe contributions to theory of mind. J Cogn Neurosci. 1998;10:640–56.

    Article  CAS  Google Scholar 

  35. Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull. 1987;13:261–76.

    Article  CAS  Google Scholar 

  36. Cella M, Reeder C, Wykes T. It is all in the factors: effects of cognitive remediation on symptom dimensions. Schizophr Res. 2014;156:60–2.

    Article  Google Scholar 

  37. Goldman HH, Skodol AE, Lave TR. Revising axis V for DSM-IV: a review of measures of social functioning. Am J Psychiatry. 1992;149:1148–56.

    Article  CAS  Google Scholar 

  38. Pillay SM, Oliver B, Butler L, Kennedy HG. Risk stratification and the carepathway. Ir J Psychol Med. 2008;25:123–7.

    Article  Google Scholar 

  39. Rose D, Wykes T, Farrier D, Doran AM, Sporle T, et al. What do clients think of cognitive remediation therapy?: a consumer-led investigation of satisfaction and side effects. Am J Psychiatr Rehabil. 2008;11:181–204.

    Article  Google Scholar 

  40. Montori VM, Guyatt GH. Intention-to-treat principle. CMAJ. 2001;165(10):1339–41.

    CAS  PubMed  PubMed Central  Google Scholar 

  41. Hayes AF. Introduction to Mediation, Moderation and conditional process analysis: a regression-based approach. New York: The Guildford Press; 2013.

    Google Scholar 

  42. Reeder C, Harris V, Pickles A, Patel A, Cella M, et al. Does change in cognitive function predict change in costs of care for people with a schizophrenia diagnosis following cognitive remediation therapy? Schizophr Bull. 2014;40:1472–81.

    Article  Google Scholar 

  43. Borkovec T, Castonguay L. What is the scientific meaning of empirically supported therapy? J Consult Clin Psychol. 1998;66:136–42.

    Article  CAS  Google Scholar 

  44. Bell EC, Marcus DK, Goodlad JK. Are the parts as good as the whole? A meta-analysis of component treatment studies. J Consult Clin Psychol. 2013;81:722–36. https://doi.org/10.1037/a0033004.

    Article  PubMed  Google Scholar 

  45. Cullen AE, Clarke AY, Kuipers E, Hodgins S, Dean K, et al. A multisite randomized trial of a cognitive skills program for male mentally disordered offenders: violence and antisocial behavior outcomes. J Consult Clin Psychol. 2012;80:1114–20.

    Article  Google Scholar 

Download references

Acknowledgements

The authors acknowledge the help and assistance of all those who voluntarily participated in the study.

Funding

This work was supported as part of service evaluation by Ireland's Health Service Executive National Forensic Mental Health Service. This research received no specific grant from any funding agency, commercial or not-for-profit sectors.

Availability of data and materials

Because of the sensitive nature of the patients’ situation, data is not publicly available but is available from the first author on reasonable request.

Author information

Authors and Affiliations

  1. Department of Psychiatry Trinity College Dublin, the University of Dublin, Dublin, Ireland

    Ken O’Reilly, Aiden Corvin, Paul O’Connell & Harry G. Kennedy

  2. The Central Mental Hospital, National Forensic Mental Health Service Ireland, Dublin, Ireland

    Ken O’Reilly, Danny O’Sullivan, Ciaran Coyle, Padraic O’Flynn, Muireann O’Donnell, Toni Galligan, Paul O’Connell & Harry G. Kennedy

  3. School of Psychology, National University of Ireland Galway, Galway, Ireland

    Gary Donohoe

Authors
  1. Ken O’Reilly
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gary Donohoe
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Danny O’Sullivan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ciaran Coyle
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Aiden Corvin
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Padraic O’Flynn
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Muireann O’Donnell
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Toni Galligan
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Paul O’Connell
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Harry G. Kennedy
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

KO’R is the lead author and this work forms a substantive part of his PhD thesis. All authors (KO’R, GD, DO’S, CC, AC, PO’F, MO’D, TG, PO’C, HGK) contributed to and have approved the final manuscript. All authors made substantial contributions to conception and design, or acquisition of data, or analysis and interpretation of data; all authors have been involved in drafting the manuscript or revising it critically for important intellectual content; and all authors have given their final approval of the version to be published. Each author has participated sufficiently in the work to take public responsibility for appropriate portions of the content; and each author has agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Corresponding author

Correspondence to Harry G. Kennedy.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the research ethics and effectiveness committee of the NFMHS (AREE/290814, 29th August 2014) and Faculty of Health Sciences Research Ethics committee Trinity College Dublin (8th September 2014). The study complied with the Helsinki Declaration of 1975, revised in 2008. All participants were assessed by their treating consultant psychiatrists as having the capacity to consent to the research study. All participants were supplied with a written letter of information concerning the study. After a period of 7 days, all gave written, informed, and competent consent in keeping with the approval of the research ethics committees.

Consent for publication

This manuscript does not contain any individual person’s data which could be readily identifiable in any form (including any individual details, images or videos) i.e. no individually identifiable material was included. And all patients gave consent to publish the study's findings.

Competing interests

All authors declare that they have no financial involvement (including employment, fees, share ownership) or affiliation with any organization whose financial interests may be affected by material in the manuscript, or which might potentially bias it. HGK is a member of the editorial board of BMC Psychiatry but has had no editorial involvement with the publication of this article.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

O’Reilly, K., Donohoe, G., O’Sullivan, D. et al. A randomized controlled trial of cognitive remediation for a national cohort of forensic patients with schizophrenia or schizoaffective disorder. BMC Psychiatry 19, 27 (2019). https://doi.org/10.1186/s12888-019-2018-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-019-2018-6

Keywords

BMC Psychiatry

ISSN: 1471-244X

Contact us