Skip to main content

A stepped wedge cluster randomised trial of a cognitive remediation intervention in alcohol and other drug (AOD) residential treatment services



Executive functioning impairment is common in substance use disorder and is a major risk factor for poor treatment outcomes, including treatment drop-out and relapse. Cognitive remediation interventions seek to improve executive functioning and offer a promising approach to increase the efficacy of alcohol and other drug (AOD) treatments and improve long-term therapeutic outcomes. This protocol describes a study funded by the NSW Agency for Clinical Innovation that assesses the effectiveness of delivering a six-week group-based intervention of cognitive remediation in an ecologically valid sample of people attending residential AOD treatment services. We primarily aim to investigate whether cognitive remediation will be effective in improving executive functioning and treatment retention rates. We will also evaluate if cognitive remediation may reduce long-term AOD use and rates of health service utilisation, as well as improve personal goal attainment, quality of life, and client satisfaction with treatment. In addition, the study will involve an economic analysis of the cost of delivering cognitive remediation.


The study uses a stepped wedge cluster randomised design, where randomisation will occur at the cluster level. Participants will be recruited from ten residential AOD treatment services provided by the non-government sector. The intervention will be delivered in 12 one-hour group-based sessions over a period of six weeks. All participants who are expected to receive treatment for the duration of the six-week intervention will be asked to participate in the study. The clusters of participants who are randomly assigned to the treatment condition will complete cognitive remediation in addition to treatment as usual (TAU). Primary and secondary outcome assessments will be conducted at pre-cognitive remediation/TAU phase, post-cognitive remediation/TAU phase, two-month follow-up, four-month follow-up, six-month follow-up, and eight-month follow-up intervals.


This study will provide comprehensive data on the effect of delivering a cognitive remediation intervention within residential AOD treatment services. If shown to be effective, cognitive remediation may be incorporated as an adjunctive intervention in current treatment programs.

Trial registration

Australian and New Zealand Clinical Trials Register (ANZCTR): ACTRN12618001190291. Prospectively registered 17th July 2018.

Peer Review reports


Substance use disorder (SUD) is a major global health problem, which has increased notably in the last few years [1]. In Australia, a recent publication reported that one in 200 people in the general population received treatment for substance use in 2014–15, which represents a 6% increase from the previous year [2]. Although SUD is frequently described as a chronic and relapsing condition, favourable long-term outcomes are consistently associated with alcohol and other drug (AOD) treatment completion [3]. However, failure to complete treatment, or “drop-out”, is very common in both inpatient and outpatient treatment services [4, 5].

According to a systematic review of the literature, one of the major risk factors of drop-out from AOD treatment is cognitive impairment [6]. Over the last two decades, neuropsychological research has consistently shown that substance use is associated with a significant degree of impairment in cognitive functioning. Whilst specific aspects of cognitive functioning may predate and influence the initiation of AOD use [7], increased substance use results in a greater degree of impairment [8, 9]. That is, there is a strong association between the quantity and duration of AOD use and the degree of cognitive dysfunction. Cognitive deficits in individuals with SUD may be further exacerbated by the presence of common comorbidities such as traumatic brain injury and psychiatric disorders [10, 11]. Although partial recovery of cognitive impairment may occur after immediate cessation of AOD use, many cognitive deficits fail to recover following withdrawal and abstinence [12, 13]. For example, it has been estimated that approximately 50–80% of recently detoxified individuals with SUD are cognitively impaired when assessed with the Montreal Cognitive Assessment [14,15,16,17].

In individuals with SUD, the most prominent cognitive deficits are seen in executive functioning (EF) [9, 18]. EF abilities (such as working memory, planning and organisational skills, reasoning, and self-regulation) are mediated by the frontal cortex, an area of the brain that is particularly vulnerable to substance-related impairment [19]. Common AOD treatment interventions, including counselling and psychoeducation, are heavily reliant on intact EF abilities in order to identify, promote and achieve successful behavioural change [20, 21]. Thus, EF impairment significantly predicts treatment drop-out and relapse [22,23,24].

Given the clinical relevance of EF deficits in the SUD population, it has been proposed that evidence-based neuropsychological interventions may be particularly useful in improving treatment outcomes and facilitating recovery [25,26,27]. Traditionally, cognitive remediation (CR) interventions have been inspired by two main theoretical perspectives; restoration and compensation [28]. Restorative (or “bottom-up”) approaches attempt to repair impaired cognitive skills directly by using “drill and practice” exercises, and have typically been used in mental health populations [29]. On the other hand, compensatory (or “top-down”) techniques circumvent the deficit with reliance on intact cognitive skills and environmental and prosthetic supports, and are frequently employed in acquired brain injury rehabilitation [30].

In the SUD literature, the majority of existing studies have predominantly used a restorative approach to CR, generally via “drill and practice” computerised tasks [31,32,33,34,35]. Whilst the results of these studies suggest that “drill and practice” leads to improvement on performance-based measures of EF, whether these improvements also lead to demonstrated improvement in everyday functioning is unclear. Performance-based measures of EF show limited ecological validity and do not relate to everyday functioning as well as inventory-based measures [36, 37]. Furthermore, there is intense debate as to the precise mechanisms of “drill and practice” training and the ability of this approach to transfer trained skills into real-world improvements, most notably treatment retention and recovery [25, 38].

In comparison, meta-analytical studies and systematic reviews have shown that compensatory CR approaches have significantly stronger effects not only on global cognition, but also on real-world functioning, than programs that focus only on restorative techniques in other cognitively impaired populations [30, 39, 40]. Whilst only a limited number of studies have examined the effects of compensatory CR in the SUD population, preliminary findings are promising [41,42,43,44]. In a sample of patients with severe alcohol-related brain damage, an intensive rehabilitation program incorporating compensatory CR strategies resulted in an 85% reduction in subsequent acute admissions [44]. Two other studies have assessed the efficacy of Goal Management Training (GMT), a predominantly “top-down” CR technique, combined with mindfulness meditation [41, 43]. Results revealed that GMT not only improved performance on tasks of working memory, impulsivity, and decision making, but also on an ecologically valid measure of goal-directed behaviour, suggesting that the intervention relates to improvements in daily life activities [43]. Another recent study showed that residents in community AOD treatment who received a combination of restorative and compensatory CR showed improvement on a performance-based measure of inhibition, as well as inventory-based measures of EF, impulsivity, self-control and quality of life [42]. Overall, these initial results support the argument that a “top-down” approach to CR may translate to real-world situations because people are better able to transfer skills from the training environment into their daily lives and that teaching such strategies helps patients compensate for the effects of persistent cognitive impairments on functioning [45, 46].

A major limitation in the existing literature is that there have been no randomised trials of compensatory CR in the SUD population. Another difficulty of the literature is that studies often exclude participants with common comorbidities such as traumatic brain injury and psychiatric comorbidities. This ultimately affects the generalisability of results. In addition, many studies have relied on performance-based measures of EF rather than more ecologically valid EF measures, which have been shown to be better predictors of real-world functioning and treatment success [47]. Finally, previous SUD literature has not followed-up the long-term effects of compensatory CR, such as treatment retention and recovery. Given findings of its success in improving functional outcomes in other cognitively impaired groups, we propose that compensatory CR aimed at improving EF is likely to be a beneficial adjunctive intervention to boost AOD treatment efficacy and long-term outcomes.

The current study

The study will aim to examine the effectiveness of adding a CR intervention to TAU on two primary outcomes, being:

  1. 1.

    A self-report inventory of executive functioning; and

  2. 2.

    Treatment retention

The study will also assess the impact of CR in addition to TAU on a number of secondary outcomes:

  1. 1.

    AOD use

  2. 2.

    Health service utilisation

  3. 3.

    Functional goal attainment

  4. 4.

    Quality of life

  5. 5.

    Client satisfaction with treatment

  6. 6.

    Performance-based measures of EF

  7. 7.

    Economic analysis

The study will be conducted as a stepped wedge randomised cluster trial. Stepped wedge designs are increasingly being utilised in the evaluation of interventions within routine treatment services and are recommended where there are limited numbers of clusters [48,49,50]. The study is funded by the NSW Agency for Clinical Innovation.


Study setting

The research program will be conducted at ten residential treatment facilities run by non-governmental organisations in NSW, Australia. All organisations will be abstinence-based however a portion of residents may be prescribed medications or opioid substitution treatments (OST) (e.g. methadone). Limited leave from the residential facilities, close observation by staff and other residents, and random urine tests will ensure abstinence from substances while participants are enrolled in treatment programs. Services that accommodate at least 15 residents and have a minimum project duration of 10 weeks will be invited to participate in the study.

Ethics approval and consent to participate

The Macquarie University Human Research Ethics Committee (HREC (Medical Science)) approved the research to trial (Reference Number 5201800077), which is registered with the Australian New Zealand Clinical Trials Registry (ACTRN12618001190291). All participants will provide written informed consent to a research officer prior to participating in the trial. Consent will be provided separately for access to linked healthcare data through the Centre for Health Record Linkage. Participants will also able to request to withdraw from the study at any point during their participation (data collection, intervention or both).

Study design

The proposed study will be conducted as a prospective stepped wedge cluster randomised trial, where randomisation will occur at the cluster level. The design involves random and sequential crossover of clusters from TAU to CR until all clusters have implemented CR (Table 1). TAU was selected as the comparator condition as the CR intervention must be demonstrated to be effective above and beyond what residential AOD services are currently offering in order to be useful as an adjunct treatment. There will be four six-week phases of either TAU or CR, interspersed by two-week test phases, at each of the ten sites. The order in which the sites receive cognitive remediation will be generated by an independent statistician using computer-generated randomisation. After the initial two-week assessment phase (weeks 1–2), all clusters will undergo 6 weeks of treatment as usual (weeks 3–8). Following the second two-week assessment phase (weeks 9–10) clients at the three sites randomised to start first will receive CR for a period of 6 weeks (weeks 11–16), then this treatment will continue for the life of the study. After the next two-week test phase (weeks 17–18), another 3 sites will be randomly selected to commence CR, and so on until all services have provided CR. Six weeks after the final post-intervention phase (weeks 33–34) an additional two-week testing phase will be allocated for follow-up (weeks 41–42). CONSORT procedures will be followed including using an intention to treat analysis [51].

Table 1 Progression of sites from Treatment as Usual to Cognitive Remediation In Stepped Wedge Design

The estimated number of participants is based on prior research in NSW residential drug and Alcohol Treatment [42]. Discharge refers to the discharge of participants from the residential treatment service (either through completing the program or self-discharge/drop out before the completion of the program). Attrition refers to drop-out from the study or otherwise being non-contactable following discharge from the treatment service.

  1. 1.

    Each site will start with n = 20 participants on average;

  2. 2.

    Within a single cohort, there will be:

    1. a.

      a 40% discharge rate over each six-week TAU/CR phase plus two-week test phase;

    2. b.

      a 65% discharge rate over the following 2 months;

    3. c.

      an 80% discharge rate over the following 4 months;

    4. d.

      a 90% discharge rate over the following 6 months; and

    5. e.

      a 95% discharge rate over the following 8 months;

  3. 3.

    New clients will enter a service at the same rate as other clients leave the service;

  4. 4.

    If a client enters a service during a TAU/CR phase, they will delay their participation in the trial until the next test phase;

  5. 5.

    Some clients will participate in more than one CR phase;

  6. 6.

    All participants who have completed at least one TAU/CR phase will be eligible for follow-up testing, which will occur at test phases 3, 4, 5 and 6.

  7. 7.

    If a participant has had a CR phase they are ineligible for TAU follow-up.

  8. 8.

    If a participant has had more than one CR phase they will still be eligible for CR follow-up

  9. 9.

    Follow-up attrition rates have been estimated to be:

    1. a.

      65% attrition at two-month follow up

    2. b.

      75% attrition at four-month follow up

    3. c.

      85% attrition at six-month follow up

    4. d.

      90% attrition at eight-month follow up


All participants will be attending residential AOD treatment programs in NSW. It is expected that over the course of the study approximately 440 participants will be recruited, with 40% expected to drop out within the first 8 weeks. Based on figures from 2014 to 15, we anticipate that the majority of participants will be seeking treatment for the four most common principal drugs of concern; alcohol, cannabis, amphetamines and heroin [2]. All participants will provide informed written consent and will be aged 18 years or older.

Inclusion and exclusion criteria

All participants attending the residential programs will be invited to participate in the study. Exclusion criteria will be kept to a minimum to ensure that the study can examine the effectiveness of using CR in addition to TAU within a “real world” setting. For example, traumatic brain injury and psychiatric comorbidities are common in individuals with AOD use [10, 11], therefore these factors will not be part of the exclusion criteria in order to make the sample as representative as possible. Similarly, while the residential treatment services will be abstinence-based, a portion of clients will be prescribed OST or other medication, and these participants will also be included.

CR intervention

The manualised Cognitive Remediation in Drug and Alcohol Services (CRiDAS) program will be used for CR, which consists of 12 one-hour group-based sessions that will take place across 6 weeks (two sessions per week). Each session will be dedicated to strategy training, which includes traditional instructional pedagogical approaches, group discussion/reflection and exercises to demonstrate concepts. The CR intervention was developed with a strong emphasis on the training of EF in view of the finding that EF is particularly impaired in an AOD treatment population. Barkley’s evolutionary model of EF [52, 53] was used to structure a large part of the program. The CR program will use a “top-down” approach, including training in compensatory strategy use with a particular emphasis on EF. The modules cover the following topics: brain functioning, attention, memory, visual and verbal working memory, emotion regulation, decision-making and problem-solving. Facilitators will be staff of the residential AOD treatment sites who will undergo training to administer the intervention, and will be chosen by service management on the basis of a minimum skillset relevant to program delivery. Facilitators will be trained immediately prior to introducing the intervention, to prevent staff from utilising CR techniques during phases of TAU.

Intervention facilitators will take attendance for each module of the intervention in order to monitor adherence and dose of the intervention. An independent researcher/clinician will use the CRiDAS treatment fidelity measure (to be developed) to measure fidelity via audio/video recordings of 10% of the sessions at each site.

Assessment measures

See Table 2 for an outline of the timeline of assessment measures. To provide an estimate of the overall level of premorbid intellectual functioning, the Test of Premorbid Functioning [54] will be administered once only, at the first test phase. One primary outcome measure will be an inventory-based measure of EF, as previous findings have shown that inventory-based assessment is more strongly associated with real-world functioning outcomes in SUD than performance-based assessment [36]. Given the high rates of treatment drop-out in residential AOD treatment services, another primary outcome measure will be the length of treatment retention, measured as time in treatment as a proportion of program duration [4]. This is because the program duration may vary across services. Secondary outcome measures will evaluate substance use severity, health service utilisation, individual goal-attainment, quality of life, treatment satisfaction, and performance-based measures of EF. An economic analysis will also be undertaken to evaluate the costs associated with delivering CR versus TAU. Data collection will be facilitated by research assistants blinded to the randomised condition, that is, whether or not a site has implemented cognitive remediation.

Table 2 Timeline of Assessment Measures

Outcome measures will be taken at intake, the test phases (2 week periods pre- and post- TAU/CR phases), and follow-up (2 months, 4 months, 6 months and 8 months following completion of a TAU/CR phase). Attempts to improve follow-up rates in the current study will include using telephone interviews and online questionnaires at follow-up to administer some of the assessments if necessary.

Primary outcome measures

Behavior Rating Inventory of Executive Function – Adult Version (BRIEF-A) [55]

The BRIEF-A is a 75 item self-report questionnaire consisting of nine subscales. The Global Executive Composite (GEC) provides an overall summary score and will be a primary outcome variable.

Time in treatment

Duration of treatment will be provided by the Alcohol and Other Drug Treatment Services National Minimum Data Set [56]. Time spent in treatment (length of stay) as a proportion of program duration will be used as a primary outcome variable.

Secondary outcome measures

Severity of Dependence Scale (SDS) [57]

The SDS is a 5-item questionnaire which assesses for severity of substance use. The outcome variable will be total score.

Health service utilisation

For each participant, the number of visits to health services in the year prior to and following commencement of CR will be compared. These data will be obtained from linking data obtained from this study with four other datasets (NSW Admitted patient data collection, NSW Emergency Department data collection, NSW Cause of death unit record file, NSW mental health ambulatory data collection). Data linkage will be undertaken by the Centre for Health Record Linkage. Variables of interest will include medical centre, hospital and emergency room admissions, access of community-based mental health and AOD services, and mortality rates.

Brief Executive Assessment Tool (BEAT) [58]

The BEAT is a screening tool developed to be sensitive to executive dysfunction, particularly in a SUD population. It includes both performance- and inventory-based items. The outcome variable will be total score.

Stroop task [59]

In this measure of response inhibition, participants must respond as quickly and accurately as possible across three conditions. The first condition presents the words “red”, “blue”, and “green”; the second presents patches of colours; the third presents words printed in incongruent colours and requires the participant to ignore the word and say the colour. The outcome variable will be total score on the third condition.

Five-point test [60]

The Five-Point Test assesses non-verbal figural fluency and consists of producing novel designs under time constraints. The task consists of a sheet of paper with 40 five-dot matrices. Participants are asked to produce as many different figures as possible by connecting the dots within each rectangle within 3 min. The outcome variable will be total designs correctly completed.

Alpha span task [61]

The Alpha Span Task is a measure of working memory in which participants are read a list of words and are asked to say the words back in alphabetical order. The outcome variable will be the total alpha score.

Symbol Digit Modalities Test (SDMT) [62]

The SDMT is a measure of processing speed in which the participant writes a series of numbers corresponding to symbols according to a symbol-number key at the top of the page. The participant is asked to work through a series of symbols as quickly as they can, with the outcome variable the total number of symbols that can be translated in 90 s.

Brief Self-Control Scale (BSCS) [63]

The BSCS is a 13-item self-report questionnaire that assesses individual differences in the construct of self-control. The outcome variable will be total score.

EUROQOL – EQ-5D-5L (EQ-5D) [64]

The EQ-5D is a 5-item measure of the quality of life that can be used to calculate Quality Adjusted Life Years in people with Substance Use Disorders. The outcome measure will be total score.

EUROHIS-QOL 8-item index (EUROHIS-QOL 8) [65]

The EUROHIS-QOL 8 is an 8-item measure of the quality of life across four domains (physical, psychological, environment, and social). Total QOL score will be the outcome variable.

Quality of Life Enjoyment and Satisfaction Questionnaire – Short Form (Q-LES-Q-SF) [66]

The Q-LES-Q-SF is a 16-item self-report questionnaire that assesses quality of life across areas of daily functioning. Total score will be used as the outcome variable.

Patient-Reported Outcomes Measurement Information System Global 10 (PROMIS Global 10) [67]

The PROMIS Global-10 consists of 10 items that assess overall perceived quality of life (QOL), including physical health, mental health, social health, pain and fatigue. Total QOL score will be used as the outcome variable.

Kessler Psychological Distress Scale Plus (K10+) [68]

The K10+ is a 14-item self-report measure that assesses if a person has been affected by anxiety or depression in the last four weeks. The outcome variable will be total score.

Goal Attainment Scaling 2.0 (GAS 2.0) [69]

GAS 2.0 is a revised version of Goal Attainment Scaling (GAS), a technique for quantifying the achievement (or otherwise) of goals set [70]. GAS 2.0 was developed to more objectively determine the level to which a client has attained their goal. Whereas conventional GAS requires the goal setter to estimate the likely outcome (primary goal) in advance, GAS 2.0 derives the primary goal on the basis of: a) current level of functioning and b) maximum realistic level of functioning. It makes use of a goal menu to facilitate and expedite the process of goal setting. The outcome variable will be post-TAU/CR GAS score.

Australian Treatment Outcomes Profile (ATOP) [71]

The ATOP is a structured interview that has been validated to measure treatment outcomes in Australian drug and alcohol populations. It contains two sections. Section one details the quantity and frequency of substance use. Section two details health and wellbeing variables such as days in paid work/study, homelessness, eviction risk, violence and arrest, as well as ratings of psychological health, physical health and overall quality of life. This measure will be administered on intake, with participants asked to respond to questions about their substance use, health and wellbeing for the four-week period leading to their commencement of residential rehabilitation. The measure will also be administered at post-discharge follow up, with participants asked to respond to questions about their substance use, health and wellbeing in the previous four weeks.

The following scale will be administered at the end of each session during the CR phase:

Group Session Rating Scale (GSRS) [72]

The GSRS is a four-item visual analogue scale, designed to be a brief clinical tool to measure group-therapy alliance. The items are presented as bipolar anchors requiring a response on a ten centimetre line. The scale assesses aspects of individual’s perceptions of a group’s therapeutic environment, including; 1) the relationship between the leader and/or group, 2) goals and topics, 3) acceptability of the approach, and 4) overall fit. GSRS scores are obtained by measuring the marks made by the client and summing the lengths to the nearest centimetre on each of the four lines. Scores are summed out of a total possible score of 40. The total score will be the process variable.

Economic analysis

An evaluation of the cost of delivering CR versus TAU will be undertaken.

Intake measures

The following data will be gathered on intake in the form of a structured questionnaire

  1. 1.


  2. 2.

    Highest level of educational attainment;

  3. 3.

    Employment status;

  4. 4.

    Marital status;

  5. 5.

    Number of Children/Dependents

  6. 6.

    Primary substance of misuse;

  7. 7.

    Years of regular use (by substance);

  8. 8.

    Nicotine Use

  9. 9.

    Use of OST

  10. 10.

    Relapses in residential treatment;

  11. 11.

    Relapses in community treatment;

  12. 12.

    Abstinence duration;

  13. 13.

    Country of birth

  14. 14.

    First language

  15. 15.

    Australian/Torres Strait Islander Status

  16. 16.

    Referral source (e.g. self-referred or court-ordered enrolment)

Drug and Alcohol Cognitive Impairment Screening Tool (DACIST) [73]

The DACIST was developed to measure self-reported historical factors that may reasonably contribute to cognitive impairment in a SUD population. Items assess history of head injury, overdose, seizures, hospitalization, foetal drug or alcohol exposure, neurological conditions, learning or behavioural difficulties during schooling and subjective appraisal of cognitive impairment.

Mini International Neuropsychiatric Interview V7.0.2 for DSM-5 (MINI) [74]

The MINI is a structured interview used for assessing indicators of DSM-5 diagnoses.

Statistical methods

Sample size estimation

The primary outcome is the BRIEF-A GEC difference score between pre- and post-TAU/CR phase. Given previous data for a more comprehensive 24 h CR program [42], sample size calculations were based on a difference in BRIEF-A score of 2.25 for the current 12 h program. We used the sample size methodology for stepped wedge designs put forward by Hooper et al. [75]. Assuming a standard deviation of 5.15, obtained from the Marceau data [42], an individually randomised trial would require a total sample of 165 people in order to have 80% power to detect the intervention effect at the 5% significance level. The design effect for cluster randomisation, assuming an intraclass correlation of 0.05 and anticipating 20 people per cluster, is 1.95 and the design effect for repeated assessment, assuming a cluster autocorrelation of 0.5, is 0.534. The required number of clusters for this stepped wedge design is therefore nine. In order to account for a 10% loss of the total sample to follow-up, (e.g participants that are discharged and not replaced by new participants in the research) and to protect against the possibility of a cluster withdrawing from the trial, an additional cluster will be recruited yielding a total of 10.

Analysis plan

Baseline characteristics will be summarised using means and standard deviations or frequencies and percentages as appropriate. The primary outcome variable will be the BRIEF-A GEC score and the effect of the intervention will be estimated using a linear mixed model. The model will include the baseline BRIEF-A GEC as a covariate and a fixed effect for each time period after baseline to account for any secular trends. We will also include random effects for treatment centre, time within centre and individual within centre to account for the clustering, repeated measurements on centre and repeated measures on individuals, respectively. The main predictor of interest will be a pre−/post-intervention variable, which will measure the overall effect of the intervention. The data will be analysed according to the intent-to-treat principle, with sensitivity analysis undertaken to include all participants under an appropriate multiple imputation model for the missing data.

Two analyses are proposed to investigate the impact of CR on treatment retention, being:

  1. 1.

    Direct analysis of retention (proportion of time spent in treatment relative to program duration) across TAU and CR conditions; and

  2. 2.

    Comparison of historical retention data (dating back 2–5 years) with retention rates following the first CR phase for each site. A 10% increase in service retention rate will be the indicator of a clinically meaningful gain.


EF impairment is a significant predictor of treatment drop-out for individuals with SUD. There is an opportunity for AOD treatment providers to address cognitive impairment as part of routine care in order to potentially increase treatment efficacy and reduce treatment drop-out. The present study aims to examine the effectiveness of providing a group-based compensatory CR intervention as an adjunct to residential AOD treatment programs. It is expected that compared to pre-intervention, participants will demonstrate a significant improvement in EF and the duration of treatment retention. In addition, it is anticipated that there will be reductions in harmful AOD use and associated health service utilisation, as well as significant improvements in personal goal achievement, quality of life, and treatment satisfaction. As the current study is the first stepped wedge cluster randomised trial of a compensatory CR intervention within a residential AOD population, the results potentially hold important implications for the way that interventions are delivered across treatment settings.

Strengths and limitations

The current study is a large, multi-site, stepped wedge cluster randomised trial that will be conducted across ten residential treatment programs. The strength of conducting this type of “real world” research is that it is more representative of actual clinical practice and helps to provide some evidence regarding the feasibility of using these types of interventions as part of ongoing routine care. The research design also includes additional attempts to increase the ecological validity of the results by using very inclusive eligibility criteria, including individuals with previous traumatic brain injuries and psychiatric comorbidities.

Another strength of the study is that outcome measures have been carefully chosen to reflect the effects of CR on real-world functioning. Given that performance- and inventory-based EF assessments are minimally correlated and may assess distinct components of EF, the current study aims to provide a comprehensive assessment of EF to account for abilities that are likely to translate to functional outcomes [36, 76]. This study will also be the first to evaluate whether compensatory CR will result in improved treatment retention, which has been shown to be an important predictor of successful long-term outcomes for individuals with SUD [3]. Furthermore, the current study will take person-centred outcomes into account, including measurements of AOD use, health service use, personal goal attainment, quality of life, and treatment satisfaction. Inclusion of person-centred outcomes will measure whether CR is likely to result in contextually meaningful and desired treatment outcomes. Finally, an economic analysis will be undertaken to determine the cost of delivering CR versus TAU in residential treatment settings.

A significant challenge in this trial is the high rate of unplanned drop-out that is common in residential AOD treatment services. According to recent figures, approximately 20% of individuals with SUD unexpectedly cease treatment [2]. To help address this concern, compensatory CR will be delivered in one-hour sessions, twice a week, over a six-week period, which is a reasonable amount of time to expect individuals to dedicate to the intervention. A further challenge will be retaining participants at follow-up. Attempts to improve follow-up rates in the current study include using telephone and online follow-up to administer some outcome assessments, obtaining contact details of significant others to help with locating participants and reinforcing the importance of conducting follow-up to participants.

The current study will be the first stepped wedge cluster randomised trial of a compensatory CR intervention in a residential substance abuse population. The study seeks to address a significant gap in the literature by examining the effectiveness of implementing a six-week CR group program within AOD residential treatment programs. It is expected that following completion of CR, participants will demonstrate significantly improved EF and treatment retention rates, reduced AOD use and health service utilisation rates, as well as achievement of individually-set goals, quality of life, and treatment satisfaction.



Alcohol and other drugs


Australian Treatment Outcomes Profile


Brief executive assessment tool


Behavioural rating inventory of executive function – adult version


Brief Self Control Scale


Cognitive Remediation in Drug and Alcohol Services


Drug and Alcohol Cognitive Impairment Screening Tool


Executive functioning




EUROHIS-QOL 8-item index

GAS 2.0:

Goal attainment scaling 2.0


Goal attainment scaling


Global executive composite


Goal Management Training


Group Session Rating Scale

K10 +:

Kessler Psychological Distress Scale Plus


Mini international neuropsychiatric interview


Opioid Substitution Therapy

PROMIS Global-10:

Patient Reported Outcomes Measurement Information System Global 10


Quality of Life Enjoyment and Satisfaction Questionnaire – Short Form


Quality of Life


Symbol Digit Modalities Test


Severity of Dependence Scale


Substance use disorder


Treatment as usual


  1. United Nations Office on Drugs and Crime. World drug report. New York: United Nations Publications, Sales No. E.16.XI.7; 2016.

    Google Scholar 

  2. Australian Institute of Health and Welfare. Alcohol and other drug treatment services in Australia 2014–15. Drug Treatment Series. Canberra: AIHW: Cat. no. HSE 173; 2016. p. 1–69.

    Google Scholar 

  3. Kleber HD, Weiss RD, Anton RF, George TP, Greenfield SF, Kosten TR, et al. APA: practice guideline for the treatment of patients with substance use disorders: second edition. Am Psychiatr Assoc. 2007(December 2005):1–276.

  4. Deane FP, Wootton DJ, Hsu C-I, Kelly PJ. Predicting dropout in the first 3 months of 12-step residential drug and alcohol treatment in an Australian sample. J Stud Alcohol Drugs. 2012;73(2):216–25.

    Article  PubMed  Google Scholar 

  5. McHugh RK, Murray HW, Hearon BA, Pratt EM, Pollack MH, Safren SA, et al. Predictors of dropout from psychosocial treatment in opioid-dependent outpatients. Am J Addict. 2013;22(1):18–22.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Brorson HH, Ajo Arnevik E, Rand-Hendriksen K, Duckert F. Drop-out from addiction treatment: A systematic review of risk factors. Clinical Psychology Review. Elsevier Ltd; 2013. p. 1010–1024.

  7. Verdejo-García A, Lawrence AJ, Clark L. Impulsivity as a vulnerability marker for substance-use disorders: review of findings from high-risk research, problem gamblers and genetic association studies. Neurosci Biobehav Rev. 2008;32(4):777–810.

    Article  PubMed  Google Scholar 

  8. Beatty WW, Tivis R, Stott HD, Nixon SJ, Parsons OA. Neuropsychological deficits in sober alcoholics: influences of chronicity and recent alcohol consumption. Alcohol Clin Exp Res. 2000;24(2):149–54.

    Article  CAS  PubMed  Google Scholar 

  9. Fernández-Serrano MJ, Pérez-García M, Schmidt Río-Valle J, Verdejo-García A. Neuropsychological consequences of alcohol and drug abuse on different components of executive functions. J Psychopharmacol. 2010;24(9):1317–32.

    Article  PubMed  Google Scholar 

  10. Sacks AL, Fenske CL, Gordon WA, Hibbard MR, Perez K, Brandau S, et al. Co-morbidity of substance abuse and traumatic brain injury. J Dual Diagn. 2009;5(3–4):404–17.

    Article  Google Scholar 

  11. Schuckit MA. Comorbidity between substance use disorders and psychiatric conditions. Addiction. 2006;101(Suppl.1):76–88.

    Article  PubMed  Google Scholar 

  12. Bates ME, Voelbel GT, Buckman JF, Labouvie EW, Barry D. Short-term neuropsychological recovery in clients with substance use disorders. Alcohol Clin Exp Res. 2005;29(3):367–77.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Schulte MHJ, Cousijn J, den Uyl TE, Goudriaan AE, van den Brink W, Veltman DJ, et al. Recovery of neurocognitive functions following sustained abstinence after substance dependence and implications for treatment. Clin Psychol Rev Elsevier Ltd. 2014;34(7):531–50.

    Article  Google Scholar 

  14. Alarcon R, Nalpas B, Pelletier S, Perney P. MoCA as a screening tool of neuropsychological deficits in alcohol-dependent patients. Alcohol Clin Exp Res. 2015;39:1042–8.

    Article  PubMed  Google Scholar 

  15. Copersino ML, Fals-Stewart W, Fitzmaurice G, Schretlen DJ, Sokoloff J, Weiss RD. Rapid cognitive screening of patients with substance use disorders. Exp Clin Psychopharmacol. 2009;17(5):337–44.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Manning V, Verdejo-Garcia A, Lubman DI. Neurocognitive impairment in addiction and opportunities for intervention. Curr Opin Behav Sci Elsevier Ltd. 2017;13:40–5.

    Article  Google Scholar 

  17. Marceau EM, Lunn J, Berry J, Clin Neuro M, Kelly PJ, Solowij N. The Montreal Cognitive Assessment (MoCA) is sensitive to head injury and cognitive impairment in a residential alcohol and other drug therapeutic community. J Subst Abuse Treat. 2016;66(2016):30–6 Elsevier Inc.

    Article  PubMed  Google Scholar 

  18. Lubman DI, Yücel M, Pantelis C. Addiction, a condition of compulsive behaviour? Neuroimaging and neuropsychological evidence of inhibitory dysregulation. Addiction. 2004;99(12):1491–502.

    Article  PubMed  Google Scholar 

  19. Goldstein RZ, Volkow ND. Drug addiction and its underlying neurobiological basis: neuroimaging evidence for the involvement of the frontal cortex. Am J Psychiatry. 2002;159(10):1642–52.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Aharonovich E, Nunes E, Hasin D. Cognitive impairment, retention and abstinence among cocaine abusers in cognitive-behavioral treatment. Drug Alcohol Depend. 2003;71(2):207–11.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Kiluk BD, Nich C, Carroll KM. Relationship of cognitive function and the acquisition of coping skills in computer assisted treatment for substance use disorders. Drug Alcohol Depend. 2011;114(2):169–76.

    PubMed  Google Scholar 

  22. Miller L. Predicting relapse and recovery in alcoholism and addiction: neuropsychology, personality, and cognitive style. J Subst Abus Treat. 1991;8(4):277–91.

    Article  CAS  Google Scholar 

  23. Passetti F, Clark L, Mehta MA, Joyce E, King M. Neuropsychological predictors of clinical outcome in opiate addiction. Drug Alcohol Depend. 2008;94(1–3):82–91.

    Article  CAS  PubMed  Google Scholar 

  24. Teichner G, Horner MD, Harvey RT. Neuropsychological predictors of the attainment of treatment objectives in substance abuse patients. Int J Neurosci. 2001;106(3–4):253–63.

    Article  CAS  PubMed  Google Scholar 

  25. Bates ME, Buckman JF, Nguyen TT. A role for cognitive rehabilitation in increasing the effectiveness of treatment for alcohol use disorders. Neuropsychol Rev. 2013;23(1):27–47.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Sofuoglu M, Devito EE, Waters AJ, Carroll KM. Cognitive enhancement as a treatment for drug addictions. Neuropharmacology. 2013;64:452–63.

    Article  CAS  PubMed  Google Scholar 

  27. Verdejo-Garcia A. Cognitive training for substance use disorders: neuroscientific mechanisms. Neurosci Biobehav Rev. 2016;68:270–81 Elsevier Ltd.

    Article  PubMed  Google Scholar 

  28. Robertson IH, Murre JMJ. Rehabilitation of brain damage : brain plasticity and principles of guided recovery. Psychol Bull. 1999;125(5):544–75.

    Article  CAS  PubMed  Google Scholar 

  29. Paquin K, Wilson AL, Cellard C, Lecomte T, Potvin S. A systematic review on improving cognition in schizophrenia: Which is the more commonly used type of training, practice or strategy learning? BMC Psychiatry. 2014;14(1):1–19.

  30. Cicerone KD, Langenbahn DM, Braden C, Malec JF, Kalmar K, Fraas M, et al. Evidence-based cognitive rehabilitation: Updated review of the literature from 2003 through 2008. Arch Phys Med Rehabil. 2011;92(4):519–30 Elsevier Inc.

    Article  PubMed  Google Scholar 

  31. Bickel WK, Yi R, Landes RD, Hill PF, Baxter C. Remember the future: working memory training decreases delay discounting among stimulant addicts. Biol Psychiatry. 2011;69(3):260–5 Elsevier Science.

    Article  PubMed  Google Scholar 

  32. Houben K, Wiers RW, Jansen A. Getting a grip on drinking behavior: training working memory to reduce alcohol abuse. Psychol Sci. 2011;22(7):968–75.

    Article  PubMed  Google Scholar 

  33. Peterson MA, Patterson B, Pillman BM, Battista MA. Cognitive recovery following alcohol detoxification: a computerised remediation study. Neuropsychol Rehabil. 2002;12(1):63–74.

    Article  Google Scholar 

  34. Rass O, Schacht RL, Buckheit K, Johnson MW, Strain EC, Mintzer MZ. A randomized controlled trial of the effects of working memory training in methadone maintenance patients. Drug Alcohol Depend. 2015;156(2015):38–46 Elsevier Ireland Ltd.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Rupp CI, Kemmler G, Kurz M, Hinterhuber H, Fleischhacker WW. Cognitive remediation therapy during treatment for alcohol dependence. J Stud Alcohol Drugs. 2012;73:625–34.

    Article  PubMed  Google Scholar 

  36. Hagen E, Erga AH, Hagen KP, Nesvåg SM, McKay JR, Lundervold AJ, et al. Assessment of executive function in patients with substance use disorder: a comparison of inventory- and performance-based assessment. J Subst Abus Treat. 2016;66:1–8.

    Article  Google Scholar 

  37. Isquith PK, Roth RM, Gioia G. Contribution of rating scales to the assessment of executive functions. Appl Neuropsychol Child. 2013;2(2):125–32.

    Article  PubMed  Google Scholar 

  38. Owen AM, Hampshire A, Grahn JA, Stenton R, Dajani S, Burns AS, et al. Putting brain training to the test. Nature. 2010;465(7299):775–8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  39. Mcgurk SR, Twamley EW, Sitzer DI, Mchugo GJ, Mueser KT. A meta-analysis of cognitive remediation in schizophrenia. Am J Psychiatry. 2007;164(12):1791–802.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Wykes T, Huddy V, Cellard C, McGurk SR, Czobor P. A meta-analysis of cognitive remediation for schizophrenia: methodology and effect sizes. Am J Psychiatry. 2011;168(5):472–85.

    Article  PubMed  Google Scholar 

  41. Alfonso JP, Caracuel A, Delgado-Pastor LC, Verdejo-García A. Combined goal management training and mindfulness meditation improve executive functions and decision-making performance in abstinent polysubstance abusers. Drug Alcohol Depend. 2011;117(1):78–81.

    Article  PubMed  Google Scholar 

  42. Marceau EM, Berry J, Lunn J, Kelly PJ, Solowij N. Cognitive remediation improves executive functions, self-regulation and quality of life in residents of a substance use disorder therapeutic community. Drug Alcohol Depend. 2017;178(April):150–8 Elsevier.

    Article  PubMed  Google Scholar 

  43. Valls-Serrano C, Caracuel A, Verdejo-Garcia A. Goal management training and mindfulness meditation improve executive functions and transfer to ecological tasks of daily life in polysubstance users enrolled in therapeutic community treatment. Drug Alcohol Depend. 2016;165:9–14 Elsevier Ireland Ltd.

    Article  PubMed  Google Scholar 

  44. Wilson K, Halsey A, Macpherson H, Billington J, Hill S, Johnson G, et al. The psycho-social rehabilitation of patients with alcohol-related brain damage in the community. Alcohol Alcohol. 2012;47(3):304–11.

    Article  PubMed  Google Scholar 

  45. McGurk SR, Mueser KT, Pascaris A. Cognitive training and supported employment for persons with severe mental illness: one-year results from a randomized controlled trial. Schizophr Bull. 2005;31(4):898–909.

    Article  PubMed  Google Scholar 

  46. Wykes T, Reeder C. Cognitive remediation therapy for schizophrenia: theory and practice. London: Routledge; 2005.

    Google Scholar 

  47. Burgess PW, Alderman N, Forbes C, Costello A, Coates LM-A, Dawson DR, et al. The case for the development and use of “ecologically valid” measures of executive function in experimental and clinical neuropsychology. J Int Neuropsychol Soc. 2006;12(02):194–209.

    Article  PubMed  Google Scholar 

  48. Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. BMJ. 2015;350(h391):1–8.

    Google Scholar 

  49. Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28(2):182–91.

    Article  PubMed  Google Scholar 

  50. Mdege ND, Man MS, Taylor CA, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. J Clin Epidemiol. 2011;64(9):936–48 Elsevier Inc.

    Article  PubMed  Google Scholar 

  51. Campbell MK, Piaggio G, Elbourne DR, Altman DG. Consort 2010 statement: extension to cluster randomised trials. BMJ. 2012;345:1–21.

    Google Scholar 

  52. Barkley R. The executive functions and self-regulation; an evolutionary neuropychological perspective. Neuropsychol Rev 2001;11(1):1–29.

  53. Barkley R. Executive functions: what they are, how they work, and why they evolved. New York: Guilford Press; 2012.

    Google Scholar 

  54. Pearson Assessment. Advanced clinical solutions for WAIS-IV and WMS-IV: clinical and interpretive manual. NCS Pearson Inc: San Antonion, Texas; 2009.

    Google Scholar 

  55. Roth IH, Isquith PK, Gioia GA. Behavioral rating inventory of executive function – adult version. Lutz, Florida: Psychological Assessment Resources Inc.; 2005.

    Google Scholar 

  56. Alcohol and Other Drug Treatment Services National Minimum Data Set (AODTS NMDS) [Internet]. [cited 2017 Sep 13]. Available from:

  57. Gossop M, Darke S, Griffiths P, Hando J, Powis B, Hall W, et al. Severity of dependence scale (SDS): psychometric properties of the SDS in English and Australian samples of heroin, cocaine and amphetamine users. Addiction. 1995;90(5):607–14.

    Article  CAS  PubMed  Google Scholar 

  58. Berry J, Sedwell A, Lunn J, Nardo T. Development and psychometric properties of the Brief Executive Assessment Tool. [Preprint]. 2018.

  59. Golden JC. Stroop color and word test. Chicago, IL: Stoelting Co.; 1978.

    Google Scholar 

  60. Goebel S, Fischer R, Ferstl R, Mehdorn HM. Normative data and psychometric properties for qualitative and quantitative scoring criteria of the five-point test. Clin Neuropsychol. 2009;23(4):675–90.

    Article  PubMed  Google Scholar 

  61. Craik FIM, Bialystok E, Gillingham S, Stuss DT. Alpha Span: A Measure of Working Memory. Can J Exp Psychol. 2017;Advance On:

  62. Smith A. Symbol Digit Modalities Test (SDMT) manual (rev. ed.). Los Angeles: Western Psychological Services; 1982.

    Google Scholar 

  63. Tangney JP, Baumeister RF, Boone AL. High self-control predicts good adjustment, less pathology, better grades, and interpersonal success. J Pers. 2004;72(2):271–324.

    Article  PubMed  Google Scholar 

  64. Brazier J, Jones N. Testing the validity of the Euroqol and comparing it with the SF-36 health survey questionnaire. Qual Life Res. 1993;2(86):169–80.

    Article  CAS  PubMed  Google Scholar 

  65. Schmidt S, Mühlan H, Power M. The EUROHIS-QOL 8-item index: psychometric results of a cross-cultural field study. Eur J Pub Health. 2006;16(4):420–8.

    Article  Google Scholar 

  66. Endicott J, Nee J, Harrison W, Blumenthal R. Quality of life enjoyment and satisfaction questionnaire: a new measure. Psychopharmacol Bull. 1993;28:321–6.

    Google Scholar 

  67. Hays RD, Bjorner JB, Revicki DA, Spritzer KL, Cella D. Development of physical and mental health summary scores from the patient-reported outcomes measurement information system (PROMIS) global items. Qual Life Res. 2009;18(7):873–80.

    Article  PubMed  PubMed Central  Google Scholar 

  68. Kessler RC, Barker PR, Colpe LJ, Epstein JF, Gfoerer JC, Hiripi E, et al. The Kessler psychological distress scale (K10). Melbourne: Australian Centre for Posttraumatic Mental Health; 2007.

    Google Scholar 

  69. Berry J. Use of a modified approach to goal attainment scaling for the measurement of self-reported functional outcomes following cognitive remediation within an alcohol and other drug rehabilitation setting. [Preprint]. 2018.

  70. Turner-Stokes L. Goal attainment scaling ( GAS ) in rehabilitation : a practical guide clinical rehabilitation. Clin Rehabil. 2009;23(February):362–270.

    Article  PubMed  Google Scholar 

  71. Ryan A, Holmes J, Hunt V, Dunlop A, Mammen K, Holland R, et al. Validation and implementation of the ATOP in specialist drug and alcohol settings. Drug Alcohol Rev. 2014;33:22–42.

    Article  Google Scholar 

  72. Quirk K, Miller S, Duncan B, Owen J. Group session rating scale: preliminary psychometrics in substance abuse group interventions. Couns Psychother Res. 2013;13(3):194–200.

    Article  Google Scholar 

  73. Berry J, Sedwell A, Lunn J, Wesseling A, Batchelor J. Development and psychometric properties of the Drug and Alcohol Cognitive Impairment Screening Tool. [Preprint]. 2018;

  74. Sheehan DV, Lecrubier Y, Harnett-Sheehan K, Amorim P, Janavs J, Weiller E, et al. The Mini neuropsychiatric interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview. J Clin Psychiatry. 1998;59(Suppl 20):22–33.

    PubMed  Google Scholar 

  75. Hooper R, Bourke L. Cluster randomised trials with repeated cross-sections: alternatives to parallel group designs. BMJ. 2015;250(h2925).

  76. Toplak ME, West RF, Stanovich KE. Practitioner review: do performance-based measures and ratings of executive function assess the same construct? J Child Psychol Psychiatry Allied Discip. 2013;54(2):131–43.

    Article  Google Scholar 

Download references


There are no additional acknowledgements.


This study is funded by the Drug and Alcohol Network of the Agency for Clinical Innovation. This includes funding related to data collection personnel, travel, facilitator training and organisational costs. Authors affiliated with the funding body have a role in the development, management and implementation of the study design, and the development of this manuscript.

Availability of data and materials

Not applicable.

Author information

Authors and Affiliations



By way of author contributions, IJ wrote the first draft based on consultation with JB who developed the initial design of the study. JL, AS1, AS2, PK, PS, MJ, JH, and SR made substantial contributions to conceptual and design refinements. DB provided expert advice and wrote the sections relevant to statistical analysis. TN revised the manuscript critically and updated references, as this has constituted the first major piece of writing towards her doctoral dissertation. All authors were members of the steering committee, who provided agreement on study design and final protocol. All authors have read and approved the manuscript.

Corresponding author

Correspondence to Talia Nardo.

Ethics declarations

Ethics approval and consent to participate

Participants will give informed consent before participating in the above research. The Macquarie University Human Research Ethics Committee (HREC (Medical Science)) approved the research to trial (Reference Number 5201800077), which is registered with the Australian New Zealand Clinical Trials Registry (ACTRN12618001190291). All participants will provide written informed consent to a research officer prior to participating in the trial. Consent will be provided separately for access to linked healthcare data through the Centre for Health Record Linkage. Participants will also able to request to withdraw from the study at any point during their participation (data collection, intervention or both). Any adverse events will be reported to the primary investigator and managed on a case by case basis, with participant wellbeing a priority. Digital copies of personal information such as contact details will be kept separately to study data only on a secure server, for the minimum duration necessary to allow for linking of baseline and follow-up data. Trial results will be communicated to site leads at the residential AOD services that participated in the study. Participants will be provided with the contact details of the researchers in order to request trial results following completion of the study. No individual level feedback will be provided.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Berry, J., Jacomb, I., Lunn, J. et al. A stepped wedge cluster randomised trial of a cognitive remediation intervention in alcohol and other drug (AOD) residential treatment services. BMC Psychiatry 19, 70 (2019).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI:


  • Cognitive rehabilitation
  • Cognitive remediation
  • Alcohol and drug
  • Executive function
  • Treatment retention
  • Goal setting