Skip to main content
Download PDF

Cost and effectiveness of one session treatment (OST) for children and young people with specific phobias compared to multi-session cognitive behavioural therapy (CBT): results from a randomised controlled trial

BMC Psychiatry volume 22, Article number: 547 (2022) Cite this article

Abstract

Background

In the UK, around 93,000 (0.8%) children and young people (CYP) are experiencing specific phobias that have a substantial impact on daily life. The current gold-standard treatment—multi-session cognitive behavioural therapy (CBT) – is effective at reducing specific phobia severity; however, CBT is time consuming, requires specialist CBT therapists, and is often at great cost and limited availability. A briefer variant of CBT called one session treatment (OST) has been found to offer similar clinical effectiveness for specific phobia as multi-session CBT. The aim of this study was to assess the cost-effectiveness of OST compared to multi-session CBT for CYP with specific phobias through the Alleviating Specific Phobias Experienced by Children Trial (ASPECT), a two-arm, pragmatic, multi-centre, non-inferiority randomised controlled trial.

Methods

CYP aged seven to 16 years with specific phobias were recruited nationally via Health and Social Care pathways, remotely randomised to the intervention group (OST) or the control group (CBT-based therapies) and analysed (n = 267). Resource use based on NHS and personal social services perspective and quality adjusted life years (QALYs) measured by EQ-5D-Y were collected at baseline and at six-month follow-up. Incremental cost-effectiveness ratio (ICER) was calculated, and non-parametric bootstrapping was conducted to capture the uncertainty around the ICER estimates. The results were presented on a cost-effectiveness acceptability curve (CEAC). A set of sensitivity analyses (including taking a societal perspective) were conducted to assess the robustness of the primary findings.

Results

After adjustment and bootstrapping, on average CYP in the OST group incurred less costs (incremental cost was -£302.96 (95% CI -£598.86 to -£28.61)) and maintained similar improvement in QALYs (QALYs gained 0.002 (95% CI − 0.004 to 0.008)). The CEAC shows that the probability of OST being cost-effective was over 95% across all the WTP thresholds. Results of a set of sensitivity analyses were consistent with the primary outcomes.

Conclusion

Compared to CBT, OST produced a reduction in costs and maintained similar improvement in QALYs. Results from both primary and sensitivity analyses suggested that OST was highly likely to be cost saving.

Trial registration

ISRCTN19883421 (30/11/2016).

Peer Review reports

Introduction

A specific phobia is a type of anxiety disorder defined as an intense, persistent and uncontrollable fear of an identifiable object, situation or activity (e.g. dogs, heights or injections) that leads to a high degree of anxiety, distress, and avoidance [1]. It is one of the most common mental health difficulties in the UK, with an estimated 93,000 (0.8%) children and young people (CYP) experiencing specific phobias, severe enough to affect their daily activity [2, 3].

Multi-session cognitive behavioural therapy (CBT) is the current gold-standard treatment for specific phobias [4,5,6], typically delivered over six to 12 one-hour sessions. It is effective and has a robust evidence-base [7,8,9]. However, CBT is time consuming, costly and has limited availability. One session treatment (OST), on the other hand, has been found to have potential to offer a brief and clinically effective treatment for specific phobias [10]. This is because OST, a variant of CBT [11], shares many of the same principles as CBT but does not require an extensive treatment period [12, 13]. Instead, OST is delivered over two sessions: an assessment and planning session lasting approximately one hour, and a second exposure session typically lasting up to three hours.

Few large-scale randomised controlled trials (RCTs) have investigated the clinical effects of OST for CYP with specific phobias [14,15,16]. Despite the differences in sample size, all three studies suggested that OST was superior to control groups (including wait-list and educational support) and provided significant clinical improvements after treatment. The recent Alleviating Specific Phobias Experienced by Children Trial (ASPECT) [17] tested the efficacy of OST compared to routinely delivered multi-session CBT and found that OST and multi-session CBT offer similar clinical benefit [18]. However, to our knowledge, no studies have investigated the cost-effectiveness of OST for CYP with specific phobias.

To bridge the evidence gap, the aim of the current study was to assess the cost-effectiveness of OST compared to CBT in CYP with specific phobias using a within-trial cost-utility analysis from the UK NHS and Personal Social Services (PSS) perspective. To take the full economic impact into account, an additional economic evaluation from the societal perspective was also included in the sensitivity analysis. This paper reports the economic evaluation results of OST for CYP with specific phobias conducted as part of the ASPECT [17].

Methods

Trial design and participants

This economic evaluation was embedded in ASPECT, a two-arm, pragmatic, multi-centre, non-inferiority RCT comparing OST with CBT for CYP with specific phobia. Details of the ASPECT methods have been published elsewhere [17]. In summary, CYP aged seven to 16 years with specific phobia were recruited nationally via Health and Social Care pathways (i.e. Child and Adolescent Mental Health Services (CAMHS), voluntary agencies, school-based wellbeing services and a University-based CYP wellbeing service) between June 2017 and January 2020. The presence of a specific phobia was assessed by DSM-5 criteria [1] using the Anxiety Disorder Interview Schedule (ADIS) [19, 20]. CYP were excluded if exposing the person to the phobic stimulus would be unsafe, or where a phobia was deemed by a clinician to be unsuitable for exposure therapy. CYP with co-morbidities (e.g. autism spectrum disorders) were included. Informed consent and baseline measurements were obtained and completed prior to randomisation. These included a face-to-face measure: the Behavioural Avoidance Task (BAT), ADIS, Child Anxiety Impact Scale (CAIS), and Revised Children’s Anxiety and Depression Scale (RCADS), and a health related quality of life (HRQoL) outcome measure: the youth version of the EQ-5D (EQ-5D-Y) and the Child Health Utility-9D (CHU-9D). Following completion of baseline measures, eligible CYP were remotely randomised to either the intervention group (OST) or the control group receiving usual care (CBT-based therapies) (1:1) using an online system through the Trials Unit. All CYP were followed up six-months after randomisation where all outcome measures were repeated. A flowchart of the study can be found in Additional file 1: Appendix 1. In total, 268 CYP (134 per arm) were recruited and randomised. This exceeded the revised sample size target, and is sufficient to detect a standardised non-inferiority margin of 0.4 on the primary outcome measure [21] with a power in excess of 90% based on intraclass correlation coefficient of 0.7, an interim observed dropout rate of 27.3%, the finding that each therapist was treating five CYP and with a design effect of 1.04.

Interventions

CBT uses cognitive and behavioural techniques to support individuals to change unhelpful behaviours and thought patterns arising in feared situations [4, 8, 22, 23]. CBT-based interventions are typically delivered in weekly hour-long sessions comprising the usual practices of building a fear hierarchy, exposure and cognitive restructuring. Each CBT session has a specific agenda and sets homework tasks for the CYP between sessions. There is no recommended number of CBT sessions for specific phobias, however, CYP would usually receive six to 12 sessions.

OST is a variant of CBT but takes a more condensed and intensive approach. OST typically involves a combination of treatment techniques, focusing on graded exposure supplemented by participant modelling, reinforcement, exploration of cognitions in the context of behavioural experiments, and skills training [24]. Unlike CBT, OST comprises two sessions: 1) an initial functional assessment and co-planning session lasting around one hour; and 2) a session (typically lasting around three hours) involving graded exposure to the phobic stimulus until fear subsides, with or without active exploration of fear-related thoughts. The main treatment session is structured around a series of graded exposure tasks, starting from the least threatening situation and increasing in difficulty as the session goes along [12], and has sets homework tasks after the session. OST has been shown to be clinically efficacious in CYP [13, 15, 16, 25].

Outcome measurements

The health economic outcome measurements for this study were quality adjusted life years (QALYs) measured by the EQ-5D-Y (self-complete version) [26] and the CHU-9D [27]. The EQ-5D-Y is a five-item questionnaire for self-completion by CYP aged eight to 15 years. It measures HRQoL on five dimensions (mobility, self-care, doing usual activities, having any pain or discomfort, and feeling worried) with three response levels (no problems, some problems, and extreme problems). The measure has been shown to be a reliable and valid instrument for use in CYP [26]. In this study, 11 CYP were aged seven and were, thus, under the age limit of the self-complete version (eight to 15 years old). These CYP were asked to complete the EQ-5D-Y questionnaire as if they belonged to the CYP group aged eight to 15, for consistency reasons. The CHU-9D, a child-completed, nine-item questionnaire also measures HRQoL for CYP aged seven to 17 years. Participants describe their feelings on nine dimensions (worried, sad, pain, tired, annoyed, schoolwork/homework, sleep, daily routine, and able to join in activities) by selecting one of five response levels (no problems, a few problems, some problems, many problems, and extreme problems) [27]. Both instruments provide utility values that allow the calculation of QALYs for use in cost-utility analysis. However, QALYs measured by EQ-5D-Y using UK adult population tariffs was chosen for primary analysis, as EQ-5D is the preferred instrument for the National Institute for Health and Care Excellence (NICE) [28].

To measure QALYs, individual responses to the EQ-5D-Y and CHU-9D were first converted to utilities based on UK adult population valuation sets [29, 30], which was chosen due to lack of UK CYP population valuation sets. Then, the estimated utilities at baseline and six-month follow-up point were further joined to calculate QALYs using the area under the curve (AUC) approach [31]. The AUC method assumes that there is a linear relationship between utilities at different time points. Hence, to calculate QALYs, the two utility scores for each individual were first averaged and then multiplied by the duration between the two scores (six months). The non-health economic related outcome measurements of the ASPECT trial are described elsewhere [18].

Cost measurements

Both the NHS and personal social service (NHS/PSS) perspective and the societal perspective were considered in this study. Costs from the NHS/PSS perspective included costs related to healthcare and social services, while societal perspective additionally considered costs of education-related services, parental out-of pocket expenses (i.e. private treatments), and parental productivity costs (time off work due to care for CYP’s phobia condition).

Resource use measurement

All resource use incurred during the six-month follow-up was considered in this study, including both intervention and service use required by CYP with specific phobias. Resource use information for training and intervention delivery was collected using tailored questionnaires completed by the study team and therapists, respectively. The resource use required to train professionals in OST was measured by the time spent by the trainer and included travel costs and the cost of materials used for the training. Costs associated with delivering the intervention were also measured by the time spent by professionals as well as other resources used (including second therapist, administration, preparation, supervision and phobic stimulus acquisition, e.g. animal hire). Information related to overheads and facility was not collected, as these costs have been allocated to the staff time and reflected in the unit costs [32].

Service use data were collected using tailored resource utilisation questionnaires completed by parents/guardians. The questionnaires were specifically designed for ASPECT and based upon previous studies focusing on CYP with mental health issues [33,34,35]. Compared to previous resource use questionnaires, more open questions were added. This was in order to collect detailed information about the resource use outside the healthcare and education systems, such as the privately paid mental health services. Overall, service use included parent-reported use of primary and secondary healthcare, as well as social care. Medication usage was also included by collecting information like name and dosage of the medicine, start and end dates, and the administration frequency. Additional therapies and services received in either arm during the six-month follow-up period were recorded, and the duration was assumed to be one hour based on expert opinions. Data on productivity loss due to work absenteeism to care for the CYP were also collected.

Valuation of resource use

All the resource use data were further multiplied by corresponding unit cost to arrive at total costs in each arm using the bottom-up costing approach. Unit costs of health and social service use were obtained from the UK national database of National Cost Collection 2018/19 (previously called Reference Costs) [28] and the Unit Costs of Health and Social Care 2018 produced by the Personal Social Services Research Unit (PSSRU) [32]. Unit costs of medication were based on the Prescription Cost Analysis – England 2018 [36]. Privately paid mental health services were separately estimated via market prices based on the information from the national online psychiatry service [37], while parental productivity costs were valued according to national average wage rates [38].

All costs were expressed in 2018 UK sterling. Discounting of costs and QALYs was not applied, as the study timeframe was less than one year [39].

Missing data

All eligible CYP who had both utility and cost data at baseline and six-month follow-up point are referred to as complete case. The complete cases along with the eligible CYP who had missing utility or cost data but had completed baseline assessments are referred to as base case. The identified missing utility and cost data were imputed using multiple imputation method via chained Eqs. [40]. The imputation were based on the following variables: trial arm, age, gender, study site, phobia type, underlying mental health conditions (autism spectrum disorder and attention deficit hyperactivity disorder), EQ-5D-Y utility scores, cost and ADIS Clinician Severity Rating (CRS) scores at baseline. These variables were available at baseline and were included in order to avoid missing any key information [41].

Statistical and economic analyses

The primary analysis of this study was a within-trial cost-utility analysis that calculated incremental cost-effectiveness ratio (ICER) based on the costs from the NHS/PSS perspective and the QALYs measured by EQ-5D-Y. Costs and utilities for each CYP were measured at baseline and 6-month follow-up point. Hence, the study time horizon for this within-trial cost-utility analysis was six months.

To account for uncertainty, seemingly unrelated regression equations (SURE) that controlled for baseline utility [42], cost, age, gender, study site, phobia type and ADIS CSR score at baseline were bootstrapped 5,000 times. The SURE approach considers the distribution of the dependent variable as well as the correlation between cost and QALY outcomes [31]; while non-parametric bootstrap re-sampling method was suggested by Briggs and colleagues [43], as the distribution of regression residuals was likely to be skewed [44]. The number of 5000 iterations was chosen because it was considered to be sufficient to generate robust estimates of standard errors [43] and is widely used in trial-based cost-effectiveness analyses for mental health illness [45,46,47]. Covariates, such as baseline utility, cost, age, gender, and study site, were chosen based on the related cost utility analysis (CUA) study for mental health illness [47]. Phobia type and ADIS CSR scores were chosen because they reflect the disease type and severity, which are considered by experts to be relevant to costs and QALYs.

The 5,000 bootstrapped results were presented graphically on the cost-effectiveness plane (CE-plane), and the probability of OST being cost-effective against a range of willingness-to-pay (WTP) thresholds was depicted using a cost-effectiveness acceptability curve (CEAC) [48]. A range of possible WTP thresholds has been proposed to assess whether an intervention is worthwhile [49,50,51]. In this study, the national WTP threshold of £20,000-£30,000 per QALY gained suggested by NICE was used to decide whether OST is cost-effective compared to CBT [39].

A set of sensitivity analyses were conducted to test assumptions made in the primary analysis and to assess the robustness of our primary findings. First, a CUA using the complete case was conducted to assess the impact of the missing data. Second, a CUA was performed on those who received interventions within the follow-up period to assess the impact of the COVID-19 pandemic. This was done because some randomised CYP did not manage to receive any intervention sessions during the study period due to the COVID-19 pandemic (n = 67). Third, a CUA was performed from a societal perspective to account for all the economic impact outside the NHS/PSS perspective. Finally, a CUA that used the CHU-9D to estimate QALYs based on the UK population tariff [17] was conducted to assess the impact of outcome measurement instrument.

All analyses were pre-defined in the health economics analysis plan and were performed using Stata version 16 (StataCorp, College Station, Texas, USA).

Ethical approval and informed consent

This study was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme (HTA15/38/04), and the International Standard Randomised Controlled Trial Number is ISRCTN19883421 (30/11/2016) [52]. The ethical approval was obtained from North East – York Ethics Research Committee (17/NE/0012), and the written informed consent was obtained from parents/guardians, alongside consent or assent from their child.

Results

Participants

A total of 340 CYP with specific phobias were recruited. After removing 72 ineligible CYP (Additional file 1: Appendix 1) and one CYP who was not eligible for multiple imputation due to missing baseline utilities, 267 CYP with specific phobia were randomised and available for primary analysis (133 were allocated to OST and 134 to CBT). This sample constitutes the base-case group. Among them, 190 (71.2%) CYP had both EQ-5D-Y and resource use data (from the NHS and PSS perspective) at both data collection time points. This sample constitutes the complete-case group. The details about the missing data and patterns on resource use and utility are reported in Additional file 1: Appendix 2.

The baseline characteristics of both base case and complete case can be found in Table 1. Slightly over one third of the CYP in the OST and the CBT arms were male, and more than 50% of CYP in both arms were of secondary school age (ranging from 11 to 16 years old). Differences in the ADIS CSR scores and EQ-5D-Y utility scores at baseline were small. Overall, the baseline characteristics were balanced across arms and samples.

Table 1 Baseline characteristics by trial arm
Full size table

Costs

On average, the estimated intervention costs per session per CYP for OST and CBT were £184.26 (£62.19 for training and £122.07 for intervention delivery) and £58.59 (£0 for training and £58.59 for intervention delivery), respectively. The training cost of OST contained the costs for both “train the trainers” and “therapist training” sessions. The main cost driver of training costs was trainer-related fees, which accounted for near 90% of total training expenditure of OST. On the other hand, the training cost for CBT was zero, as therapists in both arms are already trained for CBT. In terms of the intervention delivery costs, it contained costs for session preparation, administration, delivery and additional resources (such as second therapists and stimuli). The main drivers of intervention delivery costs were those associated with the therapist time for delivering the intervention, which account for 68% and 79% for the total delivery cost of OST and CBT, respectively (Additional file 1: Appendix 3). On average, the total intervention cost (training and intervention delivery costs) is lower for OST (£209.60, sd: 150.43) than CBT (£287.71, sd: 263.63), as OST requires less sessions than multi-session CBT.

In terms of service costs, a summary of resource use over six months is shown in Additional file 1: Appendix 4, and the total costs broken down by perspective, type of service, trial arm and before and after imputation are presented in Table 2. As shown, the average costs for healthcare services and education services were similar between the two arms. CYP in the OST arm also incurred slightly lower average costs in private expenses and parental productivity losses compared to those in the CBT arm. Overall, CYP in the OST arm incurred lower average costs in both NHS/PSS and societal perspectives. This is observed in both the complete case and the base case. However, it is worth noting that some cost differences were likely to have been driven by the high cost cases. For instance, the slightly higher average cost of CAMH services in the CBT arm was driven by one high cost case (25 psychotherapist appointments between randomisation and six-month follow-up), and the higher average cost of education services in the OST arm was driven by two high cost cases (one had 10 education welfare officer visits and another 11 school nurse visits between baseline and six-month follow-up). These high cost cases were kept in the analysis, as this was real world information and entirely plausible scenarios. Due to the presence of these high-cost cases, the cost differences need to be interpreted with caution.

Table 2 Average costs of service use between baseline and six-month follow-up by trial arm
Full size table

Outcome measurements

Table 3 shows the mean EQ-5D-Y and CHU-9D utility scores across the two trial arms at each time point when missing scores were not imputed (complete case) and when missing scores were imputed (base case). As shown, in both arms, there was a small increase (0.03 to 0.04) in EQ-5D-Y utility scores from baseline to six-month follow-up point. Similar changes were also found in utility scores measured by the CHU-9D. Such small increases were observed in both the base and the complete case. After calculation using the area under the curve approach, it was found that OST produced similar mean QALYs (0.43 QALYs) to CBT, also the QALY estimates measured by EQ-5D-Y and CHU-9D were consistent. Further details for the responses of EQ-5D-Y and CHU-9D in each domain can be found in Additional file 1: Appendix 5 and Additional file 1: Appendix 6, respectively.

Table 3 Average EQ-5D-Y and CHU-9D utility scores by trial arm
Full size table

Primary economic analysis

The outcome of primary analysis was the incremental cost-effectiveness ratio (ICER) based on the base case. After accounting for the uncertainty and adjusting for the imbalanced utility scores and healthcare costs at baseline, on average, CYP with specific phobias receiving OST incurred £302.96 (95% CI £28.61 to £598.86) less costs and gained 0.002 (95% CI -0.004 to 0.008) QALYs than those receiving CBT, which is equivalent to an extra 0.73 days of perfect health. The 5,000 bootstrapped pairs of incremental costs and incremental QALYs from the regression were plotted on the CE plane (Fig. 1A). As shown in Fig. 1A, the bootstrapped estimates were largely below the £20,000 threshold line and sat in the third and fourth quadrant, indicating that OST was highly likely to be cost-saving. This finding was also confirmed by the CEAC (Fig. 1B). As shown in Fig. 1B, the estimated probability of OST being cost-effective is 0.98 when decision makers are willing to pay £20,000 for one QALY gained.

Fig. 1
figure 1

Cost-effectiveness plane and CEAC of primary analysis (outcome measures: QALY measured by EQ-5D-Y, costs from a NHS/PSS perspective)

Full size image

Sensitivity analyses

To account for uncertainty in the cost and QALY estimations, a set of sensitivity analyses were conducted (Additional file 1: Appendix 7). The mean incremental cost and QALY estimates from the complete case were in keeping with the based-case scenario, yielding a negative cost per QALY gained. The same was observed among the CYP who received the intervention (for at least one session) within the trial follow-up period (n = 199, 98 from CBT and 101 from OST). Those who did not receive any intervention sessions (n = 67, 25%) due to the national lockdown caused by the COVID-19 pandemic in 2020 were excluded from the analysis. Other sensitivity analyses using a different cost perspective (societal perspective) and a different instrument (CHU-9D) to measure QALYs were also conducted. In the above mentioned sensitivity analyses, the mean ICER pairs lay below the recommended NICE threshold (£20,000–30,000/QALY gained), and the majority of bootstrapped estimates sat in the fourth quadrant and below the NICE threshold line (Fig. 2), confirming that OST was likely to be cost-saving compared to CBT.

Fig. 2
figure 2

Cost-effectiveness planes of sensitivity analyses

Full size image

Discussion

Principal findings

To our knowledge, this is the first study evaluating the cost-effectiveness of OST for CYP with specific phobias. Compared to multi-session CBT, OST slightly decreased the mean service use costs and increased the mean QALYs. This is evident in both primary and sensitivity analyses, which considered costs derived from various perspectives and QALYs measured by different instruments.

Implications of study

Our study shows a small reduction in average total costs for OST. Compared to baseline, it was observed that both OST and CBT decreased resource use over time, but the cost difference (from either NHS/PSS or societal perspectives) between the two intervention groups at six-month follow-up was small. The cost difference was mainly driven by higher intervention costs, followed by higher CAMHS costs in the CBT group. The higher CAMHS costs were likely to have been caused by one high value (see Sect. 3.2: Costs), whereas the higher average intervention cost of CBT was caused by low unit cost but high frequency sessions involved. Both clinical scenarios were plausible in the real world given small numbers of CYP with specific phobia frequently needing high levels of therapeutic support for periods of time. Such cost difference or cost saving of OST within the six-month timeframe is expected to have been larger if CYP in the CBT arm did not pause or delay their sessions due to the COVID-19 pandemic. Additionally, it is possible that the cost saving of OST could be further increased if the intervention services were provided to a larger scale or implemented widely, as this can lead to lower average training cost (currently accounting for 33.8% of intervention costs, Additional file 1: Appendix 3).

Our study also found that CYP in the OST arm had maintained similar improvement in QALYs. Although both OST and CBT showed improvements in utility over time, the difference in QALYs between the two arms was small. After accounting for uncertainty and controlling for baseline characteristics, the QALY difference remained minimal (0.002 QALYs), indicating the non-inferiority property of OST in HRQoL compared to CBT. This is an encouraging finding, as OST requires one treatment session while multi-session CBT needs six to 12 weeks treatment. The improvement of HRQoL is considered to be larger if the impact of the convenience of OST can be captured. Finally, there is a concern regarding the 11 CYP under the age limit of eight who have completed the EQ-5D-Y self-complete version. Such implementation might create biases in the QALY estimates, although the number of CYP is small. It is encouraging that, based on the sensitivity analysis, the findings seem to have remained unaffected, regardless of the choice of instrument. The consistent estimates from EQ-5D-Y and CHU-9D not only ensured the robustness of our study results but also demonstrated high agreement between the two instruments when measuring HRQoL for CYP with specific phobias.

The results of the health economics analysis demonstrated that OST was highly likely to save costs and maintain similar improvement of QALYs compared to CBT, and the probability of OST being cost-effective was over 95% across all thresholds. On average, OST could potentially save around £300 per person from the NHS/PSS perspective. The saving is relatively small but may be relevant for commissioners when considering resource utilisation and specifically if multiplied by the number of CYP with specific phobias in the UK context. Owing to the fact that there are currently around 93,000 CYP with specific phobia in the UK (2,3) and around 50%—60% of specific phobias are treated with CBT [53, 54], the potential cost saving to the NHS could reach £14–17 million for the CYP population as a whole. One caveat to this is, for a variety of reasons, that only a proportion of CYP with specific phobia may be currently accessing treatments in the UK [55]. This adds further support to considering OST as an alternative treatment for CYP with specific phobias alongside the primary analysis of ASPECT which demonstrated OST to be non-inferior to CBT in terms of clinical effectiveness [18].

Strengths and weakness

This is the first study evaluating the cost-effectiveness of OST for CYP with specific phobias. It is also the first study to compare the cost-effectiveness of OST with that of routinely delivered multi-session CBT. The importance of the study lies in the cost-effectiveness of OST being assessed by an evidence-based evaluation, rather than by simple assumptions based upon its shorter treatment period. The study results are likely to be useful to health policy makers, healthcare providers, CYP with specific phobias and their parent/guardians. Additionally, our study accounts for the costs measured from a range of perspectives and the QALYs measured by different instruments. The sensitivity analyses also explored the impact of missing data and the interruption of COVID-19 by analysing the complete case and the CYP who received at least one intervention sessions, respectively. The approach not only ensures the robustness of our findings but can help policy makers from different sectors to make informed decisions. Furthermore, unlike some studies that excluded certain types of specific phobia such as blood-injection-injury phobias [15], the present study investigated the full range of specific phobia types thereby representing the typical clinical population in CYP mental health services. This pragmatic study design allows the cost-effectiveness results to be applicable to real world clinical settings and represent specific phobias in CYP as a whole.

There were several limitations of the economic evaluation worthy of discussion. First, and most importantly, cases that could not receive allocated interventions or where interventions were interrupted due to the COVID-19 pandemic were a concern. The COVID-19 pandemic began in early 2020 and led to school closures, reduced service availability and difficulties in terms of in-person service delivery. The recruitment to ASPECT remained unaffected, but therapy delivery for some CYP was significantly impacted. In our study, 67 out of 267 CYP did not receive any intervention during the study period. This is partially because COVID-19 stopped many clinical services offering routine face to face treatments and partially because of CYP withdrawal and issues with services (i.e. staff absence and delays in starting treatment). Although this could potentially introduce bias to our results, the sensitivity analyses (see Sect. 3.5) on those who had interventions within the six-month follow-up period showed that our findings were largely similar to our primary analysis, thus supporting the robustness of the results. Second, service use data were collected retrospectively, and there may have been recall accuracy problems. However, this is unlikely to have affected one group more than another. Hence, the study comparison results are likely to remain unchanged. Finally, our cost results can be influenced by the “did not attend” appointments (DNAs), as a DNA of OST has a greater financial impact compared to a DNA of CBT (OST typically lasts around three hours; while CBT is typically an hour long). Although the costs of DNAs can play a role in our study and can be considerable to the NHS [56], our study did not take these costs into account due to data constraints. This decision aligns with the NHS England’s 2020 National Cost Collection guidance for mental health, which advises that missed appointments/ DNAs should not be included in the cost collection [57].

Future research

Our study measured the short-term cost-effectiveness of OST for CYP with specific phobia between baseline and six-months follow-up. Although the long-term cost-effectiveness of OST was outside the scope of the current study, a model-based economic evaluation study would be desirable in future research to allow life-time cost-effectiveness and CYP’s lost productivity during adulthood to be measured.

Conclusion

Both our primary and sensitivity analyses suggest that OST is likely to save cost and maintain similar QALYs compared to multi-session CBT for CYP with specific phobias. The findings will be of interest to policy makers, commissioners, NHS health and social care providers, local authorities, and families with an interest in child and adolescent mental health.

Availability of data and materials

The data used for the current study may be made available by the corresponding author upon reasonable request with justification.

Abbreviations

ADIS:

Anxiety disorder interview schedule

ASPECT:

Alleviating specific phobias experienced by children trial

BAT:

Behavioural avoidance task

CAIS:

Child Anxiety Impact Scale

CAMHS:

Child and adolescent mental health services

CBT:

Cognitive behavioural therapy

CE:

Cost-effectiveness

CEAC:

Cost-effectiveness acceptability curve

CHU-9D:

Child Health Utility-9D

COMIC-RU:

Child oriented mental health interventions centre – resource use

CRS:

Clinician severity rating

CUA:

Cost utility analysis

CYP:

Children and young people

DNA:

Did not attend EQ-5D-Y: youth version of the EQ-5D

HRQoL:

Health related quality of life

ICER:

Incremental cost-effectiveness ratio

NHS/PSS:

NHS and personal social service

OST:

One session treatment

PSS:

Personal social services

PSSRU:

Personal social services research unit

QALY:

Quality adjusted life years

RCADS:

Revised children’s anxiety and depression scale

RCT:

Randomised controlled trial

SURE:

Seemingly unrelated regression equations

WTP:

Willingness-to-pay

References

  1. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM–5) [Internet]. 5th edition. Vol. 51. Washington DC; 2013 [cited 2021 Apr 13]. https://doi.org/10.1176/appi.pn.2016.7a7

  2. NHS Digital. Mental Health of Children and Young People in England, 2017 - Emotional disorders [Internet]. 2018 Nov [cited 2021 Apr 20]. Available from: https://files.digital.nhs.uk/14/0E2282/MHCYP%202017%20Emotional%20Disorders.pdf

  3. Office for National Statistics. Estimates of the population for the UK, England and Wales, Scotland and Northern Ireland, mid-2019 [Internet]. 2020 Jun [cited 2021 Apr 20]. Available from: https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/populationestimates/datasets/populationestimatesforukenglandandwalesscotlandandnorthernireland

  4. Kendall P, Hedtke K. Cognitive-behavioral therapy for anxious children: Therapist manual. 3rd edition. Workbook Pub Inc. 2006.

    Google Scholar 

  5. Kendall PC, Robin JA, Hedtke KA, Suveg C, Flannery-Schroeder E, Gosch E. Considering CBT with anxious youth? Think exposures. Cogn Behav Pract. 2005;12(1):136–48.

    Article  Google Scholar 

  6. NHS. Treatment - Phobias [Internet]. nhs.uk. 2021 [cited 2021 Apr 20]. Available from: https://www.nhs.uk/mental-health/conditions/phobias/treatment/

  7. Butler AC, Chapman JE, Forman EM, Beck AT. The empirical status of cognitive-behavioral therapy: a review of meta-analyses. Clin Psychol Rev. 2006;26(1):17–31.

    Article  Google Scholar 

  8. Davis TE, Ollendick TH. Empirically supported treatments for specific phobia in children: do efficacious treatments address the components of a phobic response? Clin Psychol Sci Pract. 2005;12(2):144–60.

    Article  Google Scholar 

  9. Hofmann SG, Asnaani A, Vonk IJJ, Sawyer AT, Fang A. The efficacy of cognitive behavioral therapy: a review of meta-analyses. Cogn Ther Res. 2012;36(5):427–40.

    Article  Google Scholar 

  10. Ollendick TH, Davis TE. One-session treatment for specific phobias: a review of Öst’s single-session exposure with children and adolescents. Cogn Behav Ther. 2013;42(4):275–83.

    Article  Google Scholar 

  11. Öst LG. One-session treatment for specific phobias. Behav Res Ther. 1989;27(1):1–7.

    Article  Google Scholar 

  12. Zlomke K, Davis TE. One-session treatment of specific phobias: a detailed description and review of treatment efficacy. Behav Ther. 2008;39(3):207–23.

    Article  Google Scholar 

  13. Davis TE, Ollendick TH, Öst L-G. One-session treatment of specific phobias in children: recent developments and a systematic review. Annu Rev Clin Psychol. 2019;7(15):233–56.

    Article  Google Scholar 

  14. Ollendick TH, Halldorsdottir T, Fraire MG, Austin KE, Noguchi RJP, Lewis KM, et al. Specific phobias in youth: a randomized controlled trial comparing one-session treatment to a parent-augmented one-session treatment. Behav Ther. 2015;46(2):141–55.

    Article  Google Scholar 

  15. Ollendick TH, Öst L-G, Reuterskiöld L, Costa N, Cederlund R, Sirbu C, et al. One-session treatment of specific phobias in youth: a randomized clinical trial in the United States and Sweden. J Consult Clin Psychol. 2009;77(3):504–16.

    Article  Google Scholar 

  16. Öst LG, Svensson L, Hellström K, Lindwall R. One-session treatment of specific phobias in youths: a randomized clinical trial. J Consult Clin Psychol. 2001;69(5):814–24.

    Article  Google Scholar 

  17. Wright BD, Cooper C, Scott AJ, Tindall L, Ali S, Bee P, et al. Clinical and cost-effectiveness of one-session treatment (OST) versus multisession cognitive-behavioural therapy (CBT) for specific phobias in children: protocol for a non-inferiority randomised controlled trial. BMJ Open. 2018;8(8):e025031.

    Article  Google Scholar 

  18. Wright B, Tindall L et al. One session treatment (OST) is equivalent to multi-session cognitive behavioural therapy (CBT) in children with specific phobias (ASPECT): Results from a national non-inferiority randomised controlled trial. 2021 (In preparation).

  19. Silverman WK, Albano AM. Anxiety Disorders Interview Schedule (ADIS-IV): Child Interview Schedules. Oxford, New York: Oxford University Press; 1996.

    Google Scholar 

  20. Silverman WK, Saavedra LM, Pina AA. Test-retest reliability of anxiety symptoms and diagnoses with the Anxiety Disorders Interview Schedule for DSM-IV: child and parent versions. J Am Acad Child Adolesc Psychiatry. 2001;40(8):937–44.

    Article  CAS  Google Scholar 

  21. Jones B, Jarvis P, Lewis JA, Ebbutt AF. Trials to assess equivalence: The importance of rigorous methods. British Med J. 1996;313(7048):36-9. 22.

    Article  CAS  Google Scholar 

  22. James AC, James G, Cowdrey FA, Soler A, Choke A. Cognitive behavioural therapy for anxiety disorders in children and adolescents. Cochrane Database Syst Rev [Internet]. 2015 [cited 2021 Apr 14];(2). https://doi.org/10.1002/14651858.CD004690.pub4/full

  23. Davis TE, May A, Whiting SE. Evidence-based treatment of anxiety and phobia in children and adolescents: current status and effects on the emotional response. Clin Psychol Rev. 2011;31(4):592–602.

    Article  Google Scholar 

  24. Davis T III, Ollendick T, Öst LG. Intensive one-session treatment of specific phobias. New York: Springer Science and Business Media, LLC.; 2012.

    Book  Google Scholar 

  25. Ryan SM, Strege MV, Oar EL, Ollendick TH. One session treatment for specific phobias in children: Comorbid anxiety disorders and treatment outcome. J Behav Ther Exp Psychiatry. 2017;54:128–34.

    Article  Google Scholar 

  26. Ravens-Sieberer U, Wille N, Badia X, Bonsel G, Burström K, Cavrini G, et al. Feasibility, reliability, and validity of the EQ-5D-Y: results from a multinational study. Qual Life Res Int J Qual Life Asp Treat Care Rehabil. 2010;19(6):887–97.

    Article  Google Scholar 

  27. Stevens K. Developing a descriptive system for a new preference-based measure of health-related quality of life for children. Qual Life Res Int J Qual Life Asp Treat Care Rehabil. 2009;18(8):1105–13.

    Article  Google Scholar 

  28. NHS Improvement. NHS reference costs 2018/19 [Internet]. Available from: https://www.england.nhs.uk/national-cost-collection/ [accessed on 2021 Mar 28]

  29. Dolan P. Modeling valuations for EuroQol health states. Med Care. 1997;35(11):1095–108.

    Article  CAS  Google Scholar 

  30. Stevens K. Assessing the performance of a new generic measure of health-related quality of life for children and refining it for use in health state valuation. Appl Health Econ Health Policy. 2011;9(3):157–69.

    Article  Google Scholar 

  31. Glick H, Doshi J, Polsky D, Sonnad S. Economic evaluation in clinical trials. second. Oxford: Oxford University Press; 2014.

    Google Scholar 

  32. Curtis L, Burns A. Unit Costs of Health and Social Care 2018 [Internet]. Canterbury: Univerity of Kent; 2018 [cited 2021 Mar 28]. Available from: https://www.pssru.ac.uk/project-pages/unit-costs/unit-costs-2018/

  33. Barrett B, Byford S, Chitsabesan P, Kenning C. Mental health provision for young offenders: service use and cost. Br J Psychiatry J Ment Sci. 2006;188:541–6.

    Article  Google Scholar 

  34. Marshall D, Wright B, Allgar V, Adamson J, Williams C, Ainsworth H, et al. Social Stories in mainstream schools for children with autism spectrum disorder: a feasibility randomised controlled trial. BMJ Open. 2016;6(8): e011748.

    Article  Google Scholar 

  35. Wright B, Marshall D, Moore DC, Ainsworth H, Hackney L, Adamson J, et al. Autism spectrum social stories in schools trial (ASSSIST): study protocol for a feasibility randomised controlled trial analysing clinical and cost-effectiveness of Social Stories in mainstream schools. BMJ Open. 2014;4(7):e005952.

    Article  Google Scholar 

  36. NHS Digital. Prescription Cost Analysis - England 2018 [Internet]. Health and Social Care Information Centre; 2019 [cited 2021 Mar 28]. Available from: https://digital.nhs.uk/data-and-information/publications/statistical/prescription-cost-analysis/2018

  37. The National Online Psychiatry Service. Fees [Internet]. Available from: http://psychiatry-uk.com/fees/ [Assessed January 2021]

  38. Office for National Statistics. Employee earnings in the UK 2018 [Internet]. 2019 [cited 2021 Apr 13]. Available from: https://www.ons.gov.uk/employmentandlabourmarket/peopleinwork/earningsandworkinghours/bulletins/annualsurveyofhoursandearnings/2018

  39. National Institute of Health and Care Excellence (NICE). Guide to the methods of technology appraisal [Internet]. NICE; 2013 [cited 2021 Mar 28]. Available from: https://www.nice.org.uk/process/pmg9/chapter/foreword

  40. Rubin DB. Statistical matching using file concatenation with adjusted weights and multiple imputations. J Bus Econ Stat. 1986;4(1):87–94.

    Google Scholar 

  41. White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med. 2011;30(4):377–99.

    Article  Google Scholar 

  42. Manca A, Hawkins N, Sculpher MJ. Estimating mean QALYs in trial-based cost-effectiveness analysis: the importance of controlling for baseline utility. Health Econ. 2005;14(5):487–96.

    Article  Google Scholar 

  43. Briggs AH, Wonderling DE, Mooney CZ. Pulling cost-effectiveness analysis up by its bootstraps: A non-parametric approach to confidence interval estimation. Health Econ. 1997;6(4):327–40.

    Article  CAS  Google Scholar 

  44. Hoch JS, Briggs AH, Willan AR. Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost-effectiveness analysis. Health Econ. 2002;11(5):415–30.

    Article  Google Scholar 

  45. Tyrer P, Salkovskis P, Tyrer H, Wang D, Crawford MJ, Dupont S, et al. Cognitive-behaviour therapy for health anxiety in medical patients (CHAMP): a randomised controlled trial with outcomes to 5 years. Health Technol Assess 2017;21(50). https://doi.org/10.3310/hta21500

  46. Hedman E, Andersson E, Ljótsson B, Axelsson E, Lekander M. Cost effectiveness of internetbased cognitive behaviour therapy and behavioural stress management for severe health anxiety. BMJ Open. 2016;6:e009327.

    Article  Google Scholar 

  47. Wang H, Wright BD, Bursnall M, et alCost-utility analysis of LEGO based therapy for school children and young people with autism spectrum disorder: results from a randomised controlled trial. BMJ Open 2022;12:e056347. https://doi.org/10.1136/bmjopen-2021-056347

  48. Fenwick E, O’Brien BJ, Briggs A. Cost-effectiveness acceptability curves–facts, fallacies and frequently asked questions. Health Econ. 2004;13(5):405–15.

    Article  Google Scholar 

  49. Claxton K, Martin S, Soares M, Rice N, Spackman E, Hinde S, Devlin N, Smith PC, Sculpher M. Methods for the estimation of the National Institute for health and care excellence cost-effectiveness threshold. Health Technol Assess. 2015;19(14):1–503.

    Article  Google Scholar 

  50. Vallejo-Torres L, García-Lorenzo B, Castilla I, Valcárcel-Nazco C, García-Pérez L, Linertová R, Polentinos-Castro E, Serrano-Aguilar P. On the estimation of the cost-effectiveness threshold: why, what, how? Value in Health. 2016;19(5):558–66.

    Article  Google Scholar 

  51. Devlin N, Parkin D. Does NICE have a cost-effectiveness threshold and what other factors influence its decisions? A binary choice analysis. Health Econ. 2004;13(5):437-52. https://doi.org/10.1002/hec.864.

  52. ISRCTN - ISRCTN19883421: Alleviating specific phobias experienced by children trial (ASPECT) [Internet]. [cited 2021 Apr 13]. Available from: https://www.isrctn.com/ISRCTN19883421

  53. Seligman LD, Ollendick TH. Cognitive Behavioral Therapy for Anxiety Disorders in Youth. Child Adolesc Psychiatr Clin N Am. 2011;20(2):217–38.

    Article  Google Scholar 

  54. Silverman WK, Pina AA, Viswesvaran C. Evidence-based psychosocial treatments for phobic and anxiety disorders in children and adolescents. J Clin Child Adolesc Psychol Off J Soc Clin Child Adolesc Psychol Am Psychol Assoc Div 53. 2008;37(1):105–30.

    Google Scholar 

  55. Tindall L, Hayward E, Wright B et al. Variability in care pathways for children with specific phobia – the requirement for more clarity. 2021 (In preparation).

  56. NHS Digital. Appointments in General Practice, October 2018 [Internet]. 2018 Dec [cited 2021 Apr 13]. Available from: https://digital.nhs.uk/data-and-information/publications/statistical/appointments-in-general-practice/oct-2018

  57. NHS England. Approved Costing Guidance 2020 for mental health. [Internet]. 2020 [cited 2021 Dec 2]. Available from: https://www.england.nhs.uk/approved-costing-guidance-2020/#approved-costing-guidance-collections

Download references

Acknowledgements

We thank Amy Barr, Hannah Edwards, Jennifer Lomas and Joseph Horne for assisting with data collection and Chris Turtle and Tim Chater for supporting data management. We offer special thanks to the members of our two oversight committees: Professor Cathy Creswell, Professor Ian Norman, Dr Claire Henderson, Professor Dankmar Böhning Olivia Lawler, Professor Chris Williams, Professor Nigel Stallard and Dr Robbie Duschinsky. We also thank Dr. Jon Wilson from the Norfolk and Suffolk NHS Foundation Trust, and Professor Karina Lovell and Professor Penny Bee from the University of Manchester who were members of the trial management group.

We would also like to extend our thanks to all of the children and young people, parents/guardians and clinicians who were involved in ASPECT. Furthermore, we thank those who allowed the successful delivery of the trial through providing phobic stimuli for assessments and therapy sessions.

Funding

This project was funded by the NIHR Health Technology Assessment Programme (15/38/04). The views and opinions expressed therein are those of the authors and do not necessarily reflect those of the NHS, the NIHR or the Department of Health.

Author information

Authors and Affiliations

  1. Department of Health Sciences, Seebohm Rowntree Building, University of York, Heslington, YO10 5DD, York, UK

    Han-I. Wang, Barry Wright, Lina Gega, Dean McMillan, Simon Gilbody & Steve Parrott

  2. Leeds and York Partnership NHS Foundation Trust, Leeds, UK

    Barry Wright, Lucy Tindall & Emily Hayward

  3. University of Sheffield, Sheffield, UK

    Cindy Cooper, Katie Biggs, Ellen Lee & Kiera Solaiman

  4. Newcastle University, Newcastle upon Tyne, UK

    M. Dawn Teare

  5. Hull York Medical School, York, UK

    Lina Gega, Dean McMillan & Simon Gilbody

  6. Keele University, Keele, UK

    Alexander J. Scott

  7. Louisiana State University, Baton Rouge, USA

    Thompson Davis

  8. The University of Alabama, Tuscaloosa, USA

    Thompson Davis

Authors
  1. Han-I. Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Barry Wright
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lucy Tindall
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Cindy Cooper
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Katie Biggs
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ellen Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. M. Dawn Teare
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Lina Gega
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Alexander J. Scott
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Emily Hayward
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Kiera Solaiman
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Thompson Davis
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Dean McMillan
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Simon Gilbody
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Steve Parrott
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

HW and SP were the trial health economists and analysed the data with HW taking the lead in writing the manuscript. BW, CC, KB, TD, LG, DM and SG conceived the study idea and designed the project, TD, BW and LG also provided intervention training to clinicians. EL and DT were the study statisticians and involved in the design, analysis and interpretation of the data. LT and AS managed the trial, EH and KS were involved in the acquisition of the data. All authors contributed to data interpretation and have read and approved the final manuscript.

Corresponding author

Correspondence to Han-I. Wang.

Ethics declarations

Ethics approval and consent to participate

The ethical approval was obtained from North East – York Ethics Research Committee (17/NE/0012). The study was conducted according to the principles of the Declaration of Helsinki (version 2013) and in accordance with other relevant guidelines and regulations. The written informed consent was obtained from parents/guardians, alongside consent or assent from their child. All analyses methods were in line with National Institute for Health and Care Excellence (NICE) guidelines for assessing cost effectiveness, and the results were reported following the Consolidated Health Economic Evaluation Reporting Standards (CHEERS).

Consent for publication

Not applicable.

Competing interests

Thompson Davis receives royalties from the sale of Intensive One-Session Treatment of specific phobias and fees for training workshops and speaking engagements. The rest of the authors declared no conflicts of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, HI., Wright, B., Tindall, L. et al. Cost and effectiveness of one session treatment (OST) for children and young people with specific phobias compared to multi-session cognitive behavioural therapy (CBT): results from a randomised controlled trial. BMC Psychiatry 22, 547 (2022). https://doi.org/10.1186/s12888-022-04192-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-022-04192-8

Keywords

BMC Psychiatry

ISSN: 1471-244X

Contact us