Skip to main content
  • Study Protocol
  • Open access
  • Published:

A randomized controlled trial of a self-guided mobile app targeting repetitive negative thought to prevent depression in university students: study protocol of the Nurture-U Reducing Worry prevention trial

Abstract

Background

Tackling poor mental health in university students has been identified as a priority in higher education. However, there are few evidence-based prevention initiatives designed for students. Repetitive Negative Thought (RNT, e.g. worry, rumination) is elevated in university students and is a well-established vulnerability factor for anxiety and depression. Furthermore, there are now evidence-based cognitive-behavioural interventions to tackle RNT. A mobile self-help cognitive-behavioural app targeting RNT, adapted for students may therefore be an effective, scalable, and acceptable way to improve prevention in students.

Methods

An online single blind, two-arm parallel-group Randomised Controlled Trial (RCT) to examine the incidence of major depression and symptoms of anxiety and depression across 12 months in university students aged over 16 who screen into the study with self-reported high levels of worry and/or rumination and no current diagnosis of major depression. Eligible participants will be randomised to the active intervention arm (usual practice plus using a self-guided mobile app targeting RNT) or to the control arm (usual practice). In total, 648 participants aged over 16, with no current major depression, bipolar disorder or psychosis will be recruited from UK universities. Assessments will take place at baseline (pre-randomisation), 3 months and 12 months post- randomisation. Primary endpoint and outcome is incidence of major depression as determined by self-reported diagnostic criteria at 12-month follow-up. Depressive symptoms, anxiety, well-being, health-related quality of life, functioning and academic outcomes are secondary outcomes. Compliance, adverse events, and potentially mediating variables will be carefully monitored.

Discussion

The trial aims to provide a better understanding of the causal role of tackling RNT (worry, rumination) using a self-help mobile app with respect to preventing depression in university students. This knowledge will be used to develop and disseminate innovative evidence-based, feasible, and effective mobile-health public health strategies for preventing common mental health problems.

Trial registration

https://www.isrctn.com/ISRCTN86795807 Date of registration: 27 October 2022

Peer Review reports

Background

University provides an opportunity for young people to develop independence, positive self-identity, good coping skills and social-emotional resources to stand them in good stead through their lives, as they face challenges like leaving home, meeting academic standards, making new friends, and managing finances. However, university is also a high-risk period for stress and poor mental health, which can result in increased drop-out, poorer academic outcomes, diminished employment opportunities and long-term disadvantage [1,2,3]. Mental health concerns are increasing amongst university students, with anxiety, depression, self-harm, and alcohol/substance abuse most common [4,5,6,7,8].

One of the major challenges for enhancing student mental health is the absence of proven effective prevention and wellbeing promotion initiatives [9, 10]. To tackle this key challenge, the current Nurture-U (NURTURE University) Prevention trial investigates the use of self-guided cognitive-behavioural strategies delivered by mobile app to prevent depression in university students. More specifically, this self-help intervention targets elevated repetitive negative thought (RNT) in the form of worry and rumination. RNT is a good intervention target to help students because it is a vulnerability factor that is robustly found to predict later depression, anxiety, alcohol misuse and eating disorders [11,12,13,14] and can be successfully reduced by cognitive-behavioural approaches [15,16,17,18,19], making it a tractable target for prevention. Furthermore, recent research has indicated that RNT is elevated in university students [5] and that it may be increasing over time in students [20], and that it specifically predicts poor mental health in students [13, 18, 19, 21]. Furthermore, RNT (e.g., worry) is a problem that students can easily self-identify and are motivated to seek help for, and that does not carry the potential stigma of more directly targeting anxiety and depression – targeting RNT may thus have the benefits recently proposed for indirect preventative interventions [22].

A version of cognitive-behavioural therapy (CBT) adapted to target RNT has been proven to be effective in reducing and preventing depression and anxiety in face-to-face therapy [15,16,17]. Moreover, a randomised controlled trial of a preventative intervention designed to target excessive levels of RNT in young people with elevated levels of worry and rumination found that both a group based and internet version of a rumination-focused Cognitive Behavioural Therapy programme (RF-CBT) significantly reduced RNT (d = 0.53 to 0.89) and halved the rates of caseness for self-reported major depression and generalized anxiety disorder over the next 12 months relative to a wait-list control [18]. A further trial involving 235 UK undergraduates with high-RNT found that a therapist-guided internet-based version of this RNT-targeting therapy reduced the risk of depression by 34% relative to controls over the next 15 months and that participants showed a significant improvement in RNT and depressive symptoms in the short to medium term [19]. A feasibility arm within this trial suggested that an unguided self-help version of this approach may prevent anxiety and depression in students [19] but this needs robust evaluation in a large-scale suitably powered proof-of-concept trial to test its potential as a highly scalable approach [23].

Moreover, prior prevention work in students has focused on the use of internet-delivered interventions. However, it may be that the use of a mobile app has further advantages. First, the use of mobile phones is near ubiquitous in university students – in the UK within young people aged 16-24, in 2022, 98% had a smart phone [24]. Mobile apps can thus provide a highly scalable intervention, allowing very good coverage and reach and that is widely accessible and acceptable, and convenient that can be used anytime and anywhere, all of which are critical for an effective preventive intervention [25]. Second, an unguided self-help app would be non-consumable and can be used by a nearly unlimited number of people simultaneously unlike guided interventions, which are limited by the capacity of the coaches or therapists [26]. Third, mobile apps can help to integrate behavioural changes into daily life: the app is always on hand via the smartphone, making it well-suited for changing mental habits such as worry and rumination [27].

Despite a huge increase in the number of mobile-based mental health apps over the last ten years [28] only a small number have been developed with scientific rigour. Further, many do not utilise established treatment principles nor have they been rigorously tested in robust well-powered Randomised Controlled Trials (RCTs) [28,29,30,31,32]. While emerging evidence suggests that mobile-based applications can deliver efficacious treatment interventions for anxiety and depression [33, 34], there have not been many trials examining their use for prevention of poor mental health in young people and in university students particularly [28, 32]. Many studies have been under-powered, with less than 100 participants per trial arm.

The app in this study will adapt an existing proven intervention that targets a shift away from maladaptive worry and rumination, as well-established risk factors for poor mental health [11,12,13,14] to more adaptive problem-solving. This self-help intervention builds on proven cognitive-behavioural therapy principles and includes identifying warning signs for worry, repeated practice to train out of unhelpful habits and build helpful habits, and the training of useful alternative strategies such as being more specific, relaxation, problem-solving and self-compassion [15,16,17,18,19, 35]. The comparator condition will be usual practice, reflecting the standard experience of students not receiving the app, providing a pragmatic real-world control.

Objective

The primary objective of this trial is to examine the efficacy of unguided digital RNT-targeting self-help relative to usual practice to prevent incidence of major depression over a 12-month period in university students with elevated risk as indexed by high levels of RNT. Secondary objectives are to examine the efficacy of this self-help app on secondary outcomes concerning mental well-being and mental health and associated costs, the maintenance of these effects at 12-month follow-up and to examine potential mediators and moderators of the beneficial effects (if any) of this intervention.

It is hypothesised that for university students with elevated worry and rumination, a self-guided mobile app that targets RNT added to usual practice will outperform usual practice in reducing incidence of depression across 12 months and reducing symptoms of worry, rumination, depression, and anxiety at 3 and 12 months.

Methods

The study will be conducted and reported according to Consolidated Standards of Reporting Trials (CONSORT) [36, 37] and extensions for non-pharmacologic treatment interventions and multi-arm parallel-group randomised trials and CONSORT-EHEALTH for improving and standardising evaluation reports of Web-based and mobile health interventions [38].

Study design

The trial design is a superiority parallel 2-arm individual-level single-blind Randomized Controlled Trial (RCT). All participants will be randomized into either receiving the self-help unguided self-help app incorporating CBT strategies targeting RNT in addition to usual practice or to receiving usual practice alone.

Potential participants for the trial provide initial consent to complete screening measures to determine if they are eligible to participate in the trial, i.e., showing elevated levels of RNT. Any potential participants who are found not to be eligible are automatically signposted to other sources of support. Once trial eligibility has been determined and consent to participate in the trial has been obtained, participants are individually selected at random (in a 1:1 ratio) to be offered the unguided self-help app or to continue with usual practice only.

Recruitment and study settings

We seek to recruit 648 participants from within United Kingdom universities (focused on the partner universities in the grant: Exeter, Newcastle, Oxford, Cardiff, Southampton, and King’s College London, but also open to other UK universities). The recruitment strategy will include on-campus presentations, posters, stands, and presentations in lectures, online and website advertising; email to mailing lists; newsletters and other circulars and noticeboards within willing universities in the UK. A social media campaign will be designed and prepared to be carried out on different social networks (e.g., Facebook, Instagram, TikTok), including advertisements in social media.

Eligibility criteria

Eligible participants will be: (1) over 16 years of age; (2) studying at a UK university; (3) able to provide informed consent; (4) having regular access to a smart phone (android or iOS), tablet, PC or laptop, necessary to use intervention; (5) available for the full duration of the trial (12 months); (6) able to complete consent and online questionnaires based on a basic literacy in English; (7) scoring above previously established cut-offs on standardized self-report measures of worry (Penn State Worry Questionnaire- Short-form, PSWQ-S) [39] and rumination (Ruminative Response Scale-Brooding, RRS-B) [40] , defined as scoring in the worst performing quarter on at least one of these measures, and scoring in the worst performing third on the second measure (in practice, this means scores of >11 for worst tercile, > 12 for worst quartile on the RRS-brooding scale and >24 for top tercile and >26 for top quartile on the Penn State Worry Questionnaire short-form). These thresholds are based on prior studies finding that individuals scoring in the worst quarter on measures of RNT have elevated risk for subsequent anxiety and depression [18, 19, 41].

Since this is a prevention trial, potential participants will be excluded at baseline if currently meeting diagnostic criteria for major depression (according to psychiatric DSM-V criteria), determined in structured self-report electronic screening using the LIDAS instrument [42]. Participants will also be excluded at baseline if presenting with highly elevated symptoms of depression indicating they require more specialist treatment. This is defined as having a score of 20 or higher on the Patient Health Questionnaire (PHQ-9) [43]. Other exclusion criteria include: active suicidality; any self-reported history of severe mental health problems such as bipolar disorder and psychosis and drug/alcohol dependence; and currently receiving psychological therapy, counselling or psychiatric medication including antidepressants.

Screening and consent procedure

Potential participants who are interested in the study will be directed to our study website, (www.nurtureuniversity.co.uk) which provides further information. Interested participants can proceed directly to the Electronic Data Capture (EDC) system and undertake a brief pre-screener to check age and that the participant is a university student. If appropriate, the website visitor can watch a video version of the screening Participant Information Sheet (PIS) and/or read an electronic version of the PIS and an initial consent screen to provide contact details (email; mobile phone number), and to provide informed consent (screening consent form) to complete the screening questionnaires. After completing pre-screening, potential participants will be automatically emailed a copy of the screening PIS, privacy policy and completed screening consent form. Once this initial consent is provided, the participant will complete the screening assessment consisting of the LIDAS, PSWQ-S, RRS-B and PHQ-9 and if meeting eligibility criteria will be assigned to the trial (the screening process will in parallel be assessing participants for eligibility for a trial of internet cognitive behavioural therapy for students with elevated anxiety and depression).

Those meeting eligibility criteria following the screening assessment will then be asked to consent to take part in the trial after viewing a video version of the trial PIS and/or reading an electronic version of the trial PIS and completing an electronic trial consent form (trial consent form). Participants who provide consent are automatically emailed a copy of the trial PIS, privacy policy and completed trial consent form.

Individuals who are not suitable at pre-screen or screening (e.g., outside of age range, below threshold on RNT) will automatically be directed to a webpage explaining why they are not suitable for the trial. Those reporting mental health difficulties will be automatically guided to webpages providing information, guidance including to consult with their general practitioner (or equivalent), and weblinks and telephone numbers for help and support, including contact details for the trial team.

Baseline and follow-up assessments

The baseline assessment will take place after electronic informed consent to participate in the trial is provided and consists of web-based self-report measures to assess current and lifetime history of depression, current wellbeing, symptoms of anxiety and depression, social and work functioning, use of services and treatment received, academic grades, resilience, and stressful events, and levels of RNT (see outcome measures and Tables 1 and 2). The Lifetime Depression Assessment Self-report questionnaire (LIDAS) [42] will be used to assess lifetime major depression (MDD) diagnosis according to DSM criteria and is largely based on the widely used Composite International Diagnostic Interview (CIDI). It has been proven to be effective for determining history of depression through self-report in an online digital format, matching the needs for the current study [42]. It consists of a conditional sequence of pre-programmed questions assessing all the diagnostic criteria for depression, with logic cut-outs so that subsequent questions are determined by prior questions, keeping the assessment brief.

Table 1 Schedule of enrolment, interventions and assessments
Table 2 Measurements and endpoints

Once consented participants have completed the baseline assessment, they will be randomised automatically by an independent computer system. Randomised participants will be informed of their randomisation allocation and signed up to use the relevant variant of the app via clinically trained members of the research team. The participant’s University email address is used for app set-up.

All participants will be followed up electronically at 3 months and 12 months post-randomisation. At each follow-up point, participants will be automatically sent emails and texts with links to enter their data into the EDC. Each assessment point will involve an automated weekly follow- up by email and then text and telephone follow-ups to participants who haven’t yet completed the EDC assessment at 3 months and 12 months. Tables 1 and 2 give an overview of all measurements. Figure 1 gives an overview of trial flow. Project researchers will be blind to treatment allocation but will be available to participants to answer queries about the trial or the assessments. Participants will receive honorariums for the completion of each of the brief mediator assessments occurring each week for 8 weeks post-randomisation, 3-month and 12-month follow-up assessments.

Fig. 1
figure 1

CONSORT flow diagram

Randomisation, intervention delivery and masking

Participants will be randomised (in a 1:1 ratio) to the two intervention arms. Randomisation will be conducted automatically by means of a custom-built secure web service created and managed by the Exeter Clinical Trials Unit (ExeCTU), which interfaces with the trial database, and which will be independent of the trial researchers. To promote balance across key participant characteristics across intervention arms, randomisation will be stratified according to recruitment site (each of the six funded partner universities plus an “other” university category for students recruited elsewhere), and history of depression (no history vs past history of depression – given that this is a strong predictor of future depression and was used previously) [19]. Stratification will be used (on these two variables) and blocking will be used with minimum block size of 4 and maximum block size of 6, occurring at random to maintain concealment.

All the online recruitment and randomisation will be automated and independent of trial researchers. The Exeter CTU EDC system will contact an unblinded team member (administrator/therapist) indicating when an individual [by study ID] has been randomized to the active intervention. This team member will then access the relevant details in the EXCTU database and manually set up the participant in the mobile app intervention using administrator rights via the treatment platform dashboard. An email will also go to the participant indicating the condition to which they are randomised and informing them what to expect. The relevant unblinded team member will also monitor if the participant has accessed the intervention and check if any difficulties and encourage to sign-up.

All assessments will be routinely collected online using the EDC following automated reminders, without the involvement of researchers. Site researchers will be blind to treatment allocation. Site researchers will prompt all participants to complete follow ups by phone and text if they do not respond to the automated email reminders. Any unblinding in contact with a site researcher would be logged as a protocol deviation and only a researcher that remained blind will be able to prompt future follow-up from that participant.

Interventions

Usual practice control

This control is what usual practice the participants may receive during the course of the 12-month follow-up. Usual practice, as received by the university student outside of the trial, may include no provision of intervention, local provision of intervention, support from their GP/family doctor, local health services or youth services, or provision of intervention within their university (e.g., well-being service; support and welfare staff). The nature of usual practice will be monitored and assessed by questionnaires at each follow-up assessment, determining what treatment and services participants have received since the last assessment.

Unguided RNT-focused self-help mobile app (experimental intervention group)

The self-help app includes self-monitoring, psychoeducation, and active self-help exercises based on RNT-specific strategies from an evidence-based rumination-focused CBT intervention [35]. Core elements of the intervention are designed to break the ruminative habit and enable users to shift towards a more helpful processing style. This involves coaching participants to spot warning signs for rumination and worry, and then to plan alternative strategies. These include being more active, slowing things down, breaking tasks down, opposite action, relaxation, concrete thinking, becoming absorbed, self-compassion, and assertiveness. Participants are prompted to practice alternative strategies in response to their warning signs. The user interface includes text, pictures, audio-recordings, vignettes, animations, audio-exercises, quizzes, and questionnaires with tailored automated feedback. The app is entirely automated (i.e., self-guided) and designed for use on both iOS and Android phones. The app is accessed for free via each participant’s smartphone app store and is set up in the Minddistrict delivery platform. The app is structured in a logical order with participants needing to complete each module/lesson before proceeding to the next lesson. Each lesson can be completed within 5-30 mins and followed a structure of psychoeducation, student stories, experiential exercises, strategies to practice, making plans, and a quiz to test knowledge (see Table 3 for further detail).

Table 3 Detailed description of internet RNT-focused mobile app intervention

The content will focus on providing psychoeducation, tips, advice, strategies, and reflective exercises and learning tests relevant to reducing worry and rumination and building confidence. It has been adapted to be usable in a mobile app format and has been tailored through two iterations (one on paper with illustrative examples for a student focus group, one with n=6 students working through the app and providing feedback) to reflect student concerns, including specific sections on student issues and a series of diverse student vignettes illustrating different concerns and strategies through the app. The vignettes are designed to follow different student stories to illustrate different aspects of the intervention and different experiences of worry and rumination. The adaptation includes organising all information into “bite-sized” information that can be displayed on a mobile phone screen without the need to scroll down, typically with one key message per “page”, and with users then swiping forwards to the next “page” to make it user-friendly.

There is a “favourite” feature so that any exercise or video or information could be stored and accessed whenever the user wanted from their dashboard. The app also includes interactive features that the user can access whenever they want and as many times as they want, including features to complete diaries, set goals, and make plans.

Intervention adherence

The use of the app will be assessed and recorded including number of times the app is used, for how long, and progress through the different modules. A minimum intervention dose for the app will be defined a priori, with “compliance” defined as completion of a pre-specified minimum level of usage of the unguided self-help intervention (at least 2 modules of 7 modules in treatment package). All participants in the usual practice control will be defined as receiving the minimum intervention dose.

Outcomes

Outcomes will be assessed at baseline (pre-randomisation) and 3 months and 12 months post-randomisation.

Primary outcome

The primary outcome measure will be the incidence of major depression over 12 months (primary endpoint), indexed by the LIDAS [42] assessing diagnosis retrospectively across the follow-up period.

Secondary outcomes

Secondary outcomes include: the Patient Health Questionnaire-9 (PHQ-9), a well-validated measure of depression [43] and the Warwick -Edinburgh Mental Wellbeing Scale (WEMWBS) [44], a widely used and well-validated measure of wellbeing. The Generalized Anxiety Disorder-7 (GAD-7) questionnaire will be used to assess anxiety symptoms [45]. The Work and Social Adjustment Scale (WSAS) [46] will be used to measure functioning with respect to work/education, home management, social leisure, private leisure, and close relationships each rated from 0 not at all impaired to 8 severely impaired. A bespoke questionnaire will assess the use of university-based and non-university-based healthcare (including National Health Service) services, resources, and support. Another bespoke questionnaire will ask participants to report on the actual academic marks and their academic targets for the previous year and whether they were satisfied with their academic progress. The Brief Resilience Scale is a brief and reliable means to assess the ability to bounce back from stress [47]. The Perceived Stress Scale-4 is a four-item measure of individuals perceived levels of stress and ability to cope [48]. The Adverse Events Questionnaire is a brief measure designed to assess stressful events in young people, which is proven to predict subsequent depression [49]. It consists of 3 questions asking about relevant adverse experiences (bad experiences concerning academic study; bad experiences concerning relationships; other bad experiences) rated from 0 “No”, 1 “yes, happened once”, 2 “yes happened twice”, 3 “yes, happened more than twice”. A fourth item asks about minor problems or hassles ranging from 0 “minor problems” to 4 “large number of minor problems and hassles”.

Participants will be asked to complete brief measures each week for eight weeks after randomisation to provide potential mediators of change: a two-item measure of depression (PHQ-2) [50]; a two-item measure of anxiety (GAD-2) [51]; a single item measure of stress over the last week (scored 0 none to 4 very severe); six items from the Cognitive and Behavioural Response to Stress Scale [52] assessing the frequency and usefulness of use of cognitive reinterpretation, behavioural activation, and relaxation or meditation strategies; 3-item adaptations of the automaticity component of the Self-Report Habit Index [53] focused on assessing the extent to which worry and problem-solving respectively are each a habit (e.g., “something that I do automatically" “I do without thinking”) over the past seven days; 2-items from the Self-Compassion Scale-short-form [54]; 2 items from the RRS-Brooding 5-item questionnaire [40]; a one-item measure assessing self-efficacy (“In the last seven days I feel better prepared to handle situations I could not handle before” rated using a seven‐point Likert scale ranging from −3 (“absolutely not true), 0 (“neither nor”) to +3 (“absolutely true”) and a one-item measuring problem clarification (“In the last seven days, I understand myself and my problems better” rated using a seven‐point Likert scale ranging from −3 (“absolutely not true), 0 (“neither nor”) to +3 (“absolutely true”).

The following descriptive variables will be assessed only at baseline: age, gender, sexuality, year of study, course of study, family’s occupational status, country of birth.

Sample size

The sample size was calculated using the primary outcome based on a minimum clinically important difference (MCID) at primary endpoint allowing for power at 0.80 and a two sided alpha at 0.05. The primary outcome is incidence of major depression across the 12 months follow-up. Assuming that the MCID is an absolute risk reduction in incidence of major depressive episodes of 10% based on previously published consensus [55] and that incidence of major depressive episodes will be 25% in the usual practice arm, paralleling previous studies in this high-risk sample [18, 19], and assuming 20% follow-up attrition, then conservatively we require n=324 per arm, giving a total sample required of 648.

Statistical analysis plan

The primary analyses will be intention-to-treat (ITT) analyses [56] (i.e. all participants will be included in the analyses according to their randomised allocation) and based on complete case outcome data. The primary inferential analyses will compare across trial arms for the primary and continuous secondary outcomes at 12-months follow up using multilevel mixed-effect models, which enable us to examine nested hierarchies in the data (individual, intervention, university), across time (examining pre-to-post change), to capture dependencies in the data, to investigate individual trajectories (random intercepts, random slopes), and which have less restrictive assumptions re missing data.

Secondary analysis will be undertaken using both Complier Average Causal Effect models and multiple imputation:

  • Complier Average Causal Effect (CACE) analysis [57, 58] to provide an estimate of a treatment effect accounting for pre-specified per protocol adherence and compliance with the treatment, whilst retaining the benefits of randomisation.

  • Multiple imputation following the examination of the pattern of missing outcomes to impute primary and secondary continuous outcomes. Imputation models will be informed by treatment arm, baseline scores, other covariates to be included in the model, and other baseline characteristics found to predict outcome or propensity for missingness (logistic regression models will be used to investigate the associations between baseline characteristics and missingness).

Secondary analyses will be undertaken including:

  • Models will be estimated for the primary and secondary outcomes at 3- and 12-month follow-up and will include the covariates adjusted for in the linear regression models.

  • Cox regression models will be undertaken to investigate between group differences in the time until a major depressive episode.

  • Mediation analyses will be undertaken to gain insight into mechanisms that could explain the potential effect of the interventions on primary outcomes. We will use modern causal inference methods using structural equation modelling or parametric regression models to assess mediation effects [59]. In addition, we will investigate potential moderation of the interventions by site and history of depression.

  • The results of all models will be compared to primary analysis complete case ITT results.

  • Analyses will be undertaken by a statistician blinded to group allocation and using Stata v.17.

Organization, quality assurance and data management

Research data will be automatically collected in a pseudonymised manner through an electronic data capture system licenced/programmed by Exeter Clinical Trials Unit (CTU). In the first instance all participants will be directed to the electronic data capture system to provide their data. Participants who respond to follow-ups by telephone will have their primary outcome data entered into the system by a site researcher and this variation in data collection method will be recorded in the EDC. All data will be kept securely and confidentially and only accessed by specified researchers at the University of Exeter. The central data-management team will use de-identified backups for the monitoring of the overall progress and data quality. Ultimately, a comprehensive de-identified dataset will be produced that includes all outcome data.

Trial status

The Trial was registered in ISRCTN, number of identification 86795807. Date of registration: 27 October 2022. Recruitment commenced in July 2023 and is ongoing.

Discussion

In recent years, there has been evidence for increasing prevalence of poor mental health amongst university students, with high rates of anxiety and depression (1-5). These mental health problems have significant negative impact on students, including resulting in greater rates of university drop-out, lower grades and subsequent impact on future careers. Furthermore, many of the students who experience mental health difficulties do not receive treatment (6-8). Finding better ways to prevent the onset of common mental health problems such as depression is one necessary step to improve mental health in higher education. However, to date, there is limited evidence on effective approaches to preventing depression within university students (7-10).

Effective approaches to improve prevention need to be widely accessible and highly scalable so that they can be reach large numbers of young people. One potential approach to delivering a scalable intervention is through mobile apps (m-health) as the majority of young people regularly use mobile devices. The current study is an important contribution to this field by aiming to deliver a well-powered trial of a self-guided mobile app for university students.

Because this intervention is based on a smartphone app and is entirely self-help, without requiring support or therapist time, it has potential to be scaled up to be widely available as a public health intervention. If proven to be efficacious, this work may thus contribute to large-scale effective preventions for young people, i.e., massive open online interventions (MOOI) [23].

Availability of data and materials

Anonymised datasets arising from this trial will be made available after the primary outcomes are published to researchers and other groups via request to a data committee within the trial consortium. The results will additionally be updated on https://www.isrctn.com/ISRCTN86795807. We plan to communicate trial results through peer-reviewed open access publications and direct reports to TSC, sponsor, and participants.

Data availability

No datasets were generated or analysed during the current study.

Abbreviations

AE:

Adverse Event

CACE:

Complier average causal effect

DMEC:

Data Monitoring Ethics Committee

DSM-IV:

Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition

EDC:

Electronic Data Capture System

ExeCTU:

University of Exeter Clinical Trials Unit

GAD-7:

Generalized Anxiety Disorder-7

ITT:

Intention-to-treat

MDD:

Major depressive disorder

MI:

Multiple imputations

NIHR:

National Institute for Health Research

NRES:

NHS National Research Ethics Service

PHQ-9:

Patient Health Questionnaire

PIS:

Participant Information Sheet

RCT:

randomised controlled trial

SAE:

Serious Adverse Event

TSC:

Trial Steering Committee

References

  1. Bruffaerts R, Mortier P, Kiekens G, Auerbach RP, Cuijpers P, Demyttenaere K, Green JG, Nock MK, Kessler RC. Mental health problems in college freshmen: Prevalence and academic functioning. J Affect Disord. 2018 Jan 1;225:97-103. https://doi.org/10.1016/j.jad.2017.07.044. Epub 2017 Jul 25. PMID: 28802728; PMCID: PMC5846318.

  2. Alonso J, Vilagut G, Mortier P, Auerbach RP, Bruffaerts R, Cuijpers P, Demyttenaere K, Ebert DD, Ennis E, Gutiérrez-García RA, Green JG, Hasking P, Lee S, Bantjes J, Nock MK, Pinder-Amaker S, Sampson NA, Zaslavsky AM, Kessler RC; WHO WMH-ICS Collaborators. The role impairment associated with mental disorder risk profiles in the WHO World Mental Health International College Student Initiative. Int J Methods Psychiatr Res. 2019 Jun;28(2):e1750. https://doi.org/10.1002/mpr.1750. Epub 2018 Nov 6. PMID: 30402985; PMCID: PMC6877266.

  3. Duffy A, Keown-Stoneman C, Goodday S, et al. Predictors of mental health and academic outcomes in first-year university students: Identifying prevention and early-intervention targets. BJPsych Open. 2020;6(3): e46. https://doi.org/10.1192/bjo.2020.24.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Auerbach RP, Alonso J, Axinn WG, Cuijpers P, Ebert DD, Green JG, Hwang I, Kessler RC, Liu H, Mortier P, Nock MK, Pinder-Amaker S, Sampson NA, Aguilar-Gaxiola S, Al-Hamzawi A, Andrade LH, Benjet C, Caldas-de-Almeida JM, Demyttenaere K, Florescu S, de Girolamo G, Gureje O, Haro JM, Karam EG, Kiejna A, Kovess-Masfety V, Lee S, McGrath JJ, O'Neill S, Pennell BE, Scott K, Ten Have M, Torres Y, Zaslavsky AM, Zarkov Z, Bruffaerts R. Mental disorders among college students in the World Health Organization World Mental Health Surveys. Psychol Med. 2016 Oct;46(14):2955-2970. https://doi.org/10.1017/S0033291716001665. Epub 2016 Aug 3. Erratum in: Psychol Med. 2017 Nov;47(15):2737. PMID: 27484622; PMCID: PMC5129654.

  5. Pereira SR et al. University Student Mental Health Survey 2018: The Insight Network.

  6. Auerbach RP, Mortier P, Bruffaerts R, Alonso J, Benjet C, Cuijpers P, Demyttenaere K, Ebert DD, Green JG, Hasking P, Murray E, Nock MK, Pinder-Amaker S, Sampson NA, Stein DJ, Vilagut G, Zaslavsky AM, Kessler RC; WHO WMH-ICS Collaborators. WHO World Mental Health Surveys International College Student Project: Prevalence and distribution of mental disorders. J Abnorm Psychol. 2018 Oct;127(7):623-638. https://doi.org/10.1037/abn0000362. Epub 2018 Sep 13. PMID: 30211576; PMCID: PMC6193834.

  7. McIntyre JC, Worsley J, Corcoran R, Harrison Woods P, Bentall RP. Academic and non-academic predictors of student psychological distress: the role of social identity and loneliness. J Ment Health. 2018;27(3):230–9. https://doi.org/10.1080/09638237.2018.1437608. (Epub 2018 Feb 13 PMID: 29436883).

    Article  PubMed  Google Scholar 

  8. Thorley C. Not by degrees, Improving Student Mental Health in the UK’s universities. 2017. Institute for Public Policy Research.

  9. Andrews G, Issakidis C, Sanderson K, Corry J, Lapsley H. Utilising survey data to inform public policy: comparison of the cost-effectiveness of treatment of ten mental disorders. Br J Psychiatry. 2004;184:526–33. https://doi.org/10.1192/bjp.184.6.526. (PMID: 15172947).

    Article  PubMed  Google Scholar 

  10. Ormel J, Kessler RC, Schoevers R. Depression: more treatment but no drop in prevalence: how effective is treatment? And can we do better? Curr Opin Psychiatry. 2019;32(4):348–54. https://doi.org/10.1097/YCO.0000000000000505.PMID:30855297.

    Article  PubMed  Google Scholar 

  11. Ehring T, Watkins ER. Repetitive negative thinking as a transdiagnostic process. Vol. 1, International Journal of Cognitive Therapy. 2008.

  12. Nolen-Hoeksema S, Wisco BE, Lyubomirsky S. Rethinking Rumination. Perspect Psychol Sci. 2008;3(5):400–24.

    Article  PubMed  Google Scholar 

  13. Watkins ER, Roberts H. Reflecting on rumination: Consequences, causes, mechanisms and treatment of rumination. Behav Res Ther. 2020;127:1–28.

    Article  Google Scholar 

  14. Watkins ER. Constructive and Unconstructive Repetitive Thought. Psychol Bull. 2008;134(2):163–206.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Watkins ER, Mullan E, Wingrove J, Rimes K, Steiner H, Bathurst N, et al. Rumination-focused cognitive-behavioural therapy for residual depression: Phase II randomised controlled trial. Br J Psychiatry. 2011;199(4):317–22.

    Article  PubMed  Google Scholar 

  16. Watkins ER, Taylor RS, Byng R, Baeyens C, Read R, Pearson K, et al. Guided self-help concreteness training as an intervention for major depression in primary care: A Phase II randomized controlled trial. Psychol Med. 2012;42(7):1359–71.

    Article  CAS  PubMed  Google Scholar 

  17. Hvenegaard M, Moeller SB, Poulsen S, Gondan M, Grafton B, Austin SF, et al. Group rumination-focused cognitive-behavioural therapy (CBT) v. group CBT for depression: Phase II trial. Psychol Med. 2020;50(1):11–9.

  18. Topper M, Emmelkamp PMG, Watkins E, Ehring T. Prevention of anxiety disorders and depression by targeting excessive worry and rumination in adolescents and young adults: A randomized controlled trial. Behav Res Ther. 2017;1(90):123–36.

    Article  Google Scholar 

  19. Cook L, Mostazir M, Watkins E. Reducing stress and preventing depression (RESPOND): Randomized controlled trial of web-based rumination-focused cognitive behavioral therapy for high-ruminating university students. J Med Internet Res. 2019 May 1;21(5).

  20. Davey GCL, Meeten F, Field AP. What’s Worrying Our Students? Increasing Worry Levels over Two Decades and a New Measure of Student Worry Frequency and Domains. Cognit Ther Res. 2022;46(2):406–19. https://doi.org/10.1007/s10608-021-10270-0.

    Article  PubMed  Google Scholar 

  21. Nolen-Hoeksema S, Stice E, Wade E, Bohon C. Reciprocal relations between rumination and bulimic, substance abuse, and depressive symptoms in female adolescents. Journal of Abnormal Psychology. 2007;116(1):198–207. https://doi.org/10.1037/0021-843X.116.1.198.

    Article  PubMed  Google Scholar 

  22. Cuijpers P. Indirect Prevention and Treatment of Depression: An Emerging Paradigm? Clin Psychol Eur. 2021;3(4): e6847. https://doi.org/10.32872/cpe.6847.PMID:36398290;PMCID:PMC9667226.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Muñoz RF, Bunge EL, Chen K, Schueller SM, Bravin JI, Shaughnessy EA, et al. Massive open online interventions: A novel model for delivering behavioral- health services worldwide. Clin Psychol Sci. 2016;4(2):194–205.

    Article  Google Scholar 

  24. Statista https://www.statista.com/help/#faq52a7443e29f8d0f009000014.

  25. Schueller SM, Muñoz RF, Mohr DC. Realizing the Potential of Behavioral Intervention Technologies. Curr Dir Psychol Sci. 2013;22(6):478–83.

    Article  Google Scholar 

  26. Kazdin AE. Technology-Based Interventions and Reducing the Burdens of Mental Illness: Perspectives and Comments on the Special Series. Cogn Behav Pract. 2015;22(3):359–66.

    Article  Google Scholar 

  27. Watkins ER, Nolen-Hoeksema S. A habit-goal framework of depressive rumination. J Abnorm Psychol. 2014;123(1):24–34. https://doi.org/10.1037/a0035540.

    Article  PubMed  Google Scholar 

  28. Torous J, Roberts LW. Needed innovation in digital health and smartphone applications for mental health transparency and trust. JAMA Psychiatry. 2017;74(5):437–8.

    Article  PubMed  Google Scholar 

  29. Bakker D, Kazantzis N, Rickwood D, Rickard N. Mental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments. JMIR Ment Heal. 2016;3(1): e7.

    Article  Google Scholar 

  30. Donker T, Petrie K, Proudfoot J, Clarke J, Birch M-R, Christensen H. Smartphones for Smarter Delivery of Mental Health Programs: A Systematic Review. J Med Internet Res. 2013;15(11): e247.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Sucala M, Cuijpers P, Muench F, Cardoș R, Soflau R, Dobrean A, et al. Anxiety: There is an app for that. A systematic review of anxiety apps. Depress Anxiety. 2017;34(6):518–25.

  32. Torous J, Andersson G, Bertagnoli A, Christensen H, Cuijpers P, Firth J, et al. Towards a consensus around standards for smartphone apps and digital mental health. Vol. 18, World Psychiatry. 2019. p. 97–8.

  33. Firth J, Torous J, Carney R, Newby J, Cosco TD, Christensen H, et al. Digital Technologies in the Treatment of Anxiety: Recent Innovations and Future Directions. Curr Psychiatry Rep. 2018;20(6):44.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Firth J, Torous J, Nicholas J, Carney R, Pratap A, Rosenbaum S, et al. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. Vol. 16, World Psychiatry. 2017. p. 287–98.

  35. Watkins ER. Rumination-Focused Cognitive-Behavioral Therapy for Depression. New York: Guildford Publications; 2016.

    Google Scholar 

  36. Schulz KF, Altman DG, Moher D, Grp C. CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials. Ann Intern Med. 2010;152(11):726-W293.

    Article  PubMed  Google Scholar 

  37. Grant S, Mayo-Wilson E, Montgomery P, Macdonald G, Michie S, Hopewell S, et al. CONSORT-SPI 2018 explanation and elaboration: guidance for reporting social and psychological intervention trials. Trials. 2018;19:406.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Eysenbach G. CONSORT-EHEALTH Group CONSORT-EHEALTH: Improving and Standardizing Evaluation Reports of Web-based and Mobile Health Interventions. J Med Internet Res. 2011;13(4): e126.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Hopko DR, Stanley MA, Reas DL, Wetherell JL, Beck JG, Novy DM, et al. Assessing worry in older adults: confirmatory factor analysis of the Penn State worry questionnaire and psychometric properties of an abbreviated model. Psychol Assess. 2003;15(2):173–83.

    Article  PubMed  Google Scholar 

  40. Treynor W, Gonzalez R, Nolen-Hoeksema S. Rumination reconsidered: a psychometric analysis. Cogn Ther Res. 2003;27(3):247–59.

    Article  Google Scholar 

  41. Hankin BL, Young JF, Gallop R, Garber J. Cognitive and interpersonal vulnerabilities to adolescent depression: classification of risk profiles for a personalized prevention approach. J Abnorm Child Psychol. 2018;46(7):1521–33.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Bot M, Middeldorp CM, de Geus EJC, Lau HM, Sinke M, van Nieuwenhuizen B, et al. Validity of LIDAS (LIfetime depression assessment self-report): a self- report online assessment of lifetime major depressive disorder. Psychol Med. 2017;47(2):279–89.

    Article  CAS  PubMed  Google Scholar 

  43. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9 - validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. Stewart-Brown S, Platt S, Tennant A, et al. The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): a valid and reliable tool for measuring mental well-being in diverse populations and projects. J Epidemiol Community Health. 2011;65:A38–9.

    Article  Google Scholar 

  45. Spitzer RL, Kroenke K, Williams JBW, Lowe B. A brief measure for assessing generalized anxiety disorder - the GAD-7. Arch Intern Med. 2006;166(10):1092–7.

    Article  PubMed  Google Scholar 

  46. Mundt JC, Marks IM, Shear MK, Greist JH. The work and social adjustment scale: a simple measure of impairment in functioning. Br J Psychiatry. 2002;180:461–4.

    Article  PubMed  Google Scholar 

  47. Smith BW, Dalen J, Wiggins K, Tooley E, Christopher P, Bernard J. The brief resilience scale: assessing the ability to bounce back. Int J Behav Med. 2008;15(3):194–200. https://doi.org/10.1080/10705500802222972.

    Article  PubMed  Google Scholar 

  48. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. Journal of Health and Social Behavior. 1983;24:385–96.

    Article  CAS  PubMed  Google Scholar 

  49. Carver CS. Generalization, adverse events, and development of depressive symptoms. J Pers. 1998;66(4):607–19.

    Article  CAS  PubMed  Google Scholar 

  50. Kroenke K, Spitzer RL, Williams JB. The Patient Health Questionnaire-2: validity of a two-item depression screener. Med Care. 2003;41(11):1284–92. https://doi.org/10.1097/01.MLR.0000093487.78664.3C. (PMID: 14583691).

    Article  PubMed  Google Scholar 

  51. Kroenke K, Spitzer RL, Williams JB, Monahan PO, Löwe B. Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann Intern Med. 2007;146:317–25.

    Article  PubMed  Google Scholar 

  52. Miner AS, Schueller SM, Lattie EG, Mohr DC. Creation and validation of the Cognitive and Behavioral Response to Stress Scale in a depression trial. Psychiatry Res. 2015 Dec 30;230(3):819-25. https://doi.org/10.1016/j.psychres.2015.10.033. Epub 2015 Oct 30. PMID: 26553147; PMCID: PMC4681670.

  53. Gardner B, Abraham C, Lally P, et al. Towards parsimony in habit measurement: Testing the convergent and predictive validity of an automaticity subscale of the Self-Report Habit Index. Int J Behav Nutr Phys Act. 2012;9:102. https://doi.org/10.1186/1479-5868-9-102.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Raes F, Pommier E, Neff KD, Van Gucht D. Construction and factorial validation of a short form of the Self-Compassion Scale. Clinical Psychology & Psychotherapy. 2011;18:250–5.

    Article  Google Scholar 

  55. Buntrock C, Ebert DD, Lehr D, Smit F, Riper H, Berking M, Cuijpers P. Effect of a Web-Based Guided Self-help Intervention for Prevention of Major Depression in Adults With Subthreshold Depression: A Randomized Clinical Trial. JAMA. 2016;315(17):1854–63. https://doi.org/10.1001/jama.2016.4326. (PMID: 27139058).

    Article  CAS  PubMed  Google Scholar 

  56. White IR, Carpenter J, Horton NJ. Including all individuals is not enough: lessons for intention-to-treat analysis. Clin Trials. 2012;9(4):396–407.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Angrist JD, Imbens GW, Rubin DB. Identification of causal effects using instrumental variables. J Am Stat Assoc. 1996;91(434):444–55.

    Article  Google Scholar 

  58. Dunn G, Maracy M, Tomenson B. Estimating treatment effects from randomized clinical trials with noncompliance and loss to follow-up: the role of instrumental variable methods. Stat Methods Med Res. 2005;14(4):369–95.

    Article  PubMed  Google Scholar 

  59. Emsley R, Dunn G, White IR. Mediation and moderation of treatment effects in randomised controlled trials of complex interventions. Stat Methods Med Res. 2010;19(3):237–70.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Funding for this paper was provided by the UKRI Adolescent Mental Health and Developing Minds Scheme project (MR/W002442/1) to the project titled: Developing and Evaluating a Stepped Change Whole-University approach for Student Wellbeing and Mental Health (Nurture-U). The study protocol titled “Developing and Evaluating a Stepped Change Whole-University approach for Student Wellbeing and Mental Health: trial of unguided internet rumination CBT to prevent depression and anxiety in students (Reducing Worry)” was peer-reviewed by the funding body. The study sponsor and funder have no influence on the conduct, delivery or reporting of the research. For the purpose of open access, the author has applied a ‘Creative Commons Attribution (CC BY) licence to any Author Accepted Manuscript version arising from this submission.

Author information

Authors and Affiliations

Authors

Contributions

EW obtained funding for the Nurture-U project and designed the trial. HC, GT contributed to the design of the Nurture-U trial. DP coordinates the trial. GT prepared the statistical analysis plan. EW, HC, MN designed and prepared the content of the self-help intervention. TC and Exeter CTU (ExeCTU) set up the logistics for the trial’s data collection. All authors contributed to the writing of the manuscript and approved the final version.

Corresponding author

Correspondence to E. R Watkins..

Ethics declarations

Ethics approval and consent to participate

Ethical and professional guidelines will be followed at all times, in line with Good Clinical Practice guidelines. Institutional review board approval has been obtained from the FHLS Psychology Ethics Committee at the University of Exeter on 29 September 2022 (Ref: Ethics Application ID: 523085). All participants will provide electronic informed consent. Data will be collected in a pseudonymised manner and stored securely.

The study is currently using trial protocol version 2.0 dated 04 December 2023. The trial sponsor is the University of Exeter, Exeter, UK. Protocol modifications are recorded and communicated to trial partners, sponsor, review boards and Trial Steering Committee (TSC).

A Trial Steering Committee (TSC) with independent experts in ethics, psychiatry, statistics and a representative from a patient’s association will provide independent oversight of the trial and expert advice, meeting every 6 months, and ensure that it is being conducted in accordance with the principles of Good Clinical Practice and the relevant regulations. There will also be an independent Data Monitoring Committee (DMC) to review adverse events and monitor data with access to group allocation with respect to recruitment, retention, and safety, and report to the TSC. The DMEC will be responsible for monitoring serious adverse effects, protocol violations and any risks emerging from the trial. It has the capacity to conduct an unblinded analysis if concerned about serious adverse effects. Interim analyses will only be conducted at request of the DMC if there is a concern about harmful effects of intervention; based on these analyses, the DMC will make recommendations to the TSC who will decide if the trial or a particular intervention should be discontinued on the basis of participant well-being and safety.

Adverse events and other unintended effects of trial interventions or trial conduct will be self-reported on the EDC through open questions asking about any problems arising from participation, standardized questions about self-harm and symptoms at each follow up, healthcare use (including hospitalisation and emergency care) asked at the 3 and 12 month assessments, plus spontaneously reported feedback from participants. All SAEs recorded in the EDC must be reported to the ExeCTU Trial Manager within 24 working hours/1 working day of becoming aware of the event. Only serious adverse events (SAE) that are related to the trial and unexpected will be reported to the sponsor who will decide if onward reporting to the research ethics committee is required. All SAEs and Adverse Events (AEs) are collated in a report for each TSC/ DMC meeting.

The trial has a risk and safety protocol, which includes action for ancillary care for participants with mental health disorders, including signposting to help, aiding with onward referrals, and contact with a clinician in the team. The sponsor has trial insurance that has provision for compensation for those who suffer harm from trial participation, in the unlikely event it is required.

All participants will provide electronic informed consent prior to baseline assessment. All participants can discontinue allocated interventions at their own choice and request.

Consent for publication

Not applicable.

Competing interests

Prof Watkins developed the rumination-focused cognitive-behavioural therapy adapted for the digital app intervention and receives royalties from Guilford Press for sales of the associated therapy manual. The other authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Watkins., E.R., Phillips, D., Cranston, T. et al. A randomized controlled trial of a self-guided mobile app targeting repetitive negative thought to prevent depression in university students: study protocol of the Nurture-U Reducing Worry prevention trial. BMC Psychiatry 24, 649 (2024). https://doi.org/10.1186/s12888-024-06079-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-024-06079-2

Keywords