- Study protocol
- Open Access
Promotion of mental health in young adults via mobile phone app: study protocol of the ECoWeB (emotional competence for well-being in Young adults) cohort multiple randomised trials
BMC Psychiatry volume 20, Article number: 458 (2020)
Promoting well-being and preventing poor mental health in young people is a major global priority. Building emotional competence (EC) skills via a mobile app may be an effective, scalable and acceptable way to do this. However, few large-scale controlled trials have examined the efficacy of mobile apps in promoting mental health in young people; none have tailored the app to individual profiles.
The Emotional Competence for Well-Being in Young Adults cohort multiple randomised controlled trial (cmRCT) involves a longitudinal prospective cohort to examine well-being, mental health and EC in 16–22 year olds across 12 months. Within the cohort, eligible participants are entered to either the PREVENT trial (if selected EC scores at baseline within worst-performing quartile) or to the PROMOTE trial (if selected EC scores not within worst-performing quartile). In both trials, participants are randomised (i) to continue with usual practice, repeated assessments and a self-monitoring app; (ii) to additionally receive generic cognitive-behavioural therapy self-help in app; (iii) to additionally receive personalised EC self-help in app. In total, 2142 participants aged 16 to 22 years, with no current or past history of major depression, bipolar disorder or psychosis will be recruited across UK, Germany, Spain, and Belgium. Assessments take place at baseline (pre-randomisation), 1, 3 and 12 months post-randomisation. Primary endpoint and outcome for PREVENT is level of depression symptoms on the Patient Health Questionnaire-9 at 3 months; primary endpoint and outcome for PROMOTE is emotional well-being assessed on the Warwick-Edinburgh Mental Wellbeing Scale at 3 months. Depressive symptoms, anxiety, well-being, health-related quality of life, functioning and cost-effectiveness are secondary outcomes. Compliance, adverse events and potentially mediating variables will be carefully monitored.
The trial aims to provide a better understanding of the causal role of learning EC skills using interventions delivered via mobile phone apps with respect to promoting well-being and preventing poor mental health in young people. This knowledge will be used to develop and disseminate innovative evidence-based, feasible, and effective Mobile-health public health strategies for preventing poor mental health and promoting well-being.
There is growing global concern about the high and steadily increasing rates of poor mental health in young people and of the early onset of mental disorders such as anxiety and depression . Such poor mental health during this key formative period severely affects the future life chances of young people, with significant long-term impact on future health, education, employment and social outcomes [1,2,3,4]. The incidence of anxiety and depression each markedly increase from mid-adolescence through to young adulthood, peaking during this period . As a consequence, there has been a call for urgent improvement in primary prevention of poor mental health, and for improvement in promotion of mental well-being [4, 5].
Although there are already evidence-based effective primary prevention interventions for common mental health disorders including Social-Emotional Learning (SEL) programmes  and cognitive-behavioural approaches , systematic reviews suggest that effect sizes are relatively small and there is scope to increase intervention efficacy [7,8,9,10]. Furthermore, most current evidence-based interventions require considerable person-hours from professionals because of the involvement of a relevant workforce such as teachers and therapists. Ideally, we need mental health promotion and prevention approaches that do not require considerable person-hours and that are highly scalable to a population level, that can be delivered as a public health approach, and that can increase treatment efficacy.
To tackle these key challenges, the Assessing and Enhancing Emotional Competence for Well-being in the Young (ECoWeB) project innovatively integrates three approaches: basing interventions on a model of normal emotional functioning; personalising intervention based on baseline scores; and the use of smartphone app delivery. First, rather than basing mental health promotion and mental ill-health prevention on traditional clinical disease models of psychopathology, we adopt an approach based on an established theoretical model of normal emotional functioning – the Component Process Model of Emotion (CPM) [11,12,13]. This model proposes that individuals vary in their abilities across different areas of Emotional Competence (EC), including: (i) accurate and functional appraisals of emotional situations and of the individual’s ability to cope with these situations, which determines whether an individual experiences the emotion appropriate to a situation (Emotion Production); (ii) abilities to perceive and understand emotions in themselves and others (Emotion Knowledge and Perception); (iii) and the use of more adaptive versus less adaptive strategies to manage and regulate emotions (Emotion Regulation). The model hypothesizes that good EC functioning contributes to reduced anxiety and depression, and improved mental well-being. Considerable correlational and prospective data is consistent with this hypothesis [14,15,16,17,18,19]. Targeting hypothesized underlying mechanisms common across all individuals no matter their symptomatology has the potential to enhance intervention efficacy and is particularly well-suited to the promotion of well-being and prevention of poor mental health at the population-level. As such, the ECoWeB project will test the efficacy of a self-help intervention focused on building EC to promote well-being and prevent poor mental health in young people.
Second, ECoWeB adopts a personalisation approach in which individuals in the experimental intervention are offered specific self-help psychoeducation, strategies and training matched to their EC profile, on the hypothesis that a tailored intervention will be more acceptable and efficacious than a generic intervention. This approach has not yet been evaluated in well-being and mental health promotion/prevention research despite recent arguments for predictive, personalised, preventive and participatory medicine focused on individual well-being .
Third, ECoWeB will investigate the delivery of the self-help intervention through a mobile app. The use of mobile apps (sometimes called Behavioural Intervention Technologies, BITs)  has a number of potential advantages: (i) scalability–Mobile-health (m-health) technologies are highly scalable, allowing very good coverage and reach; they are widely accessible; (ii) non-consumable–they enable repeated use by nearly unlimited people simultaneously; (iii) convenience – they can be used anytime, anywhere; (iv) acceptability – mobile apps are highly used by young people, with the majority of young people using smart phones . In addition, mobile apps can help to integrate behavioural changes into daily life: the app is always on hand via the smartphone, making it well-suited for changing habits. Despite huge increase in the numbers of m-health apps (> 10 k) , only a very small minority have been based on robust science, utilised established treatment principles and been rigorously tested with respect to safety and efficacy in robust well-powered randomised controlled trials (RCTs) [24,25,26,27]. There is emerging evidence for m-health apps as efficacious treatment interventions for anxiety and depression [28, 29], although the average sample size is still under 100 participants per trial arm, and few trials have examined well-being promotion and prevention of poor mental health specifically in young people. To our knowledge, ECoWeB will be the first fully powered definitive trial of an m-health app for mental health promotion in young people.
A further issue within the field of mental health promotion and prevention of poor mental health is the definition of the target population of the intervention. Population-oriented public health approaches are often available to the general eligible population without specific targeting (i.e., a universal intervention). However, there is some evidence that preventive interventions that are selective and target specific higher-risk groups within the wider eligible population, such as those with subsyndromal symptoms or indicative risk factors, may be more efficacious [8, 10]. Because this remains unresolved and has considerable implications for future implementation, ECoWeB will include two RCTs: one selecting individuals with indicative elevated risk for future poor mental health based on baseline EC profile (a targeted high-risk population: ECoWeB-PREVENT), and the other including participants without such indicative elevated risk (a low-risk population: ECoWeB-PROMOTE), within a single cohort multiple randomised controlled trial (cmRCT) design . In a cmRCT, individuals meeting relevant criteria are recruited into a large-scale prospective cohort and their outcomes are regularly monitored across the prospective period. In addition to consenting to be assessed over the follow-up period, participants also consent to being offered additional intervention if eligible. For each potential RCT in the cohort, information from the cohort is used to identify all eligible participants and then some eligible participants are randomly selected and offered the additional intervention.
We stress that the two trials share the same recruitment procedure, interventions, set of outcome measures and designs and most eligibility criteria. As the funding remit for ECoWeB was for promotion of mental well-being and primary prevention of mental disorders, both trials exclude those with a history of current or past major depression or a diagnosis of bipolar disorder or psychosis: individuals passing these criteria are eligible for either PREVENT or PROMOTE depending on their EC profile. The key differences between the trials are the eligibility criteria with respect to EC profile for each trial and as a consequence the primary outcome measure. The ECoWeB-PREVENT trial will recruit participants who have a hypothesized elevated risk of poor mental health based on an EC profile in which they score in the worst quartile on at least one EC component, such as a greater tendency towards well-established unhelpful emotional regulation strategies such as rumination [31,32,33] or making negative appraisals . For this group, there is increased likelihood of worsening mental health over 12 months and we choose depression symptoms (Patient Health Questionnaire-9) as our primary outcome as potentially the most sensitive and important index of poor mental health. ECoWeB-PREVENT therefore tests whether provision of personalised digital EC self-help can prevent the onset and increase of depression symptoms relative to generic digital CBT self-help and the usual practice self-monitoring control.
The ECoWeB-PROMOTE trial will recruit participants not showing elevated risk on their EC profile, that is, relatively well and high-functioning individuals, who do not score in the worst quartile for any of the EC components. For this group, there is lower likelihood of worsening mental health over 12 months. The sensible primary outcome is therefore increased mental well-being, indexed by the Warwick-Edinburgh Mental Wellbeing Scale. ECoWeB-PROMOTE therefore tests whether the provision of personalised digital EC self-help can improve well-being relative to generic digital CBT self-help and the usual practice self-monitoring control. Both trials share the same secondary outcome measures so that well-being promotion and prevention of poor mental health can be tested in both.
Because there are many different emotional competence skills that could potentially be assessed and trained, for initial feasibility and to test proof-of-principle for this approach, we identified at least one process to target with respect to each EC domain. Targets were therefore chosen that had been robustly implicated in mental health and well-being, and already had well-established validated assessment measures. These targets were also readily adaptable and proven interventions, albeit typically delivered through different media than apps, such as web-based therapy and classroom interventions. On this basis, the four target processes selected were appraisal biases in achievement contexts; interpretative biases in social contexts, each reflecting the Emotion Production component; rumination and worry reflecting proven dysfunctional strategies in Emotion Regulation; and emotional knowledge, understanding and recognition. Specifically, there are four components within the personalized digital EC self-help intervention, with each individual participant receiving their two lowest-ranked EC components based on their EC profile.
The achievement-focused appraisal self-help component builds on the control-value theory of achievement emotions  and aims to address lack of control, lack of value, and excessive negative value. To do so, it combines three established treatment approaches: (a) attributional retraining intended to build internal and controllable attributions for academic or work-related outcomes to increase perceived control, building on a video-based short intervention that has already had benefit in college students [36,37,38]; (b) mindset training to promote perceived control and growth mindsets, found to improve academic outcomes [39, 40] and which has been shown to reduce and prevent depression and anxiety in young people over 9 months after a single 30-min session [41,42,43]; (c) utility value self-help intended to increase the perceived value and usefulness of academic study and employment-related tasks [44, 45], as well as to reduce excessive concerns and fears of failure (excessive attainment value).
The social-focused appraisal self-help component builds on a model of youth depression which argues that negative appraisals may mediate the harmful effects of peer rejection on depressive symptoms . Using an established Cognitive Bias Modification of Interpretations (CBM-I) paradigm, the Ambiguous Scenarios Task (AST), participants are trained over repeated trials to draw more positive interpretations of ambiguous social scenarios. Laboratory studies have demonstrated CBM-I to show medium to large effect sizes (ESs) in modifying negative interpretations in adults (g = 0.52 to 0.81) [47,48,49] and youth (g = 0.52 to 0.70) . CBM-I has been shown to have modest benefits in reducing anxiety, and to a lesser extent depression in adults (g = 0.23) [47, 48] and youth with elevated symptoms (g = 0.17 to 0.34) , although the true clinical benefit has been questioned in some meta-analyses [47, 51, 52].
To target the Emotion Regulation EC component, ECoWeB adapts an existing proven intervention that targets a shift away from maladaptive worry and rumination, which are well-established risk factors for poor mental health [32, 33] to more adaptive problem-solving. This rumination self-help intervention builds on proven cognitive-behavioural therapy principles and includes identifying warning signs for worry, repeated practice to train out of unhelpful habits and build helpful habits, and the training of useful alternative strategies such as being more specific, relaxation, problem-solving and self-compassion . This intervention has been proven to be effective in reducing and preventing depression and anxiety in face-to-face therapy [54,55,56] and in web-based interventions for young adults  including an entirely self-help variant .
The emotional knowledge and perception self-help component educates and enhances EC knowledge and perception through the provision of detailed psychoeducation and adapted assessment tasks in which immediate feedback helps users to build their skills. For example, training feedback on the Geneva Emotion Recognition Test which involves judging emotional expressions from video clips (GERT) [59, 60] has been found to improve performance on emotion recognition tests and increased co-operation with a stranger.
The primary objective of the ECoWeB-PROMOTE trial is to examine the efficacy of personalized digital EC self-help relative to generic digital CBT self-help and a usual practice self-monitoring control to improve mental well-being at 3-month follow-up in young people with an EC profile without elevated hypothesized risk.
The primary objective of the ECoWeB-PREVENT trial is to examine the efficacy of personalized digital EC self-help relative to generic digital CBT self-help and a usual practice self-monitoring control to reduce poor mental health indexed by self-reported depression at 3-month follow-up in young people with an EC profile with elevated hypothesized risk.
For both trials, secondary objectives are to examine the efficacy of the interventions on secondary outcomes concerning mental well-being and mental health and associated costs, the maintenance of these effects at 12 month follow-up and to examine potential mediators and moderators of the beneficial effects (if any) of these m-health interventions.
The study will be conducted and reported according to Consolidated Standards of Reporting Trials (CONSORT) [61, 62] and extensions for non-pharmacologic treatment interventions and multi-arm parallel-group randomised trials and CONSORT-EHEALTH for improving and standardising evaluation reports of Web-based and mobile health interventions .
The trial design is of a cohort multiple randomised controlled trial (cmRCT)  involving two superiority parallel 3-arm randomised multicentre, multinational RCTs (ECoWeB-PREVENT; ECoWeB-PROMOTE). The arms are the same across both trials and all participants join the 12 month prospective longitudinal cohort.
Within ECoWeB, all participants recruited into the prospective cohort will be allocated into either the PREVENT or PROMOTE trial, and all are then randomised into one of three arms. The default arm within the cohort, that is, the control trial arm, involves completing web-based assessments at baseline and at 1-, 3- and 12-month follow-up, of well-being, mental health symptoms and EC functioning, and having access to a version of the app that supports self-monitoring of the participant’s emotions, plus any additional usual care a participant may receive external to the trial (henceforward, “usual practice self-monitoring control”). The active experimental arm involves the receipt of personalised EC self-help strategies within the app, in addition to the repeated measures and self-monitoring. In addition, there is an active control arm consisting of generic CBT self-help strategies within the app, in addition to the repeated measures and self-monitoring. The outcomes of participants randomly selected to each of the experimental and active control arms are compared with eligible participants randomly selected to remain in the usual practice self-monitoring control arm, and with each other.
There are multiple advantages to this cmRCT design. First, it effectively combines a prospective long-term longitudinal cohort design with a randomised trial. Random selection of some participants within each trial to additional intervention is equivalent to random allocation of all participants within each trial with respect to generating groups where all known and unknown prognostic factors are distributed evenly at baseline, enabling strong causal inference about the causal effects of each intervention. Nonetheless, retaining the default prospective cohort group provides information as to the natural history of well-being, emotions and mental health in this sample and allows us to examine the trajectory of well-being and symptoms over time and their relationship to EC.
Second, it potentially improves the efficiency and representativeness of sample recruitment as the study can be open widely to eligible young people and advertised as participating in a cohort study to learn about young people’s emotions as well as a clinical trial. Third, because individuals consent in advance to the option of having an intervention offered if eligible, we avoid individuals being knowingly allocated to a “lesser” usual care condition, potentially enhancing recruitment and retention.
Potential participants for either PROMOTE or PREVENT provide initial consent to complete screening measures to determine if they are eligible to participate in either of the two trials (ECoWeB-PROMOTE, EC profile not showing hypothesized elevated risk for future poor mental health; ECoWeB-PREVENT, EC profile showing hypothesized elevated risk for future poor mental health). Any potential participants who are found not to be eligible for either trial are automatically signposted to other sources of support. Once trial eligibility has been determined and consent to participate in the trial has been obtained, participants are individually selected at random (in a 1:1:1 ratio) to be offered self-help components within a mobile phone app (either personalised Emotional Competence self-help or general CBT self-help) or not to be contacted about the offered self-help and to continue with the app for self-monitoring only. All participants in the cohort consent at the outset to provide data to look at the benefit of the app self-help for well-being and mental health outcomes. Thus the three trial arms are: (1) usual practice self-monitoring control in which participants continue within the cohort with repeated assessment and using an app configured only for self-monitoring; (2) digital CBT self-help (active treatment control) in which participants receive the usual practice self-monitoring control and in addition are offered generic cognitive-behavioural self-help strategies within the app; (3) a personalised digital EC self-help in which participants receive the usual practice self-monitoring control and in addition are offered personalised digital self-help EC strategies within the app. Participants allocated to personalised digital self-help EC will receive two of four components corresponding to the two EC domains ranked lowest in their EC profile.
Recruitment and study settings
We seek to recruit 2142 participants across four different European countries (United Kingdom, Germany, Spain, Belgium) with central trial sites based at the University of Exeter, UK; LMU Munich, Germany; Universitat Jaume I, Castellon, Spain; and Gent University, Belgium (see Figs. 1, 2 and 3).
The recruitment strategy includes online and website advertising; email to mailing lists; newsletters and other circulars and noticeboards within willing schools, colleges and universities in the four countries. A social media campaign will be designed and prepared to be carried out on different social networks (e.g., Facebook, YouTube, Instagram, Twitter), including advertisements in social media; and blogs by YouTube influencers. It also includes mailings to members of relevant registers (e.g. city registers); recruitment via youth and mental health charities; brochures and posters in public areas; articles in local newspapers and press releases to the national press.
Eligible participants for the top-level cmRCT cohort will be: (1) young people aged 16 to 22 years old, (2) based in the UK, Spain, Germany, or Belgium (3) having basic literacy in at least one of English, Spanish, German, or Dutch, (4) able to provide informed consent and obtain parental consent for those aged under 18 years old in Germany and Belgium, and (5) having regular access to a smart phone (android or iOS) (see Table 1).
These trials are a primary prevention trial (PREVENT) and well-being promotion trial (PROMOTE), hence participants will be excluded from the cmRCT cohort at baseline if presenting with a current episode, or if they have a past episode of major depressive disorder (according to psychiatric DSM-IV criteria). This is determined in structured self-report electronic screening using the LIDAS instrument . Other exclusion criteria include: active suicidality; any self-reported history of severe mental health problems such as bipolar disorder and psychosis; and currently receiving psychological therapy, counselling or psychiatric medication including antidepressants.
Specific inclusion/exclusion criteria will determine whether an individual is eligible for ECoWeB-PROMOTE or ECoWeB-PREVENT: elevated hypothesized vulnerability on EC profile based on the baseline assessment of EC skills is an inclusion criterion for ECoWeB-PREVENT and an exclusion criterion for ECoWeB-PROMOTE. Elevated vulnerability for a specified EC will be defined as scoring in the worst performing quarter on at least one measure assessing the component, and scoring in the worst performing third on the second measure for the same component (if two measures are being used for that component). This threshold is based on prior studies finding that individuals scoring in the worst quarter on measures of EC (e.g., rumination, appraisals, interpersonal vulnerabilities) have elevated risk for subsequent anxiety and depression [57, 65]. The exact quartile/tertile thresholds have been set following validation studies of the instruments in the target sample (16–22 year olds) across the four recruiting countries.
Screening and consent procedure
Potential participants who are interested in the study are directed to our study website, (www.mymoodcoach.com) which provides further information, including eligibility criteria, and a pre-screener to check age and country. If appropriate, the website visitor is provided with the study information sheet and an initial consent screen to provide contact details (email; mobile phone number), and to provide informed consent to complete the baseline questionnaires. Individuals who are not suitable at pre-screen (e.g., outside of age range) will automatically be directed to a webpage explaining why they are not suitable for the trial. Those reporting mental health difficulties will be automatically guided to webpages providing information, guidance including to consult with their general practitioner (or equivalent), and weblinks and telephone numbers for help and support specific to each country, including contact details for the trial team.
Those meeting eligibility criteria following the baseline assessment are then asked to consent to take part in the prospective cohort and cmRCT, using an electronic information sheet, consent form and electronic signature. Once eligible participants consent to participate in the cmRCT, they will be deterministically allocated to the relevant trial and then randomised into one of the three conditions by a computer system. Consenting participants will be automatically signed up to use the relevant variant of the app via an application programming interface (API). The participant’s email address is used for app set-up.
Baseline and follow-up assessments
The baseline assessment takes place after initial electronic informed consent is provided, and consists of web-based self-report measures to assess current and lifetime history of depression, current well-being, symptoms of anxiety and depression, social and work functioning, health-related quality of life, stressful events, and EC skills in each of the four study languages (English, German, Spanish, Dutch) (see outcome measures and Table 2). All of the questionnaires have been validated in all four languages. The Lifetime Depression Assessment Self-report questionnaire (LIDAS)  is used to assess lifetime major depression (MDD) diagnosis according to DSM criteria, and is largely based on the widely used Composite International Diagnostic Interview (CIDI). It has been proven to be effective for determining history of depression through self-report in an online digital format, matching the needs for the current study . It consists of a conditional sequence of pre-programmed questions assessing all the diagnostic criteria for depression, with logic cut-outs so that subsequent questions are determined by prior questions, keeping the assessment brief.
All participants are entered into the prospective cohort and followed up electronically at 1, 3 and 12 months post-randomisation. At each follow-up point, participants will be automatically sent emails with links to enter their data into the assessment website. Each assessment point will involve an automated weekly follow-up and then email, text and telephone follow-ups by researchers to participants who haven’t yet completed the website assessment at 3 months and 12 months. Figure 1 and Table 2 give an overview of all measurements. Site researchers will be blind to treatment allocation, but will be available to participants to follow up risk and answer technical queries. Participants receive honorariums for the completion of each follow-up assessment.
Randomisation, intervention delivery and masking
Participants will be randomised (in a 1:1:1 ratio) to the three intervention arms within each trial. Randomisation will be conducted automatically by means of a custom-built secure web service created and managed by the Exeter Clinical Trials Unit (ExeCTU), which interfaces with the trial database. To promote balance across key participant characteristics across intervention arms, randomisation will be minimised according to recruitment country (UK, Spain, Germany, Belgium), age (under 18 years old versus 18 years or older), and gender (male, female, both, neither). The minimisation algorithm will retain a stochastic element and the first 50 participants (PREVENT) and 150 (PROMOTE) will be allocated to their intervention arm by simple random allocation.
All of the online recruitment and randomisation will be automated and independent of trial researchers. The ExeCTU database will automatically send Monsenso (the app developer) the email address of the participant, their language and the version of the app that the participant is randomised to (control, active control or personalised EC version), enabling the participant to be set up with an account on the app. The online randomisation procedure will generate a unique trial identification code that is linked to the account on the app. All assessments will be routinely collected online using the assessment website following automated reminders, without the involvement of researchers. Site researchers will be blind to treatment allocation. Site researchers will prompt all participants to complete follow ups by phone, text and email if they do not respond to the automated reminders. Any unblinding in contact with a site researcher would be logged as protocol violations and only a researcher that remained blind will be able to prompt future follow-up from that participant.
Usual practice self-monitoring control
This control is carrying on in the prospective cohort, that is, usual practice plus the default basic version of the app featuring self-monitoring and the regular assessments within the cohort. Self-monitoring will include daily mood ratings and an ecological momentary assessment option (MoodTracker) for more detailed analysis of mood, activity and situational context. This self-monitoring is intended to help young people learn more about their emotional experiences and what influences them. Usual practice, as received by the young person outside of the trial, may include no provision of intervention, local provision of intervention, support from their GP/family doctor, local health services or youth services, or provision of intervention within their educational institution (e.g., well-being service at university; support and welfare staff at school). The nature of usual practice will be monitored and assessed by questionnaires at each follow-up assessment, determining what treatment and services participants have received since the last assessment.
Non-personalised digital self-help using generic CBT principles (active control group)
The active control will be a non-personalised digital self-help based on generic principles derived from cognitive behaviour therapy (CBT) for promoting mental well-being and for preventing poor mental health. This self-help app will use well-established generic cognitive-behavioural principles, including tips, advice, strategies and psychoeducation including on behavioural activation to increase positive activities, problem-solving and spotting and challenging negative thoughts, proven in RCTs to reduce symptoms of depression and anxiety and to promote well-being in young adults via online delivery [7, 8]. It will be delivered via an app using the same features, menu and structure as the personalised EC self-help to make the interventions as similar and as consistent in delivery as possible and to enable the interventions to be matched for delivery and format.
Personalised digital EC self-help (experimental intervention group)
The experimental arm is Emotional Competence (EC) self-help incorporating mobile smartphone application (app) delivery. As described earlier, there are four potential components focusing on different EC component processes: (i) improving accurate and functional emotion production via enhancing appraisals of achievement situations emphasizing increased perceived control and realistic perceived value (Achievement Appraisal); (ii) improving accurate and functional emotion production via training positive interpretations of ambiguous social events (Social Appraisal); (ii) improving emotional regulation by reducing maladaptive worry and rumination and replacing with constructive alternatives and problem-solving (Rumination); and (iv) enhancing emotional knowledge and perception through psychoeducation and learning tasks (Emotion Knowledge). The personalised digital EC self-help provides psychoeducation, tips, advice, exercises and training for each individual on the two EC components deemed to be most appropriate based on the baseline assessment. The app will include text, pictures, audio-recordings, animations, audio-exercises to practice (e.g., self-compassion), questionnaires with tailored feedback, quizzes, and gamification (e.g., badges, rewards, feedback). It will feature a menu structure including a dashboard to monitor notifications and progress, an explore function to graph the self-monitoring responses made by the participant, Challenges that provide learning exercises, and Tools that are brief strategies that young people can use in the moment when they need them. Within the app to support enhancing emotion knowledge, an innovative feature will be explored involving voluntarily provided audio-recordings being used to provide estimated feedback on perceived emotional arousal and dominance dimensions by machine learning techniques.
The app will be designed for iOS and Android use. All versions of the EC personalized self-help app will include the default self-monitoring features (including a regular daily mood rating and ecological momentary assessment) and gamification. To increase adherence on the app, completion of self-monitoring, Challenges (learning exercises) and Tools (practice of strategies) are each gamified, with badges earnt for progress on each and with electronic vouchers earnt when groups of badges are completed.
In recognition that behavioural intervention technologies rapidly evolve over time and that the technological instantiation can require debugging, updates, and enhancements of user interface, we will explicitly adopt the Trial of Intervention Principles approach . This approach distinguishes between the underlying principles and behavioural strategies of a psychological intervention (e.g., goal setting, habit change), which need to remain unchanged to maintain trial integrity and robustness, and the specific technological instantiation of these principles (e.g., specific user flow, user experience and design), which can potentially change without compromising trial integrity. This provides the possibility to update the app – to correct bugs, upgrade systems and user interface – as long as any changes remain consistent with our a priori operationalisation of treatment principles and subject to independent agreement from our independent External Advisory Board.
The use of the app will be assessed and recorded including number of times the app is used and the number of badges received in the gamification system. A minimum intervention dose for the EC and CBT self-help arms (treatment compliance) will be defined a priori, based on the principle that users will benefit from learning new ideas (completing Challenges) and practising new skills (completing Tools). All participants in the usual practice self-monitoring control are defined as receiving the minimum intervention dose.
Outcomes will be assessed at baseline (pre-randomisation) and 1, 3, and 12 months post-randomisation.
The primary outcome measure for ECoWeB-PROMOTE will be the 14-item Warwick-Edinburgh Mental Well Being Scale (WEMWBS) [67, 68], a leading validated self-reported index of well-being with excellent psychometric properties, at 3-month follow-up (the primary endpoint).
The primary outcome measure for ECoWeB-PREVENT will be the state depression score of the participants on the Patient Health Questionnaire-9 (PHQ-9) , a well-validated measure of depression at 3-month follow-up (the primary endpoint).
Secondary outcomes include: PHQ-9  (for ECoWeB-PROMOTE), WEMWBS  (for ECoWeB-PREVENT). The Generalized Anxiety Disorder-7 (GAD-7) questionnaire will be used to assess anxiety symptoms . The Work and Social Adjustment Scale (WSAS)  will be used to measure functioning with respect to work/education, home management, social leisure, private leisure and close relationships each rated from 0 not at all impaired to 8 severely impaired. Health-related quality of life will be assessed by the EuroQol instrument EQ-5D-3L . The Adult Service Use Schedule (ADSUS-adapted) [73, 74] will be adapted for adolescents and young adults and is a well-established measure within the health economics field used to index relevant health and social care costs for trial participants. The Adverse Events Questionnaire is a brief measure designed to assess stressful events in young people across the domains of academic study, relationships, other bad experiences, hassles, which is proven to predict subsequent depression .
Emotional competence skills
Different Emotional Competence skills are assessed through a battery of well-validated questionnaires and tasks, adapted and shortened for web-use: a validation study across all four countries determined shortened versions that maintained good psychometric properties. EC skills are assessed to allocate individuals to ECoWeB-PROMOTE or ECoWeB-PREVENT trials, to inform personalisation of treatment where applicable, as a manipulation check that interventions influence the targeted EC, and as potential mediators of intervention effect.
Emotion Knowledge and Perception: a brief version of the Components of Emotional Understanding Task (CEUT)  is used to assess understanding of all five emotion components of the Componential Emotion Approach (appraisals, action tendencies, bodily reactions, expression, subjective feelings). Participants read a series of emotion eliciting situations that describe potential emotional components, which the participant then rates for likelihood. The CEUT has good reliability and convergent validity.
The brief version of the Geneva Emotion Recognition Test (GERT-S)  is used to assess emotion perception: it is a 20-item performance-based emotion recognition test in which participants view short video clips of actors expressing 14 different emotions and then report which emotion had been expressed.
Emotion Production: To assess different components of appraisals, we will use (a) a shortened Emotional Disposition (EmoDis) tool  which asks participants to imagine experiencing four standardized emotional scenarios and rate their appraisals on three dimensions and the strength of three emotions; (b) a 4-item version of the Control Belief Scale which measures beliefs about one’s control, power and personal efficacy ; (c) abbreviated versions of the Perceived Academic Control scale ; Growth Mindset Scale  and Academic Value scales  to assess appraisals in achievement settings and intrinsic, utility, and attainment value. We will also use an abbreviated Achievement Emotions Questionnaire  to assess common emotions (enjoyment, anxiety, hopelessness, boredom) in different achievement contexts (school, university, work); the Rejection Sensitivity Questionnaire (ARSQ)  to assess concerns and expectations of the likelihood of rejection versus acceptance in social scenarios.
Emotion Regulation: Indices of emotion regulation will focus on repetitive negative thought in the form of worry and rumination: (a) the 5-item brooding subscale of the Ruminative Response Scale , a well-established measure of unhelpful rumination, which predicts subsequent depression; (b) the Penn State Worry Questionnaire -Abbreviated (PSWQ-A) , a well-validated 8-item measure of trait tendency towards worry.
The following descriptive variables will be assessed only at baseline: country of residence, age, gender, educational level, family’s occupational status, country of birth.
Because ECoWeB-PROMOTE and ECoWeB-PREVENT have different primary outcomes, the sample size for each trial was calculated using the respective primary outcome based on a minimum clinically important difference (MCID). The primary outcome for ECoWeB- PROMOTE is WEMWBS, which has a recommended MCID of 3.0 units . This is based on observed smallest differences in prior studies and the lowest value greater than the observed standard error of measurement . It was also the observed difference between a minimal self-help online CBT treatment and waiting list control at the 12-week endpoint for adults . A standard deviation (SD) of 11.3 units is the most conservative estimate . Using these values, with 90% power and a statistical significance threshold of 0.05, the sample size required for a 2-arm comparison would be 300 participants per arm. Accounting for 40% attrition at 3-month follow-up (the primary follow-up timepoint), a total of 500 participants per arm are required. Therefore, across the three arms of the trial, 1500 participants are required.
The primary outcome for ECoWeB-PREVENT is PHQ-9, which has an established MCID of 2.59 and SD of 5.4 . Using the same power requirements as for ECoWeB-PROMOTE, the sample size required per arm is 93 participants. Accounting for 40% attrition at 3-month follow-up, 155 participants per arm are required, producing a total of 465 participants across the three arms.
A top level cohort, comprising young adults eligible for either trial, and assuming 70% eligible for ECoWeB-PROMOTE versus 30% for ECoWeB-PREVENT, will require 2142 participants (i.e., to achieve 1500 participants for PROMOTE, estimate to recruit 642 participants for PREVENT). For all participants recruited within the first 2 months from start of recruitment, we will calculate loss to 3-month follow-up and should it exceed 40%, we will re-adjust the sample size accordingly. In the event of loss to follow-up being less than 40%, the sample size will not be reduced.
Statistical analysis plan
The primary analyses will be intention-to-treat (ITT) analyses  (i.e. all participants will be included in the analyses according to their randomised allocation) and based on complete case outcome data. The primary inferential analyses will compare across trial arms for the primary and continuous secondary outcomes at 3-months follow up using linear or logistic regression models with adjustment for baseline score, age (as a continuous variable rather than the dichotomised minimisation variable), country, and any other participant characteristics observed at baseline to be unbalanced across treatment arms.
A number of secondary analyses will be undertaken:
Complier Average Causal Effect (CACE) analysis [92, 93] to provide an estimate of a treatment effect accounting for pre-specified per protocol adherence and compliance with the treatment, whilst retaining the benefits of randomisation. Such models will be performed for the continuous primary and secondary outcomes at 3- and 12-month follow-up using observed data only, and will include the covariates adjusted for in the linear regression models.
Repeated measures analyses (using a mixed effects linear regression model with a random effect on participant) will be used to compare for primary and secondary outcomes across all follow up points of 1, 3 and 12 months, including data from participants with observed data for at least one of the three follow-up timepoints. Analyses will be performed to compare both active interventions with usual care, and to compare the personalised active intervention with the standard active intervention. A fixed effect interaction between timepoint and trial arm will be used to evaluate differential treatment effects across timepoints. Adjustments for baseline covariates will be made as for the primary analysis regression models; baseline score will be included as a covariate. Binary outcome measures will be analysed using logistic regression models with adjustments for covariates as above.
The pattern of missing outcomes will be examined and multiple imputation will be used to impute primary and secondary continuous outcomes. Imputation models will be informed by treatment arm, baseline scores, other covariates to be included in the model, and other baseline characteristics found to predict outcome or propensity for missingness (logistic regression models will be used to investigate the associations between baseline characteristics and missingness). Results of imputed models will be compared to primary analysis complete case ITT models.
Mediation analyses will be undertaken to gain insight into mechanisms that could explain the potential effect of the interventions on primary outcomes. We will use modern causal inference methods using structural equation modelling or parametric regression models to assess mediation effects  including through changes in the EC variables. In addition, we will investigate potential moderation of the interventions by site, age, and sex.
Analyses will be undertaken by a statistician blinded to group allocation and using Stata v.15.
Health economic analysis plan
The economic analyses will use a cost-consequence approach  for each country in the study, using a 12 month time horizon. Health and social care utilisation will be identified and collected using an adapted version of the Adult Service Use Schedule (AD-SUS) questionnaire, which quantifies the use of healthcare resources, use of medication and employment and time off work over the trial including follow up . Adaptation will include time away from school or college together with changes to the wording to ensure relevance across the four countries. Unit costs of health and social care will be taken from appropriate national publications to reflect differences in costs between countries. Productivity losses will be valued using the human capital approach . Wage rates for each country will be derived from European sources such as Eurostat. Outcomes will be assessed using the EQ-5D-3L , which will be converted to utility values using the EuroQoL general population tariff values for each country. Analyses will be on the intention-to-treat basis, and will be based on observed data only. Within country analyses of the differences between the trial arms will be undertaken. Although the distribution of costs is commonly skewed in populations of this kind, analyses will compare mean costs between groups using standard parametric regression models adjusted for minimisation variables and baseline costs. The robustness of the parametric tests will be confirmed using bias-corrected, non-parametric bootstrapping [97, 98]. As with primary and secondary outcomes, between group differences in costs and EQ-5D-3L will be presented as means and 95% CIs using Stata v15. Given the differences in cost structures (health and social care, and wage rates) and differences in the population tariffs between countries, no formal analyses of differences between costs and utility values between countries will be undertaken. However, the differences between the number and type of resource use and days away from education or work and employment will be examined.
During the cmRCT, implementation science approaches will examine the feasibility, fidelity, and acceptability of the interventions and examine the sustainability of uptake, pathways to increased uptake and usage, and potential barriers and obstacles to implementation. This process evaluation will identify enablers and barriers to the EC approach and conditions for implementation. The Consolidated Framework for Implementation Research (CFIR)  model will be used to examine the key domains of relevance and mediators and moderators for the implementation of the EC and CBT self-help apps. We will use a mixed methods approach, with quantitative and qualitative methods  combined with pragmatic measures, consistent with the MRC framework for developing and evaluating complex interventions [101, 102] and with constructs incorporating Theory of Change approaches . Thirty to forty participants will be interviewed immediately post-intervention and at their 3 month follow-up, matching to their quantitative data collection points to reduce Hawthorne effects and to facilitate data integration at the analysis stage. We will ask about the following implementation outcomes for personalized EC and control interventions: Feasibility (e.g., how easy/difficult is it for young people to do this intervention; do they complete it?); Fidelity (e.g. how consistently is it experienced across the different settings?); Penetration (e.g., how well has it reached those young people for whom it has been primarily designed?); Acceptability (e.g., do young people like to use it? Is it more acceptable in certain cultural groups?); Sustainability (e.g., How well can it continue to be made available to relevant young people?); Cost (e.g., what is the intervention’s potential economic impact on downstream health service use, educational attainment and employment). Exact subgroups will be informed by the development phase and early app usage statistics during the trials.
Organization, quality assurance and data management
Research data will be automatically collected in a pseudonymised manner through an electronic data capture system delivered from the website through to the central study database. In the first instance all participants will be directed to the website to provide their data. Questionnaires from respondents who prefer a paper version or who respond to follow-ups by telephone will be entered into the system by a site researcher research assistant and this variation in data collection method will be recorded. All data will be kept securely and confidentially and only accessed by specified researchers in each trial site. The central data-management team will use de-identified backups for the monitoring of the overall progress and data quality. Ultimately, a comprehensive de-identified dataset will be produced that includes data from all four research sites.
In recent years, improving the mental health of young people has been identified as a global health priority [4, 104]. Improving the mental health of young people includes both the prevention of poor mental health, such as the onset of anxiety and depression, and the promotion of increased well-being. Effective approaches to improve prevention and well-being promotion need to be widely accessible and highly scalable so that they can be reach large numbers of young people. One potential approach to delivering a scalable intervention is through the use of mobile apps (m-health) as the majority of young people regularly use mobile devices.
Whilst there is emergent evidence that mental health apps can be beneficial, to date the majority of apps available have not been tested in controlled trials and those that have been tested have been examined in relatively small samples. Large-scale intervention studies to establish the true impact of m-health apps on the promotion of well-being and the prevention of poor mental health are therefore needed specific to this age group.
The ECoWeB trial is an important contribution to this field by aiming to deliver one of the largest randomized controlled trials (n = 2142) to specifically examine the efficacy of m-health apps on the promotion of well-being and the prevention of poor mental health in 16–22 year olds across four European countries. More specifically, the study evaluates the efficacy of two different m-health strategies – a personalised self-help EC training smartphone app versus a generic CBT self-help smartphone app. As such, the ECoWeB trial will contribute to our knowledge of the efficacy and acceptability of different self-help mobile apps to improve mental health in young people. Moreover, ECoWeB is one of the first mental health trials to incorporate a personalization element as a test of whether a personalised approach can enhance outcomes relative to established generic interventions. In the personalised self-help EC training condition, participants will receive components matched to their respective abilities in emotional competence skills, to test if such matching improves treatment efficacy and usage compared to a standard non-matched intervention.
Because the trial is conducted across four distinct European states (UK, Germany, Spain, Belgium), it is envisaged that any findings could be generalised more broadly for young people across Europe and potentially around the world. By including repeated measurement of EC skills, mental well-being, and symptoms of anxiety and depression across the longitudinal cohort of the study, we also hope to learn more about the relative interaction of EC skills, well-being and mental health. For example, the trial design will enable us to determine which m-health strategies do improve EC skills, and whether this improvement in EC skills in turn predicts improvements in well-being. We hope that the lessons gained from the trial will enable the further development and enhancement of evidence-based m-health self-help strategies to promote well-being and prevent poor mental health in young people, and thereby contribute to addressing the priority of improving mental health in young people.
Availability of data and materials
Anonymised datasets arising from this trial will be made available after the primary outcomes are published to researchers and other groups via request to a data committee within the Consortium via the University of Exeter’s open access data system Open Research Exeter (ORE). ECoWeB partners will have access to the final trial dataset, commensurate with the grant Consortium Agreement. The results will additionally be updated on ClinicalTrials.gov Identifier: NCT04148508. The ECoWeB consortium plans to communicate trial results through peer-reviewed open access publications and direct reports to TSC, sponsor, and participants.
Complier average causal effect
Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition
Generalized Anxiety Disorder-7
Major depressive disorder
National Institute for Health Research
NHS National Research Ethics Service
Patient Health Questionnaire
Research control trial
Trial Steering Committee
Thapar A, Collishaw S, Pine DS, Thapar AK. Depression in adolescence. Lancet. 2012;379(9820):1056–67.
Kessler RC, Berglund P, Demler O, Jin R, Walters EE. Lifetime prevalence and age-of-onset distributions' of DSM-IV disorders in the national comorbidity survey replication. Arch Gen Psychiatry. 2005;62(6):593–602.
Mehta N, Croudace T, Davies SC. Public mental health: evidenced-based priorities. Lancet. 2015;385(9976):1472–5.
Patton GC, Sawyer SM, Ross DA, Viner RM, Santelli JS. From advocacy to action in global adolescent health. J Adolesc Health. 2016;59(4):375–7.
Royal College of Psychiatrists. No health without public mental health; 2010.
Durlak JA, Weissberg RP, Dymnicki AB, Taylor RD, Schellinger KB. The impact of enhancing Students' social and emotional learning: a meta-analysis of school-based universal interventions. Child Dev. 2011;82(1):405–32.
Clarke AM, Kuosmanen T, Barry MM. A systematic review of online youth mental health promotion and prevention interventions. J Youth Adolesc. 2015;44(1):90–113.
Hetrick SE, Cox GR, Witt KG, Bir JJ, Merry SN. Cognitive behavioural therapy (CBT), third-wave CBT and interpersonal therapy (IPT) based interventions for preventing depression in children and adolescents. Cochrane Database Syst Rev. 2016;8:332.
Merry SN, Hetrick SE, Cox GR, Brudevold-Iversen T, Bir JJ, McDowell H. Psychological and educational interventions for preventing depression in children and adolescents. Cochrane Database Syst Rev. 2011;12:277.
Stockings EA, Degenhardt L, Dobbins T, Lee YY, Erskine HE, Whiteford HA, et al. Preventing depression and anxiety in young people: a review of the joint efficacy of universal, selective and indicated prevention. Psychol Med. 2016;46(1):11–26.
Mehu M, Scherer KR. The appraisal bias model of cognitive vulnerability to depression. Emot Rev. 2015;7(3):272–9.
Scherer KR. When and why are emotions disturbed? Suggestions based on theory and data from emotion research. Emot Rev. 2015;7(3):238–49.
Scherer KR. The dynamic architecture of emotion: evidence for the component process model. Cognit Emot. 2009;23(7):1307–51.
Castro VL, Cheng YH, Halberstadt AG, Gruhn D. EUReKA! A conceptual model of emotion understanding. Emot Rev. 2016;8(3):258–68.
Castro VL, Cooke AN, Halberstadt AG, Garrett-Peters P. Bidirectional linkages between emotion recognition and problem behaviors in elementary school children. J Nonverbal Behav. 2018;42(2):155–78.
Sanchez-Alvarez N, Extremera N, Fernandez-Berrocal P. The relation between emotional intelligence and subjective well-being: a meta-analytic investigation. J Posit Psychol. 2016;11(3):276–85.
Schutte NS, Malouff JM, Thorsteinsson EB, Bhullar N, Rooke SE. A meta-analytic investigation of the relationship between emotional intelligence and health. Personal Individ Differ. 2007;42(6):921–33.
Sheppes G, Suri G, Gross JJ. Emotion regulation and psychopathology. In: Cannon TD, Widiger T, editors. Annu Rev Clin Psychol. 2015;11:379–405.
Zeidner M, Matthews G, Roberts RD. The emotional intelligence, health, and well-being nexus: what have we learned and what have we missed? Appl Psychology-Health Well Being. 2012;4(1):1–30.
European Science Foundation. Personalised medicine for the European citizen: towards more precise medicine for the diagnosis, treatment and prevention of disease; 2012.
Schueller SM, Munoz RF, Mohr DC. Realizing the potential of behavioral intervention technologies. Curr Dir Psychol Sci. 2013;22(6):478–83.
Kazdin AE. Technology-based interventions and reducing the burdens of mental illness: perspectives and comments on the special series. Cogn Behav Pract. 2015;22(3):359–66.
Torous J, Roberts LW. Needed innovation in digital health and smartphone applications for mental health transparency and trust. JAMA Psychiat. 2017;74(5):437–8.
Bakker D, Kazantzis N, Rickwood D, Rickard N. Mental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments. JMIR Ment Health 2016;3(1):e7.
Donker T, Petrie K, Proudfoot J, Clarke J, Birch MR, Christensen H. Smartphones for smarter delivery of mental health programs: a systematic review. J Med Internet Res. 2013;15(11):13.
Sucala M, Cuijpers P, Muench F, Cardos R, Soflau R, Dobrean A, et al. Anxiety: there is an app for that. A systematic review of anxiety apps. Depress Anxiety. 2017;34(6):518–25.
Torous J, Andersson G, Bertagnoli A, Christensen H, Cuijpers P, Firth J, et al. Towards a consensus around standards for smartphone apps and digital mental health. World Psychiatry. 2019;18(1):97–8.
Firth J, Torous J, Carney R, et al. Digital Technologies in the Treatment of Anxiety: Recent Innovations and Future Directions. Curr Psychiatry Rep. 2018;20(6):44.
Firth J, Torous J, Nicholas J, Carney R, Pratap A, Rosenbaum S, et al. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry. 2017;16(3):287–98.
Relton C, Torgerson D, O'Cathain A, Nicholl J. Rethinking pragmatic randomised controlled trials: introducing the "cohort multiple randomised controlled trial" design. Br Med J. 2010;340:7.
Nolen-Hoeksema S, Watkins ER. A heuristic for developing Transdiagnostic models of psychopathology: explaining multifinality and divergent trajectories. Perspect Psychol Sci. 2011;6(6):589–609.
Nolen-Hoeksema S, Wisco BE, Lyubomirsky S. Rethinking rumination. Perspect Psychol Sci. 2008;3(5):400–24.
Watkins. Constructive and unconstructive repetitive thought. Psychol Bull. 2008;134(2):163–206.
Alloy LB, Abramson LY, Whitehouse WG, Hogan ME, Tashman NA, Steinberg DL, et al. Depressogenic cognitive styles: predictive validity, information processing and personality characteristics, and developmental origins. Behav Res Ther. 1999;37(6):503–31.
Pekrun R. The control-value theory of achievement emotions: assumptions, corollaries, and implications for educational research and practice. Educ Psychol Rev. 2006;18:315–41.
Hamm JM, Perry RP, Chipperfield JG, Murayama K, Weiner B. Attribution-based motivation treatment efficacy in an online learning environment for students who differ in cognitive elaboration. Motiv Emot. 2017;41(5):600–16.
Hamm JM, Perry RP, Clifton RA, Chipperfield JG, Boese GD. Attributional retraining: a motivation treatment with differential psychosocial and performance benefits for failure prone individuals in competitive acheivement settings. Basic Appl Soc Psychol. 2014;36:221–37.
Perry RP, Hechter FJ, Menec VH, Weinberg LE. Enhancing achievement-motivation and performace in college students – an attributional retraining perspective. Res High Educ. 1993;34(6):687–723.
Paunesku D, Walton GM, Romero C, Smith EN, Yeager DS, Dweck CS. Mind-set interventions are a scalable treatment for academic underachievement. Psychol Sci. 2015;26(6):784–93.
Yeager DS, Hanselman P, Walton GM, Murray JS, Crosnoe R, Muller C, et al. A national experiment reveals where a growth mindset improves achievement. Nature. 2019;573(7774):364−+.
Miu AS, Yeager DS. Preventing symptoms of depression by teaching adolescents that people can change: effects of a brief incremental theory of personality intervention at 9-month follow-up. Clin Psychol Sci. 2015;3(5):726–43.
Schleider J, Weisz J. A single-session growth mindset intervention for adolescent anxiety and depression: 9-month outcomes of a randomized trial. J Child Psychol Psychiatry. 2018;59(2):160–70.
Schleider JL, Weisz JR. Reducing risk for anxiety and depression in adolescents: effects of a single-session intervention teaching that personality can change. Behav Res Ther. 2016;87:170–81.
Lazowski RA, Hulleman CS. Motivation interventions in education: a meta-analytic review. Rev Educ Res. 2016;86(2):602–40.
Hulleman CS, Harackiewicz JM. Promoting interest and performance in high school science classes. Science. 2009;326(5958):1410–2.
Platt B, Kadosh KC, Lau JYF. The role of peer rejection in adolescent depression. Depress Anxiety. 2013;30(9):809–21.
Hallion LS, Ruscio AM. A meta-analysis of the effect of cognitive bias modification on anxiety and depression. Psychol Bull. 2011;137(6):940–58.
Jones EB, Sharpe L. Cognitive bias modification: a review of meta-analyses. J Affect Disord. 2017;223:175–83.
Mathews A, Mackintosh B. Induced emotional interpretation bias and anxiety. J Abnorm Psychol. 2000;109(4):602–15.
Krebs G, Pile V, Grant S, Esposti MD, Montgomery P, Lau JYF. Research review: cognitive bias modification of interpretations in youth and its effect on anxiety: a meta-analysis. J Child Psychol Psychiatry. 2018;59(8):831–44.
Cristea I, Kok RN, Cuijpers P. The efficacy of cognitive bias modification interventions for mental health problems: a meta-analysis. Eur Psychiatry. 2015;30:1.
Cristea IA, Mogoase C, David D, Cuijpers P. Practitioner review: cognitive bias modification for mental health problems in children and adolescents: ameta-analysis. J Child Psychol Psychiatry. 2015;56(7):723–34.
Watkins ER. Rumination-focused cognitive-behavioral therapy for depression. New York: Guilford Press; 2016.
Watkins ER, Mullan E, Wingrove J, Rimes K, Steiner H, Bathurst N, et al. Rumination-focused cognitive-behavioural therapy for residual depression: phase II randomised controlled trial. Br J Psychiatry. 2011;199(4):317–22.
Watkins ER, Taylor RS, Byng R, Baeyens C, Read R, Pearson K, et al. Guided self-help concreteness training as an intervention for major depression in primary care: a phase II randomized controlled trial. Psychol Med. 2012;42(7):1359–71.
Hvenegaard M, Moeller SB, Poulsen S, Gondan M, Grafton B, Austin SF, et al. Group rumination-focused cognitive-behavioural therapy (CBT) v. group CBT for depression: phase II trial. Psychol Med. 2020;50(1):11–19.
Topper M, Emmelkamp PMG, Watkins E, Ehring T. Prevention of anxiety disorders and depression by targeting excessive worry and rumination in adolescents and young adults: a randomized controlled trial. Behav Res Ther. 2017;90:123–36.
Cook L, Mostazir M, Watkins E. Reducing stress and preventing depression (RESPOND): randomized controlled trial of web-based rumination-focused cognitive behavioral therapy for high-Ruminating University students. J Med Internet Res. 2019;21(5):18.
Schlegel K, Fontaine JRJ, Scherer KR. The Nomological network of emotion recognition ability evidence from the Geneva emotion recognition test. Eur J Psychol Assess. 2019;35(3):352–63.
Schlegel K, Grandjean D, Scherer KR. Introducing the Geneva emotion recognition test: an example of Rasch-based test development. Psychol Assess. 2014;26(2):666–72.
Schulz KF, Altman DG, Moher D, Grp C. CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials. Ann Intern Med. 2010;152(11):726–W293.
Grant S, Mayo-Wilson E, Montgomery P, Macdonald G, Michie S, Hopewell S, et al. CONSORT-SPI 2018 explanation and elaboration: guidance for reporting social and psychological intervention trials. Trials. 2018;19:406.
Eysenbach G. CONSORT-EHEALTH Group CONSORT-EHEALTH: Improving and Standardizing Evaluation Reports of Web-based and Mobile Health Interventions. J Med Internet Res. 2011;13(4):e126.
Bot M, Middeldorp CM, de Geus EJC, Lau HM, Sinke M, van Nieuwenhuizen B, et al. Validity of LIDAS (LIfetime depression assessment self-report): a self-report online assessment of lifetime major depressive disorder. Psychol Med. 2017;47(2):279–89.
Hankin BL, Young JF, Gallop R, Garber J. Cognitive and interpersonal vulnerabilities to adolescent depression: classification of risk profiles for a personalized prevention approach. J Abnorm Child Psychol. 2018;46(7):1521–33.
Mohr DC, Schueller SM, Riley WT, Brown CH, Cuijpers P, Duan N, et al. Trials of intervention principles: evaluation methods for evolving behavioral intervention technologies. J Med Internet Res. 2015;17(7).
Stewart-Brown S, Platt S, Tennant A, et al. The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): a valid and reliable tool for measuring mental well-being in diverse populations and projects. J Epidemiol Community Health 2011;65:A38–A39.
Tennant R, Hiller L, Fishwick R, et al. The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): development and UK validation. Health Qual Life Outcomes. 2007;5:63.
Kroenke K, Spitzer RL, Williams JBW. The PHQ-9 - validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.
Spitzer RL, Kroenke K, Williams JBW, Lowe B. A brief measure for assessing generalized anxiety disorder - the GAD-7. Arch Intern Med. 2006;166(10):1092–7.
Mundt JC, Marks IM, Shear MK, Greist JH. The work and social adjustment scale: a simple measure of impairment in functioning. Br J Psychiatry. 2002;180:461–4.
Brooks R. EuroQol: the current state of play. Health Policy. 1996;37(1):53–72.
Byford S, Barrett B, Roberts C, Wilkinson P, Dubicka B, Kelvin RG, et al. Cost-effectiveness of selective serotonin reuptake inhibitors and routine specialist care with and without cognitive-behavioural therapy in adolescents with major depression. Br J Psychiatry. 2007;191:521–7.
Kuyken W, Hayes R, Barrett B, Byng R, Dalgleish T, Kessler D, et al. The effectiveness and cost-effectiveness of mindfulness-based cognitive therapy compared with maintenance antidepressant treatment in the prevention of depressive relapse/recurrence: results of a randomised controlled trial (the PREVENT study). Health Technol Assess. 2015;19(73):151.
Carver CS. Generalization, adverse events, and development of depressive symptoms. J Pers. 1998;66(4):607–19.
Sekwena EK, Fontaine JRJ. Redefining and assessing emotional understanding based on the componential emotion approach. South Afr J Psychol. 2018;48(2):243–54.
Schlegel K, Scherer KR. Introducing a short version of the Geneva emotion recognition test (GERT-S): psychometric properties and construct validation. Behav Res Methods. 2016;48(4):1383–92.
Scherer KR. Evidence for the Existence of Emotion Dispositions and the Effects of Appraisal Bias. PsyArXiv; 2019. Web.
Hoyosa R, Scherer KR. Measuring sense of control, power and self-efficacy. Unpublished report. 2020.
Perry RP, Hladkyj S, Pekrun RH, Pelletier ST. Academic control and action control in the achievement of college students: a longitudinal field study. J Educ Psychol. 2001;93(4):776–89.
Dweck CS. Mindset: the new psychology of success. New York: Random House; 2006.
Wigfield A. Expectancy-value theory of achievement motivation: a developmental perspective. Educ Psychol Rev. 1994;6(1):49–78.
Pekrun R, Goetz T, Frenzel AC, Barchfeld P, Perry RP. Measuring emotions in students' learning and performance: the achievement emotions questionnaire (AEQ). Contemp Educ Psychol. 2011;36(1):36–48.
Berenson KR, Gyurak A, Ayduk O, Downey G, Garner MJ, Mogg K, et al. Rejection sensitivity and disruption of attention by social threat cues. J Res Pers. 2009;43(6):1064–72.
Treynor W, Gonzalez R, Nolen-Hoeksema S. Rumination reconsidered: a psychometric analysis. Cogn Ther Res. 2003;27(3):247–59.
Hopko DR, Stanley MA, Reas DL, Wetherell JL, Beck JG, Novy DM, et al. Assessing worry in older adults: confirmatory factor analysis of the Penn State worry questionnaire and psychometric properties of an abbreviated model. Psychol Assess. 2003;15(2):173–83.
Putz REOH, K.; Taggart, F.; Steward-Brown, S. Using WEMWBS to measure the impact of your work on mental wellbeing: a practice-based user guide; 2012.
Maheswaran H, Weich S, Powell J, et al. Evaluating the responsiveness of the Warwick Edinburgh Mental Well-Being Scale (WEMWBS): Group and individual level analysis. Health Qual Life Outcomes. 2012;10:156.
Powell J, Hamborg T, Stallard N, Burls A, McSorley J, Bennett K, et al. Effectiveness of a web-based cognitive-behavioral tool to improve mental well-being in the general population: randomized controlled trial. J Med Internet Res. 2013;15(1):2–18.
Lowe B, Unutzer J, Callahan CM, Perkins AJ, Kroenke K. Monitoring depression treatment outcomes with the patient health questionnaire-9. Med Care. 2004;42(12):1194–201.
White IR, Carpenter J, Horton NJ. Including all individuals is not enough: lessons for intention-to-treat analysis. Clin Trials. 2012;9(4):396–407.
Angrist JD, Imbens GW, Rubin DB. Identification of causal effects using instrumental variables. J Am Stat Assoc. 1996;91(434):444–55.
Dunn G, Maracy M, Tomenson B. Estimating treatment effects from randomized clinical trials with noncompliance and loss to follow-up: the role of instrumental variable methods. Stat Methods Med Res. 2005;14(4):369–95.
Emsley R, Dunn G, White IR. Mediation and moderation of treatment effects in randomised controlled trials of complex interventions. Stat Methods Med Res. 2010;19(3):237–70.
Angelis A, Lange A, Kanavos P. Using health technology assessment to assess the value of new medicines: results of a systematic review and expert consultation across eight European countries. Eur J Health Econ. 2018;19(1):123–52.
Koopmanschap MA, Rutten FFH. A practical guide for calculating indirect costs of disease. Pharmacoeconomics. 1996;10(5):460–6.
Thompson SG, Barber JA. How should cost data in pragmatic randomised trials be analysed? Br Med J. 2000;320(7243):1197–200.
Barber JA, Thompson SG. Analysis of cost data in randomized trials: an application of the non-parametric bootstrap. Stat Med. 2000;19(23):3219–36.
Damschroder LJ, Aron DC, Keith RE, et al. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Sci. 2009;4:50.
Palinkas LA, Horwitz SM, Chamberlain P, Hurlburt MS, Landsverk J. Mixed-methods designs in mental health services research: a review. Psychiatr Serv. 2011;62(3):255–63.
Medical Research Council. Developing and evaluating complex interventions: guidance; 2008. https://mrc.ukri.org/documents/pdf/complex-interventions-guidance/.
Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. Bmj-British Medical Journal. 2015;350:h1258.
De Silva MJ, Breuer E, Lee L, Asher L, Chowdhary N, Lund C, et al. Theory of change: a theory-driven approach to enhance the Medical Research Council's framework for complex interventions. Trials. 2014;15:267.
World Health Organisation. Depression: a global public health concern; 2012. https://www.who.int/mental_health/management/depression/who_paper_depression_wfmh_2012.pdf.
Funding for this paper was provided by the Horizon 2020 ECoWeB project (grant agreement no. 754657). The study protocol was peer-reviewed by the funding body. The study sponsor and funder have no influence on the conduct, delivery or reporting of the research.
Ethics approval and consent to participate
Ethical and professional guidelines will be followed at all times, in line with Good Clinical Practice guidelines. Institutional review board approval has been obtained from Universitat Jaume I de Castellon, Spain (14th May 2019, Reference number CD/023/2019), Ludwig-Maximiliansuniversitaet Muenchen, Germany, (4th September 2019; reference number 19–468, 19–315), University of Exeter, (23rd July 2019, reference number eCLESPsy000048 v3.0) and University of Ghent, Belgium (17th October 2019, reference number 2019–1069).
The study is currently using trial protocol version 1.2. dated 6th April 2020. The trial sponsor is the University of Exeter, Exeter, UK. Protocol modifications are recorded and communicated to trial partners, sponsor, review boards and Trial Steering Committee (TSC).
A Trial Steering Committee (TSC) with independent experts in ethics, psychiatry, statistics and a representative from a patient’s association will provide independent oversight of the trial and expert advice, meeting every 6 months, and ensure that it is being conducted in accordance with the principles of Good Clinical Practice and the relevant regulations, including if necessary a subgroup forming a Data Monitoring Committee to review adverse events. Interim analyses will only be conducted at request of the DMC if there is a concern about harmful effects of intervention; based on these analyses, the DMC will decide if the trial or a particular intervention should be discontinued on the basis of participant well-being and safety.
Adverse events and other unintended effects of trial interventions or trial conduct will be self-reported on the website through open questions asking about any problems arising from participation, standardized questions about self-harm and symptoms at each follow up, healthcare use (including hospitalisation and emergency care) asked at the 3 and 12 month assessments, plus spontaneously reported feedback from participants. All serious adverse events will be reported to sponsor, ethics board and TSC within 2 working days for review. All adverse events are collated in a report for each TSC/DMC.
Each trial site has a risk and safety protocol, which includes action for ancillary care for participants with mental health disorders, including signposting to help, aiding with onward referrals, and contact with a clinician in the team. The sponsor has trial insurance that has provision for compensation for those who suffer harm from trial participation, in the unlikely event it is required.
All participants will provide written informed consent prior to baseline assessment. All participants can discontinue allocated interventions at their own choice and request.
Consent for publication
The authors declare no competing interests, except for MF, who is a co-founder and shareholder of Monsenso.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Newbold, A., Warren, F.C., Taylor, R.S. et al. Promotion of mental health in young adults via mobile phone app: study protocol of the ECoWeB (emotional competence for well-being in Young adults) cohort multiple randomised trials. BMC Psychiatry 20, 458 (2020). https://doi.org/10.1186/s12888-020-02857-w
- Young people
- Mobile-health prevention
- Randomised controlled trial
- Emotional competence