- Study protocol
- Open Access
ENgage YOung people earlY (ENYOY): a mixed-method study design for a digital transdiagnostic clinical – and peer- moderated treatment platform for youth with beginning mental health complaints in the Netherlands
BMC Psychiatry volume 21, Article number: 368 (2021)
The onset of mental disorders typically occurs between the ages of 12 and 25, and the burden of mental health problems is the most consequential for this group. Indicated prevention interventions to target individuals with subclinical symptoms to prevent the transition to clinical levels of disorders, even leading to suicide, have shown to be effective. However, the threshold to seek help appears to be high. Digital interventions could offer a solution, especially during the Covid-19 pandemic. This implementation study will investigate the digital indicated prevention intervention ENgage YOung people Early (ENYOY), the Dutch version of the original Moderated Online Social Therapy Platform (MOST+) from Australia. In addition, the relationship between stress biomarkers, symptoms and outcome measures of youth using the platform will be investigated in this study.
The MOST+ platform will be adapted, translated and developed for the situation in the Netherlands in collaboration with a Youth Panel. A prospective cohort of 125 young people (16–25 years) with beginning mental health complaints will be on the platform and followed for a year, of which 10 participants will have an additional smart watch and 10 participants will be asked to provide feedback about the platform. Data will be collected at baseline and after 3, 6 and 12 months. Outcome measures are Psychological Distress assessed with the Kessler Psychological Distress Scale (K10), Social and occupational functioning (measures by the SOFAS), positive mental health indicators measured by the Positive Health Instrument, stress biomarkers with a smart-watch, website journeys of visitors, and feedback of youth about the platform. It will be a mixed-method study design, containing qualitative and quantitative measures.
This trial will specifically address young people with emerging mental health complaints, and offers a new approach for treatment in the Netherlands. Considering the waiting lists in (child and adolescent)-psychiatry and the increase in suicides among youth, early low-threshold and non-stigmatizing help to support young people with emerging psychiatric symptoms is of crucial importance. Moreover, this project aims to bridge the gap between child and adolescent and adult psychiatry.
Netherlands Trial Register ID NL8966, retrospectively registered on the 19th of October 2020.
|Title||ENgage YOung people earlY (ENYOY): A mixed-method study design for a digital transdiagnostic clinical – and peer- moderated treatment platform for youth with beginning mental health complaints in the Netherlands.|
|Trial registration||Netherlands Trial Register number ID NL8966 (retrospectively registered 19/10/2020).|
|Protocol version||Protocol version 1.0, 30 September 2020|
|Funding||Financial funding by The Netherlands Organisation for Health Research and Development, for personnel, materials, and implementation. File number 60–63600–98-319|
van Doorn M 1, Popma A 1, van Amelsvoort T 2, McEnery C 34, Gleeson JF 45, Öry FG 6, Jaspers MWM 1, Alvarez-Jimenez M 34, Nieman DH 1|
1. Amsterdam UMC, Amsterdam, the Netherlands
2. Maastricht University, Department of Psychiatry and Neuropsychology Maastricht, the Netherlands
3. Centre for Youth Mental Health, The University of Melbourne, Australia
4. Orygen, Parkville, Victoria, Australia
5. Healthy Brain and Mind Research Centre, School of Behavioural and Health Sciences, Australian Catholic University, Melbourne, Australia
6. Buurtzorg Jong, Almelo, the Netherlands
|Name and contact information for the trial sponsor||
The Netherlands Organisation for Health Research and Development|
Laan van Nieuw Oost-Indië 334
2593 CE Den Haag, the Netherlands
2509 AE Den Haag, the Netherlands
Phone 070349 51 11
Fax 070349 51 00
Administered at the Kamer van Koophandel Den Haag (27365263).
The Netherlands Organisation for Health Research and Development is noted as Algemeen Nut Beogende Instelling (ANBI). Fiscal number: 0028.76.528.
|Role of sponsor||Monitoring function, check on progress of the study. The sponsor/investigator will submit a summary of the progress of the trial to the accredited METC once a year. Information will be provided on the date of inclusion of the first subject, numbers of subjects included and numbers of subjects that have completed the trial, serious adverse events/serious adverse reactions, other problems, and amendments.|
Background and rationale
About 1 in 4 individuals living in the western world suffer from a mental disorder in a given year , and more than half will meet the criteria for a mental disorder at some point in their life [2, 3]. Mental disorders account for a larger proportion of disability in developed countries than any other group of illnesses, including cancer and heart disease . The waiting lists to receive adequate mental care are constantly growing , and costs associated with mental disorders are considerable and rising (e.g. ). As an example, financial costs associated with mental disorders in the Netherlands are 4 billion euro annually,  not to mention the degree of human suffering these disorders induce in patients and their families . Studies show that the onset of most mental disorders commonly fall within the timeframe from early teens to mid-twenties [9, 10], negatively affecting quality of life , life expectancy  social functioning, ability to work , and (self-)stigmatization [11, 13, 14]. Even though a proportion of mental disorders in young people resolves without professional help in their late twenties, much pain, unrealised potential, disability, or premature death will have occurred by then. Physiological changes that occur during puberty strongly affect behaviour and emotional functioning, creating a disjunction between physical, intellectual, and psychosocial maturity . Adolescence and early adulthood is also a time of major structural and functional changes in the brain, driven by a series of maturational processes that result in the refinement of the neuronal circuitry and a recalibration of the inhibitory-excitatory balance, particularly in the frontal cortex . There is an urgency to reform our current mental health care system to address the needs of youth. Young people who are experts by experience indicated the following problems with current Dutch system of mental health care: 1) The focus is too much on diagnosing and treatment protocols while young people want to receive individualized help for their problem, 2) When young people receive a psychiatric diagnosis, treatment protocols are focused on that particular diagnosis while other problems are often left untreated (e.g. drug use, low self-esteem), 3) Many psychiatric services are not appealing to youth because people of all ages are treated there and the approach is not aligned with the needs of young people, 4) The threshold to seek professional help is high because of fear of stigma associated with mental illness, 5) The gap between youth and adult mental health services at age 18 hampers continuity of care [17, 18].
Prevention and early intervention are essential for reducing the psychosocial and economic impact of any potentially serious health condition [19, 20]. The preventive approach has worked well in many other fields of medicine such as oncology and cardiology, vastly improving prognosis (e.g. [21, 22]). However, in the Dutch system of mental health care, people need to get a DSM diagnosis to receive reimbursement for their healthcare costs, even though at the stage of a DSM diagnosis, a mental disorder has worsened and prognosis has deteriorated . Intervention in an earlier phase of possible onset of mental disorders is more effective than intervention after onset of a full-blown disorder, because psychosocial and neurobiological damage is less extensive and subjects are more responsive to treatment at this stage [19, 20, 24]. Due to the effectiveness of prevention and early intervention, clinical staging in psychiatry is receiving more attention worldwide [25, 26]. The model provides clear cut-offs between stages, making it usable in clinical practice . In the current project, we focus on youth in stages 1a: Help-seeking individuals with mild symptoms and mild functional impairment, and stage 1b: People with attenuated syndromes with partial specificity, often with mixed or ambiguous symptoms and moderate functional impairment. Inter-rater reliability of this model is good, with 90% concordance between experienced raters. See Table 1 for the full overview of the clinical stages.
Early detection and treatment of mental health complaints as well as personalized health care for young people have been successfully implemented in Australia guided by the leadership of Patrick McGorry with over 120 Headspace centres that aim to prevent chronicity and referral to specialized mental health services [28, 29]. Young people aged 12–25, and their family and friends can seek help for general health and education problems, drug use and (emerging) mental health complaints. Evidence-based interventions are provided in a stepped-care manner, i.e. the least invasive and harmless evidence-based interventions are employed first [15, 30, 31]. The Headspace model has bridged the traditional service gap between youth and adult mental health services by not cutting off access to services at age 18 .
However, several studies show only a third of young people seek help for their mental health problems [33, 34], and most individuals receive mental health care at a much later stage [35,36,37]. Since the step to seek help remains relatively large, within a national youth e-mental health service (eHeadspace Generation Next), Australia successfully implemented the Moderated Online Social Therapy (MOST+); an evidence based digital interactive peer and clinical moderated treatment platform for youth with beginning mental health problems . Inspired by the Australian Headspace approach, Headspace centres have been implemented in e.g. the Netherlands, Denmark and Ireland. However, the MOST+ platform has not been implemented yet in Europe. This project aims to support young people (between the ages of 16–25; and possibly at a later stage between the age of 12 and 25) with beginning mental health problems by translating, adjusting and implementing the MOST+ digital platform to the situation in the Netherlands in collaboration with a youth panel. For the Dutch version of the platform, we use the name ENgage YOung people earlY (ENYOY). Research shows that the MOST+ site leads to minimal drop out and enhances continuation of treatment effects [32, 38]. This model has the potential to realise the goal of specialized treatment by providing cost-effective, non-stigmatising, constantly available support to young people suffering from mental health problems.
Furthermore, the relation between stress and mental disorders, such as depression, has been subject of research  and less stress reactivity has been shown to predict symptom improvement in children with anxiety disorders . Different patterns in parasympathetic and sympathetic nervous system activation respond to different kinds of treatments. Thus, stress biomarkers could be useful for individualized prognosis and treatment selection . Developments in ambulatory sensor and information technology enable researchers to equip part of the young people who are on the platform with a smart-watch for minimally-invasive stress monitoring, aiming to clarify the relation between stress and their activities, and enhancing their autonomy, insight and resilience.
With this implementation study, we aim to reduce the chance that young people develop a serious mental disorder, escalation of problems with resulting chronicity and long treatment trajectories in the Netherlands. With a stepped care and positive psychology approach we strengthen the natural recovery potential of young people with emerging mental health complaints [8, 32]. We will use the following parameters to investigate the effects and functionality of the ENYOY platform in the Netherlands: 1) empowerment, psychosocial functioning, quality of life, hope and recovery, 2) mental symptoms of young people 3) stress biomarkers 4) user experiences. We will employ the formulation of health as “the ability to adapt and to self-manage” . In Australia over one-third of MOST+ clients had significant improvements in psychological distress (K10 ) and a similar proportion in psychosocial functioning (SOFAS ). Sixty per cent of clients showed significant improvement on one or both measures . Our hypothesis is that the project will attain similar results of improvement among young people in psychological distress and psychosocial functioning with ENYOY platform in the Netherlands. Additionally, stress is one of the most-studied pathways to mental disorders. Stress indicators may prove useful as biomarkers of psychopathology. This project will contribute to determining the utility of such biomarkers for prognosis and the development of new treatment options. We will assess stress parameters with a smart-watch and time series analysis [45, 46]. A significant reduction in stress parameters is expected at follow up. Another important objective in this project is to engage young people themselves to share their concerns, ideas and suggestions with the research team by enhancing participation of youth experts who experienced mental health problems and enable the project team to learn from their experience.
To investigate the effects of the adapted MOST+ platform in the Netherlands on empowerment, psychosocial functioning, quality of life, hope and recovery as well as mental symptoms of young people.
To investigate the utility of biomarkers for prognosis and the development of new treatment options.
To engage young people themselves to share their concerns, ideas and suggestions with the research team by enhancing participation of youth experts who experienced mental health problems and enable the project team to learn from their experience.
Analyze feedback of young people on the platform concerning usability, user friendliness, accessibility, acceptability, connection among peers, and contribution of the platform to the lessening of mental health complaints and increase of positive mental health.
This study has a longitudinal cohort mixed-method design (qualitative and quantitative research) and equivalence framework. It has a single group, therefore allocation-ratio is not applicable.
Methods: participants, interventions and outcomes
The study setting is a digital treatment environment (ENYOY). The Dutch participants will be recruited via Dutch the @ease centers in Amsterdam and Maastricht, plus via social media. The physical study site is the Amsterdam UMC, though most of the interviews with participants, measures, and conversation and measurements will take place online, partly because of the current COVID-19 pandemic.
- Age 16–25. The Amsterdam University Medical centres (IRB) requested to begin the study with young people aged 16–25 instead of 12–25. Possibly at a later stage in the study, after positive first results, the age-group 12–25 can be included.
- Help-seeking for mental health concerns in stages 1a or 1b.
- Being able and willing to consent.
- Mental disorder in clinical stages 2–4.
- Acute risk of self-harm requiring urgent intervention (i.e. suicidal ideation with a current plan and intent to enact this plan).
The interventions will be supported by expert mental health and peer moderators to ensure the safety of the intervention and to directly support participants with moderation, chats and referral to other forms mental health care if needed.
Who will take informed consent?
Once a young person shows interest in the study, the participant information and informed consent forms will be sent. The project staff will inform if this information is received, and after one week the young person will be asked if he/she has any questions, and wants to participate. If a young person wants to participate, an intake will take place to determine if the ENYOY platform would be helpful for the young person, or if other care is needed. If there is a match, within one week a research assistant from the project staff will obtain informed consent before the baseline measurements take place. When at a later stage inclusion of young people aged 12–25 is possible; a parent or guardian as well as the young person will sign informed consent.
The Australian MOST+ platform is based on evidence-based modules for mental health complaints, e.g. Cognitive Behavioral Therapy and mindfulness. Each participant will start on the platform with the ‘onboarding’ process. This is a process where clinical presenting issues and character strengths of the individual will be measured (based on Seligman’s positive psychology framework [47, 48] aligned with the empirically supported VIA questionnaire [49, 50]), following which the algorithm of the platform makes an individual tailored treatment journey suggestion for that person. The project group will consider the following modules (building blocks) of the MOST+ platform for translation and adaptation in the Netherlands:
Guided therapy journeys: A program of engaging evidence-based therapy (Mindfulness-Based Cognitive Therapy, Cognitive Behavioral Therapy, Meta-Cognitive Therapy, and Social-Cognition strategies) tailored to young person’s needs by automated processes and ENYOY therapists. For example, programs for social anxiety challenges, worrying or depressive symptoms where themed content can be curated to needs of individual. Transdiagnostic processes are found in the domains of attention, memory/imagery, thinking, reasoning and behavior. Activities within a therapy journey entail:
Reflective Actions: Behavioral or cognitive experiments to improve the ability to notice thought processes in order to build insight and self-awareness of these processes.
Regular Actions: Assist the young person trial learnings in real-world contexts, hereby generalizing adaptive coping strategies and behaviors (increasing self-efficacy and challenging cognitions via experiments).
Therapy Comics: Comics that offer an engaging, powerful and accessible means of understanding mental ill health challenges. Narratives offer young people new ways of negotiating the challenges of mental illness.
Talking Points: Subjects that provide young people with an opportunity to share their effective coping strategies. This encourages social problem solving and peer modeling/learning.
Strength-Based Actions: Actions to assist the young person to use their innate character strengths to overcome mental health challenges. Helps young person utilize their strengths (rather than emphasis on alleviating symptoms).
Myth Busters: Information to help challenge internal stigma and help normalize and validate young people’s experiences.
Fun Facts: Facts to provide psychoeducation on a particular topic, which can also assist with de-stigmatizing particular experiences.
Personalized therapy toolkit: A personal library of young person’s therapy work and favorite strategies. Therapy activities that are helpful are automatically saved to the toolkit, and young people can save content in their toolkit.
Safe online social network: A moderated virtual support network of other young people with a shared experience of mental health problems, there to support young persons if and when they need it on their recovery journey
Professional online support: A base wrap-around support from online peer workers and ENYOY therapists.
In summary the ENYOY platform will contain:
peer-to-peer online social networking;
individually tailored interactive psychosocial interventions;
involvement of expert mental health and peer moderators to ensure the safety of the intervention and to directly support participants with moderation, chats, and referrals to other forms of health care if needed.
Concerning clinical safety, the MOST+ safety protocol builds on the excellent track record of the Australian group managing 24/7 available digital social media interventions safely . Manual and automated procedures will be followed. Firstly, information related to clinical risk (posts or messages) will be screened twice daily by therapists. Secondly, MOST+ incorporates an automatic alert system which detects information consistent with increased risk of suicide (via automated monitoring of self-harm-related terms posted in the social feed using previously validated approaches . Any detected increased risk will activate the safety protocol. The therapist will conduct a telephone risk assessment and, where necessary, implement one or more of the following procedures: i) inform the treating clinician (if relevant); ii) inform nominated emergency contact; iii) liaise with suitable emergency services. Additional safety features include a reporting function for users and visible 24/7 emergency numbers. This safety protocol has been approved by three ethics committees and successfully implemented in four pilot studies and two ongoing RCTs . Concerning ICT safety, the platform has been adjusted to European laws and safety standards together with a privacy officer.
Criteria for discontinuing or modifying allocated interventions
If mental health complaints of a participant worsen, e.g. develop into stage 2 or above (see introduction), together with the participant the assigned clinical moderator and ENYOY team will look into finding more intensive care. This does not exclude them per se from the platform and current study; they can have additional help and still participate. The form and intensity of additional care will be logged. Following discontinuation, treatment will be offered on a “need for care-clinician’s choice” basis according to existing clinical practice guidelines. Wherever possible, subjects who discontinue the study prior to 12 months from entry will be followed with full regular assessments as per the subjects who continue with the protocol treatment.
Strategies to improve adherence to interventions
The adherence to the platform is continually measured by the platform itself. The clinical moderators have access to usage data as well as the percentage of the personal pathway completed. With the weekly check-up they have with each participant, this will be discussed. In weekly supervision sessions among clinical-, peer moderators, and supervisors adherence of participants will be discussed, and thought about ways to improve when found low.
Relevant concomitant care permitted or prohibited during the trial
All other forms of care, co-interventions, are permitted during the trial. Co-interventions will be registered with the treatment document sheet, and could be used for explorative analysis.
Data will be collected digitally using CASTOR at baseline and after 3, 6 and 12 months.
Psychological Distress assessed with the Kessler Psychological Distress Scale (K10, ).
Social and Occupational Functioning Assessment Scale (SOFAS, ).
Stress biomarkers with a smart-watch. Participating clients who are interested will receive a smart-watch that continuously monitors relevant physiological markers of stress during 3 weeks. Available technology (e.g. the TIQ watch E2) is validated, and can measure heart rate variability. In this way, both incidental and cumulative stress can be validly assessed in a naturalistic setting. The participants will receive a short introduction for use about the watch. They can check their stress under different circumstances to discover the relationship between their activities and stress. The watch could also be used during their visits to the ENYOY site to measure the changes in stress level during exercises on the platform, such as mindfulness exercises, self-compassion elements and the anxiety program.
“Websites journeys” of visitors (number of visits, number of selected activities etc.) will be collected. The website journeys will be anonymously logged under a system generated ID number and session number.
Open questions asked in an digital online meeting (using MS teams) regarding usability, user friendliness, accessibility, acceptability, connection among peers, and contribution of the platform. The focus will lie on subjective meaning-giving and context, thereby focusing on the individual. The experience and interpretation of the participants will be explored. The presented results will form descriptions and insights into the core constructs, and help improve the ENYOY platform further.
For the participant timeline, see Fig. 1. During the 12 months, participants can use the platform as much as needed.
Rickwood et al.  reported significant change (effect size Cohen’s d > .5) in the K10 and SOFAS between their first and last Headspace service ratings. In Australia over one-third of Headspace clients had significant improvements in psychological distress (K10 ) and a similar proportion in psychosocial functioning (SOFAS ). Sixty percent of clients showed significant improvement on one or both measures. These outcomes were derived from face-to-face services, however similar effects are suspected since a similar framework will be used. Using a paired samples t-test with 80% power and an alpha of 0.01, we would need a sample of 43 subjects to find similar results. Drop-out rates for digital treatment interventions for young people with beginning mental health complaints have been found to range between 2 and 73% . Inclusion of 125 subjects in the study would give us ample power to investigate our main hypothesis.
Due to the COVID-19 crisis, there are now too few face-to-face appointments and intakes in the Headspace and other participating centers. Therefore, young people will be recruited via social media and websites for young people as well. Young people aged 16–25 years (and possibly later 12–25 years) who show interest will receive an online intake via a secured environment (MS Teams). They will be assessed for the in- and exclusion criteria and demographic variables will be collected. When eligible, a second appointment will take place, where the informed consent can be signed, the first measurements take place (see flow diagrams above), and an account for the platform will be set up.
Data collection and management
Plans for assessment and collection of outcomes
To determine eligibility, a clinical interview and screening will take place. In intervision with a team of psychologist the operationalization of the clinical staging model  will be used to determine the stage of mental health problems.
The data on T0, T1, T2 and T3 will be collected in CASTOR, which enables safety and anonymous storing of outcomes. The research team will be trained in how to collect the measures (questionnaires) and in how to use CASTOR.
The K10 is an instrument measuring psychological distress using 10 questions. Strong psychometric qualities have been found .
The Social and Occupational Functioning Scale (SOFAS) rates the social and occupational functioning of individuals. It is different from the Global Assessment of Functioning (GAF) known from the DSM-IV since it does not take into account psychological symptoms, and does take into account impairments due to a general medical condition. It is usually used for the evaluation of the current time period . The SOFAS has a good reliability and validity .
The Positive Health Instrument is an instrument that assesses empowerment, psychosocial functioning, quality of life, hope and recovery as well as mental symptoms . The instrument is relatively new and still being researched . Overall good reliability was found; the validity has not been researched yet .
Plans to promote participant retention and complete follow-up
Participants will receive financial compensation for their time (9 euros per hour) and travel costs will be fully reimbursed at the end and completion of all measurements. All deviations form protocol will be reported.
Upon enrolment, participants will receive a participant number. In a document saved with a password on a protected computer environment the key will be saved. All data will be stored using solely the participant number. As mentioned before, CASTOR will be used for safe storage. All research assistants will be trained to promote safety, and data quality. Random check-ups by other research assistants will be done to assure data is saved correctly. Moreover, data will always be processed by two research assistants, to promote accurateness.
As stated above, the personal information of participants will be stored separately from the data of the research, and is only accessible for the selected research staff, with a password. Moreover, potential participants will get a screening number, using the same process of separate data form personal information. If a young person is interested in participation, he/she can send an e-mail to a protected mailbox, thereby ensuring safety also in the shown interest. Only the research team has access to the mailbox. After the trial the data will be deidentified and saved for 15 years, in the controlled environment.
Statistical methods for primary and secondary outcomes
The study has a longitudinal cohort design. Following Rickwood et al.  frequencies of each primary presenting concern will be calculated, and age group and sex differences will be assessed by X2 analyses with Bonferroni correction for multiple comparisons. Changes in social functioning (SOFAS) and psychological stress (K10) measures over time will be analyzed in two ways . First, repeated measures multivariance analysis of covariance (MANCOVA) will be used to assess aggregate changes over time in K10 and SOFAS scores according to time point. Time on the platform, therapy pathway completed, number of visits to the ENYOY platform, age group and/or sex will be used as covariates. The statistical relationship between K10 and SOFAS scores will be expressed as a Pearson product-moment correlation coefficient. Differences between the characteristics of clients who provide follow-up data and those who did not will be analyzed by logistic regression. Second, significant change, reliable change and clinically significant change scores will be calculated for the K10 and SOFAS data, as increasingly conditional indicators of change. The criterion for significant change is a moderate effect size (0.5) or greater for the degree of change. The reliable change index (RCI) (indicating reliable improvement or decline) and clinically significant change index (CSI) (cut-off point at which the person is more likely to belong to a non-clinical rather than a clinical population) will be determined using Jacobson and Truax’s method . For the K10 scores, the RCI will be estimated as a 7-point change using reliability coefficients reported for a normative group (age group, 16–24 years) in the 2007 National Survey of Mental Health and Wellbeing , and will calculated individually on the sample. Using the same norms, the CSI cut-off is estimated to 23 points. For the SOFAS data, an RCI score of 10 will be used . Positive health and stress biomarkers outcome measures will be analyzed using regression analysis and an MANCOVA to investigate relationships between stress biomarkers, symptoms, empowerment, hope, quality of life and recovery longitudinally. Time on the platform, therapy pathway completed, number of visits to the ENYOY platform, age group and/or sex will be used as covariates. Explorative analyses can be used to research the effect of additional received treatments. Finally, 10 participants will be asked additional questions concerning usability, user friendliness, accessibility, acceptability, connection among peers, and contribution of the platform. The transcripts firstly will be coded using open methods by labeling and merging synonyms, this to ensure data reduction. Secondly the labels will be categorized by axial coding, thereby resulting in systematic arrangement. Finally, selective coding will be done to couple the research question to the central constructs.
An interim analysis will be conducted to investigate safety and usefulness in participants aged 16–25. If so, inclusion of those aged 12–15 will be considered. In accordance to section 10, subsection 4, of the WMO, the sponsor will suspend the study if there is sufficient ground that continuation of the study will jeopardise subject health or safety. The sponsor will notify the accredit METC without undue delay of a temporary halt including the reason for such an action. The study will be suspended pending a further positive decision by the accredited METC. The investigator will take care that all subjects are kept informed.
Methods in analysis to handle protocol non-adherence and any statistical methods to handle missing data
Multiple imputation (MI) will be used to handle missing data.
Plans to give access to the full protocol, participant level-data and statistical code
Participant-level dataset and statistical code can only be shared upon official request with METC permission. The study protocol will be published and will thereby be accessible.
Oversight and monitoring
Adverse event reporting and harms
The safety protocol will be consulted in the case of serious adverse events and adverse events. All serious adverse events and adverse events will be categorized, recorded and reported to sponsor, local trial site, clinical trials unit (CTU), and trial oversight committees. The investigator will report all SAEs to the sponsor without undue delay after obtaining knowledge of the events. The sponsor will report the SAEs through the web portal ToetsingOnline to the accredited METC that approved the protocol, within 15 days after the sponsor has first knowledge of the serious adverse reactions.
All AEs will be followed until they have abated, or until a stable situation has been reached. Depending on the event, follow up may require additional tests or medical procedures as indicated, and/or referral to the general physician or a medical specialist.
SAEs need to be reported till end of study within the Netherlands, as defined in the protocol.
Plans for communicating important protocol amendments to relevant parties (e.g. trial participants, ethical committees)
Amendments are changes made to the research after a favorable opinion by the accredited METC has been given. All amendments will be notified to the METC that gave a favorable opinion. All parties (e.g. investigators, participants, researchers, financers) will receive updates on changes.
The results of scientific research involving human subjects must be disclosed unreservedly and there are no objections on this regard. The participants can request to receive the results of the study. Moreover, presentations for the general public, and other healthcare professionals will take place in order to make found results accessible.
This trial will specifically address young people with emerging mental health complaints, and offer a new approach for preventive intervention in the Netherlands. Treating emerging mental health problems before they develop into more chronic mental illnesses, could contribute to decreasing the burden of mental health problems for youth, and decreasing mental health associated costs [6,7,8]. Considering the waiting lists in (child and adolescent) psychiatry and the increase in suicides among youths, early low-threshold and non-stigmatizing help for young people with emerging mental health symptoms is of crucial importance. The transition from child to adult psychiatry holds a risk for disruption in continuity of care [61, 62]. This project aims to bridge the gap between child and adolescent and adult psychiatry. Possible limitations of the study are, that there is a chance that only individuals that actively search for help will participate in the study, thereby not reaching a diverse sample of young people who need help. To overcome this limitation, we attempt to involve several parties in the recruitment, such as universities and general practitioners. Still, certain young people that stay under the radar may not be reached. This would limit the generalizability of our results regarding the effectiveness of the platform to the youth population. Moreover, this study is not an RCT, meaning the level of evidence is lower. Further, the longitudinal research design has the risk of participants dropping out over time. However, since the effectiveness of the platform has extensively been researched in Australia for over ten years, and the focus of this research is on implementation of the platform, we believe the chosen design matches the research questions best. This trial will contribute to the implementation of a transdiagnostic, digital, clinical – and peer- moderated, indicative prevention treatment platform for youth with beginning mental health complaints in the Netherlands. Moreover, this is the first time the platform is translated and adjusted to a country outside of Australia. The project could contribute to the implementation of the platform in other countries as well.
Availability of data and materials
The data resulting from the current study will not be publicly available. The data, protocol, statistical code and a list of study sites are available from the corresponding author on reasonable request.
Algemeen Nut Beogende Instelling (english: Public Benefit Institution)
ABR form, General Assessment and Registration form, is the application form that is required for submission to the accredited Ethics Committee (In Dutch, ABR = Algemene Beoordeling en Registratie)
Central Committee on Research Involving Human Subjects; in Dutch: Centrale Commissie Mensgebonden Onderzoek
Data Safety Monitoring Board
ENgage YOung people earlY
European drug regulatory affairs Clinical Trials
Good Clinical Practice
Investigational Medicinal Product
Investigational Medicinal Product Dossier
- METC :
Medical research ethics committee (MREC); in Dutch: medisch ethische toetsing commissie (METC)
(Serious) Adverse Event
Summary of Product Characteristics (in Dutch: officiële productinfomatie IB1-tekst)
The sponsor is the party that commissions the organisation or performance of the research, for example a pharmaceutical company, academic hospital, scientific organisation or investigator. A party that provides funding for a study but does not commission it is not regarded as the sponsor, but referred to as a subsidising party.
Suspected Unexpected Serious Adverse Reaction
Personal Data Protection Act (in Dutch: Wet Bescherming Persoonsgevens)
Medical Research Involving Human Subjects Act (in Dutch: Wet Medisch-wetenschappelijk Onderzoek met Mensen
Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):593–602. https://doi.org/10.1001/archpsyc.62.6.593.
Kessler RC, Chiu WT, Demler O, Merikangas KR, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):617–27. https://doi.org/10.1001/archpsyc.62.6.617.
Angst J, Paksarian D, Cui L, Merikangas KR, Hengartner MP, Ajdacic-Gross V, et al. The epidemiology of common mental disorders from age 20 to 50: results from the prospective Zurich cohort study. Epidemiol Psychiatr Sci. 2016;25(1):24–32. https://doi.org/10.1017/S204579601500027X.
Reeves WC, Strine TW, Pratt LA, Thompson W, Ahluwalia I, Dhingra SS, et al. Mental illness surveillance among adults in the United States. MMWR Suppl. 2011;60(3):1–29.
Magnée T, de Beurs D, Verhaak P. Wachttijden voor de poh-ggz. Huisarts en wetenschap. 2017;60(5):205. https://doi.org/10.1007/s12445-017-0131-7.
Vigo D, Thornicroft G, Atun R. Estimating the true global burden of mental illness. Lancet Psychiatry. 2016;3(2):171–8. https://doi.org/10.1016/s2215-0366(15)00505-2.
de Ruiter G, van Greuningen M, Luijk R. Inzicht in de geestelijke gezondheidszorg. Zorgthermometer GGZ, Vektis. 2017;Enschede: Drukkerij Roelofs:1–38.
Nieman DN. Prevention in mental health care: time for a new approach. Oxford: Routledge; 2016. https://doi.org/10.4324/9781315683805.
Insel TR, Fenton WS. Psychiatric epidemiology - It's not just about counting anymore. Arch Gen Psychiat. 2005;62(6):590–2. https://doi.org/10.1001/archpsyc.62.6.590.
Jones PB. Adult mental health disorders and their age at onset. Br J Psychiatry Suppl. 2013;54(s54):s5–10. https://doi.org/10.1192/bjp.bp.112.119164.
Rüsch N, Corrigan P, Todd A, Bodenhausen G. Implicit self-stigma in people with mental illness. J Nerv Ment Dis. 2010;198(2):150–3. https://doi.org/10.1097/NMD.0b013e3181cc43b5.
Mathers C. Global burden of disease. International Encyclopedia of Public Health. Oxford: Academic Press; 2017. p. 256–67. https://doi.org/10.1016/b978-0-12-803678-5.00175-2.
Corrigan P. How stigma interferes with mental health care. Am Psychol. 2004;59(7):614–25. https://doi.org/10.1037/0003-066X.59.7.614.
Muntaner C, Ng E, Vanroelen C, Christ S, Eaton WW. Social stratification, social closure and social class as determinants of mental health disparities. In: Aneshensel CS, Phelan JC, Bierman A, editors. Handbook of the Sociology of Mental Health. 2nd ed. Dordrecht: Springer; 2013. p. 205–28.
McGorry PD, Goldstone SD, Parker AG, Rickwood DJ, Hickie IB. Cultures for mental health care of young people: an Australian blueprint for reform. Lancet Psychiatr. 2014;1(7):559–68. https://doi.org/10.1016/S2215-0366(14)00082-0.
Keshavan MS, Giedd J, Lau JY, Lewis DA, Paus T. Changes in the adolescent brain and the pathophysiology of psychotic disorders. Lancet Psychiatr. 2014;1(7):549–58. https://doi.org/10.1016/S2215-0366(14)00081-9.
Singh SP, Tuomainen H. Transition from child to adult mental health services: needs, barriers, experiences and new models of care. World Psychiatr. 2015;14(3):358–61. https://doi.org/10.1002/wps.20266.
van Amelsvoort T. Bridging the gap. Tijdschr Psychiatr. 2014;56(10):638–9.
Fox S, Southwell A, Stafford N, Goodhue R, Jackson D, Smith C. Better Systems, Better Chances: A Review of Research and Practice for Prevention and Early Intervention. Canberra: Australian Research Alliance for Children and Youth (ARACY); 2015. p1-303.
Munoz RF, Cuijpers P, Smit F, Barrera AZ, Leykin Y. Prevention of major depression. Annu Rev Clin Psychol. 2010;6(1):181–212. https://doi.org/10.1146/annurev-clinpsy-033109-132040.
Shapiro MD, Maron DJ, Morris PB, Kosiborod M, Sandesara PB, Virani SS, et al. Preventive cardiology as a subspecialty of cardiovascular medicine JACC council perspectives. J Am Coll Cardiol. 2019;74(15):1928–42.
Broberg AM, Geisler J, Tuohinen S, Skytta T, Hrafnkelsdottir Thorn J, Nielsen KM, et al. Prevention, detection, and Management of Heart Failure in patients treated for breast Cancer. Curr Heart Fail Rep. 2020;17(6):397–408. https://doi.org/10.1007/s11897-020-00486-8.
Nieman DH, McGorry PD. Detection and treatment of at-risk mental state for developing a first psychosis: making up the balance. Lancet Psychiatr. 2015;2(9):825–34. https://doi.org/10.1016/S2215-0366(15)00221-7.
Iorfino F, Scott EM, Carpenter JS, Cross SP, Hermens DF, Killedar M, et al. Clinical stage transitions in persons aged 12 to 25 years presenting to early intervention mental health services with anxiety, mood, and psychotic disorders. JAMA Psychiatry. 2019;76(11):1167–75. https://doi.org/10.1001/jamapsychiatry.2019.2360.
Hickie IB, Scott EM, Hermens DF, Naismith SL, Guastella AJ, Kaur M, et al. Applying clinical staging to young people who present for mental health care. Early Interv Psychiatry. 2013;7(1):31–43. https://doi.org/10.1111/j.1751-7893.2012.00366.x.
McGorry PD, Hickie IB, Yung AR, Pantelis C, Jackson HJ. Clinical staging of psychiatric disorders: a heuristic framework for choosing earlier, safer and more effective interventions. Aust N Z J Psychiatry. 2006;40(8):616–22. https://doi.org/10.1080/j.1440-1614.2006.01860.x.
Shah JL, Scott J, McGorry PD, Cross SPM, Keshavan MS, Nelson B, et al. Transdiagnostic clinical staging in youth mental health: a first international consensus statement. World Psychiatry. 2020;19(2):233–42. https://doi.org/10.1002/wps.20745.
McGorry PD, Mei C. Unmet Needs in Youth Mental Health: Transforming Models of Care to Improve Outcomes. Pompili M, McIntyre R, Fiorillo A, Sartorius N (eds) New Directions in Psychiatry. Bern: Springer International Publising; 2020. https://doi.org/10.1007/978-3-030-42637-8_11.
Rickwood D, Paraskakis M, Quin D, Hobbs N, Ryall V, Trethowan J, et al. Australia's innovation in youth mental health care: the headspace Centre model. Early Interv Psychiatr. 2019;13(1):159–66. https://doi.org/10.1111/eip.12740.
Rickwood DJ, Telford NR, Mazzer KR, Parker AG, Tanti CJ, McGorry PD. The services provided to young people by headspace centres in Australia. Med J Australia. 2015;202(10):533. https://doi.org/10.5694/mja14.01695.
Rickwood DJ, Mazzer KR, Telford NR, Parker AG, Tanti CJ, McGorry PD. Changes in psychological distress and psychosocial functioning in young people visiting headspace centres for mental health problems. Med J Aust. 2015;202(10):537–42. https://doi.org/10.5694/mja14.01696.
Alvarez-Jimenez M, Gleeson JF, Rice S, Gonzalez-Blanch C, Bendall S. Online peer-to-peer support in youth mental health: seizing the opportunity. Epidemiol Psych Sci. 2016;25(2):123–6. https://doi.org/10.1017/S2045796015001092.
Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatr. 2010;10(1):113–42. https://doi.org/10.1186/1471-244X-10-113.
Green H, McGinnity Á, Meltzer H, Ford T, Goodman R. Mental health of children and young people in Great Britain. Basingstoke: Palgrave Macmillan; 2005; p. 1-383.
Bandelow B, Schuller K. Mean age and gender distribution of patients with major mental disorders participating in clinical trials. Eur Arch Psychiatry Clin Neurosci. 2019;270(6):655–9. https://doi.org/10.1007/s00406-018-0972-5.
Seidler Z, Rice S, Ogrodniczuk J, Oliffe J, Shaw J, Dhillon H. Men, masculinities, depression: implications for mental health services from a Delphi expert consensus study. Prof Psychol Res Pract. 2019;50(1):51–61. https://doi.org/10.1037/pro0000220.
Stagnaro JC, Cia AH, Vommaro H, Sustas S, Vazquez N, Serfaty E, et al. Delays in making initial treatment contact after the first onset of mental health disorders in the Argentinean study of mental health epidemiology. Epidemiol Psychiatr Sci. 2019;28(2):240–50. https://doi.org/10.1017/S2045796018000094.
Alvarez-Jimenez, M, Rice S, D'Alfonso S, Leicester S, Bendall S, Pryor I, Russon P, McEnery C, Santesteban-Echarri O, Da Costa G, Gilbertson T, Valentine, L, Solves L, Ratheesh A, McGorry PD, Gleeson J. A Novel Multimodal Digital Service (Moderated Online Social Therapy+) for Help-Seeking Young People Experiencing Mental Ill-Health: Pilot Evaluation Within a National Youth E-Mental Health Service. J Med Internet Res. 2020;22(8):e17155. https://doi.org/10.2196/17155.
Maddock C, Pariante CM. How does stress affect you? An overview of stress, immunity, depression and disease. Epidemiol Psichiatr Soc. 2001;10(3):153–62. https://doi.org/10.1017/s1121189x00005285.
van Lang NDJ, Tulen JHM, Kallen VL, Rosbergen B, Dieleman G, Ferdinand RF. Autonomic reactivity in clinically referred children attention-deficit/hyperactivity disorder versus anxiety disorder. Eur Child Adoles Psy. 2007;16(2):71–8. https://doi.org/10.1007/s00787-006-0575-y.
Walker AJ, Kim Y, Price JB, Kale RP, McGillivray JA, Berk M, Tye SJ. Stress, inflammation, and cellular vulnerability during early stages of affective disorders: biomarker strategies and opportunities for prevention and intervention. Front Psychiatry. 2014;5;1-8. https://doi.org/10.3389/fpsyt.2014.00034.
Huber M, Knottnerus JA, Green L, van der Horst H, Jadad AR, Kromhout D, et al. How should we define health? Brit Med J. 2011;343:d4163. https://doi.org/10.1136/bmj.d4163.
Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SL, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med. 2002;32(6):959–76. https://doi.org/10.1017/s0033291702006074.
Goldman HH, Skodol AE, Lave TR. Revising Axis-V for Dsm-iv - a review of measures of social functioning. Am J Psychiat. 1992;149(9):1148–56. https://doi.org/10.1176/ajp.149.9.1148.
van Lier HG, Pieterse ME, Garde A, Postel MG, de Haan HA, Vollenbroek-Hutten MMR, et al. A standardized validity assessment protocol for physiological signals from wearable technology: methodological underpinnings and an application to the E4 biosensor. Behav Res Methods. 2020;52(2):607–29. https://doi.org/10.3758/s13428-019-01263-9.
Lentferink A, Noordzij ML, Burgler A, Klaassen R, Derks Y, Oldenhuis H, et al. On the receptivity of employees to just-in-time self-tracking and eCoaching for stress management: a mixed-methods approach. Behav Inform Technol. 2021:1–27. https://doi.org/10.1080/0144929X.2021.1876764.
Duckworth AL, Steen TA, Seligman ME. Positive psychology in clinical practice. Annu Rev Clin Psychol. 2005;1(1):629–51. https://doi.org/10.1146/annurev.clinpsy.1.102803.144154.
Seligman MEP, Rashid T, Parks AC. Positive psychotherapy. Am Psychol. 2006;61(8):774–88. https://doi.org/10.1037/0003-066X.61.8.774.
Park N, Peterson C. Character strengths and happiness among young children: content analysis of parental descriptions. J Happiness Stud. 2006;7(3):323–41. https://doi.org/10.1007/s10902-005-3648-6.
Niemiec R. VIA Character Strengths: Research and Practice (The First 10 Years). In: Knoop H, Delle Fave A, editors. Well-Being and Cultures Cross-Cultural Advancements in Positive Psychology. 3. Dordrecht: Springer; 2013. https://doi.org/10.1007/978-94-007-4611-4_2.
Gleeson JF, Lederman R, Wadley G, Benda S, McGorry PD, Alvarez-Jimenez M. Safety and privacy outcomes from a moderated online social therapy for young people with first-episode psychosis. Psychiatr Serv. 2014;65(4):546–50. https://doi.org/10.1176/appi.ps.201300078.
Alvarez-Jimenez M, Alcazar-Corcoles MA, Gonzalez-Blanch C, Bendall S, McGorry PD, Gleeson JF. Online, social media and mobile technologies for psychosis treatment: a systematic review on novel user-led interventions. Schizophr Res. 2014;156(1):96–106. https://doi.org/10.1016/j.schres.2014.03.021.
Huber M, van Vliet M, Giezenberg M, Winkens B, Heerkens Y, Dagnelie PC, et al. Towards a 'patient-centred' operationalisation of the new dynamic concept of health: a mixed methods study. Bmj Open. 2016;6(1);e010091; 1-11. https://doi.org/10.1136/bmjopen-2015-010091.
Huber M, Jung, H. P., van den Brekel-Dijkstra, K. Handbook Positive Health in General Practice (Handboek Positieve Gezondheid in de Huisartspraktijk). 2021.
van Doorn M, Nijhuis LA, Egeler MD, Daams JG, Popma A, van Amelsvoort T, et al. Online indicated prevention mental health interventions for youth: a scoping review. Front Psychiatr. 2021;12:1–19. https://doi.org/10.3389/fpsyt.2021.580843.
Hay P, Katsikitis M, Begg J, Da Costa J, Blumenfeld N. A two-year follow-up study and prospective evaluation of the DSM-IV axis V. Psychiat Serv. 2003;54(7):1028–30. https://doi.org/10.1176/appi.ps.54.7.1028.
Karel YHJM, Van Vliet M, Lugtigheid CE, De Bot CMA, Dierx J. The concept of positive health for students/lecturers in the Netherlands. Int J Health Promot. 2019;57(5):286–96. https://doi.org/10.1080/14635240.2019.1623707.
Wolpert M, Gorzig A, Deighton J, Fugard AJB, Newman R, Ford T. Comparison of indices of clinically meaningful change in child and adolescent mental health services: difference scores, reliable change, crossing clinical thresholds and 'added value' - an exploration using parent rated scores on the SDQ. Child Adolesc Ment Health. 2015;20(2):94–101. https://doi.org/10.1111/camh.12080.
Jacobson NS, Truax P. Clinical-Significance - a Statistical Approach to Defining Meaningful Change in Psychotherapy-Research. J Consult Clin Psych. 1991;59(1):12–9. https://doi.org/10.1037/0022-006x.59.1.12.
Slade T, Grove R, Burgess P. Kessler Psychological Distress Scale: normative data from the 2007 Australian National Survey of Mental Health and Wellbeing. Aust Nz J Psychiat. 2011;45(4):308–16. https://doi.org/10.3109/00048674.2010.543653.
Lindgren E, Soderberg S, Skar L. The gap in transition between child and adolescent psychiatry and general adult psychiatry. J Child Adolesc Psychiatr Nurs. 2013;26(2):103–9. https://doi.org/10.1111/jcap.12027.
Signorini G, Singh SP, Marsanic VB, Dieleman G, Dodig-Curkovic K, Franic T, et al. Correction to: the interface between child/adolescent and adult mental health services: results from a European 28country survey. Eur Child Adolesc Psychiatry. 2018;27(11):1511–2. https://doi.org/10.1007/s00787-018-1132-1.
We are grateful for all individuals who participate in the ENYOY study and are essential for its successful completion. We thank all clinical moderators, peer moderators, members of the youth panel, and researchers (Laurens Nijhuis, Mees Egeler, Ria Vranken Lorenzo, Chantal Angeneind, Kate Avis, Emma Ruigt, Rubina Sewambar, Pien Verhoeven, Senna Dik, Anne Monsanto, Willemijn Leenheer, Cindy van Stratum, Paul Gelissen, Noortje Rotterdam, Tamara Schouten, Jona Cohen, and Wesley van Dijen). Further we would like to thank all who helped with the implementation (Simon d’Alfonso, Jane Haskings, Penni Russon, Tamsyn Gilberson, Jess Phillips, Hailey Tremain, Rafi Armanto, Christopher Miles, Olivia Howat, Wico Mulder, Flore Joskin, Margit Mulder, Claire Veldkamp, Houssain Mouhmouh), and all clinicians who referred their clients to us.
Financial funding by The Netherlands Organisation for Health Research and Development, for personnel, materials, and implementation. File number 60–63600–98-319. The funder oversees the research project by yearly progress rapports, and meetings. The funder had no role in the study design, and will not have any role during its execution, data collection, data analyses, interpretation of the data, or decision to submit results or publish or preparation of the manuscript.
Ethics approval and consent to participate
The trial has received ethical approval from the Medical Ethics Review Committee (MERC) at Amsterdam University Medical Centers (AMC), the Netherlands (reference: NL66345.018.18). Written informed consent will be obtained from all participants before inclusion to the study. For participants under 16 years old, written informed consent will be obtained from a parent or guardian as well. The sponsor/investigator has a liability insurance which is in accordance with article 7 of the WMO. The sponsor (also) has an insurance which is in accordance with the legal requirements in the Netherlands (Article 7 WMO). This insurance provides cover for damage to research subjects through injury or death caused by the study. The insurance applies to the damage that becomes apparent during the study or within 4 years after the end of the study.
Consent for publication
The authors report no conflicts of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
van Doorn, M., Popma, A., van Amelsvoort, T. et al. ENgage YOung people earlY (ENYOY): a mixed-method study design for a digital transdiagnostic clinical – and peer- moderated treatment platform for youth with beginning mental health complaints in the Netherlands. BMC Psychiatry 21, 368 (2021). https://doi.org/10.1186/s12888-021-03315-x
- Indicated prevention
- Mental health
- Moderated online social therapy (MOST+)
- Early detection and intervention