A smartphone-based intervention for young people who self-harm (‘PRIMARY’): study protocol for a multicenter randomized controlled trial
BMC Psychiatry volume 23, Article number: 840 (2023)
Self-harm in young people is a public health concern connected with severe mental health problems, such as personality pathology. Currently, there are no specific evidence-based interventions available for young people who self-harm. Therefore, we developed PRe-Intervention Monitoring of Affect and Relationships in Youth (PRIMARY), a smartphone-based intervention, co-designed by clinicians and young people with lived experience of mental ill-health. PRIMARY combines the Experience Sampling Method (ESM) with weekly report sessions. The study aims to examine the effectiveness of PRIMARY with regard to reducing self-harm, and improving emotion regulation and quality of relationships.
This study is a multicenter, parallel groups, randomized controlled trial (RCT) comparing the PRIMARY intervention to a waiting list control group. PRIMARY comprises 28 consecutive days of questionnaires five times each day (i.e., ESM) and four weekly report sessions. Participants will comprise 180 young people referred for treatment to the participating Dutch mental healthcare institutions and (1) are aged 12 to 25 years, and (2) engaged in ≥ 1 act of self-harm in the past year. Participants are randomly allocated to a study group after screening in a 1:1 ratio by an independent researcher using computer-generated randomization sequences with stratified block randomization by age (12 to 15 years / 16 to 25 years). Staff will conduct assessments with all participants at baseline (Wave 1), after 28 days (Wave 2), and in a subsample after 10 weeks of subsequent specialized treatment (Wave 3). The primary outcomes are self-harm, emotion regulation, and quality of relationships. Secondary outcomes include patient and clinician satisfaction. Exploratory analyses of ESM data will examine the relationship between emotions, social relationships, and self-harm.
The results of this trial will clarify whether an innovative smartphone-based intervention is effective for reducing self harm and improving emotion regulation and the quality of social relationships. It has the potential to fill a treatment gap of interventions specifically targeting self-harm. If proven effective, it would provide an accessible, easy-to-implement, low-cost intervention for young people. Furthermore, the ESM-data will allow detailed analyses into the processes underlying self-harm, which will contribute to theoretical knowledge regarding the behavior.
ISRCTN42088538 (https://doi.org/10.1186/ISRCTN42088538), retrospectively registered on the 26th of October 2022.
Self-harm is common in young people and represents a major public health challenge [1,2,3]. Self-harm is defined as all intentional acts of self-injury or self-poisoning, irrespective of the type of motive . Self-harming behavior is associated with problems in emotion regulation , enduring psychosocial problems , and shows a clear connection to severe mental health problems, such as depression, anxiety, substance use, personality pathology and suicidality [7,8,9]. Hence, early detection and intervention for self-harm are crucial. However, treatment for self-harm is often only available within specialist, psychotherapeutic programs, such as Dialectic Behavioral Therapy (DBT) and Mentalization Based Treatment (MBT), which target a range of difficulties [10, 11]. These programs entail complex and lengthy interventions, requiring extensive staff training and financial resources . Hence, there is a need for simpler and ‘scalable’ evidence-based interventions that are specifically designed for self-harm. Such interventions might be more easily implemented across the healthcare system , making them available to more young people , and are likely to be more cost-effective .
Beyond the immediate adverse effects of self-harm, like tissue damage , self-harm is a marker for an increased risk of developing various mental health problems [16, 17]. Given that the chance of repetition of self-harm within 12 months after the first incident increases with every prior act, with up to 70% in the case of four previous acts , it is important to intervene as early as possible to prevent persistent and profound problems. severe pathology. Recurrent self-harm is associated with severe psychopathology, such as borderline personality disorder (BPD) . Studies have shown that over 40% of young people who self-harm during adolescence and have received mental healthcare, go on to receive a diagnosis of BPD in adulthood . Therefore, interventions aimed at diminishing self-harm might also function as early intervention for those at risk of developing severe psychopathology, by targeting underlying problems of emotion regulation and interpersonal functioning .
Even though evidence-based treatments specifically aimed at preventing the recurrence of self-harm in young people engaging in the behavior are not yet available , positive effects of broader treatment programs provide important insights into the mechanisms underlying the reduction of self-harm. First, actions aimed at long-term improvement of psychosocial functioning have been found to be beneficial (e.g., re-orienting to a more positive future, reassessing one’s place in the social world; . Second, actions aimed at breaking the association between an individual’s psychological or social state and the act of self-harm, i.e. ‘breaking the chain’, are important for short term change . This includes strategies to manage immediate thoughts and feelings when the urge to self-harm arises, including improving emotion regulation, family support, and self-esteem . Preceding the employment of such strategies, and essential to change harmful behavior, is gaining insight or awareness of problem areas and triggers [25, 26]. As the median time between the first thought of self-harm and the actual act has been found to be 35 h in some groups , there seems to be a ‘window of opportunity’ for the young person to recognize the separate steps of the ‘chain’ leading up to the act of self-harm. Subsequently, suggestions for more helpful coping techniques might guide the individual towards alternative strategies. Given that self-harm often fulfills the function of regulating emotions and interpersonal contexts , enhancing a young person’s insight into these areas seems especially important.
Help-seeking among young people is impeded by stigma, embarrassment, trouble recognizing symptoms, and a preference for self-reliance . When young people do seek treatment, they are often faced with long waiting times within the mental healthcare system, which can demotivate them [29, 30]. This is especially problematic in the context of self-harm, given the direct and long-term adverse effects of the behavior. A smartphone-based intervention for young people who self-harm might contribute to overcoming the constraints of the current system, such as limited availability of clinicians . Such an intervention would be self-directed and readily accessible for young people in their day-to-day lives.
The Experience Sampling Method (ESM) is a smartphone-based approach that asks people to fill out questions via their smartphone on multiple occasions during the day, for example regarding their feelings and behaviors . ESM has been used to study the mechanisms underlying self-harm, which has led to the insight that heightened negative affect typically precedes the behavior [27, 33]. The ESM-methodology has thus far primarily been employed as a research tool for assessing self-harm. However, the act of systematically monitoring and registering feelings and behaviors might also be an intervention in and of itself, as it promotes reflection and facilitates the discovery of patterns of feelings and behavior . The application of ESM as an intervention has already been recognized in the field of depressive disorders, where ESM is now studied as an add-on intervention to outpatient treatment programs [35, 36]. More recently, the use of ESM as a stand-alone smartphone-intervention has been demonstrated to be associated with positive mental health outcomes in young people in the community .
ESM has been posited as a promising framework for an intervention targeting self-harm . Preliminary evidence suggests a possible decline in the frequency of the behavior when using smartphone-based interventions . However, there is large variation in the type of smartphone-based interventions available and randomized controlled trials (RCTs) are needed to rigorously examine their effectiveness. Furthermore, co-designing an ESM-intervention in partnership with people with lived experience of mental ill-health enhances the fit of the intervention to the target group .
We have developed PRe-Intervention Monitoring of Affect and Relationships in Youth (PRIMARY), which is a smartphone-based intervention for young people who self-harm. PRIMARY combines ESM with brief, weekly, one-on-one structured report sessions where the young persons’ ESM-responses are discussed. This paper presents the study protocol for a multicenter, randomized controlled trial (RCT), evaluating the effectiveness of the PRIMARY intervention compared with a waiting list control. If PRIMARY is found to be effective in enhancing emotion regulation and reducing self-harm, it would offer an accessible, easy-to-implement intervention for young people throughout the mental healthcare system.
The first objective of this RCT is to determine whether PRIMARY, compared to a waiting list control, is effective in improving the following outcomes: self-harm, emotion regulation, and quality of relationships. To this end scores at baseline (Wave 1) and at the end of the intervention phase (Wave 2) will be compared. The second objective is to examine the effectiveness of PRIMARY combined with subsequent specialized treatment in the early intervention program Helping Young People Early (HYPE)  in improving the outcomes for young people with borderline personality pathology. Scores on the specified outcome variables after 10 weeks of HYPE treatment (Wave 3) will be compared to scores at baseline (Wave 1) and at the end of the intervention phase (Wave 2) for participants who attended HYPE. The third objective is to investigate the associations between emotions, relational support and conflict, adaptive coping strategies, and self-harm using individual-level ESM data. The fourth objective is to examine the participants’ and clinicians’ satisfaction regarding the use of PRIMARY. This will be examined at the end of the intervention phase (Wave 2).
To facilitate transparency, the current protocol paper was written in accordance with the SPIRIT guidelines . The SPIRIT Checklist is provided in the Supplemental Material.
This study is a multicenter, parallel groups, randomized controlled trial of the PRIMARY intervention compared with a waiting list control in outpatients aged 12 to 25 years (inclusive). The study also includes a nested evaluation of the effect of PRIMARY on the effectiveness of subsequent specialized treatment (HYPE) .
The design of the PRIMARY study was co-created by clinicians, young people with lived experience of mental ill-health, and researchers to ensure it is acceptable to all. For example, young people with lived experience provided feedback on how to adapt the ESM lay-out and script for the weekly report sessions to appeal to their age group. To guarantee the intervention is easy-to-implement, it is constructed to be delivered by research assistants (RA’s) rather than clinicians. RA’s hold a bachelor’s diploma in psychology or a related field and completed a suicide prevention e-learning module. Adherence to the prescribed PRIMARY intervention is promoted via detailed study procedures and scripts, as well as routine joint appointments with the RA, participant and AA or TvdB. All individual participant data (i.e., questionnaires and weekly, graphical reports) are made available within the electronic patient record of the participant. This is a direct benefit of participation in the study for the participant, as this information can be integrated into their diagnostic or treatment process by their clinician.
Sample and setting
Young people aged 12 to 25 years (inclusive), with varying psychological problems, will be recruited after referral to one of the two participating mental healthcare institutions in the Netherlands: GGz Centraal and Mondriaan. These young people are awaiting further care at the institutions. Study inclusion criteria are: (1) engagement in at least one act of self-harm in the past year, and (2) sufficient understanding and skills in the Dutch language. In order to reflect ‘real world’ clinical practice, there are no exclusion criteria regarding participation in the study; participants can receive other interventions if judged necessary by the clinician in charge, also during participation in the study.
Figure 1 depicts a flow diagram of the study design. A feasibility study was conducted to ensure an optimal design and recruitment procedure. Adjustments were made based on interviews with the participants. A description of the feasibility study can be found in the Supplemental Material. In this paper, the finalized procedures are described.
Young people receive an information letter about the PRIMARY study from the clinician or RA during their first formal contact at the mental healthcare institution (e.g., screening or intake session). After a two-day consideration period, an RA contacts the young person to further discuss participation and answer any questions. If the young person chooses to participate, written informed consent is obtained (also from parents or legal guardians for those aged < 16 years). A copy of the consent form is included in the Supplemental Material. Next, the young person fills out a brief screening questionnaire to confirm eligibility for the trial. If inclusion criteria are met, the baseline assessment (Wave 1) is scheduled with the RA, after which the young person is randomly assigned to a study group. At the end of the baseline assessment, the participant, independent of study group, can choose between two selected charities for the study to donate €5,00 to for their participation.
Randomization and group allocation
Once eligibility is confirmed during screening, participants are randomly assigned to the intervention or the comparison group in a 1:1 ratio by an independent researcher using computer-generated randomization sequences with stratified block randomization by age (12 to 15 years / 16 to 25 years). Staff will not be blind to group allocation. Participants are blind to their allocated group during Wave 1 assessment. The nature of the intervention precludes concealment from participants and staff. Recruitment and retention in the trial will be maximized via study-specific training of RA’s and weekly staff-meetings to discuss the progress of the trial. In addition, retention was considered in great detail when designing the study by integrating input from young people with lived experience with mental-ill health, conducting a feasibility study and integrating recommended adjustments to increase compliance, and implementing insights from earlier ESM-studies.
After baseline assessment (Wave 1), the intervention group starts with the PRIMARY intervention. PRIMARY is an intervention consisting of two elements: ESM and weekly, one-on-one structured report sessions based on the individual’s ESM-answers. Participants fill out the ESM-questionnaire via their smartphone five times a day for 28 consecutive days (i.e., 4 weeks). Each ESM-questionnaire appears at random times within blocks of 2.5 h periods. Participants can choose a starting time for the first block between 06:00 AM and 12:00 PM. To encourage compliance with the ESM-questionnaire protocol, motivating text messages are sent once a week. In case compliance drops below 70% during the previous three days, participants receive an extra text message to stimulate respondence (maximum of once a week). If a participant allocated to the intervention group does not have a smartphone or internet on their smartphone, they can borrow a smartphone from the research staff. The internet on this smartphone is limited to accessing the ESM-questionnaire and therefore does not change the participant’s situation regarding social interactions.
The weekly report session encompasses a 15-minute video call (or appointment at the institution on request of the participant) with the RA over the course of the ESM-procedure (i.e., four times). During these sessions, the answers provided on the ESM-questionnaire over the past week are discussed in a structured, scripted way using a graphical report in which the outcomes are summarized. These sessions aim to enhance the participant’s insight into the connection between their emotions, activities and social context.
After baseline assessment (Wave 1), participants in the comparison group receive care-as-usual, which entails a waiting list for further care.
After finishing the assessment at the end of the study intervention phase (i.e. Wave 2), it is anticipated that participants in an early stage of BPD (i.e., ≥ three BPD criteria) will receive specialized treatment called HYPE (Helping Young People Early) . Allocation to HYPE is determined by clinicians independent from the study. HYPE is a time-limited integrative treatment program based on the principles of Cognitive Analytic Therapy (CAT). The time-limit comprises 16 individual, weekly psychotherapy sessions, supplemented with psychiatric, psychosocial and family sessions if indicated. There is a follow-up period of six months, wherein the young person can schedule up to four sessions.
All study measures and their timing during the study are depicted in Table 1. All participants, independent of study group, fill out questionnaires at baseline (Wave 1) prior to commencing the study intervention, and at the end of the intervention phase (i.e., four weeks later; Wave 2). Participants who subsequently enroll in HYPE also fill out the questionnaires 10 weeks after starting their treatment (Wave 3). All assessments other than the ESM-questionnaire are administered to both the intervention and comparison group at the mental healthcare institution or through a video call with an RA, depending on the preferences of the participant.
An ESM-questionnaire with 22–25 questions was developed for the purpose of the PRIMARY study. Recommendations to enhance the feasibility of an ESM-intervention in young people were taken into account in this process, like tailoring the first assessment to correspond to the young person’s sleep schedule . The questionnaire is included in the Supplemental Material.
The daily ESM-questionnaire covers activities, relational support and conflict, emotions, substance use and, at the end of the day, functioning. The questions regarding emotions were informed by similar research  and the Positive And Negative Affect Scale (PANAS) . One question regarding applied adaptive emotion regulation strategies is included, informed by Safety Planning Intervention . Additionally, a question on self-harming thoughts and behaviors since the last notification is included. Answers are provided via a multiple choice format or on a Likert-scale ranging from 1 (not at all) to 7 (very much).
Main study parameters
Self-Harming Thoughts and Behaviors. Five questions were formulated to assess frequency and severity of self-harm, these are included in the Supplemental Material.
Emotion Regulation. The 18-item Difficulties in Emotion Regulation Scale (DERS-18)  is included. The DERS-18 comprises six subscales: ‘lack of emotional awareness’, ‘lack of emotional clarity’, ‘difficulty engaging in goal-directed behavior’, ‘impulse control difficulties’, ‘nonacceptance of emotional responses’, and ‘limited access to emotion regulation strategies’. Items are answered on a 5-point Likert scale. The scale has adequate construct and predictive validity, and good test-retest reliability .
Quality of Relationships. Participants fill out the 11-item version of the Network of Relationships Inventory – Behavior Systems Version (NRI-BSV)  regarding one parent and a best friend. The NRI-BSV comprises two subscales: ‘support’ and ‘negative interactions’. Items are answered on a 5-point Likert scale. The questionnaire was validated and the factor structure was confirmed .
Evaluation of PRIMARY. Participants in the intervention group rate usability of the ESM-element of PRIMARY on the 3-item Usability Metric for User Experience (UMUX)  on a 7-point Likert scale. This questionnaire correlates well with the original, longer version, is reliable, and the items load on one underlying factor . Overall satisfaction with PRIMARY is indicated via a modified 4-item version of the Client Satisfaction Questionnaire-8 (CSQ-8) .
Included in the Supplemental Material are the modified version of the CSQ-8, two additional items regarding the duration and frequency of the ESM-questionnaire, and 10 questions assessing the clinician’s impression of the young person after the study.
Information regarding demographic characteristics and concomitant treatment is collected. BPD related pathology is measured via the BPD section of the Structured Clinical Interview for DSM-IV Axis II disorders Personality Questionnaire (SCID-II BPD PQ) , and the behavior scale of the Borderline Symptom List (BSL-23) . Achievement of developmental milestones is measured via the Developmental Milestones List (DML) , which comprises 13 items regarding developmental tasks that young people face when growing up, making up three subscales: personal, social and academic functioning. Items are answered on a 7-point Likert scale. Life experiences are assessed with a shortened version of the Life Experiences Survey (LES) . Psychopathology is measured with a Dutch questionnaire called Screeningsinstrument Psychische Stoornissen (SPSY) , which is based on the Strengths and Difficulties Questionnaire (SDQ) . The brief form of the Levels of Personality Functioning Scale 2.0 (LPFS-BF)  and Personality Inventory for DSM-5 (PID-5-BF) [58, 59] are included as measures of the Alternative Model of Personality Disorders . Impulsivity is measured with the short version of the UPPS-P impulsive behavior scale . Internalizing problems are measured with the Depression Anxiety Stress Scales (DASS) . Loneliness is assessed with the short version of the Dutch De Jong Gierveld questionnaire . Motivation for change is measured by the Motivation for Youth Treatment Scale (MYTS) . The 11-item version of the Recovering Quality of Life (ReQoL)  concerns functioning over the past week, and is answered on a 4-point Likert-scale. During the COVID-19 pandemic (i.e., until March 10, 2023), impact of COVID-19 on daily life was measured via six semi-structured interview questions developed for the study.
Participants fill out the questionnaires through an online portal called ‘RoQua’. At GGz Centraal, RoQua is also used for Routine Outcome Monitoring and it is linked to the electronic patient records. Hence, the answers on the questionnaires of this study are available to clinicians through these records. The data is stored in a secure online environment. RoQua sends personalized links via text messages in which the ESM-questionnaires are embedded. RoQua is formally recognized as an instrument to carry out research in the Netherlands and operates in accordance with the European General Data Protection Regulation .
Data will be pseudonymized and stored on a secured network, accessible only by members of the research staff. Staff are all subject to medical confidentiality via their employment at the mental healthcare facility. Personally identifiable material, such as study consent forms, will be stored separately from research data files. Data will be stored for 20 years after completion of the trial. Data integrity will be supported by fully computerized procedures, i.e., participants answering all questionnaires via a computer or their smartphone (within the RoQua environment). Hence, the chance of data being recorded incorrectly is improbable.
As the PRIMARY study includes young people who self-harm, the participant group can be considered a higher risk population, given the inherent risk of severe bodily damage and the predictive connection of self-harm to suicide attempts . Hence, careful consideration was given to the safety procedures and to imbedding this study within a safe care system. Previous ESM-studies have shown that frequently asking an individual about their symptoms, even suicidal ideation or negative emotions, does not increase the frequency of these symptoms [27, 43, 67, 68]. Furthermore, ESM was considered a promising method in the development of effective interventions for young people who self-harm  as it provides young people with the opportunity to monitor and intervene before self-harm occurs . If acute suicidality is identified during a weekly report session or a research assessment, a structured suicide-risk-protocol will be activated. This protocol was developed in line with the Dutch guidelines regarding suicide prevention , and involves the RA sharing the information with a clinician at the healthcare institution who will put the necessary interventions in place.
Serious adverse events, such as events that require hospitalization, will be monitored and reported to the Medical Ethical Board Utrecht within 15 days after the sponsor’s first awareness of the event. Serious adverse events that result in death or are life threatening will be reported within seven days of first knowledge. Since serious adverse events are monitored by the Medical Ethical Board, and given the safe care system in which the study is embedded, a Data Monitoring Committee is not required.
Data analysis plan and power calculations
Analyses that cover effectiveness of PRIMARY will be performed according to a modified version of the intention-to-treat principle , which entails including all participants with at least one data point post-baseline regardless of their compliance during the study. This way, random selection in the sample will be guaranteed which ensures the most accurate conclusions following the analyses. In the following section, analyses will be outlined for each study objective (i.e., research question) as well as the required sample size to answer the research questions based on relevant power analyses and recent literatureFootnote 1. Multiple imputation will be considered if the amount of missing values is non-trivial. The randomization stratification variable of age and gender will be examined as covariates in the analyses described below. Other covariates, such as concomitant treatment, will also be considered.
To examine the effectiveness of PRIMARY, an ANCOVA-test will be used to compare data from Wave 1 and 2 by study group (study objective 1). Specifically, the following variables will be examined: emotion regulation, quality of relationships, and self-harm. To reach a power of 0.80, the power analyses run in G*Power 3.1 Footnote 2 and R , with an additional correction for the pre-test as a covariate, indicated a sample size of n = 48 per group to be necessary to detect a medium effect size (α = 0.05). Taking into account a drop-out of 10% (based on the feasibility study), a total sample size of N = 106 is necessary to answer this research question.
Regarding the effect of PRIMARY on the effectiveness of subsequent specialized treatment (i.e., HYPE), an ANOVA-test repeated measures with a within-between interaction will be applied to Wave 1, 2 and 3 including only those participants receiving HYPE treatment (study objective 2). To reach a power of 0.80, a sample size of N = 42-106 is necessary when considering a medium-large effect size (G*Power 3.1) 1. Taking into account the 10% drop-out from the feasibility study, a sample size of N = 46-118 is required (i.e., young people receiving HYPE treatment).
To increase knowledge on underlying processes of self-harming thoughts and behaviors, and adaptive coping strategies on an individual level, a link between these constructs and emotions and social interactions will be examined using ESM data (study objective 3). Given the large number of measurements of the ESM-questionnaire (i.e., five times a day for 28 consecutive days per participant), these data are suitable for a single-case experimental design . This design focusses on the within-component of the data and is useful for investigating individual processes over time. Additionally, these analyses will be repeated on a group-level. Given the novelty of these types of analyses, it is expected that there will be relevant developments regarding statistical models in the upcoming years. Hence, the best applicable analyses will be considered once the data is collected. Currently, Group Iterative Multiple Model Estimation (GIMME)  would be an appropriate type of analysis to answer this research question. For GIMME, at least 60 data points are needed from each participant to reach sufficient power , i.e., participants with ≥ 43% compliance would be included.
Lastly, to characterize participants’ and clinicians’ evaluation of PRIMARY (study objective 4), descriptive statistics (e.g., means, standard deviations) will be calculated on the relevant questionnaires at Wave 2.
Ethics and dissemination
Ethical approval for this study was granted by the Medical Ethical Board Utrecht, the Netherlands (NL73936.041.20) on the 15th of July 2020. Important protocol modifications will be amended and submitted to the Medical Ethical Board Utrecht. Careful attention has been devoted to the consideration of participant privacy and confidentiality. Procedures to support privacy and confidentiality were discussed in detail with the legal department of GGz Centraal and are in line with the European and Dutch regulations on privacy . Participants can withdraw their consent and stop their participation in the study at any time without providing a reason. When this is the case, the data that has been collected thus far will be used in the study, unless the participant specifically requests their data to be deleted.
The study’s protocol has been publicly registered at the International Standard Randomized Controlled Trial Number registry (ISRCTN registry; doi: https://doi.org/10.1186/ISRCTN42088538). The final trial dataset belongs to the sponsor (i.e., GGz Centraal). The principal investigator has access to the dataset. The trial protocol, statistical code and other relevant information will be made publicly available on an appropriate archive platform for sharing purposes (e.g., Open Science Framework) alongside the publication of the trials’ results. The dataset will be available to other researchers on request. They can send in a brief research proposal to request access to the relevant data and may report on additional findings from the study.
Major outcomes of the study will be presented in publications in international peer-reviewed journals, at academic congresses, and any other forum in a de-identified form by the principal investigator, members of the steering committee and researchers who have significantly contributed in the execution of the study (e.g., PhD candidates). Authorship eligibility for publications will be based on contribution to the study and specific manuscript, in accordance with the Contributor Roles Taxonomy (CRediT) statement . Dissemination of findings will also commence in plain langue via the sponsors’ website. To promote the dissemination of findings in the clinical field, results will also be published in practice-oriented journals and presented at clinically oriented workshops and symposia.
The aim of the current multicenter randomized controlled trial is to examine the effectiveness of PRIMARY, a smartphone-based intervention for young people who self-harm and are awaiting further care at a mental healthcare institution. Specifically, its effect on emotion regulation and self-harming thoughts and behaviors will be examined. By using the ESM-methodology as both an intervention and measurement tool, the PRIMARY design is new within the field. Specific attention was given to increasing the feasibility of the study by co-designing PRIMARY with young people with lived experience of mental ill-health, including insights from earlier ESM-studies, and by conducting a feasibility study.
This study strives to evaluate an evidence-based, low-cost, structured intervention which can be offered to those seeking help in the future. Furthermore, the ESM-data allows for a detailed examination of the processes underlying self-harm, which will contribute to theoretical knowledge regarding this behavior.
After receiving ethical approval, a feasibility study was conducted between January and September 2021, whereafter adjustments were made to ensure feasibility of the RCT. The first participant was included in the RCT in October 2021. The study is currently ongoing. Data collection is predicted to continue until April 2026.
International trial-registration was uploaded retrospectively on the 26th of October 2022 at the ISRCTN registry (identification code: ISRCTN42088538). This protocol is version 1, dated September 2022.
The datasets generated and/or analyzed during the current study are not publicly available to protect study participant privacy. They are available from the corresponding author on reasonable request. Data are stored at controlled access servers at GGz Centraal.
New developments concerning the outlined statistical analyses and accompanying power analyses led to the adjustment of the necessary sample size in comparison to the ISTRCN registration, where a total of 180 participants was mentioned.
G*Power assumes the comparison group to deteriorate over time. However, stability was expected in this group in the current study. Hence, the suitable correction was implemented in G*Power when calculating the sample size needed to answer this research question.
PRe-Intervention Monitoring of Affect and Relationships in Youth
Experience Sampling Method
International Standard Randomized Controlled Trial Number
Dialectic Behavioral Therapy
Mentalization Based Treatment
Helping Young People Early
borderline personality disorder
randomized controlled trial
Standard Protocol Items: Recommendations for Interventional Trials
Cognitive Analytic Therapy
Positive And Negative Affect Scale
Difficulties in Emotion Regulation Scale
Network of Relationships Inventory – Behavior Systems Version
Usability Metric for User Experience
Client Satisfaction Questionnaire-8
- SCID-II BPD PQ:
Structured Clinical Interview for DSM-IV Axis II disorders Personality Questionnaire
Borderline Symptom List
Developmental Milestones List
Life Experiences Survey
Screeningsinstrument Psychische Stoornissen
Strengths and Difficulties Questionnaire
Levels of Personality Functioning Scale 2.0 - Brief Form
Personality Inventory for DSM-5 - Brief Form
short UPPS-P impulsive behavior scale
Depression Anxiety Stress Scales
Motivation for Youth Treatment Scale
Recovering Quality of Life
General Data Protection Regulation
Analysis of Covariance
Analysis of Variance
Griffin E, McMahon E. Adolescent mental health: global data informing opportunities for prevention. EClinicalMedicine. 2020;24:100413.
Griffin E, et al. Increasing rates of self-harm among children, adolescents and young adults: a 10-year national registry study 2007–2016. Soc Psychiatry Psychiatr Epidemiol. 2018;53:663–71.
Tørmoen AJ, Myhre M, Walby FA, Grøholt B, Rossow I. Change in prevalence of self-harm from 2002 to 2018 among Norwegian adolescents. Eur J Public Health. 2020;30:688–92.
Hawton K, et al. Deliberate self-harm in adolescents: a study of characteristics and trends in Oxford, 1990–2000. J Child Psychol Psychiatry. 2003;44:1191–8.
Gardner KJ, Paul E, Selby EA, Klonsky ED, Mars B. Intrapersonal and interpersonal functions as pathways to future self-harm repetition and Suicide attempts. Front Psychol. 2021;12:688472.
Borschmann R, et al. 20-year outcomes in adolescents who self-harm: a population-based cohort study. Lancet Child Adolesc Health. 2017;1:195–202.
Bohus M, et al. Borderline personality disorder. Lancet. 2021;398:1528–40.
Hawton K, Saunders KEA, O’Connor RC. Self-harm and Suicide in adolescents. Lancet. 2012;379:2373–82.
Moran P, et al. The natural history of self-harm from adolescence to young adulthood: a population-based cohort study. Lancet. 2012;379:236–43.
Hawton K et al. Interventions for self-harm in children and adolescents. Cochrane Database Syst. Rev 2021, CD012013 (2015).
Ougrin D, Tranah T, Stahl D, Moran P, Asarnow JR. Therapeutic interventions for Suicide attempts and self-harm in adolescents: systematic review and meta-analysis. J Am Acad Child Adolesc Psychiatry. 2015;54:97–107e2.
Chanen AM, Nicol K. Five failures and five challenges for prevention and early intervention for personality disorder. Curr Opin Psychol. 2021;37:134–8.
Francke AL, Smit MC, de Veer AJE, Mistiaen P. Factors influencing the implementation of clinical guidelines for health care professionals: a systematic meta-review. BMC Med Inform Decis Mak. 2008;8:38.
Dziak JJ. Optimizing the cost-effectiveness of a Multicomponent intervention using data from a factorial experiment: considerations, open questions, and tradeoffs among multiple outcomes. In: Collins LM, Kugler KC, editors. Optimization of behavioral, Biobehavioral, and Biomedical interventions: Advanced Topics. Springer International Publishing; 2018. pp. 207–67.
Skegg K. Self-harm. Lancet. 2005;366:1471–83.
Mars B, et al. Clinical and social outcomes of adolescent self harm: population based birth cohort study. BMJ. 2014;349:g5954.
Kaess M. Self-harm: a transdiagnostic marker of psychopathology and Suicide risk during the COVID-19 pandemic? Eur Child Adolesc Psychiatry. 2022;31:1–3.
Fitzpatrick S, Kuo JR. Predicting the effectiveness of engagement and disengagement emotion regulation based on emotional reactivity in borderline personality disorder. Cogn Emot. 2021;1–19. https://doi.org/10.1080/02699931.2021.2018291.
Reichl C, Kaess M. Self-harm in the context of borderline personality disorder. Curr Opin Psychol. 2021;37:139–44.
Groschwitz RC, et al. The situation of former adolescent self-injurers as young adults: a follow-up study. BMC Psychiatry. 2015;15:160.
Taylor PJ, et al. A meta-analysis of the prevalence of different functions of non-suicidal self-injury. J Affect Disord. 2018;227:759–69.
Witt KG, et al. Interventions for self-harm in children and adolescents. Cochrane Database Syst Rev. 2021;3:CD013667.
Brennan CA, et al. What helps people to reduce or stop self-harm? A systematic review and meta-synthesis of first-hand accounts. J Public Health. 2022. https://doi.org/10.1093/pubmed/fdac022.
Mummé TA, Mildred H, Knight T. How do people stop Non-suicidal Self-Injury? A systematic review. Arch Suicide Res. 2017;21:470–89.
Gorlin EI, Békés V. Agency via awareness: a unifying Meta-process in psychotherapy. Front Psychol. 2021;12:698655.
Høglend P, Hagtvet K. Change mechanisms in psychotherapy: both improved insight and improved affective awareness are necessary. J Consult Clin Psychol. 2019;87:332–44.
Andrewes HE, Hulbert C, Cotton SM, Betts J, Chanen AM. Ecological momentary assessment of nonsuicidal self-injury in youth with borderline personality disorder. Personal Disord. 2017;8:357–65.
Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010;10:113.
van den Bergh et al. Samen beter? Kinderartsen over samen-werking met kinder-en jeugdpsychiatrie. Tijdschr Gezondh Ethiek (2022).
Clark S, et al. Improving Access to child and adolescent Mental Health Care: the choice and Partnership Approach. J Can Acad Child Adolesc Psychiatry. 2018;27:5–14.
Ebert DD, et al. Internet- and mobile-based psychological interventions: applications, efficacy, and potential for improving mental health: a report of the EFPA E-Health Taskforce. Eur Psychol. 2018;23:167–87.
Larson R, Csikszentmihalyi M. The experience sampling method. In: Csikszentmihalyi M, editor. Flow and the foundations of positive psychology: the Collected Works of Mihaly Csikszentmihalyi. Springer Netherlands; 2014. pp. 21–34.
Brown AC, Dhingra K, Brown TD, Danquah AN, Taylor PJ. A systematic review of the relationship between momentary emotional states and nonsuicidal self-injurious thoughts and behaviours. Psychol Psychother. 2022;95:754–80.
Bos FM, Snippe E, Bruggeman R, Wichers M, van der Krieke L. Insights of patients and clinicians on the Promise of the experience sampling method for Psychiatric Care. Psychiatr Serv. 2019;70:983–91.
Kramer I, et al. A therapeutic application of the experience sampling method in the treatment of depression: a randomized controlled trial. World Psychiatry. 2014;13:68–77.
Riese H, von Klipstein L, Schoevers RA, van der Veen DC, Servaas MN. Personalized ESM monitoring and feedback to support psychological treatment for depression: a pragmatic randomized controlled trial (Therap-i). BMC Psychiatry. 2021;21:143.
Mens MMJ, et al. Promoting Daily Well-being in adolescents using mHealth. J Youth Adolesc. 2022;51:2173–89.
Rodríguez-Blanco L, Carballo JJ, Baca-García E. Use of Ecological Momentary Assessment (EMA) in Non-suicidal Self-Injury (NSSI): a systematic review. Psychiatry Res. 2018;263:212–9.
Arshad U, et al. A systematic review of the evidence supporting mobile- and internet-based psychological interventions for self-harm. Suicide Life Threat Behav. 2020;50:151–79.
Bevan Jones R, et al. Practitioner review: co-design of digital mental health technologies with children and young people. J Child Psychol Psychiatry. 2020;61:928–40.
Chanen AM, McCutcheon L, Kerr IB, HYPE:. A Cognitive Analytic Therapy-Based Prevention and Early Intervention Programme for Borderline Personality Disorder. in Handbook of Borderline Personality Disorder in Children and Adolescents (eds. Sharp, C. & Tackett, J. L.) 361–383. Springer New York (2014).
Chan A-W, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158:200–7.
van Roekel E, Keijsers L, Chung JM. A review of current ambulatory Assessment studies in adolescent samples and practical recommendations. J Res Adolesc. 2019;29:560–77.
Bülow A, van Roekel E, Boele S, Denissen JJA, Keijsers L. Parent-adolescent interaction quality and adolescent affect-An experience sampling study on effect heterogeneity. Child Dev. 2022;93:e315–31.
Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol. 1988;54:1063–70.
Stanley B, Brown GK. Safety Planning intervention: a brief intervention to mitigate Suicide risk. Cogn Behav Pract. 2012;19:256–64.
Gratz KL, Roemer L. Multidimensional assessment of emotion regulation and dysregulation: development, factor structure, and initial validation of the difficulties in emotion regulation scale. J Psychopathol Behav Assess. 2004;26:41–54.
Furman W, Buhrmester D, Methods, Measures. The Network of relationships Inventory: behavioral systems Version. Int J Behav Dev. 2009;33:470–8.
Finstad K. The Usability Metric for user experience. Interact Comput. 2010;22:323–7.
Attkisson CC, Greenfield TK. The client satisfaction questionnaire (CSQ) scales. Outcome assessment in clinical practice. Williams & Wilkins: Baltimore, MD, USA. Qualitative (1995).
First MB, Gibbon M, Spitzer RL, Benjamin LS, Williams JB. User’s guide for the structured clinical interview for DSM-IV Axis II Personality disorders: SCID-II. American Psychiatric Press; 1997.
Bohus M, et al. The short version of the Borderline Symptom List (BSL-23): development and initial data on psychometric properties. Psychopathology. 2009;42:32–9.
Laceulle OM, Koster N, van der Heijden PT, van Aken MAG. Development of a Developmental Task List. in progress.
Sarason IG, Johnson JH, Siegel JM. Assessing the impact of life changes: development of the Life experiences Survey. J Consult Clin Psychol. 1978;46:932–46.
Zwaanswijk M. De zelftest van Mindmasters.nl. https://www.kenniscentrum24kjp.nl/wp-content/uploads/2018/05/Rapport-zelftest-Mindmasters.pdf
Goodman R. The strengths and difficulties Questionnaire: a research note. J Child Psychol Psychiatry. 1997;38:581–6.
Hutsebaut J, Feenstra DJ. Development and preliminary psychometric evaluation of a brief self-report questionnaire for the assessment of the DSM–5 level of personality functioning scale: the LPFS brief form (LPFS-BF). Pers Disord : Theory Res Treat (2016).
Van der Heijden PT, Ingenhoven T, Berghuis H, Rossi G. Nederlandstalige bewerking van The Personality Inventory for DSM-5 ® — Brief Form (PID-5-BF). (2011).
Krueger RF, Derringer J, Markon KE, Watson D, Skodol AE. Personality inventory for DSM-5. Psychol MedicinePsychiatry Res. 2013. https://doi.org/10.1037/t30042-000.
Krueger RF, Hobbs KA. An overview of the DSM-5 Alternative Model of Personality disorders. Psychopathology. 2020;53:126–32.
Cyders MA, Littlefield AK, Coffey S, Karyadi K. A. Examination of a short English version of the UPPS-P Impulsive Behavior Scale. Addict Behav. 2014;39:1372–6.
Antony MM, Bieling PJ, Cox BJ, Enns MW, Swinson RP. Psychometric properties of the 42-item and 21-item versions of the Depression anxiety stress scales in clinical groups and a community sample. Psychol Assess. 1998;10:176–81.
Gierveld JDJ, Van Tilburg T. A 6-Item scale for overall, emotional, and Social Loneliness: confirmatory tests on Survey Data. Res Aging. 2006;28:582–98.
Breda CS, Riemer M. Motivation for youth’s treatment scale (MYTS): a new tool for measuring motivation among youths and their caregivers. Adm Policy Ment Health. 2012;39:118–32.
van Aken BC, de Beurs E, Mulder CL, van der Feltz-Cornelis CM. The Dutch recovering quality of life questionnaire (ReQoL) and its psychometric qualities. Eur Psychiatry. 2020;34:99–107.
European Commission. The General Data Protection Regulation (GDPR). eur-lex.europa.eu https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A02016R0679-20160504&qid=1532348683434 (2018).
Husky M, et al. Feasibility and validity of ecological momentary assessment in the investigation of Suicide risk. Psychiatry Res. 2014;220:564–70.
Nock MK, Prinstein MJ, Sterba SK. Revealing the form and function of self-injurious thoughts and behaviors: a real-time ecological assessment study among adolescents and young adults. J Abnorm Psychol. 2009;118:816–27.
Armey. Ecological momentary assessment and intervention in nonsuicidal self-injury: a novel approach to treatment. J Cogn Psychother (2012).
Van Hemert AM et al. Multidisciplinaire richtlijn diagnostiek en behandeling van suïcidaal gedrag. https://psychiatrieweb.nl/pw.spoed/files/docs/suicidaal%20gedrag/richtlijn/hulpmiddel/120801_MDR_DBSG_Gezondheidszorgwetgeving.pdf (2012).
Gupta SK. Intention-to-treat concept: a review. Perspect Clin Res. 2011;2:109–12.
Faul F, Erdfelder E, Buchner A, Lang A-G. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav Res Methods. 2009;41:1149–60.
Lakens D, Caldwell AR. Simulation-Based Power Analysis for Factorial Analysis of Variance Designs. Adv Methods Practices Psychol Sci. 2021;4:2515245920951503.
Bentley KH, Kleiman EM, Elliott G, Huffman JC, Nock MK. Real-time monitoring technology in single-case experimental design research: opportunities and challenges. Behav Res Ther. 2019;117:87–96.
Beltz AM, Wright AGC, Sprague BN, Molenaar P. C. M. bridging the nomothetic and Idiographic Approaches to the analysis of Clinical Data. Assessment. 2016;23:447–58.
Lane ST, Gates KM, Pike HK, Beltz AM, Wright AGC. Uncovering general, shared, and unique temporal patterns in ambulatory assessment data. Psychol Methods. 2019;24:54–69.
Brand A, Allen L, Altman M, Hlava M, Scott J. Beyond authorship: attribution, contribution, collaboration, and credit. Learn Publ (2015).
The authors like to thank the young people who participated in the feasibility study and would like to thank in advance those that will participate in the RCT. In addition, the authors thank A. van Voorst (data specialist at GGz Centraal) and the staff at RoQua (https://roqua.nl/), for building the platform on which PRIMARY is run.
This study is funded by the Netherlands Organization for Health Research and Development (ZonMw; 636310013). The funder had no role in the design of this study and will not have any role during its execution, analyses, interpretation of the data, or decision to submit results.
Ethics approval and consent to participate
Ethical permission to conduct the PRIMARY study was obtained by the Medical Ethical Board Utrecht, the Netherlands (NL73936.041.20). All participants, and parents or legal guardians for those aged < 16 years, signed written informed consent.
Consent for publication
The authors declare that there are no competing interests.
GGz Centraal; Westsingel 41; 3811 BB, Amersfoort; The Netherlands.
Issue date: October 2nd, 2023; Protocol version: 01.
Members: CJH (Principal investigator), MAGvA, OML, AMC, JKB, G. Blom, anonymous young people with lived experience of mental-ill health. The steering committee provided feedback on the design of the study and advice where needed during the implementation. G. Blom supported the young people with lived experience during this process.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
About this article
Cite this article
Aleva, A., van den Berg, T., Laceulle, O.M. et al. A smartphone-based intervention for young people who self-harm (‘PRIMARY’): study protocol for a multicenter randomized controlled trial. BMC Psychiatry 23, 840 (2023). https://doi.org/10.1186/s12888-023-05301-x