Ecological momentary intervention to enhance emotion regulation in healthcare workers via smartphone: a randomized controlled trial protocol
BMC Psychiatry volume 22, Article number: 164 (2022)
CUIDA-TE is an APP that offers transdiagnostic cognitive behavioral therapy focused on enhancing emotion regulation. As a novelty, it incorporates ecological momentary interventions (EMI), which can provide psychological support in real time, when suffering arises. The main goal of the study is to evaluate the efficacy of CUIDA-TE to improve emotion regulation in healthcare workers, a population that has been particularly emotionally impacted by the COVID-19 pandemic.
In this three-arm, randomized controlled trial (RCT) the study sample will be composed of a minimum of 174 healthcare workers. They will be randomly assigned to a 2-month EMI group (CUIDA-TE APP, n ≥ 58), a 2-month ecological momentary assessment (EMA) only group (MONITOR EMOCIONAL APP, n ≥ 58), or a wait-list control group (no daily monitoring nor intervention, n ≥ 58). CUIDA-TE will provide EMI if EMA reveals emotional problems, poor sleep quality/quantity, burnout, stress, or low perceived self-efficacy when regulating emotions. Depression will be the primary outcome. Secondary outcomes will include emotion regulation, quality of life, and resilience. Treatment acceptance and usability will also be measured. Primary and secondary outcomes will be obtained at pre- and post-intervention measurements, and at the 3-month follow-up for all groups.
To our knowledge, this is the first RCT that evaluates the efficacy of an APP-based EMI to improve emotion regulation skills in healthcare workers. This type of intervention might ultimately help disseminate treatments and reach a larger number of individuals than traditional face-to-face individual therapies.
Participant recruitment has not started.
The pandemic and healthcare workers
On March 11th, 2020, the WHO declared a worldwide pandemic level for a new coronavirus, the SARS-COV-2, better known by its disease name: COVID-19 . This pandemic has pushed the health systems around the world, including the Spanish one, to the limit. For example, the Spanish National Institute of Statistics estimates that over 84 thousand individuals have died due to COVID-19 in Spain , while over 4.5 million deaths have been calculated globally.
In addition to the burden of COVID-19 on our health systems, experts and institutions around the world have increasingly claimed for the importance of this pandemic on the mental well-being of individuals . The psychological side effects of the COVID-19 pandemic are vast and range from social isolation, fear of infection, marital conflicts, anxiety, post-traumatic stress, and depression, among others . In particular, a group of individuals that have experienced additional burden due to their high exposure to the disease and high work-related demands are healthcare professionals. A recent literature review including 24 studies supports the idea that the psychological effects of the pandemic on healthcare workers has been devastating globally . This is also the case of Spain, where at least 50% of Spanish healthcare professionals are at high risk of developing a mental disorder as a result of the stress associated with COVID-19 . In particular, this study showed that 28.1% of healthcare professionals suffered from depression, 22.5% had an anxiety disorder, almost 1 in 4 suffered from panic, 22.2% had post-traumatic stress disorder, and over 6% suffered from substance abuse. In addition, a recent investigation revealed that up to 8.4% of healthcare professionals have experienced suicidal ideation during the pandemic .
Healthcare workers are and have been facing very severe work stressors for many months. For example, they have been fighting against a relatively unfamiliar virus, have had to work for longer hours than usual, have often faced a high work overload and significant risk of infection, have had to follow very strict safety protocols, and have been asked to remain highly concentrated and vigilant [7, 8]. Not surprisingly, burnout and fatigue have significantly increased in this population as a result of the COVID-19 crisis . In this line, a study conducted at the beginning of the pandemic revealed that the most common symptoms in Spanish healthcare professionals were stress, anxiety, depression, and insomnia, which all occurred in significant levels . In another large study conducted during the first wave of the COVID-19 pandemic, one in seven healthcare professionals in Spain screened positive for a disabling mental disorder, from which emotional disorders were the most frequent . The findings suggested that workers frequently exposed to patients affected by COVID-19 patients or those who have been infected or quarantined/isolated should be considered groups that need special monitoring of mental health and psychological support. In addition to these problems, and similar to past epidemics, other adverse psychological reactions have also been observed, such as fear of infection, fear of contagion, fear of infecting family and friends, and uncertainty and stigmatization [12,13,14], which again adds to the burden of the COVID-19 pandemic.
As a result of the previous, there is growing concern about the psychological adjustment and recovery of healthcare workers who directly treat and care for patients, especially when the latter have an active infection or belong to vulnerable populations (e.g., the elderly). In particular, researchers support the idea that, if not adequately and timely addressed, the aforementioned stressors associated with patient care during the pandemic could potentially lead to the development of long-term anxiety disorders, depression, or post-traumatic stress disorder . As a result, recent studies have concluded that it is necessary to offer healthcare professionals, especially those who have been more impacted by the pandemic, psychological help to reduce the emotional impact of COVID-19. Ultimately, this might not only benefit their mental health, but also it will protect and help maintain the sustainability of our healthcare systems [15,16,17,18].
Transdiagnostic interventions to address emotion regulation in persons with emotional problems
In the last decade, transdiagnostic treatments have gained ground in the treatment of psychological problems, particularly anxiety and depression problems (i.e., emotional disorders, ED). Transdiagnostic treatments emphasize the need to target essential, shared mechanisms or processes that are common to a wide range of emotional problems without tailoring the protocol to specific diagnoses . This is important because it allows to offer a single intervention to individuals with different emotional problems, even if they have comorbidities (i.e., more than one emotional problem).
A transdiagnostic intervention for EDs that has received particular attention in the past years is the Unified Protocol . According to the UP, individuals with emotional disorders share a tendency to frequently and intensely experience negative affect and exhibit maladaptive reactions to these intense, unpleasant emotions [21, 22]. These responses to difficult emotional states are known as emotion regulation (ER) efforts and are key underlying mechanisms of psychopathology for the majority of third-wave psychological interventions, such as Dialectical Behavior Therapy (DBT [23, 24];), Acceptance Commitment Therapy (ACT ;), and the Unified Protocol . In fact, a recent systematic review  identified ER components across all intervention modalities and disorders, thus indicating that ER may be a transdiagnostic factor involved both in the expression and treatment of psychopathological problems. Vast evidence now supports this idea of ER as a transdiagnostic construct [27,28,29].
ER is a complex process that involves regulating emotional arousal and emotional expressions flexibly according to the context demands [30, 31]. Research has shown that emotion regulation strategies are associated with burnout in the professionals, so emotion regulation training is fundamental for healthcare professionals . When people deal with stress, such as the one described in healthcare professionals during the COVID-19 pandemic, ER enables individuals to evaluate the emotional impact of the situation and helps them to make decisions about the most preferable emotional reactions in that situation . In particular, the UP focuses on regulating negative affect by addressing emotional avoidance, promoting cognitive flexibility, facilitating exposure to avoided situations and sensations, and increasing present-focused emotional awareness .
Another treatment approach that includes principles or components that could be useful to target difficulties in emotion regulation is DBT. DBT is based on a skill deficit model that views dysfunctional behavior as either a consequence of dysregulated emotions or a maladaptive approach to ER . DBT places a special emphasis on increasing experiential awareness and acceptance (mindfulness techniques), but it also includes behavioral strategies focused on changing emotional reactions (e.g., opposite action) . This treatment has been suggested to be effective for a wide range of disorders with symptoms that are functionally similar to those of borderline personality disorder (e.g., depression, substance use disorder, anxiety disorders, and eating disorders), for which emotion dysregulation has been proposed to be the main etiological and transdiagnostic factor . More recently, DBT has also been used to address emotion dysregulation in clinical and non-clinical populations .
Considering the aforementioned evidence of transdiagnostic interventions for ER, the treatment proposed in this study will include different strategies from the UP and DBT. An emphasis will be placed on the prevention of emotional problems that may occur due to recurrent stress in healthcare professionals. Based on the results of past research, the selection of prevention strategies targeting common transdiagnostic processes (e.g., emotional dysregulation), as opposed to separate diagnostic categories, would present a number of advantages:  increase treatment efficacy, because common prevention strategies targeting shared processes would replace numerous interventions targeting specific disorders, thus allowing to treat more people simultaneously with less resources ; reduce economic costs by using only one intervention to prevent a broad set of emotional problems ; and, finally, transdiagnostic prevention strategies emphasize improving individual quality of life and functioning, which might help prevent disorders before they occur .
While the importance of psychological help during the pandemic has been recognized, healthcare professionals appear to face important barriers and restrictions to receiving mental health support . These appear to include, for example, the stigma associated with mental care, time restrictions, and lack of knowledge about the available resources for help. A recent call to action from mental health science underlines the importance of research identifying interventions that can be delivered under pandemic conditions to reduce its psychological impact, especially on vulnerable populations . Self-applied, online, and brief interventions could be a workable solution in this scenario.
COVID-19 has resulted in an unprecedented acceleration and penetration of the digital world in everyday life in general and in the mental health field in particular , so a new era of digital interventions is expected . While acknowledging this boost of information and communication technologies (ICTs) for mental care due to the COVID-19 pandemic, the use of ICTs is not new in the Psychology field. Internet-delivered interventions have demonstrated their efficacy in more than 100 controlled clinical trials [40, 41]. In the last 10 years, due to the increased availability of the Internet worldwide and its ubiquity through smartphones, a remarkable progress has been made in the field of psychological treatments with ICTs. As a result, the inclusion of technologies in psychological care has helped overcome some barriers and obstacles associated with psychological treatments, such as stigma, anonymity, economic accessibility, waiting lists, and travel restrictions, among others . Self-applied, online treatments can reach the patient in a more economical and immediate way and are accessible to people who would otherwise experience difficulties when attempting to receive treatment (e.g., due to long geographic distances to health centers, limited financial resources, or lack of time). Therefore, such interventions are feasible alternatives from an economic point of view, since they allow the dissemination of evidence-based treatments at low costs . Due to the advantages of self-applied, online psychological interventions, the aim of the present study is to test their efficacy and feasibility in a sample of healthcare professionals that have been in the front line of patient care during the COVID-19 pandemic.
Ecological momentary assessments and interventions: the importance of real time, ecological approaches to ER
Digital treatment platforms have advanced notably in the past years. Mobile devices, such as smartphones, are effective ways to deliver psychological interventions  and improve psychological assessment by minimizing problems like recall bias due retrospective assessments and the poor adherence to paper diaries . In addition, mobile devices take the aforementioned advantages of online treatments one step further by opening the door of ubiquity to ICT-based psychological interventions. In particular, smartphones allow users to carry the treatments with them in their pockets, which permits clinicians to react in real or in short time when a problem is detected (e.g., if a patient does not leave the home for several days) and facilitates tailoring (i.e., personalizing) treatments to the patient needs at any given moment (e.g., a treatment component can be provided depending on the problem reported in real time) .
Another advantage of mobile devices is that they facilitate the assessment and treatment of ER as situational and context-related processes . ER strategies are not adaptive or maladaptive per se, but dependent on the context in which they occur [47, 48]. For example, research has shown that, when the emotional intensity of a situation is low, people tend to use reappraisal , which is a form of cognitive change that involves reinterpreting the meaning of a potentially emotion-eliciting situation . Conversely, in the context of a situation with high emotionality, distraction (that consists of disengaging attention from emotional processing by producing neutral thoughts that are independent from and not in conflict with emotional information ) is usually preferred . A possible explanation suggested by Fruzzetti and Shenk  is that, when people are highly emotionally aroused, they experience poorer cognitive capacity, less self-awareness, and impaired ability to solve problems, which means that distraction may be an adaptive strategy on that specific context. There is already some evidence in this regard. For example, Sheppes et al.  showed that, when the intensity of emotional stimuli was low, cognitive demands were accordingly low, long-term goals were more easily activated, and individuals were more likely to implement cognitive reappraisal as an ER strategy. However, when the emotional stimuli were very intense, cognitive demands were high, short-term goals were more easily activated, and participants were keener to use distraction as a coping strategy. Overall, these findings support the view that ER strategy choice and utility is situational and context-related .
A common barrier to evaluating the effectiveness of psychological treatments has been related with the dynamic nature of emotional phenomena, which in a healthy individual fluctuates not only over time, but also notably within a single day . To date, research regarding ER has mostly been based on laboratory experiments, which tend to rely on retrospective evaluations and leave situated and momentary aspects relatively unknown . To overcome these limitations, ecological momentary assessment (EMA) has become increasingly popular in the ER research . EMA, also called Experience Sampling Method (ESM), emerged in the 1980s [56, 57], but has been traditionally difficult to implement due to the limitations of paper diaries . EMA requires the evaluation of individuals in the natural context and the moment (or as close as possible) in which events (e.g., an emotion) occur to increase the reliability and ecological validity of the measure obtained. EMA makes it possible to collect repeated inputs of thoughts, feelings, and behaviors close in time to the experience and in real-life contexts .
The popularity of EMA studies has clearly increased in the past years, arguably due to the increased availability of mobile applications . EMA has been used for both subjective  and objective  data collection, and this method has already significantly increased our knowledge about ER outside laboratory settings . Smartphone devices, which are now more accessible than ever , have shed new light into EMA and have renewed interest for this type of methodology.
In addition to EMA, smartphones facilitate Ecological Momentary Interventions (EMI), because they allow to provide psychological care to individuals in their natural environment at the time when the support is needed . EMIs consist of momentary treatments provided via mobile technologies while people are engaged in their typical everyday life routines. These interventions can be used as an adjunct to existing psychological therapies delivered by a therapist or they can be implemented as a stand-alone intervention . EMIs are important because they provide the patients with timely recommendations or therapeutic instructions when problems occur as opposed to time later during onsite appointments. This has been argued to reduce patient suffering, enhance treatment effectiveness, and reduce treatment costs [64, 65], which makes this a very suitable methodology to be implemented in new generation psychological treatments for EDs.
In sum, the availability and spread of smartphones has made EMA and EMI more feasible than ever. In fact, a recent systematic review into psychological interventions using mobile devices revealed an exponential growth of published studies focusing on the development of psychological treatments via smartphones . This study, however, indicated that a large number of investigations have used smartphones for monitoring purposes only (EMA), while RCTs comparing different functionalities or conditions are still infrequent (15.8%). The present investigation represents a step in this direction.
The current study treatment
As mentioned earlier, healthcare workers have been under a great deal of stress for almost 2 years due the COVID-19 pandemic. As a result, an important number of them have experienced significant levels of stress, anxiety, depression, and insomnia . It is important to note, however, that healthcare workers are not necessarily clinical population with previous psychopathological problems. On the contrary, they might be mentally healthy individuals that are exposed to important chronic stressors and, as a consequence of this exceptional situation, might benefit from some psychological support for prevention purposes. As noted earlier, learning ER skills can prevent the onset of emotional disorders, their maintenance, and worsening, as well as improve the quality of life of individuals. In particular, transdiagnostic interventions focused on teaching emotion regulation skills may be good therapeutic options to teach healthcare professionals how to cope with stress  and burnout .
Because time restrictions in healthcare professionals are frequent and we aim to offer timely interventions, we propose a two-month brief intervention using smartphones. This technology allows users to receive a treatment in real/short time and facilitates the adaptation of treatments to the needs of patients at any given moment. In this study, we aim to take a step further by comparing two types of innovative interventions. More specifically, the current study will analyze the efficacy of an ecological momentary intervention (EMI) to enhance emotion regulation skills compared with an ecological momentary assessment (EMA), which might enhance awareness of emotions, and a wait-list control group (no daily monitoring nor intervention).
The EMI will be an interactive intervention allowing healthcare workers to record their emotional states at momentary periods. In addition, they will receive contextual ER strategies on request. Considering the recent research on ER strategy choice [49, 53, 66], the logic of displaying one ER strategy or another via EMI will be based on the type of emotional state and emotional intensity reported by the participant. On the other hand, because emotional awareness is a form of emotion regulation processing , assessing emotions daily may help improve the self-awareness of emotions, thus contributing to a better emotional regulation. Therefore, an EMA only condition will be included in this study to distinguish the effect of EMA and EMI. The EMI protocol will include different transdiagnostic cognitive behavioral interventions that will be administered to healthcare workers who are or have been recently and repeatedly exposed to COVID-19 related stress. The treatment will be administered via smartphone during 2 months. Treatment efficacy will be evaluated at post-treatment and 3 months later (follow-up). To the best of our knowledge, this is the first investigation that aims to evaluate the efficacy of an ecological, momentary, and self-administered transdiagnostic psychological intervention via smartphone for healthcare professionals during the pandemic.
Study aims and design
The goal of this study is to evaluate the efficacy of an ecological, momentary, and self-administered transdiagnostic psychological intervention via smartphone for healthcare professionals (compared to an ecological momentary assessment group and a wait-list group) to decrease depression, difficulties in emotion regulation and increase professional quality of life and resilience. We also would like to study the usability and acceptability of the technology.
The current study will use a randomized controlled superiority trial design. A minimum of 174 healthcare workers will be randomly assigned into three conditions: (1) EMI intervention group, (2) EMA intervention group, and (3) wait-list control group. An online informed consent form will be signed by the participants before randomization. Assessments will be conducted at pre-treatment, post-treatment, and 3- month follow-up. The experimental groups will use different apps during 2 months: the experimental group (1) will use an EMI app (CUIDA-TE) and the experimental group (2) will use an EMA app (MONITOR EMOCIONAL). For ethical reasons, when the wait-list group completes the post-treatment assessment (2 months after the base-line evaluation), the EMI app will be offered if the interim analyses support this. Participants in the EMA condition will also be offered this option at the end of the 3-month follow-up, again if the results support this. The trial has been approved by the Ethics Committee of Humans Research of the Ethics Commission in Experimental Research of University of Valencia (Spain) and it has been registered in clinicaltrials.gov as NCT04958941 (https://clinicaltrials.gov/ct2/show/NCT04958941). The study will adhere to the recommendations of the Consolidated Standards of Reporting Trials (CONSORT) . The design of the study is outlined in Fig. 1.
Participants, recruitment, and eligibility criteria
A sample of 174 healthcare workers will be recruited from the Spanish healthcare system (hospitals, primary care centers, and nurse care centers). Participants will be eligible if they meet the inclusion criteria: 1) being an active healthcare worker and 2) having an Android smartphone with Internet access. Participants will be excluded if they are already receiving a psychological treatment at the time of the recruitment or 2) having a smartphone with an operating system different to Android. Participants will be recruited from two sources: 1) volunteers from a large healthcare provider company (GESMED company, with 2.500 healthcare workers at the region) and 2) volunteers from different healthcare organizations recruited online using social media (paid campaigns) and personal contacts.
The sample size was calculated a priori using GPower . Assuming a conservative effect size of 0.20, an alpha level of 0.05, an 80% power, three groups, and 3 measurements, a sample of 152 was obtained. Assuming a 15% of attrition, we will recruit a minimum of 174 participants. The small attrition rate is based on a systematic review showing that interventions for mental health that incorporate technology, such as blended interventions, tend to obtain lower dropout rates . The effect size in favor of EMI compared to EMA and the control condition is also inspired by past research .
Primary and secondary outcomes
The sociodemographic information (see Supplementary file 1) will be gathered with an ad hoc questionnaire that evaluates sex, age, specific healthcare profession, marital status, if they share their home with a COVID-19 vulnerable person, where they work (type of health care center, such us hospital, primary care, nurse home, etc.), if they work directly with COVID-19 patients, and number of COVID-19 deaths in their region (this will be collected from external, official sources) .
The primary outcome is the Brief Patient Health Questionnaire Mood Scale (PHQ-9) for depression. Secondary outcomes include the Emotion Regulation Questionnaire (ERQ), the Difficulties in Emotion Regulation Questionnaire (DERS), the Brief Resilience Scale (BRS), and the Short Professional Quality of Life Scale (ProQOL Short). Primary and secondary outcomes will be obtained at baseline, post-intervention, and 3-month follow-up.
The PHQ-9 is a 9-item depression module from the full PHQ where the user indicates the severity of depression during the previous 2 weeks. The symptom is presented in a scale measuring the frequency from 0 to 3 (0= “not at all” to 3 =” nearly every day”). The PHQ-9 has demonstrated its validity as a brief measure of depression severity in clinical samples  and the general population . The PHQ-9 score is divided into the following severity categories: 5–9 (mild depression), 10–14 (moderate depression), 15–19 (moderately severe depression), and 20 or greater (severe depression). The range for the PHQ-9 is 0-to-27. The Spanish version of the scale has demonstrated good psychometric properties .
The ERQ is a 10-item self-report measure that evaluates the use of cognitive reappraisal and emotion suppression as ER efforts to regulate emotions [74, 75]. The items are rated on a 7-point scale (1 = “strongly disagree” to 7 = “strongly agree”). We will use the Spanish adaptation of the ERQ , which has obtained good internal reliability estimates for both reappraisal (.79) and suppression (.75).
The DERS  is a 28-item questionnaire that explores five dimensions of emotion dysregulation, including lack of control, life interference, lack of emotional attention, emotional confusion, and emotional rejection. Items are rated on a scale of 1 (“almost never”) to 5 (“almost always”). We used its Spanish adaptation . The Cronbach’s alpha of the total dysregulation score has been excellent: .93 .
The BRS  evaluates resilience, understood as the ability to recover from stress. The BRS has 6 items rated from 1 (“strongly disagree”) to 5 (“strongly agree”). The scale has a Cronbach’s alpha of .80.
The ProQOL Short  is a 9-item questionnaire with 3 subscales: Compassion satisfaction, which evaluates the positive and altruistic aspects of the helping work, burnout, and secondary traumatic stress. The responses are rated on a 5-point Likert scale, in which participants indicate the frequency of each item in the last 30 days (1 = “never”, 2 = “rarely”, 3 = “Sometimes”, 4 = “Often”, and 5 = “Very Often”). ProQoL Short is based on version V of the Professional Quality of Life Scale. This questionnaire has been recently used in many studies about psychological effects of COVID-19 in healthcare professional [9, 81, 82] and its subscales have obtained good internal consistency estimates ranging from .75 to .88 . ProQoL Short showed an adequate internal structure and invariance across the studied countries .
In addition to the clinical measures, we will evaluate typical outcomes in technology studies, namely usability and acceptability of the technology and fidelity with its use. Usability and acceptability of the technology will be measured with the Acceptability and System Usability Scale (SUS) and the Usability and Acceptability Questionnaire (CUA-Brief). The SUS  is a reliable, 10-item questionnaire that assess the usability of a technology application. The SUS has an acceptable reliability (Cronbach alpha of.91) . Items are rated from 1 (“Strongly disagree”) to 5 (“Strongly agree”). Unacceptable usability could indicate that a user had difficulties while using the program, thus suggesting that the administration of the intervention through technological application could be considered a barrier for the clinical effect. The SUS can be interpreted with a qualitative scale (from “worst imaginable” to “best imaginable”) . The CUA-Brief measures the acceptability of a technology using 7 items. It was designed ad hoc in a previous study. This is not an officially validated measure, but its Cronbach alpha in a previous study by our team was excellent: .94 . The CUA-Brief allows to assess the user’s opinion about an application (perceived control while using the application, perceived ease-to-use of the app, intention to use the application in the future, confidence when using the app, feelings when using the app, and satisfaction with the size of the elements). All items are rated on a 5-point Likert scale ranging from 0 (“Totally disagree”) to 4 (“Totally agree”).
Finally, fidelity will be evaluated using passive outcomes, in line with past research. These measures will include the percentage of users making daily logins (at least 1) with respect to the total number of participants who started the treatment, the Percentage of users who continue to use the APP after 4 weeks, the Percentage of users who voluntarily use the APP outside the scheduled hours, and the Total time spent using the APP .
As mentioned earlier, the daily assessment of emotions could improve self-awareness about the emotional status and thus contribute to better emotional regulation. To control for this, the two mobile applications (EMI app and EMA app) will assess the same variables daily. These will include joy, fatigue, sadness, anxiety, anger, burnout, sleep quantity, sleep quality, perceived stress, and implemented ER (coping) skills, which have been found to be relevant emotional states reported by healthcare workers [10, 11]. Each variable will be responded using an 11-point slider question (from 0 to 10). Table 1 contains a description of the items used in the study. Items from 1 to 5 have been previously validated in a previous study , while items 6 to 10 have been elaborated ad hoc for this investigation. All items use the same format, except item 7 (sleep quantity), where the user has to select the number of hours slept. The users will receive a daily reminder to answer the 10 questions. The purpose of this reminder is to facilitate adherence. However, following the real-time and real-world philosophy of ecological and momentary assessments, the users will be able to open the app and answer to these questions on demand at any moment.
Two active conditions will be used in this study, that is, (1) the EMI intervention and (2) the EMA condition. Because, Android OS represents 80% of the users in Spain , the apps for this study have been developed only in this operating system. Further development in other mobile operative systems will be done after the results have been analyzed.
Monitor emocional APP (EMA condition)
“MONITOR EMOCIONAL” is an app for ecological momentary assessment developed in Android OS (https://play.google.com/store/apps/details?id=monitoremocional.code&gl=ES). To use this app, users will have to obtain a code from the researcher. The app will be active during 2 months. When the users open the app, the 10 daily items from Table 1 will be showed in a linear manner. After the two-month daily evaluation, the app will suggest the users to uninstall the application and will stop sending them the reminders to complete the evaluations. The users will be able to use the app any moment during the two-month period. The intervention aspect of this app is grounded on the first step of the emotion regulation process, that is, self-awareness of emotions through daily assessment.
CUIDA-TE APP (EMI condition)
“CUIDA-TE” (which could be translated to “TAKE CARE OF YOURSELF”) is an app for EMI developed in Android. As in the previous app, to use the CUIDA-TE app the user will have to obtain a code from the researcher. The app will be active during 2 months. Again, when users open the app the 10 daily items from Table 1 will be showed in a linear manner. The interventions are mediated by the intensity and type of emotional state. Thus, when the user reaches the specific scores detailed in Table 2, an EMI will be activated to offer the intervention objects linked with this score and construct. The clinical alarms in Table 2 were set after a series of meetings with experts in clinical psychology and mood disorders. For the cut-offs of severe, moderate, and mild levels of symptomatology, we followed the recommendations from past research (0–4 for mild, 5–6 for moderate, and 7–10 for severe) . Considering the results on ER strategy choice research [49, 53], when participants report a low-moderate emotional intensity, interventions related to cognitive reappraisal and behavioral change will be proposed. On the contrary, when participants indicate high emotional intensity, strategies focused on attentional deployment such as relaxation, mindfulness, and distraction will be indicated.
The interventions detailed in Table 2 consist of treatment strategies and exercises based on principles of different evidence-based transdiagnostic cognitive behavioral interventions that aim to regulate the problematic emotion experienced. Most of the strategies were adapted and abbreviated from the UP  and DBT treatments to be delivered through a smartphone as an EMI (using multimedia objects). In the following lines we briefly describe the intervention developed for each emotion. As a note, psychoeducation components were included in several EMIs to introduce the background of the intervention.
When joy is reported to be high, the goal would be to include interventions to up-regulate positive emotion (i.e., increase its intensity or duration), which has been associated with fewer symptoms of psychopathology and increased reports of life satisfaction and well-being . Different exercises are proposed to practice focusing on positive such as savoring (i.e., focus our attention on what is positive in our day-to-day life).
Fatigue usually refers to an impairment in task performance at an individual’s normal capacity. The major cause of fatigue for healthcare workers are disruptions of sleep and other health habits , which have been aggravated after the COVID-19 pandemic . Therefore, when fatigue is high, participants will be first directed to read a psychoeducation self-care module to improve health habits. After that, other mindfulness (observe with five senses) and relaxation (paced-breathing) exercises from DBT will be delivered to increase awareness and a sense of calm, respectively .
Mindfulness and positive reminiscence interventions are proposed when sadness is high. Mindfulness practice has been associated with increases in happiness  and decreases in depression . An example of a mindfulness exercise is to observe a joyful environment of a virtual nature scenery. Remembering positive personal past memories is another recommended exercise. However, when sadness is moderate, reappraisal, which leads to a decrease in negative emotion experience and expression , and behavioral activation are recommended. An example of a reappraisal exercise is checking the facts, a skill from DBT . Exercises of behavioral activation to achieve personal goals and values are also recommended to decrease depression .
Different exercises of distraction (safe place exercise), relaxation (paced breathing exercise), and mindfulness (observing nature with relaxing instructions) are proposed for high anxiety scores. The ultimate goal of these techniques in the context of this intervention is to induce relaxation and calm as ways to rapidly reduce emotional arousal . For moderate anxiety scores, a cognitive change technique named cope ahead is proposed to develop effective strategies to manage anxiety ahead of time using imagination .
When anger is high, distraction (STOP exercise), mindfulness (in a relaxing virtual nature), and relaxation (paced breathing and progressive muscle relaxation) exercises are proposed. An example of EMI for high anger is the STOP skill that instructs participants to step back, observe, and proceed mindfully towards the situation that sets up the emotion . For moderate anger scores, problem solving is aimed to change difficult situations when an emotion fits with the facts , whereas acceptance refers to accepting the situation or incapacity to deal with it . This last strategy is especially useful in situations that cannot be easily modified or reappraised (e.g., deaths that resulted from COVID-19) and has been found to be protective at both psychological and physical levels . Examples of acceptance interventions are short exercises to practice acceptance with the body .
Research has shown that the COVID-19 pandemic has negatively impacted the feeling of burnout in healthcare professionals . When burnout is high, as recommended with fatigue, participants will be first directed to a psychoeducational module. After that, mindfulness exercises to increase emotional awareness and a sense of calm will be proposed. On the contrary, when burnout is moderate, working on goals and values through behavioral activation exercises is recommended.
7,8.-sleep quantity and quality
Disruption of the circadian sleep rhythm and sleep deprivation are common in healthcare professionals . Both sleep quantity and quality will be measured. When sleep quantity is low or moderate (assessed as the number of sleep hours), psychoeducation on sleep and self-care habits are recommended. Regarding sleep quality, when this is high, participants will be instructed to practice savoring of the moment to increase awareness about the positive experience. On the contrary, when this is moderate, the participants will receive mindfulness and relaxation exercises to increase awareness and calmness.
This refers to the degree to which people evaluate life situations as stressful . Research has shown that perceived stress has increased among health care professionals working during the COVID-19 . In the study, when perception of stress is high, the same exercises proposed for anxiety will be recommended. As opposed to this, when stress levels are moderate, strategies to achieve behavioral change such as problem solving and behavioral activation will be proposed. In addition, a psychoeducational self-care module will also be presented for moderate stress.
10.-Self-perception of coping skills
Research has revealed that positive coping strategies have a beneficial impact on mental health outcomes . When self-perception of coping skills is low, practicing cope ahead can help healthcare professionals to develop and observe themselves practicing effective coping skills on the imagination in order to later put them into practice in real stressful situations. On the other hand, for moderate scores, problem solving and behavioral activation are recommended to develop solutions and take steps to achieve personal values respectively.
Whenever a user scores within the parameters defined in Table 2, an EMI will be activated and the interventions will be presented in the form of exercises in multimedia and self-applied format (audio, video, text, or little webpages). The exercises will be stored in the library section, so that the user will be able to revise the content at will. An example of the flow followed by the users using the EMI app is shown in Fig. 2.
The intervention of the CUIDA-TE app is grounded on 1) self-awareness of emotions through daily assessment and 2) learning and training adaptive responses depending on the nature and intensity of the emotion.
Shared features (the initial instructions and the assessment) from both apps also include an equivalent graphical user interface. Figure 3 shows an example of the graphical user interface of both apps. Both APPs have a missing alarm as well. If the user does not answer to the daily EMA during four consecutive days, the lead researcher will receive an automatic email warning and contact the user to check if they have a technical problem or if this reflects a potential dropout. This procedure aims to reduce attrition rates.
Randomization and procedure
Participants will be volunteers of a healthcare provider company (GESMED) and different healthcare organizations (online recruitment). For volunteers recruited online, the call of participants will be made using an open campaign that will be disseminated via social networks (WhatsApp, Instagram, Twitter, Facebook, and LinkedIn) and personal contacts. For the GESMED volunteers, the call of participants will be done sending an internal e-mail to the workers offering the study information and the website for the study (www.cuidateapp.com). Interested candidates from both sources who meet the inclusion criteria will be included in the study after the informed consent is signed online. The randomization will be conducted by an independent researcher not involved in the study and qualified from clinical point of view. Participants will be allocated to one of the three conditions using a computer-generated random software (Random allocation software 2.0 ;). After signing the consent form and once the randomization is made, the participants will know the condition in which they are allocated and will receive a brief explanation of the characteristics of their condition.
First, all users will fill the baseline questionnaires (primary and secondary outcomes) online. The first intervention group will use the CUIDA-TE app during 2 months. The second intervention group will use MONITOR EMOCIONAL app, again during 2-months. The wait-list control group will remain without treatment in a waiting list condition during 2-months. After that, they will be offered the opportunity to receive the intervention app (CUIDA-TE app) if the interim analyses support this. Primary and secondary outcomes will be measured again at post-treatment (2 months after the baseline assessment) and at follow-up (3 months).
Ethics and dissemination
This study follows the ethical standards of the Declaration Helsinki and existing guidelines of Spain and the European Union for humans’ protection in clinical trials. All participants will be volunteers, and once the study has been explained to them and if they agree to participate, they will sign an online informed consent form. Participants will be able to withdraw from the study at any time. Regarding data security, both apps will follow the strictest rules, namely the General Data Protection Regulation (GDPR), Organic Law 3/2018 of 5 December and regulation 2016/679 of the European Parliament and of the Council  and neither CUIDA-TE nor MONITOR EMOCIONAL will store any personal data. The data will be stored on two servers connected locally at the University, following the corresponding legal regulations. However, the APP will not collect any personal data. The users will be identified with an external anonymous ID provided by the researcher. This information will only be known by the user and the lead researcher. This project, entitled “CUIDA-TE, an APP for the emotional management of the healthcare professionals” was approved by the Ethics Commission in Experimental Research of the University of Valencia in May 2021 (Register code: 1547727). It has been registered in clinicaltrials.gov (https://clinicaltrials.gov) as NCT04958941 (https://clinicaltrials.gov/ct2/show/NCT04958941).
Data analysis plan
First, to ensure that the randomization process was successful, the three study conditions will be compared at baseline on all study outcomes. Then, a multilevel linear mixed model, which effectively handles missing data, will be computed. All assessment points will be included in the model. A restricted maximum likelihood method will be used to estimate the parameters. If differences at baseline are revealed, we will include them as covariates in the linear mixed model. Effect sizes (Cohen’s d) will be calculated . Usability and acceptability will be evaluated with descriptive analyses.
All analyzes will be performed with SPSS v26.0. To conduct and report the study, we will follow the recommendations of the Consolidated Standards of Reporting Trials (CONSORT) .
Recent studies have indicated that the psychological effects of the pandemic COVID-19 among healthcare workers have been devastating globally . In the same line, recent studies with Spanish healthcare professionals have shown a very high risk of developing a mental disorder (at least 50% of professionals) in this population [6, 11]. There is therefore an urgent call to action for mental health science to prioritize research on psychological interventions that can be feasibly delivered in the current pandemic conditions at a personalized level . According to some studies, only one in four people receive psychological treatment and, in many cases, these interventions are not evidence-based [104, 105]. Public resources for mental health care are, in Spain and globally, clearly insufficient , which is reflected in long waiting lists to receive a first and successive appointments [107, 108]. Self-applied treatments via the Internet or with apps, which are at least as effective as active face-to-face individual therapy [41, 109,110,111], can reach the patient in a more economical and immediate way and are accessible to people who would otherwise have difficulties in receiving treatment (for example, due to long geographical distances to health centers, limited financial resources, stigma associated with mental health care, or lack of time). Therefore, these types of interventions are economically viable alternatives to face-to-face individual interventions, as they allow the dissemination of evidence-based treatments at low cost .
The use of ICTs in psychological treatments is not new. More than 100 randomized controlled trials have shown the effectiveness of online interventions , but the COVID-19 has undoubtedly boosted their progress, use, acceptability, and need due to the restrictions in delivering face-to-face interventions . In this pandemic situation, the recommendations are to overcome the lack of time, the face-to-face restrictions, and facilitate personalized interventions in the moment when problems occur (or as close as possible).
Research has shown that ER allows individuals to cope with emotional situations . Recent findings also revealed that ER strategies may not be adaptive or maladaptive per se, but depending on the context in which they occur [47, 48]. Thus, the use of traditional, contextually-unrelated interventions is likely to be insufficient. Ecological momentary interventions that include evidence-based ER strategies delivered in the context where the emotion occurs may be suitable to overcome all these barriers .
This paper describes the protocol of a randomized controlled trial that aims to investigate the efficacy of an EMI app based on principles of different transdiagnostic cognitive behavioral interventions focused on ER. Specifically, we want to investigate the efficacy of the CUIDA-TE app to improve the psychological well-being and reduce the suffering of healthcare workers who are or have been experiencing very stressful work situations related to the COVID-19 pandemic. It is known that stressful situations and chronic strains have a considerable impact on physical and mental health  and the literature supports the importance of training on adaptive strategies to regulate emotions in order to avoid negative psychological outcomes [113, 115, 116]. Therefore, the present study appears to fit well with the needs of healthcare professionals. If the APP proves to be useful for the present study sample, we intend to test its efficacy in different samples in need from the general population or in clinical samples with emotional disorders. Because daily emotional assessments only (i.e., EMA) could act as an emotional regulation intervention (because emotional awareness is linked with the emotion regulation process) , we will study the effect of daily emotional assessments (EMA condition with APP “Monitor Emocional”) and compare this with the effect of different transdiagnostic cognitive behavioral interventions (EMI condition with APP “CUIDA-TE”), as well as with a waiting-list condition.
The current study has a number of strengths. First, to our knowledge, this is the first RCT to test an ecological momentary intervention to enhance ER strategies on healthcare professionals. Second, using transdiagnostic interventions to prevent emotion dysregulation (instead of one intervention for each specific problem) allows us to manage different problems at the same time, thus reaching more people and saving costs and time for the healthcare systems. Third, this study will be carried in different health contexts (hospital, primary care, nurse homes, etc.) and professions (physicians, nurses, physiotherapists, etc.), which may provide a map of what types of professionals and contexts have endured the most extreme stress generated by the pandemic allowing us to design more specific interventions in the future.
Finally, some limitations are expected. First, taking previous literature, dropout rates are expected, so this has been considered in the sample size calculation. Second, stigma about mental health could exist among potential participants. To mitigate this, all the information in the app will be anonymous. It is also possible that some professionals are reluctant to participate. To address this, an information website currently under construction will be provided with detailed information about the study and previous experience of the team (http://www.cuidateapp.com/). Finally, because there is no active control (e.g., an onsite psychological intervention) because this is not offered in the Spanish health system for healthcare professionals in a routine manner, the comparisons will only be made between the waiting list condition and the two active comparators (EMI vs EMA).
We expect that the findings of the study will contribute to advance in the knowledge on the use of EMAs and EMIs for emotion regulation. In addition, they will contribute to improve the quality of Internet-based psychological programs, which could be used for low-intensity interventions delivered through mobile phones or as complementary tools in face-to-face treatments.
Participant recruitment has not started. The recruitment will start in February 2022 and will continue approximately until October 2022. Follow-ups are expected to be completed by December 2022.
Availability of data and materials
It is not possible to share the data because the study status is “Not yet recruiting”.
Acceptance and Commitment Therapy
Brief Resilience Scale
Consolidated Standards Of Reporting Trials
Usability and Acceptability Questionnaire
Dialectical Behavior Therapy
Difficulties in Emotion Regulation
Ecological Momentary Assessment
Ecological Momentary Intervention
Emotion Regulation Questionnaire
Experience Sampling Method
General Data Protection Regulation
Information and Communication Technologies
Brief Patient Health Questionnaire Mood Scale
- ProQOL Short:
Short Professional Quality of Life Scale
Randomized Controlled Trial
Stop; Take a step back; Observe; Proceed Mindfully
System Usability Scale
WHO. Rolling Updates on Coronavirus Disease (COVID-19). 2020.
INE. Información estadística para el análisis del impacto de la crisis COVID-a9. Instituto Nacional de Estadística (España) 2021. https://ine.es/covid/covid_salud.htm. Accessed 12 Dec 2020.
Martín-Brufau R, Suso-Ribera C, Corbalán J. Emotion network analysis during COVID-19 quarantine - A longitudinal study. Front Psychol. 2020;11. https://doi.org/10.3389/fpsyg.2020.559572.
Wind TR, Rijkeboer M, Andersson G, Riper H. The COVID-19 pandemic: The ‘black swan’ for mental health care and a turning point for e-health. Internet Interv. 2020;20:100317. https://doi.org/10.1016/j.invent.2020.100317.
De Kock JH, Latham HA, Leslie SJ, Grindle M, Munoz SA, Ellis L, et al. A rapid review of the impact of COVID-19 on the mental health of healthcare workers: implications for supporting psychological well-being. BMC Public Health. 2021;21:1–18.
Mortier P, Vilagut G, Ferrer M, Serra C, Molina JD, López-Fresneña N, et al. Thirty-day suicidal thoughts and behaviors among hospital workers during the first wave of the Spain COVID-19 outbreak. Depress Anxiety. 2021;38:528–44. https://doi.org/10.1002/DA.23129.
Vieta E, Pérez V, Arango C. Psychiatry in the aftermath of COVID-19. Rev Psiquiatr Salud Ment. 2020;13:105–10. https://doi.org/10.1016/j.rpsm.2020.04.004.
Brooks SK, Webster RK, Smith LE, Woodland L, Wessely S, Greenberg N, et al. The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet. 2020;395:912–20. https://doi.org/10.1016/S0140-6736(20)30460-8.
Franza F, Basta R, Pellegrino F, Solomita B, Fasano V. The role of fatigue of compassion, burnout and hopelessness in healthcare: experience in the time of Covid-19 outbreak. Psychiatr Danub. 2020;32:S10–4.
Dosil Santamaría M, Ozamiz-Etxebarria N, Redondo Rodríguez I, Jaureguizar Alboniga-Mayor J, Picaza GM. Impacto psicológico de la COVID-19 en una muestra de profesionales sanitarios españoles. Rev Psiquiatr Salud Ment. 2020; In press.
Alonso J, Vilagut G, Mortier P, Ferrer M, Alayo I, Aragón-Peña A, et al. Mental health impact of the first wave of COVID-19 pandemic on Spanish healthcare workers: A large cross-sectional survey. Rev Psiquiatr y Salud Ment. 2021;14:90–105.
Li Y-F, Zhang Y-G, Niu J-T, Si X-L, Yan X-K. Analysis of TCM in prevention and treatment of post-traumatic stress disorder induced by COVID-19. Chinese Tradit herb. Drugs. 2020;51:1130–8.
Lee AM, GWS Wong J, McAlonan GM, Cheung V, Cheung C, Sham PC, et al. Stress and psychological distress among SARS survivors 1 year after the outbreak. 2007.
Taylor S, Landry CA, Rachor GS, Paluszek MM, Asmundson GJG. Fear and avoidance of healthcare workers: an important, under-recognized form of stigmatization during the COVID-19 pandemic. J Anxiety Disord. 2020;75:102289.
Trumello C, Bramanti SM, Ballarotto G, Candelori C, Cerniglia L, Cimino S, et al. Psychological adjustment of healthcare Workers in Italy during the COVID-19 pandemic: differences in stress, anxiety, depression, burnout, secondary trauma, and compassion satisfaction between frontline and non-frontline professionals. Int J Environ Res Public Heal. 2020;17:1–13. https://doi.org/10.3390/ijerph17228358.
Talaee N, Varahram M, Jamaati H, Salimi A, Attarchi M, Kazempour dizaji M, et al. Stress and burnout in health care workers during COVID-19 pandemic: validation of a questionnaire. J Public Heal. 2020;1. https://doi.org/10.1007/s10389-020-01313-z.
Morgantini Id LA, Naha U, Wang H, Id SF, Mer Acar O¨, Flores JM, et al. Factors contributing to healthcare professional burnout during the COVID-19 pandemic: A rapid turnaround global survey; 2020. https://doi.org/10.1371/journal.pone.0238217.
Matsuo T, Kobayashi D, Taki F, Sakamoto F, Uehara Y, Mori N, et al. Prevalence of health care worker burnout during the coronavirus disease 2019 (COVID-19) pandemic in Japan. JAMA Netw Open. 2020;3:e2017271. https://doi.org/10.1001/jamanetworkopen.2020.17271.
McEvoy PM, Nathan P, Norton PJ. Efficacy of Transdiagnostic Treatments: A review of published outcome studies and future research directions. J Cogn Psychother. 2009;23:20–33.
Barlow DH. Unified protocol for Transdiagnostic treatment of emotional disorders: therapist guide. Can Fam Physician. 2011;24:507–8.
Barlow DH, Sauer-Zavala S, Carl JR, Bullis JR, Ellard KK. The nature, diagnosis, and treatment of neuroticism. Clin Psychol Sci. 2014;2:344–65.
Bullis JR, Boettcher H, Sauer-Zavala S, Farchione TJ, Barlow DH. What is an emotional disorder? A transdiagnostic mechanistic definition with implications for assessment, treatment, and prevention. Clin Psychol Sci Pract. 2019;26:e12278.
Linehan MM. Skills training manual for treating borderline personality disorder. New York: Guilford P; 1993.
Linehan MM. DBT® skills training manual. 2nd ed. New York: Guilford Press; 2015.
Hayes SStrosahl KWilson K. Acceptance and commitment therapy: an experiential approach to behaviour change. New York, NY: Guildford; 1999.
Sloan E, Hall K, Moulding R, Bryce S, Mildred H, Staiger PK. Emotion regulation as a transdiagnostic treatment construct across anxiety, depression, substance, eating and borderline personality disorders: A systematic review. Clin Psychol Rev. 2017;57:141–63.
Aldao A. Emotion regulation strategies as transdiagnostic processes: A closer look at the invariance of their form and function = Estrategias de regulación emocional como procesos transdiagnósticos: Una visión más detenida sobre la invarianza de su forma y función. Rev Psicopatología y Psicol Clín. 2012;17:261.
Fernandez KC, Jazaieri H, Gross JJ. Emotion regulation: A Transdiagnostic perspective on a new RDoC domain. Cognit Ther Res. 2016;40:426–40.
Norton PJ, Paulus DJ. Toward a unified treatment for emotional disorders: update on the science and practice. Behav Ther. 2016;47:854–68.
Calkins SD. ORIGINS AND OUTCOMES OF INDIVIDUAL DIFFERENCES IN EMOTION REGULATION. Monogr Soc Res Child Dev. 1994;59:53–72.
Thompson RA. Emotion regulation: A theme in SEARCH of definition. Monogr Soc Res Child Dev. 1994;59:25–52. https://doi.org/10.1111/J.1540-5834.1994.TB01276.X.
Martín-Brufau R, Martin-Gorgojo A, Suso-Ribera C, Estrada E, Capriles-Ovalles ME, Romero-Brufau S. Emotion regulation strategies, workload conditions, and burnout in healthcare residents. Int J Environ Res Public Health. 2020;17:1–12. https://doi.org/10.3390/IJERPH17217816.
Wang M, Saudino KJ. Emotion regulation and stress. J Adult Dev. 2011;18:95–103.
Sauer-Zavala S, Gutner CA, Farchione TJ, Boettcher HT, Bullis JR, Barlow DH. Current definitions of “Transdiagnostic” in treatment development: A Search for consensus. Behav Ther. 2017;48:128–38.
Neacsiu ABohus MLinehan M. Dialectical behavior therapy skills: an intervention for emotion dysregulation. In: Neacsiu ABohus MLinehan M 2014.
Valentine SE, Bankoff SM, Poulin RM, Reidler EB, Pantalone DW. The use of dialectical behavior therapy skills training as stand-alone treatment: A systematic review of the treatment outcome literature. J Clin Psychol. 2015;71:1–20.
Badrfam R, Zandifar A, Arbabi M. Mental health of medical workers in COVID-19 pandemic: restrictions and barriers. J Res Health Sci. 2020;20:e00481.
Holmes EA, O’connor RC, Perry H, Tracey I, Wessely S, Arseneault L, et al. Multidisciplinary research priorities for the COVID-19 pandemic: a call for action for mental health science. Lancet. 2020;7:560. https://doi.org/10.1016/S2215-0366(20)30168-1.
Dores AR, Geraldo A, Carvalho IP, Barbosa F. The use of new digital information and communication Technologies in Psychological Counseling during the COVID-19 pandemic. Int J Environ Res Public Health. 2020;17:7663.
Andersson G. Internet-Delivered Psychological Treatments. Annu Rev Clin Psychol. 2016;12:157–79. https://doi.org/10.1146/annurev-clinpsy-021815-093006.
Karyotaki E, Ebert DD, Donkin L, Riper H, Twisk J, Burger S, et al. Do guided internet-based interventions result in clinically relevant changes for patients with depression? An individual participant data meta-analysis. Clin Psychol Rev. 2018;63:80–92.
Andrews G, Williams AD. Up-scaling clinician assisted internet cognitive behavioural therapy (iCBT) for depression: A model for dissemination into primary care. Clin Psychol Rev. 2015;41:40–8.
Andersson G, Carlbring P, Titov N, Lindefors N. Internet interventions for adults with anxiety and mood disorders: A narrative umbrella review of recent Meta-analyses. Can J Psychiatr. 2019;64:465–70.
Miralles I, Granell C, Díaz-Sanahuja L, van Woensel W, Bretón-López J, Mira A, et al. Smartphone apps for the treatment of mental disorders: systematic review. JMIR mHealth uHealth. 2020;8:1–28.
Garcia-Palacios A, Herrero R, Belmonte MA, Castilla D, Guixeres J, Molinari G, et al. Ecological momentary assessment for chronic pain in fibromyalgia using a smartphone: A randomized crossover study. Eur J Pain. 2014;18:862–72. https://doi.org/10.1002/j.1532-2149.2013.00425.x.
Kobylińska D, Kusev P. Flexible emotion regulation: How situational demands and individual differences influence the effectiveness of regulatory strategies. Front Psychol. 2019;10:1–9.
Colombo D, Fernández-Álvarez J, Suso-Ribera C, Cipresso P, Valev H, Leufkens T, et al. The need for change: understanding emotion regulation antecedents and consequences using ecological momentary assessment. Emotion. 2020;20:30–6.
Troy AS, Shallcross AJ, Mauss IB. A person-by-situation approach to emotion regulation. Psychol Sci. 2013;24:2505–14.
Sheppes G, Scheibe S, Suri G, Gross J. Emotion-regulation choice. Psychol Sci. 2011;22:1391–6. https://doi.org/10.1177/0956797611418350.
Lazarus RS, Alfert E. Short-circuiting of threat by experimentally altering cognitive appraisal. J Abnorm Soc Psychol. 1964;69:195–205.
Van Dillen LF, Koole SL. Clearing the mind: A working memory model of distraction from negative mood. Emotion. 2007;7:715–23.
Fruzzetti AE, Shenk C. Fostering validating responses in families. In: Borderline personality disorder: meeting the challenges to successful treatment: Routledge; 2020. p. 215–28.
Sheppes G, Scheibe S, Suri G, Radu P, Blechert J, Gross JJ. Emotion regulation choice: A conceptual framework and supporting evidence. J Exp Psychol Gen. 2014;143:163–81.
Mirchi N, Betzel RF, Bernhardt BC, Dagher A, Mišić B. Tracking mood fluctuations with functional network patterns. Soc Cogn Affect Neurosci. 2019;14:47–57.
Colombo D, Fernández-Álvarez J, Patané A, Semonella M, Kwiatkowska M, García-Palacios A, et al. Current state and future directions of technology-based ecological momentary assessment and intervention for major depressive disorder: A systematic review. J Clin Med. 2019;8:465.
Trull TJ, Ebner-Priemer UW. Using experience sampling methods/ecological momentary assessment (ESM/EMA) in clinical assessment and clinical research: introduction to the special section; 2009.
Stone AA, Shiffman S. Ecological momentary assessment (Ema) in behavioral medicine. Ann Behav Med. 1994;16:199–202. https://doi.org/10.1093/abm/16.3.199.
Suso-Ribera C, Castilla D, Zaragozá I, Ribera-Canudas MVMV, Botella C, García-Palacios A. Validity, reliability, feasibility, and usefulness of pain monitor. Clin J Pain. 2018;34:900–8. https://doi.org/10.1097/AJP.0000000000000618.
Marzano L, Bardill A, Fields B, Herd K, Veale D, Grey N, et al. The application of mHealth to mental health: opportunities and challenges. Lancet Psychiatry. 2015;2:942–8.
Bylsma LM, Rottenberg J. Uncovering the dynamics of emotion regulation and dysfunction in daily life with ecological momentary assessment. Emot Regul Well-Being. 2011:225–44. https://doi.org/10.1007/978-1-4419-6953-8_14.
Statista. Statista. Number of smartphone users from 2016 to 2021 (in billions). 2021. https://www.statista.com/statistics/330695/number-of-smartphone-users-worldwide/. Accessed 31 Aug 2021.
Balaskas A, Schueller SM, Cox AL, Doherty G. Ecological momentary interventions for mental health: A scoping review. PLoS One. 2021;16:e0248152. https://doi.org/10.1371/JOURNAL.PONE.0248152.
Loo Gee B, Griffiths KM, Gulliver A. Effectiveness of mobile technologies delivering ecological momentary interventions for stress and anxiety: a systematic review. J Am Med Informatics Assoc. 2016;23:221–9.
Olff M. Mobile mental health: a challenging research agenda. Eur J Psychotraumatol. 2015;6:27882. https://doi.org/10.3402/EJPT.V6.27882.
Price M, Yuen EK, Goetter EM, Herbert JD, Forman EM, Acierno R, et al. mHealth: A mechanism to deliver more accessible, more effective mental health care. Clin Psychol Psychother. 2014;21:427. https://doi.org/10.1002/CPP.1855.
Gross JJ. Hadbook of emotion regulation. Second edi. New York: Guildford; 2015.
Schulz K, Altman D, Moher D. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. PLoS Med. 2010;7:e1000251 https://doi.org/10.1371/journal.pmed.1000251. Accessed 10 Mar 2021.
Erdfelder E, FAul F, Buchner A, Lang AG. Statistical power analyses using G*power 3.1: tests for correlation and regression analyses. Behav Res Methods. 2009;41:1149–60.
Doris, Eichert H-C, Riper H, Ebert DD. Blending Face-to-Face and Internet-Based Interventions for the Treatment of Mental Disorders in Adults: Systematic Review. J Med Internet Res 2017;19(9)e306 https://www.jmir.org/2017/9/e306. 2017;19:e6588. doi:https://doi.org/10.2196/JMIR.6588.
Suso-Ribera C, Castilla D, Zaragozá I, Mesas Á, Server A, Medel J, et al. Telemonitoring in chronic pain management using smartphone apps: A randomized controlled trial comparing usual assessment against app-based monitoring with and without clinical alarms. Int J Environ Res Public Health. 2020;17:1–23.
Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–13. https://doi.org/10.1046/j.1525-1497.2001.016009606.x.
Martin A, Rief W, Klaiberg A, Braehler E. Validity of the brief patient health questionnaire mood scale (PHQ-9) in the general population. Gen Hosp Psychiatry. 2006;28:71–7.
Diez-Quevedo C, Rangil T, Sanchez-Planell L, Kroenke K, Spitzer RL. Validation and utility of the patient health questionnaire in diagnosing mental disorders in 1003 general hospital Spanish inpatients. Psychosom Med. 2001;63:679–86 0033-3174/01/6304-0679.
Gross JJ, John O. Individual differences in two emotion regulation processes: implications for affect, relationships, and well-being. J Pers Soc Psychol. 2003;85:348–62.
Preece DA, Becerra R, Robinson K, Gross JJ. The emotion regulation questionnaire: psychometric properties in general community samples. J Pers Assess. 2020;102:348–56. https://doi.org/10.1080/00223891.2018.1564319.
Cabello R, Salguero JM, Fernández-Berrocal P, Gross JJ. A Spanish adaptation of the emotion regulation questionnaire. Eur J Psychol Assess. 2013;29:234–40. https://doi.org/10.1027/1015-5759/a000150.
Gratz KL, Roemer L. Multidimensional assessment of emotion regulation and Dysregulation: development, factor structure, and initial validation of the difficulties in emotion regulation scale. J Psychopathol Behav Assess. 2004;26:41–54. https://doi.org/10.1023/B:JOBA.0000007455.08539.94.
Hervás G, Jódar R. Adaptación al castellano de la Escala de Dificultades en la Regulación Emocional. Clín y Salud. 2008;19 http://scielo.isciii.es/scielo.php?script=sci_arttext&pid=S1130-52742008000200001. Accessed 27 Feb 2021.
Smith BW, Dalen J, Wiggins K, Tooley E, Christopher P, Bernard J. The brief resilience scale: assessing the ability to bounce back. Int J Behav Med. 2008;15:194–200.
Galiana L, Oliver A, Arena F, De Simone G, Tomás JM, Vidal-Blanco G, et al. Development and validation of the short professional quality of life scale based on versions IV and V of the professional quality of life scale. Health Qual Life Outcomes. 2020;18:1–12. https://doi.org/10.1186/s12955-020-01618-3.
Samaniego A, Urzúa A, Buenahora M, Vera-Villarroel P. Symptomatology associated with mental health disorders in health workers in Paraguay: COVID-19 effect. Rev Interam Psicol J Psychol. 2020;54:e1298. https://doi.org/10.30849/RIPIJP.V54I1.1298.
Buselli R, Corsi M, Baldanzi S, Chiumiento M, Del LE, Dell’Oste V, et al. Professional quality of life and mental health outcomes among health care workers exposed to Sars-Cov-2 (Covid-19). Int J Environ Res Public Heal. 2020;17:6180. https://doi.org/10.3390/IJERPH17176180.
Pocatello. The Concise ProQOL Manual 2010.
Brooke JSUS. A quick and dirty usability scale. Usability Eval Ind. 1996:189–94.
Lewis JR. The system usability scale: past, present, and future. Int J Hum Comput Interact. 2018;34:577–90. https://doi.org/10.1080/10447318.2018.1455307.
Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Int J Hum Comput Interact 2008;24 June 2015:574–594.
Castilla D, Garcia-Palacios A, Miralles I, Breton-Lopez J, Parra E, Rodriguez-Berges S, et al. Effect of web navigation style in elderly users. Comput Human Behav. 2016;55:909–20. https://doi.org/10.1016/j.chb.2015.10.034.
Hermes EDA, Lyon AR, Schueller SM, Glass JE. Measuring the implementation of behavioral intervention technologies: Recharacterization of established outcomes. J Med Internet Res. 2019;21:e11752. https://doi.org/10.2196/11752.
Stats G. Mobile operating system market share Spain. Statcounter. 2020; https://gs.statcounter.com/os-market-share/mobile/spain/#monthly-202001-202011. Accessed 14 Dec 2020.
Miró J, de la Vega R, Solé E, Racine M, Jensen MP, Gálan S, et al. Defining mild, moderate, and severe pain in young people WITHPHYSICAL disabilities. Disabil Rehabil. 2017;39:1131. https://doi.org/10.1080/09638288.2016.1185469.
Díaz-García A, González-Robles A, García-Palacios A, Fernández-Álvarez J, Castilla D, Bretón JM, et al. Negative and positive affect regulation in a transdiagnostic internet-based protocol for emotional disorders: randomized controlled trial. J Med Internet Res. 2021;23:1–23.
Heiy JE, Cheavens JS. Back to basics: A naturalistic assessment of the experience and regulation of emotion. Emotion. 2014;14:878–91.
Garruba M, Joseph C. The impact of fatigue in the healthcare setting: A scoping review. Monash Heal. 2019:1–13 https://monashhealth.org/wp-content/uploads/2020/03/Health-worker-fatigue_Scoping-Review2019_FINAL.pdf. Accessed 17 Oct 2021.
Killingsworth MA, Gilbert DT. A wandering mind is an unhappy mind. Science (80- ). 2010;330:932.
Hofmann SG, Sawyer AT, Witt AA, Oh D. The effect of mindfulness-based therapy on anxiety and depression: A meta-analytic review. J Consult Clin Psychol. 2010;78:169–83.
Webb TL, Miles E, Sheeran P. Dealing with feeling: A meta-analysis of the effectiveness of strategies derived from the process model of emotion regulation. Psychol Bull. 2012;138:775–808.
Peña-Sarrionandia A, Mikolajczak M, Gross JJ. Integrating emotion regulation and emotional intelligence traditions: A meta-analysis. Front Psychol. 2015;6(160):1–27.
Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24:385.
Teshome A, Shegaze M, Glagn M, Getie A, Tekabe B, Getahun D, et al. Perceived stress and associated factors among health care professionals working in the context of COVID-19 pandemic in public health institutions of southern Ethiopia 2020. PLoS One. 2021;16:e0252809.
Sreeramareddy CT, Shankar PR, Binu V, Mukhopadhyay C, Ray B, Menezes RG. Psychological morbidity, sources of stress and coping strategies among undergraduate medical students of Nepal. BMC Med Educ. 2007;7:26.
Saghaei M. Random allocation software for parallel group randomized trials. BMC Med Res Methodol. 2004;4:1–6.
European Commission. Regulation (EU) 2016/679 (RGPD). Eur-Lex, Access to european Union Law. Directive 95/46/EC (General Data Protection Regulation). 2020. https://eur-lex.europa.eu/legal-content/EN/TXT/?qid=1532348683434&uri=CELEX:02016R0679-20160504. Accessed 14 Jan 2020.
Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed: IEA Lawrence Erlbaum Associates, Publishers; 1988. http://www.utstat.toronto.edu/~brunner/oldclass/378f16/readings/CohenPower.pdf
Harvey AG, Gumport NB. Evidence-based psychological treatments for mental disorders: modifiable barriers to access and possible solutions. Behav Res Ther. 2015;68:1–12.
Wang PS, Aguilar-Gaxiola S, Alonso J, Angermeyer MC, Borges G, Bromet EJ, et al. Use of mental health services for anxiety, mood, and substance disorders in 17 countries in the WHO world mental health surveys. Lancet. 2007;370:841–50.
Gabilondo A, Rojas-Farreras S, Rodríguez A, Fernández A, Pinto-Meza A, Vilagut G, et al. Use of primary and specialized mental health care for a major depressive episode in Spain by ESEMeD respondents. Psychiatr Serv. 2011;62:152–61.
Mateo JJ. Esperar un año para ver al psicólogo: EL PAÍS; 2019. https://elpais.com/ccaa/2019/02/19/madrid/1550602086_201784.html. Accessed 10 Dec 2021
Remacha B. La asistencia a la salud mental se perpetúa como lujo en España ante los escasos recursos del sistema público: Eldiario.es (National newspaper); 2019. https://www.eldiario.es/sociedad/salud-mental-escasez-recursos_1_1642355.html. Accessed 10 Dec 2021
Andrews G, Basu A, Cuijpers P, Craske MG, McEvoy P, English CL, et al. Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: an updated meta-analysis. J Anxiety Disord. 2018;55:70–8.
Massoudi B, Holvast F, Bockting CLH, Burger H, Blanker MH. The effectiveness and cost-effectiveness of e-health interventions for depression and anxiety in primary care: A systematic review and meta-analysis. J Affect Disord. 2019;245:728–43.
Richards D, Enrique A, Eilert N, Franklin M, Palacios J, Duffy D, et al. A pragmatic randomized waitlist-controlled effectiveness and cost-effectiveness trial of digital interventions for depression and anxiety. npj Digit Med. 2020;3:1–10. https://doi.org/10.1038/s41746-020-0293-8.
Torous J, Myrick KJ, Rauseo-Ricupero N, Firth J. Digital mental health and COVID-19: using technology today to accelerate the curve on access and quality tomorrow. JMIR Ment Heal. 2020;7:1–6.
Colombo D, Fernández-álvarez J, Palacios AG, Cipresso P, Botella C, Riva G. New technologies for the understanding, assessment, and intervention of emotion regulation. Front Psychol. 2019;10:1–10. https://doi.org/10.3389/fpsyg.2019.01261.
Thoits PA. Stress and health: major findings and policy implications. J Health Soc Behav. 2010;51(S):S41–53.
Sheppes G, Suri G, Gross JJ. Emotion regulation and psychopathology. Annu Rev Clin Psychol. 2015;11:379–405. https://doi.org/10.1146/annurev-clinpsy-032814-112739.
Berking M, Wupperman P. Emotion regulation and mental health: recent findings, current challenges, and future directions. Curr Opin Psychiatry. 2012;25:128–34.
We would especially like to thank to Ms. Beatriz Alonso Martín for allowing us to use her voice for the intervention videos.
This research was funded by CONSELLERÍA DE INNOVACIÓN, UNIVERSIDADES, CIENCIA Y SOCIEDAD DIGITAL, 2021 “Ayudas urgentes para proyectos de investigación, desarrollo tecnológico e innovación (I+D+i) por la covid19”, grant number GVA-COVID19/2021/074 an by the UNIVERSITAT JAUME I, “Plan de Promoción de la Investigación 2019”, grant number UJI-B2019–33. The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Ethics approval and consent to participate
The study follows the standards of the Declaration Helsinki and existing guidelines of Spain and the European Union for the protection of patients in clinical trials. All participants interested in participating will sign an online informed consent form. The study has been approved by the Ethics Commission in Experimental Research of University of Valencia (Spain) in May 2021 (Register code 1547727) and it has been registered in clin-icaltrials.gov as NCT04958941 (https://clinicaltrials.gov/ct2/show/NCT04958941). The study will adhere to the recommendations of the Consolidated Standards of Reporting Trials (CONSORT).
Consent for publication
“Not applicable” in this section.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Castilla, D., Navarro-Haro, M.V., Suso-Ribera, C. et al. Ecological momentary intervention to enhance emotion regulation in healthcare workers via smartphone: a randomized controlled trial protocol. BMC Psychiatry 22, 164 (2022). https://doi.org/10.1186/s12888-022-03800-x