- Study protocol
- Open Access
- Open Peer Review
Combining mobile-health (mHealth) and artificial intelligence (AI) methods to avoid suicide attempts: the Smartcrises study protocol
BMC Psychiatryvolume 19, Article number: 277 (2019)
The screening of digital footprint for clinical purposes relies on the capacity of wearable technologies to collect data and extract relevant information’s for patient management. Artificial intelligence (AI) techniques allow processing of real-time observational information and continuously learning from data to build understanding. We designed a system able to get clinical sense from digital footprints based on the smartphone’s native sensors and advanced machine learning and signal processing techniques in order to identify suicide risk.
The Smartcrisis study is a cross-national comparative study. The study goal is to determine the relationship between suicide risk and changes in sleep quality and disturbed appetite. Outpatients from the Hospital Fundación Jiménez Díaz Psychiatry Department (Madrid, Spain) and the University Hospital of Nimes (France) will be proposed to participate to the study. Two smartphone applications and a wearable armband will be used to capture the data. In the intervention group, a smartphone application (MEmind) will allow for the ecological momentary assessment (EMA) data capture related with sleep, appetite and suicide ideations.
Some concerns regarding data security might be raised. Our system complies with the highest level of security regarding patients’ data. Several important ethical considerations related to EMA method must also be considered. EMA methods entails a non-negligible time commitment on behalf of the participants. EMA rely on daily, or sometimes more frequent, Smartphone notifications. Furthermore, recording participants’ daily experiences in a continuous manner is an integral part of EMA. This approach may be significantly more than asking a participant to complete a retrospective questionnaire but also more accurate in terms of symptoms monitoring. Overall, we believe that Smartcrises could participate to a paradigm shift from the traditional identification of risks factors to personalized prevention strategies tailored to characteristics for each patient.
Trial registration number
NCT03720730. Retrospectively registered.
Suicide risk and monitoring
Over 800,000 people die because of suicide every year worldwide. For each suicide, there may have been more than 20 other attempted suicides. A previous attempt is the major predictor of death by suicide . However, many other outcomes associated with suicidal behaviors should be considered in order to strength preventative strategies prevention. Environmental, Clinical, and genetic  risk factors have been intensively studied among suicide attempters in order to improve personalization and effectiveness of preventative programs . Suicide risk assessment relies on standard follow-up outpatient visits in a psychiatric clinic. This assessment includes a mental status examination, a brief update on the history of the patient’s present illness (including a safety assessment of risk of self-harm, suicide). In order to develop a form of assessment that can more accurately track patients’ symptoms and risks between visits, we conducted several studies aiming to add ecological momentary assessment to traditional follow up strategies  . Advances in sensors technology, and artificial intelligence methods (AI) also draw new perspectives for behavior ecological assessment . Sleep disturbances and food intakes are not one of suicide risk factors usually screened in routine suicide risk monitoring .Yet this clinical information could play a central role in suicide risk identification and prediction.
Sleep, eating disorders and suicide risk
Sleep loss and sleep disturbances are associated with an increased risk of suicidal behavior, including suicidal ideation, suicide attempt, and completed suicide . This relationship is consistent across psychiatric diagnoses and age groups . The increased risk of suicidal ideation and suicide attempts among patients with early or late awakening times was demonstrated in representative samples of Korean  and British  adolescents of both genders. Chui et al. observed in a pooled sample of adolescents a linear dose–response relationship between sleep duration and suicide plans . Rossler et al. showed that the correlates between sleep disorders including short sleep duration and suicidality was also observed in adults . In a 30-year longitudinal cohort study of adults people, authors showed that the more severe the sleep problems are, the more pronounced is suicidality, including suicide ideation and behaviours. Interestingly these patterns persist even if we control for socio-demographics and in particular for accompanying mood, anxiety, or substance-use disorders, . Changes in appetite are closely connected with depressive symptomatology and suicidal behavior . Appetite has already been used in the prediction of suicidal risk . Regarding eating disorders, negative self-image variables have been associated with suicide attempt history in anorexia and suicide attempts completions in women with bulimia . In fact, in a cohort study of eating disordered subjects, the risk for suicide attempt was 4.70 (95% CI 1.41–15.74) in patients with eating disorders compared to matched (age, sex, place of residence) general population controls and further increased to 11.30 (95% CI 6.90–18.50) in those patients with history of previous suicide attempt . A recent study found that suicide attempters had lower body mass index (BMI) and waist circumference, as well as decreased levels of serum .
Suicide risk management in the e-health era
The integration of smartphones and wearables into medical practice has heralded the electronic-health (e-health) era. E-health involves the integration of new technologies into routine clinical practice by increasing networking possibilities between patients and clinicians. Recent trials using mobile electronic devices have proven successful in real-world and real-time monitoring and have improved the assessment possibilities in a large panel of clinical settings . The assessment of the patient’s dynamic relationships between events and disease course is enhanced by the development of momentary data collection strategies, such as experience sampling methods (ESM) and ecological momentary assessment (EMA) . These approaches, which rely on delivering informative contents and self-administered questionnaires, reduce the recall bias as they are done in real time . Electronic devices are also able to perform passive (or autonomous) data gathering, i.e., to extract information about the users without any effort on their part. Actigraphy, geolocation, and communication activity are usual features of current smartphones and may be indicators of the patient’s behavior if they are properly processed. Overall, an extensive panel of physical and mental conditions can be remotely monitored . Smartphones can embody such sensors and provide EMA features relying on patient self-reports. Finally, the data digital footprints, which is the automatically accumulated by-products of technological devices, offer a promising opportunity for research and clinical decision making .
The collected data can be processed and transferred over the Internet to a remote clinical back-end server for further analysis, assessment, decision making and intervention. AI is a set of analysis methods which permits to extract relevant information from any dataset. AI uses data mining techniques to get sense for the data. a set of techniques that can be used to explore treatment and outcome questions in large clinical databases and help develop algorithms and guidelines for problems where controlled data are difficult to obtain. The data mining process includes several steps, including data capture, data selection, data processing, and machine learning. Abdullah et al. reported that combining self-reported data with data from several smartphone sensors and communication patterns resulted in reliable prediction of the Social Rhythm Metric, a clinically-validated marker of stability and rhythmicity for individuals with bipolar disorder  Voice features from phone calls can also be collected and analyzed during everyday life in naturalistic settings. For inferring rhythmicity, a key marker of wellbeing for individuals with bipolar disorder. Another platform proposed A method to predict schizophrenia based on anomaly detection was developed using Beiwe, a platform able to perform data mining on smartphone data . EMA has been successfully used for real-time self-reporting of symptoms and behavior—for example, Husky et al. showed the utility and feasibility of using EMAs to study suicidal ideations .
Taking into account the strengths and pitfalls of existing suicide risk assessment methods, we have designed a system capable to combine EMA and continuous monitoring of patients using the smartphone’s and/or wearable’s sensors and data entry in order to monitor and predict suicide risk. Both poor sleep quality and disturbed appetite are clinical markers of depression, with a bidirectional relationship. Their changes could precede the increase of suicidal behavior as sleep and appetite are both influenced by mood state and regulated by the serotonergic system. Our hypothesis is that tracking sleep and appetite regularly through self-report could serve as a consistent and non-biased shortcut to assess mood state, its biological underpinnings and could potentially predict suicidal behavior.
The overall study goal is to determine the relationship between wish to die, and suicide attempt and changes in sleep quality and disturbed appetite using Smartphone and wearable technology based using ecological momentary assessment (EMA).
The principal objective of the study is to identify the correlation between quality of sleep monitored via the digital footprint and suicidal events including and suicide attempts in a cohort of suicidal patients.
Secondary objectives are:
Establish the extent to which change in appetite is related to and suicide attempts.
Clarify the timeline of the relationship between sleep disturbances and suicidal behavior.
Determine the emotional impact of the use of the app during suicide related outcomes assessed.
Develop personalized algorithms based on the EMA protocol and motor activity markers to assess the risk of suicide attempts.
Method and design
Study design and setting
This study is a pragmatic, prospective, multisite controlled trial with two parallel groups. The study setting is outpatient clinics and emergency departments at four clinical centers across two countries (Jimenez Diaz Foundation, Spain, University Hospital of Nimes, France).
To be eligible for the study, patients must be 18 years or older, attend an outpatient clinic or emergency departments of participating clinical services and owning an android or IOS smartphone. Exclusion criteria are being less than 18 years old, refusal to participate to the study, and patients and in emergency situations where their state of health does not allow obtaining written consent. Patients who are unable or unwilling to provide informed and signed consent will be also excluded.
This study was built on the results of previous studies we conduced exploring the preferences of patient regarding eHealth based suicide assessment [28, 29]. Patients were involved in the design of this study in a preliminary step of the application conception which assed the feasibility and the burden of such approach in a sample of outpatients . Patient were informed they could have access to the final result of the study during a routine medical visit, according to the ethic committee query.
Intervention and control
After agreeing to participate, clinician will collect a signed consent for each patient. Patient will be assigned to intervention or control group weather they have a personal history of suicide attempt or not. Patient with a current suicidal behavior disorder (according to DSM-5), i.e. having attempted suicide in the current year, will be assigned to the intervention group.
Patient with no history of suicide behavior will be assigned to the control group. Both intervention and control group will receive as usual follow up. monitoring visits. In the intervention group, each participant will be assessed with an EMA protocol using two smart phones apps. The first app will ask questions following a dynamic protocol (quality and duration of sleep, wish to live and wish to die, and questions regarding emotional status), the second app will record diurnal activity that is related with sleep quality using smartphone sensors. Additionally, a subsample of participants of the intervention group will be monitored with a wearable armband to assess sleep phases and physiological changes during sleep and EMA assessment. Control group will only receive as usual follow up procedure and monitoring procedure of the study protocol (see Fig. 1).
The primary outcomes are suicidal events assessed by Columbia-Suicide Severity Rating Scale (C-SSRS) in control and intervention group during the 6-month follow-up period.
Secondary outcomes are:
Evaluate appetite using the Council of Nutrition Appetite Questionnaire (CNAQ) score with EMA questions.
Sleep duration before and after a suicide attempt in intervention group during the 6-month follow-up period.
Electrodermal activity captured by waerables during EMA assessment in the intervention group.
Pooled EMA data Suicidal events and eating disorders in control and intervention group during the 6-month follow-up period.
Digital collection, and data analysis
The “Smartcrises” platform is composed by two smartphone apps, which collect EMA data and smartphone sensors data, and a back-end server, which stores and processes them.
The eB2 app collects data from inertial sensors, physical activity, phone calls and message logs, app usage, nearby Bluetooth and Wi-Fi connections, and location. Also, using Google Play Services, the app is able to access detailed activity information and nearby location data. The app was developed to run in background and the user only interacts with the app for the initial configuration. Moreover, it was designed with battery safe considerations like non-continuous recording schedule, automatic sleep/wake function, and it additionally notifies the operating system to relaunch itself when it was closed or stopped due to user’s actions or failures/reboots.
Memind is a smartphone application able to perform EMA. The MEmind app will assess wish to die via a self questionnaire and a computer assisted algorithm. The type and amount of food intake will be evaluated through the dynamic questions. Participants will be asked four static questions in the morning and evening while dynamic questions will be asked randomly at any one time-point during the day (at most 4 random questions from a pull of 32 questions distributed throughout the day). This application will offer questions on the quantity and quality of sleep, appetite and food intake, on the occurrence of social stress, evaluation of suicidal ideas and emotions. These questions are displayed according to a nonlinear dynamic model during participation to the study .
Data collection and follow-up
The baseline enrolment questionnaire includes the patient’s basic demographic information including age, gender, marital status, employment status, country of birth, language spoken at home, level of education and whether they had a regular general practitioner.
Medical treatments at inclusion, as well as any changes in these treatments during follow-up, will be collected and analyzed as potential confounders. The treatments will be classified according to the classification established by the World Health Organization (ATC index). The entire lifetime diagnosis of mental disorders axis I and II according to DSM-5 will be based on existing clinical evaluation protocols at inclusion: Mini International Neuropsychiatric Interview 7.0.0. Participants will be evaluated for depressive symptomatology , to detect the possibility of a manic episode  and to evaluate their global functioning .
We will use complementary strategies to obtain the primary outcome measures and assess adverse events. Assessments will be carried out by trained clinicians (Psychologist, Psychiatrist or Psychiatrist Residents up to second year) at outpatient clinics and emergency departments.
Researchers will check the hospital attendance data especially the emergency records.
The assessment of suicidal behaviors will include at the inclusion and completion of follow-up:
The Columbia Suicide Severity Rating Scale a scale that showed good sensitivity and specificity to identify the most at risk subjects .
If a suicide attempt has occurred, the suicide intent scale  and the Risk Rescue Rating Scale.
Suicide and sleep monitoring
Evaluation of the principal objective will be monitored via in-person interviews (see baseline assessment subsection) and EMA self-questionnaires including wish to live, wish to die, suicidal ideation, and suicide attempt during the follow-up period. The Suicidal Status Form  the Perceived Social Support Questionnaire (PSSQ,) and the Interpersonal Needs Questionnaire  have been incorporated into pop-ups to our EMA app to increase the participation rate during inactive periods .
The MEmind App will provide questions following a dynamic smartphone based assessment protocol exploring quality of sleep. The EB2 app will record diurnal activity that is related with sleep quality using smartphone sensors. EB2 will be validated with polysomnographic registers (see Fig. 2). EB2 is designed to collect information about the users’ physical and physiological activity level. This application has been developed for the Android mobile platform and works in combination with the arm Band. SmartPhone and the arm Band communicate via Bluetooth 4.0. This application obtains information from the user by accessing the built-in sensors in the host Android SmartPhone and the arm Band. Through the process of data logging the Sensor Logger APP records both the information from the SmartPhone and arm Band. This double recording of information by the Sensor Logger APP allows it to obtain enough information from inertial sensors to determine the user’s activity level during the recording process . The heart rate signal and Galvanic skin response are also recorded to determine the emotional state of the user. In our study participants in the Smartcrisis group will be monitored with a wearable armband to assess sleep phases and physiological changes during sleep.
Food intake monitoring
Two questions in the dynamic protocol will assess appetite and food intake. Food ingestion will also be assessed and paired with activity monitoring using the arm band data.
Emotional state during EMA process
The wearable tracker band will record electrodermal activity at 3 time points: 5 min prior to EMA questioning; during the patient answer to EMA and 5 min after. Objective longitudinal records from patients will determine the sleep-suicide behavior casual chain based on wearables and EMA records.
We propose to recruit 1000 patients from two sites and expect a total of 100 suicide re-attempts during the follow-up period. We plan to recruit 500 patients per site (total of 1000) during 18 months with a follow-up period of 6 months. Based on our suicidal behavior monitoring pilot data (see above), we have calculated power in multivariate logit regression models, assuming a type I error of 0.05 and two-sided comparison. Using the effect sizes and standard deviations from our pilot data we expect our sample 1000 attempters and 100 reattempters during the follow-up) to provide 80% power to detect significant changes in death desire, suicidal ideation or suicide attempt related with sleep and appetite.
We will carry out descriptive analyses of all data collected separately by site and treatment. We will calculate means, variances and empirical quartiles, and assess the distribution and skewness of the data. If groups differ significantly on covariates then these scores will additionally be included as covariates in multivariate regression models.
We will use 3 multi-level logit regression to account for multiple observations per individual, to identify individual-level (sleep, appetite, socio-demographic, clinical data, treatment data) and site-level characteristics associated with death desire, suicidal ideation or suicide attempt. We will use hazards models to relate covariate characteristics (sleep, appetite, socio-demographic, clinical data, treatment data) with time to suicide re-attempt during the follow-up period. Data mining (machine learning) techniques will be used to examine risk factors, patterns of illness evolution and outcomes, and patient stratification by level of risk.
Data privacy is a serious concern in the e-health research area. Our system complies with the highest level of security regarding patients’ data. The eB2 app captures data from smartphones, which possibly was a deterrent for patients to accept the app . In a preliminary study, patients were aware of the general approach of our method and were not very concerned about sharing their personal data since it was anonymized at the smartphone. Another major concern regarding personal electronic data is data security . In order to preserve the patient’s privacy and reduce the risk associated to a non-legitimate access, all the sensible information stored in the eB2 server was hashed and anonymized. Phone numbers, email addresses, Bluetooth, and Wi-Fi MAC addresses were hashed using the SHA-1 algorithm and the location was transformed using a non-invertible function. We store randomly-rotated relative location coordinates, where the origin was the location that was most common during the first three days after installation (typically the patient’s home). Our apps are available via app stores, which allows us to continuously update and improve the app based on newly discovered bugs and also user feedback. However, the access to the apps contents and features is permitted only for patients accepting to participate to the study. All online self-report data are de-identified (identified by a random code, unrelated to any data protected by HIPAA). Only the PI holds the code, stored in a secure location separate from data. Personal information about potential and enrolled participants will be collected, and maintained in order to protect confidentiality before, during, and after the trial according to the terms described in the ethic committee report. These data will can be used for anciliary analysis after the study manuscript publication. Data will only be shared by the cited authors of this manuscript. Data will be anonymized before communication to other research office members .
The burden of EMA method
Other important ethical are related to EMA method must also be considered. The matter of participant burden is one such issue. EMA methods entails a non-negligible time commitment on behalf of the participants. EMA rely on daily, or sometimes more frequent, Smartphone notifications. Notifications produce a significant increment in verified compliance when compared with an identical trial without notification. A significant eroding of compliance can be observed after 3 weeks of ecological assessment . Furthermore, recording participants’ daily experiences in a continuous manner is an integral part of EMA. This approach may be significantly more invasive than asking a participant to complete a retrospective questionnaire or answering a question at a traditional interview . The risk of intrusiveness into daily life is real. Receiving notifications may also inconvenience participants who are expected to complete an EMA or read information at a moment’s notice (ie, requests may occur at inopportune times).
A paradigm shift in suicide risk prevention
This study stands out from randomized controlled trials or observational studies ailing to identify suicide risk factors.
We conducted a preliminary study showing that the eB2 system was capable of identifying mobility pattern changes, which may be used as proxies for behavioral changes and relapses in mental health . We will apply the two key type of models previously tested in suicidal prediction: 1) predictive models or discriminative models and 2) explanatory or generative models. Both predictive and explanatory models use patient features to provide information on future events, such as the likelihood that a patient will attempt suicide in a given time interval. Applying these models to our database, will generation of tools to improve medical decision-making, patient outcomes, and to identify mediators and moderators within causal pathways. We will also develop latent feature models using Nonparametric Bayesian (NPB) approaches to detect the different predictive signatures. The central idea behind nonparametric Bayes (NPB) is the replacement of the classical finite-dimensional prior distributions with general stochastic processes, allowing an open-ended number of degrees of freedom in a model. Nonparametric priors have several properties that make them desirable to model data with an unknown number of characteristics of different sizes or importance.
Overall, we believe that “Smartcrises” could participate to a paradigm shift from the traditional identification of risks factors in mental illnesses to personalized prevention strategies tailored to characteristics for each patient, i.e., personalized medicine . We have developed a system that is able to capture data from the smartphone’s native sensors and other wearables. AI techniques seek to answer the question: How can we build computer systems that automatically improve with experience, and what are the fundamental laws that govern all learning processes? Machine learning techniques allow processing of real-time observational information by continuously learning from data to build understanding and uncover previously unexpected associations and patterns in data. Predictive and explanatory models might use individual patient data to predict future events like the probability of a patient attempting suicide in a given time interval. Our final goal would be the identification of more general behavioral changes (online social interaction) in outpatients, which has important applications for a wide range of chronic conditions, including mental health disorders. Apart from the continuous assessment of bio-parameters themselves, smartphone-based monitoring would also allow researchers to gather information on context and environment, which may prove valuable for the interpretation of the monitored biomedical data and allow for a better preventative approaches.
Availability of data and materials
All datasets on which the conclusions of the paper rely should be available to readers except the source code of the smartphone apps developed for the study.
Ecological momentary assessment
Experience sampling methods
Finkelstein Y, Macdonald EM, Hollands S, Sivilotti MLA, Hutson JR, Mamdani MM, et al. Risk of suicide following deliberate self-poisoning. Arch Gen Psychiatry. 2015 Jun;72(6):570.
Mirkovic B, Laurent C, Podlipski M-A, Frebourg T, Cohen D, Gerardin P. Genetic association studies of suicidal behavior: a review of the past 10 years, Progress, limitations, and future directions. Frontiers in psychiatry. 2016;7:158.
Suicide prevention. Towards integrative, innovative and individualized brief contact interventions. Eur Psychiatry [Internet] Elsevier Masson. 2018;47:25–6 Available from: https://doi.org/10.1016/j.eurpsy.2017.09.006.
Berrouiguet S, Barrigón ML, Brandt SA, Ovejero-García S, Alvarez-Garcia R, Carballo JJ, et al. Development of a web-based clinical decision support system for drug prescription: non-interventional naturalistic description of the antipsychotic prescription patterns in 4345 outpatients and future applications. PLoS One. 2016;11(10):e0163796.
Duhem S, Berrouiguet S, Debien C, Ducrocq F, Demarty AL, Messiah A, et al. Combining brief contact interventions (BCI) into a decision-making algorithm to reduce suicide reattempt: the VigilanS study protocol. BMJ Open. 2018 Oct;8(10):e022762.
Berrouiguet S, Ramirez D, Barrigón ML, Moreno-Munoz P, Carmona Camacho R, Baca-García E, et al. Combining continuous smartphone native sensors data capture and unsupervised data mining techniques for behavioral changes detection: a case series of the evidence-based behavior (eB2) study. JMIR mHealth and uHealth. 2018 Dec;6(12):e197.
Chan MKY, Bhatti H, Meader N, Stockton S, Evans J, O'Connor RC, et al. Predicting suicide following self-harm: systematic review of risk factors and risk scales. Br J Psychiatry Cambridge University Press. 2016 Oct;209(4):277–83.
Porras-Segovia A, Perez-Rodriguez MM, Lopez-Esteban P, Courtet P, Barrigon MML, lopez-Castroman J, et al. Contribution of sleep deprivation to suicidal behaviour: a systematic review. Sleep Med Rev. 2019 Apr;44:37–47.
Malik S, Kanwar A, Sim LA, Prokop LJ, Wang Z, Benkhadra K, et al. The association between sleep disturbances and suicidal behaviors in patients with psychiatric diagnoses: a systematic review and meta-analysis. Syst Rev. 2014 Feb;3:18.
Kim J-H, Park E-C, Lee SG, Yoo K-B. Associations between time in bed and suicidal thoughts, plans and attempts in Korean adolescents. BMJ Open. 2015 Sep;5(9):e008766.
Strandheim A, Bjerkeset O, Gunnell D, Bjornelv S, Holmen TL, Bentzen N. Risk factors for suicidal thoughts in adolescence--a prospective cohort study: the Young-HUNT study. BMJ Open. 2014 Aug;4(8):e005867.
Chiu H-Y, Lee H-C, Chen P-Y, Lai Y-F, Tu Y-K. Associations between sleep duration and suicidality in adolescents: a systematic review and dose-response meta-analysis. Sleep Medicine Reviews Elsevier Ltd. 2018 Dec;42:119–26.
Rossler W, Angst J, Ajdacic-Gross V, Haker H, Berrouiguet S, Ujeyl M, et al. Sleep disturbances and suicidality-a longitudinal analysis from a representative community study over 30 years. Frontiers in psychiatry. 2018;9:320.
Norra C, Richter N, Juckel G. Sleep disturbances and suicidality: a common association to look for in clinical practise and preventive care. EPMA J BioMed Central. 2011 Sep;2(3):295–307.
McIntyre L, Williams JVA, Lavorato DH, Patten S. Depression and suicide ideation in late adolescence and early adulthood are an outcome of child hunger. J Affect Disord. 2013 Aug;150(1):123–9.
Trivedi MH, Wisniewski SR, Morris DW, Fava M, Gollan JK, Warden D, et al. Concise health risk tracking scale: a brief self-report and clinician rating of suicidal risk. J Clin Psychiatry. 2011 Jun;72(6):757–64.
Runfola CD, Thornton LM, Pisetsky EM, Bulik CM, Birgegard A. Self-image and suicide in a Swedish national eating disorders clinical register. Compr Psychiatry. 2014 Apr;55(3):439–49.
Suokas JT, Suvisaari JM, Grainger M, Raevuori A, Gissler M, Haukka J. Suicide attempts and mortality in eating disorders: a follow-up study of eating disorder patients. Gen Hosp Psychiatry. 2014 May;36(3):355–7.
da Graca Cantarelli M, Nardin P, Buffon A, Eidt MC, Antonio Godoy L, Fernandes BS, et al. Serum triglycerides, but not cholesterol or leptin, are decreased in suicide attempters with mood disorders. J Affect Disord. 2015 Feb;172:403–9.
Dogan E, Sander C, Wagner X, Hegerl U, Kohls E. Smartphone-based monitoring of objective and subjective data in affective disorders: where are we and where are we going? Systematic review. J Med Internet Res. 2017 Jul;19(7):e262.
Berrouiguet S, Barrigón ML, Brandt SA, Nitzburg GC, Ovejero S, Alvarez-Garcia R, et al. Ecological assessment of Clinicians' antipsychotic prescription habits in psychiatric inpatients: a novel web- and Mobile phone-based prototype for a dynamic clinical decision support system. J Med Internet Res. 2017 Jan;19(1):e25.
Asselbergs J, Ruwaard J, Ejdys M, Schrader N, Sijbrandij M, Riper H. Mobile phone-based unobtrusive ecological momentary assessment of day-to-day mood: an explorative study. J Med Internet Res. 2016;18(3):e72.
Reinertsen E, Clifford GD. A review of physiological and behavioral monitoring with digital sensors for neuropsychiatric illnesses. Physiol Meas. 2018 May;39(5):05TR01.
Bidargaddi N, Musiat P, Makinen V-P, Ermes M, Schrader G, Licinio J. Digital footprints: facilitating large-scale environmental psychiatric research in naturalistic settings through data from everyday technologies. Mol Psychiatry. 2017 Feb;22(2):164–9.
Abdullah S, Matthews M, Frank E, Doherty G, Gay G, Choudhury T. Automatic detection of social rhythms in bipolar disorder. J Am Med Inform Assoc. 2016 May;23(3):538–43.
Torous J, Kiang MV, Lorme J, Onnela J-P. New tools for new research in psychiatry: a scalable and customizable platform to empower data driven smartphone research. JMIR mental health. 2016 May;3(2):e16.
Husky M, Swendsen J, Ionita A, Jaussent I, Genty C, Courtet P. Predictors of daily life suicidal ideation in adults recently discharged after a serious suicide attempt_ a pilot study. Psychiatry Res. 2017 Jun;256:79–84.
Husky M, Olié E, Guillaume S, Genty C, Swendsen J, Courtet P. Feasibility and validity of ecological momentary assessment in the investigation of suicide risk. Psychiatry Res. 2014 Dec;220(1–2):564–70.
Berrouiguet S, Gravey M, Le Galudec M, Alavi Z, Walter M. Post-acute crisis text messaging outreach for suicide prevention: a pilot study. Psychiatry Res. 2014 Jul;217(3):154–7.
Barrigón ML, Berrouiguet S, Carballo JJ, Bonal-Giménez C, Fernández-Navarro P, Pfang B, et al. User profiles of an electronic mental health tool for ecological momentary assessment: MEmind. Int J Methods Psychiatr Res. 2017 Mar;26(1).
Fartacek C, Schiepek G, Kunrath S, Fartacek R, Plöderl M. Real-time monitoring of non-linear suicidal dynamics: methodology and a demonstrative case report. Front Psychol. 2016;7:130.
Rush AJ, Gullion CM, Basco MR, Jarrett RB, Trivedi MH. The inventory of depressive symptomatology (IDS): psychometric properties. Psychol Med. 1996 May;26(3):477–86.
Young RC, Biggs JT, Ziegler VE, Meyer DA. A rating scale for mania: reliability, validity and sensitivity. Br J Psychiatry. 1978 Nov;133:429–35.
Kulnik ST, Nikoletou D. WHODAS 2.0 in community rehabilitation: a qualitative investigation into the validity of a generic patient-reported measure of disability. Apr. 2013;36(2):146–54.
Posner K, Brown GK, Stanley B, Brent DA, Yershova KV, Oquendo MA, et al. The Columbia-suicide severity rating scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry. 2011 Dec;168(12):1266–77.
Beck RW, Morris JB, Beck AT. Cross-validation of the suicidal intent scale. Psychol Rep. 1974 Apr;34(2):445–6.
Jobes DA, Kahn-Greene E, Greene JA, Goeke-Morey M. Clinical improvements of suicidal outpatients: examining suicide status form responses as predictors and moderators. Arch Suicide Res. 2009;13(2):147–59.
Parkhurst KA, Conwell Y, Van Orden KA. The interpersonal needs questionnaire with a shortened response scale for oral administration with older adults. Aging Ment Health. 2016;20(3):277–83.
Nazabal A, Garcia-Moreno P, Artes-Rodriguez A, Ghahramani Z. Human activity recognition by combining a small number of classifiers. IEEE J Biomed Health Inform. 2016 Sep;20(5):1342–51.
MD EW, MD JT, MD RH, MD TG. Confidentiality and privacy for smartphone applications in child and adolescent psychiatry. Child and Adolescent Psychiatry Clinics of NA. 2016 Oct:1–8.
Fernández-Alemán JL, Señor IC, Lozoya PÁO, Toval A. Security and privacy in electronic health records: a systematic literature review. J Biomed Inform. 2013 Jun;46(3):541–62.
Broderick JE, Schwartz JE, Shiffman S, Hufford MR, Stone AA. Signaling does not adequately improve diary compliance. Ann Behav Med. 2003 Oct;26(2):139–48.
Davidson CL, Anestis MD, Gutierrez PM. Ecological momentary assessment is a neglected methodology in Suicidology. Archives of suicide research. 2016 May;21(1):1–11.
Torous J, Onnela J-P, Keshavan M. New dimensions and new tools to realize the potential of RDoC: digital phenotyping via smartphones and connected devices. Mar. 2017;7(3):e1053.
We acknowledge patient who agreed to participate to our previous studies on the same topic. Their contribution made the design of this project possible.
This study was partly funded by Fundación Jiménez Díaz Hospital, Instituto de Salud Carlos III (PI16/01852), Delegación del Gobierno para el Plan Nacional de Drogas (20151073), American Foundation for Suicide Prevention (AFSP) (LSRG-1-005-16), the Madrid Regional Government (B2017/BMD-3740 AGES-CM 2CM; Y2018/TCS-4705 PRACTICO-CM) and Structural Funds of the European Union. MINECO/FEDER (‘ADVENTURE’, id. TEC2015–69868-C2–1-R) and MCIU Explora Grant ‘aMBITION’ (id. TEC2017–92552-EXP), the French Embassy in Madrid, Spain, The foundation de l’avenir, and the Fondation de France. The work of D. Ramírez and A. Artés-Rodríguez has been partly supported by Ministerio de Economía of Spain under projects: OTOSIS (TEC2013–41718-R), AID (TEC2014–62194-EXP) and the COMONSENS Network (TEC2015–69648-REDC), by the Ministerio de Economía of Spain jointly with the European Commission (ERDF) under projects ADVENTURE (TEC2015–69868-C2–1-R) and CAIMAN (TEC2017–86921-C2–2-R), and by the Comunidad de Madrid under project CASI-CAM-CM (S2013/ICE-2845). The work of P. Moreno-Muñoz has been supported by FPI grant BES-2016-077626. The funding bodies were not involved in the design of the study, the collection, analysis, and interpretation of data for the writing of the present manuscript. The American Foundation for Suicide Prevention peer reviewed the study protocol in the funding section prior to fund the study.
Ethics approval and consent to participate
This study protocol was approved by Ethics committees in france (Comité de protection des personnes Ouest IV) and spain (Comité de ética fundación jimenez diaz). Written informed consent will be obtained from all patient prior to participation to the study.
Consent for publication
All data included in this manuscript received consent for publication.
Authors declare having no conflict interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.