- Study protocol
- Open Access
Remote assessment of disease and relapse in major depressive disorder (RADAR-MDD): a multi-centre prospective cohort study protocol
BMC Psychiatry volume 19, Article number: 72 (2019)
There is a growing body of literature highlighting the role that wearable and mobile remote measurement technology (RMT) can play in measuring symptoms of major depressive disorder (MDD). Outcomes assessment typically relies on self-report, which can be biased by dysfunctional perceptions and current symptom severity. Predictors of depressive relapse include disrupted sleep, reduced sociability, physical activity, changes in mood, prosody and cognitive function, which are all amenable to measurement via RMT. This study aims to: 1) determine the usability, feasibility and acceptability of RMT; 2) improve and refine clinical outcome measurement using RMT to identify current clinical state; 3) determine whether RMT can provide information predictive of depressive relapse and other critical outcomes.
RADAR-MDD is a multi-site prospective cohort study, aiming to recruit 600 participants with a history of depressive disorder across three sites: London, Amsterdam and Barcelona. Participants will be asked to wear a wrist-worn activity tracker and download several apps onto their smartphones. These apps will be used to either collect data passively from existing smartphone sensors, or to deliver questionnaires, cognitive tasks, and speech assessments. The wearable device, smartphone sensors and questionnaires will collect data for up to 2-years about participants’ sleep, physical activity, stress, mood, sociability, speech patterns, and cognitive function. The primary outcome of interest is MDD relapse, defined via the Inventory of Depressive Symptomatology- Self-Report questionnaire (IDS-SR) and the World Health Organisation’s self-reported Composite International Diagnostic Interview (CIDI-SF).
This study aims to provide insight into the early predictors of major depressive relapse, measured unobtrusively via RMT. If found to be acceptable to patients and other key stakeholders and able to provide clinically useful information predictive of future deterioration, RMT has potential to change the way in which depression and other long-term conditions are measured and managed.
The last decade has seen an explosion in the capability of monitoring individuals via sensors in smartphones or wearable devices, and the range of parameters which can be measured by such technologies will continue to grow . The development of remote measurement technologies (RMT), using these inbuilt sensors to unobtrusively measure human behaviour and physiology, combined with active measurement of daily experiences via smartphone apps, is an innovation which could be used to provide real-time information about patients’ current clinical state, as well as information potentially predictive of future deterioration .
Major Depressive Disorder (MDD) is associated with a wide range of negative outcomes including: premature mortality ; reduced quality-of-life ; loss of occupational function ; and is often experienced alongside physical comorbidity  and approximately 55% will go on to develop chronic depression, characterised by periods of recovery and relapse [6, 7]. Developing interventions which can disrupt the pattern of remission and relapse is of crucial importance to maintain sustained periods of recovery . Predictors of depressive relapse include disrupted sleep , reduced sociability , changes in mood , prosody  and cognition , and there is evidence highlighting the impact psychological and pharmacological interventions can have on reducing risk of relapse [14, 15]. Identifying the optimal time to deliver a preventative intervention, when these symptoms may be sub-threshold, context dependent, or too subtle for the individual to recognise, is challenging. Symptom recall in patients with depression may also not be accurate, potentially biased by current symptom severity and environmental stressors [16, 17]. This retrospective recall cannot capture symptom variability and context reactivity which would allow interventions to be administered at a crucial point in the relapse signature.
RMT may provide a solution to these problems by giving richer, objective characterisation of behaviour, cognition, speech and physiology. Data can be collected with excellent temporal resolution, including an ability to assess diurnal variation which may be indicative of early decline in mood . Passive RMT (pRMT) uses sensors in activity monitors and smartphones to gather data with no input from the wearer , including Global Positioning System (GPS), accelerometer, gyroscope, communication logs, ambient noise and light levels and screen interactions. Many of these sensors have been used to identify changes in sleep, communication and activity patterns associated with depressive episodes [20, 21]. Prosodic speech characteristics, such as speaking rate, pitch, pause duration and energy, collected via smartphone microphones, have been used to detect depression with a prediction accuracy of 81.3% . Active RMT (aRMT) uses smartphone apps to deliver validated questionnaires, cognitive games, speech tasks or electronic diaries using the experience sampling method (ESM) to provide fine-grained understanding of mood changes and stressors in the context of daily life . aRMT has been used to measure affect, cognitions, thoughts, mood and behaviours in real-time, with evidence highlighting the increased validity of this methodology in comparison to traditional retrospective reports . aRMT assessments of positive and negative affect have also been found to be reliably indicative of mood state [25, 26] and have been associated with MDD symptoms .
Despite this growing body of research evidence, there has been limited assessment of the utility of multi-parametric RMT in clinical populations [28, 29], combining multiple sensors to detect signatures potentially useful for predicting outcomes in MDD. This protocol describes the clinical study designed to test this utility of RMT.
Patient involvement in the RADAR-MDD study protocol
Systematic reviews have identified the barriers and facilitators of RMT uptake ; service-user focus groups have identified the outcomes prioritised by service-users, identified appropriate methods of measuring these outcomes, and investigated the use of technology to measure and manage symptoms ; surveys and user experience testing have informed the selection of devices and development of all user-facing systems to ensure optimal usability and functionality. Extensive device-selection procedures combined all acquired knowledge from literature reviews, focus groups and scoping exercises to provide a short-list of suitable activity monitors. Participant-facing documents (such as information sheets and consent forms) were developed in collaboration with service-user research groups to ensure materials are understandable and describe the technology and protocol in clear language.
RADAR-MDD is a clinical study aiming to assess the utility of multi-parametric RMT in clinical populations with MDD.
Specifically, RADAR-MDD aims to:
Determine the usability, feasibility and acceptability of, and adherence to, RMT to provide real-time objective multidimensional indications of clinical state in individuals with MDD.
Improve and refine clinical outcome measurement using RMT as a means of identifying current clinical state.
Determine whether multi-parametric RMT collected in populations with recurrent MDD can provide information predictive of depressive relapse and other critical outcomes including anxiety, quality-of-life, and MDD remission.
RADAR-MDD is a multi-centre prospective observational cohort study in which 600 individuals with a recent history of MDD will be asked to download several RMT apps and use an activity tracker for up to 2 years of follow-up. The study involves no randomisation or intervention, and uses commercially available activity trackers and smartphone sensors.
An estimated 100 relapses are required in order to provide sufficient power on which to test the predictive utility of RMT, if 10 variables were entered into the predictive model . With an approximated annual relapse rate of 33% (a lower estimate than that provided in the Star*D trial; ), 300 participants would be required, followed-up for one year. Although there is evidence to suggest promising uptake to RMT protocols, the attrition rate in this length of follow-up is unknown, there are likely to be missing data, data are inherently “noisy”, and the relapse rate in our population may be lower than anticipated. We therefore aim to recruit a total of 600 individuals with a history of MDD across three research sites.
The eligibility criteria for inclusion in this study are summarised in Table 1. To recruit people at risk of relapse during the follow-up period, people with a recent history of MDD, with indication of a recurring trajectory will be approached to participate. No limitations have been applied regarding any treatment they may be receiving, although medication use and other psychological interventions will be monitored throughout the course of follow-up. Additionally, participants will be eligible to participate regardless of whether they are currently experiencing depression symptoms or not.
Participants will be recruited over eighteen months from three international clinical cohorts or research infrastructures held at King’s College London (UK); the Netherlands Study of Depression and Anxiety and other available patient groups at Vrije Universiteit Medisch Centrum (VUmc; Amsterdam, The Netherlands); and Centro de Investigacion Biomedican en Red (CIBER; Barcelona, Spain). The schedule of observations is available in Table 2. The flow of participants through the study, including reasons for not participating in the study will be standardised across sites and documented in a flowchart (Fig. 1).
Recruitment procedures will vary slightly across sites. Potentially eligible individuals will be identified either through existing research cohorts (in London and The Netherlands) who have given consent to be contacted for research purposes, or through mental health services (in London and Barcelona). These individuals will be contacted by a member of the on-site research teams and sent the study information sheet and consent from. Those who provide verbal consent to participate will have a more detailed conversation with the research teams, during which they will have an opportunity to ask questions about the study, have their eligibility confirmed, and arrange a suitable time for enrolment.
Enrolment will either happen at the research centre, or at the participant’s home depending on the site they have been recruited from. Participants will receive a £15/€20 for enrolling in the study, and £5/€10 for every three months of continued participation. Participants who take part in additional qualitative interviews at 3-month or 1-year follow-up will receive £10/€10 per interview. Written consent will be obtained, during the enrolment session, which will include collection of sociodemographic, social environment, medical history and technology use questionnaires, and lifetime depression history measured through the Lifetime Depression Assessment – Self-Report (LIDAS ;), alongside baseline data collection of all outcome measures via Research Electronic Data Capture (REDCap) software .
Remote data collection
RADAR-MDD is the clinical study in depression being undertaken as part of a larger body of work managed by the Remote Assessment of Disease and Relapse – Central Nervous System (RADAR-CNS; ) international research consortium. This includes similar clinical studies conducted in epilepsy and multiple sclerosis, as well as teams dedicated to patient and public involvement, integration into care pathways, regulation. Software engineers, data scientists and software developers have developed an open-source platform to support data collection via wearable devices. More detailed technical information about this open-source platform and the sensors available for use is provided elsewhere . Below is a summary of the methods of remote data collection used in the RADAR-MDD study.
Passive RMT (pRMT) app
All modern smartphones comprise the sensors required for measurement in RADAR-MDD, however our study will only incorporate Android smartphones. For participants who do not use a smartphone, we will offer to provide a suitable smartphone for them. Participants who are using a non-Android smartphone will not be recruited unless they explicitly state that they are willing to switch to an Android smartphone as their only phone for the duration of follow-up, and in these cases an appropriate phone will be provided. Each participant will be asked to install the purpose-built pRMT application. This will run in the background, requiring minimal input from participants, collecting data on ambient noise, ambient light, GPS location, keystokes (at the London site only), Bluetooth connectivity, length and duration of calls, number of text messages and emails and weather conditions, in addition to battery life. GPS location data will be obfuscated; that is, providing relative location data, not absolute coordinates, preventing identification of an individual’s home address or precise geographical location.
Active RMT (aRMT) app
Following extensive focus group work and user testing , an additional app has been created to administer the aRMT aspects of the study protocol. This includes validated questionnaires to measure depressive symptoms and self-esteem. Variability of depressive symptoms will be measured via the 8-item Patient Health Questionnaire (PHQ8; ) every 2 weeks throughout the course of follow-up. Variation in self-esteem will be measured using the Rosenberg Self-Esteem Scale; RSES . The RSES is a widely-used 10-item self-reported questionnaire used to quantify self-esteem along a continuum and will be administered alongside the PHQ8 every 2 weeks.
As with the PHQ8 and RSES, every 2- weeks participants will be asked to complete a speech task. This requires participants to say aloud, in a quiet area, some excerpts from “The North Wind and the Sun”, which are shown to be phonetically balanced across all three languages . These will be offered on a random schedule to prevent rehearsal and fluency and preserve prosodic features. In addition to this, participants will be asked to respond to the following question: “Can you describe something you are looking forward to this week?”
The aRMT app will also deliver an ESM schedule (see online Additional file 1), which has been designed to collect brief, in-the-moment assessments relating to several of our domains of interest: mood, stress, sociability, activity and sleep. Participants will receive a series of questions intended to reflect their current state (such as “right now, I feel content”), with 7-point Likert scale answer options (0 = Not at all, 7 = Very much). The ESM schedule consists of approximately 44 items, taking up to 3-min to complete, delivered 9 random times per day within 90-min blocks starting from 08.30 and ending at 22.00 for 6 consecutive days every 6 weeks.
Cognitive function will also be measured using the THINC-IT® app, which has been specifically designed and validated to screen for cognitive dysfunction in depression , and includes assessments of elements of executive function such as memory, concentration, and attention.
The wearable device planned for use in RADAR-MDD is the FitBit Charge 2. Participants will be asked to wear this device for the duration of follow-up, providing ongoing data collection of accelerometery and heart rate, which provide information about movement, daytime activity, sedentary activity, physical exercise, step count, sleep efficiency, sleep latency, wake episodes, sleep fragmentation and post-midnight sleep start. The FitBit Charge 2 was selected due to its commercial availability, its competitive pricing, and the range of measurements available. Furthermore, it met several usability requirements highlighted by our focus groups and patient advisory boards, including: additional utility of a watch-face; comfort and durability; provided by a well-known brand (therefore reducing any potential stigma or identification as “research participant”); an acceptable battery life (3–5 days, requiring approximately 30 min to charge fully), and an excellent app interface. In research environments, the FitBit has also been found to be acceptable for use by depressed samples across a relatively long period of follow-up , and has recently demonstrated good ability to accurately identify sleep-wake state and sleep stage cycles .
Measurements will be taken at baseline, then every three months for the duration of follow-up (up to 2 years). All outcomes will be collected via Research Electronic Data Capture (REDCap) software , which sends automatic survey invitations and reminders to participants for the duration of the study.
Major depressive disorder relapse
The presence of MDD during follow-up will be defined as meeting criteria for MDD according to the Wold Health Organisation’s Composite International Diagnostic Interview – Short Form (CIDI-SF; ). The CIDI-SF has been used extensively on web-based platforms, and has shown excellent sensitivity and specificity to identify current MDD state . Additionally, a score of > 25 on the the Inventory of Depressive Symptomatology – Self-Reported (IDS-SR; ) will be required to establish that the severity of the depressive episode is at least moderate. The IDS-SR is a 30-item questionnaire, widely used in depression trials and providing detailed information on depressive symptoms, including all 9 Diagnostic and Statistical Manual (DSM) domains, symptoms commonly associated with depression (such as irritability or pain), melancholic symptoms and atypical symptoms. Scores on each of the 30 items are summed to create a total score ranging from 0 to 84, with the following thresholds: 0–13 (no symptoms); 14–25 (mild symptoms); 26–38 (moderate symptoms); 39–48 (severe symptoms); 49–84 (very severe symptoms) . In the case of IDS-SR/CIDI-SF identified relapse, a confirmatory diagnostic interview will be conducted, to additionally confirm of relapse onset.
Anxiety will be measured via the 7-item Generalised Anxiety Disorder questionnaire; GAD7 , which provides a dimensional score of anxiety symptoms which are frequently comorbid with depression. Quality-of-life/disability will be measured via the Work and Social Adjustment Scale; WSAS , which is a 5-item assessment of perceived social and work-related functional impairment used widely across a range of mental and physical disorders. Illness perceptions will be assessed using the Brief Illness Perceptions Questionnaire; BIPQ . The BIPQ provides an insight into the participant’s views about their underlying condition – including a measure of how well they see themselves coping with its symptoms and treatments. Alcohol use will be measured using the self-reported Alcohol Use Disorders Identification Test (AUDIT), which has been found to be a reliable and valid method of identifying at-risk and alcohol-dependent drinkers . MDD remission, the confirmation of continued remission status, or new remission status in participants who had previously relapsed, will be established using the IDS-SR followed by CIDI-SF. Participants scoring < 14 on the IDS-SR and who do not meet CIDI-SF criteria for MDD will be considered in a state of remission.
We will also seek to identify major changes in participants’ circumstances which may affect outcomes as well as use of RMT (such as the death of a relative or major illness), so every 3 months we are additionally collecting information about: treatments for depression, including changes in antidepressants, psychological therapies and any other action the individual has taken to alleviate depressive symptoms, and adherence to medication. The modified Client Service Receipt Inventory (CSRI ) is a well-validated and widely used measure of health economic data allowing us to model costs in future analyses. Change in life circumstances will be assessed using the List of Threatening Experiences – Questionnaire; LTE-Q .
To ensure a system which meets participant and researcher needs, there will be continued monitoring of the acceptability and usability of the RADAR-CNS platform, including the app, assessment scheme and outcome collection platform. This will involve conducting qualitative interviews with a random selection of 15 participants enrolled within the first 3 months and thorough assessment of platform usability via self-reported questionnaires (the Post-Study System Usability Questionnaire (PSSUQ ) and the Technology Assessment Model Fast Form (TAM-FF; ). This process will be replicated in a further 15 randomly selected participants at the point of drop-out or at 1-year post-enrolment. At study endpoint, post-participation qualitative interviews will be conducted in a random selection of participants who participated until study end-point, and those who dropped out throughout the course of follow-up. Data obtained throughout the course of process evaluation will be used, if necessary, to make iterative developments to the platform software, to optimise usability of the system.
Follow-up procedure and data monitoring
Participants will be encouraged to live their lives as normal, responding to in-app notifications when required and completing outcomes assessments via REDCap every 3 months for the duration of follow-up. The research team will be able to periodically review incoming data using the RADAR-CNS management portal and may contact participants if there is a loss of data stream from a device, to determine whether there are issues relating to functionality or user-experience. These contacts will be recorded as evidence of feasibility and acceptability outcomes. In addition to the telephone call provided after the introductory training session, participants will receive a further call after 1-month to address any further concerns or questions, and brief follow-up telephone calls will then be offered every 3 months to maintain engagement with participants throughout the course of the study and to remind participants of any upcoming outcome assessments.
In the case of suspected depressive relapse, participants will also be contacted by research teams to perform clinical interview and risk assessment. In the case of a depressive relapse or for participants who express significant suicidal ideas, we will advise the participant to contact their treating physician. If the participant is not willing to do so, the study team may, if sufficiently concerned, make direct contact with the treating physician without participant consent. Note that participants will, at recruitment, be forewarned and be asked to consent to this procedure.
At the end of the follow-up period, participants will receive a maximum 60 min “debrief” session, which will serve to collect end-point acceptability and usability outcomes, and include a qualitative interview investigating their experiences of participating for randomly selected participants. This will be done in person if possible, or over the phone if more convenient for the participant. Participants will also have an opportunity to view and discuss their own data.
Adverse events and study withdrawal
It is not expected that participation in RADAR-MDD will increase the risk of relapse, nor of there being other significant risks of harm to participants. There may be several reasons for withdrawal from the study:
Participant choosing to no longer participate; participants will be informed both in writing and verbally that participation is voluntary, that non-participation will not influence their medical care, and that they are free to withdraw from the study at any point without providing reasons.
The research team may withdraw the participant in the event of inter-current illness, adverse event (AE), protocol violation, administrative or other reasons.
The participant loses capacity for continued participation.
In the case of participant self-withdrawal, all attempts will be made to follow-up with the participant to establish cause of withdrawal, and to collect qualitative data regarding experience of participation. Depressive relapse itself will not be cause for automatic withdrawal; unless they choose to stop, participants who are identified as experiencing a relapse will continue to participate until study end-point. All data, including those from withdrawn participants (unless they request for their data to be deleted), will be included in the final analysis. If a participant withdraws from the study prematurely without providing evaluable data, a replacement participant will be sought if resources allow.
Statistical and analysis plan
Descriptive statistics for demographics, attrition rate, and number of participants using the remote assessment measurements without loss or damage and providing adequate data for the duration of the study period will be estimated. Using classification/regression approaches, we will investigate whether any demographics and/or other numerical information obtained during baseline of the study might serve as a predictor for subjects drop out/percentage of adequate data. Using mixed-effect models with participants as random factor, we will estimate whether relationships between the amount of usable data during the weeks prior to the outcome assessment and obtained scale’s measurements exist.
Aggregated features obtained from biosensors, smartphones, cognitive tests and from ESM, as well as their changes from baseline or previous time points (delta features) will be used for statistical analysis. Aggregation will be done for the period of 2 weeks prior to participant’s evaluation with PHQ8 or longer time interval preceding 3-mothly outcome scale assessment, since relapse identification is done retrospectively. First, univariate approach, where each variable/feature will be modelled with use of mixed-effect models, with depressive relapse as fixed and participant as random effect, to find out which variables are influenced during the relapse. Demographics and other baseline characteristics will be added to the model, when necessary, with correction for multiple comparisons.
Secondly, we will construct predictive models, using aggregated data obtained prior to assessment of relapses and their changes from previous time points to predict binary (relapsed or not) or continuous (when scale score is treated as continuous variable) outcomes. Under assumption that data are missing at random, multiple imputation will be applied for covariates, where missing-ness is not drastically high. Multivariate prediction model will be constructed and variable selection, based on, for example, LASSO L1-regularization for linear models, or different feature selection algorithms will be applied. Models’ performance will be characterized through the cross-validation, putting stress on sensitivity and specificity of relapse prediction model.
There is substantial evidence to suggest that changes in physical activity, sleep, stress, prosodic features, cognitive function, mood and sociability are associated with an increased risk of relapse [9,10,11,12,13]. RMT provides a new and unobtrusive way of measuring these variables, using smartphones and wearable technology to collect data reflective of participants’ daily lives and clinical symptoms. RADAR-MDD is the largest study to investigate multimodal RMT in a clinical cohort. If RADAR-MDD demonstrates that RMT is feasible to use in large populations, acceptable for participants, and provides clinically useful data, it may represent that start of a paradigm shift in how clinical data are collected and respective change in how health services are delivered . The RADAR-CNS platform is a device-agnostic system and could be applied to any diagnosis or incorporated into any study design, potentially transforming data collection for clinical and research purposes.
However, to ensure translation into health services, extensive work is required to identify the RMT biosignatures most useful to assist in early detection of deterioration, and to understand the potential barriers and facilitators of large-scale uptake. There are anticipated challenges to this novel method of data collection. Firstly, change in health status may be a key barrier to long-term engagement with this study ; an exacerbation of depressive symptoms may influence ongoing participation rate throughout the duration of follow-up, and participant drop-out may represent a depressive relapse. However, there is also some evidence to suggest that people experiencing more severe symptoms may participate more fully, as they may be more motivated to improve their understanding of their condition . Secondly, whilst this is a non-interventional study, encouraging individuals to monitor their own health and providing feedback on activity and sleep (via the FitBit app) may prompt people to change their behaviours or seek help sooner, reducing risk of relapse. There is also evidence to suggest that encouraging health monitoring may increase health anxiety, which in turn may contribute to worsening depressive symptoms .
There are clear challenges to overcome, and RADAR-MDD hopes to identify as many of them as possible through qualitative interviews and intensive follow-up procedures and provide some insight into how to overcome these barriers for future implementation of RMT procedures. There are also important future benefits of this method of data collection. The data are inherently personal, and providing personalised feedback may increase individuals’ health awareness and facilitate self-management behaviours to improve long-term health outcomes . Furthermore, RMT may provide a solution to traditional reliance on infrequently measured subjective outcomes in clinical trials, which can lead to imprecision, inefficiency, and the need for larger sample sizes.
RADAR-MDD is an essential step towards improving our understanding of the feasibility and acceptability of large-scale RMT data collection and determining the clinical utility and predictive ability of RMT to predict relapse in major depressive disorder.
Active remote measurement technology
Alcohol use disorders identification test
Brief Illness perceptions questionnaire
Centro de investigacion biomedican en red
Composite international diagnostic interview - self Report
Client service receipt inventory
Diagnostic and statistical manual
Experience sampling method
7-item generalised anxiety disorder questionnaire
Global positioning system
Inventory of depressive symptomatology- self-report questionnaire
Lifetime depression assessment – self-report
List of threatening experiences – questionnaire
Major depressive disorder
8-item patient health questionnaire
passive remote measurement technology
Post-Study system usability questionnaire
Remote assessment of disease and relapse - central nervous system
Remote assessment of disease and relapse - major depressive disorder
Research electronic data capture
Remote measurement technology
Rosenberg self-esteem scale
Technology assessment model fast form
Vrije Universiteit Medisch Centrum
Work and social adjustment scale
Naslund JA, Marsch LA, McHugo GJ, Bartels SJ. Emerging mHealth and eHealth interventions for serious mental illness: a review of the literature. J Ment Health. 2015;24:321–32.
Cuijpers P, Schoevers RA. Increased mortality in depressive disorders: a review. Curr Psychiatry Rep. 2004;6:430–7.
Lenox-Smith A, Macdonald MTB, Reed C, Tylee A, Peveler R, Quail D, et al. Quality of life in depressed patients in UK primary care: the FINDER study. Neurol Ther. 2013;2:25–42.
Lerner D, Adler DA, Chang H, Berndt ER, Irish JT, Lapitsky L, et al. The clinical and occupational correlates of work productivity loss among employed patients with depression. J Occup Environ Med. 2004:46LS46–55.
Cimpean D, Drake RE. Treating co-morbind chronic medical conditions and anxiety/depression. Epidemiol Psychiatr Sci. 2011;20:141–50.
Verduijn J, Verhoeven JE, Milaneschi Y, Schoevers RA, van Hemert AM, Beekman ATF, et al. Reconsidering the prognosis of major depressive disorder across diagnostic boundaries: full recovery is the exception rather than the rule. BMC Med. 2017. https://doi.org/10.1186/s12916-017-0972-8.
Blanco C, Okunda M, Markowitz JC, Liu SM, Grant BF, Hasin DS. The epidemiology of chronic major depressive disorder and dysthymic disorder: results from the National Epidemiologic Survey on alcohol and related conditions. J Clin Psychiatry. 2010;17:1645–56.
Bockting CL, Hollon SD, Jarrett RB, Kuyken W, Dobson K. A lifetime approach to major depressive disorder: the contributions of psychological interventions in preventing relapse and recurrence. Clin Psychol Rev. 2015;41:16–26.
Li S, Chan J, Lam J, Yu M, Wing Y. Can nocturnal sleep disturbances predict non-remission and relapse in patients with major depressive disorder? V a 5-year naturalistic longitudinal study. Sleep Med. 2013;14:e48.
Cruwys T, Dingle GA, Haslam C, Haslam SA, Jetten J, Morton TA. Social group memberships protect against future depression, alleviate depression symptoms and prevent depression relapse. Soc Sci Med. 2013;98:179–86.
van Rijsbergen GD, Bockting CLH, Burger H, Spinhoven P, Koeter MWJ, Ruhé HG, et al. Mood reactivity rather than cognitive reactivity is predictive of depressive relapse: A randomized study with 5.5-year follow-up. J Consult Clin Psychol. 2013;81:508–17.
Hashim NW, Wilkes M, Salomon R, Meggs J, France DJ. Evaluation of Voice Acoustics as Predictors of Clinical Depression Scores. J Voice. 2017;31:256.e1–6.
Papakostas GI. Cognitive symptoms in patients with major depressive disorder and their implications for clinical practice. J Clin Psychiatry. 2014;75:8–14.
Shallcross AJ, Gross JJ, Visvanathan PD, Kumar N, Palfrey A, Ford BQ, et al. Relapse prevention in major depressive disorder: mindfulness-based cognitive therapy versus an active control condition. J Consult Clin Psychol. 2015;83:964–75.
Sim K, Lau WK, Sim J, Sum MY, Baldessarini RJ. Prevention of relapse and recurrence in adults with major depressive disorder: Systematic review and meta-analyses of controlled trials. Int J Neuropsychopharmacol. 2016;19:pyv076.
Wells JE, Horwood LJ. How accurate is recall of key symptoms of depression? A comparison of recall and longitudinal reports. Psychol Med. 2004;34:1001–11.
Zupan Z, Žeželj I, Andjelković I. Memory bias in depression: effective of self-reference and age. J Soc Clin Psychol. 2017;36:300–15.
Mohr DC, Zhang M, Schueller SM. Personal sensing: understanding mental health using ubiquitous sensors and machine learning. Annu Rev Clin Psychol. 2017;13:23–47.
Steinhubl SR, Muse ED, Topol EJ. The emerging field of mobile health. Sci Transl Med. 2015;7:283rv3.
Jeong T, Klabjan D, Starren J. Predictive analytics using smartphone sensors for depressive episodes. 2016; http://arxiv.org/abs/1603.07692.
Doryab A, Min JK, Wiese J, Zimmerman J, Hong J. Detection of behavior change in people with depression. Modern Artificial Intelligence for Health Analytics- Papers from the AAAI-14. 2014. Available from: http://www.aaai.org/ocs/index.php/WS/AAAIW14/paper/viewFile/8850/8303.
Sanchez MH, Vergyri D, Ferrer L, Richey C, Garcia P, Knoth B, et al. Using prosodic and spectral features in detecting depression in elderly males. Interspeech. 2011:3001–4.
Myin-Germeys I, Oorschot M, Collip D, Lataster J, Delespaul P, van Os J. Experience sampling research in psychopathology: opening the black box of daily life. Psychol Med. 2009;39:1533–47.
Baxter RJ, Hunton JE. Capturing affect via the experience sampling method: prospects for accounting information systems researchers. Int J Account Inf Syst. 2011;12:90–8.
Merz EL, Roesch SC. Modeling trait and state variation using multilevel factor analysis with PANAS daily diary data. J Res Pers. 2011;45:2–9.
Wilhelm P, Schoebi D. Assessing mood in daily life. Europ J Psychol Assess. 2007;23:258–67.
aan het Rot M, Hogenelst K, Schoevers RA. Mood disorders in everyday life: A systematic review of experience sampling and ecological momentary assessment studies. Clin Psychol Rev. 2012;3:510–23.
Clinicaltrials.gov. Study to evaluate potential predictors of relapse in participants with major depressive disorder (MDD). Identifier NCT02489305.
Clinicaltrials.gov. Wellness monitoring for major depressive disorder (CBN-Well). Identifier NCT02934334.
Simblett SK, Greer B, Matcham F, Polhemus A, Curtis H, Ferrao J, et al. Barriers and facilitators to engagement with remote measurement technology for managing health: a systematic review and content analysis of findings. J Med Internet Res. 2018;20:e10480.
Simblett S, Matcham F, Siddi S, Bulgari V, Barattieri di San Pietro C, Hortas López J, Ferrão J, Polhemus A, Haro JM, de Girolamo G, Gamble P, Eriksson H, Hotopf M, Wykes T, RADAR-CNS Consortium. Barriers to and facilitators of engagement With mHealth technology for remote measurement and management of depression: Qualitative analysis. JMIR Mhealth Uhealth. 2019;7(1):e11325.
Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1995;49:1373–9.
Trivedi MH, Rush AJ, Wisniewski SR, Nierenberg AA, Warden D, Ritz L, et al. Evaluation of outcomes with citalopram for depression using measurement-based care in STAR*D: implications for clinical practice. Am J Psychiatry. 2006;163:28–40.
Bot M, Middeldorp CM, de Geus EJC, Lau HM, Sinke M, van Nieuwenhuizen B, et al. Validity of LIDAS (LIfetime depression assessment self-report): a self-report online assessment of lifetime major depressive disorder. Psychol Med. 2017;47:279–89.
Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42:377–81.
Remote Assessment of Disease and Relapse in central Nervous System (RADAR-CNS) [cited 2018 Jan 24]. Available from: https://www.radar-cns.org/
Ranjan Y, Rashid Z, Stewart C, Kerz M, Begale M, Verbeeck D, et al. RADAR-base: An open source mHealth platform for collecting, monitoring and analyzing data using sensors, wearables, and mobile devices. JMIR mHealth and uHealth, under review.
Kroenke K, Strine TW, Spitzer, Robert L, Williams J, Berry JT, Mokdad AH. The PHQ-8 as a measure of current depression in the general population. J Affect Disord. 2009;114:163–73.
Greenberger E, Chen C, Dmitrieva J, Farruggia SP. Item-wording and the dimensionality of the Rosenberg self-esteem scale: do they matter? Pers Individ Diff. 2003;35:1241–54.
Williamson JR, Quatieri TF, Helfer BS, Ciccarelli G, Mehta DD. Vocal and facial biomarkers of depression based on motor incoordination and timing. In: 4th international audio/visual emotion challenge and workshop: depression challenge. Florida: Orlando; 2014. Available from: https://doi.org/10.1145/2661806.2661809
McIntyre RS, Harrison J. Validation of the THINC-it tool for cognitive dysfunction in major depressive disorder. National Library of Medicine. https://clinicaltrials.gov/ct2/show/NCT02508493.
Chum J, Kim MS, Zielinski L, Bhatt M, Chung D, Yeung S, et al. Acceptability of the Fitbit in behavioural activation therapy for depression: a qualitative study. Evid Based Ment Heal. 2017;20:128–33.
de Zambotti M, Goldstone A, Claudatos S, Colrain IM, Baker FC. A validation study of Fitbit charge 2™ compared with polysomnography in adults. Chronobiol Int. 2018;35:465–76.
Kessler RC, Andrews G, Mroczek D, Ustun B, Wittchen H-U. The World Health Organization composite international diagnostic interview short-form (CIDI-SF). Int J Methods Psychiatr Res. 1998;7:171–85.
Rush AJ, Carmody T, Reimitz P-E. The inventory of depressive symptomatology (IDS): clinician (IDS-C) and self-report (IDS-SR) ratings of depressive symptoms. Int J Methods Psychiatr Res. 2000;9:45–59.
Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166:1092–7.
Mundt JC. The work and social adjustment scale: a simple measure of impairment in functioning. Br J Psychiatry. 2002;180:1092–7.
Broadbent E, Petrie KJ, Main J, Weinman J. The brief illness perception questionnaire. J Psychosom Res. 2006;60:631–7.
Daeppen J-B, Yersin B, Landry U, Pecoud A, Decrey H. Reliability and validity of the alcohol use disorders identification test (AUDIT) embedded within a general health risk screening questionnaire: results of a survey in 332 primary care patients. Alcohol Clin Exp Res. 2000;24:659–65.
Chisholm D, Knapp MRJ, Knudsen HC, Amaddeo DF, Gaite L, Van Wijngaarden B. Client socio-demographic and service receipt inventory - European version : development of an instrument for international research. Br J Psychiatry. 2000;S39:S28–33.
Brugha TS, Cragg D. The list of threatening experiences: the reliability and validity of a brief life events questionnaire. Acta Psychiatr Scand. 1990;82:77–81.
Lewis JR. Psychometric evaluation of the PSSUQ using data from five years of usability studies. Int J Hum Comput Interact. 2002;14:463–88.
Chin WW, Johnson N, Schwarz A. A fast form approach to measuring technology acceptance and other constructs. MIS Q. 2008;32:687–703.
Lang A, Craven M, Morriss R, Hollis C. Investigating user needs and integration of Remote Measuring Technologies into clinical practice. In: The Proceedings of the 20th Triennial Congress of the International Ergonomics Association. Florence, Italy; 2018.
Dogan E, Sander C, Wagner X, Hegerl U, Kohls E. Smartphone-based monitoring of objective and subjective data in affective disorders: where are we and where are we going? Systematic rReview J Med Internet Res. 2017;19:e262.
McGillion M, Yost J, Turner A, Bender D, Scott T, Carroll S, et al. Technology-enabled remote monitoring and self-management - vision for patient empowerment following cardiac and vascular surgery: user testing and randomized controlled trial protocol. JMIR Res Protoc. 2016;5:e149.
We thank our colleagues both within the RADAR-CNS consortium and across all involved institutions for their contribution to the development of this protocol. We thank all the members of the RADAR-CNS patient advisory board for their contribution to the device selection procedures, and their invaluable advice throughout the study protocol design. We also thank Sonia DiFrancesco, Katie White, Alina Ivan, Ashley Polhemus, Jose Ferrao, Michiel Ringkjøbing-Elema, Francesco Nobilia, Wolfgang Viechtbauer, Sjaak Peelen, Yatharth Ranjan, Zulqarnain Rashid, Janneke Boere, Nicholas Cummins, and Nick Meyer.
This paper represents independent research part funded by the NIHR Wellcome Trust King’s Clinical Research facility and the National Institute for Health Research (NIHR) Biomedical Research Centre and South London and Maudsley NHS Foundation Trust and King’s College London. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care. TW also acknowledges are NIHR Senior Investigator Award. This research was reviewed by a team with experience of mental health problems and their carers who have been specially trained to advise on research proposals and documentation through the Feasibility and Acceptability Support Team for Researchers (FAST-R): a free, confidential service in England provided by the National Institute for Health Research Maudsley Biomedical Research Centre via King’s College London and South London and Maudsley NHS Foundation Trust.
Ethical approval and consent to participate
RADAR-MDD will be conducted per the Declaration of Helsinki and Good Clinical Practice, adhering to principles outlined in the NHS Research Governance Framework for Health and Social Care (2nd edition). Ethical approval has been obtained in London from the Camberwell St Giles Research Ethics Committee (REC reference: 17/LO/1154), in London from the CEIC Fundacio Sant Joan de Deu (CI: PIC-128-17) and in The Netherlands from the Medische Ethische Toetsingscommissie VUms (METc VUmc registratienummer: 2018.012 – NL63557.029.17). All staff working on the study have received training in study conduct, informed consent and risk assessment. RMT data will be pseudonymised and stored in a research database in accordance with the General Data Protection Regulation. The informed consent process will ensure that participants understand the nature of the study, and the data being collected. Interested individuals will be sent the study materials, including information sheet and consent form to review. If, after reading, they wish to participate, they will be invited to an enrolment session which will involve the collection of written consent before the administration of any study procedures. They will understand that their privacy is protected, that they can withdraw at any time without giving a reason, and request to have all data collected from them deleted. Participants may not necessarily be in contact with healthcare services during the study, but for those that are, their relationships with their care teams will not be impacted by participation or withdrawal from the study.
The RADAR-CNS project has received funding from the Innovative Medicines Initiative 2 Joint Undertaking under grant agreement No 115902. This Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation programme and EFPIA (www.imi.europa.eu).
This communication reflects the views of the RADAR-CNS consortium and neither IMI nor the European Union and EFPIA are liable for any use that may be made of the information contained herein.
The funding body have not been involved in the design of the study, the collection or analysis of data, or the interpretation of data.
Availability of data and materials
Not applicabale – this manuscript does not contain any data,.
Consent for publication
HE is a full-time employee of H. Lundbeck A/S and holds stock and stock optionsin H. Lundbeck A/S. QL, NM and VN are employees of Janssen Research & Development, LLC and hold company stocks/stock options. JMH has received economic compensation for participating in advisotry boards or giving educational lectures from Eli Lilly & Co, Sanofi, Lundbeck, and Otsuka. No other authors have competing interests to declare.
About this article
Cite this article
Matcham, F., Barattieri di San Pietro, C., Bulgari, V. et al. Remote assessment of disease and relapse in major depressive disorder (RADAR-MDD): a multi-centre prospective cohort study protocol. BMC Psychiatry 19, 72 (2019). https://doi.org/10.1186/s12888-019-2049-z
- Major depressive disorder
- Remote measurement technology
- Passive sensing
- Prospective study
- Observational cohort
- Outcome measurement