This article has Open Peer Review reports available.
Electronic self-monitoring of mood using IT platforms in adult patients with bipolar disorder: A systematic review of the validity and evidence
© Faurholt-Jepsen et al. 2016
Received: 19 August 2015
Accepted: 8 January 2016
Published: 15 January 2016
Various paper-based mood charting instruments are used in the monitoring of symptoms in bipolar disorder. During recent years an increasing number of electronic self-monitoring tools have been developed. The objectives of this systematic review were 1) to evaluate the validity of electronic self-monitoring tools as a method of evaluating mood compared to clinical rating scales for depression and mania and 2) to investigate the effect of electronic self-monitoring tools on clinically relevant outcomes in bipolar disorder.
A systematic review of the scientific literature, reported according to the Preferred Reporting items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines was conducted. MEDLINE, Embase, PsycINFO and The Cochrane Library were searched and supplemented by hand search of reference lists. Databases were searched for 1) studies on electronic self-monitoring tools in patients with bipolar disorder reporting on validity of electronically self-reported mood ratings compared to clinical rating scales for depression and mania and 2) randomized controlled trials (RCT) evaluating electronic mood self-monitoring tools in patients with bipolar disorder.
A total of 13 published articles were included. Seven articles were RCTs and six were longitudinal studies. Electronic self-monitoring of mood was considered valid compared to clinical rating scales for depression in six out of six studies, and in two out of seven studies compared to clinical rating scales for mania.
The included RCTs primarily investigated the effect of heterogeneous electronically delivered interventions; none of the RCTs investigated the sole effect of electronic mood self-monitoring tools. Methodological issues with risk of bias at different levels limited the evidence in the majority of studies.
Electronic self-monitoring of mood in depression appears to be a valid measure of mood in contrast to self-monitoring of mood in mania. There are yet few studies on the effect of electronic self-monitoring of mood in bipolar disorder. The evidence of electronic self-monitoring is limited by methodological issues and by a lack of RCTs. Although the idea of electronic self-monitoring of mood seems appealing, studies using rigorous methodology investigating the beneficial as well as possible harmful effects of electronic self-monitoring are needed.
In bipolar disorder research, there has during the last decade been an emerging shift in illness paradigm from a focus on affective episodes to an increasing focus on inter-episodic mood instability [1, 2]. Many patients with bipolar disorder remain symptomatic during inter-episode periods and experience significant subsyndromal day-to-day or week-to-week mood swings that are of greater severity than those experienced by healthy individuals and appear to reflect illness activity . Further, these subsyndromal mood swings seem associated with high risk of relapse, hospitalization and impaired functioning [1, 3–5]. Continuous monitoring and assessment of mood instability and other variables possibly reflecting illness activity in detail, including measures of duration, severity and frequency of symptoms, may therefore be clinically relevant since it would allow for early intervention on subsyndromal symptoms and ultimately prevention of full-blown affective episodes. Self-reports are ubiquitous in psychiatric research, and various mood charting instruments for self-monitoring are frequently used in the management and monitoring of depressive and manic symptoms in patients with bipolar disorder. Traditionally these mood charting instruments have been paper-based, such as the National Institute of Mental Health LifeChart Method (NIMH-LCM) , the Systematic Treatment Enhancement Program for Bipolar Disorder (STEP-BP) the Mood Chart (mood chart no longer available online) and the ChronoSheet  and have been shown valid compared to clinical rating scales for depression and mania [8, 9]. Paper-based mood charting instruments can be viewed as facilitating tools helping patients with bipolar disorder gain illness insight, facilitate patient empowerment, teach patients to recognize early warning signs of recurrence of affective episodes and enable individualized characterization of mood instability in detail. However, several issues limiting the usefulness of paper-based mood charting instruments have been addressed, such as low compliance and potential recall bias when reporting data retrospectively, i.e. where patients complete batches of daily ratings at a single time (sometimes referred to as hoarding or backfilling) [10–13]. During recent years there has been an increasing growth of e-mental health technologies , including electronic platforms offering tools for self-monitoring of mood. The electronic approach for self-monitoring of mood offers ecological momentary assessments , a monitoring technique for assessment in real-time and in naturalistic settings, offers the ability to verify the timing and compliance of data collection, eliminates the need for costly and error-prone data entry, may help remind patients to perform the self-monitoring and may have higher usability than paper-based versions.
However, it remains unclear whether the severity of self-monitored mood registered using electronic self-monitoring tools is a valid measure compared to validated clinical rating scales for depression and mania, which are currently used as the golden standard for assessing the severity of depressive and manic symptoms in patients with bipolar disorder. Furthermore, it remains unclear to what extent the use of electronic mood self-monitoring tools affects clinically relevant outcomes, and importantly whether there may in fact, be harmful effects, e.g. self-monitoring of mood symptoms may induce depressive ruminations that may result in increasing severity of depressive symptoms . An understanding and overview of these aspects is crucial in order to guide the use and development of IT platforms for electronic self-monitoring of mood in bipolar disorder.
The objectives of the present systematic review were thus 1) to evaluate the validity of electronic mood self-monitoring tools compared to validated clinical rating scales for depression and mania and 2) to evaluate the evidence of the effect of electronic mood self-monitoring tools on clinically relevant outcomes in randomized controlled trials (RCT).
This is the first systematic review of electronic self-monitoring of mood in patients with bipolar disorder.
This systematic review was conducted and reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement . Methods of the review and eligibility criteria were established in advance and documented in a review protocol that can be retrieved from the authors upon request. No modifications were made to the review protocol during the review process.
Original studies involving IT platforms for electronic self-monitoring of mood used by adult patients with bipolar disorder ≥18 years of age and either reporting on correlations between electronically self-monitored mood and validated clinical rating scales for depression and mania or RCTs assessing the effect of electronic self-monitoring tools as an intervention were eligible for review. The language of the publications was restricted to English. The types of IT platforms for electronic self-monitoring of mood were defined as cell phones, computers, tablets, PDAs, smartphones and online devices. Papers only describing the technical part of the IT platforms, not including patients with bipolar disorder and/or not reporting on correlations between electronic mood self-monitoring and validated clinical rating scales for depression and mania or the effect of electronic self-monitoring as an intervention in RCTs in patients with bipolar disorder were excluded from review. Where multiple articles reported on different validated clinical rating scales deriving from the same study and reported on the same patient sample, all of these articles were included for review.
Information sources and search strategy
Published studies were identified through searching the electronic databases MEDLINE (January 1950 to July 2015), PsychINFO (1806 to July 2015), Embase (1974 to July 2015) and The Cochrane Library (issue 6, 2015) supplemented by hand search of reference lists of retrieved articles.
The literature search was conducted by one researcher (MFJ) and employed the search terms/key words: (telephone or mobile phone or cellular phone or cell phone or smartphone or computer or telecommunications or electronic or electronic device or text message or application or app) and (bipolar disorder or manic depressive psychosis or manic depressive disorder or mania or bipolar affective disorder or manic or bipolar depression).
Study selection and data extraction
The present systematic review did not need ethical approval. Data presented are from individual studies approved by local ethical commitees and consent obtained in individual studies.
The results of the literature search and selection of studies are presented in Fig. 1. The literature search involving the MEDLINE, PsychInfo, Embase and The Cochrane Library databases identified a total of 4438 titles and additionally six titles were identified by hand search. Of these, 4396 titles, including duplicates, were excluded from review due to not fulfilling the eligibility criteria, the main reasons for exclusion being 1) not involving self-monitoring 2) not including patients with bipolar disorder and 3) only providing the technical description of the IT platforms. Thus, 48 full-text articles were further evaluated for eligibility. Of these, 35 articles were excluded from review due to 1) not describing a mood self-monitoring tool (n = 10) [19–28] 2) not reporting on patient data (n = 13) [29–41], 3) being review articles (n = 2) [42, 43], and 4) not reporting on validated clinical rating scales for depression and mania (n = 10) [44–53]. A total of 13 articles fulfilled the eligibility criteria and were included in the qualitative analysis [12, 16, 54–64].
Of the 13 included articles seven were RCTs [16, 57, 58, 60–63] and six had a longitudinal design (non-RCTs) [12, 54–56, 59, 64]. One article did not present data on follow-up period . The remaining articles reported follow-up periods ranging from 2 weeks to 24 months. The sample sizes ranged from 10 to 233 patients and the mean age ranged from 33.4 to 47.5 years. The included studies were conducted in Europe [16, 55, 59, 60, 64], USA [12, 56–58, 62], Canada , and Australia [61, 63], respectively. The different IT platforms used for electronic self-monitoring of mood in the studies were computers (using e-mail or web interfaces) [12, 54, 55, 57, 60, 61, 63, 64], PDAs [56, 64] and smartphones [16, 58, 59, 62, 64], respectively.
Validity of electronic self-monitored mood compared to validated clinical rating scales for depression and mania
Characteristics of studies evaluating the validity of electronic self-monitoring tools of mood compared to validated clinically administrated rating scales for depression and mania in patients with bipolar disorder listed according to year of publication. N = 206
Author, Country, year of publication
IT platform, name of tool
Sample size, setting, age, bipolar type I
Self-monitoring frequency, follow-up
Blinding of outcome assessor
Corresponding days between self-monitoring data and ratings in analyses
Missing self-monitored data
Whybrow PC et al., USA, Canada & Germany, 2003 
80, Outpatient, 38.67 (SD 10.86), 72.5 %
Daily, 3 months
Pearson: HDRS: r = −0.683 (p < 0.001)
6.1 % (SD 9.3)
Bauer M et al., USA, Canada & Germany, 2004 
80, Outpatient, 38.67 (SD 10.86), 72.5 %
Daily, 3 months
Pearson: HDRS: r = −0.683 (p < 0.001)
6.1 % (SD 9.3)
Linear mixed model coefficient: HDRS: β = −0.303 (p < 0.001)
Bauer M et al., USA, Canada & Germany, 2008 
27 Inpatient & 80 Outpatient,
YMRS, MRS c
Pearson: YMRS: r = 0.825 (p < 0.001)
Linear mixed model coefficient: YMRS: β = 0.229 (p = 0.001)
Depp CA et al., USA, 2010 
10, Outpatient, 41.0 (SD 13.7)
Daily, 2 weeks
Pearson: MADRS: r = 0.841 (p = 0.018)
22 % (SD 14)
Depp CA et al., USA, 2012 
Self-monitoring using smartphone
18, Outpatient, 44.0 (SD 14), 90.9 %
Twice/ day in fixed time blocks, 12 weeks
Pearson: Baseline: MADRS: r = −0.567 (p = 0.014)
57.9 % (SD 26.6)
6 weeks: MADRS: r = −0.542 (p = 0.028)
YMRS: r = 0.520 (p = 0.032)
Faurholt-Jepsen M et al., Denmark, 2014 
17, Outpatient, 33.4 (SD 9.5), 82.4 %
Daily, 3 months
Linear mixed model coefficient: HRDS: β = −0.051 (p < 0.001)
Schärer LO et al., Germany, 2015 
Computer, PDA, smartphone, Personal Life-Chart app
54, Outpatient, 40.6
Daily, 18 months
Spearman correlation coefficient: IDS-C: r = 0.60–0.62 (p-value not shown)
YMRS: r = 0.17–0.39 (p-value not shown)
Correlation with clinically rated depressive symptoms
Six (n = 179) of the seven articles evaluated the validity of electronic self-monitoring of mood compared to clinical rating scales for depression using the Montgomery Asberg Depression Rating Scale (MADRS) , the Hamilton Depression Rating Scale (HDRS)  or the Inventory of Depressive Symptomatology, clinician rated (IDS-C) . All of the six articles found a significant correlation between self-monitored mood and clinical rating scales for depression, indicating that increasing severity of self-monitored depressive mood correlated with increasing scores of clinical rating scales for depression. Regression coefficients and slopes are presented in Table 1, but not all studies provided both of these statistical measures.
The monitoring tools used were PDAs [56, 64], computers [12, 54, 64] and smartphones [58, 59, 68], respectively. All but one article, which did not provide data on this in the paper  investigated the validity of electronic self-monitoring compared to clinical rating scales for depression from corresponding days.
Correlation with clinically rated manic symptoms
All of the seven articles evaluated the validity of electronic self-monitoring of mood compared to clinical rating scales for mania using the Young Mania Rating Scale (YMRS) . Two articles (n = 64) found a significant correlation between self-monitored mood and the clinical rating scale for mania [55, 64], indicating that increasing severity of self-monitored manic mood correlated increasing scores on the clinical rating scale for mania. One study (n = 18) found a significant positive correlation between self-monitored mood and the clinical rating scale for mania after 6 weeks of mood self-monitoring, but not at baseline . Regression coefficients and slopes are presented in Table 1, but not all studies provided both of these statistical measures. The monitoring tools used were PDAs [56, 64], computers [12, 54, 55, 64] and smartphones [58, 59, 64], respectively. All but one article, which did not provide data on this in the paper  investigated the validity of electronic self-monitoring compared to clinical rating scales for mania from corresponding days.
Effect of electronic mood self-monitoring tools on clinically relevant outcomes in randomized controlled trials
Characteristics of studies on randomized controlled trials (RCT) investigating the effect of IT platforms with intervention programmes including electronic self-monitoring of mood on different outcomes in adult patients with bipolar disorder listed according to year of publication. N = 759
Author, Country, year of publication
Intervention group: IT platform, name of tool
Sample size, setting, agea, Bipolar disorder type I
Additional information on the intervention group
Self-monitoring frequency, follow-up
Blinding of outcome assessor
Lieberman DZ et al., USA, 2010 
Computer-based, Online self-monitoring using LCMb
48, Outpatient, 37.7 (SD 12.5), 13 %
Online self-monitoring of mood, medications and other variables
Daily, 90 days
- No difference in CGI-Sc score between the groups
- Significantly higher number of days rated and with complete data in the electronic self-monitoring group (intervention group)
Depp CA et al., USA, 2012 
Smartphone-based, Self-monitoring using smartphone
40, Outpatient, 45.1 (SD 13.8), 90.4 %
Smartphone-based monitoring of momentary mood and related experiences
Twice/ day in fixed time blocks, 12 weeks
- Significantly higher variability of self-monitored mood in the electronic self-monitoring group both within-person and between-persons
- Significantly higher compliance in paper-and pencil group (control group)
Todd NJ et al., UK, 2014 
Web-based, Online self-monitoring using ‘Living with Bipolar’
TAU (and waiting list)
122, Outpatient, 43.44 (SD 11.25), 70 %
Web-based recovery informed self-management and self-monitoring
NA, 6 months
No (self-assessed unblinded by patients)
- Primary outcome: Significantly higher self-assessed quality of life (QoL.BD-Briefd and WHOQoL-BREFe) in the intervention group
- Secondary outcome: Significantly higher self-assessed recovery (BRQ f), lower symptoms severity (ISSg), and higher social functioning (SASSh) in the intervention group
Barnes CW et al., Autralia, 2015 
Web-based, Online self-monitoring using ‘Recovery Road for Bipolar Disorder’
Websites on ‘healthy lifestyles’ (and waiting list)
233, Outpatients, 39.0 (SD 10.8), 87.6 %
Web-based psychoeducatio-nal program and self-monitoring
Weekly, 12 months
No (self-assessed unblinded by patients)
- Primary outcome: No significant differences in self-reported time to recurrence (BDI-IIi, ISSg, self-reported hospitalization and Sheehan Disability Scale) between the groups
Depp CA et al., USA, 2015 
Smartphone-based, Self-monitoring using ‘Personalized Real-Time Intervention for Stabilizing Mood (PRISM)’
82, Outpatient, 47.5 (SD 12.8), 87.8 %
Smartphone-based personal self-management strategies and self-monitoring
Twice/ day in fixed time blocks, 24 weeks
- Primary outcome: Significantly lower MADRSj score at week 6 and 12 in the intervention group. No difference at end of study.
- Secondary outcome: No significant differences in YMRSk and self-rated functional impairmentl between the groups
Lauder S et al.,Australia, 2015 
Web-based, Online self-monitoring using ‘Moodswings’
Moodswings (online psychoeducation, self-monitoring of mood and discussion boards)
156, Outpatients, 40.6 (SD 10.6), 51.5 %
Moodswings plus online Cognitive Behavioral Therapy
Daily, 12 months
No (self-assessed unblinded by patients)
- Primary outcome: Significantly lower ASRMm score in the intervention group. No difference in MADRS Self-assessment and other self-assessed outcomes between the groups.
Faurholt-Jepsen M et al., Denmark, 2015 
Smartphone-based, self-monitoring using ‘MONARCA’
Placebo smartphone and TAU
78, Outpatients, 29.3 (SD 8.43), 67.1 %
Smartphone-based self-monitoring and daily feedback loop to patient and clinicians
Daily, 6 months
- Primary outcome: No significant difference in HDRS-17n and YMRS between the groups.
- Sub-analyses: More depressive symptoms in the intervention group. Fewer manic symptoms in the intervention group.
Two of the RCTs aimed primarily at investigating differences in compliance rates between using an electronic mood self-monitoring tool compared to using paper-and-pencil mood self-monitoring [57, 58] and reported on differences in symptom scores as secondary outcomes. The first study (n = 48) reported that the intervention group showed significantly higher compliance to mood self-monitoring compared to the control group. No difference in Clinical Global Impression Severity (CGI-S) score was found between the two groups . The second study (n = 40) reported that the intervention group showed significantly higher variability of self-monitored mood compared to the control group. Further, a higher compliance to mood self-monitoring was found in the control group .
Five of the seven included RCTs investigated the effect of different electronically delivered intervention programmes including a self-monitoring tool on symptoms of illness activity in patients with bipolar disorder [16, 60–63].
One study (n = 122) reported on a RCT investigating the effect of an online interactive intervention based on principles of Cognitive Behavioral Therapy and psychoeducation including self-monitoring (‘Living with Bipolar’) (intervention group) compared to treatment-as-usual (TAU) (control group). The study reported that the intervention group showed significant improvement in self-assessed quality of life, recovery, symptoms severity and social functioning compared to the control group .
Another study (n = 233) reported on a RCT investigating the effect of a web-based psychoeducational program including self-monitoring (Recovery Road for Bipolar Disorder) (intervention group) compared to a control group directed to web-sites on healthy lifestyles. The study reported that there were no significant differences between the two groups in any of the defined outcome .
The third study (n = 82) reported on a RCT investigating the effect of smartphone-based personalized self-management strategies based on self-reported mood scores (intervention group) compared to paper-and-pencil mood self-monitoring (control group). The study reported no significant differences in depressive and manic symptoms between the two groups at the end of study .
The fourth study (n = 156) reported on a RCT investigating the effect of an online psychoeducation, mood tracking, discussion boards and cognitive behavioral therapy program (MoodSwings Plus) (intervention group) compared to an online psychoeducation, mood tracking and discussion boards program (MoodSwings) (control group). The study reported that the intervention group showed significant reductions in self-assessed manic symptoms compared to the control group, but no difference was observed in relation to self-assessed depressive symptoms . The last study, by the authors, (n = 78) reported on a RCT investigating the effect of smartphone-based self-monitoring including a feedback loop to the clinicians (MONARCA) (intervention group) compared to a placebo smartphone and TAU (control group). The study reported no significant differences between the two groups in any of the defined outcomes. Sub-analyses showed that the intervention group had more depressive symptoms and fewer manic symptoms than the control group during the study period .
Risk of bias within individual studies
All of the included articles but one  included only outpatients. Notably only one of the longitudinal studies provided data on the patients who were excluded from participating in the study . Three of the six longitudinal studies reported on data collected with assessors who were blinded to the electronic self-monitoring data [55, 58, 59]. Thus, most included longitudinal studies were evaluated to be at risk of selection bias, performance bias and/or detection bias at some level.
One of the RCTs did not state whether the outcome assessors were blinded to randomization group and were therefore evaluated to be at risk of possible detection bias . Further to this point, given the nature of the intervention (the patients were unblinded to intervention) in the included RCTs none of the studies were double blinded, and therefore naturally all at risk of performance bias. Furthermore, three of the RCTs investigated the effect of different electronically delivered intervention programmes including mood self-monitoring on self-assessed outcome measures with no observer/researcher blinded outcome measures [60, 61, 63].
This is the first systematic review of the evidence of the validity of electronic mood self-monitoring tools using IT platforms as methods for assessing mood in adult patients with bipolar disorder compared with clinical rating scales for depression and mania. Further, the evidence of the effect of electronic mood self-monitoring tools on clinically relevant outcomes in RCTs was assessed. A total of 13 published articles were included. The included articles were heterogeneous, employing various monitoring IT platforms and included different clinically relevant outcomes.
Electronic self-monitored mood was found valid compared to clinical rating scales for depression in six out of six studies comprising a total of 179 outpatients [12, 54, 56, 58, 59, 64], but only two studies found a correlation between electronic self-monitored mood and a validated rating scale for mania [55, 64]. Thus, the present review suggests that despite different bias issues it seems possible for patients to validly evaluate the severity of their depressive symptoms, but specifically difficult to report emerging manic symptoms in a valid way and may be due to decreased illness insight during hypomania/mania . Furthermore, as mentioned most of the studies included only outpatients who did not present with severe levels/ high scores on clinical rating scales for depression and mania. The validity of the electronic self-monitoring tools may be both overestimated as well as underestimated disregarding the possible difficulty of self-monitoring the severity of symptoms in more severe cases.
The studies included describe convergent validity of electronic self-monitoring tools. Other variables such as activity level and sleep length could represent parameters for self-monitoring that may correlate with clinical rating scales for depression and mania, but content validity was not investigated in the present review. Further, the reliability and predictive validity of the electronic self-monitoring tools were not investigated in the present review.
Paper-based self-monitoring tools for depressive mood registered using different types of paper-based tools has been shown to significantly correlate with the scores on clinical rating scales for depression in a number of studies [7, 9, 71–73]. The severity of self-monitored manic mood has been shown to correlate with the scores of clinical rating scales for mania in a number of studies [8, 9, 74, 75], however, not in all studies . Further, other parameters such as activity level may correlate with the scores of clinical rating scales for mania . Two of the RCTs included researcher blinded validated clinical rating scales for depression and mania as outcomes [16, 62]. These studies could potentially investigate the validity of electronic mood self-monitored compared to clinical rating scales for depression and mania and thus further contribute to the knowledge in this area.
It should be mentioned that a paper by the authors analyzing the validity between mood self-monitoring and clinical rating scales for depression and mania has been accepted for publication . This study used a smartphone-based mood self-monitoring tool and found a significant correlation between self-monitored mood and validated ratings scales for both depression and mania, respectively.
Using electronic self-monitoring tools may offer solutions regarding issues of low compliance and potential recall bias that are present when using paper-based self-monitoring tools. However, the results presented in this review suggest that it seems difficult for patients to evaluate manic symptoms calling for other new and more objective real-time electronic methods to monitoring the severity of manic symptoms in patients with bipolar disorder.
To provide a more complete and inclusive picture of the scientific research on electronic self-monitoring the RCTs using electronic self-monitoring tools as a part of an intervention were evaluated. No study investigated the sole effect of electronic self-monitoring of mood as an intervention in itself, but investigated the effect of different electronically delivered intervention programmes with electronic self-monitoring of mood represented as part of the intervention. The evidence of the effect of electronic self-monitoring was limited by methodological issues and by a lack of RCTs. Notably, three of the RCTs investigating the effect of electronically delivered interventions did not report on any researcher blinded outcomes [60, 61, 63] and thus introduces bias issues on the validity of the results from these studies and introducing the risk of overestimating or underestimating the beneficial and harmful effects of the interventions. One RCT , by the authors, reported on potentially harmful effects of electronic self-monitoring with more depressive symptoms but fewer manic symptoms in the intervention group. A paper by Scott & Colom discuss the issues of a differential effectiveness of psychological interventions for manic and depressive phases , and points out that the reasons for these differential effects are not clear. Manic prodromes are more distinct and may be easier to detect and treat more quickly and effectively with pharmacotherapy than depressive episodes . On the contrary, depressive symptoms are more difficult to differentiate from normal day-to-day problems and may have a more gradual onset and prolonged duration . Considering electronic self-monitoring a psychological intervention, the potential harmful effects on depressive symptoms as suggested by the findings from the RCT by the authors  highlight that electronic self-monitoring should not be uncritically used or implemented in clinical practice and that important aspects need further clarification before it is implemented as a standard tool.
If there would be an effect of electronic self-monitoring on the severity of depressive or manic symptoms, then self-monitoring would influence the variables it measures (mood). Whether that would be a threat to the reliability and validity is unknown and should be investigated further.
In westerns countries nearly everyone has at least one device that would be able to handle electronic self-monitoring. The use of computers and/or tablets as tools for electronic self-monitoring of mood require some technical skills by the user and can be quite expensive to acquire. However, most people have access to a computer or tablet and know how to interact with simple software systems. Computers and tablets allow for storage and visual presentation of self-monitored data making recognition of symptom patterns possible, thus potentially providing tools for increasing the patients’ illness insight and empowerment. PDAs represent a tool that is possible for the patients to carry with them during the day making continuous real-time electronic self-monitoring in naturalistic settings is possible. However, when using a separate and non-standard electronic device for self-monitoring of illness activity the risk of stigmatization is present . Other electronic devices could replace PDAs as an electronic self-monitoring tool in the years to come. Unlike computers and PDAs, smartphones offer opportunities for continuous electronic self-monitoring in naturalistic environments that cannot be achieved using other types of IT platforms. Since most people carry their cell phone with them during most of the day and use it for communicative purposes through various platforms the risk of stigmatization is not present. Furthermore, the number of smartphone users worldwide has been estimated to reach 2.5 billion people by 2017  which makes smartphones an obvious tool for electronic self-monitoring.
Patients willing to participate in studies using these kinds of novel and technical electronic interventions could represent a more motivated and technically oriented group of patients with higher degree of illness insight and willingness to use the electronic self-monitoring tools in question. As can be seen from some of the included articles, compliance to self-monitoring was highly variable, and patients participating were quite young. Elucidation of possible technical barriers for using an electronic device for self-monitoring among non-technically oriented patient groups, perhaps in patients with higher age than in the included studies, could be of interest. In addition, future studies should provide more information on excluded patients and reasons for declining to participate in studies in order to allow the readers to better assess the level of generalizability of the study results.
None of the included studies provided information regarding the economical part of the development and maintenance of the electronic self-monitoring IT platforms, and is likely a relevant factor in the development of future efforts in this area as well as for the clinical implementation.
Some limitations to the present review should be mentioned. Telemedicine in general and e-mental health are areas under great expansion and the investigations in this area are published in very diverse forms and places reflecting that this is an research area in the intersection between two areas of research- medical research and IT research. Therefore, conducting a search strategy that is able to capture all relevant scientific literature is a challenge. A search on Google Scholar alone on electronic self-monitoring in bipolar disorder resulted in 595.000 hits. Many commercial websites and smartphone applications (for both Android, iOS and Windows) for electronic self-monitoring exist in the App store and the Google Play store. The search strategy for the present review reflects that we aimed at systematically collecting and reviewing published scientific studies in order to get an overview of the validity of electronic mood self-monitoring compared to validated clinical rating scales and the evidence status related to using these kinds of electronic self-monitoring tools.
Most of the included studies had a daily and momentary frequency of self-monitoring, but one study used a frequency of self-monitoring on a weekly basis. A recent paper discussed differences in momentary and retrospective trait self-report techniques pointing out that retrospective self-monitoring is influenced by peak moments with greater salience of moments that occur closets in time to the assessment .
The interventions of the included RCTs were heterogeneous and often mood self-monitoring was a part of an intervention, which incorporated mood self-monitoring alongside other psychological interventions. In addition, the RCTS employed various monitoring IT platforms and included different clinically relevant outcomes. Thus, comparing not only different mood self-monitoring tools but also different interventions as well as outcomes is a big challenge.
It should be noted that the authors did not have access to the various electronic self-monitoring tools reviewed apart from one of the tools for smartphones [16, 59]. Further, as pointed out by others  all of the self-monitoring tools are different from one another allowing for calculation of many different measures of illness activity and also making it difficult to compare findings across studies.
One author (MFJ) selected all papers and extracted all data, and one of the co-authors (KM) independently checked the extracted data.
It should also be noted that in most of the articles the patients had to provide the hardware for the electronic self-monitoring themselves and no information regarding economical compensation was given. None of the included articles provided information regarding the cost of developing and maintaining the electronic software and the amount of possible technical problems with the electronic self-monitoring systems. These aspects are likely relevant factors that should be evaluated in future studies.
It would be interesting to investigate the validity between electronic mood self-monitored and validated clinical rating scales for depression and mania and the effect of electronic self-monitoring as an intervention in a non-technically oriented group of patients with bipolar disorder, and further to elucidate these aspects during full-blown affective episodes.
This systematic review identified relatively few studies investigating IT platforms for electronic self-monitoring in adult patients with bipolar disorder. Electronic self-monitoring of mood in depression appears to be a valid measure of mood in contrast to self-monitoring of mood in mania. This calls for other new and more objective real-time electronic methods for monitoring the severity of manic symptoms.
The evidence of the effect of electronic self-monitoring tools investigated in RCTs was limited by methodological issues and, by small number of RCTs primarily investigating the effect of different electronically delivered intervention programmes. Crucially, the potential beneficial or harmful effect of electronic self-monitoring tools on clinically relevant researcher blinded outcomes has scarcely been investigated and is unknown. Whether electronic self-monitoring should be considered an instrument or as an intervention or both is unknown and future research should investigate this further.
There is a need for further research using rigorous methodology and more RCTs investigating the effect and economic consequences of electronic self-monitoring using different types of IT platforms in patients with bipolar disorder. Furthermore, future RCTs should elucidate possible harmful effects to inform whether the potential benefits are worth the costs and potential risks.
The study was funded by the EU, 7th Frame Program as part of the MONARCA study and the Mental Health Services in Copenhagen. The funders had no role in the study design, data collection, and interpretation of data and writing of the report.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- MacQueen GM, Marriott M, Begin H, Robb J, Joffe RT, Young LT. Subsyndromal symptoms assessed in longitudinal, prospective follow-up of a cohort of patients with bipolar disorder. Bipolar Disord. 2003;5:349–55.PubMedView ArticleGoogle Scholar
- Bonsall MB, Wallace-Hadrill SMA, Geddes JR, Goodwin GM, Holmes EA. Nonlinear time-series approaches in characterizing mood stability and mood instability in bipolar disorder. Proc Biol Sci. 2012;279:916–24.PubMedPubMed CentralView ArticleGoogle Scholar
- Judd LL, Schettler PJ, Akiskal HS, Maser J, Coryell W, Solomon D, et al. Long-term symptomatic status of bipolar I vs. bipolar II disorders. Int J Neuropsychopharmacol Off Sci J Coll Int Neuropsychopharmacol CINP. 2003;6:127–37.Google Scholar
- Joffe RT, MacQueen GM, Marriott M, Trevor Young L. A prospective, longitudinal study of percentage of time spent ill in patients with bipolar I or bipolar II disorders. Bipolar Disord. 2004;6:62–6.PubMedView ArticleGoogle Scholar
- Strejilevich SA, Martino DJ, Murru A, Teitelbaum J, Fassi G, Marengo E, et al. Mood instability and functional recovery in bipolar disorders. Acta Psychiatr Scand. 2013;128:194–202.PubMedView ArticleGoogle Scholar
- Leverich GS, Nolen WA, Rush AJ, McElroy SL, Keck PE, Denicoff KD, et al. The Stanley Foundation Bipolar Treatment Outcome Network. I. Longitudinal methodology. J Affect Disord. 2001;67:33–44.PubMedView ArticleGoogle Scholar
- Bauer MS, Crits-Christoph P, Ball WA, Dewees E, McAllister T, Alahi P, et al. Independent assessment of manic and depressive symptoms by self-rating. Scale characteristics and implications for the study of mania. Arch Gen Psychiatry. 1991;48:807–12.PubMedView ArticleGoogle Scholar
- Denicoff KD, Leverich GS, Nolen WA, Rush AJ, McElroy SL, Keck PE, et al. Validation of the prospective NIMH-Life-Chart Method (NIMH-LCM-p) for longitudinal assessment of bipolar illness. Psychol Med. 2000;30:1391–7.PubMedView ArticleGoogle Scholar
- Born C, Amann BL, Grunze H, Post RM, Schärer L. Saving time and money: a validation of the self ratings on the prospective NIMH life-chart method (NIMH-LCM). BMC Psychiatry. 2014;14:130.PubMedPubMed CentralView ArticleGoogle Scholar
- Kobak KA, Greist JH, Jefferson JW, Katzelnick DJ, Mundt JC. New technologies to improve clinical trials. J Clin Psychopharmacol. 2001;21:255–6.PubMedView ArticleGoogle Scholar
- Stone AA, Shiffman S, Schwartz JE, Broderick JE, Hufford MR. Patient compliance with paper and electronic diaries. Control Clin Trials. 2003;24:182–99.PubMedView ArticleGoogle Scholar
- Whybrow PC, Grof P, Gyulai L, Rasgon N, Glenn T, Bauer M. The electronic assessment of the longitudinal course of bipolar disorder: the ChronoRecord software. Pharmacopsychiatry. 2003;36 Suppl 3:S244–249.PubMedGoogle Scholar
- Conner TS, Barrett LF. Trends in ambulatory self-report: the role of momentary experience in psychosomatic medicine. Psychosom Med. 2012;74:327–37.PubMedPubMed CentralView ArticleGoogle Scholar
- Lal S, Adair CE. E-mental health: a rapid review of the literature. Psychiatr Serv Wash DC. 2014;65:24–32.View ArticleGoogle Scholar
- Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol. 2008;4:1–32.PubMedView ArticleGoogle Scholar
- Faurholt-Jepsen M, Frost M, Ritz C, Christensen EM, Jacoby AS, Mikkelsen RL, et al. Daily electronic self-monitoring in bipolar disorder using smartphones - the MONARCA I trial: a randomized, placebo-controlled, single-blind, parallel group trial. Psychol Med. 2015;45(13):2691–704.PubMedView ArticleGoogle Scholar
- Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62:1006–12.PubMedView ArticleGoogle Scholar
- Higgins J, Green S: Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available from www.cochrane-handbook.org. Accessed date July 2015.
- Simpson S, Barnes E, Griffiths E, Hood K, Cohen D, Craddock N, et al. The Bipolar Interactive Psychoeducation (BIPED) study: trial design and protocol. BMC Psychiatry. 2009;9:50.PubMedPubMed CentralView ArticleGoogle Scholar
- Prociow PA, Crowe JA. Towards personalised ambient monitoring of mental health via mobile technologies. Technol Health Care Off J Eur Soc Eng Med. 2010;18:275–84.Google Scholar
- Reilly-Harrington NA, DeBonis D, Leon AC, Sylvia L, Perlis R, Lewis D, et al. The interactive computer interview for mania. Bipolar Disord. 2010;12:521–7.PubMedPubMed CentralView ArticleGoogle Scholar
- Nicholas J, Proudfoot J, Parker G, Gillis I, Burckhardt R, Manicavasagar V, et al. The ins and outs of an online bipolar education program: a study of program attrition. J Med Internet Res. 2010;12(5):e57.PubMedPubMed CentralView ArticleGoogle Scholar
- Smith DJ, Griffiths E, Poole R, di Florio A, Barnes E, Kelly MJ, et al. Beating Bipolar: exploratory trial of a novel internet-based psychoeducational treatment for bipolar disorder. Bipolar Disord. 2011;13:571–7.PubMedView ArticleGoogle Scholar
- Miller CJ, Johnson SL, Eisner L. Assessment tools for adult bipolar disorder. Clin Psychol Publ Div Clin Psychol Am Psychol Assoc. 2009;16:188–201.Google Scholar
- Grünerbl A, Muaremi A, Osmani V, Bahle G, Ohler S, Tröster G, et al. Smartphone-based recognition of states and state changes in bipolar disorder patients. IEEE J Biomed Health Inform. 2015;19:140–8.PubMedView ArticleGoogle Scholar
- Potash JB. Electronic medical records: fast track to big data in bipolar disorder. Am J Psychiatry. 2015;172:310–1.PubMedView ArticleGoogle Scholar
- Castro VM, Minnier J, Murphy SN, Kohane I, Churchill SE, Gainer V, et al. Validation of electronic health record phenotyping of bipolar disorder cases and controls. Am J Psychiatry. 2015;172:363–72.PubMedView ArticleGoogle Scholar
- Murray G, Leitan ND, Berk M, Thomas N, Michalak E, Berk L, et al. Online mindfulness-based intervention for late-stage bipolar disorder: pilot evidence for feasibility and effectiveness. J Affect Disord. 2015;178:46–51.PubMedView ArticleGoogle Scholar
- Scharer LO, Hartweg V, Valerius G, Graf M, Hoern M, Biedermann C, et al. Life charts on a palmtop computer: first results of a feasibility study with an electronic diary for bipolar patients. Bipolar Disord. 2002;4 Suppl 1:107–8.PubMedView ArticleGoogle Scholar
- Scharer LO, Hartweg V, Hoern M, Graesslin Y, Strobl N, Frey S, et al. Electronic diary for bipolar patients. Neuropsychobiology. 2002;46 Suppl 1:10–2.PubMedGoogle Scholar
- Paradiso R, Bianchi AM, Lau K, Scilingo EP. PSYCHE: personalised monitoring systems for care in mental health. Conf Proc Annu Int Conf IEEE Eng Med Biol Soc IEEE Eng Med Biol Soc Conf. 2010;2010:3602–5.Google Scholar
- Barnes DC, Harvey R, Mitchell P, Smith M, Wilhelm K. Evaluation of an online relapse prevention program for bipolar disorder. Dis Manag Health Outcomes. 2007;15:215–24.View ArticleGoogle Scholar
- Malliaris Y. MyiMonitor.com v. 1: A user-friendly mobile electronic diary for bipolar patients. Ann Gen Psychiatry. 2010;9 Suppl 1:S12. Volume 2010. Thessaloniki, Greece.PubMed CentralView ArticleGoogle Scholar
- Todd NJ, Solis-Trapala I, Jones SH, Lobban FA. An online randomised controlled trial to assess the feasibility, acceptability and potential effectiveness of “Living with Bipolar”: a web-based self-management intervention for bipolar disorder: trial design and protocol. Contemp Clin Trials. 2012;33:679–88.PubMedView ArticleGoogle Scholar
- Andersen P-OB, Babic A. Mobile-supported life charting for bipolar patients - user requirements study. Stud Health Technol Inform. 2013;192:1111.PubMedGoogle Scholar
- Christensen H, Petrie K. State of the e-mental health field in Australia: where are we now? Aust N Z J Psychiatry. 2013;47:117–20.PubMedView ArticleGoogle Scholar
- Lauder S, Chester A, Castle D, Dodd S, Berk L, Klein B, et al. Development of an online intervention for bipolar disorder. Psychol Health Med. 2013;18:155–65. www.moodswings.net.au. Accessed date July 2015.PubMedView ArticleGoogle Scholar
- Faurholt-Jepsen M, Vinberg M, Christensen EM, Frost M, Bardram J, Kessing LV: Daily electronic self-monitoring of subjective and objective symptoms in bipolar disorder--the MONARCA trial protocol (MONitoring, treAtment and pRediCtion of bipolAr disorder episodes): a randomised controlled single-blind trial. BMJ Open 2013, 3. doi: 10.1136/bmjopen-2013-003353.
- Faurholt-Jepsen M, Vinberg M, Frost M, Christensen EM, Bardram J, Kessing LV. Daily electronic monitoring of subjective and objective measures of illness activity in bipolar disorder using smartphones– the MONARCA II trial protocol: a randomized controlled single-blind parallel-group trial. BMC Psychiatry. 2014;14:309.PubMedPubMed CentralView ArticleGoogle Scholar
- Hidalgo-Mazzei D, Mateu A, Reinares M, Undurraga J, Bonnín Cdel M, Sánchez-Moreno J, et al. Self-monitoring and psychoeducation in bipolar patients with a smart-phone application (SIMPLe) project: design, development and studies protocols. BMC Psychiatry. 2015;15:52.PubMedPubMed CentralView ArticleGoogle Scholar
- Lobban F, Dodd AL, Dagnan D, Diggle PJ, Griffiths M, Hollingsworth B, et al. Feasibility and acceptability of web-based enhanced relapse prevention for bipolar disorder (ERPonline): trial protocol. Contemp Clin Trials. 2015;41:100–9.PubMedView ArticleGoogle Scholar
- Donker T, Petrie K, Proudfoot J, Clarke J, Birch M-R, Christensen H. Smartphones for smarter delivery of mental health programs: a systematic review. J Med Internet Res. 2013;15:e247.PubMedPubMed CentralView ArticleGoogle Scholar
- Koenders MA, Nolen WA, Giltay EJ, Hoencamp E, Spijker AT. The use of the prospective NIMH Life Chart Method as a bipolar mood assessment method in research: a systematic review of different methods, outcome measures and interpretations. J Affect Disord. 2015;175:260–8.PubMedView ArticleGoogle Scholar
- Chinman M, Young AS, Schell T, Hassell J, Mintz J. Computer-assisted self-assessment in persons with severe mental illness. J Clin Psychiatry. 2004;65:1343–51.PubMedView ArticleGoogle Scholar
- Adli M, Whybrow PC, Grof P, Rasgon N, Gyulai L, Baethge C, et al. Use of polypharmacy and self-reported mood in outpatients with bipolar disorder. Int J Psychiatry Clin Pract. 2005;9:251–6.PubMedView ArticleGoogle Scholar
- Bauer M, Rasgon N, Grof P, Gyulai L, Glenn T, Whybrow PC. Does the use of an automated tool for self-reporting mood by patients with bipolar disorder bias the collected data? MedGenMed Medscape Gen Med. 2005;7:21.Google Scholar
- Bauer M, Grof P, Rasgon NL, Marsh W, Munoz RA, Sagduyu K, et al. Self-reported data from patients with bipolar disorder: impact on minimum episode length for hypomania. J Affect Disord. 2006;96:101–5.PubMedView ArticleGoogle Scholar
- Bauer M, Glenn T, Grof P, Pfennig A, Rasgon NL, Marsh W, et al. Self-reported data from patients with bipolar disorder: frequency of brief depression. J Affect Disord. 2007;101:227–33.PubMedView ArticleGoogle Scholar
- Husky MM, Gindre C, Mazure CM, Brebant C, Nolen-Hoeksema S, Sanacora G, et al. Computerized ambulatory monitoring in mood disorders: feasibility, compliance, and reactivity. Psychiatry Res. 2010;178:440–2.PubMedView ArticleGoogle Scholar
- Bopp JM, Miklowitz DJ, Goodwin GM, Stevens W, Rendell JM, Geddes JR. The longitudinal course of bipolar disorder as revealed through weekly text messaging: a feasibility study. Bipolar Disord. 2010;12:327–34.PubMedPubMed CentralView ArticleGoogle Scholar
- Lieberman DZ, Swayze S, Goodwin FK. An automated Internet application to help patients with bipolar disorder track social rhythm stabilization. Psychiatr Serv Wash DC. 2011;62:1267–9.View ArticleGoogle Scholar
- Moore PJ, Little MA, McSharry PE, Geddes JR, Goodwin GM. Forecasting depression in bipolar disorder. IEEE Trans Biomed Eng. 2012;59:2801–7.PubMedView ArticleGoogle Scholar
- Mutschler J, von Zitzewitz F, Rossler W, Grosshans M. Application of electronic diaries in patients with schizophrenia and bipolar disorders. Psychiatr Danub. 2012;24:206–10.PubMedGoogle Scholar
- Bauer M, Grof P, Gyulai L, Rasgon N, Glenn T, Whybrow PC. Using technology to improve longitudinal studies: self-reporting with ChronoRecord in bipolar disorder. Bipolar Disord. 2004;6:67–74.PubMedView ArticleGoogle Scholar
- Bauer M, Wilson T, Neuhaus K, Sasse J, Pfennig A, Lewitzka U, et al. Self-reporting software for bipolar disorder: validation of ChronoRecord by patients with mania. Psychiatry Res. 2008;159:359–66.PubMedView ArticleGoogle Scholar
- Depp CA, Mausbach B, Granholm E, Cardenas V, Ben-Zeev D, Patterson TL, et al. Mobile interventions for severe mental illness: design and preliminary data from three approaches. J Nerv Ment Dis. 2010;198:715–21.PubMedPubMed CentralView ArticleGoogle Scholar
- Lieberman DZ, Kelly TF, Douglas L, Goodwin FK. A randomized comparison of online and paper mood charts for people with bipolar disorder. J Affect Disord. 2010;124:85–9.PubMedView ArticleGoogle Scholar
- Depp CA, Kim DH, de Dios LV, Wang V, Ceglowski J. A pilot study of mood ratings captured by mobile phone versus paper-and-pencil mood charts in bipolar disorder. J Dual Diagn. 2012;8:326–32.PubMedPubMed CentralView ArticleGoogle Scholar
- Faurholt-Jepsen M, Frost M, Vinberg M, Christensen EM, Bardram JE, Kessing LV. Smartphone data as objective measures of bipolar disorder symptoms. Psychiatry Res. 2014;217:124–7.PubMedView ArticleGoogle Scholar
- Todd NJ, Jones SH, Hart A, Lobban FA. A web-based self-management intervention for Bipolar Disorder “living with bipolar”: a feasibility randomised controlled trial. J Affect Disord. 2014;169:21–9.PubMedView ArticleGoogle Scholar
- Barnes CW, Hadzi-Pavlovic D, Wilhelm K, Mitchell PB. A web-based preventive intervention program for bipolar disorder: outcome of a 12-months randomized controlled trial. J Affect Disord. 2015;174:485–92.PubMedView ArticleGoogle Scholar
- Depp CA, Ceglowski J, Wang VC, Yaghouti F, Mausbach BT, Thompson WK, et al. Augmenting psychoeducation with a mobile intervention for bipolar disorder: A randomized controlled trial. J Affect Disord. 2015;174:23–30.PubMedView ArticleGoogle Scholar
- Lauder S, Chester A, Castle D, Dodd S, Gliddon E, Berk L, et al. A randomized head to head trial of MoodSwings.net.au: An internet based self-help program for bipolar disorder. J Affect Disord. 2015;171:13–21.PubMedView ArticleGoogle Scholar
- Schärer LO, Krienke UJ, Graf S-M, Meltzer K, Langosch JM. Validation of life-charts documented with the personal life-chart app – a self-monitoring tool for bipolar disorder. BMC Psychiatry. 2015;15:49.PubMedPubMed CentralView ArticleGoogle Scholar
- Montgomery SA, Asberg M. A new depression scale designed to be sensitive to change. Br J Psychiatry J Ment Sci. 1979;134:382–9.View ArticleGoogle Scholar
- Hamilton M. Development of a rating scale for primary depressive illness. Br J Soc Clin Psychol. 1967;6:278–96.PubMedView ArticleGoogle Scholar
- Rush AJ, Gullion CM, Basco MR, Jarrett RB, Trivedi MH. The Inventory of Depressive Symptomatology (IDS): psychometric properties. Psychol Med. 1996;26:477–86.PubMedView ArticleGoogle Scholar
- Schärer LO, Hartweg V, Hoern M, Graesslin Y, Strobl N, Frey S, et al. Electronic diary for bipolar patients. Neuropsychobiology. 2002;46 Suppl 1:10–2.PubMedGoogle Scholar
- Young RC, Biggs JT, Ziegler VE, Meyer DA. A rating scale for mania: reliability, validity and sensitivity. Br J Psychiatry. 1978;133:429–35.PubMedView ArticleGoogle Scholar
- Depp CA, Harmell AL, Savla GN, Mausbach BT, Jeste DV, Palmer BW. A prospective study of the trajectories of clinical insight, affective symptoms, and cognitive ability in bipolar disorder. J Affect Disord. 2014;152–154:250–5.PubMedView ArticleGoogle Scholar
- Carroll BJ, Feinberg M, Smouse PE, Rawson SG, Greden JF. The Carroll rating scale for depression. I. Development, reliability and validation. Br J Psychiatry J Ment Sci. 1981;138:194–200.View ArticleGoogle Scholar
- Rush AJ, Trivedi MH, Ibrahim HM, Carmody TJ, Arnow B, Klein DN, et al. The 16-Item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression. Biol Psychiatry. 2003;54:573–83.PubMedView ArticleGoogle Scholar
- Denicoff KD, Smith-Jackson EE, Disney ER, Suddath RL, Leverich GS, Post RM. Preliminary evidence of the reliability and validity of the prospective life-chart methodology (LCM-p). J Psychiatr Res. 1997;31:593–603.PubMedView ArticleGoogle Scholar
- Shugar G, Schertzer S, Toner BB, Di Gasbarro I. Development, use, and factor analysis of a self-report inventory for mania. Compr Psychiatry. 1992;33:325–31.PubMedView ArticleGoogle Scholar
- Altman EG, Hedeker D, Peterson JL, Davis JM. The altman self-rating mania scale. Biol Psychiatry. 1997;42:948–55.PubMedView ArticleGoogle Scholar
- Faurholt-Jepsen M, Vinberg M, Frost M, Christensen EM, Bardram JE, Kessing LV. Smartphone data as an electronic biomarker of illness activity in bipolar disorder. Bipolar Disord. 2015;17:715–28.PubMedView ArticleGoogle Scholar
- Scott J, Colom F. Gaps and limitations of psychological interventions for bipolar disorders. Psychother Psychosom. 2008;77:4–11.PubMedView ArticleGoogle Scholar
- Perry A, Tarrier N, Morriss R, McCarthy E, Limb K. Randomised controlled trial of efficacy of teaching patients with bipolar disorder to identify early symptoms of relapse and obtain treatment. BMJ. 1999;318:149–53.PubMedPubMed CentralView ArticleGoogle Scholar
- Simon GE, Ludman EJ, Bauer MS, Unützer J, Operskalski B. Long-term effectiveness and cost of a systematic care program for bipolar disorder. Arch Gen Psychiatry. 2006;63:500–8.PubMedView ArticleGoogle Scholar
- Smartphone Users Worldwide Will Total 1.75 Billion in 2014 - eMarketer [http://www.emarketer.com/Article/Smartphone-Users-Worldwide-Will-Total-175-Billion-2014/1010536]. Accessed date July 2015.