- Research article
- Open Access
Patient-reported outcomes in major depressive disorder with suicidal ideation: a real-world data analysis using PatientsLikeMe platform
BMC Psychiatry volume 20, Article number: 384 (2020)
The current analysis utilized data collected via an online patient community platform, PatientsLikeMe (PLM) to compare patient-reported experiences in patients with major depressive disorder (MDD) with suicidal ideation (MDSI) to those with MDD but without suicidal ideation.
PLM members who joined PLM between May-2007 and February-2018 and reported a diagnosis of MDD were included. The MDSI cohort included patients with MDD who reported at least one suicide-related symptom at a severity greater than “none”. Demographics, comorbidities, symptoms, and side-effects were compared between MDSI and MDD cohorts. Factors correlated with suicidal ideation (SI) were determined by a random forest procedure.
Patients in the MDSI cohort (n = 266) were younger (median age, 36 vs 44 years) with an earlier disease onset (before 30 years, 83% vs 71%), and a longer diagnosis latency (median, 4 vs 2 years) vs patients in the MDD cohort (n = 11,963). Majority of patients were women in both cohorts (73% vs 83%). Median number of psychiatric comorbidities was higher in the MDSI cohort (4 vs 3). Unprompted symptoms (e.g., loneliness, feeling of hopelessness, social anxiety, impulsivity, and self-hating thoughts) were more frequent in the MDSI cohort. Hopelessness, loneliness, anhedonia, social anxiety, and younger age were highly correlated with suicidal ideation.
This analysis utilized patient-reported data to better understand symptoms, experiences, and characteristics of patients with MDSI compared to patients with MDD. The results identified various risk factors correlated with suicidal ideation that may help guide clinical judgement for patients with MDD who may not voluntarily report suicidal ideation.
Suicide is a major public health concern and is one of the leading causes of death worldwide . In the U.S., 47,000 deaths were reported in 2017 due to suicide. Of the 17.6 million patients with major depressive disorder (MDD), 5.5 million adults reported suicide ideation (SI) and 2 million patients reported SI with intent . In the same year, age adjusted suicide rate was 15.3 per 100,000 persons, considerably higher than the global rate of 10.5 per 100,000 persons [3, 4]. Notably, the highest prevalence of suicide is found in the most economically productive age group (15–44 years) . Moreover, examination of data of young adults aged 18–25 years from the National Surveys on Drug Use and Health (2009–2015) showed an increase in the 12-month prevalence of SI (6.1 to 8.3%), suicide plan (2.0 to 2.7%), and suicide attempt (1.1 to 1.6%) .
Suicidal behavior and ideation have a significant economic burden. In Europe, Jaffe et al.  reported SI to be associated with higher absenteeism, presenteeism, work productivity impairment, and activity impairment compared to individuals without SI. The burden of suicidal behavior and ideation extends to caregivers of individuals with SI, as they reported that the constant worry affected their social and occupational functioning . In addition to the traumatic, often unexpected loss of life, friends and family members of an individual who dies by suicide may face social isolation, stigma, and are at increased risk for depression-related mental illness, substance abuse, and suicide .
MDD is the mental health diagnosis most commonly associated with suicide. Globally, more than 60% of individuals who have attempted suicide struggle with MDD . Moreover, patients with MDD have a 20-fold higher risk of suicide than the general population . As the prevalence of SI is high among patients with MDD, understanding the characteristics that differ in patients with MDD and SI compared to those without SI is critical for early identification of high-risk patients .
Detection of SI, early diagnosis of depression, continuity of care and treatment adherence have been identified as critical to improve outcomes in patient with SI . Therefore, it is important to understand the patient perspective and the needs of this high-risk population to increase efficacy of suicide prevention strategies. Comorbid psychiatric conditions such as personality disorders, anxiety disorders, and substance use disorders are associated with an increased risk of suicide in patients with MDD [14,15,16,17]. Hence, the treatment plan should also feature concomitant treatment of the comorbid condition. In patients with comorbid substance use disorders, easing access to treatment, providing counseling, and social support in addition to the treatment of depression is recommended . However, as patients with SI are often excluded from most antidepressant trials, limited data are available to study their disease or treatment characteristics .
Online patient communities provide patients with a platform to share their disease and treatment experiences, which subsequently provide researchers with valuable data pertaining to patient reported outcomes, perspectives, and preferences . PatientsLikeMe (PLM) is one such global online community that provides patients with resources to record, track, and share their symptoms, disease experiences, and treatment outcomes, and to improve their care through peer-to-peer interactions. Patients are free to share as much or as little data as they want. PLM enables visualization of an individual’s health profile graphically as well as aggregates data into reports that are available on the website . The PLM community comprises > 775,000 patients overall from across the globe, with > 62,100 members reporting a diagnosis of MDD (as of 23rd May 2020) . In the present analysis, we utilized the data provided by PLM to characterize and compare the patient-reported characteristics and experiences of living with MDD with SI (MDSI group) to those with MDD but without SI (MDD group).
Retrospective data of adult patients (aged ≥18 years) who were members of the global PLM community, registered to the PLM website between May 2007 and February 2018, and reported a diagnosis of MDD were obtained. Although patients in the PLM community were not prompted to report any symptom related to SI, those patients who reported at least one SI-related symptom (“suicidal thoughts or urges,” “suicidal,” “depression with suicidal thoughts,” “SI,” “suicide attempt,” or “suicidal behavior”) at a severity greater than none were included in the MDSI cohort. Patients who reported an MDD diagnosis without any suicide-related symptoms were included in the MDD cohort. Patients who reported a primary diagnosis of bipolar disorder, borderline personality disorder, paranoid schizophrenia, Parkinson’s disease, post-traumatic stress disorder, psychosis disorder, psychotic depression, schizoaffective disorder, schizoid personality disorder, schizophrenia, or any life-threatening illness (e,g., cancer) in the PLM database were excluded (Supplementary Table 1). Patients with active or prior history of substance abuse/dependence were not excluded.
All assessments were performed based on the clinical, diagnostic, and treatment experiences reported by patients with MDD (with and without SI) on the PLM platform. Direct, spontaneous data reported by the patients were used and no validated instruments were employed for data collection. The data collected from patients were categorized into demographics, comorbid conditions, symptoms, and treatments. Demographic data of patients included age, sex, race/ethnicity, nationality, education level, and health insurance type, while comorbidities and condition-associated information included diagnosis status, onset date (date of first symptom), and diagnosis date. The prevalence of each comorbidity was also assessed.
Symptoms reported by the patients on the PLM platform were categorized into three groups: prompted general symptoms (pain, fatigue, insomnia, depressed mood, and anxious mood), MDD-specific symptoms (increased need for sleep, anhedonia, decreased/increased appetite, irritability, bradykinesia, and decreased sex drive), and spontaneously-reported symptoms (any symptom the patient wishes to report and track on their profile). Recording the severity of the five general symptoms was mandatory for patients with MDD on the PLM platform and severity reporting was also mandated for any MDD-specific or spontaneously reported symptoms the patient chose to include. Symptom severity was recorded on a subjective rating scale, by the patient, as none, mild, moderate, and severe.
All patients on the PLM platform who reported an MDD diagnosis were prompted to report whether they have ever been prescribed any of the following MDD-associated treatments: bupropion, citalopram, duloxetine, escitalopram, fluoxetine, sertraline, venlafaxine or individual therapy. Additionally, patients also provided treatment related details including treatment dose, start date, perceived effectiveness, side effects and their severity, and burden of treatment. Perceived treatment effectiveness was recorded on a subjective rating scale, by the patient, as “can’t tell,” “none,” “slight,” “moderate,” and “major,” while severity of side effects was rated as “none,” “mild,” “moderate,” and “severe.”
Patients were also encouraged to complete a mood map platform survey (PLM’s proprietary 25-item survey, which captured information that might reflect the patient’s current mood) as well as freely enter text in forums, treatment evaluation reports, and treatment stop reports.
Risk factors for suicidal ideation
We used a random forest classifier (RF) to determine the risk factors for SI in the study population. A RF is a data classification algorithm comprising multiple individual decision trees that operate as a group or ensemble. Each tree gives a class or variable prediction and the one with the most votes becomes the model’s prediction . RF has advantages over other data classification methodologies such as the ability to handle highly non-linearly correlated data, robustness to noise, tuning simplicity, and opportunity for efficient parallel processing . We developed and trained the RF model to predict whether a patient belongs to the MDSI cohort or MDD cohort. Demographic, comorbidity, symptom, and mood map variables were assessed to determine the most important characteristics in distinguishing the cohorts.
Descriptive statistics were used to summarize the data. Categorical variables were presented as frequency and numbers while continuous variables were presented as medians.
A chi-square test of independence was applied to compare sets of distributions, whereas a binomial test of proportions was used for pairwise comparison of binary proportions. Bonferroni correction was applied to control for potential Type I errors related to multiple comparisons. Variability around proportions was presented by 95% confidence intervals (CI). CIs of binary proportions were calculated using Clopper-Pearson method, which yields asymmetric upper and lower bounds that do not exceed 0 or 1.
Of the 12,229 PLM users with MDD who registered and provided data during the study period, 266 reported symptoms related to suicidality with a severity greater than none (MDSI cohort), and 11,963 reported never experiencing any of these symptoms (MDD cohort).
The majority of the patients in both cohorts were White (MDSI: 87.5% vs. MDD: 86.7%, p = 0.3158) and had completed at least high school (MDSI: 91% vs. MDD: 94%, p = 0.3606). Patients in the MDSI cohort compared to those in the MDD cohort were significantly younger (median age 36 years vs. 44 years, p < 0.0001), more frequently men (27.1% vs. 16.7%, p < 0.0001), and were less likely to report a family history of MDD (45.9% vs. 49.7%, p = 0.0003) (Table 1).
Onset date and diagnosis latency
A total of 129 (48.5%) patients in the MDSI cohort and 6440 (53.8%) patients in the MDD cohort reported their first symptom date, while the diagnosis date was reported by 121 (46.0%) and 5943 (49.7%) patients in the MDSI and MDD cohorts, respectively. The MDSI cohort included a significantly larger proportion of users reporting an age of onset < 30 years (83.0% vs. 71.2%, p = 0.001) and significantly longer median diagnosis latency compared to the MDD cohort (4 years vs. 2 years, p = 0.0002).
A total of 229 (86.1%) patients in the MDSI cohort and 8054 (67.3%) patients in the MDD cohort reported data on at least one comorbidity. The MDSI cohort reported a significantly greater median number of comorbidities than the MDD cohort (4 vs. 3, p < 0.0001). The top three comorbidities reported at a higher frequency in the MDSI cohort compared to the MDD cohort were generalized anxiety disorder (63.1%; 95% CI, 56.7–69.6% vs. 44.3%; 95% CI, 43.3–45.5%), social anxiety disorder (44.5%; 95% CI, 38.0–51.2% vs. 18.3%; 95% CI, 17.4–19.1%), and dysthymia (35.4%; 95% CI, 29.2–41.9% vs 17.7%; 95% CI, 16.9–18.6%) (p < 0.001 for all). However, the proportion of these comorbid conditions was relatively high in MDD cohort as well. Fibromyalgia was the only comorbidity that was reported significantly more in the MDD cohort than the MDSI cohort (31.0%; 95% CI, 30.0–32.0% vs. 9.6%; 95% CI, 6.1–14.2%, p < 0.001) (Fig. 1).
All patients (MDSI: 266, MDD: 11,963) included in the study reported at least one symptom. Pain was the only prompted symptom that showed a significant difference in reporting frequency after averaging patient reports over time (MDSI: 43.2%; 95% CI, 35.0–51.6% vs. MDD: 58.9%; 95% CI, 57.9–59.9%, p < 0.001) (Fig. 2a). However, comparison of worst-ever scoring for prompted symptoms showed a significantly greater reporting frequency of “high severity” in the MDSI cohort than the MDD cohort for anxious mood (88.8%; 95% CI, 83.6–92.9% vs. 70.6%; 95% CI, 69.7–71.5%, p < 0.0001), depressed mood (94.4%; 95% CI, 90.3–97.2% vs. 78.0%; 95% CI, 77.1–78.8%, p < 0.0001), and fatigue (89.5; 95% CI, 84.5–93.3% vs. 81.6%; 95% CI, 80.8–82.3%, p < 0.01) (Fig. 2b).
No significant differences were observed between the two groups in the reporting frequency of MDD-specific symptoms after averaging patient reports over time (Fig. 2c). However, when the worst-ever scores were considered, significantly greater reporting frequency of “high severity” was observed in the MDSI cohort compared to the MDD cohort for anhedonia (76.9%; 95% CI, 69.2–83.6% vs. 54.6%; 95% CI, 53.5–55.7%, p < 0.0001) and irritability (84.0%; 95% CI, 75.0–90.8% vs. 67.8%; 95% CI, 65.2–70.3%, p < 0.001) (Fig. 2d). The prompted and MDD-specific symptoms’ results are supported by the mood map analysis. While symptom severities between the cohorts are similar when averaged over time (Supplementary Figure 1A), certain symptoms including depressed or anxious mood and irritability, do increase in severity when patients are at their worst (Supplementary Figure 1B).
Spontaneous symptom reporting frequency was significantly greater in the MDSI cohort compared to the MDD cohort for symptoms including panic attack (27.1%; 95% CI, 21.8–32.8% vs. 7.5%; 95% CI, 7.0–8.0%), restlessness (26.6%; 95% CI, 20.4–31.3% vs. 12.3%; 95% CI, 11.7–12.9%), memory problems (25.2%; 95% CI, 20.1–30.9% vs. 6.3%; 95% CI, 5.8–6.7%), loneliness (24.1%; 95% CI, 19.1–29.7% vs. 1.1%; 95% CI, 0.96–1.34%, p < 0.0001 for all), and persistent worry (24.1%; 95% CI, 19.1–29.7% vs. 12.3%; 95% CI, 11.8–12.9%, p < 0.001) (Fig. 3).
A total of 243 (91.4%) patients in the MDSI cohort and 10,951 (91.5%) patients in the MDD cohort reported receiving ≥1 treatment during the observational period. The MDSI cohort reported intake of more antidepressant treatments than the MDD cohort (mean values: 3 vs. 2.4). The five most reported treatments were sertraline (36.6%), bupropion (36.6%), fluoxetine (35.8%), venlafaxine (32.9%), and citalopram (31.3%) in the MDSI cohort, and bupropion (38.3%), fluoxetine (34.2%), sertraline (33.4%), duloxetine (32.0%), and venlafaxine (30.9%) in the MDD cohort.
Treatment’s perceived effectiveness
The proportion of patients who reported “moderate to major perceived effectiveness” with commonly prescribed antidepressant treatments was higher in the MDD cohort compared with the MDSI cohort. The MDSI cohort experienced the lowest perceived effectiveness for citalopram (25.0% vs. 52.0%), venlafaxine (35.0% vs. 66.0%), and duloxetine (40.0% vs. 60.0%) (Fig. 4a).
Treatment burden and side-effects
A total of 134 (50.4%) patients in the MDSI cohort and 3070 (25.7%) patients in the MDD cohort reported data for treatment burden and side-effects. Patients in the MDSI cohort more frequently reported side-effects with duloxetine (78.0% vs. 37.0%), citalopram (52.0% vs 30.0%), and bupropion (36.0% vs. 25.0%) compared to those in the MDD cohort. Similar trends were observed for side effects with other treatments (Fig. 4b).
The proportion of patients rating antidepressant treatments as “somewhat to very” burdensome was greater in the MDSI cohort compared to the MDD cohort for sertraline (14.0% vs. 10.0%), venlafaxine (24.0% vs. 14.0%), citalopram (20.0% vs. 12.0%), and duloxetine (22.0% vs. 12.0%); but lesser compared to the MDD cohort for bupropion (8.0% vs. 9.0%), fluoxetine (0% vs. 11.0%), and escitalopram (8.0% vs. 12.0%).
Risk factors for suicidal ideation
A RF classifier determined the risk factors for SI by predicting whether a patient belonged to the MDSI or MDD cohort. Each variable or feature was assigned an importance value to determine ranking. Variables include demographic characteristics, comorbidities, prompted and unprompted symptoms, and mood map items. Supplementary Figure 2 shows the receiver operating characteristic curve of the RF model. According to the feature importance values obtained from the classifier, feelings of hopelessness (importance value: 0.09 [standard deviation: 0.04]), loneliness (0.08 [0.04]), anhedonia (0.06 [0.04]), social anxiety (0.05 [0.03]) and age (0.04 [0.01]) were the top five predictors of SI in patients diagnosed with MDD in the PLM platform (Fig. 5).
Retrospective analysis of patient-reported data from the PLM depression community showed patients with MDSI are younger, have more comorbidities and higher symptom severity, and experience lower treatment effectiveness but higher treatment side effects.
Among patients with MDD, our results indicated a greater proportion of SI among young adults, with almost 50% of the MDSI cohort being below 35 years of age; as well as among males and patients with a family history of MDD. These findings are consistent with earlier reports and WHO-provided suicide rate data for the US [3, 6, 24]. Han et al.  evaluated data of young adults aged 18–25 years from the National Surveys on Drug Use and Health (2009–2015) and reported the mean 2009–2015 annual prevalence of SI among patients with a major depressive episode (MDE) in the US to be 37.3%. Prevalence of SI differs depending on the type of reporting method used. The higher prevalence of SI among 18–25 year old patients in the Han et al. study  (37.3%) compared to the MDSI cohort of the present study (28.2%) is probably driven by the difference in reporting method (prompted national survey vs. voluntary web-based platform). In the present study, reporting of SI was anonymous, but patients were not prompted to report any SI-related symptom. Other factors influencing the difference in prevalence of SI could be the larger sample size (n = 145,800 vs. n = 12,229), age difference (only young adults [18–25 years] vs. all age groups [median age 36 years]), and confirmation of depression (MDE based on DSM-IV vs. self-reported diagnosis of MDD). In line with previous surveys [6, 25,26,27], the present study reported a greater proportion of women reporting diagnosis of MDD than men regardless of presence of SI.
The greater proportion of young adults in the MDSI cohort was associated with reduced age of onset for depression in this cohort compared to the MDD cohort (< 20 years of age, 72.1% vs. 49.1%). Previous studies have also associated SI with a young age of onset for depression [28,29,30,31,32]. Patients with MDD may be exposed to a greater risk of SI if they do not receive early treatment for MDD . Studies have shown that longer duration of untreated MDD is a critical risk factor for SI in patients. Hence, early screening, diagnosis, and treatment of MDD may contribute to reducing the risk of SI . A novel finding of the current study is that patients in the MDSI cohort reported longer median diagnosis latency than the MDD cohort (4 vs. 2 years), which could be attributed to the lack of mental healthcare-seeking pattern in patients with SI [35, 36] leading to delays in diagnosis and treatment initiation.
In the current study, 68% of the patients reported at least one comorbidity, with the MDSI cohort reporting more comorbidities than the MDD cohort. Additionally, patients with MDSI experienced more comorbid anxiety and substance use disorders than the MDD cohort. These findings were consistent with previous research showing a positive association between number of comorbidities and SI [26, 37, 38]. Furthermore, anxiety and substance use disorder were found to be independent risk factors for suicide and pose a higher risk of suicide attempts [17, 26, 39,40,41].
Previous research has shown a robust association between depression symptom severity and SI. Two different studies assessed outpatient data employing different methodologies and reported a significant relationship between baseline depression severity and SI [31, 42]. We evaluated symptoms using a three-pronged approach (prompted, MDD-specific, and spontaneous) to enable comprehensive assessment in a standardized manner and obtained similar results. The MDSI cohort exhibited greater prompted and MDD-specific symptom severity (anxious or depressed mood, anhedonia, and irritability), as well as spontaneous patient-reported symptoms pertaining to social isolation, hopelessness, and self-hating thoughts compared to the MDD cohort. These symptoms have been associated with SI previously . However, the symptom severity in the MDSI cohort was greater only at their worst, and not when averaged over time. This unique finding may highlight a specific pattern of symptom evolution in patients with SI. In combination with treatment of depression; patients with SI may require regular tracking of symptom severity; a therapeutic strategy to reduce symptoms at their peak including emotion regulation psychotherapy; and easy access to crisis intervention units when the mitigation strategies fail to control SI. Assessment of depression severity and treatment efficacy in patients with SI needs to focus not only on the average severity but also on the symptom’s maximum severity. Use of digital assessment tools would help patients to report and collect symptoms’ severity data at their peak. However, currently available apps often lack clinical reliability requirements .
A greater number of patients in the MDSI cohort experienced severe side effects, lower antidepressant effectiveness, and greater burden from antidepressant use compared to the MDD cohort. The aforementioned outcomes may be interlinked and affect each other. The low perceived treatment effectiveness in the MDSI cohort may be correlated with increased side effect severity; however, such associations were not evaluated. Although patients with MDD and SI require consistent treatment engagement to tackle the complex neuropsychological interplay at hand, their needs to achieve this goal are often unmet due to multiple factors including low adherence to treatment and follow-up . Hence, understanding the patient’s perspective and expectation about treatment is critical to increase patient involvement and continuity of care.
The present study identified young age and feelings of hopelessness, loneliness, anhedonia, and social anxiety to be significantly associated with SI in patients diagnosed with MDD. These risk factors are consistent with previous studies across geographies that employed varying methodologies [27, 45,46,47,48,49]. This result also ties in with the current study’s mood map analysis, which demonstrated increased symptom severity in the MDSI cohort compared to the MDD cohort only during their worse symptom report. Current research continues to look for predictors of suicidal behavior such as biological markers, psychosocial factors and disease characteristics amongst others to improve screening and identification of patients at risk for suicidal behavior. Patient-reported experiences, such as what is available through PLM, allow us to examine associations between various patient characteristics with suicidal behavior from the perspective of the patient. As such, they provide additional data compared to clinician-reported outcomes and add the spontaneously reported patient perspective.
The concept of using online platforms and apps designed for patients with MDD to track their mood has been reported previously . Online communities such as PLM can provide a safe space for individuals who might not receive the support they require from friends, family, and healthcare providers. Moreover, these platforms provide tools to encourage patients to be active and involved in their disease management, thus giving them a sense of control. These benefits have been documented in patients with epilepsy [51, 52]. Sharing symptom and side effect-related information on such platforms may also help in informed decision-making, further benefitting the patient via improved outcomes. Finally, data collected through an online platform provides researchers a different set of information, collected either prospectively or retrospectively, and offers direct access to the patients’ perspective.
The stress-diathesis model acknowledges that suicidal ideation and behavior is the result of a complex pattern of biological and psychological risk factors combined with personal experiences and stressors. The current study showed patients with MDD and SI struggle with more comorbidities and have a different perception of treatment effectiveness and burden. These factors require a tailored approach that may increase adherence to treatment. Critical strategies to improve outcomes in patients with MDD and SI include: screening and detection of high-risk patients; early initiation of pharmacological treatment of MDD in accordance with treatment guidelines [53,54,55,56]; psychotherapy specifically designed to enhance patient engagement and manage emotions [15, 16, 57]; and finally, information about on-demand crisis intervention resources to support the patient.
Although standardized methods are routinely utilized for data collection, these methods may not be able to collect spontaneous patient perception data, which is important to bridge the gap between patient perception and evidence. The patient-reported data collected in PLM is of great value to gain access to patient perspectives without the filter of standardized assessment. However, this method is associated with uncertainty regarding their validity and reliability. The cross-sectional nature of this study is also a limitation, as causality cannot be interpreted from the data. Therefore, associations between outcomes such as treatment effectiveness, side effect severity, and burden were not assessed. The requirement for internet access as well as technical competency to engage with the platform may also give rise to bias, as patients with chronic disease often lack these skills . Moreover, participation bias is a concern as research has shown only ~ 1% of members create content, 9% contribute sparingly, and 90% merely observe . However, platforms like PLM do not mandate recording data but rather encourage the patient to take steps gradually. Hence, this limitation is due to the open nature of PLM. Finally, although this study is based on data obtained from a real-world setting, the sample may represent members who differ from the general population.
The current study highlights that the MDSI population reports worse depressive symptoms, more comorbidities, and lesser perceived effectiveness of antidepressant treatments compared to the MDD population without SI. The current study also demonstrates differences in how patients with MDSI report on their disease experiences which may point to specificities in the psychopathology of MDD in patients with SI compared to MDD patients without SI. Given many of these results are consistent with that obtained from prior, standardized, clinician-rated assessments, this study supports the use of patient-reported data and provides additional information regarding patient perspectives and internal experiences that may be missed with traditional assessments. Further research is required to better understand patient perspectives and identify key leverage points to improve patient satisfaction and clinical outcomes in patients with MDD and SI.
Availability of data and materials
All the relevant data has been reported in the manuscript. Additional data could be obtained from the authors with an appropriate request.
Major depressive episode
Major depressive disorder
Major depressive disorder with suicidal ideation
Yoshimasu K, Kiyohara C, Miyashita K. and The Stress Research Group of The Japanese Society for Hygiene. Suicidal risk factors and completed suicide: meta-analyses based on psychological autopsy studies. Environ Health Prev Med. 2008;13(5):243–56.
Administration. SAaMHS. Key substance use and mental health indicators in the United States: Results from the 2018 National Survey on Drug Use and Health. In: HHS Publication No PEP19–5068, NSDUH Series H-54. Rockville: Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration; 2019.
World Health Statistics data visualizations dashboard. Available at http://apps.who.int/gho/data/node.sdg.3-4-data?lang=en. Accessed 20 June 2020.
Global Health Observatory (GHO) data. Available at https://www.who.int/gho/mental_health/suicide_rates/en/. Accessed 20 June 2020.
Mental health-suicide data. Available at http://www.who.int/mental-health/prevention/suicide/suicideprevent/en/. Accessed 20 June 2020.
Han B, Compton WM, Blanco C, Colpe L, Huang L, McKeon R. National Trends in the prevalence of suicidal ideation and behavior among young adults and receipt of mental health care among suicidal young adults. J Am Acad Child Adolesc Psychiatry. 2018;57(1):20–7 e22.
Jaffe DH, Rive B, Denee TR. The burden of suicidal ideation across Europe: a cross-sectional survey in five countries. Neuropsychiatr Dis Treat. 2019;15:2257–71.
McLaughlin C, McGowan I, O'Neill S, Kernohan G. The burden of living with and caring for a suicidal family member. J Ment Health. 2014;23(5):236–40.
Pompili M, Shrivastava A, Serafini G, Innamorati M, Milelli M, Erbuto D, et al. Bereavement after the suicide of a significant other. Indian J Psychiatry. 2013;55(3):256–63.
Nock MK, Hwang I, Sampson N, Kessler RC, Angermeyer M, Beautrais A, et al. Cross-national analysis of the associations among mental disorders and suicidal behavior: findings from the WHO world mental health surveys. PLoS Med. 2009;6(8):e1000123.
Xin LM, Chen L, Su YA, Yang FD, Wang G, Fang YR, et al. Risk factors for recent suicide attempts in major depressive disorder patients in China: results from a National Study. Front Psychiatry. 2018;9:300.
Holma KM, Melartin TK, Haukka J, Holma IA, Sokero TP, Isometsa ET. Incidence and predictors of suicide attempts in DSM-IV major depressive disorder: a five-year prospective study. Am J Psychiatry. 2010;167(7):801–8.
Knesper DJ. Continuity of Care for Suicide Prevention and Research: suicide attempts and suicide deaths subsequent to discharge from the emergency department or psychiatry inpatient unit. Newton: Education Development Center, Inc; 2010.
Isometsa E. Suicidal behaviour in mood disorders--who, when, and why? Can J Psychiatr. 2014;59(3):120–30.
Maruti S, Desjardins I, Bagge CL, Althoff RR. Commentary: opioid use disorder and suicide: an important opportunity to address two significant public health epidemics. Prev Med. 2019;128:105854.
Bohnert ASB, Ilgen MA. Understanding links among opioid use, overdose, and suicide. Reply. N Engl J Med. 2019;380(14):1380.
Olfson M, Crystal S, Wall M, Wang S, Liu SM, Blanco C. Causes of death after nonfatal opioid overdose. JAMA Psychiatry. 2018;75(8):820–7.
Ballard ED, Snider SL, Nugent AC, Luckenbaugh DA, Park L, Zarate CA Jr. Active suicidal ideation during clinical antidepressant trials. Psychiatry Res. 2017;257:303–8.
Solberg LB. The benefits of online health communities. Virtual Mentor. 2014;16(4):270–4.
Wicks P, Massagli M, Frost J, Brownstein C, Okun S, Vaughan T, et al. Sharing health data for better outcomes on PatientsLikeMe. J Med Internet Res. 2010;12(2):e19.
PatientsLikeMe. Available at https://www.patientslikeme.com/patients/searches/detail_search. Accessed 20 June 2020.
Understanding Random Forest: How the Algorithm Works and Why it Is So Effective. Available at https://towardsdatascience.com/understanding-random-forest-58381e0602d2. Accessed 20 June 2020.
Caruana R, Niculescu-Mizil A. An Empirical Comparison of Supervised Learning Algorithms. In: Proceedings of the 23rd International Conference on Machine Learning (ICML '06). New York: ACM Press; 2006. p. 161–8.
Fergusson DM, Beautrais AL, Horwood LJ. Vulnerability and resiliency to suicidal behaviours in young people. Psychol Med. 2003;33(1):61–73.
Kessler RC, Borges G, Walters EE. Prevalence of and risk factors for lifetime suicide attempts in the National Comorbidity Survey. Arch Gen Psychiatry. 1999;56(7):617–26.
Nock MK, Borges G, Bromet EJ, Alonso J, Angermeyer M, Beautrais A, et al. Cross-national prevalence and risk factors for suicidal ideation, plans and attempts. Br J Psychiatry. 2008;192(2):98–105.
Han B, McKeon R, Gfroerer J. Suicidal ideation among community-dwelling adults in the United States. Am J Public Health. 2014;104(3):488–97.
Handley T, Rich J, Davies K, Lewin T, Kelly B. The challenges of predicting suicidal thoughts and behaviours in a sample of rural Australians with depression. Int J Environ Res Public Health. 2018;15(5):928.
Korczak DJ, Goldstein BI. Childhood onset major depressive disorder: course of illness and psychiatric comorbidity in a community sample. J Pediatr. 2009;155(1):118–23.
Williams JM, Barnhofer T, Crane C, Duggan DS, Shah D, Brennan K, et al. Pre-adult onset and patterns of suicidality in patients with a history of recurrent depression. J Affect Disord. 2012;138(1–2):173–9.
Trivedi MH, Morris DW, Wisniewski SR, Nierenberg AA, Gaynes BN, Kurian BT, et al. Clinical and sociodemographic characteristics associated with suicidal ideation in depressed outpatients. Can J Psychiatr. 2013;58(2):113–22.
Zhu Y, Zhang H, Shi S, Gao J, Li Y, Tao M, et al. Suicidal risk factors of recurrent major depression in Han Chinese women. PLoS One. 2013;8(11):e80030.
Rice SM, Simmons MB, Bailey AP, Parker AG, Hetrick SE, Davey CG, et al. Development of practice principles for the management of ongoing suicidal ideation in young people diagnosed with major depressive disorder. SAGE Open Med. 2014;2:2050312114559574.
Kraus C, Kadriu B, Lanzenberger R, Zarate CA Jr, Kasper S. Prognosis and improved outcomes in major depression: a review. Transl Psychiatry. 2019;9(1):127.
McCarty CA, Russo J, Grossman DC, Katon W, Rockhill C, McCauley E, et al. Adolescents with suicidal ideation: health care use and functioning. Acad Pediatr. 2011;11(5):422–6.
Wong J, Brownson C, Rutkowski L, Nguyen CP, Becker MS. A mediation model of professional psychological help seeking for suicide ideation among Asian American and white American college students. Arch Suicide Res. 2014;18(3):259–73.
Cavanagh JT, Carson AJ, Sharpe M, Lawrie SM. Psychological autopsy studies of suicide: a systematic review. Psychol Med. 2003;33(3):395–405.
Holmstrand C, Bogren M, Mattisson C, Bradvik L. Long-term suicide risk in no, one or more mental disorders: the Lundby study 1947-1997. Acta Psychiatr Scand. 2015;132(6):459–69.
Brezo J, Paris J, Tremblay R, Vitaro F, Hebert M, Turecki G. Identifying correlates of suicide attempts in suicidal ideators: a population-based study. Psychol Med. 2007;37(11):1551–62.
Borges G, Nock MK, Haro Abad JM, Hwang I, Sampson NA, Alonso J, et al. Twelve-month prevalence of and risk factors for suicide attempts in the World Health Organization world mental health surveys. J Clin Psychiatry. 2010;71(12):1617–28.
May AM, Klonsky ED, Klein DN. Predicting future suicide attempts among depressed suicide ideators: a 10-year longitudinal study. J Psychiatr Res. 2012;46(7):946–52.
Valuck RJ, Anderson HO, Libby AM, Brandt E, Bryan C, Allen RR, et al. Enhancing electronic health record measurement of depression severity and suicide ideation: a distributed ambulatory research in therapeutics network (DARTNet) study. J Am Board Fam Med. 2012;25(5):582–93.
Martinengo L, Van Galen L, Lum E, Kowalski M, Subramaniam M, Car J. Suicide prevention and depression apps' suicide risk assessment and management: a systematic assessment of adherence to clinical guidelines. BMC Med. 2019;17(1):231.
Sansone RA, Sansone LA. Antidepressant adherence: are patients taking their medications? Innov Clin Neurosci. 2012;9(5–6):41–6.
Wang YY, Jiang NZ, Cheung EF, Sun HW, Chan RC. Role of depression severity and impulsivity in the relationship between hopelessness and suicidal ideation in patients with major depressive disorder. J Affect Disord. 2015;183:83–9.
Hawes M, Galynker I, Barzilay S, Yaseen ZS. Anhedonia and suicidal thoughts and behaviors in psychiatric outpatients: the role of acuity. Depress Anxiety. 2018;35(12):1218–27.
Spijker J, de Graaf R, Ten Have M, Nolen WA, Speckens A. Predictors of suicidality in depressive spectrum disorders in the general population: results of the Netherlands mental health survey and incidence study. Soc Psychiatry Psychiatr Epidemiol. 2010;45(5):513–21.
Beutel ME, Klein EM, Brahler E, Reiner I, Junger C, Michal M, et al. Loneliness in the general population: prevalence, determinants and relations to mental health. BMC Psychiatry. 2017;17(1):97.
Teo AR, Marsh HE, Forsberg CW, Nicolaidis C, Chen JI, Newsom J, et al. Loneliness is closely associated with depression outcomes and suicidal ideation among military veterans in primary care. J Affect Disord. 2018;230:42–9.
Caldeira C, Chen Y, Chan L, Pham V, Chen Y, Zheng K. Mobile apps for mood tracking: an analysis of features and user reviews. AMIA Annu Symp Proc. 2017;2017:495–504.
Cramer JA, Steinborn B, Striano P, Hlinkova L, Bergmann A, Bacos I, et al. Non-interventional surveillance study of adverse events in patients with epilepsy. Acta Neurol Scand. 2011;124(1):13–21.
Wicks P, Keininger DL, Massagli MP, de la Loge C, Brownstein C, Isojarvi J, et al. Perceived benefits of sharing health data between people with epilepsy on an online platform. Epilepsy Behav. 2012;23(1):16–23.
Pompili M. Critical appraisal of major depression with suicidal ideation. Ann General Psychiatry. 2019;18:7.
Kennedy SH, Lam RW, McIntyre RS, Tourjman SV, Bhat V, Blier P, et al. Canadian network for mood and anxiety treatments (CANMAT) 2016 clinical guidelines for the Management of Adults with major depressive disorder: section 3. Pharmacological Treatments. Can J Psychiatry. 2016;61(9):540–60.
Practice Guideline for the Treatment of Patients with Major Depressive Disorder, Third edn. Washington, DC: American Psychiatric Association; 2010.
VA/DoD Clinical Practice Guideline for the Management of Major Depressive Disorder: Department of Veterans Affairs and Department of Defense; 2016. Available at https://www.healthquality.va.gov/guidelines/MH/mdd/VADoDMDDCPGFINAL82916.pdf. Accessed 20 June 2020.
Okolie C, Dennis M, Simon Thomas E, John A. A systematic review of interventions to prevent suicidal behaviors and reduce suicidal ideation in older people. Int Psychogeriatr. 2017;29(11):1801–24.
Fox SP, K. Chronic disease and the internet. Washington DC: Pew Research Center; 2010.
van Mierlo T. The 1% rule in four digital health social networks: an observational study. J Med Internet Res. 2014;16(2):e33.
The authors thank Leo J. Philip Tharappel and Rishabh Pandey, PhD (SIRO Clinpharm Pvt. Ltd.) for medical writing support and Ellen Baum, PhD (Janssen Global Services, LLC) for editorial support.
A poster was presented at the American Psychiatric Association: 2019 Annual Meeting. San Francisco, May 18–22, 2019.
This study was sponsored by Janssen Research & Development, LLC. The funder did not have any role in the design of the study, collection, analysis, and interpretation of data and in drafting the manuscript.
Ethics approval and consent to participate
The study protocol was exempted from review by the New England Independent Review Board. Users consented to research as per PLM’s user policy when they signed up for PLM.
Consent for publication
Authors provide consent to publish data reported in the present manuscript.
All authors are employees of Janssen Research & Development, LLC.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1: Supplementary Figure 1.
Mood Map analysis of reported symptoms. (A) Mood map average over time (B) Mood map highest ever severity
Additional file 2: Supplementary Figure 2.
Receiver operating characteristic curve of the random forest model
Additional file 3: Supplementary Table 1.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Borentain, S., Nash, A.I., Dayal, R. et al. Patient-reported outcomes in major depressive disorder with suicidal ideation: a real-world data analysis using PatientsLikeMe platform. BMC Psychiatry 20, 384 (2020). https://doi.org/10.1186/s12888-020-02758-y
- Major depressive disorder
- Major depressive disorder with suicidal ideation
- Suicidal ideation