Skip to main content

Feasibility and acceptability of a novel telepsychiatry-delivered precision prescribing intervention for anxiety and depression

Abstract

Background

Major Depressive Disorder and Generalized Anxiety Disorder are pervasive and debilitating conditions, though treatment is often inaccessible and based on trial-and-error prescribing methods. The present observational study seeks to describe the use of a proprietary precision prescribing algorithm piloted during routine clinical practice as part of Brightside’s telepsychiatry services. The primary aim is to determine the feasibility and acceptability of implementing this intervention. Secondary aims include exploring remission and symptom improvement rates.

Methods

Participants were adult patients enrolled in Brightside who completed at least 12 weeks of treatment for depression and/or anxiety and received a prescription for at least one psychiatric medication. A prescription recommendation was made by Brightside’s algorithm at treatment onset and was utilized for clinical decision support. Participants received baseline screening surveys of the PHQ-9 and GAD-7, and at weeks 2,4,6,8,10 and 12. Intent-to-treat (ITT) sensitivity analyses were conducted. Feasibility of the implementation was measured by the platform’s ability to enroll and engage participants in timely psychiatric care, as well as offer high touch-point treatment options. Acceptability was measured by patient responses to a 5-star satisfaction rating.

Results

Brightside accessed and treated 6248 patients from October 2018 to April 2021, treating a majority of patients within 4-days of enrollment. The average plan cost was $115/month. 89% of participants utilized Brightside’s core medication plan at a cost of $95/month. 13.4% of patients in the study rated Brightside’s services as highly satisfactory, averaging a 4.6-star rating. Furthermore, 90% of 6248 patients experienced a MCID in PHQ-9 or GAD-7 score. Remission rates were 75% (final PHQ-9 or GAD-7 score < 10) for the study sample and 59% for the ITT sample. 69.3% of Brightside patients were treated with the medication initially prescribed at intake.

Conclusions

Results suggest that the present intervention may be feasible and acceptable within the assessed population. Exploratory analyses suggest that Brightside’s course of treatment, guided by precision recommendations, improved patients’ symptoms of anxiety and depression.

Peer Review reports

Background

Major Depressive Disorder (MDD) is one of the leading causes of disability in the United States that affects more than 16.1 million adults each year [1], though only 65% of people suffering from depression receive treatment [2]. Often co-occurring with depression, Generalized Anxiety Disorder (GAD) is also a pervasive and debilitating condition affecting 6.8 million adults nationally, yet only about 43% of individuals receive treatment [1]. While a significant number of adults suffer from mental health problems like anxiety and depression in the United States, only some receive adequate care, with reported barriers to seeking treatment contributing to an unmet need for accessible, quality care options. Key barriers to receiving care that can account for this treatment gap include lack of health insurance and financial resources, limited availability of providers, transportation difficulties, stigma, cultural competencies, and distress associated with having a psychological impairment [3,4,5]. Importantly, many of these barriers involve structural difficulties to accessing mental health services, such as lack of safe infrastructure and commute options, shortage of hospitals and licensed specialty providers [6, 7]. Research has shown that specialty care tends to be concentrated to urban, populated areas, often isolating rural communities from evidence-based treatment options and rendering them out of reach [6, 7]. This disparity is highlighted by findings that while the gold standard of psychiatric treatment for mental health disorders includes measurement-based psychiatric care with regular follow-ups, optimizing ongoing treatment decisions based on individualized outcomes [8], the majority of people with anxiety and/or depression in the United States are treated in an unspecialized primary care setting with medication management [9]. Many primary care providers in rural treatment settings report a significant unmet need for increased access to evidence-based treatment modalities and specialized psychiatry services [10].

Over the last two decades, a rich literature has evolved outlining the promise of digital mental health care options like telepsychiatry that can help eliminate structural barriers to evidence-based care [11,12,13,14,15,16,17,18,19,20,21].Telepsychiatry refers to the use of electronic communication to provide psychiatric care at a distance, rather than through an in-person meeting between patient and provider [11]. Research has shown that the innovation of telehealth has helped to eliminate physical and geographical barriers to evidence-based treatment, even offering a centralized, digital workspace for psychiatric providers to collaborate across great distances [22,23,24]. Studies also suggest that telepsychiatry treatments for anxiety [16] and depression [14] may be beneficial, offering lower attrition rates than those observed in traditional in-person care. These data underscore telepsychiatry as an accessible and effective treatment delivery option with the potential to increase widespread availability of evidence-based mental health care.

Particularly during the COVID-19 pandemic, a period marked by unprecedented structural barriers to care across patient demographic lines, telepsychiatry services have seen extraordinary popularity and growth, with governments and organizations across the globe encouraging the use of telepsychiatry services to offer imminent and continued access to services [25]. As providers closed their brick-and-mortar locations in an attempt to reduce infection risk, many were forced to realize the full potential of digital tools amid rising demand from individuals affected by anxiety, grief, fear of contamination, isolative depression during quarantine, and socioeconomic impacts that have marked life during the COVID-19 pandemic [26]. Accordingly, leveraging this surge in acceptance and utility of digital health platforms has largely been seen as an opportunity for the field to expand access to evidence-based mental health care [26].

As mental health platforms and applications have become more prevalent, multiple studies have been conducted to assess their efficacy in the treatment of psychiatric illness, particularly depression and anxiety disorders. Meta-analysis of these studies has demonstrated that patients using mobile applications showed greater improvement in symptoms than controls, with the effect greater when compared to inactive control conditions [27, 28]. Many of these mobile applications empower patients by providing them with the ability to track their progress, thus become an active participant in their treatment. Applications may also serve as useful tools for symptom monitoring, thereby facilitating early identification of risk, and mitigating negative psychiatric outcomes [29].

For those who do have access to and receive evidence-based psychiatric care, several factors highlight the need for a more precise means of treatment selection that expands on current standards for patients with anxiety and depression. At present, only about 50% of psychiatric drug treatment choices are successful [30]. Unlike most medical fields to date, modern psychiatric practice largely remains based on subjective symptoms and observations charted throughout the patient-provider relationship [31, 32]. As such, traditional symptom-only based categories, like those constructed in the DSM-5 and ICD-10 manuals, exclude biological validity, lending such models to a level of heterogeneity [31, 32]. There exists a critical need for personalization of treatment within psychiatry, by means of selecting treatments that are effective and avoiding those that may not serve a particular patient.

Precision medicine has shown promise as a method for optimizing treatment selection to improve outcomes and manage complex disease states. Precision medicine relies on “treatments targeted to the needs of individual patients on the basis of genetic, biomarker, phenotypic, or psychosocial characteristics that distinguish a given patient from other patients with similar clinical presentations.” [33] Recent advances in precision medicine have significantly changed diagnosis and treatment in areas such as oncology with clinicians now being able to take into account patients’ individual clinical and biological characteristics to inform clinical decision making [34]. The use of precision medicine in psychiatry is in its early stages compared to other medical fields [35], but there is promising early evidence for a paradigm shift toward more individualized diagnosis. For example, in the Sequenced Treatment Alternatives to Relieve Depression (STAR*D) study, it was found that risk for treatment-resistance among those with major depressive disorder can be predicted using various demographic and patient-reported clinical features (e.g., insomnia, psychosis, etc) [36].

In particular, research from the U.S. National Institute of Mental Health’s “precision medicine for psychiatry” project suggests that building a more precise psychiatric framework beyond current diagnostic categories can predict key outcome measures [37]. Utilizing Research Domain Criteria (RDoC), researchers have deconstructed diagnostic groups into biologically meaningful subgroups of mood disorders that have biological validity, though importantly, these subgroups do not map neatly onto existing psychiatric symptom clusters [38]. These insights suggest that empirically clustering patient symptoms and biological information beyond traditional models has potential for clinical utility.

More recently, the field of precision psychiatry has begun exploring the potential of advanced analytic methods, such as machine learning, to predict clinically useful treatment determinations [38]. Machine learning refers to the use of algorithmic methods to identify general data principles underlying a set of analytical observations without specific instructions, characterized by mining knowledge from Big data and limited formal assumptions, allowing the data to be self-explanatory [38]. Using data derived from the STAR*D study, machine learning algorithms were assessed alongside logistical regression methods to determine the automated potential of a variety of clinical variables to predict treatment resistance to antidepressants [36]. Both methods showed comparable ability to predict treatment resistance to depression across datasets [36]. Specifically, a logistic regression model achieved an area under the receiver operating characteristic curve (AUC) of 0.72 across cohorts, using demographic and patient-reported clinical factors (like insomnia, psychosis, etc), thereby providing clinicians with a useful clinical-decision support tool.

Many such algorithms have been incorporated into decision support (CDS) tools to assist providers in treating depression in making choices about the best clinical approach, with demonstrated efficacy in depression outcomes in primary care and general practices [39,40,41]. For example, the Texas Medication Algorithm Project (TMAP) [42] was developed as a CDS to incorporate treatment guidelines, based on the empirical literature and expert opinion, for use in primary care. While initially in paper and pencil format, a computerized decision support system was developed for TMAP and found to be superior to usual care [40].

Given the promise of telemental health care delivery, decision-support, and precision psychiatry methods for providing accessible, quality treatment of depression and anxiety, Brightside Health Inc. developed a proprietary precision prescribing algorithm, leveraging digital clinical decision support based on patient symptom clusters and existing research literature. The use of this algorithm has been piloted via telepsychiatry for large-scale clinical care across the United States. The primary goal of this study was to determine the feasibility and acceptability of implementing this algorithm in a virtual clinical setting. We also sought to calculate remission and symptom improvement rates. We hypothesized that the Brightside intervention would be feasible and acceptable within the defined population.

Methods

Participants

The Brightside dataset was constructed from the total population of patients receiving psychiatric care for depression and/or anxiety from Brightside during the period of October 2018 through April 2021. This included only Brightside members receiving psychiatric (and not psychotherapy) services, with a primary diagnosis of depression and/or anxiety, and a positive screen (10+) for depression or anxiety as measured by the Patient Health Questionnaire-9 (PHQ-9) or the Generalized Anxiety Disorder (GAD-7) questionnaire upon intake. Patients were included in the study if they had a minimum of 12 weeks of survey data and received a prescription for at least one psychiatric medication during that time. Patients were excluded if they had psychosis, schizophrenia, or bipolar 1 disorder, or chronic health conditions that would require active lab monitoring (e.g., chronic liver or kidney disease). The number of participants assessed for eligibility and the final sample are presented in Fig. 1. Intent-to-treat (ITT) sensitivity analyses were completed, which included participants excluded because they either cancelled their Brightside treatment plan before the completion of 12 weeks, or they provided incomplete data (i.e., less than 12 weeks).

Fig. 1
figure 1

Eligible and ineligible participants

Procedure

The WCG Institutional Review Board approved this retrospective protocol. Brightside’s telemental health platform offers psychiatric services via a web-based interface, using a measurement-based approach to track outcomes and provide clinical decision support to clinical providers. The Brightside platform provides this decision support via a computerized symptom cluster analysis (see symptoms clusters in Table 5) at treatment intake. Based on analysis of presenting symptom clusters, as well as decision support based on the empirical literature, treatment recommendations are provided. After treatment begins, patients are monitored via the platform using the PHQ-9, GAD-7 and other proprietary questions to track progress and surface concerns to the treating provider. Providers are alerted in real time when patients fail to improve, worsen, or experience symptoms such as suicidal ideation. Brightside providers, most of whom were primary care physicians at the time of this study, communicate with their patients both asynchronously via electronic messaging and synchronously via live video sessions. Precision prescribing, coupled with measurement-based follow-up, all delivered via telehealth, differentiates Brightside care.

Brightside clinicians prescribe from a wide array of psychotropic medications. Treatment recommendations can include over 300 different prescription combinations (see Table 1 for the initial prescription categories of the study sample). The focus of this study is on Brightside’s psychiatric and medication services, though Brightside also offers psychothearapy.

Table 1 Initial prescription medication classes of study sample

Surveys of the PHQ-9 and GAD-7 were administered digitally through an email prompt at baseline before the start of treatment, and then at 2,4,6,8,10, and 12 weeks. Clinical touchpoints included synchronous video consults, asynchronous provider messages sent and received, case-reviews and completed surveys. Survey completion at start and endline of study were required for participation. Endline surveys were collected at week 12, or within a 4-week buffer period after week 12 if the participant did not submit one exactly at week 12. At 4–8 weeks after initiation of treatment, participants were prompted by Brightside to rate their satisfaction with the platform’s services.

Measures

The feasibility of implementing Brightside’s precision prescribing algorithm via telepsychiatry as part of routine clinical practice was measured by the platform’s ability to enroll and engage participants in timely, cost-effective psychiatric care, as well as offer dynamic, high touch-point treatment options throughout the duration of the study. Acceptability of Brightside’s methodology was examined by patient responses to a 5-star, Likert satisfaction scale with the prompt, “how satisfied were you with Brightside’s services?” One star represented unsatisfied and five stars represented very satisfied. The PHQ-9 is a 9-question self-report measure of depressive symptom severity. Respondents rate each item on a four-point Likert scale (0–3) with total scores ranging from 0 to 27 (higher scores reflect greater depression severity). The PHQ-9 demonstrates strong reliability and validity with 88% sensitivity and 88% specificity for major depressive disorder (MDD) [43]. It is sensitive to antidepressant response [44].

The GAD-7 is a 7-item self-report measure of Generalized Anxiety Disorder (GAD) symptoms with a four-point Likert scale and a total score ranging from 0 to 21. Like the PHQ-9, a higher score corresponds to a greater anxiety severity. The GAD-7 has good psychometric properties with 89% sensitivity and 82% specificity for GAD [45, 46].

Based on response to intake questions, Brightside patients are categorized by symptom clusters, and one or more symptom clusters are surfaced to the clinician. These include severe melancholic depression, presence of anxious distress, atypical features of depression, prominent anxiety, insomnia, presence of chronic pain, cardiovascular risk factors, pregnancy or breastfeeding, or prior success with a medication trial.

Data analyses were performed using SPSS to assemble the patient data sample, apply inclusion and exclusion criteria and establish baseline versus endline survey outcomes. Brightside maintains de-identified SQL databases for analytics that facilitate granular insights into clinical decisions, interactions and outcomes. Specifically, the key outcomes computed included the proportion of patients experiencing a minimal clinically important difference (MCID) in PHQ-9 (5+ point reduction) [47] and/or GAD-7 (4+ point reduction) [48] scores and the proportion of patients achieving remission with a < 10 score on PHQ-9 and/or GAD-7 after starting with corresponding baseline score of 10 or greater.

Results

A total of 6248 patients were enrolled in Brightside from October 2018 to April 2021 and completed at least 12-weeks of treatment with Brightside (Table 2). As can be seen in Table 2, there were statistically significant, but negligible differences between the study sample and those who were ineligible. The study sample contained 5% more white participants. Patients averaged 3.7 days from the time of enrollment to first appointment (50.8% of patients were treated within 48 hours of enrollment, 68.7% within 72 hours, 78.9% within 96 hours.) Study patients experienced an average of 15.5 clinical touchpoints throughout the 12-week study period, which included synchronous video consults, asynchronous provider messages sent and received, case-reviews and check-in surveys. 13.4% of patients in this study submitted a review of their experience with Brightside’s services, with an average rating of 4.6 stars. Of those that submitted a review, 72.5% rated their experience with 5-stars.

Table 2 Demographic characteristics of study and ineligible samples

Study patients skewed female, with 71% identifying as female, and saw the greatest proportion of patients in the 25–34-year-old age bracket with a mean age of 31.6 years (Table 2). Approximately 80% of study patients identified as White (Table 2). Income levels of patients varied; 31% of the patients earned less than $30,000 income per year (Table 2).

Mean PHQ-9 score at baseline was 17.9. PHQ-9 and GAD-7 scores are presented in Table 3. Mean PHQ-9 and GAD-7 scores across all 12 weeks are presented in Fig. 2. The depressive severity seen in study participants as measured by baseline PHQ-9 was distributed as 4% mild, 20% moderate, 37% moderate-severe, and 39% severe. The ineligible group had similar scores at baseline (Table 3), but there was significantly greater change in the study sample, and significantly lower scores at 12 weeks, both with medium effect sizes [50].

Table 3 Survey means (standard deviation) by group
Fig. 2
figure 2

Mean PHQ-9 and GAD-7 scores over 12-week study period

90% of study patients experienced a minimally clinically important reduction (MCID) from baseline to 12 weeks (Table 3), as compared to 61% of those who were ineligible. 81% of study patients experienced a minimally clinically important reduction (MCID) on the PHQ-9 from baseline to 12 weeks (Table 3). Of the patients achieving remission at 12 weeks, 65% of patients achieved remission by 28 days, and 82% by 48 days (Table 4). Mean time to remission was 31 days. Remission rates were 75% as measured by a final PHQ-9 or GAD-7 score below 10, and remission rates were 63% as measured by a final PHQ-9 score below 10 (Table 4). There were significant differences in MCID and remission rates between the study sample and those who were ineligible. Symptom clusters associated with highest rates of remission were anxiety, insomnia and core emotional features of depression (Table 5). Symptom clusters associated with lower rates of remission were severe melancholic subtypes, presence of chronic pain, anxious distress subtypes, and atypical features (Table 5).

Table 4 Frequency of MCID and remission outcomes at endline
Table 5 Symptom cluster overview

Brightside study patients in the study received over 1000 medication/dose combinations, and more than half of patients had at least 1 medication adjustment within the study period. Using a symptom cluster approach and data driven clinical decision support, 69.3% of Brightside study patients were treated with the medication initially prescribed at intake (irrespective of medication dosage), whereas 30.7% required further iteration of their treatment plan with an augmentation strategy or switch.

Discussion

Telepsychiatry has shown promise as an emerging solution for inhibited access to quality psychiatric care in the United States. Additionally, leveraging precision prescribing to deliver large-scale precision psychiatry insights has demonstrated progress as a means of advancing traditional and often heterogeneous psychiatric prescribing methods.

The present analysis sought to investigate the feasibility and acceptability of a proprietary precision prescribing algorithm via telepsychiatry for large-scale, routine clinical care for anxiety and depression across the United States. We also sought to explore the potential effectiveness of this algorithm to identify appropriate courses of treatment at onset and subsequently assess associated symptom improvement and remission rates.

Ultimately, Brightside was able to treat 6248 patients from October 2018 to April 2021, a period that included an unprecedented period of structural access to psychiatric care as a result of the COVID-19 pandemic. There were not appreciable differences between those who completed 12 weeks of treatment and those who did not. The platform was able to provide timely psychiatric care, treating a majority of patients within 4-days of enrollment, as compared to evidence gathered across three major cities in the United States that suggests average wait times for psychiatry appointments can be an average of 25 days [51]. Furthermore, 89% of participants paid $95 per month for psychiatric services as compared to a higher average cost for an initial psychiatric evaluation plus follow-up. This rate compares favorably to Ruskin et al.’s [52] estimated marginal costs of $86.16 for a single telepsychiatry session. The estimated cost of one month of in-person psychiatry services is about $600 [53]. The cost of telepsychiatry is widely debated and discussed with various ways of calculating potential cost savings [54, 55].

Of the Brightside study sample, 90% of study patients (and 74% of the ITT sample) experienced a minimally clinically important reduction (MCID) from baseline to 12 weeks. The mean change of − 9.6 on the PHQ-9 compares favorably to a mean change of − 7.5 in the Improving Mood-Promoting Access to Collaborative Care (IMPACT) cohort over the same time period [47]. Remission rates were 75% as measured by a final PHQ-9 or GAD-7 score below 10, and 59% in the overall ITT sample. These rates compare favorably to a remission rate of 28% in the initial 14 weeks of treatment in the STAR*D trial with generally milder depression [56], though a different outcome measure was used in that study. Clinical trials for depression report remission rates of 22 to 40%, while studies including representative samples of depressed patients more similar to those seen in actual clinical practice report lower remission rates of 11 to 30% [57]. Clearly, the Brightside study sample, whether inclusive of those who dropped out or not, fared well relative to these historical numbers. There were significant differences in MCID and remission rates between the study sample and those who were ineligible, with medium effect sizes. As the ineligible group included a large portion (64%) who received at least some treatment, these effect sizes are likely an underestimate of the true treatment effect.

Remission rate is particularly important because those who achieve remission with treatment will likely have higher functioning [58] and improved prognosis [59], relative to non-remitters, over time, though further follow-up will be needed to assess whether the remission is sustained in the Brightside patients.

Though only 13% of patients provided satisfaction data, the average rating was 4.6 stars, with 72.5% rating their experience with 5-stars. Ruskin et al. [52] similarly reported overall good satisfaction (i.e., ‘agree’ to ‘strongly agree’) with their telepsychiatry platform. In general, patients report high satisfaction with telepsychiatry services [22, 60], with particularly high ratings for financial and accessibility/convenience [61]. A recent review of depression trials found that satisfaction with telepsychiatry was equivalent to or significantly higher than to face-to-face [62]. Our low response rate overall, however, with only 15% of participants responding, tempers our ability to draw conclusions regarding satisfaction with the Brightside platform.

Results of the current study should be considered in light of its design limitations. Importantly, the current investigation was not a clinical trial. As such, conclusions cannot be drawn regarding the effectiveness of Brightside’s precision prescribing method as a stand-alone treatment method for reducing symptoms of anxiety and depression. Along the same vein, this study lacks a control group to compare the outcomes of Brightside patients to outcomes of patients treated with standard of care. Furthermore, while patients receiving psychotherapy services through Brightside were excluded to prevent introducing a confounding variable, it is unknown if patients were receiving psychotherapy independent of the platform.

The present study also contains key biases, such as self-selection bias, as patients independently seek out care. Survivorship bias. This sample also biases results toward a majority White female population, revealing challenges recruiting a sample with wider race and sex diversity, although socioeconomic status showed notable variance. Lastly, information about marital status was unknown, so it was not possible to determine whether married participants fared better in our sample, as research has previously shown [63]. These biases limit the generalizability of the present study’s findings.

This study also utilized a patient-reported tool, the PHQ-9, to measure patient symptoms of depression over the course of treatment and did not utilize a clinician-reported measurement tool such as the Hamilton Depression Rating Scale (HDRS)  [64]. It is important to note that the PHQ-9 is a brief measure of depression symptoms that is commonly used in clinical practice. While the HDRS is the measure typically used in clinical trials, its length is prohibitive in real-world clinical settings. Further, research has shown that patients’ reports of their own symptoms are generally very similar to clinician-reported measures of symptoms [65].

Conclusions

These results suggest that Brightside’s intervention may be feasible within the defined population. Brightside was also well received among users. When given the opportunity to rate their experience with Brightside, a majority of patients submitted a 5-star review. Furthermore, as most patients were treated using the medication initially prescribed by Brightside’s prescribing algorithm, preliminary findings suggest that Brightside’s course of treatment may have improved patients’ symptoms of anxiety and depression.

Future study should utilize a randomized controlled trial or wait-list control group to assess the effectiveness of Brightside’s precision prescribing method, including strong measures of baseline sociodemographic and clinical characteristics, exploring potential mediators of treatment outcome.

Availability of data and materials

The datasets analyzed for the current study are available from the corresponding author on reasonable request.

Abbreviations

DSM-5:

Diagnostic and Statistical Manual of Mental Disorders, Edition 5

GAD-7:

Generalized Anxiety Disorder Scale, 7-item instrument

GBDT:

Gradient Boosting Decision Tree

HRSD:

Hamilton Rating Scale for Depression

ICD-10:

International Classification of Diseases, Edition 10

MCID:

Minimally Clinically Important Differences

MDD:

Major Depressive Disorder

PHQ-9:

Patient Health Questionnaire, 9-item instrument

RDoC:

Research Domain Criteria

STAR*D:

Sequenced Treatment Alternatives to Relieve Depression Study

SQL:

Structured Query Language

References

  1. Anxiety and Depression Association of America. Facts and Statistics. 2021 [cited 2021 September 2]; Available from: https://adaa.org/understanding-anxiety/facts-statistics.

    Google Scholar 

  2. National Institute of Mental Health. Major Depression. 2021 [cited 2021 December 16]; Available from: https://www.nimh.nih.gov/health/statistics/major-depression.

    Google Scholar 

  3. Collins KA, et al. Gaps in accessing treatment for anxiety and depression: challenges for the delivery of care. Clin Psychol Rev. 2004;24(5):583–616.

    Article  PubMed  Google Scholar 

  4. Mojtabai R, et al. Barriers to mental health treatment: results from the National Comorbidity Survey Replication. Psychol Med. 2011;41(8):1751–61.

    Article  CAS  PubMed  Google Scholar 

  5. Walker ER, et al. Insurance status, use of mental health services, and unmet need for mental health care in the United States. Psychiatr Serv. 2015;66(6):578–84.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Bull CN, et al. Access and issues of equity in remote/rural areas. J Rural Health. 2001;17(4):356–9.

    Article  CAS  PubMed  Google Scholar 

  7. Koran LM. Psychiatrists' distribution across the 50 states, 1978. Arch Gen Psychiatry. 1981;38(10):1155–9.

    Article  CAS  PubMed  Google Scholar 

  8. Guo T, et al. Measurement-based care versus standard Care for Major Depression: a randomized controlled trial with blind raters. Am J Psychiatry. 2015;172(10):1004–13.

    Article  PubMed  Google Scholar 

  9. Colorafi K, Vanselow J, Nelson T. Treating anxiety and depression in primary care: reducing barriers to access. Fam Pract Manag. 2017;24(4):11–6.

    PubMed  Google Scholar 

  10. Jameson JP, Blank MB. The role of clinical psychology in rural mental health services: defining problems and developing solutions. Clin Psychol Sci Pract. 2007;14(3):283–98.

    Article  Google Scholar 

  11. Drago A, Winding TN, Antypa N. Videoconferencing in psychiatry, a meta-analysis of assessment and treatment. Eur Psychiatry. 2016;36:29–37.

    Article  CAS  PubMed  Google Scholar 

  12. Gros DF, et al. Delivery of evidence-based psychotherapy via video telehealth. J Psychopathol Behav Assess. 2013;35(4):506–21.

    Article  Google Scholar 

  13. Hariman K, Ventriglio A, Bhugra D. The future of digital psychiatry. Curr Psychiatry Rep. 2019;21(9):88.

    Article  PubMed  Google Scholar 

  14. Mohr DC, et al. Effect of telephone-administered vs face-to-face cognitive behavioral therapy on adherence to therapy and depression outcomes among primary care patients: a randomized trial. JAMA. 2012;307(21):2278–85.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther. 2009;38(4):196–205.

    Article  PubMed  Google Scholar 

  16. Brenes GA, et al. A randomized controlled trial of telephone-delivered cognitive-behavioral therapy for late-life anxiety disorders. Am J Geriatr Psychiatry. 2012;20(8):707–16.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Christensen H, Reynolds J, Griffiths KM. The use of e-health applications for anxiety and depression in young people: challenges and solutions. Early Interv Psychiatry. 2011;5(Suppl 1):58–62.

    Article  PubMed  Google Scholar 

  18. Reger MA, Gahm GA. A meta-analysis of the effects of internet- and computer-based cognitive-behavioral treatments for anxiety. J Clin Psychol. 2009;65(1):53–75.

    Article  PubMed  Google Scholar 

  19. Carlbring P, Andersson G. Internet and psychological treatment. How well can they be combined? Comput Hum Behav. 2006;22(3):545–53.

    Article  Google Scholar 

  20. Newman MG, et al. A review of technology-assisted self-help and minimal contact therapies for anxiety and depression: is human contact necessary for therapeutic efficacy? Clin Psychol Rev. 2011;31(1):89–103.

    Article  PubMed  Google Scholar 

  21. Proudfoot JG. Computer-based treatment for anxiety and depression: is it feasible? Is it effective? Neurosci Biobehav Rev. 2004;28(3):353–63.

    Article  PubMed  Google Scholar 

  22. Chong J, Moreno F. Feasibility and acceptability of clinic-based telepsychiatry for low-income Hispanic primary care patients. Telemed J E Health. 2012;18(4):297–304.

    Article  PubMed  Google Scholar 

  23. Chung-Do J, et al. Rural mental health: implications for telepsychiatry in clinical service, workforce development, and organizational capacity. Telemed J E Health. 2012;18(3):244–6.

    Article  PubMed  Google Scholar 

  24. Deslich S, et al. Telepsychiatry in the 21(st) century: transforming healthcare with technology. Perspect Health Inf Manag. 2013;10:1f.

    PubMed  PubMed Central  Google Scholar 

  25. Psychiatry Online. Telepsychiatry and Health Technologies. [cited 2021 September 16]; Available from: https://html5-player.libsyn.com/embed/episode/id/9829475/height/90/theme/custom/thumbnail/yes/direction/forward/render-playlist/no/custom-color/003399/.

  26. Wind TR, et al. The COVID-19 pandemic: the ‘black swan’ for mental health care and a turning point for e-health. Internet Interv. 2020;20:100317.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Firth J, et al. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry. 2017;16(3):287–98.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Lecomte T, et al. Mobile apps for mental health issues: Meta-review of Meta-analyses. JMIR Mhealth Uhealth. 2020;8(5):e17458.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Betthauser LM, et al. Mobile app for mental health monitoring and clinical outreach in veterans: mixed methods feasibility and acceptability study. J Med Internet Res. 2020;22(8):e15506.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Wong EH, et al. Challenges and opportunities for drug discovery in psychiatric disorders: the drug hunters' perspective. Int J Neuropsychopharmacol. 2010;13(9):1269–84.

    Article  PubMed  Google Scholar 

  31. Hyman SE. Can neuroscience be integrated into the DSM-V? Nat Rev Neurosci. 2007;8(9):725–32.

    Article  CAS  PubMed  Google Scholar 

  32. Insel TR, Cuthbert BN, Medicine. Brain disorders? Precisely. Science. 2015;348(6234):499–500.

    Article  CAS  PubMed  Google Scholar 

  33. Jameson JL, Longo DL. Precision medicine--personalized, problematic, and promising. N Engl J Med. 2015;372(23):2229–34.

    Article  CAS  PubMed  Google Scholar 

  34. AJMC. How Advances in Precision Oncology Are Shaping a New Diagnostic and Treatment Frontier. Perspectives in Precision Oncology 2019 [cited 2021 September 16]; Available from: https://www.ajmc.com/view/how-advances-in-precision-oncology-new-diagnostic-and-treatment-frontier.

    Google Scholar 

  35. Alda M. Personalized psychiatry: many questions, fewer answers. J Psychiatry Neurosci. 2013;38(6):363–5.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Perlis RH. A clinical risk stratification tool for predicting treatment resistance in major depressive disorder. Biol Psychiatry. 2013;74(1):7–14.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Insel T, et al. Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am J Psychiatry. 2010;167(7):748–51.

    Article  PubMed  Google Scholar 

  38. Bzdok D, Meyer-Lindenberg A. Machine learning for precision psychiatry: opportunities and challenges. Biol Psychiatry Cogn Neurosci Neuroimaging. 2018;3(3):223–30.

    PubMed  Google Scholar 

  39. Balestrieri M, et al. Effectiveness of clinical decision support systems and telemedicine on outcomes of depression: a cluster randomized trial in general practice. Fam Pract. 2020;37(6):731–7.

    Article  PubMed  Google Scholar 

  40. Kurian BT, et al. A computerized decision support system for depression in primary care. Prim Care Companion J Clin Psychiatry. 2009;11(4):140–6.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Trivedi MH, et al. Clinical results for patients with major depressive disorder in the Texas medication algorithm project. Arch Gen Psychiatry. 2004;61(7):669–80.

    Article  PubMed  Google Scholar 

  42. Crismon ML, et al. The Texas medication algorithm project: report of the Texas consensus conference panel on medication treatment of major depressive disorder. J Clin Psychiatry. 1999;60(3):142–56.

    Article  CAS  PubMed  Google Scholar 

  43. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. Lowe B, et al. Responsiveness of the PHQ-9 to psychopharmacological depression treatment. Psychosomatics. 2006;47(1):62–7.

    Article  PubMed  Google Scholar 

  45. Plummer F, et al. Screening for anxiety disorders with the GAD-7 and GAD-2: a systematic review and diagnostic metaanalysis. Gen Hosp Psychiatry. 2016;39:24–31.

    Article  PubMed  Google Scholar 

  46. Spitzer RL, et al. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–7.

    Article  PubMed  Google Scholar 

  47. Lowe B, et al. Monitoring depression treatment outcomes with the patient health questionnaire-9. Med Care. 2004;42(12):1194–201.

    Article  PubMed  Google Scholar 

  48. Toussaint A, et al. Sensitivity to change and minimal clinically important difference of the 7-item generalized anxiety disorder questionnaire (GAD-7). J Affect Disord. 2020;265:395–401.

    Article  PubMed  Google Scholar 

  49. Rea LM, Parker RA. Designing and conducting survey research. San Francisco: Jossey-Boss; 1992.

    Google Scholar 

  50. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. New Jersey: Lawrence Erlbaum; 1988.

    Google Scholar 

  51. Malowney M, et al. Availability of outpatient care from psychiatrists: a simulated-patient study in three U.S. cities. Psychiatr Serv. 2015;66(1):94–6.

    Article  PubMed  Google Scholar 

  52. Ruskin PE, et al. Treatment outcomes in depression: comparison of remote treatment through telepsychiatry to in-person treatment. Am J Psychiatry. 2004;161(8):1471–6.

    Article  PubMed  Google Scholar 

  53. Electronic Health Reporter. How Much Does a Psychiatrist Cost? 2021 [cited 2022 February 20]; Available from: https://electronichealthreporter.com/how-much-does-a-psychiatrist-cost/#:~:text=While%20practices%20differ%2C%20patients%20canat%20least%2024100%20per%20hour .

    Google Scholar 

  54. Naslund JA, et al. Economic evaluation and costs of telepsychiatry programmes: a systematic review. J Telemed Telecare. 2020:1357633X20938919.

  55. Sanders GD, et al. Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analyses: second panel on cost-effectiveness in health and Medicine. JAMA. 2016;316(10):1093–103.

    Article  PubMed  Google Scholar 

  56. Sinyor M, Schaffer A, Levitt A. The sequenced treatment alternatives to relieve depression (STAR*D) trial: a review. Can J Psychiatr. 2010;55(3):126–35.

    Article  Google Scholar 

  57. Mendlewicz J. Towards achieving remission in the treatment of depression. Dialogues Clin Neurosci. 2008;10(4):371–5.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Hirschfeld RM, et al. Does psychosocial functioning improve independent of depressive symptoms? A comparison of nefazodone, psychotherapy, and their combination. Biol Psychiatry. 2002;51(2):123–33.

    Article  PubMed  Google Scholar 

  59. Rush AJ, et al. Report by the ACNP task force on response and remission in major depressive disorder. Neuropsychopharmacology. 2006;31(9):1841–53.

    Article  PubMed  Google Scholar 

  60. Hubley S, et al. Review of key telepsychiatry outcomes. World J Psychiatry. 2016;6(2):269–82.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Haxhihamza K, et al. Patient satisfaction with use of telemedicine in University Clinic of Psychiatry: Skopje, North Macedonia during COVID-19 pandemic. Telemed J E Health. 2021;27(4):464–7.

    Article  CAS  PubMed  Google Scholar 

  62. Guaiana G, et al. A systematic review of the use of Telepsychiatry in depression. Community Ment Health J. 2021;57(1):93–100.

    Article  PubMed  Google Scholar 

  63. Trivedi MH, et al. Evaluation of outcomes with citalopram for depression using measurement-based care in STAR*D: implications for clinical practice. Am J Psychiatry. 2006;163(1):28–40.

    Article  PubMed  Google Scholar 

  64. Iannuzzo RW, et al. Development and reliability of the HAM-D/MADRS interview: an integrated depression symptom rating scale. Psychiatry Res. 2006;145(1):21–37.

    Article  PubMed  Google Scholar 

  65. Gerbasi ME, et al. Associations between commonly used patient-reported outcome tools in postpartum depression clinical practice and the Hamilton rating scale for depression. Arch Womens Ment Health. 2020;23(5):727–35.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Funding for the current research study was provided by Brightside Health, Inc.

Author information

Authors and Affiliations

Authors

Contributions

MW conceived the study. HB and MW designed the study. MW and EOC supervised the data analysis, interpreted the data, and drafted the manuscript. SS and HB analyzed all data and created figures and Tables. CG contributed to the interpretation of data and was a major contributor in writing the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Carina Gupta.

Ethics declarations

Ethics approval and consent to participate

The WCG IRB (www.wcgirb.com), Ethics Committee Panel 1, approved the retrospective research analysis of clinical data obtained by Brightside as part of routine clinical care. All participants completed written consent documentation to participate in research. WCG IRB is registered with OHRP/FDA; the IRB registration number is IRB00000533, parent organization number is IORG0000432.

r WCG IRB’s OHRP/FDA IRB registration number (IRB00000533).

Consent for publication

Not applicable.

Competing interests

Dr. O’Callaghan, Dr. Belanger, Mr. Sullivan and Dr. Winsberg all hold stock in Brightside Health Inc. Dr. O’Callaghan, Mr. Sullivan, Ms. Gupta, Dr. Belanger, and Dr. Winsberg are all employees of Brightside Health, Inc. As such, the funding body took part in the design of the study and collection, analysis, and interpretation of data, and the writing of the manuscript. All participants in this study received psychiatric healthcare at Brightside Health Inc., a mental healthcare company. All authors of the submitted manuscript are employees of Brightside Health.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

O’Callaghan, E., Sullivan, S., Gupta, C. et al. Feasibility and acceptability of a novel telepsychiatry-delivered precision prescribing intervention for anxiety and depression. BMC Psychiatry 22, 483 (2022). https://doi.org/10.1186/s12888-022-04113-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-022-04113-9

Keywords